2023-12-05T08:49:13.520 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-05T08:49:13.521 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420 --owner mchangir --verbose --name mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420/orig.config.yaml 2023-12-05T08:49:13.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T08:49:13.675 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420 branch: wip-mchangir-testing-20231205.064351 description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: mchangir@redhat.com first_in_suite: false job_id: '7477420' kernel: flavor: default kdb: true sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-mchangir-testing-20231205.064351 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20231205.064351 sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 owner: mchangir priority: 1000 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9770 sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 sleep_before_teardown: 0 subset: 782/1024 suite: fs suite_branch: wip-mchangir-testing-20231205.064351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHS5jYZtkjceRfwHtaU358dFtA0mrMxKQT2N74/VgBaOxYtnZDjJnvcjAacIyr2mfVHUguQyetFGXXUbzfMPok= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAC7aCyhiG4JoyuAzxJcXfUai0Jgy4lYZHbdRum0UriSKq17r0+2aQsqL+Yadq9Bfab5OJ5FxbN1nQIu2RnnTX0= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-05_08:35:01 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-05T08:49:13.676 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa; will attempt to use it 2023-12-05T08:49:13.677 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks 2023-12-05T08:49:13.677 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-05T08:49:13.679 INFO:teuthology.task.internal:Checking packages... 2023-12-05T08:49:13.707 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227' 2023-12-05T08:49:13.707 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T08:49:13.708 INFO:teuthology.packaging:ref: None 2023-12-05T08:49:13.708 INFO:teuthology.packaging:tag: None 2023-12-05T08:49:13.708 INFO:teuthology.packaging:branch: wip-mchangir-testing-20231205.064351 2023-12-05T08:49:13.708 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T08:49:13.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-mchangir-testing-20231205.064351 2023-12-05T08:49:13.852 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-11.g3fe8d441 2023-12-05T08:49:13.852 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-05T08:49:13.858 INFO:teuthology.task.internal:no buildpackages task found 2023-12-05T08:49:13.858 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-05T08:49:13.873 INFO:teuthology.task.internal:Saving configuration 2023-12-05T08:49:13.896 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-05T08:49:13.902 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T08:49:13.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 08:36:37.496653', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHS5jYZtkjceRfwHtaU358dFtA0mrMxKQT2N74/VgBaOxYtnZDjJnvcjAacIyr2mfVHUguQyetFGXXUbzfMPok='} 2023-12-05T08:49:13.951 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 08:36:37.495001', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAC7aCyhiG4JoyuAzxJcXfUai0Jgy4lYZHbdRum0UriSKq17r0+2aQsqL+Yadq9Bfab5OJ5FxbN1nQIu2RnnTX0='} 2023-12-05T08:49:13.952 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-05T08:49:13.957 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-05T08:49:13.957 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-05T08:49:13.957 INFO:teuthology.run_tasks:Running task console_log... 2023-12-05T08:49:14.027 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd8f82d3a60>, signals=[15]) 2023-12-05T08:49:14.028 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-05T08:49:14.034 INFO:teuthology.task.internal:Opening connections... 2023-12-05T08:49:14.034 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T08:49:14.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:49:14.105 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2023-12-05T08:49:14.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:49:14.173 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-05T08:49:14.181 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-12-05T08:49:14.204 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-12-05T08:49:14.205 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8" 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8" 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-12-05T08:49:14.267 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T08:49:14.268 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2023-12-05T08:49:14.268 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T08:49:14.268 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T08:49:14.268 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T08:49:14.268 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-12-05T08:49:14.285 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-12-05T08:49:14.307 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-12-05T08:49:14.308 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-12-05T08:49:14.369 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-12-05T08:49:14.369 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2023-12-05T08:49:14.369 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-12-05T08:49:14.369 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-12-05T08:49:14.369 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2023-12-05T08:49:14.369 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-12-05T08:49:14.370 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-05T08:49:14.370 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-12-05T08:49:14.370 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-05T08:49:14.370 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-12-05T08:49:14.370 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T08:49:14.370 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-05T08:49:14.370 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T08:49:14.370 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-12-05T08:49:14.393 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-05T08:49:14.402 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-05T08:49:14.409 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-05T08:49:14.409 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2023-12-05T08:49:14.412 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2023-12-05T08:49:14.432 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-05T08:49:14.438 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-05T08:49:14.438 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2023-12-05T08:49:14.475 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2023-12-05T08:49:14.511 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-05T08:49:14.569 INFO:teuthology.run_tasks:Running task kernel... 2023-12-05T08:49:14.584 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'} 2023-12-05T08:49:14.585 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'}}, timeout 300 2023-12-05T08:49:14.585 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-05T08:49:14.586 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-05T08:49:14.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T08:49:14.605 DEBUG:teuthology.task.kernel:sha1 for host.b is 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T08:49:14.605 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "9471594ae3a4c6992c4327df9a789df8f2b6aeae"... 2023-12-05T08:49:14.606 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-12-05T08:49:14.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T08:49:14.608 DEBUG:teuthology.task.kernel:sha1 for host.a is 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T08:49:14.608 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "9471594ae3a4c6992c4327df9a789df8f2b6aeae"... 2023-12-05T08:49:14.609 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-12-05T08:49:14.664 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-489.el8.x86_64 2023-12-05T08:49:14.665 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T08:49:14.665 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-05T08:49:14.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T08:49:14.670 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-489.el8.x86_64 2023-12-05T08:49:14.670 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T08:49:14.670 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-05T08:49:14.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T08:49:15.055 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum upgrade -y linux-firmware 2023-12-05T08:49:15.063 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum upgrade -y linux-firmware 2023-12-05T08:49:21.634 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - AppStream 8.5 MB/s | 34 MB 00:04 2023-12-05T08:49:23.243 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - AppStream 6.1 MB/s | 34 MB 00:05 2023-12-05T08:49:44.009 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - BaseOS 3.5 MB/s | 55 MB 00:15 2023-12-05T08:49:52.850 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2023-12-05T08:49:53.471 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2023-12-05T08:49:53.902 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-12-05T08:49:55.370 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-12-05T08:49:57.707 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - BaseOS 1.9 MB/s | 55 MB 00:28 2023-12-05T08:49:59.411 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 424 kB/s | 24 kB 00:00 2023-12-05T08:50:03.892 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 1 Package 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 286 M 2023-12-05T08:50:03.893 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T08:50:06.423 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras 21 kB/s | 18 kB 00:00 2023-12-05T08:50:07.123 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2023-12-05T08:50:07.550 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-12-05T08:50:09.050 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-12-05T08:50:12.934 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 314 kB/s | 24 kB 00:00 2023-12-05T08:50:16.888 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T08:50:16.888 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T08:50:16.888 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-05T08:50:16.888 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T08:50:16.888 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2023-12-05T08:50:16.888 INFO:teuthology.orchestra.run.smithi134.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-12-05T08:50:16.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T08:50:16.889 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T08:50:16.889 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T08:50:16.889 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 1 Package 2023-12-05T08:50:16.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T08:50:16.889 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 286 M 2023-12-05T08:50:16.889 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T08:53:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 1.6 MB/s | 286 MB 03:02 2023-12-05T08:53:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T08:53:21.570 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.5 MB/s | 286 MB 03:04 2023-12-05T08:53:23.273 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T08:53:23.346 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T08:53:23.347 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T08:53:25.120 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T08:53:25.150 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T08:53:36.969 INFO:teuthology.orchestra.run.smithi067.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 1.4 MB/s | 286 MB 03:31 2023-12-05T08:53:36.969 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T08:53:36.969 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.3 MB/s | 286 MB 03:33 2023-12-05T08:53:38.752 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T08:53:38.916 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T08:53:38.916 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T08:53:40.779 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T08:53:40.927 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T08:53:43.870 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T08:53:44.244 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-12-05T08:53:44.457 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T08:53:44.687 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T08:53:44.687 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-12-05T08:53:45.569 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T08:53:45.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T08:53:45.569 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2023-12-05T08:53:45.569 INFO:teuthology.orchestra.run.smithi134.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-12-05T08:53:45.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T08:53:45.569 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T08:53:45.740 INFO:teuthology.task.kernel:Downloading kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on host.b... 2023-12-05T08:53:45.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T08:53:45.994 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/ 2023-12-05T08:53:45.995 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g9471594ae3a4-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-05T08:53:45.997 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi134.front.sepia.ceph.com to complete... 2023-12-05T08:54:01.200 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T08:54:01.589 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-12-05T08:54:01.834 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T08:54:02.068 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T08:54:02.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-12-05T08:54:02.942 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-12-05T08:54:02.942 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T08:54:02.943 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2023-12-05T08:54:02.943 INFO:teuthology.orchestra.run.smithi067.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-12-05T08:54:02.943 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T08:54:02.943 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T08:54:03.142 INFO:teuthology.task.kernel:Downloading kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on host.a... 2023-12-05T08:54:03.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9471594ae3a4c6992c4327df9a789df8f2b6aeae 2023-12-05T08:54:03.424 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/ 2023-12-05T08:54:03.425 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g9471594ae3a4-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-05T08:54:03.427 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi067.front.sepia.ceph.com to complete... 2023-12-05T08:54:52.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05 08:54:52 URL:https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/kernel-6.6.0_g9471594ae3a4-1.x86_64.rpm [383178600/383178600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-05T08:54:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:FINISHED --2023-12-05 08:54:52-- 2023-12-05T08:54:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:Total wall clock time: 49s 2023-12-05T08:54:52.270 INFO:teuthology.orchestra.run.smithi067.stderr:Downloaded: 1 files, 365M in 48s (7.55 MB/s) 2023-12-05T08:54:52.271 INFO:teuthology.task.kernel:Installing kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on host.a... 2023-12-05T08:54:52.271 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-05T08:54:54.027 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying... ######################################## 2023-12-05T08:54:54.073 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing... ######################################## 2023-12-05T08:54:54.188 INFO:teuthology.orchestra.run.smithi067.stdout:Updating / installing... 2023-12-05T08:55:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05 08:55:23 URL:https://2.chacra.ceph.com/r/kernel/testing/9471594ae3a4c6992c4327df9a789df8f2b6aeae/centos/8/flavors/default/x86_64/kernel-6.6.0_g9471594ae3a4-1.x86_64.rpm [383178600/383178600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-05T08:55:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:FINISHED --2023-12-05 08:55:23-- 2023-12-05T08:55:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:Total wall clock time: 1m 37s 2023-12-05T08:55:23.145 INFO:teuthology.orchestra.run.smithi134.stderr:Downloaded: 1 files, 365M in 1m 36s (3.79 MB/s) 2023-12-05T08:55:23.158 INFO:teuthology.task.kernel:Installing kernel 9471594ae3a4c6992c4327df9a789df8f2b6aeae on host.b... 2023-12-05T08:55:23.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-05T08:55:24.968 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying... ######################################## 2023-12-05T08:55:25.013 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing... ######################################## 2023-12-05T08:55:25.120 INFO:teuthology.orchestra.run.smithi134.stdout:Updating / installing... 2023-12-05T08:55:34.953 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-6.6.0_g9471594ae3a4-1 ######################################## 2023-12-05T08:55:37.482 INFO:teuthology.orchestra.run.smithi067.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-05T08:55:57.453 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-05T08:55:57.453 DEBUG:teuthology.orchestra.run.smithi067:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/boot/System.map-6.6.0-g9471594ae3a4 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/boot/config-6.6.0-g9471594ae3a4 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-05T08:55:57.483 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-05T08:55:57.484 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ansi_cprng.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/anubis.ko 2023-12-05T08:55:57.485 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/arc4.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_memcpy.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_pq.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_tx.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_xor.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/raid6test.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authenc.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authencesn.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blake2b_generic.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_common.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_generic.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/camellia_generic.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast5_generic.ko 2023-12-05T08:55:57.486 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast6_generic.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast_common.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ccm.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cmac.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crc32_generic.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_engine.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_user.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cts.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/des_generic.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/dh_generic.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/echainiv.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/essiv.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/fcrypt.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/khazad.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4.ko 2023-12-05T08:55:57.487 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4hc.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/md4.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/michael_mic.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcbc.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcrypt.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/rmd160.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/seed.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/serpent_generic.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tcrypt.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tea.ko 2023-12-05T08:55:57.488 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_common.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_generic.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/vmac.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/wp512.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xcbc.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xor.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xxhash_generic.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_pad.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/custom_method.ko 2023-12-05T08:55:57.489 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/ec_sys.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/platform_profile.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbs.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbshc.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/video.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/acard-ahci.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ahci_platform.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ata_generic.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/libahci_platform.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_acpi.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ali.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_amd.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_artop.ko 2023-12-05T08:55:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atiixp.ko 2023-12-05T08:55:57.516 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atp867x.ko 2023-12-05T08:55:57.516 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd640.ko 2023-12-05T08:55:57.516 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd64x.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cypress.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_efar.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt366.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt37x.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it8213.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it821x.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_jmicron.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_marvell.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_mpiix.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_netcell.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ninja32.ko 2023-12-05T08:55:57.517 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87410.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87415.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_oldpiix.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_opti.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_optidma.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pcmcia.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_piccolo.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_rdc.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sch.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_serverworks.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sil680.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sis.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sl82c105.ko 2023-12-05T08:55:57.518 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_triflex.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_via.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pdc_adma.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_inic162x.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_mv.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_nv.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_promise.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_qstor.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil24.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sis.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_svw.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sx4.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_uli.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_via.ko 2023-12-05T08:55:57.519 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_vsc.ko 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay/ks0108.ko 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma/bcma.ko 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe/aoe.ko 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/brd.ko 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd/drbd.ko 2023-12-05T08:55:57.520 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/floppy.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/loop.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/nbd.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk/null_blk.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/pktcdvd.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/rbd.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/virtio_blk.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkfront.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram/zram.ko 2023-12-05T08:55:57.521 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hangcheck-timer.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/via-rng.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-05T08:55:57.522 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/lp.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave/mwave.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ppdev.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tlclk.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/uv_mmtimer.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/virtio_console.ko 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq 2023-12-05T08:55:57.523 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-05T08:55:57.524 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-aes.ko 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-sha.ko 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca/dca.ko 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/devfreq 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-05T08:55:57.525 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/amd64_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/e752x_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/edac_mce_amd.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3000_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3200_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5100_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5400_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7300_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7core_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i82975x_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/ie31200_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/sb_edac.ko 2023-12-05T08:55:57.526 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/x38_edac.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/edd.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-ich.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-appleir.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-aureal.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-axff.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-dr.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elecom.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elo.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-emsff.ko 2023-12-05T08:55:57.527 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gaff.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gt683r.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gyration.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtekff.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-hyperv.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-icade.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-keytouch.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-kye.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lcpower.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-led.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lenovo.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-05T08:55:57.528 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-multitouch.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ortek.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-penmount.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-petalynx.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-picolcd.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-pl.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-plantronics.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-primax.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-rmi.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-common.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-05T08:55:57.529 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-saitek.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-samsung.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sjoy.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sony.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-speedlink.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-steelseries.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sunplus.ko 2023-12-05T08:55:57.530 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tivo.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tmff.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-topseed.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-twinhan.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-uclogic.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-waltop.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-wiimote.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-xinmo.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zpff.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zydacron.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/uhid.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/wacom.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_balloon.ko 2023-12-05T08:55:57.531 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_utils.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_vmbus.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru3.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7414.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7418.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adc128d818.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1025.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1026.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1029.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1031.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm9240.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ads7828.ko 2023-12-05T08:55:57.532 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7410.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7411.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7462.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7470.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7475.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7x10.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/amc6821.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/applesmc.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asb100.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asc7621.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/atxp1.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/coretemp.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-05T08:55:57.533 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dme1737.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds1621.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds620.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc1403.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc6w201.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71805f.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71882fg.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f75375s.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fam15h_power.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fschmd.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g760a.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g762.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl518sm.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl520sm.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-05T08:55:57.534 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5500_temp.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5k_amb.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmaem.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmpex.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina209.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina2xx.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/it87.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k10temp.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k8temp.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lineage-pem.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm63.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm73.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm75.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm77.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm78.ko 2023-12-05T08:55:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm80.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm83.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm85.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm87.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm90.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm92.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm93.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95234.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95241.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95245.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc2945.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4151.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4215.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4222.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4245.ko 2023-12-05T08:55:57.536 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4260.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4261.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max16065.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1619.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1668.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max197.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6639.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6650.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6697.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/mcp3021.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6683.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775-core.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct7802.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87360.ko 2023-12-05T08:55:57.537 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87427.ko 2023-12-05T08:55:57.538 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pcf8591.ko 2023-12-05T08:55:57.538 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus 2023-12-05T08:55:57.538 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-05T08:55:57.538 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-05T08:55:57.542 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-05T08:55:57.542 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-05T08:55:57.542 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-05T08:55:57.542 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-05T08:55:57.542 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-05T08:55:57.542 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-05T08:55:57.542 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-05T08:55:57.542 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/powr1220.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5627.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5636.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht15.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht21.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/shtc1.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sis5595.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47b397.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m1.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m192.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/thmc50.ko 2023-12-05T08:55:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp102.ko 2023-12-05T08:55:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp103.ko 2023-12-05T08:55:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp401.ko 2023-12-05T08:55:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp421.ko 2023-12-05T08:55:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via-cputemp.ko 2023-12-05T08:55:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via686a.ko 2023-12-05T08:55:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt1211.ko 2023-12-05T08:55:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt8231.ko 2023-12-05T08:55:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627ehf.ko 2023-12-05T08:55:57.545 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627hf.ko 2023-12-05T08:55:57.545 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83781d.ko 2023-12-05T08:55:57.545 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83791d.ko 2023-12-05T08:55:57.546 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83792d.ko 2023-12-05T08:55:57.546 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83793.ko 2023-12-05T08:55:57.546 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83795.ko 2023-12-05T08:55:57.546 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l785ts.ko 2023-12-05T08:55:57.546 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l786ng.ko 2023-12-05T08:55:57.546 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c 2023-12-05T08:55:57.546 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-05T08:55:57.547 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-05T08:55:57.548 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-05T08:55:57.549 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-dev.ko 2023-12-05T08:55:57.549 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-mux.ko 2023-12-05T08:55:57.549 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-05T08:55:57.549 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-smbus.ko 2023-12-05T08:55:57.549 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-stub.ko 2023-12-05T08:55:57.549 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband 2023-12-05T08:55:57.549 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_core.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5 2023-12-05T08:55:57.550 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-05T08:55:57.551 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/gameport.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/joydev.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/appletouch.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/bcm5974.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/cyapatp.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/sermouse.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-05T08:55:57.552 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/altera_ps2.ko 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/arc_ps2.ko 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/serio_raw.ko 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/sparse-keymap.ko 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu 2023-12-05T08:55:57.553 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd 2023-12-05T08:55:57.554 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-05T08:55:57.554 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds 2023-12-05T08:55:57.554 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-blinkm.ko 2023-12-05T08:55:57.554 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3530.ko 2023-12-05T08:55:57.554 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lp3944.ko 2023-12-05T08:55:57.554 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-ss4200.ko 2023-12-05T08:55:57.554 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger 2023-12-05T08:55:57.555 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-05T08:55:57.555 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-05T08:55:57.555 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-05T08:55:57.555 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-05T08:55:57.555 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-05T08:55:57.555 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-05T08:55:57.555 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache/bcache.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-bio-prison.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache-smq.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-crypt.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-delay.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-flakey.ko 2023-12-05T08:55:57.556 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-log-userspace.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-multipath.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-queue-length.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-raid.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-round-robin.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-service-time.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-switch.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-thin-pool.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-verity.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/faulty.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/linear.ko 2023-12-05T08:55:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/multipath.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid0.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid1.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid10.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid456.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptbase.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptctl.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptfc.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptlan.ko 2023-12-05T08:55:57.558 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptsas.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptscsih.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptspi.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_ich.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_sch.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/mfd-core.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/sm501.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/viperboard.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/vx855.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/wl1273-core.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds9802als.ko 2023-12-05T08:55:57.559 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds990x.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/bh1770glc.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710/cb710.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/at24.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/max6875.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/enclosure.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/hpilo.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29003.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29020.ko 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d 2023-12-05T08:55:57.560 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-me.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-txe.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-gru 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_7xx1.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_core.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tsl2550.ko 2023-12-05T08:55:57.561 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_balloon.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding/bonding.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dummy.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/eql.ko 2023-12-05T08:55:57.562 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon 2023-12-05T08:55:57.563 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-05T08:55:57.564 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade 2023-12-05T08:55:57.565 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-05T08:55:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip 2023-12-05T08:55:57.567 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dnet.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ethoc.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fealnx.ko 2023-12-05T08:55:57.568 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf 2023-12-05T08:55:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/jme.ko 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-05T08:55:57.570 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion 2023-12-05T08:55:57.571 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-05T08:55:57.572 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rocker 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-05T08:55:57.573 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti 2023-12-05T08:55:57.574 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/geneve.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ifb.ko 2023-12-05T08:55:57.575 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan 2023-12-05T08:55:57.576 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-05T08:55:57.576 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvlan.ko 2023-12-05T08:55:57.576 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvtap.ko 2023-12-05T08:55:57.576 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio 2023-12-05T08:55:57.576 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio.ko 2023-12-05T08:55:57.576 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-05T08:55:57.576 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-05T08:55:57.576 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mii.ko 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/net_failover.ko 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/netconsole.ko 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/nlmon.ko 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/amd.ko 2023-12-05T08:55:57.577 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm87xx.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/broadcom.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/cicada.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/davicom.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/dp83640.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/et1011c.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/icplus.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/lxt.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/marvell.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/micrel.ko 2023-12-05T08:55:57.578 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/national.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/phylink.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/qsemi.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/realtek.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/smsc.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/ste10Xp.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/vitesse.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_async.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppoe.ko 2023-12-05T08:55:57.579 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppox.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pptp.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slhc.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slip.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/sungem_phy.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tap.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_random.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tun.ko 2023-12-05T08:55:57.580 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/veth.ko 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/virtio_net.ko 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan/vxlan.ko 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netfront.ko 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb/ntb.ko 2023-12-05T08:55:57.581 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme-core.ko 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme.ko 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport.ko 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_cs.ko 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_pc.ko 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_serial.ko 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pcie 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-05T08:55:57.582 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/xen-pcifront.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/i82092.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pd6729.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acerhdf.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-05T08:55:57.583 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/hdaps.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel_ips.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-05T08:55:57.584 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps_parport.ko 2023-12-05T08:55:57.585 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/pps_core.ko 2023-12-05T08:55:57.586 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp 2023-12-05T08:55:57.586 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp.ko 2023-12-05T08:55:57.586 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp_kvm.ko 2023-12-05T08:55:57.586 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-05T08:55:57.587 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-em3027.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max6900.ko 2023-12-05T08:55:57.588 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-x1205.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-9xxx.ko 2023-12-05T08:55:57.589 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-sas.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-xxxx.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/BusLogic.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/a100u2w.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/advansys.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/am53c974.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/atp870u.ko 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi 2023-12-05T08:55:57.590 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa/bfa.ko 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ch.ko 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-05T08:55:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dc395x.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dmx3191d.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-05T08:55:57.592 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esp_scsi.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic/fnic.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hpsa.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hptiop.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hv_storvsc.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/initio.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ipr.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ips.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci/isci.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-05T08:55:57.593 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc/libfc.ko 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi.ko 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas/libsas.ko 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid.ko 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-05T08:55:57.594 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvumi.ko 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pmcraid.ko 2023-12-05T08:55:57.595 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla1280.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/raid_class.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_debug.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ses.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/st.ko 2023-12-05T08:55:57.596 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/stex.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/virtio_scsi.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/wd719x.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb/ssb.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_file.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_iblock.ko 2023-12-05T08:55:57.597 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_mod.ko 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_pscsi.ko 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_user.ko 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-05T08:55:57.598 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-05T08:55:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_gsm.ko 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_hdlc.ko 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/nozomi.ko 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/arc_uart.ko 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host 2023-12-05T08:55:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_aec.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_cif.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_pci_generic.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_sercos3.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-acm.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usblp.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usbtmc.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-05T08:55:57.601 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/mdc800.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/microtek.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/adutux.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/appledisplay.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi26.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi62.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ezusb.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/idmouse.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/iowarrior.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ldusb.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/legousbtower.ko 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga 2023-12-05T08:55:57.602 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usb3503.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usblcd.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/uss720.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/yurex.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-generic.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/aircable.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ark3116.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ch341.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cp210x.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cyberjack.ko 2023-12-05T08:55:57.603 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/empeg.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_ti.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipaq.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipw.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ir-usb.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-05T08:55:57.604 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mct_u232.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7720.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7840.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/navman.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/omninet.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/opticon.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/option.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/oti6858.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/pl2303.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcaux.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcserial.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/quatech2.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/safe_serial.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/sierra.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ssu100.ko 2023-12-05T08:55:57.605 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/symbolserial.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_debug.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/visor.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/whiteheat.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/uas.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-05T08:55:57.606 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-karma.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/usb-storage.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci 2023-12-05T08:55:57.607 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio.ko 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost.ko 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_net.ko 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_scsi.ko 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video 2023-12-05T08:55:57.608 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/apple_bl.ko 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lcd.ko 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio.ko 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_balloon.ko 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_mmio.ko 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci.ko 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-05T08:55:57.609 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_ring.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2482.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2490.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-05T08:55:57.610 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/wire.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/hpwdt.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/i6300esb.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ib700wdt.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ibmasr.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-05T08:55:57.611 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it87_wdt.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/machzwd.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/nv_tco.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/softdog.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/via_wdt.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wdt_pci.ko 2023-12-05T08:55:57.612 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/xen_wdt.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-evtchn.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntalloc.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntdev.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-privcmd.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p/9p.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs/affs.ko 2023-12-05T08:55:57.613 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs/befs.ko 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/binfmt_misc.ko 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs/btrfs.ko 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles/cachefiles.ko 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph/ceph.ko 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda/coda.ko 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs/cramfs.ko 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm/dlm.ko 2023-12-05T08:55:57.614 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ecryptfs 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs/f2fs.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/fat.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/msdos.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/vfat.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache/fscache.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/cuse.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/fuse.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2/gfs2.ko 2023-12-05T08:55:57.615 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs/hfs.ko 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus/hfsplus.ko 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs/isofs.ko 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs/jfs.ko 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd/lockd.ko 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix/minix.ko 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs/netfs.ko 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout 2023-12-05T08:55:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfs.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv3.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv4.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/grace.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/nfs_acl.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd/nfsd.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2/nilfs2.ko 2023-12-05T08:55:57.617 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-celtic.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-centeuro.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-croatian.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-cyrillic.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-gaelic.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-greek.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-iceland.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-inuit.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-roman.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-romanian.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-turkish.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1250.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1251.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1255.ko 2023-12-05T08:55:57.618 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp737.ko 2023-12-05T08:55:57.619 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp775.ko 2023-12-05T08:55:57.619 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp850.ko 2023-12-05T08:55:57.619 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp852.ko 2023-12-05T08:55:57.619 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp855.ko 2023-12-05T08:55:57.619 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp857.ko 2023-12-05T08:55:57.619 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp860.ko 2023-12-05T08:55:57.619 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp861.ko 2023-12-05T08:55:57.619 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp862.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp863.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp864.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp865.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp866.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp869.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp874.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp932.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp936.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp949.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp950.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_euc-jp.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-1.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-13.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-14.ko 2023-12-05T08:55:57.620 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-15.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-2.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-3.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-4.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-5.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-6.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-7.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-9.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-r.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-ru.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-u.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_utf8.ko 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster 2023-12-05T08:55:57.621 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs/overlay.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore/ramoops.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs/reiserfs.ko 2023-12-05T08:55:57.622 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs/romfs.ko 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client/cifs.ko 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_arc4.ko 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_md4.ko 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs/squashfs.ko 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv/sysv.ko 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf/udf.ko 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs 2023-12-05T08:55:57.623 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs/ufs.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs/xfs.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/rcu 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/rcu/rcutorture.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/torture.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/trace 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/asn1_encoder.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc-itu-t.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc8.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libarc4.ko 2023-12-05T08:55:57.624 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libdes.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/libcrc32c.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lru_cache.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4_compress.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4hc_compress.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math/cordic.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6/raid6_pq.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_bm.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_fsm.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_kmp.ko 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/zstd 2023-12-05T08:55:57.625 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/zstd/zstd_compress.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/mm 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/mm/hwpoison-inject.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/6lowpan.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_dest.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_fragment.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_hop.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_mobility.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_routing.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_udp.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/garp.ko 2023-12-05T08:55:57.626 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/mrp.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/p8022.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/psnap.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/stp.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q/8021q.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_fd.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_rdma.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_virtio.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv/batman-adv.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/br_netfilter.ko 2023-12-05T08:55:57.627 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/bridge.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-05T08:55:57.628 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtables.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-05T08:55:57.629 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph/libceph.ko 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/failover.ko 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/pktgen.ko 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp.ko 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_diag.ko 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv4.ko 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv6.ko 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dns_resolver 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dns_resolver/dns_resolver.ko 2023-12-05T08:55:57.630 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/dsa_core.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_brcm.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_dsa.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_none.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_trailer.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ah4.ko 2023-12-05T08:55:57.631 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/esp4.ko 2023-12-05T08:55:57.641 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/fou.ko 2023-12-05T08:55:57.641 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/gre.ko 2023-12-05T08:55:57.641 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/inet_diag.ko 2023-12-05T08:55:57.641 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_gre.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_tunnel.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_vti.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipcomp.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipip.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-05T08:55:57.642 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_bic.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_dctcp.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_diag.ko 2023-12-05T08:55:57.643 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_highspeed.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_htcp.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_hybla.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_illinois.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_lp.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_scalable.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_vegas.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_veno.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_westwood.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_yeah.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tunnel4.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_diag.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_tunnel.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6 2023-12-05T08:55:57.644 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ah6.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/esp6.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/fou6.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_tunnel.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_vti.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ipcomp6.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-05T08:55:57.645 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-05T08:55:57.646 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/sit.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/tunnel6.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/key 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/key/af_key.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_core.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_eth.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip6.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_netlink.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ppp.ko 2023-12-05T08:55:57.647 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/llc.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154/mac802154.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls/mpls_gso.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-05T08:55:57.648 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-05T08:55:57.649 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-05T08:55:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-05T08:55:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-05T08:55:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-05T08:55:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-05T08:55:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-05T08:55:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-05T08:55:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-05T08:55:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conncount.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-05T08:55:57.651 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_log_syslog.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_irc.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_sip.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_tables.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_log.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-05T08:55:57.652 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_chain_nat.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_compat.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_ct.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fib.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_hash.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_limit.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_log.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_masq.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_nat.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_numgen.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_queue.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_quota.ko 2023-12-05T08:55:57.653 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_redir.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject_inet.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_socket.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_tunnel.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_AUDIT.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CT.ko 2023-12-05T08:55:57.654 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_DSCP.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HL.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HMARK.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LED.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LOG.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NETMAP.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFLOG.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_RATEEST.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_SECMARK.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-05T08:55:57.655 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TEE.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TPROXY.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TRACE.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_addrtype.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_bpf.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cgroup.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cluster.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_comment.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connbytes.ko 2023-12-05T08:55:57.656 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlabel.ko 2023-12-05T08:55:57.657 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlimit.ko 2023-12-05T08:55:57.657 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connmark.ko 2023-12-05T08:55:57.657 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_conntrack.ko 2023-12-05T08:55:57.657 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cpu.ko 2023-12-05T08:55:57.657 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dccp.ko 2023-12-05T08:55:57.657 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_devgroup.ko 2023-12-05T08:55:57.657 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dscp.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ecn.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_esp.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hashlimit.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_helper.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hl.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipcomp.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_iprange.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipvs.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_l2tp.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_length.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_limit.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mac.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mark.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_multiport.ko 2023-12-05T08:55:57.658 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nat.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nfacct.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_osf.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_owner.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_physdev.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_pkttype.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_policy.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_quota.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_rateest.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_realm.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_recent.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_sctp.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_set.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_socket.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_state.ko 2023-12-05T08:55:57.659 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_statistic.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_string.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_tcpmss.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_time.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_u32.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink/netlink_diag.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh/nsh.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/openvswitch.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-geneve.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-gre.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-vxlan.ko 2023-12-05T08:55:57.660 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet/af_packet_diag.ko 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds.ko 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_rdma.ko 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_tcp.ko 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_csum.ko 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_gact.ko 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_ipt.ko 2023-12-05T08:55:57.661 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_mirred.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_nat.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_pedit.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_police.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_simple.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_skbedit.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_vlan.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_basic.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_bpf.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_flow.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_fw.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_route.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_u32.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_cmp.ko 2023-12-05T08:55:57.662 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_ipset.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_meta.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_nbyte.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_text.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_u32.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_choke.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_codel.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_drr.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_fq.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_gred.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hfsc.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hhf.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_htb.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_ingress.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio.ko 2023-12-05T08:55:57.663 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio_lib.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_multiq.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_netem.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_pie.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_plug.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_prio.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_qfq.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_red.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfb.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfq.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_tbf.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_teql.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp_diag.ko 2023-12-05T08:55:57.664 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/sunrpc.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/diag.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/tipc.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix/unix_diag.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock.ko 2023-12-05T08:55:57.665 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/encrypted-keys 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/trusted-keys 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/trusted-keys/trusted.ko 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib/irqbypass.ko 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.alias 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.alias.bin 2023-12-05T08:55:57.666 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin.bin 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin.modinfo 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.dep 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.dep.bin 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.devname 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.order 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.softdep 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.symbols 2023-12-05T08:55:57.667 INFO:teuthology.orchestra.run.smithi067.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.symbols.bin 2023-12-05T08:55:57.668 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g9471594ae3a4 2023-12-05T08:55:57.668 DEBUG:teuthology.orchestra.run.smithi067:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-05T08:55:57.710 INFO:teuthology.orchestra.run.smithi067.stdout:postinstall scriptlet (using /bin/sh): 2023-12-05T08:55:57.710 INFO:teuthology.orchestra.run.smithi067.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g9471594ae3a4 -a -r /boot/System.map-6.6.0-g9471594ae3a4 ]; then 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:cp /boot/vmlinuz-6.6.0-g9471594ae3a4 /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:cp /boot/System.map-6.6.0-g9471594ae3a4 /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:rm -f /boot/vmlinuz-6.6.0-g9471594ae3a4 /boot/System.map-6.6.0-g9471594ae3a4 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/installkernel 6.6.0-g9471594ae3a4 /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:rm -f /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:fi 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:new-kernel-pkg --remove 6.6.0-g9471594ae3a4 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g9471594ae3a4.img 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-install remove 6.6.0-g9471594ae3a4 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:fi 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-05T08:55:57.711 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/update-bootloader --remove 6.6.0-g9471594ae3a4 2023-12-05T08:55:57.712 INFO:teuthology.orchestra.run.smithi067.stdout:fi 2023-12-05T08:55:57.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -qi grub2-tools 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Name : grub2-tools 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Epoch : 1 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Version : 2.02 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Release : 129.el8 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: x86_64 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Group : System Environment/Base 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Size : 9265586 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:License : GPLv3+ 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-05T08:55:57.792 INFO:teuthology.orchestra.run.smithi067.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:Relocations : (not relocatable) 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:Packager : CentOS BuildSystem 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:Vendor : CentOS 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:Summary : Support tools for GRUB. 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:Description : 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:hardware devices. 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T08:55:57.793 INFO:teuthology.orchestra.run.smithi067.stdout:This subpackage provides tools for support of all platforms. 2023-12-05T08:55:57.794 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-05T08:55:57.794 INFO:teuthology.task.kernel:Updating grub on smithi067 to boot 6.6.0-g9471594ae3a4 2023-12-05T08:55:57.795 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-05T08:56:03.417 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-6.6.0_g9471594ae3a4-1 ######################################## 2023-12-05T08:56:03.418 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2023-12-05T08:56:04.724 INFO:teuthology.orchestra.run.smithi134.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-05T08:56:05.944 INFO:teuthology.orchestra.run.smithi067.stderr:done 2023-12-05T08:56:05.946 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-12-05T08:56:06.017 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.qCuXP7DFT8 2023-12-05T08:56:06.017 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qCuXP7DFT8 2023-12-05T08:56:06.089 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.qCuXP7DFT8 2023-12-05T08:56:06.284 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.qCuXP7DFT8 is 6KB 2023-12-05T08:56:06.332 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.qCuXP7DFT8 2023-12-05T08:56:06.353 DEBUG:teuthology.orchestra.run.smithi067:> sudo /bin/ls /boot/loader/entries || true 2023-12-05T08:56:06.423 INFO:teuthology.orchestra.run.smithi067.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-05T08:56:06.423 INFO:teuthology.orchestra.run.smithi067.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-05T08:56:06.423 INFO:teuthology.orchestra.run.smithi067.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-05T08:56:06.423 INFO:teuthology.orchestra.run.smithi067.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-g9471594ae3a4.conf 2023-12-05T08:56:06.424 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-g9471594ae3a4 2023-12-05T08:56:06.593 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2023-12-05T08:56:28.499 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-05T08:56:28.499 DEBUG:teuthology.orchestra.run.smithi134:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-05T08:56:28.532 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/System.map-6.6.0-g9471594ae3a4 2023-12-05T08:56:28.532 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/config-6.6.0-g9471594ae3a4 2023-12-05T08:56:28.532 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/vmlinuz-6.6.0-g9471594ae3a4 2023-12-05T08:56:28.532 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-05T08:56:28.533 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-05T08:56:28.534 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-05T08:56:28.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-05T08:56:28.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel 2023-12-05T08:56:28.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu 2023-12-05T08:56:28.535 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce 2023-12-05T08:56:28.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-05T08:56:28.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm 2023-12-05T08:56:28.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-05T08:56:28.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-05T08:56:28.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/arch/x86/kvm/kvm.ko 2023-12-05T08:56:28.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto 2023-12-05T08:56:28.538 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ansi_cprng.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/anubis.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/arc4.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_memcpy.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_pq.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_tx.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/async_xor.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/async_tx/raid6test.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authenc.ko 2023-12-05T08:56:28.539 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/authencesn.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blake2b_generic.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_common.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/blowfish_generic.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/camellia_generic.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast5_generic.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast6_generic.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cast_common.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/ccm.ko 2023-12-05T08:56:28.540 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cmac.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crc32_generic.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_engine.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/crypto_user.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/cts.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/des_generic.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/dh_generic.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/echainiv.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/essiv.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/fcrypt.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/khazad.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/lz4hc.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/md4.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/michael_mic.ko 2023-12-05T08:56:28.541 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcbc.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/pcrypt.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/rmd160.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/seed.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/serpent_generic.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tcrypt.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/tea.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_common.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/twofish_generic.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/vmac.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/wp512.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xcbc.ko 2023-12-05T08:56:28.542 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xor.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/crypto/xxhash_generic.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/acpi_pad.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/custom_method.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/ec_sys.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/platform_profile.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbs.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/sbshc.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/acpi/video.ko 2023-12-05T08:56:28.543 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/acard-ahci.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ahci_platform.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/ata_generic.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/libahci_platform.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_acpi.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ali.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_amd.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_artop.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atiixp.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_atp867x.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd640.ko 2023-12-05T08:56:28.544 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cmd64x.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_cypress.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_efar.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt366.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt37x.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it8213.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_it821x.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_jmicron.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_marvell.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_mpiix.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_netcell.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ninja32.ko 2023-12-05T08:56:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87410.ko 2023-12-05T08:56:28.546 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_ns87415.ko 2023-12-05T08:56:28.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_oldpiix.ko 2023-12-05T08:56:28.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_opti.ko 2023-12-05T08:56:28.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_optidma.ko 2023-12-05T08:56:28.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pcmcia.ko 2023-12-05T08:56:28.547 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-05T08:56:28.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-05T08:56:28.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_piccolo.ko 2023-12-05T08:56:28.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_rdc.ko 2023-12-05T08:56:28.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sch.ko 2023-12-05T08:56:28.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_serverworks.ko 2023-12-05T08:56:28.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sil680.ko 2023-12-05T08:56:28.549 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sis.ko 2023-12-05T08:56:28.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_sl82c105.ko 2023-12-05T08:56:28.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_triflex.ko 2023-12-05T08:56:28.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pata_via.ko 2023-12-05T08:56:28.550 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/pdc_adma.ko 2023-12-05T08:56:28.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_inic162x.ko 2023-12-05T08:56:28.588 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_mv.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_nv.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_promise.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_qstor.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sil24.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sis.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_svw.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_sx4.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_uli.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_via.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ata/sata_vsc.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/auxdisplay/ks0108.ko 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base 2023-12-05T08:56:28.589 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/bcma/bcma.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/aoe/aoe.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/brd.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/drbd/drbd.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/floppy.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/loop.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-05T08:56:28.590 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/nbd.ko 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/null_blk/null_blk.ko 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/pktcdvd.ko 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/rbd.ko 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/virtio_blk.ko 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/xen-blkfront.ko 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/block/zram/zram.ko 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char 2023-12-05T08:56:28.591 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hangcheck-timer.ko 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/via-rng.ko 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-05T08:56:28.592 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/lp.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/mwave/mwave.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/ppdev.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tlclk.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-05T08:56:28.593 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/uv_mmtimer.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/char/virtio_console.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/ccp/ccp.ko 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel 2023-12-05T08:56:28.594 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-aes.ko 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/padlock-sha.ko 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dca/dca.ko 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/devfreq 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw 2023-12-05T08:56:28.595 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/amd64_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/e752x_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/edac_mce_amd.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3000_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i3200_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5100_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i5400_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7300_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i7core_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/i82975x_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/ie31200_edac.ko 2023-12-05T08:56:28.596 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/sb_edac.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/edac/x38_edac.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/edd.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-ich.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-appleir.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-aureal.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-axff.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-dr.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elecom.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-elo.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-emsff.ko 2023-12-05T08:56:28.597 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gaff.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gt683r.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-gyration.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-holtekff.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-hyperv.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-icade.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-keytouch.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-kye.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lcpower.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-led.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-lenovo.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-05T08:56:28.598 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-multitouch.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-ortek.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-penmount.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-petalynx.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-picolcd.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-pl.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-plantronics.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-primax.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-rmi.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-common.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-05T08:56:28.599 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-roccat.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-saitek.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-samsung.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sjoy.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sony.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-speedlink.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-steelseries.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-sunplus.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-05T08:56:28.600 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tivo.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-tmff.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-topseed.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-twinhan.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-uclogic.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-waltop.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-wiimote.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-xinmo.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zpff.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/hid-zydacron.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/uhid.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hid/wacom.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_balloon.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_utils.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hv/hv_vmbus.ko 2023-12-05T08:56:28.601 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/abituguru3.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7414.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ad7418.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adc128d818.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1025.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1026.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1029.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm1031.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adm9240.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ads7828.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7410.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7411.ko 2023-12-05T08:56:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7462.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7470.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7475.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/adt7x10.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/amc6821.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/applesmc.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asb100.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asc7621.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/atxp1.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/coretemp.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/dme1737.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds1621.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ds620.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc1403.ko 2023-12-05T08:56:28.603 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/emc6w201.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71805f.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f71882fg.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/f75375s.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fam15h_power.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/fschmd.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g760a.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/g762.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl518sm.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/gl520sm.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5500_temp.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/i5k_amb.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmaem.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ibmpex.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina209.ko 2023-12-05T08:56:28.604 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ina2xx.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/it87.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k10temp.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/k8temp.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lineage-pem.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm63.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm73.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm75.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm77.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm78.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm80.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm83.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm85.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm87.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm90.ko 2023-12-05T08:56:28.605 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm92.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm93.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95234.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95241.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/lm95245.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc2945.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4151.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4215.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4222.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4245.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4260.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/ltc4261.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max16065.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1619.ko 2023-12-05T08:56:28.606 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max1668.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max197.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6639.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6650.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/max6697.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/mcp3021.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6683.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775-core.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct6775.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/nct7802.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87360.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pc87427.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pcf8591.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-05T08:56:28.607 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/powr1220.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5627.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch5636.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht15.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sht21.ko 2023-12-05T08:56:28.608 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/shtc1.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/sis5595.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47b397.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m1.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/smsc47m192.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/thmc50.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp102.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp103.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp401.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/tmp421.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via-cputemp.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/via686a.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt1211.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/vt8231.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627ehf.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83627hf.ko 2023-12-05T08:56:28.609 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83781d.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83791d.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83792d.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83793.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83795.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l785ts.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/hwmon/w83l786ng.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses 2023-12-05T08:56:28.610 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-05T08:56:28.611 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-dev.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-mux.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-smbus.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/i2c/i2c-stub.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_core.ko 2023-12-05T08:56:28.612 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib 2023-12-05T08:56:28.613 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/gameport/gameport.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/joydev.ko 2023-12-05T08:56:28.614 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/appletouch.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/bcm5974.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/cyapatp.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/sermouse.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/altera_ps2.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/arc_ps2.ko 2023-12-05T08:56:28.615 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/serio/serio_raw.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/input/sparse-keymap.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-blinkm.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lm3530.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-lp3944.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/leds-ss4200.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-05T08:56:28.616 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/bcache/bcache.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-bio-prison.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache-smq.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-cache.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-crypt.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-delay.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-flakey.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-log-userspace.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-multipath.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-queue-length.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-raid.ko 2023-12-05T08:56:28.617 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-round-robin.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-service-time.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-switch.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-thin-pool.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/dm-verity.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/faulty.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/linear.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/multipath.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid0.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid1.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid10.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/md/raid456.ko 2023-12-05T08:56:28.618 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptbase.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptctl.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptfc.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptlan.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptsas.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptscsih.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/message/fusion/mptspi.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_ich.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/lpc_sch.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/mfd-core.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/sm501.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/viperboard.ko 2023-12-05T08:56:28.619 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/vx855.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/mfd/wl1273-core.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds9802als.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/apds990x.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/bh1770glc.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/cb710/cb710.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/at24.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/eeprom/max6875.ko 2023-12-05T08:56:28.620 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/enclosure.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/hpilo.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29003.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/isl29020.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-me.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei-txe.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/mei/mei.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-gru 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-05T08:56:28.621 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_7xx1.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tifm_core.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/tsl2550.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_balloon.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/bonding/bonding.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-05T08:56:28.622 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/dummy.ko 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/eql.ko 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-05T08:56:28.623 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd 2023-12-05T08:56:28.624 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-05T08:56:28.625 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio 2023-12-05T08:56:28.626 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec 2023-12-05T08:56:28.627 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/dnet.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ethoc.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/fealnx.ko 2023-12-05T08:56:28.628 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-05T08:56:28.629 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/jme.ko 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox 2023-12-05T08:56:28.630 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion 2023-12-05T08:56:28.631 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-05T08:56:28.632 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rocker 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-05T08:56:28.633 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-05T08:56:28.634 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/geneve.ko 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154 2023-12-05T08:56:28.635 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ifb.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvlan.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/macvtap.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/mii.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/net_failover.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/netconsole.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/nlmon.ko 2023-12-05T08:56:28.636 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/amd.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/bcm87xx.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/broadcom.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/cicada.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/davicom.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/dp83640.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/et1011c.ko 2023-12-05T08:56:28.637 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/icplus.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/lxt.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/marvell.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/micrel.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/national.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/phylink.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/qsemi.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/realtek.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/smsc.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/ste10Xp.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/phy/vitesse.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_async.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-05T08:56:28.638 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-05T08:56:28.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-05T08:56:28.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-05T08:56:28.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppoe.ko 2023-12-05T08:56:28.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pppox.ko 2023-12-05T08:56:28.639 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/ppp/pptp.ko 2023-12-05T08:56:28.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip 2023-12-05T08:56:28.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slhc.ko 2023-12-05T08:56:28.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/slip/slip.ko 2023-12-05T08:56:28.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/sungem_phy.ko 2023-12-05T08:56:28.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tap.ko 2023-12-05T08:56:28.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team 2023-12-05T08:56:28.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team.ko 2023-12-05T08:56:28.641 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_random.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/tun.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/veth.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/virtio_net.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/vxlan/vxlan.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/net/xen-netfront.ko 2023-12-05T08:56:28.642 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ntb/ntb.ko 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme-core.ko 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/nvme/host/nvme.ko 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport.ko 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_cs.ko 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_pc.ko 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/parport/parport_serial.ko 2023-12-05T08:56:28.643 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pcie 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pci/xen-pcifront.ko 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/i82092.ko 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/pd6729.ko 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl 2023-12-05T08:56:28.644 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/acerhdf.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/hdaps.ko 2023-12-05T08:56:28.645 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/intel_ips.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/platform/x86/wmi.ko 2023-12-05T08:56:28.646 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/clients/pps_parport.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/pps/pps_core.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ptp/ptp_kvm.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-05T08:56:28.647 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-em3027.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-max6900.ko 2023-12-05T08:56:28.648 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/rtc/rtc-x1205.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-9xxx.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-sas.ko 2023-12-05T08:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/3w-xxxx.ko 2023-12-05T08:56:28.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/BusLogic.ko 2023-12-05T08:56:28.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/a100u2w.ko 2023-12-05T08:56:28.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid 2023-12-05T08:56:28.650 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/advansys.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/am53c974.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/atp870u.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bfa/bfa.ko 2023-12-05T08:56:28.651 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ch.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dc395x.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-05T08:56:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/dmx3191d.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/esp_scsi.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/fnic/fnic.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hpsa.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hptiop.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/hv_storvsc.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/initio.ko 2023-12-05T08:56:28.653 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ipr.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ips.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/isci/isci.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libfc/libfc.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/libsas/libsas.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid 2023-12-05T08:56:28.654 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/mvumi.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/pmcraid.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla1280.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-05T08:56:28.655 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/raid_class.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_debug.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/ses.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/st.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/stex.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/virtio_scsi.ko 2023-12-05T08:56:28.656 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/scsi/wd719x.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ssb/ssb.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_file.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_iblock.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_mod.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_pscsi.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/target_core_user.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-05T08:56:28.657 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-05T08:56:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_gsm.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/n_hdlc.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/nozomi.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/arc_uart.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs 2023-12-05T08:56:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio.ko 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_aec.ko 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_cif.ko 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_pci_generic.ko 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/uio/uio_sercos3.ko 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb 2023-12-05T08:56:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class 2023-12-05T08:56:28.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-acm.ko 2023-12-05T08:56:28.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-05T08:56:28.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usblp.ko 2023-12-05T08:56:28.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/class/usbtmc.ko 2023-12-05T08:56:28.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host 2023-12-05T08:56:28.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-05T08:56:28.661 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image 2023-12-05T08:56:28.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/mdc800.ko 2023-12-05T08:56:28.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/image/microtek.ko 2023-12-05T08:56:28.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc 2023-12-05T08:56:28.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/adutux.ko 2023-12-05T08:56:28.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/appledisplay.ko 2023-12-05T08:56:28.662 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi26.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/emi62.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ezusb.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/idmouse.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/iowarrior.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/ldusb.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/legousbtower.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usb3503.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usblcd.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-05T08:56:28.663 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/uss720.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/misc/yurex.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/phy/phy-generic.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/aircable.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ark3116.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ch341.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cp210x.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cyberjack.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/empeg.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-05T08:56:28.664 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/io_ti.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipaq.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ipw.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ir-usb.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mct_u232.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7720.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/mos7840.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/navman.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/omninet.ko 2023-12-05T08:56:28.665 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/opticon.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/option.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/oti6858.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/pl2303.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcaux.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/qcserial.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/quatech2.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/safe_serial.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/sierra.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ssu100.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/symbolserial.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_debug.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-05T08:56:28.666 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/visor.ko 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/whiteheat.ko 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/uas.ko 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-05T08:56:28.667 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-05T08:56:28.669 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-karma.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/storage/usb-storage.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio 2023-12-05T08:56:28.670 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci 2023-12-05T08:56:28.671 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-05T08:56:28.671 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-05T08:56:28.671 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio.ko 2023-12-05T08:56:28.672 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-05T08:56:28.672 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost 2023-12-05T08:56:28.672 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost.ko 2023-12-05T08:56:28.672 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-05T08:56:28.672 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_net.ko 2023-12-05T08:56:28.672 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/vhost/vhost_scsi.ko 2023-12-05T08:56:28.672 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video 2023-12-05T08:56:28.672 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/apple_bl.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/lcd.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_balloon.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_mmio.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/virtio/virtio_ring.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2482.ko 2023-12-05T08:56:28.673 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/masters/ds2490.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/w1/wire.ko 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog 2023-12-05T08:56:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/hpwdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/i6300esb.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ib700wdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ibmasr.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/it87_wdt.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/machzwd.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/nv_tco.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-05T08:56:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/softdog.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/via_wdt.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/wdt_pci.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/watchdog/xen_wdt.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-evtchn.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntalloc.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-gntdev.ko 2023-12-05T08:56:28.676 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xen-privcmd.ko 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/9p/9p.ko 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/affs/affs.ko 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/befs/befs.ko 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/binfmt_misc.ko 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs 2023-12-05T08:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/btrfs/btrfs.ko 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cachefiles/cachefiles.ko 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ceph/ceph.ko 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/coda/coda.ko 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/cramfs/cramfs.ko 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/dlm/dlm.ko 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ecryptfs 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/f2fs/f2fs.ko 2023-12-05T08:56:28.678 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/fat.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/msdos.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fat/vfat.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fscache/fscache.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/cuse.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/fuse/fuse.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/gfs2/gfs2.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfs/hfs.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/hfsplus/hfsplus.ko 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs 2023-12-05T08:56:28.679 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/isofs/isofs.ko 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/jfs/jfs.ko 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/lockd/lockd.ko 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/minix/minix.ko 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/netfs/netfs.ko 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-05T08:56:28.680 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfs.ko 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv3.ko 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs/nfsv4.ko 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/grace.ko 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfs_common/nfs_acl.ko 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nfsd/nfsd.ko 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nilfs2/nilfs2.ko 2023-12-05T08:56:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls 2023-12-05T08:56:28.682 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-celtic.ko 2023-12-05T08:56:28.682 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-centeuro.ko 2023-12-05T08:56:28.682 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-croatian.ko 2023-12-05T08:56:28.682 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-cyrillic.ko 2023-12-05T08:56:28.682 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-gaelic.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-greek.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-iceland.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-inuit.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-roman.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-romanian.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/mac-turkish.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1250.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1251.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp1255.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp737.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp775.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp850.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp852.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp855.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp857.ko 2023-12-05T08:56:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp860.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp861.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp862.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp863.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp864.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp865.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp866.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp869.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp874.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp932.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp936.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp949.ko 2023-12-05T08:56:28.684 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_cp950.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_euc-jp.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-1.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-13.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-14.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-15.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-2.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-3.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-4.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-5.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-6.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-7.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_iso8859-9.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-r.ko 2023-12-05T08:56:28.685 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-ru.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_koi8-u.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/nls/nls_utf8.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-05T08:56:28.686 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs 2023-12-05T08:56:28.687 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/overlayfs/overlay.ko 2023-12-05T08:56:28.687 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore 2023-12-05T08:56:28.687 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/pstore/ramoops.ko 2023-12-05T08:56:28.687 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs 2023-12-05T08:56:28.687 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/reiserfs/reiserfs.ko 2023-12-05T08:56:28.687 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs 2023-12-05T08:56:28.687 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/romfs/romfs.ko 2023-12-05T08:56:28.689 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb 2023-12-05T08:56:28.689 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client 2023-12-05T08:56:28.689 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/client/cifs.ko 2023-12-05T08:56:28.689 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common 2023-12-05T08:56:28.689 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_arc4.ko 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/smb/common/cifs_md4.ko 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/squashfs/squashfs.ko 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/sysv/sysv.ko 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/udf/udf.ko 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/ufs/ufs.ko 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/fs/xfs/xfs.ko 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/rcu 2023-12-05T08:56:28.690 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/rcu/rcutorture.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/torture.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/trace 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/asn1_encoder.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc-itu-t.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crc8.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libarc4.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/crypto/libdes.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/libcrc32c.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lru_cache.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4_compress.ko 2023-12-05T08:56:28.691 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/lz4/lz4hc_compress.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/math/cordic.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/raid6/raid6_pq.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_bm.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_fsm.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/ts_kmp.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/zstd 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/lib/zstd/zstd_compress.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/mm 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/mm/hwpoison-inject.ko 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan 2023-12-05T08:56:28.692 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/6lowpan.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_dest.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_fragment.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_hop.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_mobility.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_routing.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/6lowpan/nhc_udp.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/garp.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/mrp.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/p8022.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/psnap.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/802/stp.ko 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q 2023-12-05T08:56:28.693 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/8021q/8021q.ko 2023-12-05T08:56:28.694 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p 2023-12-05T08:56:28.694 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet.ko 2023-12-05T08:56:28.694 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_fd.ko 2023-12-05T08:56:28.694 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_rdma.ko 2023-12-05T08:56:28.695 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/9p/9pnet_virtio.ko 2023-12-05T08:56:28.695 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv 2023-12-05T08:56:28.695 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/batman-adv/batman-adv.ko 2023-12-05T08:56:28.695 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge 2023-12-05T08:56:28.695 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/br_netfilter.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/bridge.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-05T08:56:28.696 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-05T08:56:28.697 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-05T08:56:28.697 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-05T08:56:28.697 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-05T08:56:28.697 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-05T08:56:28.697 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/ebtables.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ceph/libceph.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/failover.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/core/pktgen.ko 2023-12-05T08:56:28.698 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_diag.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv4.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dccp/dccp_ipv6.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dns_resolver 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dns_resolver/dns_resolver.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/dsa_core.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_brcm.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_dsa.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_none.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/dsa/tag_trailer.ko 2023-12-05T08:56:28.699 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ah4.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/esp4.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/fou.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/gre.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/inet_diag.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_gre.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_tunnel.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ip_vti.ko 2023-12-05T08:56:28.700 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipcomp.ko 2023-12-05T08:56:28.701 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/ipip.ko 2023-12-05T08:56:28.701 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter 2023-12-05T08:56:28.701 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-05T08:56:28.701 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-05T08:56:28.701 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-05T08:56:28.701 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-05T08:56:28.701 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-05T08:56:28.701 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-05T08:56:28.702 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_bic.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_dctcp.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_diag.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_highspeed.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_htcp.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_hybla.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_illinois.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_lp.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_scalable.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_vegas.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_veno.ko 2023-12-05T08:56:28.703 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_westwood.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tcp_yeah.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/tunnel4.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_diag.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/udp_tunnel.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ah6.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/esp6.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/fou6.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_tunnel.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ip6_vti.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/ipcomp6.ko 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter 2023-12-05T08:56:28.704 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-05T08:56:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/sit.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/tunnel6.ko 2023-12-05T08:56:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/key 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/key/af_key.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_core.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_eth.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ip6.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_netlink.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/l2tp/l2tp_ppp.ko 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc 2023-12-05T08:56:28.707 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/llc/llc.ko 2023-12-05T08:56:28.708 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154 2023-12-05T08:56:28.708 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mac802154/mac802154.ko 2023-12-05T08:56:28.708 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls 2023-12-05T08:56:28.708 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/mpls/mpls_gso.ko 2023-12-05T08:56:28.708 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter 2023-12-05T08:56:28.708 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset 2023-12-05T08:56:28.708 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-05T08:56:28.709 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-05T08:56:28.710 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conncount.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-05T08:56:28.711 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_log_syslog.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat.ko 2023-12-05T08:56:28.712 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_irc.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_sip.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nf_tables.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_log.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_chain_nat.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_compat.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_ct.ko 2023-12-05T08:56:28.713 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fib.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_hash.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_limit.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_log.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_masq.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_nat.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_numgen.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_queue.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_quota.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_redir.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_reject_inet.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_socket.ko 2023-12-05T08:56:28.714 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/nft_tunnel.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_AUDIT.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_CT.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_DSCP.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HL.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_HMARK.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LED.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_LOG.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-05T08:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NETMAP.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFLOG.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_RATEEST.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_SECMARK.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TEE.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TPROXY.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_TRACE.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_addrtype.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_bpf.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cgroup.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cluster.ko 2023-12-05T08:56:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_comment.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connbytes.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlabel.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connlimit.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_connmark.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_conntrack.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_cpu.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dccp.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_devgroup.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_dscp.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ecn.ko 2023-12-05T08:56:28.717 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_esp.ko 2023-12-05T08:56:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hashlimit.ko 2023-12-05T08:56:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_helper.ko 2023-12-05T08:56:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_hl.ko 2023-12-05T08:56:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipcomp.ko 2023-12-05T08:56:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_iprange.ko 2023-12-05T08:56:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_ipvs.ko 2023-12-05T08:56:28.718 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_l2tp.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_length.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_limit.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mac.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_mark.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_multiport.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nat.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_nfacct.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_osf.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_owner.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_physdev.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_pkttype.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_policy.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_quota.ko 2023-12-05T08:56:28.719 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_rateest.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_realm.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_recent.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_sctp.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_set.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_socket.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_state.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_statistic.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_string.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_tcpmss.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_time.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netfilter/xt_u32.ko 2023-12-05T08:56:28.720 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/netlink/netlink_diag.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/nsh/nsh.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/openvswitch.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-geneve.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-gre.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/openvswitch/vport-vxlan.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/packet/af_packet_diag.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_rdma.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/rds/rds_tcp.ko 2023-12-05T08:56:28.721 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_csum.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_gact.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_ipt.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_mirred.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_nat.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_pedit.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_police.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_simple.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_skbedit.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/act_vlan.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_basic.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_bpf.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_flow.ko 2023-12-05T08:56:28.722 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_fw.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_route.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/cls_u32.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_cmp.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_ipset.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_meta.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_nbyte.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_text.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/em_u32.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_choke.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_codel.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_drr.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_fq.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_gred.ko 2023-12-05T08:56:28.723 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hfsc.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_hhf.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_htb.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_ingress.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_mqprio_lib.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_multiq.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_netem.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_pie.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_plug.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_prio.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_qfq.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_red.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfb.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_sfq.ko 2023-12-05T08:56:28.724 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_tbf.ko 2023-12-05T08:56:28.725 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sched/sch_teql.ko 2023-12-05T08:56:28.725 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp 2023-12-05T08:56:28.725 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp.ko 2023-12-05T08:56:28.725 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sctp/sctp_diag.ko 2023-12-05T08:56:28.725 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc 2023-12-05T08:56:28.726 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss 2023-12-05T08:56:28.726 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-05T08:56:28.726 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-05T08:56:28.726 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/sunrpc.ko 2023-12-05T08:56:28.726 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma 2023-12-05T08:56:28.726 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/diag.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/tipc/tipc.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/unix/unix_diag.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-05T08:56:28.727 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security 2023-12-05T08:56:28.728 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys 2023-12-05T08:56:28.728 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/encrypted-keys 2023-12-05T08:56:28.728 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-05T08:56:28.728 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/trusted-keys 2023-12-05T08:56:28.728 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/security/keys/trusted-keys/trusted.ko 2023-12-05T08:56:28.729 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt 2023-12-05T08:56:28.729 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib 2023-12-05T08:56:28.729 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/kernel/virt/lib/irqbypass.ko 2023-12-05T08:56:28.729 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.alias 2023-12-05T08:56:28.729 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.alias.bin 2023-12-05T08:56:28.729 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin 2023-12-05T08:56:28.729 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin.bin 2023-12-05T08:56:28.730 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.builtin.modinfo 2023-12-05T08:56:28.730 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.dep 2023-12-05T08:56:28.730 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.dep.bin 2023-12-05T08:56:28.730 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.devname 2023-12-05T08:56:28.730 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.order 2023-12-05T08:56:28.730 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.softdep 2023-12-05T08:56:28.730 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.symbols 2023-12-05T08:56:28.730 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.6.0-g9471594ae3a4/modules.symbols.bin 2023-12-05T08:56:28.731 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g9471594ae3a4 2023-12-05T08:56:28.731 DEBUG:teuthology.orchestra.run.smithi134:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-05T08:56:28.759 INFO:teuthology.orchestra.run.smithi134.stdout:postinstall scriptlet (using /bin/sh): 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g9471594ae3a4 -a -r /boot/System.map-6.6.0-g9471594ae3a4 ]; then 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:cp /boot/vmlinuz-6.6.0-g9471594ae3a4 /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:cp /boot/System.map-6.6.0-g9471594ae3a4 /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:rm -f /boot/vmlinuz-6.6.0-g9471594ae3a4 /boot/System.map-6.6.0-g9471594ae3a4 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/installkernel 6.6.0-g9471594ae3a4 /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:rm -f /boot/.vmlinuz-6.6.0-g9471594ae3a4-rpm /boot/.System.map-6.6.0-g9471594ae3a4-rpm 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:new-kernel-pkg --remove 6.6.0-g9471594ae3a4 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g9471594ae3a4.img 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-install remove 6.6.0-g9471594ae3a4 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2023-12-05T08:56:28.760 INFO:teuthology.orchestra.run.smithi134.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-05T08:56:28.761 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-05T08:56:28.761 INFO:teuthology.orchestra.run.smithi134.stdout:/sbin/update-bootloader --remove 6.6.0-g9471594ae3a4 2023-12-05T08:56:28.761 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2023-12-05T08:56:28.762 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2023-12-05T08:56:28.842 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2023-12-05T08:56:28.842 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.02 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 129.el8 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Group : System Environment/Base 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 9265586 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Relocations : (not relocatable) 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : CentOS BuildSystem 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-05T08:56:28.843 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2023-12-05T08:56:28.844 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2023-12-05T08:56:28.844 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T08:56:28.844 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-05T08:56:28.844 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-05T08:56:28.844 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-05T08:56:28.844 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2023-12-05T08:56:28.844 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T08:56:28.844 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2023-12-05T08:56:28.845 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-05T08:56:28.845 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 6.6.0-g9471594ae3a4 2023-12-05T08:56:28.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-05T08:56:31.877 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2023-12-05T08:56:33.710 INFO:teuthology.orchestra.run.smithi134.stderr:done 2023-12-05T08:56:33.711 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-12-05T08:56:33.734 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.tnhRfeQwyP 2023-12-05T08:56:33.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tnhRfeQwyP 2023-12-05T08:56:33.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.tnhRfeQwyP 2023-12-05T08:56:33.955 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.tnhRfeQwyP is 6KB 2023-12-05T08:56:34.009 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.tnhRfeQwyP 2023-12-05T08:56:34.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2023-12-05T08:56:34.100 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-05T08:56:34.101 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-05T08:56:34.101 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-05T08:56:34.101 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-g9471594ae3a4.conf 2023-12-05T08:56:34.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-g9471594ae3a4 2023-12-05T08:56:34.271 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2023-12-05T08:56:36.598 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-05T08:56:36.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-05T08:56:36.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:56:55.143 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-05T08:57:04.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-05T08:57:04.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:57:04.281 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-05T08:57:04.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-05T08:57:04.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:57:07.238 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-05T08:57:19.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-05T08:57:19.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:57:22.792 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-05T08:57:31.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-05T08:57:31.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:57:34.850 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-12-05T08:57:37.641 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-12-05T08:57:46.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-05T08:57:46.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:57:52.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-05T08:57:52.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T08:57:52.907 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-12-05T08:57:53.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-05T08:57:53.459 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.6.0-g9471594ae3a4"... 2023-12-05T08:57:53.459 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-12-05T08:57:53.505 INFO:teuthology.orchestra.run.smithi067.stdout:6.6.0-g9471594ae3a4 2023-12-05T08:57:53.505 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g9471594ae3a4 vs 6.6.0-g9471594ae3a4 2023-12-05T08:57:53.505 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-05T08:57:53.505 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-05T08:57:54.506 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-05T08:57:54.509 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-05T08:57:54.732 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2023-12-05T08:57:54.749 DEBUG:teuthology.parallel:result is None 2023-12-05T08:58:18.678 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-12-05T08:58:19.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-05T08:58:19.084 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.6.0-g9471594ae3a4"... 2023-12-05T08:58:19.086 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-12-05T08:58:19.138 INFO:teuthology.orchestra.run.smithi134.stdout:6.6.0-g9471594ae3a4 2023-12-05T08:58:19.138 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g9471594ae3a4 vs 6.6.0-g9471594ae3a4 2023-12-05T08:58:19.138 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-05T08:58:19.139 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-05T08:58:20.142 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-05T08:58:20.142 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-05T08:58:20.260 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2023-12-05T08:58:20.285 DEBUG:teuthology.parallel:result is None 2023-12-05T08:58:20.286 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-05T08:58:20.306 INFO:teuthology.task.internal:Creating test directory... 2023-12-05T08:58:20.306 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-05T08:58:20.311 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-05T08:58:20.358 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-05T08:58:20.365 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-05T08:58:20.378 INFO:teuthology.task.internal:Creating archive directory... 2023-12-05T08:58:20.378 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-05T08:58:20.384 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-05T08:58:20.465 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-05T08:58:20.474 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-05T08:58:20.474 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-05T08:58:20.479 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-05T08:58:20.571 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T08:58:20.572 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T08:58:20.604 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T08:58:20.604 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-05T08:58:20.604 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-05T08:58:20.617 INFO:teuthology.task.internal:Configuring sudo... 2023-12-05T08:58:20.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-05T08:58:20.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-05T08:58:20.694 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-05T08:58:20.703 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-05T08:58:20.704 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-05T08:58:20.708 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-05T08:58:20.755 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T08:58:20.866 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T08:58:20.951 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T08:58:21.043 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T08:58:21.119 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T08:58:21.119 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-05T08:58:21.192 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T08:58:21.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-05T08:58:21.343 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T08:58:21.419 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-05T08:58:21.511 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T08:58:21.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-05T08:58:21.588 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2023-12-05T08:58:21.593 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2023-12-05T08:58:21.713 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T08:58:21.758 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T08:58:22.220 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-05T08:58:22.228 INFO:teuthology.task.internal:Starting timer... 2023-12-05T08:58:22.229 INFO:teuthology.run_tasks:Running task pcp... 2023-12-05T08:58:22.246 INFO:teuthology.run_tasks:Running task selinux... 2023-12-05T08:58:22.260 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-05T08:58:22.260 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2023-12-05T08:58:22.396 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2023-12-05T08:58:22.399 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2023-12-05T08:58:22.528 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2023-12-05T08:58:22.533 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-05T08:58:22.534 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2023-12-05T08:58:22.595 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2023-12-05T08:58:22.595 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2023-12-05T08:58:22.653 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2023-12-05T08:58:22.653 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2023-12-05T08:58:22.653 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T08:58:22.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T08:58:22.724 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T08:58:22.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T08:58:22.795 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-05T08:58:22.795 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2023-12-05T08:58:22.869 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2023-12-05T08:58:22.941 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-05T08:58:22.974 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-05T08:58:22.975 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-05T08:58:23.055 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-05T08:58:23.057 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-05T09:11:46.322 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2023-12-05T09:11:46.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-05T09:11:46.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:11:46.415 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-12-05T09:11:46.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-12-05T09:11:46.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-05T09:11:46.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T09:11:46.621 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-12-05T09:11:46.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-05T09:11:46.735 INFO:teuthology.run_tasks:Running task clock... 2023-12-05T09:11:46.745 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-05T09:11:46.746 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-05T09:11:46.746 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T09:11:46.751 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-05T09:11:46.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T09:11:46.823 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-05T09:11:46.849 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-05T09:11:46.857 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-05T09:11:46.881 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-05T09:11:46.947 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2023-12-05T09:11:46.972 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2023-12-05T09:11:46.977 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2023-12-05T09:11:47.000 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2023-12-05T09:11:47.010 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-05T09:11:47.032 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-05T09:11:47.045 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-05T09:11:47.064 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-05T09:11:47.131 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2023-12-05T09:11:47.139 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T09:11:47.139 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2023-12-05T09:11:47.139 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:11:47.139 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:11:47.139 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:11:47.139 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:11:47.150 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2023-12-05T09:11:47.157 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T09:11:47.157 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2023-12-05T09:11:47.157 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:11:47.157 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:11:47.157 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:11:47.157 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:11:47.159 INFO:teuthology.run_tasks:Running task pexec... 2023-12-05T09:11:47.169 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-05T09:11:47.169 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:11:47.169 DEBUG:teuthology.orchestra.run.smithi067:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-05T09:11:47.170 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi134.front.sepia.ceph.com 2023-12-05T09:11:47.170 DEBUG:teuthology.orchestra.run.smithi134:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-05T09:11:48.255 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:14 ago on Tue 05 Dec 2023 09:09:34 AM UTC. 2023-12-05T09:11:48.293 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:04 ago on Tue 05 Dec 2023 09:09:44 AM UTC. 2023-12-05T09:11:50.481 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout:Resetting modules: 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:11:50.483 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:11:50.716 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:11:50.717 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:11:50.717 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2023-12-05T09:11:50.717 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:11:50.717 INFO:teuthology.orchestra.run.smithi067.stdout:Resetting modules: 2023-12-05T09:11:50.717 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools 2023-12-05T09:11:50.718 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:11:50.718 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:11:50.718 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:11:50.718 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:11:50.758 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:11:51.002 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:11:51.892 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:17 ago on Tue 05 Dec 2023 09:09:34 AM UTC. 2023-12-05T09:11:52.214 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:08 ago on Tue 05 Dec 2023 09:09:44 AM UTC. 2023-12-05T09:11:54.089 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:11:54.284 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:11:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:11:54.284 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:11:54.284 INFO:teuthology.orchestra.run.smithi134.stdout:Installing group/module packages: 2023-12-05T09:11:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-05T09:11:54.285 INFO:teuthology.orchestra.run.smithi134.stdout:Installing module profiles: 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools/common 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling module streams: 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools rhel8 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2023-12-05T09:11:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:11:54.287 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 27 M 2023-12-05T09:11:54.287 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 89 M 2023-12-05T09:11:54.287 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:11:54.581 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:11:54.712 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 3.1 MB/s | 750 kB 00:00 2023-12-05T09:11:54.762 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 762 kB/s | 38 kB 00:00 2023-12-05T09:11:54.787 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:11:54.788 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:11:54.788 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:11:54.788 INFO:teuthology.orchestra.run.smithi067.stdout:Installing group/module packages: 2023-12-05T09:11:54.788 INFO:teuthology.orchestra.run.smithi067.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-05T09:11:54.788 INFO:teuthology.orchestra.run.smithi067.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-05T09:11:54.788 INFO:teuthology.orchestra.run.smithi067.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-05T09:11:54.789 INFO:teuthology.orchestra.run.smithi067.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-05T09:11:54.789 INFO:teuthology.orchestra.run.smithi067.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-05T09:11:54.789 INFO:teuthology.orchestra.run.smithi067.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-05T09:11:54.789 INFO:teuthology.orchestra.run.smithi067.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-05T09:11:54.789 INFO:teuthology.orchestra.run.smithi067.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-05T09:11:54.789 INFO:teuthology.orchestra.run.smithi067.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-05T09:11:54.789 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:11:54.789 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout:Installing module profiles: 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools/common 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling module streams: 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools rhel8 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:11:54.790 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:11:54.791 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:11:54.791 INFO:teuthology.orchestra.run.smithi067.stdout:Install 13 Packages 2023-12-05T09:11:54.791 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:11:54.791 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 27 M 2023-12-05T09:11:54.791 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 89 M 2023-12-05T09:11:54.792 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:11:54.796 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 3.1 MB/s | 1.0 MB 00:00 2023-12-05T09:11:54.822 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 4.0 MB/s | 241 kB 00:00 2023-12-05T09:11:54.872 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 3.5 MB/s | 178 kB 00:00 2023-12-05T09:11:54.930 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 426 kB/s | 25 kB 00:00 2023-12-05T09:11:54.997 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2023-12-05T09:11:55.071 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] buildah-1.32.0-1.module_el8+712+4cd1bd69.x86_64.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/AppStream/x86_64/os/Packages/buildah-1.32.0-1.module_el8%2b712%2b4cd1bd69.x86_64.rpm (IP: 152.19.134.43) 2023-12-05T09:11:55.076 INFO:teuthology.orchestra.run.smithi067.stdout:[MIRROR] cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/AppStream/x86_64/os/Packages/cockpit-podman-78-1.module_el8%2b712%2b4cd1bd69.noarch.rpm (IP: 152.19.134.43) 2023-12-05T09:11:55.189 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 10 MB/s | 3.9 MB 00:00 2023-12-05T09:11:55.230 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64.rpm: Status code: 403 for http://distro.ibiblio.org/centos/8-stream/AppStream/x86_64/os/Packages/toolbox-0.0.99.4-6.module_el8%2b712%2b4cd1bd69.x86_64.rpm (IP: 152.19.134.43) 2023-12-05T09:11:55.615 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 8.4 MB/s | 9.6 MB 00:01 2023-12-05T09:11:55.673 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 911 kB/s | 53 kB 00:00 2023-12-05T09:11:55.740 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 4.6 MB/s | 2.5 MB 00:00 2023-12-05T09:11:55.765 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 445 kB/s | 41 kB 00:00 2023-12-05T09:11:55.820 INFO:teuthology.orchestra.run.smithi067.stdout:(1/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 1.2 MB/s | 1.0 MB 00:00 2023-12-05T09:11:55.846 INFO:teuthology.orchestra.run.smithi067.stdout:(2/13): cockpit-podman-78-1.module_el8+712+4cd1 879 kB/s | 750 kB 00:00 2023-12-05T09:11:55.871 INFO:teuthology.orchestra.run.smithi067.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 756 kB/s | 38 kB 00:00 2023-12-05T09:11:56.007 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 8.1 MB/s | 8.1 MB 00:01 2023-12-05T09:11:56.008 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:11:56.008 INFO:teuthology.orchestra.run.smithi134.stdout:Total 15 MB/s | 27 MB 00:01 2023-12-05T09:11:56.021 INFO:teuthology.orchestra.run.smithi067.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 1.3 MB/s | 241 kB 00:00 2023-12-05T09:11:56.080 INFO:teuthology.orchestra.run.smithi067.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 3.0 MB/s | 178 kB 00:00 2023-12-05T09:11:56.158 INFO:teuthology.orchestra.run.smithi067.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 318 kB/s | 25 kB 00:00 2023-12-05T09:11:56.222 INFO:teuthology.orchestra.run.smithi067.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2023-12-05T09:11:56.444 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:11:56.469 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:11:56.470 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:11:56.539 INFO:teuthology.orchestra.run.smithi067.stdout:(8/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 6.2 MB/s | 9.6 MB 00:01 2023-12-05T09:11:56.598 INFO:teuthology.orchestra.run.smithi067.stdout:(9/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 5.4 MB/s | 3.9 MB 00:00 2023-12-05T09:11:56.656 INFO:teuthology.orchestra.run.smithi067.stdout:(10/13): udica-0.2.6-20.module_el8+712+4cd1bd69 908 kB/s | 53 kB 00:00 2023-12-05T09:11:56.715 INFO:teuthology.orchestra.run.smithi067.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 704 kB/s | 41 kB 00:00 2023-12-05T09:11:56.730 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:11:56.733 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:11:57.007 INFO:teuthology.orchestra.run.smithi067.stdout:(12/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 10 MB/s | 8.1 MB 00:00 2023-12-05T09:11:57.421 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:11:57.543 INFO:teuthology.orchestra.run.smithi067.stdout:(13/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 2.5 MB/s | 2.5 MB 00:01 2023-12-05T09:11:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:11:57.544 INFO:teuthology.orchestra.run.smithi067.stdout:Total 9.7 MB/s | 27 MB 00:02 2023-12-05T09:11:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-05T09:11:57.831 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-05T09:11:57.995 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:11:58.023 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:11:58.023 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:11:58.026 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-05T09:11:58.261 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T09:11:58.314 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:11:58.318 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:11:58.865 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-05T09:11:59.037 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:11:59.299 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-05T09:11:59.432 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-05T09:11:59.642 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-05T09:11:59.859 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T09:11:59.911 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T09:12:00.488 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-05T09:12:00.628 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-05T09:12:00.891 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-05T09:12:01.121 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-05T09:12:01.525 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-05T09:12:01.605 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T09:12:01.871 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-05T09:12:02.126 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-05T09:12:02.379 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-05T09:12:02.468 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T09:12:02.701 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-05T09:12:02.803 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-05T09:12:02.886 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T09:12:03.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-05T09:12:03.815 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T09:12:04.025 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-05T09:12:04.186 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T09:12:04.457 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-05T09:12:04.457 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:12:04.457 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:04.458 INFO:teuthology.orchestra.run.smithi134.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-05T09:12:04.459 INFO:teuthology.orchestra.run.smithi134.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-05T09:12:04.459 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:12:04.459 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:12:04.690 DEBUG:teuthology.parallel:result is None 2023-12-05T09:12:04.864 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-05T09:12:04.864 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-05T09:12:04.864 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-05T09:12:04.864 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-05T09:12:04.865 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-05T09:12:05.710 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-05T09:12:05.710 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:12:05.710 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:12:05.710 INFO:teuthology.orchestra.run.smithi067.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:05.710 INFO:teuthology.orchestra.run.smithi067.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:12:05.711 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:12:05.933 DEBUG:teuthology.parallel:result is None 2023-12-05T09:12:05.933 INFO:teuthology.run_tasks:Running task install... 2023-12-05T09:12:05.942 DEBUG:teuthology.task.install:project ceph 2023-12-05T09:12:05.943 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'}} 2023-12-05T09:12:05.943 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'} 2023-12-05T09:12:05.943 INFO:teuthology.task.install:Using flavor: default 2023-12-05T09:12:05.949 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-05T09:12:05.949 INFO:teuthology.task.install:extra packages: [] 2023-12-05T09:12:05.949 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227', 'tag': None, 'wait_for_package': False} 2023-12-05T09:12:05.949 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:12:05.949 INFO:teuthology.packaging:ref: None 2023-12-05T09:12:05.949 INFO:teuthology.packaging:tag: None 2023-12-05T09:12:05.949 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:12:05.950 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:12:05.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T09:12:05.952 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227', 'tag': None, 'wait_for_package': False} 2023-12-05T09:12:05.952 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:12:05.952 INFO:teuthology.packaging:ref: None 2023-12-05T09:12:05.952 INFO:teuthology.packaging:tag: None 2023-12-05T09:12:05.952 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:12:05.952 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:12:05.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T09:12:06.207 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/ 2023-12-05T09:12:06.207 INFO:teuthology.task.install.rpm:Package version is 17.2.7-109.g1fd3ca3c 2023-12-05T09:12:06.265 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/ 2023-12-05T09:12:06.266 INFO:teuthology.task.install.rpm:Package version is 17.2.7-109.g1fd3ca3c 2023-12-05T09:12:06.401 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-05T09:12:06.401 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:12:06.401 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-05T09:12:06.429 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-05T09:12:06.429 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:12:06.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-05T09:12:06.472 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-05T09:12:06.473 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:12:06.473 INFO:teuthology.packaging:ref: None 2023-12-05T09:12:06.473 INFO:teuthology.packaging:tag: None 2023-12-05T09:12:06.473 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:12:06.473 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:12:06.473 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-05T09:12:06.508 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-05T09:12:06.508 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:12:06.508 INFO:teuthology.packaging:ref: None 2023-12-05T09:12:06.508 INFO:teuthology.packaging:tag: None 2023-12-05T09:12:06.508 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:12:06.508 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:12:06.508 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-05T09:12:06.584 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-05T09:12:06.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-05T09:12:06.682 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-05T09:12:06.717 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-05T09:12:06.751 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2023-12-05T09:12:06.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2023-12-05T09:12:06.786 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2023-12-05T09:12:06.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2023-12-05T09:12:07.131 INFO:teuthology.orchestra.run.smithi067.stdout:76 files removed 2023-12-05T09:12:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:76 files removed 2023-12-05T09:12:07.169 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw 2023-12-05T09:12:07.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2023-12-05T09:12:08.140 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 185 kB/s | 78 kB 00:00 2023-12-05T09:12:08.186 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 178 kB/s | 78 kB 00:00 2023-12-05T09:12:08.478 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 36 kB/s | 9.1 kB 00:00 2023-12-05T09:12:08.508 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 28 kB/s | 9.1 kB 00:00 2023-12-05T09:12:08.800 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-12-05T09:12:08.904 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 3.6 kB/s | 1.5 kB 00:00 2023-12-05T09:12:11.079 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - AppStream 16 MB/s | 34 MB 00:02 2023-12-05T09:12:22.016 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - AppStream 2.6 MB/s | 34 MB 00:13 2023-12-05T09:12:22.146 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 55 MB 00:03 2023-12-05T09:12:30.883 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - BaseOS 27 MB/s | 55 MB 00:02 2023-12-05T09:12:31.663 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - Extras 25 kB/s | 18 kB 00:00 2023-12-05T09:12:32.172 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.9 kB 00:00 2023-12-05T09:12:33.249 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 8 - PowerTools 7.3 MB/s | 6.6 MB 00:00 2023-12-05T09:12:34.884 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-12-05T09:12:36.253 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-12-05T09:12:39.533 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras 83 kB/s | 18 kB 00:00 2023-12-05T09:12:39.992 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 6.9 kB 00:00 2023-12-05T09:12:40.926 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - PowerTools 8.6 MB/s | 6.6 MB 00:00 2023-12-05T09:12:41.027 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 361 kB/s | 24 kB 00:00 2023-12-05T09:12:42.561 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-12-05T09:12:44.179 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-12-05T09:12:46.040 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.6 M 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.2 M 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 23 M 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 24 k 2023-12-05T09:12:46.043 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 796 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 506 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.6 M 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 45 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 115 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 190 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 372 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 358 k 2023-12-05T09:12:46.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 107 k 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout:Install 21 Packages 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 2 Packages 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 63 M 2023-12-05T09:12:46.045 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:12:48.178 INFO:teuthology.orchestra.run.smithi067.stdout:(1/23): ceph-common-17.2.7-109.g1fd3ca3c.el8.x8 14 MB/s | 23 MB 00:01 2023-12-05T09:12:48.220 INFO:teuthology.orchestra.run.smithi067.stdout:(2/23): ceph-selinux-17.2.7-109.g1fd3ca3c.el8.x 590 kB/s | 24 kB 00:00 2023-12-05T09:12:48.370 INFO:teuthology.orchestra.run.smithi067.stdout:(3/23): libcephfs2-17.2.7-109.g1fd3ca3c.el8.x86 5.2 MB/s | 796 kB 00:00 2023-12-05T09:12:48.571 INFO:teuthology.orchestra.run.smithi067.stdout:(4/23): ceph-radosgw-17.2.7-109.g1fd3ca3c.el8.x 8.1 MB/s | 17 MB 00:02 2023-12-05T09:12:48.635 INFO:teuthology.orchestra.run.smithi067.stdout:(5/23): libradosstriper1-17.2.7-109.g1fd3ca3c.e 1.9 MB/s | 506 kB 00:00 2023-12-05T09:12:48.670 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 463 kB/s | 24 kB 00:00 2023-12-05T09:12:48.696 INFO:teuthology.orchestra.run.smithi067.stdout:(6/23): python3-ceph-argparse-17.2.7-109.g1fd3c 736 kB/s | 45 kB 00:00 2023-12-05T09:12:48.771 INFO:teuthology.orchestra.run.smithi067.stdout:(7/23): python3-ceph-common-17.2.7-109.g1fd3ca3 1.5 MB/s | 115 kB 00:00 2023-12-05T09:12:48.847 INFO:teuthology.orchestra.run.smithi067.stdout:(8/23): python3-cephfs-17.2.7-109.g1fd3ca3c.el8 2.5 MB/s | 190 kB 00:00 2023-12-05T09:12:48.931 INFO:teuthology.orchestra.run.smithi067.stdout:(9/23): python3-rados-17.2.7-109.g1fd3ca3c.el8. 4.4 MB/s | 372 kB 00:00 2023-12-05T09:12:49.031 INFO:teuthology.orchestra.run.smithi067.stdout:(10/23): python3-rbd-17.2.7-109.g1fd3ca3c.el8.x 3.5 MB/s | 358 kB 00:00 2023-12-05T09:12:49.106 INFO:teuthology.orchestra.run.smithi067.stdout:(11/23): librgw2-17.2.7-109.g1fd3ca3c.el8.x86_6 10 MB/s | 5.6 MB 00:00 2023-12-05T09:12:49.131 INFO:teuthology.orchestra.run.smithi067.stdout:(12/23): python3-rgw-17.2.7-109.g1fd3ca3c.el8.x 1.0 MB/s | 107 kB 00:00 2023-12-05T09:12:49.423 INFO:teuthology.orchestra.run.smithi067.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 890 kB/s | 259 kB 00:00 2023-12-05T09:12:49.448 INFO:teuthology.orchestra.run.smithi067.stdout:(14/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.0 MB/s | 354 kB 00:00 2023-12-05T09:12:49.490 INFO:teuthology.orchestra.run.smithi067.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 659 kB/s | 44 kB 00:00 2023-12-05T09:12:49.607 INFO:teuthology.orchestra.run.smithi067.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 296 kB/s | 47 kB 00:00 2023-12-05T09:12:49.783 INFO:teuthology.orchestra.run.smithi067.stdout:(17/23): ceph-base-17.2.7-109.g1fd3ca3c.el8.x86 1.6 MB/s | 5.2 MB 00:03 2023-12-05T09:12:49.808 INFO:teuthology.orchestra.run.smithi067.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 294 kB/s | 59 kB 00:00 2023-12-05T09:12:49.833 INFO:teuthology.orchestra.run.smithi067.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 894 kB/s | 306 kB 00:00 2023-12-05T09:12:50.009 INFO:teuthology.orchestra.run.smithi067.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 333 kB/s | 75 kB 00:00 2023-12-05T09:12:50.159 INFO:teuthology.orchestra.run.smithi067.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 4.9 MB/s | 1.7 MB 00:00 2023-12-05T09:12:50.359 INFO:teuthology.orchestra.run.smithi067.stdout:(22/23): librbd1-17.2.7-109.g1fd3ca3c.el8.x86_6 10 MB/s | 3.6 MB 00:00 2023-12-05T09:12:51.051 INFO:teuthology.orchestra.run.smithi067.stdout:(23/23): librados2-17.2.7-109.g1fd3ca3c.el8.x86 2.8 MB/s | 3.5 MB 00:01 2023-12-05T09:12:51.053 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:12:51.053 INFO:teuthology.orchestra.run.smithi067.stdout:Total 13 MB/s | 63 MB 00:05 2023-12-05T09:12:51.151 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:12:51.209 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:12:51.209 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:12:51.618 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:12:51.622 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:12:52.934 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:12:53.123 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-05T09:12:53.314 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T09:12:53.390 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:12:53.392 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.6 M 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.2 M 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 23 M 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 24 k 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 796 k 2023-12-05T09:12:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 506 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 5.6 M 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 45 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 115 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 190 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 372 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 358 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 107 k 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-05T09:12:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:12:53.395 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:12:53.395 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:12:53.395 INFO:teuthology.orchestra.run.smithi134.stdout:Install 21 Packages 2023-12-05T09:12:53.395 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2023-12-05T09:12:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:12:53.395 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 63 M 2023-12-05T09:12:53.395 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:12:53.771 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T09:12:53.972 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:12:54.090 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:12:54.356 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T09:12:54.556 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:12:54.571 INFO:teuthology.orchestra.run.smithi134.stdout:(1/23): ceph-base-17.2.7-109.g1fd3ca3c.el8.x86_ 6.7 MB/s | 5.2 MB 00:00 2023-12-05T09:12:54.622 INFO:teuthology.orchestra.run.smithi134.stdout:(2/23): ceph-selinux-17.2.7-109.g1fd3ca3c.el8.x 489 kB/s | 24 kB 00:00 2023-12-05T09:12:54.772 INFO:teuthology.orchestra.run.smithi134.stdout:(3/23): libcephfs2-17.2.7-109.g1fd3ca3c.el8.x86 5.2 MB/s | 796 kB 00:00 2023-12-05T09:12:54.889 INFO:teuthology.orchestra.run.smithi134.stdout:(4/23): libradosstriper1-17.2.7-109.g1fd3ca3c.e 4.3 MB/s | 506 kB 00:00 2023-12-05T09:12:55.025 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:12:55.222 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:12:55.487 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:12:55.572 INFO:teuthology.orchestra.run.smithi134.stdout:(5/23): librgw2-17.2.7-109.g1fd3ca3c.el8.x86_64 8.1 MB/s | 5.6 MB 00:00 2023-12-05T09:12:55.686 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-05T09:12:55.756 INFO:teuthology.orchestra.run.smithi134.stdout:(6/23): ceph-radosgw-17.2.7-109.g1fd3ca3c.el8.x 8.6 MB/s | 17 MB 00:01 2023-12-05T09:12:55.781 INFO:teuthology.orchestra.run.smithi134.stdout:(7/23): python3-ceph-argparse-17.2.7-109.g1fd3c 215 kB/s | 45 kB 00:00 2023-12-05T09:12:55.806 INFO:teuthology.orchestra.run.smithi134.stdout:(8/23): python3-ceph-common-17.2.7-109.g1fd3ca3 2.3 MB/s | 115 kB 00:00 2023-12-05T09:12:55.848 INFO:teuthology.orchestra.run.smithi134.stdout:(9/23): python3-cephfs-17.2.7-109.g1fd3ca3c.el8 2.8 MB/s | 190 kB 00:00 2023-12-05T09:12:55.890 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-05T09:12:55.898 INFO:teuthology.orchestra.run.smithi134.stdout:(10/23): python3-rados-17.2.7-109.g1fd3ca3c.el8 4.0 MB/s | 372 kB 00:00 2023-12-05T09:12:55.924 INFO:teuthology.orchestra.run.smithi134.stdout:(11/23): python3-rbd-17.2.7-109.g1fd3ca3c.el8.x 4.7 MB/s | 358 kB 00:00 2023-12-05T09:12:55.949 INFO:teuthology.orchestra.run.smithi134.stdout:(12/23): python3-rgw-17.2.7-109.g1fd3ca3c.el8.x 2.1 MB/s | 107 kB 00:00 2023-12-05T09:12:56.064 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T09:12:56.216 INFO:teuthology.orchestra.run.smithi134.stdout:(13/23): ceph-common-17.2.7-109.g1fd3ca3c.el8.x 9.7 MB/s | 23 MB 00:02 2023-12-05T09:12:56.325 INFO:teuthology.orchestra.run.smithi134.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 692 kB/s | 259 kB 00:00 2023-12-05T09:12:56.350 INFO:teuthology.orchestra.run.smithi134.stdout:(15/23): librdkafka-0.11.4-3.el8.x86_64.rpm 831 kB/s | 354 kB 00:00 2023-12-05T09:12:56.376 INFO:teuthology.orchestra.run.smithi134.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 277 kB/s | 44 kB 00:00 2023-12-05T09:12:56.484 INFO:teuthology.orchestra.run.smithi134.stdout:(17/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 295 kB/s | 47 kB 00:00 2023-12-05T09:12:56.510 INFO:teuthology.orchestra.run.smithi134.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 440 kB/s | 59 kB 00:00 2023-12-05T09:12:56.585 INFO:teuthology.orchestra.run.smithi134.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-12-05T09:12:56.644 INFO:teuthology.orchestra.run.smithi134.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 473 kB/s | 75 kB 00:00 2023-12-05T09:12:56.704 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T09:12:56.947 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:12:57.030 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:12:57.044 INFO:teuthology.orchestra.run.smithi134.stdout:(21/23): librados2-17.2.7-109.g1fd3ca3c.el8.x86 7.6 MB/s | 3.5 MB 00:00 2023-12-05T09:12:57.161 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 11/25 2023-12-05T09:12:57.202 INFO:teuthology.orchestra.run.smithi134.stdout:(22/23): librbd1-17.2.7-109.g1fd3ca3c.el8.x86_6 6.4 MB/s | 3.6 MB 00:00 2023-12-05T09:12:57.377 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T09:12:57.394 INFO:teuthology.orchestra.run.smithi134.stdout:(23/23): thrift-0.13.0-2.el8.x86_64.rpm 2.0 MB/s | 1.7 MB 00:00 2023-12-05T09:12:57.399 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:12:57.399 INFO:teuthology.orchestra.run.smithi134.stdout:Total 16 MB/s | 63 MB 00:04 2023-12-05T09:12:57.493 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:12:57.543 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:12:57.543 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:12:57.595 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T09:12:57.823 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 14/25 2023-12-05T09:12:57.945 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:12:57.949 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:12:58.038 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T09:12:58.134 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T09:12:58.422 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-05T09:12:58.590 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-05T09:12:58.819 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-05T09:12:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:12:59.064 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 19/25 2023-12-05T09:12:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-05T09:12:59.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T09:12:59.851 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-05T09:13:00.028 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:13:00.148 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:13:00.374 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T09:13:00.545 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:13:01.007 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:13:01.170 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:13:01.424 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:13:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-05T09:13:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-05T09:13:01.994 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T09:13:02.214 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:13:02.615 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-05T09:13:02.656 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:13:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:13:02.889 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:13:03.074 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 11/25 2023-12-05T09:13:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T09:13:03.357 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:13:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T09:13:03.626 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T09:13:03.650 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 14/25 2023-12-05T09:13:03.802 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T09:13:03.863 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T09:13:03.897 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 15/25 2023-12-05T09:13:04.163 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:13:04.166 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-05T09:13:04.337 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-05T09:13:04.537 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-05T09:13:04.778 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 19/25 2023-12-05T09:13:07.757 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:13:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:13:08.745 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 20/25 2023-12-05T09:13:08.985 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T09:13:09.173 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 21/25 2023-12-05T09:13:09.360 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:13:25.326 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:13:25.326 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2023-12-05T09:13:25.326 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2023-12-05T09:13:25.326 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2023-12-05T09:13:25.326 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /run 2023-12-05T09:13:25.327 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2023-12-05T09:13:25.327 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2023-12-05T09:13:25.327 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2023-12-05T09:13:25.327 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2023-12-05T09:13:25.327 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2023-12-05T09:13:25.327 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:27.207 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T09:13:27.333 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T09:13:27.333 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T09:13:27.557 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T09:13:27.557 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:13:28.565 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:13:28.565 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/25 2023-12-05T09:13:28.565 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/25 2023-12-05T09:13:28.565 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:13:28.565 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 7/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 8/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 9/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 11/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-05T09:13:28.566 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-05T09:13:28.567 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-05T09:13:28.567 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-05T09:13:28.567 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-05T09:13:28.567 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-05T09:13:28.567 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:13:28.567 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-05T09:13:28.567 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 24/25 2023-12-05T09:13:29.551 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:13:29.551 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2023-12-05T09:13:29.551 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2023-12-05T09:13:29.552 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2023-12-05T09:13:29.552 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /run 2023-12-05T09:13:29.552 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2023-12-05T09:13:29.552 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2023-12-05T09:13:29.552 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2023-12-05T09:13:29.552 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2023-12-05T09:13:29.552 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2023-12-05T09:13:29.552 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:29.809 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:13:29.809 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:29.809 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2023-12-05T09:13:29.809 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.809 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.809 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:13:29.809 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.809 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.810 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.811 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-05T09:13:29.811 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.811 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.811 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:29.811 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-05T09:13:29.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:29.811 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:13:30.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-test 2023-12-05T09:13:31.311 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:51 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:13:31.357 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T09:13:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 23/25 2023-12-05T09:13:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T09:13:31.695 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-05T09:13:31.695 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 7/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x 8/25 2023-12-05T09:13:32.691 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86 9/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 10/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 11/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 12/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 13/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-05T09:13:32.692 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 22/25 2023-12-05T09:13:32.693 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-05T09:13:32.693 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 24/25 2023-12-05T09:13:33.179 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:13:33.180 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:13:33.180 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 52 M 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 174 k 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout:Install 6 Packages 2023-12-05T09:13:33.181 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:33.182 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 53 M 2023-12-05T09:13:33.182 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 234 M 2023-12-05T09:13:33.182 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:13:33.590 INFO:teuthology.orchestra.run.smithi067.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 922 kB/s | 203 kB 00:00 2023-12-05T09:13:33.649 INFO:teuthology.orchestra.run.smithi067.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 3.2 MB/s | 187 kB 00:00 2023-12-05T09:13:33.699 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-05T09:13:33.700 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:33.701 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:13:33.724 INFO:teuthology.orchestra.run.smithi067.stdout:(3/6): libcephsqlite-17.2.7-109.g1fd3ca3c.el8.x 492 kB/s | 174 kB 00:00 2023-12-05T09:13:33.785 INFO:teuthology.orchestra.run.smithi067.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.3 MB/s | 323 kB 00:00 2023-12-05T09:13:33.900 INFO:teuthology.orchestra.run.smithi067.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 403 kB/s | 71 kB 00:00 2023-12-05T09:13:34.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2023-12-05T09:13:35.120 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:47 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:13:36.550 INFO:teuthology.orchestra.run.smithi067.stdout:(6/6): ceph-test-17.2.7-109.g1fd3ca3c.el8.x86_6 16 MB/s | 52 MB 00:03 2023-12-05T09:13:36.552 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:13:36.552 INFO:teuthology.orchestra.run.smithi067.stdout:Total 16 MB/s | 53 MB 00:03 2023-12-05T09:13:36.651 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:13:36.677 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:13:36.677 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:13:36.844 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:13:36.845 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 52 M 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 174 k 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2023-12-05T09:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 53 M 2023-12-05T09:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 234 M 2023-12-05T09:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:13:37.006 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:13:37.010 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:13:37.090 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.0 MB/s | 203 kB 00:00 2023-12-05T09:13:37.182 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-12-05T09:13:37.283 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): libcephsqlite-17.2.7-109.g1fd3ca3c.el8.x 445 kB/s | 174 kB 00:00 2023-12-05T09:13:37.308 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-12-05T09:13:37.433 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 470 kB/s | 71 kB 00:00 2023-12-05T09:13:37.566 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:13:37.779 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-05T09:13:37.973 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-05T09:13:38.267 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T09:13:38.366 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T09:13:38.535 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-05T09:13:38.701 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T09:13:39.417 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): ceph-test-17.2.7-109.g1fd3ca3c.el8.x86_6 20 MB/s | 52 MB 00:02 2023-12-05T09:13:39.419 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:13:39.419 INFO:teuthology.orchestra.run.smithi134.stdout:Total 20 MB/s | 53 MB 00:02 2023-12-05T09:13:39.515 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:13:39.540 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:13:39.540 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:13:39.852 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:13:39.856 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:13:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:13:40.581 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-05T09:13:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-05T09:13:40.905 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T09:13:41.006 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-05T09:13:41.222 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-05T09:13:41.388 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T09:13:44.405 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T09:13:44.599 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T09:13:45.039 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T09:13:45.039 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/6 2023-12-05T09:13:45.039 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/6 2023-12-05T09:13:45.040 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-05T09:13:45.040 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-05T09:13:45.040 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-05T09:13:45.956 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout: jq-1.6-8.el8.x86_64 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:13:46.179 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph 2023-12-05T09:13:46.730 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/6 2023-12-05T09:13:46.970 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T09:13:47.298 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:07 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:13:47.324 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 6/6 2023-12-05T09:13:47.324 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/6 2023-12-05T09:13:47.325 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/6 2023-12-05T09:13:47.325 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-05T09:13:47.325 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-05T09:13:47.325 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-05T09:13:48.085 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.6-8.el8.x86_64 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:48.086 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:13:48.294 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2023-12-05T09:13:49.174 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:13:49.177 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:13:49.177 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:13:49.177 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:13:49.177 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:13:49.177 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 6.4 k 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 2.3 M 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 1.6 M 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 238 k 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.9 M 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-05T09:13:49.178 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-05T09:13:49.179 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout:Install 32 Packages 2023-12-05T09:13:49.180 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:13:49.181 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 28 M 2023-12-05T09:13:49.181 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 110 M 2023-12-05T09:13:49.181 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:13:49.441 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:01 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:13:49.785 INFO:teuthology.orchestra.run.smithi067.stdout:(1/32): ceph-17.2.7-109.g1fd3ca3c.el8.x86_64.rp 35 kB/s | 6.4 kB 00:00 2023-12-05T09:13:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:(2/32): ceph-mgr-17.2.7-109.g1fd3ca3c.el8.x86_6 4.4 MB/s | 1.6 MB 00:00 2023-12-05T09:13:50.294 INFO:teuthology.orchestra.run.smithi067.stdout:(3/32): ceph-mds-17.2.7-109.g1fd3ca3c.el8.x86_6 3.3 MB/s | 2.3 MB 00:00 2023-12-05T09:13:50.369 INFO:teuthology.orchestra.run.smithi067.stdout:(4/32): ceph-mgr-modules-core-17.2.7-109.g1fd3c 3.1 MB/s | 238 kB 00:00 2023-12-05T09:13:50.536 INFO:teuthology.orchestra.run.smithi067.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 944 kB/s | 157 kB 00:00 2023-12-05T09:13:50.603 INFO:teuthology.orchestra.run.smithi067.stdout:(6/32): ceph-mon-17.2.7-109.g1fd3ca3c.el8.x86_6 4.8 MB/s | 3.9 MB 00:00 2023-12-05T09:13:50.628 INFO:teuthology.orchestra.run.smithi067.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 422 kB/s | 39 kB 00:00 2023-12-05T09:13:50.679 INFO:teuthology.orchestra.run.smithi067.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-12-05T09:13:50.779 INFO:teuthology.orchestra.run.smithi067.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 590 kB/s | 103 kB 00:00 2023-12-05T09:13:50.838 INFO:teuthology.orchestra.run.smithi067.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.8 MB/s | 457 kB 00:00 2023-12-05T09:13:51.021 INFO:teuthology.orchestra.run.smithi067.stdout:(11/32): ceph-osd-17.2.7-109.g1fd3ca3c.el8.x86_ 16 MB/s | 17 MB 00:01 2023-12-05T09:13:51.138 INFO:teuthology.orchestra.run.smithi067.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 693 kB/s | 249 kB 00:00 2023-12-05T09:13:51.214 INFO:teuthology.orchestra.run.smithi067.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 569 kB/s | 109 kB 00:00 2023-12-05T09:13:51.280 INFO:teuthology.orchestra.run.smithi067.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 308 kB/s | 44 kB 00:00 2023-12-05T09:13:51.298 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 6.4 k 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 2.3 M 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 1.6 M 2023-12-05T09:13:51.302 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 238 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.9 M 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 17 M 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-05T09:13:51.303 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-05T09:13:51.304 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-05T09:13:51.305 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-05T09:13:51.305 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-05T09:13:51.305 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:51.305 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:13:51.305 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:13:51.305 INFO:teuthology.orchestra.run.smithi134.stdout:Install 32 Packages 2023-12-05T09:13:51.305 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:13:51.306 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 28 M 2023-12-05T09:13:51.306 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 110 M 2023-12-05T09:13:51.306 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:13:51.322 INFO:teuthology.orchestra.run.smithi067.stdout:(15/32): python3-cryptography-3.2.1-6.el8.x86_6 1.3 MB/s | 641 kB 00:00 2023-12-05T09:13:51.373 INFO:teuthology.orchestra.run.smithi067.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.8 MB/s | 173 kB 00:00 2023-12-05T09:13:51.448 INFO:teuthology.orchestra.run.smithi067.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-12-05T09:13:51.473 INFO:teuthology.orchestra.run.smithi067.stdout:(18/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 714 kB/s | 185 kB 00:00 2023-12-05T09:13:51.499 INFO:teuthology.orchestra.run.smithi067.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 349 kB/s | 18 kB 00:00 2023-12-05T09:13:51.524 INFO:teuthology.orchestra.run.smithi067.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 974 kB/s | 49 kB 00:00 2023-12-05T09:13:51.549 INFO:teuthology.orchestra.run.smithi067.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2023-12-05T09:13:51.583 INFO:teuthology.orchestra.run.smithi067.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.4 MB/s | 384 kB 00:00 2023-12-05T09:13:51.608 INFO:teuthology.orchestra.run.smithi067.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-12-05T09:13:51.633 INFO:teuthology.orchestra.run.smithi067.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 373 kB/s | 19 kB 00:00 2023-12-05T09:13:51.659 INFO:teuthology.orchestra.run.smithi067.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 476 kB/s | 24 kB 00:00 2023-12-05T09:13:51.684 INFO:teuthology.orchestra.run.smithi067.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 585 kB/s | 29 kB 00:00 2023-12-05T09:13:51.710 INFO:teuthology.orchestra.run.smithi134.stdout:(1/32): ceph-17.2.7-109.g1fd3ca3c.el8.x86_64.rp 44 kB/s | 6.4 kB 00:00 2023-12-05T09:13:51.718 INFO:teuthology.orchestra.run.smithi067.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 468 kB/s | 27 kB 00:00 2023-12-05T09:13:51.768 INFO:teuthology.orchestra.run.smithi067.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-12-05T09:13:51.802 INFO:teuthology.orchestra.run.smithi067.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.1 MB/s | 255 kB 00:00 2023-12-05T09:13:51.827 INFO:teuthology.orchestra.run.smithi067.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.3 MB/s | 251 kB 00:00 2023-12-05T09:13:51.852 INFO:teuthology.orchestra.run.smithi067.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 458 kB/s | 23 kB 00:00 2023-12-05T09:13:51.877 INFO:teuthology.orchestra.run.smithi067.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 784 kB/s | 85 kB 00:00 2023-12-05T09:13:51.881 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:13:51.881 INFO:teuthology.orchestra.run.smithi067.stdout:Total 11 MB/s | 28 MB 00:02 2023-12-05T09:13:52.010 INFO:teuthology.orchestra.run.smithi134.stdout:(2/32): ceph-mds-17.2.7-109.g1fd3ca3c.el8.x86_6 5.2 MB/s | 2.3 MB 00:00 2023-12-05T09:13:52.071 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:13:52.116 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:13:52.116 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:13:52.219 INFO:teuthology.orchestra.run.smithi134.stdout:(3/32): ceph-mgr-17.2.7-109.g1fd3ca3c.el8.x86_6 2.4 MB/s | 1.6 MB 00:00 2023-12-05T09:13:52.278 INFO:teuthology.orchestra.run.smithi134.stdout:(4/32): ceph-mon-17.2.7-109.g1fd3ca3c.el8.x86_6 6.9 MB/s | 3.9 MB 00:00 2023-12-05T09:13:52.303 INFO:teuthology.orchestra.run.smithi134.stdout:(5/32): ceph-mgr-modules-core-17.2.7-109.g1fd3c 2.8 MB/s | 238 kB 00:00 2023-12-05T09:13:52.420 INFO:teuthology.orchestra.run.smithi134.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 333 kB/s | 39 kB 00:00 2023-12-05T09:13:52.462 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:13:52.465 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:13:52.478 INFO:teuthology.orchestra.run.smithi134.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 784 kB/s | 157 kB 00:00 2023-12-05T09:13:52.529 INFO:teuthology.orchestra.run.smithi134.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-12-05T09:13:52.554 INFO:teuthology.orchestra.run.smithi134.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 772 kB/s | 103 kB 00:00 2023-12-05T09:13:52.688 INFO:teuthology.orchestra.run.smithi134.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.8 MB/s | 457 kB 00:00 2023-12-05T09:13:52.797 INFO:teuthology.orchestra.run.smithi134.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.0 MB/s | 249 kB 00:00 2023-12-05T09:13:53.048 INFO:teuthology.orchestra.run.smithi134.stdout:(12/32): ceph-osd-17.2.7-109.g1fd3ca3c.el8.x86_ 16 MB/s | 17 MB 00:01 2023-12-05T09:13:53.072 INFO:teuthology.orchestra.run.smithi134.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 396 kB/s | 109 kB 00:00 2023-12-05T09:13:53.114 INFO:teuthology.orchestra.run.smithi134.stdout:(14/32): python3-cryptography-3.2.1-6.el8.x86_6 1.5 MB/s | 641 kB 00:00 2023-12-05T09:13:53.548 INFO:teuthology.orchestra.run.smithi134.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 87 kB/s | 44 kB 00:00 2023-12-05T09:13:53.757 INFO:teuthology.orchestra.run.smithi134.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 271 kB/s | 185 kB 00:00 2023-12-05T09:13:53.809 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:13:53.813 INFO:teuthology.orchestra.run.smithi134.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 247 kB/s | 173 kB 00:00 2023-12-05T09:13:53.890 INFO:teuthology.orchestra.run.smithi134.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 83 kB/s | 11 kB 00:00 2023-12-05T09:13:53.941 INFO:teuthology.orchestra.run.smithi134.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 138 kB/s | 18 kB 00:00 2023-12-05T09:13:53.999 INFO:teuthology.orchestra.run.smithi134.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 853 kB/s | 384 kB 00:00 2023-12-05T09:13:54.033 INFO:teuthology.orchestra.run.smithi134.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 343 kB/s | 49 kB 00:00 2023-12-05T09:13:54.083 INFO:teuthology.orchestra.run.smithi134.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 414 kB/s | 59 kB 00:00 2023-12-05T09:13:54.094 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-05T09:13:54.192 INFO:teuthology.orchestra.run.smithi134.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 98 kB/s | 16 kB 00:00 2023-12-05T09:13:54.217 INFO:teuthology.orchestra.run.smithi134.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 140 kB/s | 19 kB 00:00 2023-12-05T09:13:54.242 INFO:teuthology.orchestra.run.smithi134.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-12-05T09:13:54.317 INFO:teuthology.orchestra.run.smithi134.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 191 kB/s | 24 kB 00:00 2023-12-05T09:13:54.351 INFO:teuthology.orchestra.run.smithi134.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 219 kB/s | 29 kB 00:00 2023-12-05T09:13:54.368 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-05T09:13:54.377 INFO:teuthology.orchestra.run.smithi134.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 206 kB/s | 27 kB 00:00 2023-12-05T09:13:54.518 INFO:teuthology.orchestra.run.smithi134.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 604 kB/s | 85 kB 00:00 2023-12-05T09:13:54.546 INFO:teuthology.orchestra.run.smithi134.stdout:(30/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.1 MB/s | 255 kB 00:00 2023-12-05T09:13:54.569 INFO:teuthology.orchestra.run.smithi134.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.1 MB/s | 251 kB 00:00 2023-12-05T09:13:54.617 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-05T09:13:54.644 INFO:teuthology.orchestra.run.smithi134.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 183 kB/s | 23 kB 00:00 2023-12-05T09:13:54.648 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:13:54.648 INFO:teuthology.orchestra.run.smithi134.stdout:Total 8.5 MB/s | 28 MB 00:03 2023-12-05T09:13:54.835 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:13:54.857 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-05T09:13:54.877 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:13:54.877 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:13:55.204 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-05T09:13:55.210 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:13:55.213 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:13:55.415 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-05T09:13:55.661 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-05T09:13:55.831 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-05T09:13:56.099 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-05T09:13:56.303 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:13:56.384 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-05T09:13:56.570 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-05T09:13:56.614 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-05T09:13:56.796 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-05T09:13:56.832 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-05T09:13:57.040 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-05T09:13:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-05T09:13:57.321 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-05T09:13:57.487 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-05T09:13:57.548 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-05T09:13:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-05T09:13:57.758 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-05T09:13:57.873 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-05T09:13:57.987 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-05T09:13:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-05T09:13:58.202 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T09:13:58.258 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-05T09:13:58.544 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-05T09:13:58.588 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-05T09:13:58.782 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-05T09:13:59.016 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-05T09:13:59.386 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-05T09:13:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-05T09:13:59.573 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-05T09:13:59.701 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-05T09:13:59.781 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-05T09:13:59.870 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-05T09:14:00.053 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-05T09:14:00.102 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-05T09:14:00.307 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-05T09:14:00.313 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T09:14:00.582 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-05T09:14:00.666 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-05T09:14:00.885 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-05T09:14:00.979 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-05T09:14:01.065 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-05T09:14:01.250 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-05T09:14:01.355 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-05T09:14:01.520 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-05T09:14:01.776 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 27/32 2023-12-05T09:14:01.793 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-05T09:14:01.985 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T09:14:02.090 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-05T09:14:02.435 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-05T09:14:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-05T09:14:03.705 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T09:14:03.719 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 27/32 2023-12-05T09:14:03.910 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T09:14:03.927 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T09:14:04.446 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T09:14:04.798 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T09:14:05.070 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T09:14:05.215 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T09:14:05.259 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T09:14:05.406 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T09:14:05.511 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T09:14:05.511 INFO:teuthology.orchestra.run.smithi067.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-05T09:14:05.511 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:05.525 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 28/32 2023-12-05T09:14:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T09:14:06.067 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 6/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-05T09:14:06.068 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-05T09:14:06.069 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-05T09:14:06.070 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-05T09:14:06.070 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-05T09:14:06.070 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-05T09:14:06.070 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-05T09:14:06.197 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 29/32 2023-12-05T09:14:06.388 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T09:14:06.649 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 30/32 2023-12-05T09:14:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T09:14:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 31/32 2023-12-05T09:14:06.984 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T09:14:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 32/32 2023-12-05T09:14:07.094 INFO:teuthology.orchestra.run.smithi134.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-05T09:14:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:07.315 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-05T09:14:07.315 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:07.315 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:14:07.315 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-05T09:14:07.316 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-2.6-1.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-05T09:14:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-05T09:14:07.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-05T09:14:07.318 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-05T09:14:07.318 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:07.318 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:14:07.577 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-base 2023-12-05T09:14:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 3/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 4/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 5/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.n 6/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-05T09:14:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-05T09:14:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-05T09:14:08.698 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:28 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:08.808 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-05T09:14:08.809 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-2.6-1.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:08.810 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:14:09.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2023-12-05T09:14:10.077 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:22 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:14:10.357 INFO:teuthology.orchestra.run.smithi067.stdout:Package ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:14:10.614 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:14:10.616 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:14:10.616 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:14:10.741 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install cephadm 2023-12-05T09:14:11.591 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:14:11.835 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:14:11.837 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:14:11.837 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:14:11.856 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:31 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:14:11.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2023-12-05T09:14:13.047 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:25 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:14:13.893 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:14:13.894 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:13.894 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 80 k 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 80 k 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 364 k 2023-12-05T09:14:13.895 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:14:14.077 INFO:teuthology.orchestra.run.smithi067.stdout:cephadm-17.2.7-109.g1fd3ca3c.el8.noarch.rpm 441 kB/s | 80 kB 00:00 2023-12-05T09:14:14.078 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:14.078 INFO:teuthology.orchestra.run.smithi067.stdout:Total 437 kB/s | 80 kB 00:00 2023-12-05T09:14:14.078 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:14:14.090 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:14:14.090 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:14:14.093 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:14:14.096 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:14:14.171 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:14:14.850 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 80 k 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-05T09:14:14.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 80 k 2023-12-05T09:14:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 364 k 2023-12-05T09:14:14.852 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:14:15.058 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-17.2.7-109.g1fd3ca3c.el8.noarch.rpm 391 kB/s | 80 kB 00:00 2023-12-05T09:14:15.059 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:15.059 INFO:teuthology.orchestra.run.smithi134.stdout:Total 387 kB/s | 80 kB 00:00 2023-12-05T09:14:15.060 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:14:15.070 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:14:15.070 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:14:15.074 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:14:15.077 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:14:15.121 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:14:15.684 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:14:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:14:16.140 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:14:16.270 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:14:16.414 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:14:16.721 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:14:16.847 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:14:16.847 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:16.847 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:14:16.848 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:16.848 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:16.848 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:14:17.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2023-12-05T09:14:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/1 2023-12-05T09:14:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:17.474 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:14:17.474 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:17.474 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:17.474 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:14:17.708 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-immutable-object-cache 2023-12-05T09:14:18.177 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:30 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:14:18.826 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:38 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:14:19.926 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 162 k 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-05T09:14:19.927 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:19.928 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 162 k 2023-12-05T09:14:19.928 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 490 k 2023-12-05T09:14:19.928 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:14:20.412 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-17.2.7-109.g1fd3ca3 335 kB/s | 162 kB 00:00 2023-12-05T09:14:20.413 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:20.413 INFO:teuthology.orchestra.run.smithi134.stdout:Total 333 kB/s | 162 kB 00:00 2023-12-05T09:14:20.414 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:14:20.429 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:14:20.429 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:14:20.489 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:14:20.492 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:14:20.619 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:14:20.709 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 162 k 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-12-05T09:14:20.710 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:20.711 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 162 k 2023-12-05T09:14:20.711 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 490 k 2023-12-05T09:14:20.711 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:14:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:14:20.915 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-immutable-object-cache-17.2.7-109.g1fd3ca3 795 kB/s | 162 kB 00:00 2023-12-05T09:14:20.916 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:20.916 INFO:teuthology.orchestra.run.smithi067.stdout:Total 789 kB/s | 162 kB 00:00 2023-12-05T09:14:20.916 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:14:20.931 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:14:20.931 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:14:20.988 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:14:20.992 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:14:21.115 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:14:21.321 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:14:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:14:21.990 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:14:22.216 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:14:22.216 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:22.216 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:14:22.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:22.216 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:22.216 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:14:22.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2023-12-05T09:14:22.752 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.e 1/1 2023-12-05T09:14:22.752 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:22.752 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:14:22.752 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:14:22.752 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:22.753 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:14:22.976 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr 2023-12-05T09:14:23.493 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:35 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:14:24.095 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:44 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:14:24.995 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:14:25.233 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:14:25.234 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:14:25.234 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:14:25.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2023-12-05T09:14:25.802 INFO:teuthology.orchestra.run.smithi067.stdout:Package ceph-mgr-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:14:26.057 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:14:26.058 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:14:26.058 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:14:26.191 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-dashboard 2023-12-05T09:14:26.430 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:38 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:14:27.302 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:47 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:14:28.183 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:14:28.184 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:28.184 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 1.7 M 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 23 k 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 14 k 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2023-12-05T09:14:28.185 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:28.186 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 2.0 M 2023-12-05T09:14:28.186 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 8.0 M 2023-12-05T09:14:28.186 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:14:28.864 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): ceph-prometheus-alerts-17.2.7-109.g1fd3c 34 kB/s | 14 kB 00:00 2023-12-05T09:14:28.889 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-grafana-dashboards-17.2.7-109.g1fd3 51 kB/s | 23 kB 00:00 2023-12-05T09:14:29.114 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 170 kB/s | 43 kB 00:00 2023-12-05T09:14:29.201 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 1.7 M 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 23 k 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 14 k 2023-12-05T09:14:29.202 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-05T09:14:29.203 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-05T09:14:29.203 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-05T09:14:29.203 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:29.203 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:14:29.203 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:29.203 INFO:teuthology.orchestra.run.smithi067.stdout:Install 6 Packages 2023-12-05T09:14:29.203 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:29.203 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 2.0 M 2023-12-05T09:14:29.204 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 8.0 M 2023-12-05T09:14:29.204 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:14:29.373 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 70 kB/s | 34 kB 00:00 2023-12-05T09:14:29.415 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): ceph-mgr-dashboard-17.2.7-109.g1fd3ca3c. 1.7 MB/s | 1.7 MB 00:00 2023-12-05T09:14:29.627 INFO:teuthology.orchestra.run.smithi067.stdout:(1/6): ceph-grafana-dashboards-17.2.7-109.g1fd3 124 kB/s | 23 kB 00:00 2023-12-05T09:14:29.794 INFO:teuthology.orchestra.run.smithi067.stdout:(2/6): ceph-prometheus-alerts-17.2.7-109.g1fd3c 41 kB/s | 14 kB 00:00 2023-12-05T09:14:29.807 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 284 kB/s | 196 kB 00:00 2023-12-05T09:14:29.810 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:29.811 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.2 MB/s | 2.0 MB 00:01 2023-12-05T09:14:29.837 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:14:29.850 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:14:29.850 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:14:29.861 INFO:teuthology.orchestra.run.smithi067.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 183 kB/s | 43 kB 00:00 2023-12-05T09:14:29.951 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:14:29.954 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:14:29.970 INFO:teuthology.orchestra.run.smithi067.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 192 kB/s | 34 kB 00:00 2023-12-05T09:14:30.161 INFO:teuthology.orchestra.run.smithi067.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 655 kB/s | 196 kB 00:00 2023-12-05T09:14:30.242 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:14:30.253 INFO:teuthology.orchestra.run.smithi067.stdout:(6/6): ceph-mgr-dashboard-17.2.7-109.g1fd3ca3c. 2.1 MB/s | 1.7 MB 00:00 2023-12-05T09:14:30.257 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:30.257 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2023-12-05T09:14:30.282 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:14:30.296 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:14:30.296 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:14:30.405 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:14:30.409 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:14:30.467 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-05T09:14:30.698 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:14:30.886 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-05T09:14:30.908 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-05T09:14:31.108 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-05T09:14:31.193 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-05T09:14:31.239 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 4/6 2023-12-05T09:14:31.414 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-05T09:14:31.610 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 5/6 2023-12-05T09:14:31.796 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 4/6 2023-12-05T09:14:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T09:14:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T09:14:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 1/6 2023-12-05T09:14:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2/6 2023-12-05T09:14:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 3/6 2023-12-05T09:14:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-05T09:14:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-05T09:14:32.191 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 5/6 2023-12-05T09:14:32.373 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T09:14:32.723 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 6/6 2023-12-05T09:14:32.723 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.n 1/6 2023-12-05T09:14:32.723 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2/6 2023-12-05T09:14:32.723 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.no 3/6 2023-12-05T09:14:32.723 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-05T09:14:32.723 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-05T09:14:32.858 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:32.859 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:14:33.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-05T09:14:33.573 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:33.574 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:14:33.739 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-05T09:14:34.104 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:46 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:14:34.852 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:54 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:14:35.867 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================================ 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================================ 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 7.4 M 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-05T09:14:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-05T09:14:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-05T09:14:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:35.870 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:14:35.870 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================================ 2023-12-05T09:14:35.870 INFO:teuthology.orchestra.run.smithi134.stdout:Install 8 Packages 2023-12-05T09:14:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:35.870 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 35 M 2023-12-05T09:14:35.871 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 210 M 2023-12-05T09:14:35.871 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:14:36.632 INFO:teuthology.orchestra.run.smithi134.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 7.0 MB/s | 4.7 MB 00:00 2023-12-05T09:14:36.724 INFO:teuthology.orchestra.run.smithi134.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 6.3 MB/s | 4.9 MB 00:00 2023-12-05T09:14:36.738 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================ 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================ 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 7.4 M 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-05T09:14:36.740 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:36.741 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:14:36.741 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================================ 2023-12-05T09:14:36.741 INFO:teuthology.orchestra.run.smithi067.stdout:Install 8 Packages 2023-12-05T09:14:36.741 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:36.741 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 35 M 2023-12-05T09:14:36.741 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 210 M 2023-12-05T09:14:36.741 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:14:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.8 MB/s | 225 kB 00:00 2023-12-05T09:14:36.966 INFO:teuthology.orchestra.run.smithi134.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 11 MB/s | 3.7 MB 00:00 2023-12-05T09:14:37.058 INFO:teuthology.orchestra.run.smithi134.stdout:(5/8): ceph-mgr-diskprediction-local-17.2.7-109 6.7 MB/s | 7.4 MB 00:01 2023-12-05T09:14:37.250 INFO:teuthology.orchestra.run.smithi134.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 899 kB/s | 172 kB 00:00 2023-12-05T09:14:37.284 INFO:teuthology.orchestra.run.smithi134.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2023-12-05T09:14:37.577 INFO:teuthology.orchestra.run.smithi134.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 17 MB/s | 14 MB 00:00 2023-12-05T09:14:37.578 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:37.578 INFO:teuthology.orchestra.run.smithi134.stdout:Total 21 MB/s | 35 MB 00:01 2023-12-05T09:14:37.620 INFO:teuthology.orchestra.run.smithi067.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 7.4 MB/s | 4.7 MB 00:00 2023-12-05T09:14:37.695 INFO:teuthology.orchestra.run.smithi067.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 6.8 MB/s | 4.9 MB 00:00 2023-12-05T09:14:37.754 INFO:teuthology.orchestra.run.smithi067.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.8 MB/s | 225 kB 00:00 2023-12-05T09:14:37.903 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:14:37.926 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:14:37.926 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:14:37.975 INFO:teuthology.orchestra.run.smithi067.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 11 MB/s | 3.7 MB 00:00 2023-12-05T09:14:38.105 INFO:teuthology.orchestra.run.smithi067.stdout:(5/8): ceph-mgr-diskprediction-local-17.2.7-109 6.6 MB/s | 7.4 MB 00:01 2023-12-05T09:14:38.345 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:14:38.346 INFO:teuthology.orchestra.run.smithi067.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 714 kB/s | 172 kB 00:00 2023-12-05T09:14:38.348 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:14:38.480 INFO:teuthology.orchestra.run.smithi067.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.2 MB/s | 645 kB 00:00 2023-12-05T09:14:38.730 INFO:teuthology.orchestra.run.smithi067.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 14 MB/s | 14 MB 00:00 2023-12-05T09:14:38.731 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:38.731 INFO:teuthology.orchestra.run.smithi067.stdout:Total 18 MB/s | 35 MB 00:01 2023-12-05T09:14:38.939 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:14:39.067 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:14:39.090 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:14:39.090 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:14:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T09:14:39.264 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T09:14:39.396 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T09:14:39.556 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:14:39.560 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:14:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T09:14:40.207 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:14:40.238 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:14:40.343 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T09:14:40.535 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-05T09:14:40.676 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T09:14:40.919 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:14:41.054 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T09:14:41.414 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-05T09:14:41.568 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:14:41.862 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T09:14:42.205 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T09:14:42.297 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:14:42.401 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T09:14:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T09:14:43.278 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-05T09:14:43.648 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T09:14:43.909 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T09:14:44.519 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T09:14:45.858 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-05T09:14:46.078 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-05T09:14:46.120 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T09:14:46.533 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T09:14:46.533 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 1/8 2023-12-05T09:14:46.533 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-05T09:14:46.534 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:14:46.534 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-05T09:14:46.534 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T09:14:46.534 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-05T09:14:46.534 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-05T09:14:47.489 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-05T09:14:47.522 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-05T09:14:47.522 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:47.522 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:14:47.522 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:47.523 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:14:47.692 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T09:14:47.709 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2023-12-05T09:14:48.118 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 8/8 2023-12-05T09:14:48.118 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c 1/8 2023-12-05T09:14:48.119 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-05T09:14:48.119 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-05T09:14:48.119 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-05T09:14:48.119 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-05T09:14:48.119 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-05T09:14:48.119 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-05T09:14:48.757 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:00 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:14:48.966 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-05T09:14:48.966 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:48.967 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:14:49.151 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-rook 2023-12-05T09:14:50.247 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:10 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:14:50.629 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:14:50.630 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 47 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-05T09:14:50.631 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-05T09:14:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-05T09:14:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:50.632 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:14:50.632 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:14:50.632 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2023-12-05T09:14:50.632 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:14:50.632 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 1.9 M 2023-12-05T09:14:50.632 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 25 M 2023-12-05T09:14:50.633 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:14:51.155 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 230 kB/s | 27 kB 00:00 2023-12-05T09:14:51.180 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 142 kB/s | 20 kB 00:00 2023-12-05T09:14:51.263 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-12-05T09:14:51.289 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): ceph-mgr-rook-17.2.7-109.g1fd3ca3c.el8. 190 kB/s | 47 kB 00:00 2023-12-05T09:14:51.314 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 823 kB/s | 110 kB 00:00 2023-12-05T09:14:51.448 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 320 kB/s | 43 kB 00:00 2023-12-05T09:14:51.506 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 639 kB/s | 155 kB 00:00 2023-12-05T09:14:52.189 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:14:52.191 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:52.191 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:14:52.191 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:52.191 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:14:52.191 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 47 k 2023-12-05T09:14:52.191 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:52.192 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:14:52.193 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:14:52.193 INFO:teuthology.orchestra.run.smithi067.stdout:Install 13 Packages 2023-12-05T09:14:52.193 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:52.193 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 1.9 M 2023-12-05T09:14:52.193 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 25 M 2023-12-05T09:14:52.193 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:14:52.702 INFO:teuthology.orchestra.run.smithi067.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 226 kB/s | 27 kB 00:00 2023-12-05T09:14:52.727 INFO:teuthology.orchestra.run.smithi067.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 140 kB/s | 20 kB 00:00 2023-12-05T09:14:52.853 INFO:teuthology.orchestra.run.smithi067.stdout:(3/13): ceph-mgr-rook-17.2.7-109.g1fd3ca3c.el8. 176 kB/s | 47 kB 00:00 2023-12-05T09:14:52.878 INFO:teuthology.orchestra.run.smithi067.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 732 kB/s | 110 kB 00:00 2023-12-05T09:14:52.903 INFO:teuthology.orchestra.run.smithi067.stdout:(5/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 630 kB/s | 126 kB 00:00 2023-12-05T09:14:53.020 INFO:teuthology.orchestra.run.smithi067.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 300 kB/s | 43 kB 00:00 2023-12-05T09:14:53.045 INFO:teuthology.orchestra.run.smithi067.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 806 kB/s | 155 kB 00:00 2023-12-05T09:14:53.163 INFO:teuthology.orchestra.run.smithi067.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 127 kB/s | 33 kB 00:00 2023-12-05T09:14:53.238 INFO:teuthology.orchestra.run.smithi067.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 75 kB/s | 16 kB 00:00 2023-12-05T09:14:53.371 INFO:teuthology.orchestra.run.smithi067.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 249 kB/s | 81 kB 00:00 2023-12-05T09:14:53.397 INFO:teuthology.orchestra.run.smithi067.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 405 kB/s | 64 kB 00:00 2023-12-05T09:14:53.472 INFO:teuthology.orchestra.run.smithi067.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 612 kB/s | 61 kB 00:00 2023-12-05T09:14:53.514 INFO:teuthology.orchestra.run.smithi067.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 3.3 MB/s | 1.2 MB 00:00 2023-12-05T09:14:53.517 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:14:53.517 INFO:teuthology.orchestra.run.smithi067.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2023-12-05T09:14:53.662 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:14:53.683 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:14:53.683 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:14:53.795 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:14:53.799 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:14:54.491 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:14:54.746 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-05T09:14:54.924 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-05T09:14:55.166 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-05T09:14:55.433 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-05T09:14:55.618 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-05T09:14:55.633 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-cachetools-3.1.1-4.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for https://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-cachetools-3.1.1-4.el8.noarch.rpm [OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 104] 2023-12-05T09:14:55.769 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-certifi-2018.10.15-7.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for https://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-certifi-2018.10.15-7.el8.noarch.rpm [OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 104] 2023-12-05T09:14:55.831 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-google-auth-1.1.1-10.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for https://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-google-auth-1.1.1-10.el8.noarch.rpm [OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 104] 2023-12-05T09:14:55.891 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-05T09:14:56.224 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-05T09:14:56.494 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-05T09:14:57.768 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-05T09:14:58.024 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-05T09:14:58.250 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-05T09:14:58.530 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-05T09:14:58.707 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-05T09:14:59.073 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-05T09:14:59.074 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-05T09:14:59.074 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-05T09:14:59.074 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-05T09:14:59.954 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-05T09:14:59.954 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:59.954 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:14:59.954 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:14:59.954 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-05T09:14:59.954 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-05T09:14:59.954 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-05T09:14:59.954 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:14:59.955 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:00.114 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-mgr-cephadm 2023-12-05T09:15:01.236 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:21 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:03.135 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:03.136 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:03.136 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 121 k 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout:Install 5 Packages 2023-12-05T09:15:03.137 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:03.138 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 6.0 M 2023-12-05T09:15:03.138 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 26 M 2023-12-05T09:15:03.138 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:15:03.714 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-cachetools-3.1.1-4.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-cachetools-3.1.1-4.el8.noarch.rpm [Failed to connect to mirror.facebook.net port 80: Connection refused] 2023-12-05T09:15:03.850 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-certifi-2018.10.15-7.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-certifi-2018.10.15-7.el8.noarch.rpm [Failed to connect to mirror.facebook.net port 80: Connection refused] 2023-12-05T09:15:03.931 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 2.6 kB/s | 33 kB 00:12 2023-12-05T09:15:03.931 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-google-auth-1.1.1-10.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-google-auth-1.1.1-10.el8.noarch.rpm [Failed to connect to mirror.facebook.net port 80: Connection refused] 2023-12-05T09:15:04.032 INFO:teuthology.orchestra.run.smithi067.stdout:(1/5): ceph-mgr-cephadm-17.2.7-109.g1fd3ca3c.el 537 kB/s | 121 kB 00:00 2023-12-05T09:15:04.081 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 1.3 kB/s | 16 kB 00:12 2023-12-05T09:15:04.082 INFO:teuthology.orchestra.run.smithi067.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.9 MB/s | 538 kB 00:00 2023-12-05T09:15:04.106 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 6.4 kB/s | 81 kB 00:12 2023-12-05T09:15:04.315 INFO:teuthology.orchestra.run.smithi067.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 9.4 MB/s | 4.8 MB 00:00 2023-12-05T09:15:04.341 INFO:teuthology.orchestra.run.smithi067.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 233 kB/s | 60 kB 00:00 2023-12-05T09:15:04.541 INFO:teuthology.orchestra.run.smithi067.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 935 kB/s | 476 kB 00:00 2023-12-05T09:15:04.542 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:04.542 INFO:teuthology.orchestra.run.smithi067.stdout:Total 4.2 MB/s | 6.0 MB 00:01 2023-12-05T09:15:04.628 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:15:04.644 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:15:04.644 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:15:04.822 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:15:04.826 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:15:05.156 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:15:05.561 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-05T09:15:06.654 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-05T09:15:07.025 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-05T09:15:07.317 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-05T09:15:07.515 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T09:15:07.909 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T09:15:07.910 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/5 2023-12-05T09:15:07.910 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-05T09:15:07.910 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-05T09:15:07.910 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:08.964 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:09.131 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-fuse 2023-12-05T09:15:10.241 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:30 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:12.012 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-kubernetes-11.0.0-6.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-kubernetes-11.0.0-6.el8.noarch.rpm [Failed to connect to mirror.facebook.net port 80: Connection refused] 2023-12-05T09:15:12.146 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:12.147 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:12.147 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-12-05T09:15:12.147 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:12.147 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:15:12.147 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 875 k 2023-12-05T09:15:12.147 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-12-05T09:15:12.148 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-05T09:15:12.148 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:12.148 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:15:12.148 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:12.148 INFO:teuthology.orchestra.run.smithi067.stdout:Install 2 Packages 2023-12-05T09:15:12.148 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:12.148 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 958 k 2023-12-05T09:15:12.149 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 3.0 M 2023-12-05T09:15:12.149 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:15:12.172 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-rsa-4.9-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-rsa-4.9-2.el8.noarch.rpm [Failed to connect to mirror.facebook.net port 80: Connection refused] 2023-12-05T09:15:12.185 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-websocket-client-0.56.0-5.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-websocket-client-0.56.0-5.el8.noarch.rpm [Failed to connect to mirror.facebook.net port 80: Connection refused] 2023-12-05T09:15:12.499 INFO:teuthology.orchestra.run.smithi067.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 504 kB/s | 83 kB 00:00 2023-12-05T09:15:12.607 INFO:teuthology.orchestra.run.smithi067.stdout:(2/2): ceph-fuse-17.2.7-109.g1fd3ca3c.el8.x86_6 3.1 MB/s | 875 kB 00:00 2023-12-05T09:15:12.608 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:12.608 INFO:teuthology.orchestra.run.smithi067.stdout:Total 2.0 MB/s | 958 kB 00:00 2023-12-05T09:15:12.634 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:15:12.660 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:15:12.660 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:15:12.770 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:15:12.773 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:15:12.996 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:15:13.939 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-05T09:15:14.174 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T09:15:14.814 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T09:15:14.814 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/2 2023-12-05T09:15:15.553 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-05T09:15:15.553 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:15.553 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:15:15.554 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-05T09:15:15.554 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:15.554 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:15.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librados-devel 2023-12-05T09:15:16.332 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-kubernetes-11.0.0-6.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for https://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-kubernetes-11.0.0-6.el8.noarch.rpm [OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 104] 2023-12-05T09:15:16.496 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-rsa-4.9-2.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for https://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-rsa-4.9-2.el8.noarch.rpm [OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 104] 2023-12-05T09:15:16.509 INFO:teuthology.orchestra.run.smithi134.stdout:[MIRROR] python3-websocket-client-0.56.0-5.el8.noarch.rpm: Curl error (56): Failure when receiving data from the peer for https://mirror.facebook.net/fedora/epel/8/Everything/x86_64/Packages/p/python3-websocket-client-0.56.0-5.el8.noarch.rpm [OpenSSL SSL_read: SSL_ERROR_SYSCALL, errno 104] 2023-12-05T09:15:16.681 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 5.1 kB/s | 64 kB 00:12 2023-12-05T09:15:16.756 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 4.8 kB/s | 61 kB 00:12 2023-12-05T09:15:16.915 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 92 kB/s | 1.2 MB 00:12 2023-12-05T09:15:16.915 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:16.916 INFO:teuthology.orchestra.run.smithi134.stdout:Total 75 kB/s | 1.9 MB 00:26 2023-12-05T09:15:16.963 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:36 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:17.057 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:15:17.078 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:15:17.078 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:15:17.185 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:15:17.188 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:15:17.824 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:15:18.821 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-05T09:15:18.938 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:18.939 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:18.939 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2023-12-05T09:15:18.940 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:18.940 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:15:18.940 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 130 k 2023-12-05T09:15:18.940 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:18.940 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:15:18.940 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:18.941 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-12-05T09:15:18.941 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:18.941 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 130 k 2023-12-05T09:15:18.941 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 464 k 2023-12-05T09:15:18.942 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:15:19.008 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-05T09:15:19.233 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-05T09:15:19.449 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-05T09:15:19.515 INFO:teuthology.orchestra.run.smithi067.stdout:librados-devel-17.2.7-109.g1fd3ca3c.el8.x86_64. 226 kB/s | 130 kB 00:00 2023-12-05T09:15:19.515 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:19.516 INFO:teuthology.orchestra.run.smithi067.stdout:Total 226 kB/s | 130 kB 00:00 2023-12-05T09:15:19.516 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:15:19.525 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:15:19.526 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:15:19.590 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:15:19.594 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:15:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-05T09:15:19.740 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:15:19.881 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-05T09:15:20.012 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:20.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-05T09:15:20.387 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:20.483 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-05T09:15:21.124 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:21.124 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:21.124 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:15:21.124 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:15:21.124 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:21.124 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:21.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install libcephfs2 2023-12-05T09:15:21.708 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-05T09:15:21.972 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-05T09:15:22.173 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-05T09:15:22.418 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-05T09:15:22.494 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:42 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:22.589 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 13/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-05T09:15:22.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-05T09:15:22.959 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-05T09:15:23.803 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-05T09:15:23.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-05T09:15:23.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-05T09:15:23.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-05T09:15:23.804 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-05T09:15:23.804 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:23.804 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:23.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2023-12-05T09:15:24.316 INFO:teuthology.orchestra.run.smithi067.stdout:Package libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:24.580 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:24.580 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:15:24.580 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:24.696 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install libcephfs-devel 2023-12-05T09:15:25.030 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:37 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:25.811 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:45 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:26.787 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:15:26.788 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:26.788 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:15:26.788 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:26.788 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:15:26.788 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:17.2.7-109.g1fd3ca3c.el8 ceph-noarch 121 k 2023-12-05T09:15:26.788 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:15:26.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-05T09:15:26.788 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-05T09:15:26.789 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-05T09:15:26.789 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-05T09:15:26.789 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:26.789 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:15:26.789 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:26.789 INFO:teuthology.orchestra.run.smithi134.stdout:Install 5 Packages 2023-12-05T09:15:26.789 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:26.789 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 6.0 M 2023-12-05T09:15:26.790 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 26 M 2023-12-05T09:15:26.790 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:15:27.115 INFO:teuthology.orchestra.run.smithi134.stdout:(1/5): ceph-mgr-cephadm-17.2.7-109.g1fd3ca3c.el 621 kB/s | 121 kB 00:00 2023-12-05T09:15:27.199 INFO:teuthology.orchestra.run.smithi134.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.9 MB/s | 538 kB 00:00 2023-12-05T09:15:27.424 INFO:teuthology.orchestra.run.smithi134.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 9.5 MB/s | 4.8 MB 00:00 2023-12-05T09:15:27.441 INFO:teuthology.orchestra.run.smithi134.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 250 kB/s | 60 kB 00:00 2023-12-05T09:15:27.591 INFO:teuthology.orchestra.run.smithi134.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.0 MB/s | 476 kB 00:00 2023-12-05T09:15:27.593 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:27.593 INFO:teuthology.orchestra.run.smithi134.stdout:Total 7.4 MB/s | 6.0 MB 00:00 2023-12-05T09:15:27.673 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:15:27.688 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:15:27.688 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:15:27.708 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:27.709 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:27.709 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2023-12-05T09:15:27.709 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:27.709 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:15:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 25 k 2023-12-05T09:15:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:27.710 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:15:27.710 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:27.710 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-12-05T09:15:27.710 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:27.711 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 25 k 2023-12-05T09:15:27.711 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 109 k 2023-12-05T09:15:27.711 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:15:27.807 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:15:27.811 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:15:27.934 INFO:teuthology.orchestra.run.smithi067.stdout:libcephfs-devel-17.2.7-109.g1fd3ca3c.el8.x86_64 111 kB/s | 25 kB 00:00 2023-12-05T09:15:27.934 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:27.935 INFO:teuthology.orchestra.run.smithi067.stdout:Total 110 kB/s | 25 kB 00:00 2023-12-05T09:15:27.935 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:15:27.940 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:15:27.940 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:15:27.945 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:15:27.948 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:15:28.000 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:15:28.128 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:15:28.230 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:28.480 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-05T09:15:28.550 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:29.241 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:29.242 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:29.242 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:15:29.242 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:15:29.242 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:29.242 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:29.400 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librados2 2023-12-05T09:15:29.517 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-05T09:15:29.892 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-05T09:15:30.181 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-05T09:15:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T09:15:30.529 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:50 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:30.783 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 5/5 2023-12-05T09:15:30.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 1/5 2023-12-05T09:15:30.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-05T09:15:30.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-05T09:15:30.783 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-05T09:15:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-05T09:15:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:31.518 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:15:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:17.2.7-109.g1fd3ca3c.el8.noarch 2023-12-05T09:15:31.518 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-05T09:15:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-05T09:15:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-05T09:15:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-05T09:15:31.519 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:31.519 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:31.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2023-12-05T09:15:32.173 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:32.436 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:32.438 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:15:32.438 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:32.557 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install librbd1 2023-12-05T09:15:32.748 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:44 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:33.680 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:53 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:34.509 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:15:34.510 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:34.510 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-05T09:15:34.510 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:34.510 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:15:34.510 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 875 k 2023-12-05T09:15:34.511 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-05T09:15:34.511 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-05T09:15:34.511 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:34.511 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:15:34.511 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:34.511 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2023-12-05T09:15:34.511 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:34.512 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 958 k 2023-12-05T09:15:34.512 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 3.0 M 2023-12-05T09:15:34.512 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:15:34.896 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 276 kB/s | 83 kB 00:00 2023-12-05T09:15:34.932 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): ceph-fuse-17.2.7-109.g1fd3ca3c.el8.x86_6 2.5 MB/s | 875 kB 00:00 2023-12-05T09:15:34.933 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:34.933 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.2 MB/s | 958 kB 00:00 2023-12-05T09:15:34.957 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:15:34.982 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:15:34.982 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:15:35.086 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:15:35.090 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:15:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:15:35.295 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-05T09:15:35.555 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:35.557 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:15:35.557 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:35.706 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rados 2023-12-05T09:15:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T09:15:36.368 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2/2 2023-12-05T09:15:36.369 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/2 2023-12-05T09:15:36.828 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:56 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:37.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-05T09:15:37.070 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:37.070 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:15:37.070 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-05T09:15:37.070 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:37.070 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:37.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2023-12-05T09:15:38.408 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:50 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:38.450 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:38.709 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:15:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:38.836 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rgw 2023-12-05T09:15:39.964 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:02:59 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:40.191 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:15:40.191 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:40.191 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 130 k 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:40.192 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 130 k 2023-12-05T09:15:40.193 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 464 k 2023-12-05T09:15:40.193 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:15:40.536 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-17.2.7-109.g1fd3ca3c.el8.x86_64. 379 kB/s | 130 kB 00:00 2023-12-05T09:15:40.536 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:40.537 INFO:teuthology.orchestra.run.smithi134.stdout:Total 377 kB/s | 130 kB 00:00 2023-12-05T09:15:40.537 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:15:40.544 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:15:40.545 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:15:40.601 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:15:40.605 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:15:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:15:40.968 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:41.345 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:41.575 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:41.836 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:41.837 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:15:41.837 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:41.955 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-cephfs 2023-12-05T09:15:42.096 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:42.097 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:42.097 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:15:42.097 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:15:42.097 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:42.097 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:42.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2023-12-05T09:15:43.073 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:03 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:43.372 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:55 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:44.717 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:44.972 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:44.973 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:15:44.973 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:45.088 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install python3-rbd 2023-12-05T09:15:45.151 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:15:45.153 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:15:45.153 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:45.286 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2023-12-05T09:15:46.208 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:06 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:46.361 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:58 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:47.832 INFO:teuthology.orchestra.run.smithi067.stdout:Package python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:48.090 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:48.091 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-12-05T09:15:48.091 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:48.119 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:15:48.119 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:48.119 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-05T09:15:48.119 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:48.119 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 25 k 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 25 k 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 109 k 2023-12-05T09:15:48.120 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:15:48.219 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-fuse 2023-12-05T09:15:48.338 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-17.2.7-109.g1fd3ca3c.el8.x86_64 114 kB/s | 25 kB 00:00 2023-12-05T09:15:48.339 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:48.339 INFO:teuthology.orchestra.run.smithi134.stdout:Total 114 kB/s | 25 kB 00:00 2023-12-05T09:15:48.339 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:15:48.344 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:15:48.344 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:15:48.348 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:15:48.351 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:15:48.403 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:15:48.576 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:48.871 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:49.339 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:09 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:49.549 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:15:49.550 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:49.786 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2023-12-05T09:15:50.850 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:02 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:51.230 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:51.230 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:51.230 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2023-12-05T09:15:51.230 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 90 k 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 90 k 2023-12-05T09:15:51.231 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 264 k 2023-12-05T09:15:51.232 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:15:51.524 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-fuse-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 309 kB/s | 90 kB 00:00 2023-12-05T09:15:51.524 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:51.525 INFO:teuthology.orchestra.run.smithi067.stdout:Total 307 kB/s | 90 kB 00:00 2023-12-05T09:15:51.525 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:15:51.538 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:15:51.538 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:15:51.599 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:15:51.602 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:15:51.716 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:15:51.934 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:52.324 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:52.385 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:52.630 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:15:52.631 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:15:52.631 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:52.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2023-12-05T09:15:53.067 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:53.067 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:53.067 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:15:53.067 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:15:53.067 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:53.067 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:15:53.337 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-mirror 2023-12-05T09:15:53.832 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:05 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:54.460 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:14 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:15:55.371 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:55.614 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:15:55.615 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:15:55.616 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:55.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2023-12-05T09:15:56.326 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:15:56.327 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:56.327 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repo Size 2023-12-05T09:15:56.327 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:56.327 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:15:56.328 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T09:15:56.328 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:56.328 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:15:56.328 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:15:56.328 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-12-05T09:15:56.328 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:56.328 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 3.5 M 2023-12-05T09:15:56.328 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 16 M 2023-12-05T09:15:56.329 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:15:56.821 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:08 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:57.269 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-mirror-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 3.7 MB/s | 3.5 MB 00:00 2023-12-05T09:15:57.269 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:15:57.270 INFO:teuthology.orchestra.run.smithi067.stdout:Total 3.7 MB/s | 3.5 MB 00:00 2023-12-05T09:15:57.270 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:15:57.288 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:15:57.288 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:15:57.367 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:15:57.371 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:15:58.039 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:15:58.320 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:58.331 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:15:58.571 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:15:58.573 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:15:58.573 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:15:58.709 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2023-12-05T09:15:59.148 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:59.783 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:11 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:15:59.897 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:15:59.897 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:59.897 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:15:59.897 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:15:59.897 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:15:59.897 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:16:00.134 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install rbd-nbd 2023-12-05T09:16:01.253 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:03:21 ago on Tue 05 Dec 2023 09:12:40 AM UTC. 2023-12-05T09:16:01.291 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:16:01.531 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:16:01.533 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:16:01.533 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:16:01.664 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2023-12-05T09:16:02.733 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:14 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:16:03.129 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 173 k 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2023-12-05T09:16:03.130 INFO:teuthology.orchestra.run.smithi067.stdout:Install 1 Package 2023-12-05T09:16:03.131 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:16:03.131 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 173 k 2023-12-05T09:16:03.131 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 552 k 2023-12-05T09:16:03.131 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-12-05T09:16:03.465 INFO:teuthology.orchestra.run.smithi067.stdout:rbd-nbd-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 522 kB/s | 173 kB 00:00 2023-12-05T09:16:03.465 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:16:03.465 INFO:teuthology.orchestra.run.smithi067.stdout:Total 519 kB/s | 173 kB 00:00 2023-12-05T09:16:03.465 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-12-05T09:16:03.479 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-12-05T09:16:03.479 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-12-05T09:16:03.539 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-12-05T09:16:03.542 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-12-05T09:16:03.667 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-12-05T09:16:03.866 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:04.252 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:04.274 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:16:04.515 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:16:04.516 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:16:04.516 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:16:04.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2023-12-05T09:16:05.036 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:05.036 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:16:05.036 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-12-05T09:16:05.036 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:16:05.036 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:16:05.036 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-12-05T09:16:05.263 DEBUG:teuthology.parallel:result is None 2023-12-05T09:16:05.716 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:17 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:16:07.226 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 is already installed. 2023-12-05T09:16:07.468 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:16:07.469 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-05T09:16:07.469 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:16:07.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2023-12-05T09:16:08.666 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:20 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:16:10.423 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:16:10.424 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2023-12-05T09:16:10.424 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:10.424 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:16:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 90 k 2023-12-05T09:16:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:10.424 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:16:10.424 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:10.425 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-05T09:16:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:10.425 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 90 k 2023-12-05T09:16:10.425 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 264 k 2023-12-05T09:16:10.425 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:16:10.610 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 488 kB/s | 90 kB 00:00 2023-12-05T09:16:10.611 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:16:10.611 INFO:teuthology.orchestra.run.smithi134.stdout:Total 484 kB/s | 90 kB 00:00 2023-12-05T09:16:10.611 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:16:10.624 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:16:10.624 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:16:10.681 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:16:10.684 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:16:10.798 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:16:10.989 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:11.366 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:12.090 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:16:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:16:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:12.090 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:16:12.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2023-12-05T09:16:13.420 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:25 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:16:15.155 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:16:15.155 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:15.155 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-05T09:16:15.155 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:15.156 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:16:15.156 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 3.5 M 2023-12-05T09:16:15.156 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:15.156 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:16:15.156 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:15.156 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-05T09:16:15.156 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:15.156 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.5 M 2023-12-05T09:16:15.157 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 16 M 2023-12-05T09:16:15.157 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:16:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 5.1 MB/s | 3.5 MB 00:00 2023-12-05T09:16:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:16:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:Total 5.1 MB/s | 3.5 MB 00:00 2023-12-05T09:16:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:16:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:16:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:16:15.923 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:16:15.926 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:16:16.410 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:16:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:17.287 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:18.040 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:18.040 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:18.040 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:16:18.040 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:16:18.040 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:18.040 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:16:18.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2023-12-05T09:16:19.354 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:31 ago on Tue 05 Dec 2023 09:12:48 AM UTC. 2023-12-05T09:16:21.105 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:17.2.7-109.g1fd3ca3c.el8 ceph 173 k 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-05T09:16:21.106 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:21.107 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 173 k 2023-12-05T09:16:21.107 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 552 k 2023-12-05T09:16:21.107 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-05T09:16:21.316 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-17.2.7-109.g1fd3ca3c.el8.x86_64.rpm 832 kB/s | 173 kB 00:00 2023-12-05T09:16:21.316 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:16:21.316 INFO:teuthology.orchestra.run.smithi134.stdout:Total 826 kB/s | 173 kB 00:00 2023-12-05T09:16:21.316 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-05T09:16:21.330 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-05T09:16:21.330 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-05T09:16:21.388 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-05T09:16:21.391 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-05T09:16:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-05T09:16:21.704 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:22.075 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:22.833 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 1/1 2023-12-05T09:16:22.833 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:22.833 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-05T09:16:22.833 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:17.2.7-109.g1fd3ca3c.el8.x86_64 2023-12-05T09:16:22.833 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:16:22.833 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-05T09:16:23.096 DEBUG:teuthology.parallel:result is None 2023-12-05T09:16:23.096 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:16:23.096 INFO:teuthology.packaging:ref: None 2023-12-05T09:16:23.096 INFO:teuthology.packaging:tag: None 2023-12-05T09:16:23.096 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:16:23.096 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:16:23.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T09:16:23.339 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-05T09:16:23.400 INFO:teuthology.orchestra.run.smithi067.stdout:17.2.7-109.g1fd3ca3c.el8 2023-12-05T09:16:23.401 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-109.g1fd3ca3c.el8 2023-12-05T09:16:23.401 INFO:teuthology.task.install:The correct ceph version 17.2.7-109.g1fd3ca3c is installed. 2023-12-05T09:16:23.401 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-05T09:16:23.401 INFO:teuthology.packaging:ref: None 2023-12-05T09:16:23.401 INFO:teuthology.packaging:tag: None 2023-12-05T09:16:23.401 INFO:teuthology.packaging:branch: quincy 2023-12-05T09:16:23.401 INFO:teuthology.packaging:sha1: 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:16:23.401 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-05T09:16:23.623 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-05T09:16:23.678 INFO:teuthology.orchestra.run.smithi134.stdout:17.2.7-109.g1fd3ca3c.el8 2023-12-05T09:16:23.678 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-109.g1fd3ca3c.el8 2023-12-05T09:16:23.678 INFO:teuthology.task.install:The correct ceph version 17.2.7-109.g1fd3ca3c is installed. 2023-12-05T09:16:23.679 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-05T09:16:23.679 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:16:23.679 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-05T09:16:23.758 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:16:23.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-05T09:16:23.828 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-05T09:16:23.828 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:16:23.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2023-12-05T09:16:23.902 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-05T09:16:23.972 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:16:23.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2023-12-05T09:16:24.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-05T09:16:24.149 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-05T09:16:24.150 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:16:24.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-05T09:16:24.220 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-05T09:16:24.329 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:16:24.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-05T09:16:24.399 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-05T09:16:24.508 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-05T09:16:24.508 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:16:24.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2023-12-05T09:16:24.578 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-05T09:16:24.688 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:16:24.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2023-12-05T09:16:24.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-05T09:16:24.865 INFO:teuthology.run_tasks:Running task print... 2023-12-05T09:16:24.874 INFO:teuthology.task.print:**** done install task... 2023-12-05T09:16:24.874 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-05T09:16:24.973 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'} 2023-12-05T09:16:24.973 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-05T09:16:24.974 INFO:tasks.cephadm:Cluster fsid is f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:16:24.974 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-05T09:16:24.974 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-05T09:16:24.974 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi067': '172.21.15.67', 'mon.smithi134': '172.21.15.134'} 2023-12-05T09:16:24.974 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-05T09:16:24.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname $(hostname -s) 2023-12-05T09:16:25.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2023-12-05T09:16:25.120 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-05T09:16:25.120 DEBUG:teuthology.orchestra.run.smithi067:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-05T09:16:25.342 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 5 09:16 /home/ubuntu/cephtest/cephadm 2023-12-05T09:16:25.343 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-05T09:16:25.527 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 5 09:16 /home/ubuntu/cephtest/cephadm 2023-12-05T09:16:25.527 DEBUG:teuthology.orchestra.run.smithi067:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-05T09:16:25.576 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-05T09:16:25.634 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-05T09:16:25.635 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-05T09:16:25.639 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-05T09:16:26.809 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T09:16:26.826 INFO:teuthology.orchestra.run.smithi067.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T09:17:09.522 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-12-05T09:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)", 2023-12-05T09:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d", 2023-12-05T09:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2023-12-05T09:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:0d4f01deeba216c15211c4d6aff905005feecdc02196b3d83cd04ba900a424d3" 2023-12-05T09:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-12-05T09:17:09.523 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-12-05T09:17:14.281 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:17:14.281 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph_version": "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)", 2023-12-05T09:17:14.281 INFO:teuthology.orchestra.run.smithi067.stdout: "image_id": "e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d", 2023-12-05T09:17:14.281 INFO:teuthology.orchestra.run.smithi067.stdout: "repo_digests": [ 2023-12-05T09:17:14.281 INFO:teuthology.orchestra.run.smithi067.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:0d4f01deeba216c15211c4d6aff905005feecdc02196b3d83cd04ba900a424d3" 2023-12-05T09:17:14.281 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2023-12-05T09:17:14.281 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:17:14.308 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph 2023-12-05T09:17:14.383 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2023-12-05T09:17:14.462 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /etc/ceph 2023-12-05T09:17:14.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2023-12-05T09:17:14.604 INFO:tasks.cephadm:Writing seed config... 2023-12-05T09:17:14.605 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-05T09:17:14.605 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-05T09:17:14.605 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-05T09:17:14.605 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-05T09:17:14.605 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-05T09:17:14.605 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-05T09:17:14.605 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-05T09:17:14.606 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-05T09:17:14.607 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-05T09:17:14.608 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-05T09:17:14.608 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-05T09:17:14.608 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:17:14.608 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-05T09:17:14.654 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f6a41352-934e-11ee-95a2-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-05T09:17:14.655 DEBUG:teuthology.orchestra.run.smithi067:mon.smithi067> sudo journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067.service 2023-12-05T09:17:14.698 INFO:tasks.cephadm:Bootstrapping... 2023-12-05T09:17:14.699 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid f6a41352-934e-11ee-95a2-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.67 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:17:14.768 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:-- Logs begin at Tue 2023-12-05 08:57:36 UTC. -- 2023-12-05T09:17:15.007 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-12-05T09:17:15.007 INFO:teuthology.orchestra.run.smithi067.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'f6a41352-934e-11ee-95a2-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.67', '--skip-admin-label'] 2023-12-05T09:17:15.054 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 4.6.1 2023-12-05T09:17:15.054 INFO:teuthology.orchestra.run.smithi067.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-05T09:17:15.054 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying podman|docker is present... 2023-12-05T09:17:15.100 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 4.6.1 2023-12-05T09:17:15.100 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying lvm2 is present... 2023-12-05T09:17:15.100 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying time synchronization is in place... 2023-12-05T09:17:15.115 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-05T09:17:15.115 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-05T09:17:15.128 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-05T09:17:15.128 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2023-12-05T09:17:15.142 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout enabled 2023-12-05T09:17:15.156 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout active 2023-12-05T09:17:15.156 INFO:teuthology.orchestra.run.smithi067.stdout:Unit chronyd.service is enabled and running 2023-12-05T09:17:15.156 INFO:teuthology.orchestra.run.smithi067.stdout:Repeating the final host check... 2023-12-05T09:17:15.201 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout 4.6.1 2023-12-05T09:17:15.201 INFO:teuthology.orchestra.run.smithi067.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-05T09:17:15.201 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl is present 2023-12-05T09:17:15.201 INFO:teuthology.orchestra.run.smithi067.stdout:lvcreate is present 2023-12-05T09:17:15.214 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-05T09:17:15.214 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-05T09:17:15.228 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-05T09:17:15.228 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2023-12-05T09:17:15.242 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout enabled 2023-12-05T09:17:15.255 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout active 2023-12-05T09:17:15.255 INFO:teuthology.orchestra.run.smithi067.stdout:Unit chronyd.service is enabled and running 2023-12-05T09:17:15.255 INFO:teuthology.orchestra.run.smithi067.stdout:Host looks OK 2023-12-05T09:17:15.255 INFO:teuthology.orchestra.run.smithi067.stdout:Cluster fsid: f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:15.256 INFO:teuthology.orchestra.run.smithi067.stdout:Acquiring lock 140708272515560 on /run/cephadm/f6a41352-934e-11ee-95a2-87774f69a715.lock 2023-12-05T09:17:15.256 INFO:teuthology.orchestra.run.smithi067.stdout:Lock 140708272515560 acquired on /run/cephadm/f6a41352-934e-11ee-95a2-87774f69a715.lock 2023-12-05T09:17:15.256 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying IP 172.21.15.67 port 3300 ... 2023-12-05T09:17:15.256 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying IP 172.21.15.67 port 6789 ... 2023-12-05T09:17:15.256 INFO:teuthology.orchestra.run.smithi067.stdout:Base mon IP(s) is [172.21.15.67:3300, 172.21.15.67:6789], mon addrv is [v2:172.21.15.67:3300,v1:172.21.15.67:6789] 2023-12-05T09:17:15.265 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.67 metric 100 2023-12-05T09:17:15.265 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.67 metric 100 2023-12-05T09:17:15.272 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-05T09:17:15.272 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-05T09:17:15.272 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1719sec hoplimit 64 pref medium 2023-12-05T09:17:15.280 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-05T09:17:15.280 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-05T09:17:15.280 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-05T09:17:15.280 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-05T09:17:15.280 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-12-05T09:17:15.280 INFO:teuthology.orchestra.run.smithi067.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-05T09:17:15.281 INFO:teuthology.orchestra.run.smithi067.stdout:Mon IP `172.21.15.67` is in CIDR network `172.21.0.0/20` 2023-12-05T09:17:15.281 INFO:teuthology.orchestra.run.smithi067.stdout:Mon IP `172.21.15.67` is in CIDR network `172.21.0.0/20` 2023-12-05T09:17:15.281 INFO:teuthology.orchestra.run.smithi067.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-05T09:17:15.282 INFO:teuthology.orchestra.run.smithi067.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-05T09:17:15.283 INFO:teuthology.orchestra.run.smithi067.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T09:17:15.705 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stdout e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d 2023-12-05T09:17:15.705 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-05T09:17:15.705 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Getting image source signatures 2023-12-05T09:17:15.705 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying blob sha256:f8d912e8e8635896f84e43426bf9a1ea53664c8ccfe5796c31e0716d111e3afa 2023-12-05T09:17:15.706 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-05T09:17:15.706 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Copying config sha256:e139fc5fd9fc28339620da34f9acb14e94fcbf74091249cf080e32fcdc94a81d 2023-12-05T09:17:15.706 INFO:teuthology.orchestra.run.smithi067.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-05T09:17:16.372 INFO:teuthology.orchestra.run.smithi067.stdout:ceph: stdout ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable) 2023-12-05T09:17:16.372 INFO:teuthology.orchestra.run.smithi067.stdout:Ceph version: ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable) 2023-12-05T09:17:16.372 INFO:teuthology.orchestra.run.smithi067.stdout:Extracting ceph user uid/gid from container image... 2023-12-05T09:17:16.934 INFO:teuthology.orchestra.run.smithi067.stdout:stat: stdout 167 167 2023-12-05T09:17:16.934 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial keys... 2023-12-05T09:17:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQCd6m5lDd4LEhAAfbxSUwqRxLS6WMdut3nRFg== 2023-12-05T09:17:18.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQCd6m5lKzZWMxAAbR2PjGb4FyhMgVCARDeUyQ== 2023-12-05T09:17:18.708 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph-authtool: stdout AQCe6m5lKiF+GRAA+GKplRThMr8V0NmAwmyt1g== 2023-12-05T09:17:18.710 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial monmap... 2023-12-05T09:17:19.284 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-05T09:17:19.284 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-05T09:17:19.285 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:19.285 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-05T09:17:19.285 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool for smithi067 [v2:172.21.15.67:3300,v1:172.21.15.67:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-05T09:17:19.285 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = octopus 2023-12-05T09:17:19.285 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: set fsid to f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:19.285 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-05T09:17:19.285 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:17:19.285 INFO:teuthology.orchestra.run.smithi067.stdout:Creating mon... 2023-12-05T09:17:19.901 INFO:teuthology.orchestra.run.smithi067.stdout:create mon.smithi067 on 2023-12-05T09:17:20.113 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-05T09:17:20.310 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-05T09:17:20.522 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f6a41352-934e-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-f6a41352-934e-11ee-95a2-87774f69a715.target. 2023-12-05T09:17:20.522 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f6a41352-934e-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-f6a41352-934e-11ee-95a2-87774f69a715.target. 2023-12-05T09:17:20.815 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067 2023-12-05T09:17:20.815 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067.service: Unit ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067.service not loaded. 2023-12-05T09:17:21.034 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f6a41352-934e-11ee-95a2-87774f69a715.target.wants/ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067.service → /etc/systemd/system/ceph-f6a41352-934e-11ee-95a2-87774f69a715@.service. 2023-12-05T09:17:21.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:21 smithi067 systemd[1]: Starting Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:17:21.690 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T09:17:21.690 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2023-12-05T09:17:21.712 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T09:17:21.712 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2023-12-05T09:17:21.712 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2023-12-05T09:17:21.712 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to enable service . firewalld.service is not available 2023-12-05T09:17:21.712 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mon to start... 2023-12-05T09:17:21.713 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mon... 2023-12-05T09:17:21.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:21 smithi067 bash[106647]: cc57f145ea890f46c494d47d60a6dc6dad4f470fadd91bd3a7101b86461ef628 2023-12-05T09:17:21.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:21 smithi067 systemd[1]: Started Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:17:21.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:21 smithi067 ceph-mon[106685]: mkfs f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:21.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:21 smithi067 ceph-mon[106685]: mon.smithi067 is new leader, mons smithi067 in quorum (ranks 0) 2023-12-05T09:17:22.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout cluster: 2023-12-05T09:17:22.781 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout id: f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:22.781 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-05T09:17:22.781 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout services: 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi067 (age 0.731124s) 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout data: 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout pgs: 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.342+0000 7f5d47d43700 1 Processor -- start 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.342+0000 7f5d47d43700 1 -- start start 2023-12-05T09:17:22.782 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.342+0000 7f5d47d43700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d400760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.342+0000 7f5d47d43700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d40077fe0 con 0x7f5d40077bd0 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.343+0000 7f5d45adf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d400760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.343+0000 7f5d45adf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d400760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52918/0 (socket says 172.21.15.67:52918) 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.343+0000 7f5d45adf700 1 -- 172.21.15.67:0/2491385210 learned_addr learned my addr 172.21.15.67:0/2491385210 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.344+0000 7f5d45adf700 1 -- 172.21.15.67:0/2491385210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40076620 con 0x7f5d40077bd0 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.344+0000 7f5d45adf700 1 --2- 172.21.15.67:0/2491385210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d400760e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0098e0 tx=0x7f5d3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469663555c4e8492 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.344+0000 7f5d44add700 1 -- 172.21.15.67:0/2491385210 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d3c00b860 con 0x7f5d40077bd0 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.344+0000 7f5d44add700 1 -- 172.21.15.67:0/2491385210 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c00b9c0 con 0x7f5d40077bd0 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.344+0000 7f5d44add700 1 -- 172.21.15.67:0/2491385210 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d3c00bc90 con 0x7f5d40077bd0 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.345+0000 7f5d47d43700 1 -- 172.21.15.67:0/2491385210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 msgr2=0x7f5d400760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.345+0000 7f5d47d43700 1 --2- 172.21.15.67:0/2491385210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d400760e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0098e0 tx=0x7f5d3c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:22.783 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.345+0000 7f5d47d43700 1 -- 172.21.15.67:0/2491385210 shutdown_connections 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.345+0000 7f5d47d43700 1 --2- 172.21.15.67:0/2491385210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d400760e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.345+0000 7f5d47d43700 1 -- 172.21.15.67:0/2491385210 >> 172.21.15.67:0/2491385210 conn(0x7f5d400fda50 msgr2=0x7f5d400ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.345+0000 7f5d47d43700 1 -- 172.21.15.67:0/2491385210 shutdown_connections 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.345+0000 7f5d47d43700 1 -- 172.21.15.67:0/2491385210 wait complete. 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.346+0000 7f5d47d43700 1 Processor -- start 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.346+0000 7f5d47d43700 1 -- start start 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.346+0000 7f5d47d43700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d40112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.346+0000 7f5d47d43700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d401130c0 con 0x7f5d40077bd0 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.347+0000 7f5d45adf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d40112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.347+0000 7f5d45adf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d40112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52920/0 (socket says 172.21.15.67:52920) 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.347+0000 7f5d45adf700 1 -- 172.21.15.67:0/3775141602 learned_addr learned my addr 172.21.15.67:0/3775141602 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.347+0000 7f5d45adf700 1 -- 172.21.15.67:0/3775141602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c0094f0 con 0x7f5d40077bd0 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.347+0000 7f5d45adf700 1 --2- 172.21.15.67:0/3775141602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d40112b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009290 tx=0x7f5d3c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:22.784 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.348+0000 7f5d367fc700 1 -- 172.21.15.67:0/3775141602 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d3c01c5c0 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.348+0000 7f5d367fc700 1 -- 172.21.15.67:0/3775141602 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c01c740 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.348+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d401132c0 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.348+0000 7f5d367fc700 1 -- 172.21.15.67:0/3775141602 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d3c01ca50 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.348+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d401136d0 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.348+0000 7f5d367fc700 1 -- 172.21.15.67:0/3775141602 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5d3c01a450 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.348+0000 7f5d367fc700 1 -- 172.21.15.67:0/3775141602 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5d3c02e790 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.349+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4004bb80 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.352+0000 7f5d367fc700 1 -- 172.21.15.67:0/3775141602 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f5d3c01ce30 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.429+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f5d4010c160 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.429+0000 7f5d367fc700 1 -- 172.21.15.67:0/3775141602 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f5d3c01a890 con 0x7f5d40077bd0 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.430+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 msgr2=0x7f5d40112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:22.785 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.430+0000 7f5d47d43700 1 --2- 172.21.15.67:0/3775141602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d40112b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009290 tx=0x7f5d3c016000 comp rx=0 tx=0).stop 2023-12-05T09:17:22.786 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.430+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 shutdown_connections 2023-12-05T09:17:22.786 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.430+0000 7f5d47d43700 1 --2- 172.21.15.67:0/3775141602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d40077bd0 0x7f5d40112b80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:22.786 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.430+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 >> 172.21.15.67:0/3775141602 conn(0x7f5d400fda50 msgr2=0x7f5d40107040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:22.786 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.430+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 shutdown_connections 2023-12-05T09:17:22.786 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:22.430+0000 7f5d47d43700 1 -- 172.21.15.67:0/3775141602 wait complete. 2023-12-05T09:17:22.786 INFO:teuthology.orchestra.run.smithi067.stdout:mon is available 2023-12-05T09:17:22.786 INFO:teuthology.orchestra.run.smithi067.stdout:Assimilating anything we can from ceph.conf... 2023-12-05T09:17:23.098 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:22 smithi067 ceph-mon[106685]: mon.smithi067 is new leader, mons smithi067 in quorum (ranks 0) 2023-12-05T09:17:23.098 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:22 smithi067 ceph-mon[106685]: monmap e1: 1 mons at {smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:17:23.098 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:22 smithi067 ceph-mon[106685]: fsmap 2023-12-05T09:17:23.098 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:22 smithi067 ceph-mon[106685]: osdmap e1: 0 total, 0 up, 0 in 2023-12-05T09:17:23.098 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:22 smithi067 ceph-mon[106685]: mgrmap e1: no daemons active 2023-12-05T09:17:23.098 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:22 smithi067 ceph-mon[106685]: from='client.? 172.21.15.67:0/3775141602' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-05T09:17:23.772 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:23.772 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [global] 2023-12-05T09:17:23.772 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout fsid = f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:23.772 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.67:3300,v1:172.21.15.67:6789] 2023-12-05T09:17:23.772 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [osd] 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-05T09:17:23.773 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.343+0000 7f60c759e700 1 Processor -- start 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.343+0000 7f60c759e700 1 -- start start 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.343+0000 7f60c759e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c8076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.343+0000 7f60c759e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8078000 con 0x7f60c8077bf0 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.344+0000 7f60c659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c8076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.344+0000 7f60c659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c8076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52932/0 (socket says 172.21.15.67:52932) 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.344+0000 7f60c659c700 1 -- 172.21.15.67:0/1360498088 learned_addr learned my addr 172.21.15.67:0/1360498088 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.344+0000 7f60c659c700 1 -- 172.21.15.67:0/1360498088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8076640 con 0x7f60c8077bf0 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.344+0000 7f60c659c700 1 --2- 172.21.15.67:0/1360498088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c8076100 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f60b80098e0 tx=0x7f60b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab934ca9f90a4f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c559a700 1 -- 172.21.15.67:0/1360498088 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b800b860 con 0x7f60c8077bf0 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c559a700 1 -- 172.21.15.67:0/1360498088 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b800b9c0 con 0x7f60c8077bf0 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c559a700 1 -- 172.21.15.67:0/1360498088 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b800bc90 con 0x7f60c8077bf0 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c759e700 1 -- 172.21.15.67:0/1360498088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 msgr2=0x7f60c8076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c759e700 1 --2- 172.21.15.67:0/1360498088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c8076100 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f60b80098e0 tx=0x7f60b8009250 comp rx=0 tx=0).stop 2023-12-05T09:17:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c759e700 1 -- 172.21.15.67:0/1360498088 shutdown_connections 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c759e700 1 --2- 172.21.15.67:0/1360498088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c8076100 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c759e700 1 -- 172.21.15.67:0/1360498088 >> 172.21.15.67:0/1360498088 conn(0x7f60c80fd880 msgr2=0x7f60c80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c759e700 1 -- 172.21.15.67:0/1360498088 shutdown_connections 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.345+0000 7f60c759e700 1 -- 172.21.15.67:0/1360498088 wait complete. 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.346+0000 7f60c759e700 1 Processor -- start 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.346+0000 7f60c759e700 1 -- start start 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.347+0000 7f60c759e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c81129e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.347+0000 7f60c759e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8112f20 con 0x7f60c8077bf0 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.347+0000 7f60c659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c81129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.347+0000 7f60c659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c81129e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52944/0 (socket says 172.21.15.67:52944) 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.347+0000 7f60c659c700 1 -- 172.21.15.67:0/2901121685 learned_addr learned my addr 172.21.15.67:0/2901121685 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.347+0000 7f60c659c700 1 -- 172.21.15.67:0/2901121685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b80094f0 con 0x7f60c8077bf0 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.347+0000 7f60c659c700 1 --2- 172.21.15.67:0/2901121685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c81129e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009290 tx=0x7f60b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.348+0000 7f60b6ffd700 1 -- 172.21.15.67:0/2901121685 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b801c5c0 con 0x7f60c8077bf0 2023-12-05T09:17:23.775 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.348+0000 7f60b6ffd700 1 -- 172.21.15.67:0/2901121685 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b801c740 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.348+0000 7f60b6ffd700 1 -- 172.21.15.67:0/2901121685 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b801ca50 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.348+0000 7f60c759e700 1 -- 172.21.15.67:0/2901121685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c8113120 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.348+0000 7f60c759e700 1 -- 172.21.15.67:0/2901121685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c8113530 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.348+0000 7f60b6ffd700 1 -- 172.21.15.67:0/2901121685 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f60b801a450 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.348+0000 7f60b6ffd700 1 -- 172.21.15.67:0/2901121685 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f60b802e790 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.349+0000 7f60b4ff9700 1 -- 172.21.15.67:0/2901121685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac0052b0 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.352+0000 7f60b6ffd700 1 -- 172.21.15.67:0/2901121685 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f60b801ce30 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.424+0000 7f60b4ff9700 1 -- 172.21.15.67:0/2901121685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f60ac002400 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.428+0000 7f60b6ffd700 1 -- 172.21.15.67:0/2901121685 <== mon.0 v2:172.21.15.67:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f60b801b3e0 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.429+0000 7f60b6ffd700 1 -- 172.21.15.67:0/2901121685 <== mon.0 v2:172.21.15.67:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f60b802e950 con 0x7f60c8077bf0 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.430+0000 7f60b4ff9700 1 -- 172.21.15.67:0/2901121685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 msgr2=0x7f60c81129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.430+0000 7f60b4ff9700 1 --2- 172.21.15.67:0/2901121685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c81129e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009290 tx=0x7f60b8016000 comp rx=0 tx=0).stop 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.430+0000 7f60b4ff9700 1 -- 172.21.15.67:0/2901121685 shutdown_connections 2023-12-05T09:17:23.776 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.430+0000 7f60b4ff9700 1 --2- 172.21.15.67:0/2901121685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60c8077bf0 0x7f60c81129e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:23.777 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.430+0000 7f60b4ff9700 1 -- 172.21.15.67:0/2901121685 >> 172.21.15.67:0/2901121685 conn(0x7f60c80fd880 msgr2=0x7f60c8106ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:23.777 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.430+0000 7f60b4ff9700 1 -- 172.21.15.67:0/2901121685 shutdown_connections 2023-12-05T09:17:23.777 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:23.430+0000 7f60b4ff9700 1 -- 172.21.15.67:0/2901121685 wait complete. 2023-12-05T09:17:23.777 INFO:teuthology.orchestra.run.smithi067.stdout:Generating new minimal ceph.conf... 2023-12-05T09:17:24.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:23 smithi067 ceph-mon[106685]: from='client.? 172.21.15.67:0/2901121685' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-05T09:17:24.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:23 smithi067 ceph-mon[106685]: from='client.? 172.21.15.67:0/2901121685' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.177+0000 7f3c2fb35700 1 Processor -- start 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.177+0000 7f3c2fb35700 1 -- start start 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.177+0000 7f3c2fb35700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.177+0000 7f3c2fb35700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28078000 con 0x7f3c28077bf0 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.177+0000 7f3c2d8d1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.178+0000 7f3c2d8d1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52956/0 (socket says 172.21.15.67:52956) 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.178+0000 7f3c2d8d1700 1 -- 172.21.15.67:0/3495585259 learned_addr learned my addr 172.21.15.67:0/3495585259 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.178+0000 7f3c2d8d1700 1 -- 172.21.15.67:0/3495585259 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c28076640 con 0x7f3c28077bf0 2023-12-05T09:17:24.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.178+0000 7f3c2d8d1700 1 --2- 172.21.15.67:0/3495585259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28076100 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3c240098e0 tx=0x7f3c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96088dabbefa5d29 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.178+0000 7f3c2c8cf700 1 -- 172.21.15.67:0/3495585259 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c2400b860 con 0x7f3c28077bf0 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.178+0000 7f3c2c8cf700 1 -- 172.21.15.67:0/3495585259 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3c2400be30 con 0x7f3c28077bf0 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.178+0000 7f3c2c8cf700 1 -- 172.21.15.67:0/3495585259 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c24010380 con 0x7f3c28077bf0 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.179+0000 7f3c2fb35700 1 -- 172.21.15.67:0/3495585259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 msgr2=0x7f3c28076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.179+0000 7f3c2fb35700 1 --2- 172.21.15.67:0/3495585259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28076100 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3c240098e0 tx=0x7f3c24009250 comp rx=0 tx=0).stop 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.179+0000 7f3c2fb35700 1 -- 172.21.15.67:0/3495585259 shutdown_connections 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.179+0000 7f3c2fb35700 1 --2- 172.21.15.67:0/3495585259 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28076100 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.179+0000 7f3c2fb35700 1 -- 172.21.15.67:0/3495585259 >> 172.21.15.67:0/3495585259 conn(0x7f3c280fda50 msgr2=0x7f3c280ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:24.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.179+0000 7f3c2fb35700 1 -- 172.21.15.67:0/3495585259 shutdown_connections 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.179+0000 7f3c2fb35700 1 -- 172.21.15.67:0/3495585259 wait complete. 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.180+0000 7f3c2fb35700 1 Processor -- start 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.180+0000 7f3c2fb35700 1 -- start start 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.180+0000 7f3c2fb35700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.180+0000 7f3c2fb35700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281138c0 con 0x7f3c28077bf0 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.181+0000 7f3c2d8d1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.181+0000 7f3c2d8d1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52964/0 (socket says 172.21.15.67:52964) 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.181+0000 7f3c2d8d1700 1 -- 172.21.15.67:0/1856461787 learned_addr learned my addr 172.21.15.67:0/1856461787 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.181+0000 7f3c2d8d1700 1 -- 172.21.15.67:0/1856461787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240094f0 con 0x7f3c28077bf0 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.181+0000 7f3c2d8d1700 1 --2- 172.21.15.67:0/1856461787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3c24006b00 tx=0x7f3c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.181+0000 7f3c1e7fc700 1 -- 172.21.15.67:0/1856461787 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c24010a80 con 0x7f3c28077bf0 2023-12-05T09:17:24.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.182+0000 7f3c1e7fc700 1 -- 172.21.15.67:0/1856461787 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3c2401a430 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.182+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c28113ac0 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.182+0000 7f3c1e7fc700 1 -- 172.21.15.67:0/1856461787 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c240245b0 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.182+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c28113ed0 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.182+0000 7f3c1e7fc700 1 -- 172.21.15.67:0/1856461787 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3c24024ab0 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.182+0000 7f3c1e7fc700 1 -- 172.21.15.67:0/1856461787 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3c2402eb00 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.184+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2804bb80 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.186+0000 7f3c1e7fc700 1 -- 172.21.15.67:0/1856461787 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3c2402ecc0 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.260+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3c2810cd60 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.260+0000 7f3c1e7fc700 1 -- 172.21.15.67:0/1856461787 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f3c2402ee60 con 0x7f3c28077bf0 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.261+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 msgr2=0x7f3c28113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.261+0000 7f3c2fb35700 1 --2- 172.21.15.67:0/1856461787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3c24006b00 tx=0x7f3c24009250 comp rx=0 tx=0).stop 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.261+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 shutdown_connections 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.261+0000 7f3c2fb35700 1 --2- 172.21.15.67:0/1856461787 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c28077bf0 0x7f3c28113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.261+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 >> 172.21.15.67:0/1856461787 conn(0x7f3c280fda50 msgr2=0x7f3c280ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:24.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.262+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 shutdown_connections 2023-12-05T09:17:24.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:24.262+0000 7f3c2fb35700 1 -- 172.21.15.67:0/1856461787 wait complete. 2023-12-05T09:17:24.568 INFO:teuthology.orchestra.run.smithi067.stdout:Restarting the monitor... 2023-12-05T09:17:24.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:24 smithi067 systemd[1]: Stopping Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:17:24.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:24 smithi067 ceph-mon[106685]: from='client.? 172.21.15.67:0/1856461787' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:17:25.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:24 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067[106662]: 2023-12-05T09:17:24.847+0000 7f7aceba0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi067 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:17:25.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:24 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067[106662]: 2023-12-05T09:17:24.847+0000 7f7aceba0700 -1 mon.smithi067@0(leader) e1 *** Got Signal Terminated *** 2023-12-05T09:17:25.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 bash[107014]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067 2023-12-05T09:17:25.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067.service: Succeeded. 2023-12-05T09:17:25.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 systemd[1]: Stopped Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:17:25.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 systemd[1]: Starting Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:17:25.806 INFO:teuthology.orchestra.run.smithi067.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 bash[107136]: 1d8ca51c25464a247aeef06f95a386d7ecb627f1edc86b4b58e867f821518df3 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 systemd[1]: Started Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable), process ceph-mon, pid 7 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: pidfile_write: ignore empty --pid-file 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: load: jerasure load: lrc 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: RocksDB version: 6.15.5 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Compile date Dec 4 2023 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: DB SUMMARY 2023-12-05T09:17:26.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: DB Session ID: JFJMQQG53I4VIU5NFGKE 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: CURRENT file: CURRENT 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi067/store.db dir, Total Num: 1, files: 000008.sst 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi067/store.db: 000010.log size: 96760 ; 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.error_if_exists: 0 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.create_if_missing: 0 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.paranoid_checks: 1 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.env: 0x55cdad9baa80 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.fs: Posix File System 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.info_log: 0x55cdafdc6780 2023-12-05T09:17:26.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.statistics: (nil) 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.use_fsync: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_log_file_size: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.allow_fallocate: 1 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.use_direct_reads: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.db_log_dir: 2023-12-05T09:17:26.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi067/store.db 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.write_buffer_manager: 0x55cdb0b369f0 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T09:17:26.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.unordered_write: 0 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.row_cache: None 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.wal_filter: None 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T09:17:26.127 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.preserve_deletes: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.two_write_queues: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.atomic_flush: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.log_readahead_size: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T09:17:26.128 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T09:17:26.129 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_background_jobs: 2 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_background_compactions: -1 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_subcompactions: 1 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T09:17:26.130 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T09:17:26.131 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T09:17:26.131 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_open_files: -1 2023-12-05T09:17:26.131 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T09:17:26.131 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T09:17:26.131 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T09:17:26.131 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T09:17:26.131 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_background_flushes: -1 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Compression algorithms supported: 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: kZSTD supported: 0 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: kXpressCompression supported: 0 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: kZlibCompression supported: 1 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: kSnappyCompression supported: 1 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: kLZ4Compression supported: 1 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: kBZip2Compression supported: 0 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000009 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.merge_operator: 2023-12-05T09:17:26.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_filter: None 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cdafe16f90) 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: cache_index_and_filter_blocks: 1 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: pin_top_level_index_and_filter: 1 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_type: 0 2023-12-05T09:17:26.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_block_index_type: 0 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_shortening: 1 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: hash_index_allow_collision: 1 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: checksum: 1 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: no_block_cache: 0 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache: 0x55cdafe49090 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_name: BinnedLRUCache 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_options: 2023-12-05T09:17:26.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: capacity : 536870912 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: num_shard_bits : 4 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: strict_capacity_limit : 0 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: high_pri_pool_ratio: 0.000 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_compressed: (nil) 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: persistent_cache: (nil) 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_size: 4096 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_size_deviation: 10 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_restart_interval: 16 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_block_restart_interval: 1 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: metadata_block_size: 4096 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: partition_filters: 0 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: use_delta_encoding: 1 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: whole_key_filtering: 1 2023-12-05T09:17:26.135 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: verify_compression: 0 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: read_amp_bytes_per_bit: 0 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: format_version: 4 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: enable_index_compression: 1 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_align: 0 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compression: NoCompression 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.num_levels: 7 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T09:17:26.136 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T09:17:26.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T09:17:26.138 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.arena_block_size: 4194304 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T09:17:26.139 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.table_properties_collectors: 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.inplace_update_support: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.bloom_locality: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.max_successive_merges: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.ttl: 2592000 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.enable_blob_files: false 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.min_blob_size: 0 2023-12-05T09:17:26.140 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701767845819478, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701767845820814, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92129, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90224, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13225, "raw_average_key_size": 49, "raw_value_size": 82963, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 267, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701767845, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "be185244-5e26-4327-a417-f7e6526f40c8", "db_session_id": "JFJMQQG53I4VIU5NFGKE"}} 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701767845821416, "job": 1, "event": "recovery_finished"} 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi067/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55cdafddd180 2023-12-05T09:17:26.141 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: DB pointer 0x55cdafeb2000 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** DB Stats ** 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:17:26.142 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: L0 2/0 91.77 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Sum 2/0 91.77 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 107.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative compaction: 0.00 GB write, 14.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval compaction: 0.00 GB write, 14.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:17:26.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: L0 2/0 91.77 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Sum 2/0 91.77 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 107.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 107.7 0.00 0.00 1 0.001 0 0 2023-12-05T09:17:26.144 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative compaction: 0.00 GB write, 14.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: starting mon.smithi067 rank 0 at public addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] at bind addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi067 fsid f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067@-1(???) e1 preinit fsid f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067@-1(???).mds e1 new map 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067@-1(???).mds e1 print_map 2023-12-05T09:17:26.145 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: e1 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: legacy client fscid: -1 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: No filesystems configured 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mon.smithi067 is new leader, mons smithi067 in quorum (ranks 0) 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: monmap e1: 1 mons at {smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: fsmap 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: osdmap e1: 0 total, 0 up, 0 in 2023-12-05T09:17:26.146 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:25 smithi067 ceph-mon[107174]: mgrmap e1: no daemons active 2023-12-05T09:17:26.639 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.216+0000 7f925b59e700 1 Processor -- start 2023-12-05T09:17:26.639 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.216+0000 7f925b59e700 1 -- start start 2023-12-05T09:17:26.639 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.216+0000 7f925b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:26.639 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.216+0000 7f925b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c078000 con 0x7f925c077bf0 2023-12-05T09:17:26.639 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.217+0000 7f925a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:26.639 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.217+0000 7f925a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33720/0 (socket says 172.21.15.67:33720) 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.217+0000 7f925a59c700 1 -- 172.21.15.67:0/1683198423 learned_addr learned my addr 172.21.15.67:0/1683198423 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.217+0000 7f925a59c700 1 -- 172.21.15.67:0/1683198423 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c076640 con 0x7f925c077bf0 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.217+0000 7f925a59c700 1 --2- 172.21.15.67:0/1683198423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c076100 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f924c0098e0 tx=0x7f924c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410124f760405dac server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925959a700 1 -- 172.21.15.67:0/1683198423 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f924c00b860 con 0x7f925c077bf0 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925959a700 1 -- 172.21.15.67:0/1683198423 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f924c00be30 con 0x7f925c077bf0 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925959a700 1 -- 172.21.15.67:0/1683198423 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f924c010380 con 0x7f925c077bf0 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925b59e700 1 -- 172.21.15.67:0/1683198423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 msgr2=0x7f925c076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925b59e700 1 --2- 172.21.15.67:0/1683198423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c076100 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f924c0098e0 tx=0x7f924c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925b59e700 1 -- 172.21.15.67:0/1683198423 shutdown_connections 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925b59e700 1 --2- 172.21.15.67:0/1683198423 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c076100 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925b59e700 1 -- 172.21.15.67:0/1683198423 >> 172.21.15.67:0/1683198423 conn(0x7f925c0fd880 msgr2=0x7f925c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.218+0000 7f925b59e700 1 -- 172.21.15.67:0/1683198423 shutdown_connections 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.219+0000 7f925b59e700 1 -- 172.21.15.67:0/1683198423 wait complete. 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.219+0000 7f925b59e700 1 Processor -- start 2023-12-05T09:17:26.640 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.219+0000 7f925b59e700 1 -- start start 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.220+0000 7f925b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.220+0000 7f925b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c113730 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.220+0000 7f925a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.220+0000 7f925a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c1131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33736/0 (socket says 172.21.15.67:33736) 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.220+0000 7f925a59c700 1 -- 172.21.15.67:0/1818320088 learned_addr learned my addr 172.21.15.67:0/1818320088 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.220+0000 7f925a59c700 1 -- 172.21.15.67:0/1818320088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c0094f0 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.221+0000 7f925a59c700 1 --2- 172.21.15.67:0/1818320088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c1131f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f924c006b00 tx=0x7f924c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.221+0000 7f924affd700 1 -- 172.21.15.67:0/1818320088 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f924c010a80 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.221+0000 7f924affd700 1 -- 172.21.15.67:0/1818320088 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f924c01a430 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.221+0000 7f925b59e700 1 -- 172.21.15.67:0/1818320088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c113930 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.221+0000 7f924affd700 1 -- 172.21.15.67:0/1818320088 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f924c0245b0 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.221+0000 7f925b59e700 1 -- 172.21.15.67:0/1818320088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c113d40 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.221+0000 7f924affd700 1 -- 172.21.15.67:0/1818320088 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f924c024a60 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.222+0000 7f924affd700 1 -- 172.21.15.67:0/1818320088 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f924c02ec20 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.222+0000 7f9248ff9700 1 -- 172.21.15.67:0/1818320088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92400052b0 con 0x7f925c077bf0 2023-12-05T09:17:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.225+0000 7f924affd700 1 -- 172.21.15.67:0/1818320088 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f924c02ede0 con 0x7f925c077bf0 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.298+0000 7f9248ff9700 1 -- 172.21.15.67:0/1818320088 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f9240005830 con 0x7f925c077bf0 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.303+0000 7f924affd700 1 -- 172.21.15.67:0/1818320088 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f924c010be0 con 0x7f925c077bf0 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.304+0000 7f9248ff9700 1 -- 172.21.15.67:0/1818320088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 msgr2=0x7f925c1131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.304+0000 7f9248ff9700 1 --2- 172.21.15.67:0/1818320088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c1131f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f924c006b00 tx=0x7f924c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.304+0000 7f9248ff9700 1 -- 172.21.15.67:0/1818320088 shutdown_connections 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.304+0000 7f9248ff9700 1 --2- 172.21.15.67:0/1818320088 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f925c077bf0 0x7f925c1131f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.304+0000 7f9248ff9700 1 -- 172.21.15.67:0/1818320088 >> 172.21.15.67:0/1818320088 conn(0x7f925c0fd880 msgr2=0x7f925c0ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.304+0000 7f9248ff9700 1 -- 172.21.15.67:0/1818320088 shutdown_connections 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:26.304+0000 7f9248ff9700 1 -- 172.21.15.67:0/1818320088 wait complete. 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:Creating mgr... 2023-12-05T09:17:26.642 INFO:teuthology.orchestra.run.smithi067.stdout:Verifying port 9283 ... 2023-12-05T09:17:26.961 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f6a41352-934e-11ee-95a2-87774f69a715@mgr.smithi067.alxtvv 2023-12-05T09:17:26.961 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f6a41352-934e-11ee-95a2-87774f69a715@mgr.smithi067.alxtvv.service: Unit ceph-f6a41352-934e-11ee-95a2-87774f69a715@mgr.smithi067.alxtvv.service not loaded. 2023-12-05T09:17:27.170 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f6a41352-934e-11ee-95a2-87774f69a715.target.wants/ceph-f6a41352-934e-11ee-95a2-87774f69a715@mgr.smithi067.alxtvv.service → /etc/systemd/system/ceph-f6a41352-934e-11ee-95a2-87774f69a715@.service. 2023-12-05T09:17:27.587 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:27 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1818320088' entity='client.admin' 2023-12-05T09:17:27.769 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T09:17:27.770 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2023-12-05T09:17:27.792 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T09:17:27.792 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2023-12-05T09:17:27.792 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2023-12-05T09:17:27.792 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to enable service . firewalld.service is not available 2023-12-05T09:17:27.814 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T09:17:27.814 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2023-12-05T09:17:27.836 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T09:17:27.836 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2023-12-05T09:17:27.836 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2023-12-05T09:17:27.836 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-05T09:17:27.836 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr to start... 2023-12-05T09:17:27.836 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr... 2023-12-05T09:17:28.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:28 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3873835925' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T09:17:28.678 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:28.681 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:17:28.681 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "f6a41352-934e-11ee-95a2-87774f69a715", 2023-12-05T09:17:28.681 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T09:17:28.681 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T09:17:28.681 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T09:17:28.681 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T09:17:28.682 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:28.682 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T09:17:28.682 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T09:17:28.682 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2023-12-05T09:17:28.682 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:28.682 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T09:17:28.682 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "smithi067" 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T09:17:28.683 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:28.684 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T09:17:28.684 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T09:17:28.684 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T09:17:28.698 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T09:17:28.699 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T09:17:28.699 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T09:17:28.699 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:28.699 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T09:17:28.699 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T09:17:28.699 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T09:17:28.699 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T09:17:28.699 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:28.700 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T09:17:28.701 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T09:17:21.701670+0000", 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.245+0000 7fe00861b700 1 Processor -- start 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.246+0000 7fe00861b700 1 -- start start 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.246+0000 7fe00861b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe0000760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.246+0000 7fe00861b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000077fa0 con 0x7fe000077b90 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.247+0000 7fe0063b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe0000760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.247+0000 7fe0063b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe0000760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33766/0 (socket says 172.21.15.67:33766) 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.247+0000 7fe0063b7700 1 -- 172.21.15.67:0/2602654778 learned_addr learned my addr 172.21.15.67:0/2602654778 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:28.702 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.247+0000 7fe0063b7700 1 -- 172.21.15.67:0/2602654778 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000765e0 con 0x7fe000077b90 2023-12-05T09:17:28.703 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.248+0000 7fe0063b7700 1 --2- 172.21.15.67:0/2602654778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe0000760a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0098e0 tx=0x7fdffc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6057c1e1c1961ac0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:28.703 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.248+0000 7fe0053b5700 1 -- 172.21.15.67:0/2602654778 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdffc00b860 con 0x7fe000077b90 2023-12-05T09:17:28.703 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.248+0000 7fe0053b5700 1 -- 172.21.15.67:0/2602654778 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdffc00be30 con 0x7fe000077b90 2023-12-05T09:17:28.703 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.248+0000 7fe0053b5700 1 -- 172.21.15.67:0/2602654778 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdffc010380 con 0x7fe000077b90 2023-12-05T09:17:28.703 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.249+0000 7fe00861b700 1 -- 172.21.15.67:0/2602654778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 msgr2=0x7fe0000760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:28.703 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.249+0000 7fe00861b700 1 --2- 172.21.15.67:0/2602654778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe0000760a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0098e0 tx=0x7fdffc009250 comp rx=0 tx=0).stop 2023-12-05T09:17:28.703 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.249+0000 7fe00861b700 1 -- 172.21.15.67:0/2602654778 shutdown_connections 2023-12-05T09:17:28.704 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.249+0000 7fe00861b700 1 --2- 172.21.15.67:0/2602654778 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe0000760a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:28.704 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.249+0000 7fe00861b700 1 -- 172.21.15.67:0/2602654778 >> 172.21.15.67:0/2602654778 conn(0x7fe0000fda50 msgr2=0x7fe0000ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:28.704 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.249+0000 7fe00861b700 1 -- 172.21.15.67:0/2602654778 shutdown_connections 2023-12-05T09:17:28.704 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.249+0000 7fe00861b700 1 -- 172.21.15.67:0/2602654778 wait complete. 2023-12-05T09:17:28.704 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.250+0000 7fe00861b700 1 Processor -- start 2023-12-05T09:17:28.704 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.251+0000 7fe00861b700 1 -- start start 2023-12-05T09:17:28.704 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.251+0000 7fe00861b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe000113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.251+0000 7fe00861b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0001138c0 con 0x7fe000077b90 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.251+0000 7fe0063b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe000113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.251+0000 7fe0063b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe000113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33772/0 (socket says 172.21.15.67:33772) 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.251+0000 7fe0063b7700 1 -- 172.21.15.67:0/3873835925 learned_addr learned my addr 172.21.15.67:0/3873835925 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.252+0000 7fe0063b7700 1 -- 172.21.15.67:0/3873835925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0094f0 con 0x7fe000077b90 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.252+0000 7fe0063b7700 1 --2- 172.21.15.67:0/3873835925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe000113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdffc006b00 tx=0x7fdffc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.252+0000 7fdff6ffd700 1 -- 172.21.15.67:0/3873835925 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdffc010a80 con 0x7fe000077b90 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.252+0000 7fdff6ffd700 1 -- 172.21.15.67:0/3873835925 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fdffc01a430 con 0x7fe000077b90 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.252+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000113ac0 con 0x7fe000077b90 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.252+0000 7fdff6ffd700 1 -- 172.21.15.67:0/3873835925 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdffc0245b0 con 0x7fe000077b90 2023-12-05T09:17:28.705 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.252+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe000113ed0 con 0x7fe000077b90 2023-12-05T09:17:28.706 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.253+0000 7fdff6ffd700 1 -- 172.21.15.67:0/3873835925 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdffc024a60 con 0x7fe000077b90 2023-12-05T09:17:28.706 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.253+0000 7fdff6ffd700 1 -- 172.21.15.67:0/3873835925 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdffc02eaa0 con 0x7fe000077b90 2023-12-05T09:17:28.706 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.253+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00004bb80 con 0x7fe000077b90 2023-12-05T09:17:28.706 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.256+0000 7fdff6ffd700 1 -- 172.21.15.67:0/3873835925 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdffc02ec60 con 0x7fe000077b90 2023-12-05T09:17:28.706 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.332+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe000108570 con 0x7fe000077b90 2023-12-05T09:17:28.706 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.333+0000 7fdff6ffd700 1 -- 172.21.15.67:0/3873835925 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe000108570 con 0x7fe000077b90 2023-12-05T09:17:28.706 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.334+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 msgr2=0x7fe000113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:28.707 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.334+0000 7fe00861b700 1 --2- 172.21.15.67:0/3873835925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe000113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdffc006b00 tx=0x7fdffc009250 comp rx=0 tx=0).stop 2023-12-05T09:17:28.707 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.334+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 shutdown_connections 2023-12-05T09:17:28.707 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.334+0000 7fe00861b700 1 --2- 172.21.15.67:0/3873835925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe000077b90 0x7fe000113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:28.707 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.334+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 >> 172.21.15.67:0/3873835925 conn(0x7fe0000fda50 msgr2=0x7fe0000ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:28.707 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.334+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 shutdown_connections 2023-12-05T09:17:28.708 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:28.334+0000 7fe00861b700 1 -- 172.21.15.67:0/3873835925 wait complete. 2023-12-05T09:17:28.708 INFO:teuthology.orchestra.run.smithi067.stdout:mgr not available, waiting (1/15)... 2023-12-05T09:17:31.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:31.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:17:31.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "f6a41352-934e-11ee-95a2-87774f69a715", 2023-12-05T09:17:31.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T09:17:31.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T09:17:31.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T09:17:31.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "smithi067" 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:31.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T09:17:31.554 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T09:17:31.563 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T09:17:31.564 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T09:17:21.701670+0000", 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.117+0000 7f6414a6c700 1 Processor -- start 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.117+0000 7f6414a6c700 1 -- start start 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.118+0000 7f6414a6c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f64101026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.118+0000 7f6414a6c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410102c20 con 0x7f64101022d0 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.118+0000 7f640e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f64101026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:31.565 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.118+0000 7f640e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f64101026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33776/0 (socket says 172.21.15.67:33776) 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.118+0000 7f640e59c700 1 -- 172.21.15.67:0/885276775 learned_addr learned my addr 172.21.15.67:0/885276775 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.119+0000 7f640e59c700 1 -- 172.21.15.67:0/885276775 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6410102d60 con 0x7f64101022d0 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.119+0000 7f640e59c700 1 --2- 172.21.15.67:0/885276775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f64101026e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f64000098e0 tx=0x7f6400009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d110e7d2158c83f server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.119+0000 7f640d59a700 1 -- 172.21.15.67:0/885276775 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f640000b860 con 0x7f64101022d0 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.119+0000 7f640d59a700 1 -- 172.21.15.67:0/885276775 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f640000be30 con 0x7f64101022d0 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.119+0000 7f640d59a700 1 -- 172.21.15.67:0/885276775 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6400010380 con 0x7f64101022d0 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.120+0000 7f6414a6c700 1 -- 172.21.15.67:0/885276775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 msgr2=0x7f64101026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.120+0000 7f6414a6c700 1 --2- 172.21.15.67:0/885276775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f64101026e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f64000098e0 tx=0x7f6400009250 comp rx=0 tx=0).stop 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.120+0000 7f6414a6c700 1 -- 172.21.15.67:0/885276775 shutdown_connections 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.120+0000 7f6414a6c700 1 --2- 172.21.15.67:0/885276775 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f64101026e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.120+0000 7f6414a6c700 1 -- 172.21.15.67:0/885276775 >> 172.21.15.67:0/885276775 conn(0x7f64100fda50 msgr2=0x7f64100ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.120+0000 7f6414a6c700 1 -- 172.21.15.67:0/885276775 shutdown_connections 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.120+0000 7f6414a6c700 1 -- 172.21.15.67:0/885276775 wait complete. 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.121+0000 7f6414a6c700 1 Processor -- start 2023-12-05T09:17:31.566 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.122+0000 7f6414a6c700 1 -- start start 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.122+0000 7f6414a6c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f6410111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.122+0000 7f6414a6c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410111680 con 0x7f64101022d0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.122+0000 7f640e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f6410111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.122+0000 7f640e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f6410111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33790/0 (socket says 172.21.15.67:33790) 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.122+0000 7f640e59c700 1 -- 172.21.15.67:0/3361458495 learned_addr learned my addr 172.21.15.67:0/3361458495 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.123+0000 7f640e59c700 1 -- 172.21.15.67:0/3361458495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000094f0 con 0x7f64101022d0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.123+0000 7f640e59c700 1 --2- 172.21.15.67:0/3361458495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f6410111140 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6400000c00 tx=0x7f6400009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.123+0000 7f63feffd700 1 -- 172.21.15.67:0/3361458495 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6400010a80 con 0x7f64101022d0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.123+0000 7f63feffd700 1 -- 172.21.15.67:0/3361458495 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f640001a430 con 0x7f64101022d0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.123+0000 7f63feffd700 1 -- 172.21.15.67:0/3361458495 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64000245b0 con 0x7f64101022d0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.123+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6410111880 con 0x7f64101022d0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.124+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6410111c90 con 0x7f64101022d0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.124+0000 7f63feffd700 1 -- 172.21.15.67:0/3361458495 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6400024a20 con 0x7f64101022d0 2023-12-05T09:17:31.567 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.124+0000 7f63feffd700 1 -- 172.21.15.67:0/3361458495 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f640002eb00 con 0x7f64101022d0 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.125+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641004bb80 con 0x7f64101022d0 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.128+0000 7f63feffd700 1 -- 172.21.15.67:0/3361458495 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f640001a960 con 0x7f64101022d0 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.229+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f64101040e0 con 0x7f64101022d0 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.230+0000 7f63feffd700 1 -- 172.21.15.67:0/3361458495 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f640002ed10 con 0x7f64101022d0 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.231+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 msgr2=0x7f6410111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.231+0000 7f6414a6c700 1 --2- 172.21.15.67:0/3361458495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f6410111140 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6400000c00 tx=0x7f6400009250 comp rx=0 tx=0).stop 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.231+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 shutdown_connections 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.231+0000 7f6414a6c700 1 --2- 172.21.15.67:0/3361458495 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f64101022d0 0x7f6410111140 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.231+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 >> 172.21.15.67:0/3361458495 conn(0x7f64100fda50 msgr2=0x7f64100ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.231+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 shutdown_connections 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:31.231+0000 7f6414a6c700 1 -- 172.21.15.67:0/3361458495 wait complete. 2023-12-05T09:17:31.568 INFO:teuthology.orchestra.run.smithi067.stdout:mgr not available, waiting (2/15)... 2023-12-05T09:17:32.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:31 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3361458495' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T09:17:34.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:34 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/612668294' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "f6a41352-934e-11ee-95a2-87774f69a715", 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2023-12-05T09:17:34.375 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "smithi067" 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T09:17:34.376 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T09:17:34.386 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T09:17:34.387 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T09:17:34.388 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:34.389 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T09:17:34.389 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T09:17:34.389 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T09:17:34.389 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T09:17:34.389 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T09:17:34.390 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T09:17:34.390 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T09:17:34.390 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:34.390 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:34.390 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:34.390 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T09:17:34.391 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:34.391 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T09:17:21.701670+0000", 2023-12-05T09:17:34.391 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:34.391 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:34.391 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T09:17:34.391 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:17:34.391 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.961+0000 7faee6212700 1 Processor -- start 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.961+0000 7faee6212700 1 -- start start 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.961+0000 7faee6212700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee0104f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.961+0000 7faee6212700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01054a0 con 0x7faee0070f40 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.961+0000 7faedf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee0104f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.962+0000 7faedf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee0104f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33806/0 (socket says 172.21.15.67:33806) 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.962+0000 7faedf7fe700 1 -- 172.21.15.67:0/1680876490 learned_addr learned my addr 172.21.15.67:0/1680876490 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.962+0000 7faedf7fe700 1 -- 172.21.15.67:0/1680876490 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee01055e0 con 0x7faee0070f40 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.962+0000 7faedf7fe700 1 --2- 172.21.15.67:0/1680876490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee0104f60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faed00098e0 tx=0x7faed0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893506be4bc98534 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.962+0000 7faede7fc700 1 -- 172.21.15.67:0/1680876490 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faed000b8f0 con 0x7faee0070f40 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faede7fc700 1 -- 172.21.15.67:0/1680876490 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7faed0011420 con 0x7faee0070f40 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faede7fc700 1 -- 172.21.15.67:0/1680876490 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faed0010540 con 0x7faee0070f40 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faee6212700 1 -- 172.21.15.67:0/1680876490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 msgr2=0x7faee0104f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faee6212700 1 --2- 172.21.15.67:0/1680876490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee0104f60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faed00098e0 tx=0x7faed0009250 comp rx=0 tx=0).stop 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faee6212700 1 -- 172.21.15.67:0/1680876490 shutdown_connections 2023-12-05T09:17:34.392 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faee6212700 1 --2- 172.21.15.67:0/1680876490 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee0104f60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faee6212700 1 -- 172.21.15.67:0/1680876490 >> 172.21.15.67:0/1680876490 conn(0x7faee00fc970 msgr2=0x7faee00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faee6212700 1 -- 172.21.15.67:0/1680876490 shutdown_connections 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.963+0000 7faee6212700 1 -- 172.21.15.67:0/1680876490 wait complete. 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.964+0000 7faee6212700 1 Processor -- start 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.964+0000 7faee6212700 1 -- start start 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.965+0000 7faee6212700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee01111e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.965+0000 7faee6212700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0111720 con 0x7faee0070f40 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.965+0000 7faedf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee01111e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.965+0000 7faedf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee01111e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33822/0 (socket says 172.21.15.67:33822) 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.965+0000 7faedf7fe700 1 -- 172.21.15.67:0/612668294 learned_addr learned my addr 172.21.15.67:0/612668294 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.966+0000 7faedf7fe700 1 -- 172.21.15.67:0/612668294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00094f0 con 0x7faee0070f40 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.966+0000 7faedf7fe700 1 --2- 172.21.15.67:0/612668294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee01111e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faed0011d20 tx=0x7faed0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.966+0000 7faec7fff700 1 -- 172.21.15.67:0/612668294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faed0010910 con 0x7faee0070f40 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.966+0000 7faec7fff700 1 -- 172.21.15.67:0/612668294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7faed0010ee0 con 0x7faee0070f40 2023-12-05T09:17:34.393 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.966+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee0111920 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.966+0000 7faec7fff700 1 -- 172.21.15.67:0/612668294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faed001add0 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.967+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee0111d30 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.967+0000 7faec7fff700 1 -- 172.21.15.67:0/612668294 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7faed00246c0 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.967+0000 7faec7fff700 1 -- 172.21.15.67:0/612668294 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7faed002d950 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.968+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee004bb80 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:33.970+0000 7faec7fff700 1 -- 172.21.15.67:0/612668294 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7faed0029070 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.047+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7faee010ab70 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.047+0000 7faec7fff700 1 -- 172.21.15.67:0/612668294 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7faed001a430 con 0x7faee0070f40 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.048+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 msgr2=0x7faee01111e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.048+0000 7faee6212700 1 --2- 172.21.15.67:0/612668294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee01111e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faed0011d20 tx=0x7faed0009250 comp rx=0 tx=0).stop 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.048+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 shutdown_connections 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.048+0000 7faee6212700 1 --2- 172.21.15.67:0/612668294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faee0070f40 0x7faee01111e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.048+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 >> 172.21.15.67:0/612668294 conn(0x7faee00fc970 msgr2=0x7faee00fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:34.394 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.048+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 shutdown_connections 2023-12-05T09:17:34.395 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:34.048+0000 7faee6212700 1 -- 172.21.15.67:0/612668294 wait complete. 2023-12-05T09:17:34.395 INFO:teuthology.orchestra.run.smithi067.stdout:mgr not available, waiting (3/15)... 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: mgrmap e2: smithi067.alxtvv(active, starting, since 0.00487022s) 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:17:37.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:17:37.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:17:37.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' 2023-12-05T09:17:37.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' 2023-12-05T09:17:37.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:36 smithi067 ceph-mon[107174]: from='mgr.14100 172.21.15.67:0/476745379' entity='mgr.smithi067.alxtvv' 2023-12-05T09:17:37.150 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "f6a41352-934e-11ee-95a2-87774f69a715", 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T09:17:37.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "smithi067" 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T09:17:37.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T09:17:37.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T09:17:37.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T09:17:37.160 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T09:17:37.161 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T09:17:21.701670+0000", 2023-12-05T09:17:37.162 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.806+0000 7f4856332700 1 Processor -- start 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.806+0000 7f4856332700 1 -- start start 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.806+0000 7f4856332700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.806+0000 7f4856332700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4850078000 con 0x7f4850077bf0 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.807+0000 7f484ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.807+0000 7f484ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45790/0 (socket says 172.21.15.67:45790) 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.807+0000 7f484ffff700 1 -- 172.21.15.67:0/2113299075 learned_addr learned my addr 172.21.15.67:0/2113299075 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.807+0000 7f484ffff700 1 -- 172.21.15.67:0/2113299075 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850076640 con 0x7f4850077bf0 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.807+0000 7f484ffff700 1 --2- 172.21.15.67:0/2113299075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850076100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f48400098e0 tx=0x7f4840009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19dc0ba713b96bb server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.807+0000 7f484effd700 1 -- 172.21.15.67:0/2113299075 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f484000b860 con 0x7f4850077bf0 2023-12-05T09:17:37.163 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f484effd700 1 -- 172.21.15.67:0/2113299075 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f484000be30 con 0x7f4850077bf0 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f484effd700 1 -- 172.21.15.67:0/2113299075 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4840010380 con 0x7f4850077bf0 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f4856332700 1 -- 172.21.15.67:0/2113299075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 msgr2=0x7f4850076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f4856332700 1 --2- 172.21.15.67:0/2113299075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850076100 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f48400098e0 tx=0x7f4840009250 comp rx=0 tx=0).stop 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f4856332700 1 -- 172.21.15.67:0/2113299075 shutdown_connections 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f4856332700 1 --2- 172.21.15.67:0/2113299075 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850076100 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f4856332700 1 -- 172.21.15.67:0/2113299075 >> 172.21.15.67:0/2113299075 conn(0x7f48500fda50 msgr2=0x7f48500ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f4856332700 1 -- 172.21.15.67:0/2113299075 shutdown_connections 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.808+0000 7f4856332700 1 -- 172.21.15.67:0/2113299075 wait complete. 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.809+0000 7f4856332700 1 Processor -- start 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.809+0000 7f4856332700 1 -- start start 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.810+0000 7f4856332700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.810+0000 7f4856332700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48501138c0 con 0x7f4850077bf0 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.810+0000 7f484ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.810+0000 7f484ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45804/0 (socket says 172.21.15.67:45804) 2023-12-05T09:17:37.164 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.810+0000 7f484ffff700 1 -- 172.21.15.67:0/1359521747 learned_addr learned my addr 172.21.15.67:0/1359521747 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.810+0000 7f484ffff700 1 -- 172.21.15.67:0/1359521747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400094f0 con 0x7f4850077bf0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.810+0000 7f484ffff700 1 --2- 172.21.15.67:0/1359521747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850113380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4840006b00 tx=0x7f4840009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.811+0000 7f484cff9700 1 -- 172.21.15.67:0/1359521747 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4840010a80 con 0x7f4850077bf0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.811+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4850113ac0 con 0x7f4850077bf0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.811+0000 7f484cff9700 1 -- 172.21.15.67:0/1359521747 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f484001a430 con 0x7f4850077bf0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.811+0000 7f484cff9700 1 -- 172.21.15.67:0/1359521747 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f48400245b0 con 0x7f4850077bf0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.811+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4850113ed0 con 0x7f4850077bf0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.812+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485004bb80 con 0x7f4850077bf0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.812+0000 7f484cff9700 1 -- 172.21.15.67:0/1359521747 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 2) v1 ==== 43037+0+0 (secure 0 0 0) 0x7f4840010be0 con 0x7f4850077bf0 2023-12-05T09:17:37.165 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.813+0000 7f484cff9700 1 -- 172.21.15.67:0/1359521747 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f484004a6d0 con 0x7f4850077bf0 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.815+0000 7f484cff9700 1 -- 172.21.15.67:0/1359521747 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4840010e90 con 0x7f4850077bf0 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.893+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f485010d140 con 0x7f4850077bf0 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.893+0000 7f484cff9700 1 -- 172.21.15.67:0/1359521747 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f4840023390 con 0x7f4850077bf0 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.894+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 msgr2=0x7f4850113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.894+0000 7f4856332700 1 --2- 172.21.15.67:0/1359521747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850113380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4840006b00 tx=0x7f4840009250 comp rx=0 tx=0).stop 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.894+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 shutdown_connections 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.894+0000 7f4856332700 1 --2- 172.21.15.67:0/1359521747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4850077bf0 0x7f4850113380 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.894+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 >> 172.21.15.67:0/1359521747 conn(0x7f48500fda50 msgr2=0x7f48500ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.894+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 shutdown_connections 2023-12-05T09:17:37.166 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:36.894+0000 7f4856332700 1 -- 172.21.15.67:0/1359521747 wait complete. 2023-12-05T09:17:37.167 INFO:teuthology.orchestra.run.smithi067.stdout:mgr not available, waiting (4/15)... 2023-12-05T09:17:38.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:37 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1359521747' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T09:17:38.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:37 smithi067 ceph-mon[107174]: mgrmap e3: smithi067.alxtvv(active, since 1.00859s) 2023-12-05T09:17:40.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:39 smithi067 ceph-mon[107174]: mgrmap e4: smithi067.alxtvv(active, since 2s) 2023-12-05T09:17:44.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:44 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3590256294' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-05T09:17:45.940 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:45.940 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsid": "f6a41352-934e-11ee-95a2-87774f69a715", 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "health": { 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 0 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "smithi067" 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:45.941 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-05T09:17:45.942 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-05T09:17:45.951 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-05T09:17:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "restful" 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ], 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "modified": "2023-12-05T09:17:21.701670+0000", 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout }, 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.852+0000 7f70b1aaf700 1 Processor -- start 2023-12-05T09:17:45.953 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.852+0000 7f70b1aaf700 1 -- start start 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.852+0000 7f70b1aaf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac0760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.852+0000 7f70b1aaf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac077fa0 con 0x7f70ac077b90 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.853+0000 7f70ab7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac0760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.853+0000 7f70ab7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac0760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45812/0 (socket says 172.21.15.67:45812) 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.853+0000 7f70ab7fe700 1 -- 172.21.15.67:0/1168474054 learned_addr learned my addr 172.21.15.67:0/1168474054 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.853+0000 7f70ab7fe700 1 -- 172.21.15.67:0/1168474054 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0765e0 con 0x7f70ac077b90 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.853+0000 7f70ab7fe700 1 --2- 172.21.15.67:0/1168474054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac0760a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f709c0098e0 tx=0x7f709c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6a7764cfe30a53 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70aa7fc700 1 -- 172.21.15.67:0/1168474054 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f709c00b860 con 0x7f70ac077b90 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70aa7fc700 1 -- 172.21.15.67:0/1168474054 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f709c00be30 con 0x7f70ac077b90 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70aa7fc700 1 -- 172.21.15.67:0/1168474054 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f709c010380 con 0x7f70ac077b90 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70b1aaf700 1 -- 172.21.15.67:0/1168474054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 msgr2=0x7f70ac0760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70b1aaf700 1 --2- 172.21.15.67:0/1168474054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac0760a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f709c0098e0 tx=0x7f709c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70b1aaf700 1 -- 172.21.15.67:0/1168474054 shutdown_connections 2023-12-05T09:17:45.954 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70b1aaf700 1 --2- 172.21.15.67:0/1168474054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac0760a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70b1aaf700 1 -- 172.21.15.67:0/1168474054 >> 172.21.15.67:0/1168474054 conn(0x7f70ac0fda50 msgr2=0x7f70ac0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70b1aaf700 1 -- 172.21.15.67:0/1168474054 shutdown_connections 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.854+0000 7f70b1aaf700 1 -- 172.21.15.67:0/1168474054 wait complete. 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.855+0000 7f70b1aaf700 1 Processor -- start 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.855+0000 7f70b1aaf700 1 -- start start 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.856+0000 7f70b1aaf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.856+0000 7f70b1aaf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac1138c0 con 0x7f70ac077b90 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.856+0000 7f70ab7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.856+0000 7f70ab7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45822/0 (socket says 172.21.15.67:45822) 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.856+0000 7f70ab7fe700 1 -- 172.21.15.67:0/3590256294 learned_addr learned my addr 172.21.15.67:0/3590256294 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.856+0000 7f70ab7fe700 1 -- 172.21.15.67:0/3590256294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0094f0 con 0x7f70ac077b90 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.857+0000 7f70ab7fe700 1 --2- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac113380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f709c006d40 tx=0x7f709c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.857+0000 7f7093fff700 1 -- 172.21.15.67:0/3590256294 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f709c0109b0 con 0x7f70ac077b90 2023-12-05T09:17:45.955 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.857+0000 7f7093fff700 1 -- 172.21.15.67:0/3590256294 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f709c024440 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.857+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ac113ac0 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.857+0000 7f7093fff700 1 -- 172.21.15.67:0/3590256294 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f709c01a5f0 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.857+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac113ed0 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.858+0000 7f7093fff700 1 -- 172.21.15.67:0/3590256294 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f709c024970 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.858+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ac04bb80 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.858+0000 7f7093fff700 1 --2- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f70940365f0 0x7f7094038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.858+0000 7f7093fff700 1 -- 172.21.15.67:0/3590256294 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f709c04a3c0 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.859+0000 7f70aaffd700 1 --2- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f70940365f0 0x7f7094038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.859+0000 7f70aaffd700 1 --2- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f70940365f0 0x7f7094038aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009990 tx=0x7f70a0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:43.864+0000 7f7093fff700 1 -- 172.21.15.67:0/3590256294 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f709c0245b0 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.151+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f70ac10d140 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.151+0000 7f7093fff700 1 -- 172.21.15.67:0/3590256294 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f709c0233a0 con 0x7f70ac077b90 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.153+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f70940365f0 msgr2=0x7f7094038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.153+0000 7f70b1aaf700 1 --2- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f70940365f0 0x7f7094038aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009990 tx=0x7f70a0006e40 comp rx=0 tx=0).stop 2023-12-05T09:17:45.956 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.153+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 msgr2=0x7f70ac113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.153+0000 7f70b1aaf700 1 --2- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac113380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f709c006d40 tx=0x7f709c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.154+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 shutdown_connections 2023-12-05T09:17:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.154+0000 7f70b1aaf700 1 --2- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f70940365f0 0x7f7094038aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.154+0000 7f70b1aaf700 1 --2- 172.21.15.67:0/3590256294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70ac077b90 0x7f70ac113380 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.154+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 >> 172.21.15.67:0/3590256294 conn(0x7f70ac0fda50 msgr2=0x7f70ac0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.154+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 shutdown_connections 2023-12-05T09:17:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:44.154+0000 7f70b1aaf700 1 -- 172.21.15.67:0/3590256294 wait complete. 2023-12-05T09:17:45.957 INFO:teuthology.orchestra.run.smithi067.stdout:mgr is available 2023-12-05T09:17:46.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:46 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/397802267' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [global] 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout fsid = f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-05T09:17:46.919 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout [osd] 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.379+0000 7f20edee0700 1 Processor -- start 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.379+0000 7f20edee0700 1 -- start start 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.379+0000 7f20edee0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.379+0000 7f20edee0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8077fc0 con 0x7f20e8077bb0 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.380+0000 7f20e77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.380+0000 7f20e77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35658/0 (socket says 172.21.15.67:35658) 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.380+0000 7f20e77fe700 1 -- 172.21.15.67:0/1597405359 learned_addr learned my addr 172.21.15.67:0/1597405359 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:46.920 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.380+0000 7f20e77fe700 1 -- 172.21.15.67:0/1597405359 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8076600 con 0x7f20e8077bb0 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.380+0000 7f20e77fe700 1 --2- 172.21.15.67:0/1597405359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e80760c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f20d80098e0 tx=0x7f20d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3487b3b4a068b53 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20e67fc700 1 -- 172.21.15.67:0/1597405359 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20d800b860 con 0x7f20e8077bb0 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20e67fc700 1 -- 172.21.15.67:0/1597405359 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f20d800be30 con 0x7f20e8077bb0 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20e67fc700 1 -- 172.21.15.67:0/1597405359 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20d8010380 con 0x7f20e8077bb0 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20edee0700 1 -- 172.21.15.67:0/1597405359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 msgr2=0x7f20e80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20edee0700 1 --2- 172.21.15.67:0/1597405359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e80760c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f20d80098e0 tx=0x7f20d8009250 comp rx=0 tx=0).stop 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20edee0700 1 -- 172.21.15.67:0/1597405359 shutdown_connections 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20edee0700 1 --2- 172.21.15.67:0/1597405359 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e80760c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20edee0700 1 -- 172.21.15.67:0/1597405359 >> 172.21.15.67:0/1597405359 conn(0x7f20e80fda50 msgr2=0x7f20e80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20edee0700 1 -- 172.21.15.67:0/1597405359 shutdown_connections 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.381+0000 7f20edee0700 1 -- 172.21.15.67:0/1597405359 wait complete. 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.382+0000 7f20edee0700 1 Processor -- start 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.382+0000 7f20edee0700 1 -- start start 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.383+0000 7f20edee0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e81133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.383+0000 7f20edee0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8113910 con 0x7f20e8077bb0 2023-12-05T09:17:46.921 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.383+0000 7f20e77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e81133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.383+0000 7f20e77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e81133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35668/0 (socket says 172.21.15.67:35668) 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.383+0000 7f20e77fe700 1 -- 172.21.15.67:0/397802267 learned_addr learned my addr 172.21.15.67:0/397802267 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.383+0000 7f20e77fe700 1 -- 172.21.15.67:0/397802267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80094f0 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.383+0000 7f20e77fe700 1 --2- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e81133d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20d800b440 tx=0x7f20d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.384+0000 7f20cffff700 1 -- 172.21.15.67:0/397802267 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20d80107a0 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.384+0000 7f20cffff700 1 -- 172.21.15.67:0/397802267 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f20d8010d70 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.384+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e8113b10 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.384+0000 7f20cffff700 1 -- 172.21.15.67:0/397802267 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20d801adc0 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.384+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e8113f20 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.385+0000 7f20cffff700 1 -- 172.21.15.67:0/397802267 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f20d8010900 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.385+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e804bb80 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.385+0000 7f20cffff700 1 --2- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f20d0036640 0x7f20d0038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.385+0000 7f20cffff700 1 -- 172.21.15.67:0/397802267 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f20d8049c10 con 0x7f20e8077bb0 2023-12-05T09:17:46.922 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.386+0000 7f20e6ffd700 1 --2- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f20d0036640 0x7f20d0038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.386+0000 7f20e6ffd700 1 --2- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f20d0036640 0x7f20d0038af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009990 tx=0x7f20dc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.390+0000 7f20cffff700 1 -- 172.21.15.67:0/397802267 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f20d8006d70 con 0x7f20e8077bb0 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.594+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f20e8108550 con 0x7f20e8077bb0 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.595+0000 7f20cffff700 1 -- 172.21.15.67:0/397802267 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f20d8023350 con 0x7f20e8077bb0 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f20d0036640 msgr2=0x7f20d0038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 --2- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f20d0036640 0x7f20d0038af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009990 tx=0x7f20dc006e40 comp rx=0 tx=0).stop 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 msgr2=0x7f20e81133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 --2- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e81133d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20d800b440 tx=0x7f20d8009250 comp rx=0 tx=0).stop 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 shutdown_connections 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 --2- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f20d0036640 0x7f20d0038af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 --2- 172.21.15.67:0/397802267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20e8077bb0 0x7f20e81133d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 >> 172.21.15.67:0/397802267 conn(0x7f20e80fda50 msgr2=0x7f20e80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 shutdown_connections 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:46.597+0000 7f20edee0700 1 -- 172.21.15.67:0/397802267 wait complete. 2023-12-05T09:17:46.923 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling cephadm module... 2023-12-05T09:17:48.105 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:47 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/222295204' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.289+0000 7f6337de1700 1 Processor -- start 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.289+0000 7f6337de1700 1 -- start start 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.290+0000 7f6337de1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f6330076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.290+0000 7f6337de1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6330078000 con 0x7f6330077bf0 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.290+0000 7f6335b7d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f6330076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.290+0000 7f6335b7d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f6330076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35680/0 (socket says 172.21.15.67:35680) 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.290+0000 7f6335b7d700 1 -- 172.21.15.67:0/2689053345 learned_addr learned my addr 172.21.15.67:0/2689053345 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.290+0000 7f6335b7d700 1 -- 172.21.15.67:0/2689053345 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330076640 con 0x7f6330077bf0 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.291+0000 7f6335b7d700 1 --2- 172.21.15.67:0/2689053345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f6330076100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f632c0098e0 tx=0x7f632c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c491455f2b48e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:48.151 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.291+0000 7f6334b7b700 1 -- 172.21.15.67:0/2689053345 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f632c00b860 con 0x7f6330077bf0 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.291+0000 7f6334b7b700 1 -- 172.21.15.67:0/2689053345 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f632c00be30 con 0x7f6330077bf0 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.291+0000 7f6334b7b700 1 -- 172.21.15.67:0/2689053345 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f632c010380 con 0x7f6330077bf0 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.291+0000 7f6337de1700 1 -- 172.21.15.67:0/2689053345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 msgr2=0x7f6330076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.291+0000 7f6337de1700 1 --2- 172.21.15.67:0/2689053345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f6330076100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f632c0098e0 tx=0x7f632c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.292+0000 7f6337de1700 1 -- 172.21.15.67:0/2689053345 shutdown_connections 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.292+0000 7f6337de1700 1 --2- 172.21.15.67:0/2689053345 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f6330076100 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.292+0000 7f6337de1700 1 -- 172.21.15.67:0/2689053345 >> 172.21.15.67:0/2689053345 conn(0x7f63300fda50 msgr2=0x7f63300ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.292+0000 7f6337de1700 1 -- 172.21.15.67:0/2689053345 shutdown_connections 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.292+0000 7f6337de1700 1 -- 172.21.15.67:0/2689053345 wait complete. 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.292+0000 7f6337de1700 1 Processor -- start 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.293+0000 7f6337de1700 1 -- start start 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.293+0000 7f6337de1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f63301133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.293+0000 7f6337de1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63301138e0 con 0x7f6330077bf0 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.293+0000 7f6335b7d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f63301133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:48.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.293+0000 7f6335b7d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f63301133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35696/0 (socket says 172.21.15.67:35696) 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.293+0000 7f6335b7d700 1 -- 172.21.15.67:0/222295204 learned_addr learned my addr 172.21.15.67:0/222295204 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.294+0000 7f6335b7d700 1 -- 172.21.15.67:0/222295204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0094f0 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.294+0000 7f6335b7d700 1 --2- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f63301133a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f632c006b00 tx=0x7f632c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.294+0000 7f63267fc700 1 -- 172.21.15.67:0/222295204 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f632c010a80 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.294+0000 7f63267fc700 1 -- 172.21.15.67:0/222295204 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f632c01a430 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.294+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6330113ae0 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.294+0000 7f63267fc700 1 -- 172.21.15.67:0/222295204 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f632c0245b0 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.294+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6330113ef0 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.295+0000 7f63267fc700 1 -- 172.21.15.67:0/222295204 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f632c010be0 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.295+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633004bb80 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.296+0000 7f63267fc700 1 --2- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f631c0365f0 0x7f631c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.296+0000 7f63267fc700 1 -- 172.21.15.67:0/222295204 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f632c04aa50 con 0x7f6330077bf0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.296+0000 7f633537c700 1 --2- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f631c0365f0 0x7f631c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.297+0000 7f633537c700 1 --2- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f631c0365f0 0x7f631c038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6320009990 tx=0x7f6320006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:48.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.301+0000 7f63267fc700 1 -- 172.21.15.67:0/222295204 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f632c02e440 con 0x7f6330077bf0 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.556+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f633010d140 con 0x7f6330077bf0 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.839+0000 7f63267fc700 1 -- 172.21.15.67:0/222295204 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f632c00fd90 con 0x7f6330077bf0 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.841+0000 7f63267fc700 1 -- 172.21.15.67:0/222295204 <== mon.0 v2:172.21.15.67:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f632c0174e0 con 0x7f6330077bf0 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f631c0365f0 msgr2=0x7f631c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 --2- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f631c0365f0 0x7f631c038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6320009990 tx=0x7f6320006e40 comp rx=0 tx=0).stop 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 msgr2=0x7f63301133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 --2- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f63301133a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f632c006b00 tx=0x7f632c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 shutdown_connections 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 --2- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f631c0365f0 0x7f631c038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 --2- 172.21.15.67:0/222295204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6330077bf0 0x7f63301133a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 >> 172.21.15.67:0/222295204 conn(0x7f63300fda50 msgr2=0x7f63300ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 shutdown_connections 2023-12-05T09:17:48.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:47.843+0000 7f6337de1700 1 -- 172.21.15.67:0/222295204 wait complete. 2023-12-05T09:17:49.055 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:48 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/222295204' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-05T09:17:49.055 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:48 smithi067 ceph-mon[107174]: mgrmap e5: smithi067.alxtvv(active, since 11s) 2023-12-05T09:17:49.222 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "active_name": "smithi067.alxtvv", 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.597+0000 7f05e3b39700 1 Processor -- start 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.598+0000 7f05e3b39700 1 -- start start 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.598+0000 7f05e3b39700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.598+0000 7f05e3b39700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc077fe0 con 0x7f05dc077bd0 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.598+0000 7f05e18d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.598+0000 7f05e18d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc0760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35718/0 (socket says 172.21.15.67:35718) 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.598+0000 7f05e18d5700 1 -- 172.21.15.67:0/97222703 learned_addr learned my addr 172.21.15.67:0/97222703 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.599+0000 7f05e18d5700 1 -- 172.21.15.67:0/97222703 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc076620 con 0x7f05dc077bd0 2023-12-05T09:17:49.223 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.599+0000 7f05e18d5700 1 --2- 172.21.15.67:0/97222703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc0760e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098e0 tx=0x7f05d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f893385830676432 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.599+0000 7f05e08d3700 1 -- 172.21.15.67:0/97222703 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d800b860 con 0x7f05dc077bd0 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.599+0000 7f05e08d3700 1 -- 172.21.15.67:0/97222703 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f05d800be30 con 0x7f05dc077bd0 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.599+0000 7f05e08d3700 1 -- 172.21.15.67:0/97222703 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d8010380 con 0x7f05dc077bd0 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.600+0000 7f05e3b39700 1 -- 172.21.15.67:0/97222703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 msgr2=0x7f05dc0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.600+0000 7f05e3b39700 1 --2- 172.21.15.67:0/97222703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc0760e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f05d80098e0 tx=0x7f05d8009250 comp rx=0 tx=0).stop 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.600+0000 7f05e3b39700 1 -- 172.21.15.67:0/97222703 shutdown_connections 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.600+0000 7f05e3b39700 1 --2- 172.21.15.67:0/97222703 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc0760e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.600+0000 7f05e3b39700 1 -- 172.21.15.67:0/97222703 >> 172.21.15.67:0/97222703 conn(0x7f05dc0fda50 msgr2=0x7f05dc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.600+0000 7f05e3b39700 1 -- 172.21.15.67:0/97222703 shutdown_connections 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.600+0000 7f05e3b39700 1 -- 172.21.15.67:0/97222703 wait complete. 2023-12-05T09:17:49.224 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.601+0000 7f05e3b39700 1 Processor -- start 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.601+0000 7f05e3b39700 1 -- start start 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.602+0000 7f05e3b39700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.602+0000 7f05e3b39700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc113900 con 0x7f05dc077bd0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.602+0000 7f05e18d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.602+0000 7f05e18d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc1133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35734/0 (socket says 172.21.15.67:35734) 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.602+0000 7f05e18d5700 1 -- 172.21.15.67:0/2725014598 learned_addr learned my addr 172.21.15.67:0/2725014598 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.602+0000 7f05e18d5700 1 -- 172.21.15.67:0/2725014598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d80094f0 con 0x7f05dc077bd0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.603+0000 7f05e18d5700 1 --2- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc1133c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05d8006fd0 tx=0x7f05d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.603+0000 7f05d27fc700 1 -- 172.21.15.67:0/2725014598 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d8010750 con 0x7f05dc077bd0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.603+0000 7f05d27fc700 1 -- 172.21.15.67:0/2725014598 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f05d8010d20 con 0x7f05dc077bd0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.603+0000 7f05d27fc700 1 -- 172.21.15.67:0/2725014598 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05d801ada0 con 0x7f05dc077bd0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.603+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc113b00 con 0x7f05dc077bd0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.603+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc113f10 con 0x7f05dc077bd0 2023-12-05T09:17:49.225 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.604+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc04bb80 con 0x7f05dc077bd0 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.604+0000 7f05d27fc700 1 -- 172.21.15.67:0/2725014598 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f05d80108b0 con 0x7f05dc077bd0 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.605+0000 7f05d27fc700 1 --2- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f05c8036640 0x7f05c8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.605+0000 7f05d27fc700 1 -- 172.21.15.67:0/2725014598 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f05d8049af0 con 0x7f05dc077bd0 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.605+0000 7f05e10d4700 1 -- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f05c8036640 msgr2=0x7f05c8038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/1356443197 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.605+0000 7f05e10d4700 1 --2- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f05c8036640 0x7f05c8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.610+0000 7f05d27fc700 1 -- 172.21.15.67:0/2725014598 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f05d802c350 con 0x7f05dc077bd0 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.806+0000 7f05e10d4700 1 -- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f05c8036640 msgr2=0x7f05c8038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/1356443197 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.806+0000 7f05e10d4700 1 --2- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f05c8036640 0x7f05c8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.871+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f05dc0008d0 con 0x7f05dc077bd0 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.871+0000 7f05d27fc700 1 -- 172.21.15.67:0/2725014598 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f05d8020070 con 0x7f05dc077bd0 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.873+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f05c8036640 msgr2=0x7f05c8038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.873+0000 7f05e3b39700 1 --2- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f05c8036640 0x7f05c8038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:49.226 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.873+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 msgr2=0x7f05dc1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.873+0000 7f05e3b39700 1 --2- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc1133c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f05d8006fd0 tx=0x7f05d8009250 comp rx=0 tx=0).stop 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.873+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 shutdown_connections 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.873+0000 7f05e3b39700 1 --2- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f05c8036640 0x7f05c8038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.873+0000 7f05e3b39700 1 --2- 172.21.15.67:0/2725014598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f05dc077bd0 0x7f05dc1133c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.873+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 >> 172.21.15.67:0/2725014598 conn(0x7f05dc0fda50 msgr2=0x7f05dc0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.874+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 shutdown_connections 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:48.874+0000 7f05e3b39700 1 -- 172.21.15.67:0/2725014598 wait complete. 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for the mgr to restart... 2023-12-05T09:17:49.227 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr epoch 5... 2023-12-05T09:17:50.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:49 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2725014598' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-05T09:17:57.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: Active manager daemon smithi067.alxtvv restarted 2023-12-05T09:17:57.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:17:57.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: osdmap e2: 0 total, 0 up, 0 in 2023-12-05T09:17:57.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: mgrmap e6: smithi067.alxtvv(active, starting, since 0.00354142s) 2023-12-05T09:17:57.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:17:57.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:17:57.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:17:57.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:17:57.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:17:57.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:17:57.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:17:57.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:17:57.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:17:57.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:17:57.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:17:57.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:17:57.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:56 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:17:57.719 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:17:57.719 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-05T09:17:57.719 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.607+0000 7f8c52759700 1 Processor -- start 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.607+0000 7f8c52759700 1 -- start start 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.607+0000 7f8c52759700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.607+0000 7f8c52759700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c102c20 con 0x7f8c4c1022d0 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.608+0000 7f8c4bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.608+0000 7f8c4bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35748/0 (socket says 172.21.15.67:35748) 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.608+0000 7f8c4bfff700 1 -- 172.21.15.67:0/3217029059 learned_addr learned my addr 172.21.15.67:0/3217029059 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:57.720 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.608+0000 7f8c4bfff700 1 -- 172.21.15.67:0/3217029059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c102d60 con 0x7f8c4c1022d0 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.608+0000 7f8c4bfff700 1 --2- 172.21.15.67:0/3217029059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c1026e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0098e0 tx=0x7f8c3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47b4b25a31a9f3f server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.609+0000 7f8c4affd700 1 -- 172.21.15.67:0/3217029059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c3c00b860 con 0x7f8c4c1022d0 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.609+0000 7f8c4affd700 1 -- 172.21.15.67:0/3217029059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8c3c00be30 con 0x7f8c4c1022d0 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.609+0000 7f8c4affd700 1 -- 172.21.15.67:0/3217029059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c3c010380 con 0x7f8c4c1022d0 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.609+0000 7f8c52759700 1 -- 172.21.15.67:0/3217029059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 msgr2=0x7f8c4c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.609+0000 7f8c52759700 1 --2- 172.21.15.67:0/3217029059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c1026e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0098e0 tx=0x7f8c3c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.610+0000 7f8c52759700 1 -- 172.21.15.67:0/3217029059 shutdown_connections 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.610+0000 7f8c52759700 1 --2- 172.21.15.67:0/3217029059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c1026e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.610+0000 7f8c52759700 1 -- 172.21.15.67:0/3217029059 >> 172.21.15.67:0/3217029059 conn(0x7f8c4c0fda50 msgr2=0x7f8c4c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.610+0000 7f8c52759700 1 -- 172.21.15.67:0/3217029059 shutdown_connections 2023-12-05T09:17:57.721 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.610+0000 7f8c52759700 1 -- 172.21.15.67:0/3217029059 wait complete. 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.611+0000 7f8c52759700 1 Processor -- start 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.611+0000 7f8c52759700 1 -- start start 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.611+0000 7f8c52759700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.611+0000 7f8c52759700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c113880 con 0x7f8c4c1022d0 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.611+0000 7f8c4bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.611+0000 7f8c4bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c113340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35758/0 (socket says 172.21.15.67:35758) 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.611+0000 7f8c4bfff700 1 -- 172.21.15.67:0/3669469057 learned_addr learned my addr 172.21.15.67:0/3669469057 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.612+0000 7f8c4bfff700 1 -- 172.21.15.67:0/3669469057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0094f0 con 0x7f8c4c1022d0 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.612+0000 7f8c4bfff700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c113340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c000c00 tx=0x7f8c3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.612+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c3c010a80 con 0x7f8c4c1022d0 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.612+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8c3c01a430 con 0x7f8c4c1022d0 2023-12-05T09:17:57.722 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.612+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c113a80 con 0x7f8c4c1022d0 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.612+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c3c0245b0 con 0x7f8c4c1022d0 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.612+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4c113e90 con 0x7f8c4c1022d0 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.614+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f8c3c010be0 con 0x7f8c4c1022d0 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.614+0000 7f8c48ff9700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.614+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 --> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c34039200 con 0x7f8c34036640 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.614+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8c3c04ab50 con 0x7f8c4c1022d0 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.614+0000 7f8c4b7fe700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 msgr2=0x7f8c34038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/1356443197 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.614+0000 7f8c4b7fe700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.815+0000 7f8c4b7fe700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 msgr2=0x7f8c34038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/1356443197 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:49.815+0000 7f8c4b7fe700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:50.216+0000 7f8c4b7fe700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 msgr2=0x7f8c34038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/1356443197 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:50.216+0000 7f8c4b7fe700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:51.017+0000 7f8c4b7fe700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 msgr2=0x7f8c34038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/1356443197 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:51.017+0000 7f8c4b7fe700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-05T09:17:57.723 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:52.619+0000 7f8c4b7fe700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 msgr2=0x7f8c34038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/1356443197 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:52.619+0000 7f8c4b7fe700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:55.822+0000 7f8c4b7fe700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 msgr2=0x7f8c34038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/1356443197 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:55.822+0000 7f8c4b7fe700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:56.448+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7f8c3c02e910 con 0x7f8c4c1022d0 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:56.448+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 msgr2=0x7f8c34038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:56.448+0000 7f8c48ff9700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.450+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7f8c3c02e440 con 0x7f8c4c1022d0 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.450+0000 7f8c48ff9700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8c34039f60 0x7f8c3403c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.450+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c34039200 con 0x7f8c34039f60 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.451+0000 7f8c4b7fe700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8c34039f60 0x7f8c3403c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.452+0000 7f8c4b7fe700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8c34039f60 0x7f8c3403c340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c400039d0 tx=0x7f8c40009350 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.453+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f8c34039200 con 0x7f8c34039f60 2023-12-05T09:17:57.724 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.459+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8c4c04bb80 con 0x7f8c34039f60 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c48ff9700 1 -- 172.21.15.67:0/3669469057 <== mgr.14122 v2:172.21.15.67:6800/2543364948 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8c4c04bb80 con 0x7f8c34039f60 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8c34039f60 msgr2=0x7f8c3403c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8c34039f60 0x7f8c3403c340 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8c400039d0 tx=0x7f8c40009350 comp rx=0 tx=0).stop 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 msgr2=0x7f8c4c113340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c113340 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c000c00 tx=0x7f8c3c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 shutdown_connections 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8c34039f60 0x7f8c3403c340 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c4c1022d0 0x7f8c4c113340 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 --2- 172.21.15.67:0/3669469057 >> [v2:172.21.15.67:6800/1356443197,v1:172.21.15.67:6801/1356443197] conn(0x7f8c34036640 0x7f8c34038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 >> 172.21.15.67:0/3669469057 conn(0x7f8c4c0fda50 msgr2=0x7f8c4c0ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 shutdown_connections 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:57.460+0000 7f8c52759700 1 -- 172.21.15.67:0/3669469057 wait complete. 2023-12-05T09:17:57.725 INFO:teuthology.orchestra.run.smithi067.stdout:mgr epoch 5 is available 2023-12-05T09:17:57.726 INFO:teuthology.orchestra.run.smithi067.stdout:Setting orchestrator backend to cephadm... 2023-12-05T09:17:58.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:57 smithi067 ceph-mon[107174]: Found migration_current of "None". Setting to last migration. 2023-12-05T09:17:58.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:57 smithi067 ceph-mon[107174]: mgrmap e7: smithi067.alxtvv(active, since 1.00619s) 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.107+0000 7faff0c12700 1 Processor -- start 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.107+0000 7faff0c12700 1 -- start start 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.107+0000 7faff0c12700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec0760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.107+0000 7faff0c12700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec077fc0 con 0x7fafec077bb0 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.108+0000 7fafea59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec0760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.108+0000 7fafea59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec0760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45190/0 (socket says 172.21.15.67:45190) 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.108+0000 7fafea59c700 1 -- 172.21.15.67:0/1985374770 learned_addr learned my addr 172.21.15.67:0/1985374770 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.108+0000 7fafea59c700 1 -- 172.21.15.67:0/1985374770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec076600 con 0x7fafec077bb0 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.108+0000 7fafea59c700 1 --2- 172.21.15.67:0/1985374770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec0760c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0098e0 tx=0x7fafdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5511c3e8ae66cac server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.109+0000 7fafe959a700 1 -- 172.21.15.67:0/1985374770 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafdc00b860 con 0x7fafec077bb0 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.109+0000 7fafe959a700 1 -- 172.21.15.67:0/1985374770 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fafdc00be30 con 0x7fafec077bb0 2023-12-05T09:17:58.664 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.109+0000 7fafe959a700 1 -- 172.21.15.67:0/1985374770 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafdc010380 con 0x7fafec077bb0 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.109+0000 7faff0c12700 1 -- 172.21.15.67:0/1985374770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 msgr2=0x7fafec0760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.109+0000 7faff0c12700 1 --2- 172.21.15.67:0/1985374770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec0760c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0098e0 tx=0x7fafdc009250 comp rx=0 tx=0).stop 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.110+0000 7faff0c12700 1 -- 172.21.15.67:0/1985374770 shutdown_connections 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.110+0000 7faff0c12700 1 --2- 172.21.15.67:0/1985374770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec0760c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.110+0000 7faff0c12700 1 -- 172.21.15.67:0/1985374770 >> 172.21.15.67:0/1985374770 conn(0x7fafec0fda50 msgr2=0x7fafec0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.110+0000 7faff0c12700 1 -- 172.21.15.67:0/1985374770 shutdown_connections 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.110+0000 7faff0c12700 1 -- 172.21.15.67:0/1985374770 wait complete. 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.111+0000 7faff0c12700 1 Processor -- start 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.111+0000 7faff0c12700 1 -- start start 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.111+0000 7faff0c12700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.111+0000 7faff0c12700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec1138e0 con 0x7fafec077bb0 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.112+0000 7fafea59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.112+0000 7fafea59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec1133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45200/0 (socket says 172.21.15.67:45200) 2023-12-05T09:17:58.665 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.112+0000 7fafea59c700 1 -- 172.21.15.67:0/446003937 learned_addr learned my addr 172.21.15.67:0/446003937 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.112+0000 7fafea59c700 1 -- 172.21.15.67:0/446003937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc0094f0 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.112+0000 7fafea59c700 1 --2- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec1133a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafdc006fd0 tx=0x7fafdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.112+0000 7fafdaffd700 1 -- 172.21.15.67:0/446003937 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafdc010750 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.113+0000 7fafdaffd700 1 -- 172.21.15.67:0/446003937 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fafdc010d20 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.113+0000 7fafdaffd700 1 -- 172.21.15.67:0/446003937 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafdc01ada0 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.113+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec113ae0 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.113+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec113ef0 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.114+0000 7fafdaffd700 1 -- 172.21.15.67:0/446003937 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fafdc0108b0 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.114+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec04bb80 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.114+0000 7fafdaffd700 1 --2- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fafd4036510 0x7fafd40389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.114+0000 7fafdaffd700 1 -- 172.21.15.67:0/446003937 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fafdc0499f0 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.115+0000 7fafe9d9b700 1 --2- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fafd4036510 0x7fafd40389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.116+0000 7fafe9d9b700 1 --2- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fafd4036510 0x7fafd40389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009990 tx=0x7fafe0006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.120+0000 7fafdaffd700 1 -- 172.21.15.67:0/446003937 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fafdc01a5d0 con 0x7fafec077bb0 2023-12-05T09:17:58.666 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.346+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fafec10d200 con 0x7fafd4036510 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.353+0000 7fafdaffd700 1 -- 172.21.15.67:0/446003937 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fafec10d200 con 0x7fafd4036510 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fafd4036510 msgr2=0x7fafd40389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 --2- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fafd4036510 0x7fafd40389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009990 tx=0x7fafe0006e40 comp rx=0 tx=0).stop 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 msgr2=0x7fafec1133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 --2- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec1133a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafdc006fd0 tx=0x7fafdc009250 comp rx=0 tx=0).stop 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 shutdown_connections 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 --2- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fafd4036510 0x7fafd40389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 --2- 172.21.15.67:0/446003937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fafec077bb0 0x7fafec1133a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 >> 172.21.15.67:0/446003937 conn(0x7fafec0fda50 msgr2=0x7fafec0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 shutdown_connections 2023-12-05T09:17:58.667 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:58.356+0000 7faff0c12700 1 -- 172.21.15.67:0/446003937 wait complete. 2023-12-05T09:17:59.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:58 smithi067 ceph-mon[107174]: from='client.14126 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-05T09:17:59.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:58 smithi067 ceph-mon[107174]: from='client.14126 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-05T09:17:59.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:58 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:17:59.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:58 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:17:59.686 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.097+0000 7fbbb0eb1700 1 Processor -- start 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.097+0000 7fbbb0eb1700 1 -- start start 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.097+0000 7fbbb0eb1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac0760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.097+0000 7fbbb0eb1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac077fa0 con 0x7fbbac077b90 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.098+0000 7fbbaa59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac0760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.098+0000 7fbbaa59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac0760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45212/0 (socket says 172.21.15.67:45212) 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.098+0000 7fbbaa59c700 1 -- 172.21.15.67:0/3618194020 learned_addr learned my addr 172.21.15.67:0/3618194020 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.098+0000 7fbbaa59c700 1 -- 172.21.15.67:0/3618194020 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0765e0 con 0x7fbbac077b90 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.098+0000 7fbbaa59c700 1 --2- 172.21.15.67:0/3618194020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac0760a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0098e0 tx=0x7fbb9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85325a6744d5fd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbba959a700 1 -- 172.21.15.67:0/3618194020 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb9c00b860 con 0x7fbbac077b90 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbba959a700 1 -- 172.21.15.67:0/3618194020 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fbb9c00be30 con 0x7fbbac077b90 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbba959a700 1 -- 172.21.15.67:0/3618194020 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb9c010380 con 0x7fbbac077b90 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/3618194020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 msgr2=0x7fbbac0760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbbb0eb1700 1 --2- 172.21.15.67:0/3618194020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac0760a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0098e0 tx=0x7fbb9c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/3618194020 shutdown_connections 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbbb0eb1700 1 --2- 172.21.15.67:0/3618194020 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac0760a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/3618194020 >> 172.21.15.67:0/3618194020 conn(0x7fbbac0fda50 msgr2=0x7fbbac0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/3618194020 shutdown_connections 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.099+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/3618194020 wait complete. 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.100+0000 7fbbb0eb1700 1 Processor -- start 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.100+0000 7fbbb0eb1700 1 -- start start 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.100+0000 7fbbb0eb1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.100+0000 7fbbb0eb1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1138c0 con 0x7fbbac077b90 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.101+0000 7fbbaa59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.101+0000 7fbbaa59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45224/0 (socket says 172.21.15.67:45224) 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.101+0000 7fbbaa59c700 1 -- 172.21.15.67:0/1922800140 learned_addr learned my addr 172.21.15.67:0/1922800140 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.101+0000 7fbbaa59c700 1 -- 172.21.15.67:0/1922800140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c0094f0 con 0x7fbbac077b90 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.101+0000 7fbbaa59c700 1 --2- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac113380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c006b00 tx=0x7fbb9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:59.688 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.102+0000 7fbb9affd700 1 -- 172.21.15.67:0/1922800140 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb9c010a80 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.102+0000 7fbb9affd700 1 -- 172.21.15.67:0/1922800140 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fbb9c01a430 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.102+0000 7fbb9affd700 1 -- 172.21.15.67:0/1922800140 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb9c0245b0 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.102+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac113ac0 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.102+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac113ed0 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.103+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac04bb80 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.103+0000 7fbb9affd700 1 -- 172.21.15.67:0/1922800140 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fbb9c010be0 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.104+0000 7fbb9affd700 1 --2- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fbb94036510 0x7fbb940389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.104+0000 7fbb9affd700 1 -- 172.21.15.67:0/1922800140 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbb9c04a960 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.104+0000 7fbba9d9b700 1 --2- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fbb94036510 0x7fbb940389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.105+0000 7fbba9d9b700 1 --2- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fbb94036510 0x7fbb940389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009990 tx=0x7fbba0006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.108+0000 7fbb9affd700 1 -- 172.21.15.67:0/1922800140 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbb9c01a5a0 con 0x7fbbac077b90 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.311+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbac0008d0 con 0x7fbb94036510 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.311+0000 7fbb9affd700 1 -- 172.21.15.67:0/1922800140 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fbbac0008d0 con 0x7fbb94036510 2023-12-05T09:17:59.689 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fbb94036510 msgr2=0x7fbb940389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 --2- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fbb94036510 0x7fbb940389c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009990 tx=0x7fbba0006e40 comp rx=0 tx=0).stop 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 msgr2=0x7fbbac113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 --2- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac113380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c006b00 tx=0x7fbb9c009250 comp rx=0 tx=0).stop 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 shutdown_connections 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 --2- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fbb94036510 0x7fbb940389c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 --2- 172.21.15.67:0/1922800140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbac077b90 0x7fbbac113380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 >> 172.21.15.67:0/1922800140 conn(0x7fbbac0fda50 msgr2=0x7fbbac0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 shutdown_connections 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:17:59.314+0000 7fbbb0eb1700 1 -- 172.21.15.67:0/1922800140 wait complete. 2023-12-05T09:17:59.690 INFO:teuthology.orchestra.run.smithi067.stdout:Generating ssh key... 2023-12-05T09:18:00.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:59 smithi067 ceph-mon[107174]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:00.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:17:59 smithi067 ceph-mon[107174]: mgrmap e8: smithi067.alxtvv(active, since 2s) 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.113+0000 7f8474bdc700 1 Processor -- start 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.114+0000 7f8474bdc700 1 -- start start 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.114+0000 7f8474bdc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.114+0000 7f8474bdc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470102d10 con 0x7f8470070f80 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.114+0000 7f846e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.114+0000 7f846e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45234/0 (socket says 172.21.15.67:45234) 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.114+0000 7f846e59c700 1 -- 172.21.15.67:0/1855634084 learned_addr learned my addr 172.21.15.67:0/1855634084 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.115+0000 7f846e59c700 1 -- 172.21.15.67:0/1855634084 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470107860 con 0x7f8470070f80 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.115+0000 7f846e59c700 1 --2- 172.21.15.67:0/1855634084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470107320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f84600098e0 tx=0x7f8460009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d198284372a49c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.115+0000 7f846d59a700 1 -- 172.21.15.67:0/1855634084 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f846000b860 con 0x7f8470070f80 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.115+0000 7f846d59a700 1 -- 172.21.15.67:0/1855634084 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f846000be30 con 0x7f8470070f80 2023-12-05T09:18:00.863 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.115+0000 7f846d59a700 1 -- 172.21.15.67:0/1855634084 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8460010380 con 0x7f8470070f80 2023-12-05T09:18:00.864 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.116+0000 7f8474bdc700 1 -- 172.21.15.67:0/1855634084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 msgr2=0x7f8470107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:00.864 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.116+0000 7f8474bdc700 1 --2- 172.21.15.67:0/1855634084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470107320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f84600098e0 tx=0x7f8460009250 comp rx=0 tx=0).stop 2023-12-05T09:18:00.864 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:00 smithi067 ceph-mon[107174]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:00.864 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:00 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:00.864 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:00 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:18:00.864 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:00 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:00.864 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:00 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.116+0000 7f8474bdc700 1 -- 172.21.15.67:0/1855634084 shutdown_connections 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.116+0000 7f8474bdc700 1 --2- 172.21.15.67:0/1855634084 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470107320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.116+0000 7f8474bdc700 1 -- 172.21.15.67:0/1855634084 >> 172.21.15.67:0/1855634084 conn(0x7f84700fc970 msgr2=0x7f84700fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.116+0000 7f8474bdc700 1 -- 172.21.15.67:0/1855634084 shutdown_connections 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.116+0000 7f8474bdc700 1 -- 172.21.15.67:0/1855634084 wait complete. 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.117+0000 7f8474bdc700 1 Processor -- start 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.117+0000 7f8474bdc700 1 -- start start 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.117+0000 7f8474bdc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.117+0000 7f8474bdc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84701138c0 con 0x7f8470070f80 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.117+0000 7f846e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.118+0000 7f846e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45250/0 (socket says 172.21.15.67:45250) 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.118+0000 7f846e59c700 1 -- 172.21.15.67:0/2397574135 learned_addr learned my addr 172.21.15.67:0/2397574135 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:00.868 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.118+0000 7f846e59c700 1 -- 172.21.15.67:0/2397574135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600094f0 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.118+0000 7f846e59c700 1 --2- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470113380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8460006d40 tx=0x7f8460009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.118+0000 7f845effd700 1 -- 172.21.15.67:0/2397574135 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84600109b0 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.118+0000 7f845effd700 1 -- 172.21.15.67:0/2397574135 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f8460024440 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.118+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8470113ac0 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.118+0000 7f845effd700 1 -- 172.21.15.67:0/2397574135 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f846001a5f0 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.119+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8470113ed0 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.120+0000 7f845effd700 1 -- 172.21.15.67:0/2397574135 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f846001a870 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.120+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847004bb80 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.120+0000 7f845effd700 1 --2- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f84580365f0 0x7f8458038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.120+0000 7f845effd700 1 -- 172.21.15.67:0/2397574135 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f846004a5b0 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.120+0000 7f846dd9b700 1 --2- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f84580365f0 0x7f8458038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.121+0000 7f846dd9b700 1 --2- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f84580365f0 0x7f8458038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8464009990 tx=0x7f8464006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.125+0000 7f845effd700 1 -- 172.21.15.67:0/2397574135 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8460018530 con 0x7f8470070f80 2023-12-05T09:18:00.869 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.329+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f847010d1b0 con 0x7f84580365f0 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.605+0000 7f845effd700 1 -- 172.21.15.67:0/2397574135 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f847010d1b0 con 0x7f84580365f0 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f84580365f0 msgr2=0x7f8458038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 --2- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f84580365f0 0x7f8458038aa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8464009990 tx=0x7f8464006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 msgr2=0x7f8470113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 --2- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470113380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8460006d40 tx=0x7f8460009250 comp rx=0 tx=0).stop 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 shutdown_connections 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 --2- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f84580365f0 0x7f8458038aa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 --2- 172.21.15.67:0/2397574135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8470070f80 0x7f8470113380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 >> 172.21.15.67:0/2397574135 conn(0x7f84700fc970 msgr2=0x7f84700fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 shutdown_connections 2023-12-05T09:18:00.870 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:00.608+0000 7f8474bdc700 1 -- 172.21.15.67:0/2397574135 wait complete. 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ75w/973i781ZUQfJnLmAZ7xFl39mSnzBpTE7TT3OD+bfpxF9gP+LnSNP/fvyCvsEu70B02gAOBXIpf7olv0CvzwC+V5HzdTQEXc7TuFdKFVC3rWv0DWjHORDp9wQO0Pej+1l0pu6pfL0miI1ZpITVW2wh/MHzGuoJ+yL8f9PC+YAeSs5S5O5FZcscNgmOLJk7klbxlwOFbhA7XGY3w7aPrBmBzBU06NYz1DO1NJVDdPqSSyJ6aZMoCfyyEQYbxZsgTTKWkOiwzSOFnIPmn+eSyZOUKyIiTTFUvC9O4mGj1mRM1B9Rjv1+VbfaIxhuuZyvU94KnXt5O0goFWFao1Wl6/sAgkgwykxa9KbvxAW54gofu4p+yevwCnbayRCmUvQtlN4tX0zky146O9OuBtDEookeSwUrQy39LqUO7AM0/xvII/0duWO6bWoki5U6FP5WIS99FcNzr3zeS9R++VYcnY+yeA/fMoCsBmMEkcxyZR1dyTHNj/okH+mo30mwdU= ceph-f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.279+0000 7f3041502700 1 Processor -- start 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.279+0000 7f3041502700 1 -- start start 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.280+0000 7f3041502700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c0760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.280+0000 7f3041502700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c077fa0 con 0x7f303c077b90 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.280+0000 7f303affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c0760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.280+0000 7f303affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c0760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45252/0 (socket says 172.21.15.67:45252) 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.280+0000 7f303affd700 1 -- 172.21.15.67:0/936454116 learned_addr learned my addr 172.21.15.67:0/936454116 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.280+0000 7f303affd700 1 -- 172.21.15.67:0/936454116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0765e0 con 0x7f303c077b90 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.281+0000 7f303affd700 1 --2- 172.21.15.67:0/936454116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c0760a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f302c0098e0 tx=0x7f302c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7536e5fe7991778b server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:01.828 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.281+0000 7f3039ffb700 1 -- 172.21.15.67:0/936454116 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f302c00b860 con 0x7f303c077b90 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.281+0000 7f3039ffb700 1 -- 172.21.15.67:0/936454116 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f302c00be30 con 0x7f303c077b90 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.281+0000 7f3039ffb700 1 -- 172.21.15.67:0/936454116 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f302c010380 con 0x7f303c077b90 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.281+0000 7f3041502700 1 -- 172.21.15.67:0/936454116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 msgr2=0x7f303c0760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.281+0000 7f3041502700 1 --2- 172.21.15.67:0/936454116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c0760a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f302c0098e0 tx=0x7f302c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.282+0000 7f3041502700 1 -- 172.21.15.67:0/936454116 shutdown_connections 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.282+0000 7f3041502700 1 --2- 172.21.15.67:0/936454116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c0760a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.282+0000 7f3041502700 1 -- 172.21.15.67:0/936454116 >> 172.21.15.67:0/936454116 conn(0x7f303c0fda50 msgr2=0x7f303c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.282+0000 7f3041502700 1 -- 172.21.15.67:0/936454116 shutdown_connections 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.282+0000 7f3041502700 1 -- 172.21.15.67:0/936454116 wait complete. 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.282+0000 7f3041502700 1 Processor -- start 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.283+0000 7f3041502700 1 -- start start 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.283+0000 7f3041502700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.283+0000 7f3041502700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c1138c0 con 0x7f303c077b90 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.283+0000 7f303affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:01.829 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.283+0000 7f303affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45262/0 (socket says 172.21.15.67:45262) 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.283+0000 7f303affd700 1 -- 172.21.15.67:0/3810127895 learned_addr learned my addr 172.21.15.67:0/3810127895 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.284+0000 7f303affd700 1 -- 172.21.15.67:0/3810127895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c0094f0 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.284+0000 7f303affd700 1 --2- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c113380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f302c006b00 tx=0x7f302c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.284+0000 7f30237fe700 1 -- 172.21.15.67:0/3810127895 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f302c010a80 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.284+0000 7f30237fe700 1 -- 172.21.15.67:0/3810127895 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f302c01a430 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.284+0000 7f30237fe700 1 -- 172.21.15.67:0/3810127895 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f302c0245b0 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.284+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c113ac0 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.284+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c113ed0 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.285+0000 7f30237fe700 1 -- 172.21.15.67:0/3810127895 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f302c010be0 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.285+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c04bb80 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.286+0000 7f30237fe700 1 --2- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3024036640 0x7f3024038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.286+0000 7f30237fe700 1 -- 172.21.15.67:0/3810127895 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f302c04abb0 con 0x7f303c077b90 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.286+0000 7f303a7fc700 1 --2- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3024036640 0x7f3024038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.287+0000 7f303a7fc700 1 --2- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3024036640 0x7f3024038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3030009990 tx=0x7f3030006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:01.830 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.291+0000 7f30237fe700 1 -- 172.21.15.67:0/3810127895 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f302c01a5a0 con 0x7f303c077b90 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.493+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f303c0008d0 con 0x7f3024036640 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.493+0000 7f30237fe700 1 -- 172.21.15.67:0/3810127895 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f303c0008d0 con 0x7f3024036640 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3024036640 msgr2=0x7f3024038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 --2- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3024036640 0x7f3024038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3030009990 tx=0x7f3030006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 msgr2=0x7f303c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 --2- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c113380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f302c006b00 tx=0x7f302c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 shutdown_connections 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 --2- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3024036640 0x7f3024038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 --2- 172.21.15.67:0/3810127895 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f303c077b90 0x7f303c113380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 >> 172.21.15.67:0/3810127895 conn(0x7f303c0fda50 msgr2=0x7f303c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 shutdown_connections 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:01.496+0000 7f3041502700 1 -- 172.21.15.67:0/3810127895 wait complete. 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-05T09:18:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:Adding key to root@localhost authorized_keys... 2023-12-05T09:18:01.832 INFO:teuthology.orchestra.run.smithi067.stdout:Adding host smithi067... 2023-12-05T09:18:02.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:01 smithi067 ceph-mon[107174]: [05/Dec/2023:09:18:00] ENGINE Bus STARTING 2023-12-05T09:18:02.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:01 smithi067 ceph-mon[107174]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:02.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:01 smithi067 ceph-mon[107174]: Generating ssh key... 2023-12-05T09:18:02.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:01 smithi067 ceph-mon[107174]: [05/Dec/2023:09:18:00] ENGINE Serving on https://172.21.15.67:7150 2023-12-05T09:18:02.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:01 smithi067 ceph-mon[107174]: [05/Dec/2023:09:18:00] ENGINE Bus STARTED 2023-12-05T09:18:03.090 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:02 smithi067 ceph-mon[107174]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:03.974 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:03 smithi067 ceph-mon[107174]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi067", "addr": "172.21.15.67", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:05.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:04 smithi067 ceph-mon[107174]: Deploying cephadm binary to smithi067 2023-12-05T09:18:05.413 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Added host 'smithi067' with addr '172.21.15.67' 2023-12-05T09:18:05.413 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.207+0000 7fa27a3cf700 1 Processor -- start 2023-12-05T09:18:05.413 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.207+0000 7fa27a3cf700 1 -- start start 2023-12-05T09:18:05.413 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.207+0000 7fa27a3cf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa274076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:05.413 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.207+0000 7fa27a3cf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa274078000 con 0x7fa274077bf0 2023-12-05T09:18:05.413 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.208+0000 7fa273fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa274076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:05.413 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.208+0000 7fa273fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa274076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45276/0 (socket says 172.21.15.67:45276) 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.208+0000 7fa273fff700 1 -- 172.21.15.67:0/1901716156 learned_addr learned my addr 172.21.15.67:0/1901716156 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.208+0000 7fa273fff700 1 -- 172.21.15.67:0/1901716156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274076640 con 0x7fa274077bf0 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.208+0000 7fa273fff700 1 --2- 172.21.15.67:0/1901716156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa274076100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2640098e0 tx=0x7fa264009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50008a6ce6ff232b server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.208+0000 7fa272ffd700 1 -- 172.21.15.67:0/1901716156 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa26400b860 con 0x7fa274077bf0 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.208+0000 7fa272ffd700 1 -- 172.21.15.67:0/1901716156 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa26400be30 con 0x7fa274077bf0 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.209+0000 7fa272ffd700 1 -- 172.21.15.67:0/1901716156 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa264010380 con 0x7fa274077bf0 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.209+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1901716156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 msgr2=0x7fa274076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.209+0000 7fa27a3cf700 1 --2- 172.21.15.67:0/1901716156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa274076100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2640098e0 tx=0x7fa264009250 comp rx=0 tx=0).stop 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.209+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1901716156 shutdown_connections 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.209+0000 7fa27a3cf700 1 --2- 172.21.15.67:0/1901716156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa274076100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.209+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1901716156 >> 172.21.15.67:0/1901716156 conn(0x7fa2740fda50 msgr2=0x7fa2740ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.209+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1901716156 shutdown_connections 2023-12-05T09:18:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.209+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1901716156 wait complete. 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.210+0000 7fa27a3cf700 1 Processor -- start 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.210+0000 7fa27a3cf700 1 -- start start 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.211+0000 7fa27a3cf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa2741133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.211+0000 7fa27a3cf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2741138e0 con 0x7fa274077bf0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.211+0000 7fa273fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa2741133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.211+0000 7fa273fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa2741133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45278/0 (socket says 172.21.15.67:45278) 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.211+0000 7fa273fff700 1 -- 172.21.15.67:0/1097501817 learned_addr learned my addr 172.21.15.67:0/1097501817 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.211+0000 7fa273fff700 1 -- 172.21.15.67:0/1097501817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2640094f0 con 0x7fa274077bf0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.211+0000 7fa273fff700 1 --2- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa2741133a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa264006b00 tx=0x7fa264009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.212+0000 7fa270ff9700 1 -- 172.21.15.67:0/1097501817 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa264010a80 con 0x7fa274077bf0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.212+0000 7fa270ff9700 1 -- 172.21.15.67:0/1097501817 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fa26401a430 con 0x7fa274077bf0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.212+0000 7fa270ff9700 1 -- 172.21.15.67:0/1097501817 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2640245b0 con 0x7fa274077bf0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.212+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa274113ae0 con 0x7fa274077bf0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.212+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa274113ef0 con 0x7fa274077bf0 2023-12-05T09:18:05.415 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.213+0000 7fa270ff9700 1 -- 172.21.15.67:0/1097501817 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fa264010be0 con 0x7fa274077bf0 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.213+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27404bb80 con 0x7fa274077bf0 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.213+0000 7fa270ff9700 1 --2- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fa25c036640 0x7fa25c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.214+0000 7fa270ff9700 1 -- 172.21.15.67:0/1097501817 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa26404abb0 con 0x7fa274077bf0 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.214+0000 7fa2737fe700 1 --2- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fa25c036640 0x7fa25c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.214+0000 7fa2737fe700 1 --2- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fa25c036640 0x7fa25c038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa268009990 tx=0x7fa268006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.218+0000 7fa270ff9700 1 -- 172.21.15.67:0/1097501817 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa26401a5a0 con 0x7fa274077bf0 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:02.425+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi067", "addr": "172.21.15.67", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2740008d0 con 0x7fa25c036640 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.065+0000 7fa270ff9700 1 -- 172.21.15.67:0/1097501817 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fa2740008d0 con 0x7fa25c036640 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.067+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fa25c036640 msgr2=0x7fa25c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.067+0000 7fa27a3cf700 1 --2- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fa25c036640 0x7fa25c038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa268009990 tx=0x7fa268006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.067+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 msgr2=0x7fa2741133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.067+0000 7fa27a3cf700 1 --2- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa2741133a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa264006b00 tx=0x7fa264009250 comp rx=0 tx=0).stop 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.068+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 shutdown_connections 2023-12-05T09:18:05.416 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.068+0000 7fa27a3cf700 1 --2- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fa25c036640 0x7fa25c038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:05.417 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.068+0000 7fa27a3cf700 1 --2- 172.21.15.67:0/1097501817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa274077bf0 0x7fa2741133a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:05.417 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.068+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 >> 172.21.15.67:0/1097501817 conn(0x7fa2740fda50 msgr2=0x7fa2740ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:05.417 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.068+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 shutdown_connections 2023-12-05T09:18:05.417 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.068+0000 7fa27a3cf700 1 -- 172.21.15.67:0/1097501817 wait complete. 2023-12-05T09:18:05.417 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying mon service with default placement... 2023-12-05T09:18:06.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:06 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:06.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:06 smithi067 ceph-mon[107174]: Added host smithi067 2023-12-05T09:18:06.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:06 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:18:06.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:06 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:06.403 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-05T09:18:06.403 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.795+0000 7f6ea0235700 1 Processor -- start 2023-12-05T09:18:06.403 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.795+0000 7f6ea0235700 1 -- start start 2023-12-05T09:18:06.403 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.795+0000 7f6ea0235700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e981026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.795+0000 7f6ea0235700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98102c20 con 0x7f6e981022d0 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.795+0000 7f6e9dfd1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e981026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.796+0000 7f6e9dfd1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e981026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45286/0 (socket says 172.21.15.67:45286) 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.796+0000 7f6e9dfd1700 1 -- 172.21.15.67:0/562044374 learned_addr learned my addr 172.21.15.67:0/562044374 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.796+0000 7f6e9dfd1700 1 -- 172.21.15.67:0/562044374 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e98102d60 con 0x7f6e981022d0 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.796+0000 7f6e9dfd1700 1 --2- 172.21.15.67:0/562044374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e981026e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e940098e0 tx=0x7f6e94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20eeaa73a638d09 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.796+0000 7f6e9cfcf700 1 -- 172.21.15.67:0/562044374 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e9400b860 con 0x7f6e981022d0 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.796+0000 7f6e9cfcf700 1 -- 172.21.15.67:0/562044374 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6e9400be30 con 0x7f6e981022d0 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.797+0000 7f6e9cfcf700 1 -- 172.21.15.67:0/562044374 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e94010380 con 0x7f6e981022d0 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.797+0000 7f6ea0235700 1 -- 172.21.15.67:0/562044374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 msgr2=0x7f6e981026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.797+0000 7f6ea0235700 1 --2- 172.21.15.67:0/562044374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e981026e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e940098e0 tx=0x7f6e94009250 comp rx=0 tx=0).stop 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.797+0000 7f6ea0235700 1 -- 172.21.15.67:0/562044374 shutdown_connections 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.797+0000 7f6ea0235700 1 --2- 172.21.15.67:0/562044374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e981026e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:06.404 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.797+0000 7f6ea0235700 1 -- 172.21.15.67:0/562044374 >> 172.21.15.67:0/562044374 conn(0x7f6e980fda50 msgr2=0x7f6e980ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.797+0000 7f6ea0235700 1 -- 172.21.15.67:0/562044374 shutdown_connections 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.797+0000 7f6ea0235700 1 -- 172.21.15.67:0/562044374 wait complete. 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.798+0000 7f6ea0235700 1 Processor -- start 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.798+0000 7f6ea0235700 1 -- start start 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.799+0000 7f6ea0235700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e98111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.799+0000 7f6ea0235700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98111680 con 0x7f6e981022d0 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.799+0000 7f6e9dfd1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e98111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.799+0000 7f6e9dfd1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e98111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45294/0 (socket says 172.21.15.67:45294) 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.799+0000 7f6e9dfd1700 1 -- 172.21.15.67:0/3814471859 learned_addr learned my addr 172.21.15.67:0/3814471859 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.799+0000 7f6e9dfd1700 1 -- 172.21.15.67:0/3814471859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940094f0 con 0x7f6e981022d0 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.799+0000 7f6e9dfd1700 1 --2- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e98111140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e94000c00 tx=0x7f6e94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.800+0000 7f6e8e7fc700 1 -- 172.21.15.67:0/3814471859 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e94010a80 con 0x7f6e981022d0 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.800+0000 7f6e8e7fc700 1 -- 172.21.15.67:0/3814471859 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f6e9401a430 con 0x7f6e981022d0 2023-12-05T09:18:06.405 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.800+0000 7f6e8e7fc700 1 -- 172.21.15.67:0/3814471859 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e940245b0 con 0x7f6e981022d0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.800+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e98111880 con 0x7f6e981022d0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.800+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e98111c90 con 0x7f6e981022d0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.801+0000 7f6e8e7fc700 1 -- 172.21.15.67:0/3814471859 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f6e9401a5a0 con 0x7f6e981022d0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.801+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9804bb80 con 0x7f6e981022d0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.801+0000 7f6e8e7fc700 1 --2- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f6e84036640 0x7f6e84038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.801+0000 7f6e8e7fc700 1 -- 172.21.15.67:0/3814471859 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6e9404ab10 con 0x7f6e981022d0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.801+0000 7f6e9d7d0700 1 --2- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f6e84036640 0x7f6e84038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.802+0000 7f6e9d7d0700 1 --2- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f6e84036640 0x7f6e84038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009990 tx=0x7f6e88006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:05.806+0000 7f6e8e7fc700 1 -- 172.21.15.67:0/3814471859 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6e94023df0 con 0x7f6e981022d0 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.026+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e9810afc0 con 0x7f6e84036640 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.034+0000 7f6e8e7fc700 1 -- 172.21.15.67:0/3814471859 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6e9810afc0 con 0x7f6e84036640 2023-12-05T09:18:06.406 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f6e84036640 msgr2=0x7f6e84038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 --2- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f6e84036640 0x7f6e84038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009990 tx=0x7f6e88006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 msgr2=0x7f6e98111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 --2- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e98111140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e94000c00 tx=0x7f6e94009250 comp rx=0 tx=0).stop 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 shutdown_connections 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 --2- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f6e84036640 0x7f6e84038af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 --2- 172.21.15.67:0/3814471859 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e981022d0 0x7f6e98111140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 >> 172.21.15.67:0/3814471859 conn(0x7f6e980fda50 msgr2=0x7f6e980ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 shutdown_connections 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.037+0000 7f6ea0235700 1 -- 172.21.15.67:0/3814471859 wait complete. 2023-12-05T09:18:06.407 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying mgr service with default placement... 2023-12-05T09:18:07.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-05T09:18:07.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.995+0000 7fd787e9c700 1 Processor -- start 2023-12-05T09:18:07.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.995+0000 7fd787e9c700 1 -- start start 2023-12-05T09:18:07.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.995+0000 7fd787e9c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:07.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.995+0000 7fd787e9c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd780104310 con 0x7fd7801039c0 2023-12-05T09:18:07.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.996+0000 7fd785c38700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.996+0000 7fd785c38700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46962/0 (socket says 172.21.15.67:46962) 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.996+0000 7fd785c38700 1 -- 172.21.15.67:0/2746447720 learned_addr learned my addr 172.21.15.67:0/2746447720 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.996+0000 7fd785c38700 1 -- 172.21.15.67:0/2746447720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780101fb0 con 0x7fd7801039c0 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.996+0000 7fd785c38700 1 --2- 172.21.15.67:0/2746447720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780103dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0098e0 tx=0x7fd77c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e3e5ed148ade2 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.997+0000 7fd784c36700 1 -- 172.21.15.67:0/2746447720 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd77c00b860 con 0x7fd7801039c0 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.997+0000 7fd784c36700 1 -- 172.21.15.67:0/2746447720 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd77c00be70 con 0x7fd7801039c0 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.997+0000 7fd784c36700 1 -- 172.21.15.67:0/2746447720 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd77c010380 con 0x7fd7801039c0 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.997+0000 7fd787e9c700 1 -- 172.21.15.67:0/2746447720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 msgr2=0x7fd780103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.997+0000 7fd787e9c700 1 --2- 172.21.15.67:0/2746447720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780103dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0098e0 tx=0x7fd77c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.997+0000 7fd787e9c700 1 -- 172.21.15.67:0/2746447720 shutdown_connections 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.997+0000 7fd787e9c700 1 --2- 172.21.15.67:0/2746447720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780103dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:07.579 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.997+0000 7fd787e9c700 1 -- 172.21.15.67:0/2746447720 >> 172.21.15.67:0/2746447720 conn(0x7fd7800fda40 msgr2=0x7fd7800ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:07.580 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.998+0000 7fd787e9c700 1 -- 172.21.15.67:0/2746447720 shutdown_connections 2023-12-05T09:18:07.580 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.998+0000 7fd787e9c700 1 -- 172.21.15.67:0/2746447720 wait complete. 2023-12-05T09:18:07.580 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.999+0000 7fd787e9c700 1 Processor -- start 2023-12-05T09:18:07.580 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.999+0000 7fd787e9c700 1 -- start start 2023-12-05T09:18:07.580 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.999+0000 7fd787e9c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:07.580 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.999+0000 7fd787e9c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd780077190 con 0x7fd7801039c0 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.999+0000 7fd785c38700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.999+0000 7fd785c38700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46970/0 (socket says 172.21.15.67:46970) 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:06.999+0000 7fd785c38700 1 -- 172.21.15.67:0/108997388 learned_addr learned my addr 172.21.15.67:0/108997388 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.000+0000 7fd785c38700 1 -- 172.21.15.67:0/108997388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0094f0 con 0x7fd7801039c0 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.000+0000 7fd785c38700 1 --2- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780078d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd77c003080 tx=0x7fd77c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.000+0000 7fd7767fc700 1 -- 172.21.15.67:0/108997388 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd77c010800 con 0x7fd7801039c0 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.000+0000 7fd7767fc700 1 -- 172.21.15.67:0/108997388 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd77c010e10 con 0x7fd7801039c0 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.000+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd780077390 con 0x7fd7801039c0 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.000+0000 7fd7767fc700 1 -- 172.21.15.67:0/108997388 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd77c01a430 con 0x7fd7801039c0 2023-12-05T09:18:07.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.001+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7800777a0 con 0x7fd7801039c0 2023-12-05T09:18:07.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.002+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78010b190 con 0x7fd7801039c0 2023-12-05T09:18:07.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.002+0000 7fd7767fc700 1 -- 172.21.15.67:0/108997388 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd77c010960 con 0x7fd7801039c0 2023-12-05T09:18:07.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.002+0000 7fd7767fc700 1 --2- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd76c0365f0 0x7fd76c038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:07.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.002+0000 7fd7767fc700 1 -- 172.21.15.67:0/108997388 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd77c04a6a0 con 0x7fd7801039c0 2023-12-05T09:18:07.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.003+0000 7fd785437700 1 --2- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd76c0365f0 0x7fd76c038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:07.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.003+0000 7fd785437700 1 --2- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd76c0365f0 0x7fd76c038aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd770009990 tx=0x7fd770006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:07.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.008+0000 7fd7767fc700 1 -- 172.21.15.67:0/108997388 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd77c0226c0 con 0x7fd7801039c0 2023-12-05T09:18:07.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.226+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd780077aa0 con 0x7fd76c0365f0 2023-12-05T09:18:07.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.233+0000 7fd7767fc700 1 -- 172.21.15.67:0/108997388 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd780077aa0 con 0x7fd76c0365f0 2023-12-05T09:18:07.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd76c0365f0 msgr2=0x7fd76c038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:07.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 --2- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd76c0365f0 0x7fd76c038aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd770009990 tx=0x7fd770006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:07.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 msgr2=0x7fd780078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 --2- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780078d10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd77c003080 tx=0x7fd77c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 shutdown_connections 2023-12-05T09:18:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 --2- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd76c0365f0 0x7fd76c038aa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 --2- 172.21.15.67:0/108997388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd7801039c0 0x7fd780078d10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 >> 172.21.15.67:0/108997388 conn(0x7fd7800fda40 msgr2=0x7fd7800ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 shutdown_connections 2023-12-05T09:18:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.236+0000 7fd787e9c700 1 -- 172.21.15.67:0/108997388 wait complete. 2023-12-05T09:18:07.584 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying crash service with default placement... 2023-12-05T09:18:08.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:07 smithi067 ceph-mon[107174]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:08.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:07 smithi067 ceph-mon[107174]: Saving service mon spec with placement count:5 2023-12-05T09:18:08.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:07 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:08.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:07 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:08.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:07 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:08.791 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.956+0000 7f05a1455700 1 Processor -- start 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.956+0000 7f05a1455700 1 -- start start 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.957+0000 7f05a1455700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.957+0000 7f05a1455700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c078000 con 0x7f059c077bf0 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.957+0000 7f059affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.957+0000 7f059affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46972/0 (socket says 172.21.15.67:46972) 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.957+0000 7f059affd700 1 -- 172.21.15.67:0/3033277431 learned_addr learned my addr 172.21.15.67:0/3033277431 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.958+0000 7f059affd700 1 -- 172.21.15.67:0/3033277431 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c076640 con 0x7f059c077bf0 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.958+0000 7f059affd700 1 --2- 172.21.15.67:0/3033277431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c076100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f058c0098e0 tx=0x7f058c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c259c0979b828a23 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.958+0000 7f059a7fc700 1 -- 172.21.15.67:0/3033277431 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f058c00b860 con 0x7f059c077bf0 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.958+0000 7f059a7fc700 1 -- 172.21.15.67:0/3033277431 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f058c00be70 con 0x7f059c077bf0 2023-12-05T09:18:08.792 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.958+0000 7f059a7fc700 1 -- 172.21.15.67:0/3033277431 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f058c010380 con 0x7f059c077bf0 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.959+0000 7f05a1455700 1 -- 172.21.15.67:0/3033277431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 msgr2=0x7f059c076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.959+0000 7f05a1455700 1 --2- 172.21.15.67:0/3033277431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c076100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f058c0098e0 tx=0x7f058c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.959+0000 7f05a1455700 1 -- 172.21.15.67:0/3033277431 shutdown_connections 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.959+0000 7f05a1455700 1 --2- 172.21.15.67:0/3033277431 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c076100 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.959+0000 7f05a1455700 1 -- 172.21.15.67:0/3033277431 >> 172.21.15.67:0/3033277431 conn(0x7f059c0fda50 msgr2=0x7f059c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.959+0000 7f05a1455700 1 -- 172.21.15.67:0/3033277431 shutdown_connections 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.959+0000 7f05a1455700 1 -- 172.21.15.67:0/3033277431 wait complete. 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.960+0000 7f05a1455700 1 Processor -- start 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.961+0000 7f05a1455700 1 -- start start 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.961+0000 7f05a1455700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.961+0000 7f05a1455700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c113900 con 0x7f059c077bf0 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.961+0000 7f059affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.961+0000 7f059affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c1133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46984/0 (socket says 172.21.15.67:46984) 2023-12-05T09:18:08.793 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.961+0000 7f059affd700 1 -- 172.21.15.67:0/3296937973 learned_addr learned my addr 172.21.15.67:0/3296937973 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.962+0000 7f059affd700 1 -- 172.21.15.67:0/3296937973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c0094f0 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.962+0000 7f059affd700 1 --2- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c1133c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f058c006d40 tx=0x7f058c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.962+0000 7f0593fff700 1 -- 172.21.15.67:0/3296937973 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f058c010960 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.962+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c113b00 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.962+0000 7f0593fff700 1 -- 172.21.15.67:0/3296937973 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f058c01a430 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.962+0000 7f0593fff700 1 -- 172.21.15.67:0/3296937973 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f058c0245b0 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.963+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c113f10 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.964+0000 7f0593fff700 1 -- 172.21.15.67:0/3296937973 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f058c010ac0 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.964+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c04bb80 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.964+0000 7f0593fff700 1 --2- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f057c036640 0x7f057c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.964+0000 7f0593fff700 1 -- 172.21.15.67:0/3296937973 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f058c04a150 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.965+0000 7f05927fc700 1 --2- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f057c036640 0x7f057c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.965+0000 7f05927fc700 1 --2- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f057c036640 0x7f057c038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0584009990 tx=0x7f0584006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:07.969+0000 7f0593fff700 1 -- 172.21.15.67:0/3296937973 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f058c02b4d0 con 0x7f059c077bf0 2023-12-05T09:18:08.794 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.190+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f059c0008d0 con 0x7f057c036640 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.195+0000 7f0593fff700 1 -- 172.21.15.67:0/3296937973 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f059c0008d0 con 0x7f057c036640 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.197+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f057c036640 msgr2=0x7f057c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 --2- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f057c036640 0x7f057c038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0584009990 tx=0x7f0584006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 msgr2=0x7f059c1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 --2- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c1133c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f058c006d40 tx=0x7f058c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 shutdown_connections 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 --2- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f057c036640 0x7f057c038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 --2- 172.21.15.67:0/3296937973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f059c077bf0 0x7f059c1133c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 >> 172.21.15.67:0/3296937973 conn(0x7f059c0fda50 msgr2=0x7f059c0ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 shutdown_connections 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:08.198+0000 7f05a1455700 1 -- 172.21.15.67:0/3296937973 wait complete. 2023-12-05T09:18:08.795 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying prometheus service with default placement... 2023-12-05T09:18:09.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:08 smithi067 ceph-mon[107174]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:09.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:08 smithi067 ceph-mon[107174]: Saving service mgr spec with placement count:2 2023-12-05T09:18:09.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:08 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:09.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:08 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:09.733 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.192+0000 7f97d0a47700 1 Processor -- start 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.192+0000 7f97d0a47700 1 -- start start 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.192+0000 7f97d0a47700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc0760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.192+0000 7f97d0a47700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc077fc0 con 0x7f97cc077bb0 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.193+0000 7f97ca59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc0760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.193+0000 7f97ca59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc0760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:46994/0 (socket says 172.21.15.67:46994) 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.193+0000 7f97ca59c700 1 -- 172.21.15.67:0/1594063291 learned_addr learned my addr 172.21.15.67:0/1594063291 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.193+0000 7f97ca59c700 1 -- 172.21.15.67:0/1594063291 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc076600 con 0x7f97cc077bb0 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.194+0000 7f97ca59c700 1 --2- 172.21.15.67:0/1594063291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc0760c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0098e0 tx=0x7f97bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eab4816a36813c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.194+0000 7f97c9d9b700 1 -- 172.21.15.67:0/1594063291 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97bc00b860 con 0x7f97cc077bb0 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.194+0000 7f97c9d9b700 1 -- 172.21.15.67:0/1594063291 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97bc00be70 con 0x7f97cc077bb0 2023-12-05T09:18:09.734 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.194+0000 7f97c9d9b700 1 -- 172.21.15.67:0/1594063291 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97bc010380 con 0x7f97cc077bb0 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.195+0000 7f97d0a47700 1 -- 172.21.15.67:0/1594063291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 msgr2=0x7f97cc0760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.195+0000 7f97d0a47700 1 --2- 172.21.15.67:0/1594063291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc0760c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0098e0 tx=0x7f97bc009250 comp rx=0 tx=0).stop 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.195+0000 7f97d0a47700 1 -- 172.21.15.67:0/1594063291 shutdown_connections 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.195+0000 7f97d0a47700 1 --2- 172.21.15.67:0/1594063291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc0760c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.195+0000 7f97d0a47700 1 -- 172.21.15.67:0/1594063291 >> 172.21.15.67:0/1594063291 conn(0x7f97cc0fda50 msgr2=0x7f97cc0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.195+0000 7f97d0a47700 1 -- 172.21.15.67:0/1594063291 shutdown_connections 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.195+0000 7f97d0a47700 1 -- 172.21.15.67:0/1594063291 wait complete. 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.196+0000 7f97d0a47700 1 Processor -- start 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.196+0000 7f97d0a47700 1 -- start start 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.196+0000 7f97d0a47700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc1133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.196+0000 7f97d0a47700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc113910 con 0x7f97cc077bb0 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.197+0000 7f97ca59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc1133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.197+0000 7f97ca59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc1133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47010/0 (socket says 172.21.15.67:47010) 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.197+0000 7f97ca59c700 1 -- 172.21.15.67:0/3897064853 learned_addr learned my addr 172.21.15.67:0/3897064853 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:09.735 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.197+0000 7f97ca59c700 1 -- 172.21.15.67:0/3897064853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc0094f0 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.197+0000 7f97ca59c700 1 --2- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc1133d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006d40 tx=0x7f97bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.198+0000 7f97c2ffd700 1 -- 172.21.15.67:0/3897064853 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97bc010960 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.198+0000 7f97c2ffd700 1 -- 172.21.15.67:0/3897064853 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97bc01a430 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.198+0000 7f97c2ffd700 1 -- 172.21.15.67:0/3897064853 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97bc0245b0 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.198+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97cc113b10 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.198+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97cc113f20 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.199+0000 7f97c2ffd700 1 -- 172.21.15.67:0/3897064853 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f97bc01a9f0 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.199+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97cc04bb80 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.200+0000 7f97c2ffd700 1 --2- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f97b8036690 0x7f97b8038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.200+0000 7f97c2ffd700 1 -- 172.21.15.67:0/3897064853 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f97bc04a0c0 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.200+0000 7f97c3fff700 1 --2- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f97b8036690 0x7f97b8038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.200+0000 7f97c3fff700 1 --2- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f97b8036690 0x7f97b8038b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009990 tx=0x7f97b4006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.205+0000 7f97c2ffd700 1 -- 172.21.15.67:0/3897064853 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f97bc02b8c0 con 0x7f97cc077bb0 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.422+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f97cc0008d0 con 0x7f97b8036690 2023-12-05T09:18:09.736 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.427+0000 7f97c2ffd700 1 -- 172.21.15.67:0/3897064853 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f97cc0008d0 con 0x7f97b8036690 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.429+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f97b8036690 msgr2=0x7f97b8038b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.429+0000 7f97d0a47700 1 --2- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f97b8036690 0x7f97b8038b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009990 tx=0x7f97b4006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.429+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 msgr2=0x7f97cc1133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.429+0000 7f97d0a47700 1 --2- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc1133d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006d40 tx=0x7f97bc009250 comp rx=0 tx=0).stop 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.429+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 shutdown_connections 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.429+0000 7f97d0a47700 1 --2- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f97b8036690 0x7f97b8038b40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.429+0000 7f97d0a47700 1 --2- 172.21.15.67:0/3897064853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97cc077bb0 0x7f97cc1133d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.429+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 >> 172.21.15.67:0/3897064853 conn(0x7f97cc0fda50 msgr2=0x7f97cc0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.430+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 shutdown_connections 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:09.430+0000 7f97d0a47700 1 -- 172.21.15.67:0/3897064853 wait complete. 2023-12-05T09:18:09.737 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying grafana service with default placement... 2023-12-05T09:18:10.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:09 smithi067 ceph-mon[107174]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:10.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:09 smithi067 ceph-mon[107174]: Saving service crash spec with placement * 2023-12-05T09:18:10.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:09 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.127+0000 7f9efa2fd700 1 Processor -- start 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.127+0000 7f9efa2fd700 1 -- start start 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.128+0000 7f9efa2fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef40760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.128+0000 7f9efa2fd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4077fc0 con 0x7f9ef4077bb0 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.128+0000 7f9ef3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef40760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.128+0000 7f9ef3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef40760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47014/0 (socket says 172.21.15.67:47014) 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.128+0000 7f9ef3fff700 1 -- 172.21.15.67:0/758764132 learned_addr learned my addr 172.21.15.67:0/758764132 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.128+0000 7f9ef3fff700 1 -- 172.21.15.67:0/758764132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4076600 con 0x7f9ef4077bb0 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.129+0000 7f9ef3fff700 1 --2- 172.21.15.67:0/758764132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef40760c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40098e0 tx=0x7f9ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5862bf5e14b029f server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:10.694 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.129+0000 7f9ef2ffd700 1 -- 172.21.15.67:0/758764132 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ee400b860 con 0x7f9ef4077bb0 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.129+0000 7f9ef2ffd700 1 -- 172.21.15.67:0/758764132 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ee400be70 con 0x7f9ef4077bb0 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.129+0000 7f9ef2ffd700 1 -- 172.21.15.67:0/758764132 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ee4010380 con 0x7f9ef4077bb0 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.129+0000 7f9efa2fd700 1 -- 172.21.15.67:0/758764132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 msgr2=0x7f9ef40760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.129+0000 7f9efa2fd700 1 --2- 172.21.15.67:0/758764132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef40760c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40098e0 tx=0x7f9ee4009250 comp rx=0 tx=0).stop 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.130+0000 7f9efa2fd700 1 -- 172.21.15.67:0/758764132 shutdown_connections 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.130+0000 7f9efa2fd700 1 --2- 172.21.15.67:0/758764132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef40760c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.130+0000 7f9efa2fd700 1 -- 172.21.15.67:0/758764132 >> 172.21.15.67:0/758764132 conn(0x7f9ef40fda50 msgr2=0x7f9ef40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.130+0000 7f9efa2fd700 1 -- 172.21.15.67:0/758764132 shutdown_connections 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.130+0000 7f9efa2fd700 1 -- 172.21.15.67:0/758764132 wait complete. 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.131+0000 7f9efa2fd700 1 Processor -- start 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.131+0000 7f9efa2fd700 1 -- start start 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.132+0000 7f9efa2fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef41133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.132+0000 7f9efa2fd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4113910 con 0x7f9ef4077bb0 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.132+0000 7f9ef3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef41133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:10.695 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.132+0000 7f9ef3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef41133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47024/0 (socket says 172.21.15.67:47024) 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.132+0000 7f9ef3fff700 1 -- 172.21.15.67:0/1835627780 learned_addr learned my addr 172.21.15.67:0/1835627780 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.132+0000 7f9ef3fff700 1 -- 172.21.15.67:0/1835627780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee40094f0 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.132+0000 7f9ef3fff700 1 --2- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef41133d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006d40 tx=0x7f9ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.133+0000 7f9ef0ff9700 1 -- 172.21.15.67:0/1835627780 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ee4010960 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.133+0000 7f9ef0ff9700 1 -- 172.21.15.67:0/1835627780 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ee401a430 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.133+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef4113b10 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.133+0000 7f9ef0ff9700 1 -- 172.21.15.67:0/1835627780 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9ee40245b0 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.133+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef4113f20 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.134+0000 7f9ef0ff9700 1 -- 172.21.15.67:0/1835627780 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f9ee401a9f0 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.134+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef404bb80 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.135+0000 7f9ef0ff9700 1 --2- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f9edc036640 0x7f9edc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.135+0000 7f9ef0ff9700 1 -- 172.21.15.67:0/1835627780 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9ee404a090 con 0x7f9ef4077bb0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.135+0000 7f9ef37fe700 1 --2- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f9edc036640 0x7f9edc038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:10.696 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.135+0000 7f9ef37fe700 1 --2- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f9edc036640 0x7f9edc038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009990 tx=0x7f9ee8006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.139+0000 7f9ef0ff9700 1 -- 172.21.15.67:0/1835627780 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9ee402b8c0 con 0x7f9ef4077bb0 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.361+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ef40008d0 con 0x7f9edc036640 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.366+0000 7f9ef0ff9700 1 -- 172.21.15.67:0/1835627780 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f9ef40008d0 con 0x7f9edc036640 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f9edc036640 msgr2=0x7f9edc038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 --2- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f9edc036640 0x7f9edc038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009990 tx=0x7f9ee8006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 msgr2=0x7f9ef41133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 --2- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef41133d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4006d40 tx=0x7f9ee4009250 comp rx=0 tx=0).stop 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 shutdown_connections 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 --2- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f9edc036640 0x7f9edc038af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 --2- 172.21.15.67:0/1835627780 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9ef4077bb0 0x7f9ef41133d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 >> 172.21.15.67:0/1835627780 conn(0x7f9ef40fda50 msgr2=0x7f9ef40ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 shutdown_connections 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:10.368+0000 7f9efa2fd700 1 -- 172.21.15.67:0/1835627780 wait complete. 2023-12-05T09:18:10.697 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying node-exporter service with default placement... 2023-12-05T09:18:10.955 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:10 smithi067 ceph-mon[107174]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:10.955 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:10 smithi067 ceph-mon[107174]: Saving service prometheus spec with placement count:1 2023-12-05T09:18:10.955 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:10 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:10.955 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:10 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:11.740 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-05T09:18:11.740 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.134+0000 7f343a342700 1 Processor -- start 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.134+0000 7f343a342700 1 -- start start 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.134+0000 7f343a342700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f3434104f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.135+0000 7f343a342700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3434105460 con 0x7f3434070f80 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.135+0000 7f3433fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f3434104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.135+0000 7f3433fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f3434104f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47026/0 (socket says 172.21.15.67:47026) 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.135+0000 7f3433fff700 1 -- 172.21.15.67:0/2885608829 learned_addr learned my addr 172.21.15.67:0/2885608829 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.135+0000 7f3433fff700 1 -- 172.21.15.67:0/2885608829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34341055a0 con 0x7f3434070f80 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.136+0000 7f3433fff700 1 --2- 172.21.15.67:0/2885608829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f3434104f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34240098e0 tx=0x7f3424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899e3e6bc1b16647 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:11.741 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.136+0000 7f3432ffd700 1 -- 172.21.15.67:0/2885608829 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f342400b860 con 0x7f3434070f80 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.136+0000 7f3432ffd700 1 -- 172.21.15.67:0/2885608829 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f342400be70 con 0x7f3434070f80 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.136+0000 7f3432ffd700 1 -- 172.21.15.67:0/2885608829 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3424010380 con 0x7f3434070f80 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.137+0000 7f343a342700 1 -- 172.21.15.67:0/2885608829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 msgr2=0x7f3434104f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.137+0000 7f343a342700 1 --2- 172.21.15.67:0/2885608829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f3434104f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34240098e0 tx=0x7f3424009250 comp rx=0 tx=0).stop 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.137+0000 7f343a342700 1 -- 172.21.15.67:0/2885608829 shutdown_connections 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.137+0000 7f343a342700 1 --2- 172.21.15.67:0/2885608829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f3434104f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.137+0000 7f343a342700 1 -- 172.21.15.67:0/2885608829 >> 172.21.15.67:0/2885608829 conn(0x7f34340fc970 msgr2=0x7f34340fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.137+0000 7f343a342700 1 -- 172.21.15.67:0/2885608829 shutdown_connections 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.137+0000 7f343a342700 1 -- 172.21.15.67:0/2885608829 wait complete. 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.138+0000 7f343a342700 1 Processor -- start 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.138+0000 7f343a342700 1 -- start start 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.139+0000 7f343a342700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f34341111b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:11.742 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.139+0000 7f343a342700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34341116f0 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.139+0000 7f3433fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f34341111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.139+0000 7f3433fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f34341111b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47030/0 (socket says 172.21.15.67:47030) 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.139+0000 7f3433fff700 1 -- 172.21.15.67:0/3599483867 learned_addr learned my addr 172.21.15.67:0/3599483867 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.139+0000 7f3433fff700 1 -- 172.21.15.67:0/3599483867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34240094f0 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.140+0000 7f3433fff700 1 --2- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f34341111b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3424006d40 tx=0x7f3424009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.140+0000 7f3430ff9700 1 -- 172.21.15.67:0/3599483867 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3424010960 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.140+0000 7f3430ff9700 1 -- 172.21.15.67:0/3599483867 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f342401a430 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.140+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34341118f0 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.140+0000 7f3430ff9700 1 -- 172.21.15.67:0/3599483867 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f34240245b0 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.140+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3434111d00 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.141+0000 7f3430ff9700 1 -- 172.21.15.67:0/3599483867 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f342402d3f0 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.141+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343404bb80 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.142+0000 7f3430ff9700 1 --2- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f341c036640 0x7f341c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.142+0000 7f3430ff9700 1 -- 172.21.15.67:0/3599483867 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f342404a160 con 0x7f3434070f80 2023-12-05T09:18:11.743 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.142+0000 7f34337fe700 1 --2- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f341c036640 0x7f341c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.143+0000 7f34337fe700 1 --2- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f341c036640 0x7f341c038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3428009990 tx=0x7f3428006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.147+0000 7f3430ff9700 1 -- 172.21.15.67:0/3599483867 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f342402b8e0 con 0x7f3434070f80 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.370+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f343410aff0 con 0x7f341c036640 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.374+0000 7f3430ff9700 1 -- 172.21.15.67:0/3599483867 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f343410aff0 con 0x7f341c036640 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f341c036640 msgr2=0x7f341c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 --2- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f341c036640 0x7f341c038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3428009990 tx=0x7f3428006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 msgr2=0x7f34341111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 --2- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f34341111b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3424006d40 tx=0x7f3424009250 comp rx=0 tx=0).stop 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 shutdown_connections 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 --2- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f341c036640 0x7f341c038af0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 --2- 172.21.15.67:0/3599483867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3434070f80 0x7f34341111b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 >> 172.21.15.67:0/3599483867 conn(0x7f34340fc970 msgr2=0x7f34340fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 shutdown_connections 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:11.377+0000 7f343a342700 1 -- 172.21.15.67:0/3599483867 wait complete. 2023-12-05T09:18:11.744 INFO:teuthology.orchestra.run.smithi067.stdout:Deploying alertmanager service with default placement... 2023-12-05T09:18:11.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:11 smithi067 ceph-mon[107174]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:11.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:11 smithi067 ceph-mon[107174]: Saving service grafana spec with placement count:1 2023-12-05T09:18:11.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:11 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:12.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-05T09:18:12.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.113+0000 7fdb6bfff700 1 Processor -- start 2023-12-05T09:18:12.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.113+0000 7fdb6bfff700 1 -- start start 2023-12-05T09:18:12.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.113+0000 7fdb6bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c102550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:12.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.113+0000 7fdb6bfff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c102a90 con 0x7fdb6c102140 2023-12-05T09:18:12.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.113+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c102550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:12.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.114+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c102550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47032/0 (socket says 172.21.15.67:47032) 2023-12-05T09:18:12.641 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.114+0000 7fdb6affd700 1 -- 172.21.15.67:0/3231981815 learned_addr learned my addr 172.21.15.67:0/3231981815 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.114+0000 7fdb6affd700 1 -- 172.21.15.67:0/3231981815 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c102bd0 con 0x7fdb6c102140 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.114+0000 7fdb6affd700 1 --2- 172.21.15.67:0/3231981815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c102550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0098e0 tx=0x7fdb5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b4cb28323a384b server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.114+0000 7fdb69ffb700 1 -- 172.21.15.67:0/3231981815 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb5c00b860 con 0x7fdb6c102140 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.114+0000 7fdb69ffb700 1 -- 172.21.15.67:0/3231981815 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb5c00be70 con 0x7fdb6c102140 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.114+0000 7fdb69ffb700 1 -- 172.21.15.67:0/3231981815 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb5c010380 con 0x7fdb6c102140 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.115+0000 7fdb6bfff700 1 -- 172.21.15.67:0/3231981815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 msgr2=0x7fdb6c102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.115+0000 7fdb6bfff700 1 --2- 172.21.15.67:0/3231981815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c102550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0098e0 tx=0x7fdb5c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.115+0000 7fdb6bfff700 1 -- 172.21.15.67:0/3231981815 shutdown_connections 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.115+0000 7fdb6bfff700 1 --2- 172.21.15.67:0/3231981815 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c102550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.115+0000 7fdb6bfff700 1 -- 172.21.15.67:0/3231981815 >> 172.21.15.67:0/3231981815 conn(0x7fdb6c0fd880 msgr2=0x7fdb6c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.115+0000 7fdb6bfff700 1 -- 172.21.15.67:0/3231981815 shutdown_connections 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.115+0000 7fdb6bfff700 1 -- 172.21.15.67:0/3231981815 wait complete. 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.116+0000 7fdb6bfff700 1 Processor -- start 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.116+0000 7fdb6bfff700 1 -- start start 2023-12-05T09:18:12.642 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.116+0000 7fdb6bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.116+0000 7fdb6bfff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c076080 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.117+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.117+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47046/0 (socket says 172.21.15.67:47046) 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.117+0000 7fdb6affd700 1 -- 172.21.15.67:0/2973722201 learned_addr learned my addr 172.21.15.67:0/2973722201 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.117+0000 7fdb6affd700 1 -- 172.21.15.67:0/2973722201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0094f0 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.117+0000 7fdb6affd700 1 --2- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c077c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c010 tx=0x7fdb5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.117+0000 7fdb537fe700 1 -- 172.21.15.67:0/2973722201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb5c010960 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.117+0000 7fdb537fe700 1 -- 172.21.15.67:0/2973722201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb5c01a430 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.118+0000 7fdb537fe700 1 -- 172.21.15.67:0/2973722201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb5c019580 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.118+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c076280 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.118+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c076690 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.119+0000 7fdb537fe700 1 -- 172.21.15.67:0/2973722201 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fdb5c01a980 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.119+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c04bb80 con 0x7fdb6c102140 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.119+0000 7fdb537fe700 1 --2- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fdb54036640 0x7fdb54038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:12.643 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.119+0000 7fdb537fe700 1 -- 172.21.15.67:0/2973722201 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdb5c04a360 con 0x7fdb6c102140 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.119+0000 7fdb6a7fc700 1 --2- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fdb54036640 0x7fdb54038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.120+0000 7fdb6a7fc700 1 --2- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fdb54036640 0x7fdb54038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009990 tx=0x7fdb60006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.124+0000 7fdb537fe700 1 -- 172.21.15.67:0/2973722201 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdb5c02bb30 con 0x7fdb6c102140 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.338+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb6c10ac70 con 0x7fdb54036640 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.342+0000 7fdb537fe700 1 -- 172.21.15.67:0/2973722201 <== mgr.14122 v2:172.21.15.67:6800/2543364948 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fdb6c10ac70 con 0x7fdb54036640 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fdb54036640 msgr2=0x7fdb54038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 --2- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fdb54036640 0x7fdb54038af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009990 tx=0x7fdb60006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 msgr2=0x7fdb6c077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 --2- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c077c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c010 tx=0x7fdb5c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 shutdown_connections 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 --2- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fdb54036640 0x7fdb54038af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 --2- 172.21.15.67:0/2973722201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c102140 0x7fdb6c077c00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 >> 172.21.15.67:0/2973722201 conn(0x7fdb6c0fd880 msgr2=0x7fdb6c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 shutdown_connections 2023-12-05T09:18:12.644 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:12.345+0000 7fdb6bfff700 1 -- 172.21.15.67:0/2973722201 wait complete. 2023-12-05T09:18:13.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:12 smithi067 ceph-mon[107174]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:13.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:12 smithi067 ceph-mon[107174]: Saving service node-exporter spec with placement * 2023-12-05T09:18:13.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:12 smithi067 ceph-mon[107174]: from='mgr.14122 172.21.15.67:0/2556597652' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:13.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.032+0000 7f99066e2700 1 Processor -- start 2023-12-05T09:18:13.552 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.033+0000 7f99066e2700 1 -- start start 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.033+0000 7f99066e2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f99001026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.033+0000 7f99066e2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9900102c20 con 0x7f99001022d0 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.033+0000 7f98fffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f99001026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.033+0000 7f98fffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f99001026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47056/0 (socket says 172.21.15.67:47056) 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.033+0000 7f98fffff700 1 -- 172.21.15.67:0/2699790424 learned_addr learned my addr 172.21.15.67:0/2699790424 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.034+0000 7f98fffff700 1 -- 172.21.15.67:0/2699790424 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900102d60 con 0x7f99001022d0 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.034+0000 7f98fffff700 1 --2- 172.21.15.67:0/2699790424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f99001026e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98f00098e0 tx=0x7f98f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a1f9716f79403a server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.034+0000 7f98feffd700 1 -- 172.21.15.67:0/2699790424 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98f000b860 con 0x7f99001022d0 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.034+0000 7f98feffd700 1 -- 172.21.15.67:0/2699790424 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98f000be70 con 0x7f99001022d0 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.034+0000 7f98feffd700 1 -- 172.21.15.67:0/2699790424 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98f0010380 con 0x7f99001022d0 2023-12-05T09:18:13.553 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.035+0000 7f99066e2700 1 -- 172.21.15.67:0/2699790424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 msgr2=0x7f99001026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:13.556 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.035+0000 7f99066e2700 1 --2- 172.21.15.67:0/2699790424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f99001026e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98f00098e0 tx=0x7f98f0009250 comp rx=0 tx=0).stop 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.035+0000 7f99066e2700 1 -- 172.21.15.67:0/2699790424 shutdown_connections 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.035+0000 7f99066e2700 1 --2- 172.21.15.67:0/2699790424 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f99001026e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.035+0000 7f99066e2700 1 -- 172.21.15.67:0/2699790424 >> 172.21.15.67:0/2699790424 conn(0x7f99000fda50 msgr2=0x7f99000ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.035+0000 7f99066e2700 1 -- 172.21.15.67:0/2699790424 shutdown_connections 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.035+0000 7f99066e2700 1 -- 172.21.15.67:0/2699790424 wait complete. 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.036+0000 7f99066e2700 1 Processor -- start 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.036+0000 7f99066e2700 1 -- start start 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.036+0000 7f99066e2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f9900111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.036+0000 7f99066e2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99001116b0 con 0x7f99001022d0 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.036+0000 7f98fffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f9900111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.037+0000 7f98fffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f9900111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47062/0 (socket says 172.21.15.67:47062) 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.037+0000 7f98fffff700 1 -- 172.21.15.67:0/1303760647 learned_addr learned my addr 172.21.15.67:0/1303760647 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:13.557 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.037+0000 7f98fffff700 1 -- 172.21.15.67:0/1303760647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00094f0 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.037+0000 7f98fffff700 1 --2- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f9900111170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f98f000c010 tx=0x7f98f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.037+0000 7f98fcff9700 1 -- 172.21.15.67:0/1303760647 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98f0010960 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.037+0000 7f98fcff9700 1 -- 172.21.15.67:0/1303760647 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98f001a430 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.037+0000 7f98fcff9700 1 -- 172.21.15.67:0/1303760647 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98f0019580 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.037+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99001118b0 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.038+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9900111cc0 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.039+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990004bb80 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.039+0000 7f98fcff9700 1 -- 172.21.15.67:0/1303760647 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f98f001a980 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.040+0000 7f98fcff9700 1 --2- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f98e80365f0 0x7f98e8038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.040+0000 7f98fcff9700 1 -- 172.21.15.67:0/1303760647 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f98f004a570 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.040+0000 7f98ff7fe700 1 --2- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f98e80365f0 0x7f98e8038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.041+0000 7f98ff7fe700 1 --2- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f98e80365f0 0x7f98e8038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009990 tx=0x7f98f4006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.044+0000 7f98fcff9700 1 -- 172.21.15.67:0/1303760647 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f98f0018d20 con 0x7f99001022d0 2023-12-05T09:18:13.558 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.245+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f99001040b0 con 0x7f99001022d0 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.251+0000 7f98fcff9700 1 -- 172.21.15.67:0/1303760647 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f98f0018b40 con 0x7f99001022d0 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f98e80365f0 msgr2=0x7f98e8038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 --2- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f98e80365f0 0x7f98e8038aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009990 tx=0x7f98f4006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 msgr2=0x7f9900111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 --2- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f9900111170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f98f000c010 tx=0x7f98f0009250 comp rx=0 tx=0).stop 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 shutdown_connections 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 --2- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f98e80365f0 0x7f98e8038aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 --2- 172.21.15.67:0/1303760647 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f99001022d0 0x7f9900111170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 >> 172.21.15.67:0/1303760647 conn(0x7f99000fda50 msgr2=0x7f99000ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 shutdown_connections 2023-12-05T09:18:13.559 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.254+0000 7f99066e2700 1 -- 172.21.15.67:0/1303760647 wait complete. 2023-12-05T09:18:14.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:13 smithi067 ceph-mon[107174]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:14.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:13 smithi067 ceph-mon[107174]: Saving service alertmanager spec with placement count:1 2023-12-05T09:18:14.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:13 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1303760647' entity='client.admin' 2023-12-05T09:18:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.942+0000 7fd0c6e29700 1 Processor -- start 2023-12-05T09:18:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.942+0000 7fd0c6e29700 1 -- start start 2023-12-05T09:18:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.942+0000 7fd0c6e29700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.942+0000 7fd0c6e29700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0078000 con 0x7fd0c0077bf0 2023-12-05T09:18:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.943+0000 7fd0c5e27700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.943+0000 7fd0c5e27700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47074/0 (socket says 172.21.15.67:47074) 2023-12-05T09:18:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.943+0000 7fd0c5e27700 1 -- 172.21.15.67:0/827206304 learned_addr learned my addr 172.21.15.67:0/827206304 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:14.407 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.943+0000 7fd0c5e27700 1 -- 172.21.15.67:0/827206304 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0076640 con 0x7fd0c0077bf0 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.943+0000 7fd0c5e27700 1 --2- 172.21.15.67:0/827206304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0076100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0098e0 tx=0x7fd0bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43299f1cb674df3a server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c4e25700 1 -- 172.21.15.67:0/827206304 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0bc00b860 con 0x7fd0c0077bf0 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c4e25700 1 -- 172.21.15.67:0/827206304 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0bc00be70 con 0x7fd0c0077bf0 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c4e25700 1 -- 172.21.15.67:0/827206304 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0bc010380 con 0x7fd0c0077bf0 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c6e29700 1 -- 172.21.15.67:0/827206304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 msgr2=0x7fd0c0076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c6e29700 1 --2- 172.21.15.67:0/827206304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0076100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0098e0 tx=0x7fd0bc009250 comp rx=0 tx=0).stop 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c6e29700 1 -- 172.21.15.67:0/827206304 shutdown_connections 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c6e29700 1 --2- 172.21.15.67:0/827206304 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0076100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c6e29700 1 -- 172.21.15.67:0/827206304 >> 172.21.15.67:0/827206304 conn(0x7fd0c00fd880 msgr2=0x7fd0c00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c6e29700 1 -- 172.21.15.67:0/827206304 shutdown_connections 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.944+0000 7fd0c6e29700 1 -- 172.21.15.67:0/827206304 wait complete. 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.945+0000 7fd0c6e29700 1 Processor -- start 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.945+0000 7fd0c6e29700 1 -- start start 2023-12-05T09:18:14.408 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.946+0000 7fd0c6e29700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.946+0000 7fd0c6e29700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0113770 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.946+0000 7fd0c5e27700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.946+0000 7fd0c5e27700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47086/0 (socket says 172.21.15.67:47086) 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.946+0000 7fd0c5e27700 1 -- 172.21.15.67:0/2481218935 learned_addr learned my addr 172.21.15.67:0/2481218935 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.946+0000 7fd0c5e27700 1 -- 172.21.15.67:0/2481218935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc0094f0 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.946+0000 7fd0c5e27700 1 --2- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0113230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc006d40 tx=0x7fd0bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.947+0000 7fd0b67fc700 1 -- 172.21.15.67:0/2481218935 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0bc010960 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.947+0000 7fd0b67fc700 1 -- 172.21.15.67:0/2481218935 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0bc01a430 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.947+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c0113970 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.947+0000 7fd0b67fc700 1 -- 172.21.15.67:0/2481218935 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd0bc0245b0 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.947+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c0113d80 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.948+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c004bb80 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.948+0000 7fd0b67fc700 1 -- 172.21.15.67:0/2481218935 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd0bc01a9f0 con 0x7fd0c0077bf0 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.949+0000 7fd0b67fc700 1 --2- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd0ac036640 0x7fd0ac038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:14.409 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.949+0000 7fd0b67fc700 1 -- 172.21.15.67:0/2481218935 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd0bc04a150 con 0x7fd0c0077bf0 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.949+0000 7fd0c5626700 1 --2- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd0ac036640 0x7fd0ac038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.950+0000 7fd0c5626700 1 --2- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd0ac036640 0x7fd0ac038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009990 tx=0x7fd0b0006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:13.953+0000 7fd0b67fc700 1 -- 172.21.15.67:0/2481218935 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd0bc02b8c0 con 0x7fd0c0077bf0 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.156+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fd0c01083e0 con 0x7fd0c0077bf0 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.162+0000 7fd0b67fc700 1 -- 172.21.15.67:0/2481218935 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd0bc02b2f0 con 0x7fd0c0077bf0 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd0ac036640 msgr2=0x7fd0ac038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 --2- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd0ac036640 0x7fd0ac038af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009990 tx=0x7fd0b0006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 msgr2=0x7fd0c0113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 --2- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0113230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc006d40 tx=0x7fd0bc009250 comp rx=0 tx=0).stop 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 shutdown_connections 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 --2- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd0ac036640 0x7fd0ac038af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 --2- 172.21.15.67:0/2481218935 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0077bf0 0x7fd0c0113230 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 >> 172.21.15.67:0/2481218935 conn(0x7fd0c00fd880 msgr2=0x7fd0c00ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:14.410 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 shutdown_connections 2023-12-05T09:18:14.411 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.165+0000 7fd0c6e29700 1 -- 172.21.15.67:0/2481218935 wait complete. 2023-12-05T09:18:14.411 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling the dashboard module... 2023-12-05T09:18:15.464 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:15 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2481218935' entity='client.admin' 2023-12-05T09:18:15.464 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:15 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/914973290' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-05T09:18:15.501 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.820+0000 7f8bb1c39700 1 Processor -- start 2023-12-05T09:18:15.501 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.821+0000 7f8bb1c39700 1 -- start start 2023-12-05T09:18:15.501 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.821+0000 7f8bb1c39700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac1026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:15.501 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.821+0000 7f8bb1c39700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac102c20 con 0x7f8bac1022d0 2023-12-05T09:18:15.501 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.821+0000 7f8bab7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac1026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:15.501 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.821+0000 7f8bab7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac1026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47100/0 (socket says 172.21.15.67:47100) 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.821+0000 7f8bab7fe700 1 -- 172.21.15.67:0/3283180267 learned_addr learned my addr 172.21.15.67:0/3283180267 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.822+0000 7f8bab7fe700 1 -- 172.21.15.67:0/3283180267 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac102d60 con 0x7f8bac1022d0 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.822+0000 7f8bab7fe700 1 --2- 172.21.15.67:0/3283180267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac1026e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0098e0 tx=0x7f8b9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cb3f01ee00f3d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.822+0000 7f8baa7fc700 1 -- 172.21.15.67:0/3283180267 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b9c00b860 con 0x7f8bac1022d0 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.822+0000 7f8baa7fc700 1 -- 172.21.15.67:0/3283180267 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b9c00be70 con 0x7f8bac1022d0 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.822+0000 7f8baa7fc700 1 -- 172.21.15.67:0/3283180267 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b9c010380 con 0x7f8bac1022d0 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.823+0000 7f8bb1c39700 1 -- 172.21.15.67:0/3283180267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 msgr2=0x7f8bac1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.823+0000 7f8bb1c39700 1 --2- 172.21.15.67:0/3283180267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac1026e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0098e0 tx=0x7f8b9c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.823+0000 7f8bb1c39700 1 -- 172.21.15.67:0/3283180267 shutdown_connections 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.823+0000 7f8bb1c39700 1 --2- 172.21.15.67:0/3283180267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac1026e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:15.502 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.823+0000 7f8bb1c39700 1 -- 172.21.15.67:0/3283180267 >> 172.21.15.67:0/3283180267 conn(0x7f8bac0fda50 msgr2=0x7f8bac0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.823+0000 7f8bb1c39700 1 -- 172.21.15.67:0/3283180267 shutdown_connections 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.823+0000 7f8bb1c39700 1 -- 172.21.15.67:0/3283180267 wait complete. 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.824+0000 7f8bb1c39700 1 Processor -- start 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.824+0000 7f8bb1c39700 1 -- start start 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.825+0000 7f8bb1c39700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.825+0000 7f8bb1c39700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac1116b0 con 0x7f8bac1022d0 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.825+0000 7f8bab7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.825+0000 7f8bab7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47110/0 (socket says 172.21.15.67:47110) 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.825+0000 7f8bab7fe700 1 -- 172.21.15.67:0/914973290 learned_addr learned my addr 172.21.15.67:0/914973290 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.825+0000 7f8bab7fe700 1 -- 172.21.15.67:0/914973290 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0094f0 con 0x7f8bac1022d0 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.826+0000 7f8bab7fe700 1 --2- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac111170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00c010 tx=0x7f8b9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.826+0000 7f8b93fff700 1 -- 172.21.15.67:0/914973290 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b9c010960 con 0x7f8bac1022d0 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.826+0000 7f8b93fff700 1 -- 172.21.15.67:0/914973290 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b9c01a430 con 0x7f8bac1022d0 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.826+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac1118b0 con 0x7f8bac1022d0 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.826+0000 7f8b93fff700 1 -- 172.21.15.67:0/914973290 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b9c019580 con 0x7f8bac1022d0 2023-12-05T09:18:15.503 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.826+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac111cc0 con 0x7f8bac1022d0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.827+0000 7f8b93fff700 1 -- 172.21.15.67:0/914973290 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f8b9c01a980 con 0x7f8bac1022d0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.827+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac04bb80 con 0x7f8bac1022d0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.827+0000 7f8b93fff700 1 --2- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8b94036640 0x7f8b94038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.828+0000 7f8b93fff700 1 -- 172.21.15.67:0/914973290 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8b9c04a420 con 0x7f8bac1022d0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.828+0000 7f8baaffd700 1 --2- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8b94036640 0x7f8b94038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.828+0000 7f8baaffd700 1 --2- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8b94036640 0x7f8b94038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009990 tx=0x7f8ba0006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:14.832+0000 7f8b93fff700 1 -- 172.21.15.67:0/914973290 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8b9c02bb30 con 0x7f8bac1022d0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.091+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f8bac10af90 con 0x7f8bac1022d0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.162+0000 7f8b93fff700 1 -- 172.21.15.67:0/914973290 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f8b9c021d40 con 0x7f8bac1022d0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.165+0000 7f8b93fff700 1 -- 172.21.15.67:0/914973290 <== mon.0 v2:172.21.15.67:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f8b9c00f750 con 0x7f8bac1022d0 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8b94036640 msgr2=0x7f8b94038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 --2- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8b94036640 0x7f8b94038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009990 tx=0x7f8ba0006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 msgr2=0x7f8bac111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:15.504 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 --2- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac111170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00c010 tx=0x7f8b9c009250 comp rx=0 tx=0).stop 2023-12-05T09:18:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 shutdown_connections 2023-12-05T09:18:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 --2- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f8b94036640 0x7f8b94038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 --2- 172.21.15.67:0/914973290 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8bac1022d0 0x7f8bac111170 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 >> 172.21.15.67:0/914973290 conn(0x7f8bac0fda50 msgr2=0x7f8bac0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 shutdown_connections 2023-12-05T09:18:15.505 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.168+0000 7f8bb1c39700 1 -- 172.21.15.67:0/914973290 wait complete. 2023-12-05T09:18:16.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:16 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/914973290' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-05T09:18:16.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:16 smithi067 ceph-mon[107174]: mgrmap e9: smithi067.alxtvv(active, since 18s) 2023-12-05T09:18:16.711 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:18:16.711 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "active_name": "smithi067.alxtvv", 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.930+0000 7fd8cfed7700 1 Processor -- start 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.930+0000 7fd8cfed7700 1 -- start start 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.931+0000 7fd8cfed7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.931+0000 7fd8cfed7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8077fe0 con 0x7fd8c8077bd0 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.931+0000 7fd8cdc73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.931+0000 7fd8cdc73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c80760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39976/0 (socket says 172.21.15.67:39976) 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.931+0000 7fd8cdc73700 1 -- 172.21.15.67:0/2820640189 learned_addr learned my addr 172.21.15.67:0/2820640189 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.932+0000 7fd8cdc73700 1 -- 172.21.15.67:0/2820640189 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8076620 con 0x7fd8c8077bd0 2023-12-05T09:18:16.712 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.932+0000 7fd8cdc73700 1 --2- 172.21.15.67:0/2820640189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c80760e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40098e0 tx=0x7fd8c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496a00c7770ba212 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.932+0000 7fd8ccc71700 1 -- 172.21.15.67:0/2820640189 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8c400b860 con 0x7fd8c8077bd0 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.932+0000 7fd8ccc71700 1 -- 172.21.15.67:0/2820640189 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd8c400be70 con 0x7fd8c8077bd0 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.932+0000 7fd8ccc71700 1 -- 172.21.15.67:0/2820640189 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8c4010380 con 0x7fd8c8077bd0 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.933+0000 7fd8cfed7700 1 -- 172.21.15.67:0/2820640189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 msgr2=0x7fd8c80760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.933+0000 7fd8cfed7700 1 --2- 172.21.15.67:0/2820640189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c80760e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40098e0 tx=0x7fd8c4009250 comp rx=0 tx=0).stop 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.933+0000 7fd8cfed7700 1 -- 172.21.15.67:0/2820640189 shutdown_connections 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.933+0000 7fd8cfed7700 1 --2- 172.21.15.67:0/2820640189 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c80760e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.933+0000 7fd8cfed7700 1 -- 172.21.15.67:0/2820640189 >> 172.21.15.67:0/2820640189 conn(0x7fd8c80fda50 msgr2=0x7fd8c80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.933+0000 7fd8cfed7700 1 -- 172.21.15.67:0/2820640189 shutdown_connections 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.933+0000 7fd8cfed7700 1 -- 172.21.15.67:0/2820640189 wait complete. 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.934+0000 7fd8cfed7700 1 Processor -- start 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.934+0000 7fd8cfed7700 1 -- start start 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.935+0000 7fd8cfed7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c81133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:16.713 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.935+0000 7fd8cfed7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8113900 con 0x7fd8c8077bd0 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.935+0000 7fd8cdc73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c81133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.935+0000 7fd8cdc73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c81133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39986/0 (socket says 172.21.15.67:39986) 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.935+0000 7fd8cdc73700 1 -- 172.21.15.67:0/1108890049 learned_addr learned my addr 172.21.15.67:0/1108890049 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.935+0000 7fd8cdc73700 1 -- 172.21.15.67:0/1108890049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c40094f0 con 0x7fd8c8077bd0 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.936+0000 7fd8cdc73700 1 --2- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c81133c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4006d40 tx=0x7fd8c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.936+0000 7fd8be7fc700 1 -- 172.21.15.67:0/1108890049 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8c4010960 con 0x7fd8c8077bd0 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.936+0000 7fd8be7fc700 1 -- 172.21.15.67:0/1108890049 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd8c401a430 con 0x7fd8c8077bd0 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.936+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c8113b00 con 0x7fd8c8077bd0 2023-12-05T09:18:16.714 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.936+0000 7fd8be7fc700 1 -- 172.21.15.67:0/1108890049 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd8c40245b0 con 0x7fd8c8077bd0 2023-12-05T09:18:16.715 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.936+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c8113f10 con 0x7fd8c8077bd0 2023-12-05T09:18:16.715 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.937+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c804bb80 con 0x7fd8c8077bd0 2023-12-05T09:18:16.715 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.937+0000 7fd8be7fc700 1 -- 172.21.15.67:0/1108890049 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fd8c4010ac0 con 0x7fd8c8077bd0 2023-12-05T09:18:16.715 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.938+0000 7fd8be7fc700 1 --2- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd8b4036690 0x7fd8b4038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:16.715 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.938+0000 7fd8be7fc700 1 -- 172.21.15.67:0/1108890049 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd8c404a100 con 0x7fd8c8077bd0 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.938+0000 7fd8cd472700 1 -- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd8b4036690 msgr2=0x7fd8b4038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/2543364948 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.938+0000 7fd8cd472700 1 --2- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd8b4036690 0x7fd8b4038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:15.944+0000 7fd8be7fc700 1 -- 172.21.15.67:0/1108890049 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd8c402b4d0 con 0x7fd8c8077bd0 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.139+0000 7fd8cd472700 1 -- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd8b4036690 msgr2=0x7fd8b4038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/2543364948 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.139+0000 7fd8cd472700 1 --2- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd8b4036690 0x7fd8b4038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.205+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd8c80008d0 con 0x7fd8c8077bd0 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.206+0000 7fd8be7fc700 1 -- 172.21.15.67:0/1108890049 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fd8c402b2f0 con 0x7fd8c8077bd0 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.208+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd8b4036690 msgr2=0x7fd8b4038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.208+0000 7fd8cfed7700 1 --2- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd8b4036690 0x7fd8b4038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.208+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 msgr2=0x7fd8c81133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.208+0000 7fd8cfed7700 1 --2- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c81133c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4006d40 tx=0x7fd8c4009250 comp rx=0 tx=0).stop 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.209+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 shutdown_connections 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.209+0000 7fd8cfed7700 1 --2- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7fd8b4036690 0x7fd8b4038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.209+0000 7fd8cfed7700 1 --2- 172.21.15.67:0/1108890049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd8c8077bd0 0x7fd8c81133c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:16.716 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.209+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 >> 172.21.15.67:0/1108890049 conn(0x7fd8c80fda50 msgr2=0x7fd8c80ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:16.717 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.209+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 shutdown_connections 2023-12-05T09:18:16.717 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:16.209+0000 7fd8cfed7700 1 -- 172.21.15.67:0/1108890049 wait complete. 2023-12-05T09:18:16.717 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for the mgr to restart... 2023-12-05T09:18:16.717 INFO:teuthology.orchestra.run.smithi067.stdout:Waiting for mgr epoch 9... 2023-12-05T09:18:17.593 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:17 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1108890049' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-05T09:18:24.034 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: Active manager daemon smithi067.alxtvv restarted 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: osdmap e3: 0 total, 0 up, 0 in 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: mgrmap e10: smithi067.alxtvv(active, starting, since 0.00365188s) 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:18:24.035 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:23 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:18:25.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:24 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:18:25.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:24 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:18:25.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:24 smithi067 ceph-mon[107174]: [05/Dec/2023:09:18:24] ENGINE Bus STARTING 2023-12-05T09:18:25.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:24 smithi067 ceph-mon[107174]: [05/Dec/2023:09:18:24] ENGINE Serving on https://172.21.15.67:7150 2023-12-05T09:18:25.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:24 smithi067 ceph-mon[107174]: [05/Dec/2023:09:18:24] ENGINE Bus STARTED 2023-12-05T09:18:25.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:24 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:25.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:24 smithi067 ceph-mon[107174]: mgrmap e11: smithi067.alxtvv(active, since 1.00774s) 2023-12-05T09:18:25.431 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout { 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout } 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.088+0000 7f3a6faee700 1 Processor -- start 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.089+0000 7f3a6faee700 1 -- start start 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.089+0000 7f3a6faee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a680760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.089+0000 7f3a6faee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68077fe0 con 0x7f3a68077bd0 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.089+0000 7f3a6d88a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a680760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.089+0000 7f3a6d88a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a680760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40000/0 (socket says 172.21.15.67:40000) 2023-12-05T09:18:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.089+0000 7f3a6d88a700 1 -- 172.21.15.67:0/3120097374 learned_addr learned my addr 172.21.15.67:0/3120097374 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.090+0000 7f3a6d88a700 1 -- 172.21.15.67:0/3120097374 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68076620 con 0x7f3a68077bd0 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.090+0000 7f3a6d88a700 1 --2- 172.21.15.67:0/3120097374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a680760e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a640098e0 tx=0x7f3a64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8b957aa1d942ab server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.090+0000 7f3a6c888700 1 -- 172.21.15.67:0/3120097374 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a6400b860 con 0x7f3a68077bd0 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.090+0000 7f3a6c888700 1 -- 172.21.15.67:0/3120097374 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3a6400be70 con 0x7f3a68077bd0 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.090+0000 7f3a6c888700 1 -- 172.21.15.67:0/3120097374 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a64010380 con 0x7f3a68077bd0 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.091+0000 7f3a6faee700 1 -- 172.21.15.67:0/3120097374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 msgr2=0x7f3a680760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.091+0000 7f3a6faee700 1 --2- 172.21.15.67:0/3120097374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a680760e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a640098e0 tx=0x7f3a64009250 comp rx=0 tx=0).stop 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.091+0000 7f3a6faee700 1 -- 172.21.15.67:0/3120097374 shutdown_connections 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.091+0000 7f3a6faee700 1 --2- 172.21.15.67:0/3120097374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a680760e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.091+0000 7f3a6faee700 1 -- 172.21.15.67:0/3120097374 >> 172.21.15.67:0/3120097374 conn(0x7f3a680fda50 msgr2=0x7f3a680ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.091+0000 7f3a6faee700 1 -- 172.21.15.67:0/3120097374 shutdown_connections 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.091+0000 7f3a6faee700 1 -- 172.21.15.67:0/3120097374 wait complete. 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.092+0000 7f3a6faee700 1 Processor -- start 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.092+0000 7f3a6faee700 1 -- start start 2023-12-05T09:18:25.433 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.093+0000 7f3a6faee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a681133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.093+0000 7f3a6faee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68113900 con 0x7f3a68077bd0 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.093+0000 7f3a6d88a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a681133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.093+0000 7f3a6d88a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a681133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40008/0 (socket says 172.21.15.67:40008) 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.093+0000 7f3a6d88a700 1 -- 172.21.15.67:0/1060606148 learned_addr learned my addr 172.21.15.67:0/1060606148 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.093+0000 7f3a6d88a700 1 -- 172.21.15.67:0/1060606148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640094f0 con 0x7f3a68077bd0 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.093+0000 7f3a6d88a700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a681133c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a64006d40 tx=0x7f3a64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.094+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a64010960 con 0x7f3a68077bd0 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.094+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3a6401a430 con 0x7f3a68077bd0 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.094+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a68113b00 con 0x7f3a68077bd0 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.094+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a640245b0 con 0x7f3a68077bd0 2023-12-05T09:18:25.434 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.094+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a68113f10 con 0x7f3a68077bd0 2023-12-05T09:18:25.435 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.095+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f3a6402d3f0 con 0x7f3a68077bd0 2023-12-05T09:18:25.435 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.095+0000 7f3a5e7fc700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:25.435 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.095+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 --> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a6804bb80 con 0x7f3a54036640 2023-12-05T09:18:25.435 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.096+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3a6404a150 con 0x7f3a68077bd0 2023-12-05T09:18:25.435 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.096+0000 7f3a6d089700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 msgr2=0x7f3a54038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/2543364948 2023-12-05T09:18:25.435 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.096+0000 7f3a6d089700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:18:25.436 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.297+0000 7f3a6d089700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 msgr2=0x7f3a54038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/2543364948 2023-12-05T09:18:25.436 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.297+0000 7f3a6d089700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:18:25.436 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.698+0000 7f3a6d089700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 msgr2=0x7f3a54038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/2543364948 2023-12-05T09:18:25.436 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:17.698+0000 7f3a6d089700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-05T09:18:25.436 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:18.499+0000 7f3a6d089700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 msgr2=0x7f3a54038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/2543364948 2023-12-05T09:18:25.436 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:18.499+0000 7f3a6d089700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-05T09:18:25.436 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:20.100+0000 7f3a6d089700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 msgr2=0x7f3a54038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/2543364948 2023-12-05T09:18:25.436 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:20.100+0000 7f3a6d089700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:23.303+0000 7f3a6d089700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 msgr2=0x7f3a54038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/2543364948 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:23.303+0000 7f3a6d089700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:23.904+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f3a6401a9f0 con 0x7f3a68077bd0 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:23.904+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 msgr2=0x7f3a54038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:23.904+0000 7f3a5e7fc700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.907+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f3a64049730 con 0x7f3a68077bd0 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.907+0000 7f3a5e7fc700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f3a54039f40 0x7f3a5403c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.907+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 --> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a6804bb80 con 0x7f3a54039f40 2023-12-05T09:18:25.437 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.908+0000 7f3a6d089700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f3a54039f40 0x7f3a5403c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:25.438 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.909+0000 7f3a6d089700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f3a54039f40 0x7f3a5403c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3a580039d0 tx=0x7f3a580092f0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:25.438 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.910+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mgr.14164 v2:172.21.15.67:6800/434315882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f3a6804bb80 con 0x7f3a54039f40 2023-12-05T09:18:25.438 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.916+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 --> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3a68108540 con 0x7f3a54039f40 2023-12-05T09:18:25.438 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.917+0000 7f3a5e7fc700 1 -- 172.21.15.67:0/1060606148 <== mgr.14164 v2:172.21.15.67:6800/434315882 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f3a68108540 con 0x7f3a54039f40 2023-12-05T09:18:25.438 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.917+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f3a54039f40 msgr2=0x7f3a5403c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:25.438 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.917+0000 7f3a6faee700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f3a54039f40 0x7f3a5403c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3a580039d0 tx=0x7f3a580092f0 comp rx=0 tx=0).stop 2023-12-05T09:18:25.438 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.917+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 msgr2=0x7f3a681133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:25.438 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.917+0000 7f3a6faee700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a681133c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a64006d40 tx=0x7f3a64009250 comp rx=0 tx=0).stop 2023-12-05T09:18:25.439 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.918+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 shutdown_connections 2023-12-05T09:18:25.439 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.918+0000 7f3a6faee700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f3a54039f40 0x7f3a5403c320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:25.439 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.918+0000 7f3a6faee700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3a68077bd0 0x7f3a681133c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:25.439 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.918+0000 7f3a6faee700 1 --2- 172.21.15.67:0/1060606148 >> [v2:172.21.15.67:6800/2543364948,v1:172.21.15.67:6801/2543364948] conn(0x7f3a54036640 0x7f3a54038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:25.439 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.918+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 >> 172.21.15.67:0/1060606148 conn(0x7f3a680fda50 msgr2=0x7f3a680ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:25.439 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.918+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 shutdown_connections 2023-12-05T09:18:25.439 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:24.918+0000 7f3a6faee700 1 -- 172.21.15.67:0/1060606148 wait complete. 2023-12-05T09:18:25.439 INFO:teuthology.orchestra.run.smithi067.stdout:mgr epoch 9 is available 2023-12-05T09:18:25.440 INFO:teuthology.orchestra.run.smithi067.stdout:Generating a dashboard self-signed certificate... 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.849+0000 7f4ef6597700 1 Processor -- start 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.850+0000 7f4ef6597700 1 -- start start 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.850+0000 7f4ef6597700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef00760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.850+0000 7f4ef6597700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0077fc0 con 0x7f4ef0077bb0 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.850+0000 7f4eeffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef00760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.851+0000 7f4eeffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef00760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34736/0 (socket says 172.21.15.67:34736) 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.851+0000 7f4eeffff700 1 -- 172.21.15.67:0/3483399366 learned_addr learned my addr 172.21.15.67:0/3483399366 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.851+0000 7f4eeffff700 1 -- 172.21.15.67:0/3483399366 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0076600 con 0x7f4ef0077bb0 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.851+0000 7f4eeffff700 1 --2- 172.21.15.67:0/3483399366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef00760c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00098e0 tx=0x7f4ee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b70ea46b68cd49 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:26.577 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4eeeffd700 1 -- 172.21.15.67:0/3483399366 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee000b860 con 0x7f4ef0077bb0 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4eeeffd700 1 -- 172.21.15.67:0/3483399366 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ee000be70 con 0x7f4ef0077bb0 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4eeeffd700 1 -- 172.21.15.67:0/3483399366 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee0010380 con 0x7f4ef0077bb0 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4ef6597700 1 -- 172.21.15.67:0/3483399366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 msgr2=0x7f4ef00760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4ef6597700 1 --2- 172.21.15.67:0/3483399366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef00760c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00098e0 tx=0x7f4ee0009250 comp rx=0 tx=0).stop 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4ef6597700 1 -- 172.21.15.67:0/3483399366 shutdown_connections 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4ef6597700 1 --2- 172.21.15.67:0/3483399366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef00760c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4ef6597700 1 -- 172.21.15.67:0/3483399366 >> 172.21.15.67:0/3483399366 conn(0x7f4ef00fda50 msgr2=0x7f4ef00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4ef6597700 1 -- 172.21.15.67:0/3483399366 shutdown_connections 2023-12-05T09:18:26.578 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.852+0000 7f4ef6597700 1 -- 172.21.15.67:0/3483399366 wait complete. 2023-12-05T09:18:26.579 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:26 smithi067 ceph-mon[107174]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-05T09:18:26.579 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:26 smithi067 ceph-mon[107174]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-05T09:18:26.579 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:26 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:26.579 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:26 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:26.579 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:26 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:26.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.853+0000 7f4ef6597700 1 Processor -- start 2023-12-05T09:18:26.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.854+0000 7f4ef6597700 1 -- start start 2023-12-05T09:18:26.581 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.854+0000 7f4ef6597700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef01133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.854+0000 7f4ef6597700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef0113910 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.854+0000 7f4eeffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef01133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.854+0000 7f4eeffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef01133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34746/0 (socket says 172.21.15.67:34746) 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.854+0000 7f4eeffff700 1 -- 172.21.15.67:0/2080366041 learned_addr learned my addr 172.21.15.67:0/2080366041 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.855+0000 7f4eeffff700 1 -- 172.21.15.67:0/2080366041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00094f0 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.855+0000 7f4eeffff700 1 --2- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef01133d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0003080 tx=0x7f4ee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.855+0000 7f4eecff9700 1 -- 172.21.15.67:0/2080366041 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee0010960 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.855+0000 7f4eecff9700 1 -- 172.21.15.67:0/2080366041 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ee001a430 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.855+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef0113b10 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.855+0000 7f4eecff9700 1 -- 172.21.15.67:0/2080366041 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ee00245b0 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.855+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef0113f20 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.857+0000 7f4eecff9700 1 -- 172.21.15.67:0/2080366041 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f4ee001a9f0 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.857+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef004bb80 con 0x7f4ef0077bb0 2023-12-05T09:18:26.582 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.857+0000 7f4eecff9700 1 --2- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f4ed8036510 0x7f4ed80389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.857+0000 7f4eecff9700 1 -- 172.21.15.67:0/2080366041 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f4ee004a0b0 con 0x7f4ef0077bb0 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.858+0000 7f4eef7fe700 1 --2- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f4ed8036510 0x7f4ed80389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.858+0000 7f4eef7fe700 1 --2- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f4ed8036510 0x7f4ed80389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009990 tx=0x7f4ee4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:25.863+0000 7f4eecff9700 1 -- 172.21.15.67:0/2080366041 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4ee002b8e0 con 0x7f4ef0077bb0 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.073+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 --> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ef00008d0 con 0x7f4ed8036510 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.216+0000 7f4eecff9700 1 -- 172.21.15.67:0/2080366041 <== mgr.14164 v2:172.21.15.67:6800/434315882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f4ef00008d0 con 0x7f4ed8036510 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.219+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f4ed8036510 msgr2=0x7f4ed80389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.219+0000 7f4ef6597700 1 --2- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f4ed8036510 0x7f4ed80389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4009990 tx=0x7f4ee4006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.219+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 msgr2=0x7f4ef01133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.219+0000 7f4ef6597700 1 --2- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef01133d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0003080 tx=0x7f4ee0009250 comp rx=0 tx=0).stop 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.219+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 shutdown_connections 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.219+0000 7f4ef6597700 1 --2- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f4ed8036510 0x7f4ed80389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.219+0000 7f4ef6597700 1 --2- 172.21.15.67:0/2080366041 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ef0077bb0 0x7f4ef01133d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.219+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 >> 172.21.15.67:0/2080366041 conn(0x7f4ef00fda50 msgr2=0x7f4ef00ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.220+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 shutdown_connections 2023-12-05T09:18:26.583 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:26.220+0000 7f4ef6597700 1 -- 172.21.15.67:0/2080366041 wait complete. 2023-12-05T09:18:26.584 INFO:teuthology.orchestra.run.smithi067.stdout:Creating initial admin user... 2023-12-05T09:18:27.531 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:27 smithi067 ceph-mon[107174]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:27.531 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:27 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:27.531 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:27 smithi067 ceph-mon[107174]: mgrmap e12: smithi067.alxtvv(active, since 2s) 2023-12-05T09:18:28.147 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$nPWnhb4kpJ2pzNeLMlz.Je.jPuCGeizJoxbvgrv5R2luNRw1pUi5a", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1701767907, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-05T09:18:28.147 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.044+0000 7fe1c80cb700 1 Processor -- start 2023-12-05T09:18:28.147 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.044+0000 7fe1c80cb700 1 -- start start 2023-12-05T09:18:28.147 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.044+0000 7fe1c80cb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c00760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:28.147 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.044+0000 7fe1c80cb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0077fc0 con 0x7fe1c0077bb0 2023-12-05T09:18:28.147 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.045+0000 7fe1c5e67700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c00760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:28.147 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.045+0000 7fe1c5e67700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c00760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34760/0 (socket says 172.21.15.67:34760) 2023-12-05T09:18:28.147 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.045+0000 7fe1c5e67700 1 -- 172.21.15.67:0/3120095556 learned_addr learned my addr 172.21.15.67:0/3120095556 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.045+0000 7fe1c5e67700 1 -- 172.21.15.67:0/3120095556 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0076600 con 0x7fe1c0077bb0 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.045+0000 7fe1c5e67700 1 --2- 172.21.15.67:0/3120095556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c00760c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0098e0 tx=0x7fe1bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129e43b8de67933a server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.046+0000 7fe1c4e65700 1 -- 172.21.15.67:0/3120095556 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1bc00b860 con 0x7fe1c0077bb0 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.046+0000 7fe1c4e65700 1 -- 172.21.15.67:0/3120095556 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1bc00be70 con 0x7fe1c0077bb0 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.046+0000 7fe1c4e65700 1 -- 172.21.15.67:0/3120095556 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1bc010380 con 0x7fe1c0077bb0 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.046+0000 7fe1c80cb700 1 -- 172.21.15.67:0/3120095556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 msgr2=0x7fe1c00760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.046+0000 7fe1c80cb700 1 --2- 172.21.15.67:0/3120095556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c00760c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0098e0 tx=0x7fe1bc009250 comp rx=0 tx=0).stop 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.046+0000 7fe1c80cb700 1 -- 172.21.15.67:0/3120095556 shutdown_connections 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.046+0000 7fe1c80cb700 1 --2- 172.21.15.67:0/3120095556 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c00760c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.047+0000 7fe1c80cb700 1 -- 172.21.15.67:0/3120095556 >> 172.21.15.67:0/3120095556 conn(0x7fe1c00fda50 msgr2=0x7fe1c00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.047+0000 7fe1c80cb700 1 -- 172.21.15.67:0/3120095556 shutdown_connections 2023-12-05T09:18:28.152 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.047+0000 7fe1c80cb700 1 -- 172.21.15.67:0/3120095556 wait complete. 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.048+0000 7fe1c80cb700 1 Processor -- start 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.048+0000 7fe1c80cb700 1 -- start start 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.048+0000 7fe1c80cb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c01133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.048+0000 7fe1c80cb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0113910 con 0x7fe1c0077bb0 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.048+0000 7fe1c5e67700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c01133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.048+0000 7fe1c5e67700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c01133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34774/0 (socket says 172.21.15.67:34774) 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.048+0000 7fe1c5e67700 1 -- 172.21.15.67:0/1200470838 learned_addr learned my addr 172.21.15.67:0/1200470838 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.049+0000 7fe1c5e67700 1 -- 172.21.15.67:0/1200470838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0094f0 con 0x7fe1c0077bb0 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.049+0000 7fe1c5e67700 1 --2- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c01133d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc006d40 tx=0x7fe1bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.049+0000 7fe1b67fc700 1 -- 172.21.15.67:0/1200470838 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1bc010960 con 0x7fe1c0077bb0 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.049+0000 7fe1b67fc700 1 -- 172.21.15.67:0/1200470838 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1bc01a430 con 0x7fe1c0077bb0 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.049+0000 7fe1b67fc700 1 -- 172.21.15.67:0/1200470838 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1bc0245b0 con 0x7fe1c0077bb0 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.049+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c0113b10 con 0x7fe1c0077bb0 2023-12-05T09:18:28.153 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.049+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c0113f20 con 0x7fe1c0077bb0 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.051+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c004bb80 con 0x7fe1c0077bb0 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.051+0000 7fe1b67fc700 1 -- 172.21.15.67:0/1200470838 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fe1bc01a9f0 con 0x7fe1c0077bb0 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.051+0000 7fe1b67fc700 1 --2- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fe1ac036640 0x7fe1ac038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.051+0000 7fe1b67fc700 1 -- 172.21.15.67:0/1200470838 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe1bc04a330 con 0x7fe1c0077bb0 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.052+0000 7fe1c5666700 1 --2- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fe1ac036640 0x7fe1ac038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.052+0000 7fe1c5666700 1 --2- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fe1ac036640 0x7fe1ac038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009990 tx=0x7fe1b0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.057+0000 7fe1b67fc700 1 -- 172.21.15.67:0/1200470838 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe1bc02b8e0 con 0x7fe1c0077bb0 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.291+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 --> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe1c0108550 con 0x7fe1ac036640 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.540+0000 7fe1b67fc700 1 -- 172.21.15.67:0/1200470838 <== mgr.14164 v2:172.21.15.67:6800/434315882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fe1c0108550 con 0x7fe1ac036640 2023-12-05T09:18:28.154 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fe1ac036640 msgr2=0x7fe1ac038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 --2- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fe1ac036640 0x7fe1ac038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009990 tx=0x7fe1b0006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 msgr2=0x7fe1c01133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 --2- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c01133d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc006d40 tx=0x7fe1bc009250 comp rx=0 tx=0).stop 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 shutdown_connections 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 --2- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fe1ac036640 0x7fe1ac038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 --2- 172.21.15.67:0/1200470838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1c0077bb0 0x7fe1c01133d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 >> 172.21.15.67:0/1200470838 conn(0x7fe1c00fda50 msgr2=0x7fe1c00ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 shutdown_connections 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:27.542+0000 7fe1c80cb700 1 -- 172.21.15.67:0/1200470838 wait complete. 2023-12-05T09:18:28.155 INFO:teuthology.orchestra.run.smithi067.stdout:Fetching dashboard port number... 2023-12-05T09:18:28.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:28 smithi067 ceph-mon[107174]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:28.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:28 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:29.116 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stdout 8443 2023-12-05T09:18:29.117 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.546+0000 7f954a95c700 1 Processor -- start 2023-12-05T09:18:29.117 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.546+0000 7f954a95c700 1 -- start start 2023-12-05T09:18:29.117 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.546+0000 7f954a95c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f95441026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:29.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.546+0000 7f954a95c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9544102c20 con 0x7f95441022d0 2023-12-05T09:18:29.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.547+0000 7f9543fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f95441026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:29.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.547+0000 7f9543fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f95441026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34782/0 (socket says 172.21.15.67:34782) 2023-12-05T09:18:29.121 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.547+0000 7f9543fff700 1 -- 172.21.15.67:0/3622647910 learned_addr learned my addr 172.21.15.67:0/3622647910 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.547+0000 7f9543fff700 1 -- 172.21.15.67:0/3622647910 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544102d60 con 0x7f95441022d0 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.547+0000 7f9543fff700 1 --2- 172.21.15.67:0/3622647910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f95441026e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95340098e0 tx=0x7f9534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d377af43617d7a server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f9542ffd700 1 -- 172.21.15.67:0/3622647910 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f953400b860 con 0x7f95441022d0 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f9542ffd700 1 -- 172.21.15.67:0/3622647910 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f953400be70 con 0x7f95441022d0 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f9542ffd700 1 -- 172.21.15.67:0/3622647910 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9534010380 con 0x7f95441022d0 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f954a95c700 1 -- 172.21.15.67:0/3622647910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 msgr2=0x7f95441026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f954a95c700 1 --2- 172.21.15.67:0/3622647910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f95441026e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95340098e0 tx=0x7f9534009250 comp rx=0 tx=0).stop 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f954a95c700 1 -- 172.21.15.67:0/3622647910 shutdown_connections 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f954a95c700 1 --2- 172.21.15.67:0/3622647910 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f95441026e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f954a95c700 1 -- 172.21.15.67:0/3622647910 >> 172.21.15.67:0/3622647910 conn(0x7f95440fda50 msgr2=0x7f95440ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f954a95c700 1 -- 172.21.15.67:0/3622647910 shutdown_connections 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.548+0000 7f954a95c700 1 -- 172.21.15.67:0/3622647910 wait complete. 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.549+0000 7f954a95c700 1 Processor -- start 2023-12-05T09:18:29.122 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.549+0000 7f954a95c700 1 -- start start 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.550+0000 7f954a95c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f9544111170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.550+0000 7f954a95c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95441116b0 con 0x7f95441022d0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.550+0000 7f9543fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f9544111170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.550+0000 7f9543fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f9544111170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34794/0 (socket says 172.21.15.67:34794) 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.550+0000 7f9543fff700 1 -- 172.21.15.67:0/3556746661 learned_addr learned my addr 172.21.15.67:0/3556746661 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.550+0000 7f9543fff700 1 -- 172.21.15.67:0/3556746661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95340094f0 con 0x7f95441022d0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.551+0000 7f9543fff700 1 --2- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f9544111170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f953400c010 tx=0x7f9534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.551+0000 7f9540ff9700 1 -- 172.21.15.67:0/3556746661 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9534010960 con 0x7f95441022d0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.551+0000 7f9540ff9700 1 -- 172.21.15.67:0/3556746661 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f953401a430 con 0x7f95441022d0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.551+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95441118b0 con 0x7f95441022d0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.551+0000 7f9540ff9700 1 -- 172.21.15.67:0/3556746661 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9534019580 con 0x7f95441022d0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.551+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9544111cc0 con 0x7f95441022d0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.552+0000 7f9540ff9700 1 -- 172.21.15.67:0/3556746661 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f953401a980 con 0x7f95441022d0 2023-12-05T09:18:29.123 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.552+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954404bb80 con 0x7f95441022d0 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.553+0000 7f9540ff9700 1 --2- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f952c036640 0x7f952c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.553+0000 7f9540ff9700 1 -- 172.21.15.67:0/3556746661 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f953404a590 con 0x7f95441022d0 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.553+0000 7f95437fe700 1 --2- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f952c036640 0x7f952c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.554+0000 7f95437fe700 1 --2- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f952c036640 0x7f952c038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9538009990 tx=0x7f9538006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.557+0000 7f9540ff9700 1 -- 172.21.15.67:0/3556746661 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f953402b950 con 0x7f95441022d0 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.759+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f95441040b0 con 0x7f95441022d0 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.759+0000 7f9540ff9700 1 -- 172.21.15.67:0/3556746661 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f953402b300 con 0x7f95441022d0 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f952c036640 msgr2=0x7f952c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 --2- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f952c036640 0x7f952c038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9538009990 tx=0x7f9538006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 msgr2=0x7f9544111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 --2- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f9544111170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f953400c010 tx=0x7f9534009250 comp rx=0 tx=0).stop 2023-12-05T09:18:29.124 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 shutdown_connections 2023-12-05T09:18:29.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 --2- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f952c036640 0x7f952c038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:29.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 --2- 172.21.15.67:0/3556746661 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95441022d0 0x7f9544111170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:29.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 >> 172.21.15.67:0/3556746661 conn(0x7f95440fda50 msgr2=0x7f95440ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:29.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 shutdown_connections 2023-12-05T09:18:29.125 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:28.762+0000 7f954a95c700 1 -- 172.21.15.67:0/3556746661 wait complete. 2023-12-05T09:18:29.141 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-05T09:18:29.141 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout disabled 2023-12-05T09:18:29.160 INFO:teuthology.orchestra.run.smithi067.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-05T09:18:29.160 INFO:teuthology.orchestra.run.smithi067.stdout:systemctl: stdout inactive 2023-12-05T09:18:29.160 INFO:teuthology.orchestra.run.smithi067.stdout:firewalld.service is not enabled 2023-12-05T09:18:29.160 INFO:teuthology.orchestra.run.smithi067.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-05T09:18:29.162 INFO:teuthology.orchestra.run.smithi067.stdout:Ceph Dashboard is now available at: 2023-12-05T09:18:29.162 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:29.163 INFO:teuthology.orchestra.run.smithi067.stdout: URL: https://smithi067.front.sepia.ceph.com:8443/ 2023-12-05T09:18:29.163 INFO:teuthology.orchestra.run.smithi067.stdout: User: admin 2023-12-05T09:18:29.163 INFO:teuthology.orchestra.run.smithi067.stdout: Password: f36ixgecy1 2023-12-05T09:18:29.163 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:29.164 INFO:teuthology.orchestra.run.smithi067.stdout:Saving cluster configuration to /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config directory 2023-12-05T09:18:29.164 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling autotune for osd_memory_target 2023-12-05T09:18:29.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:29 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3556746661' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-05T09:18:30.183 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.571+0000 7f7d5c3b7700 1 Processor -- start 2023-12-05T09:18:30.183 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.571+0000 7f7d5c3b7700 1 -- start start 2023-12-05T09:18:30.183 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.571+0000 7f7d5c3b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d541026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:30.183 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.571+0000 7f7d5c3b7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54102c20 con 0x7f7d541022d0 2023-12-05T09:18:30.183 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.572+0000 7f7d5a153700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d541026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:30.183 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.572+0000 7f7d5a153700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d541026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34810/0 (socket says 172.21.15.67:34810) 2023-12-05T09:18:30.183 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.572+0000 7f7d5a153700 1 -- 172.21.15.67:0/2538256520 learned_addr learned my addr 172.21.15.67:0/2538256520 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:30.183 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.572+0000 7f7d5a153700 1 -- 172.21.15.67:0/2538256520 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d54102d60 con 0x7f7d541022d0 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.573+0000 7f7d5a153700 1 --2- 172.21.15.67:0/2538256520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d541026e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d500098e0 tx=0x7f7d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ede4b960d0c634 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.573+0000 7f7d59151700 1 -- 172.21.15.67:0/2538256520 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d5000b860 con 0x7f7d541022d0 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.573+0000 7f7d59151700 1 -- 172.21.15.67:0/2538256520 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d5000be70 con 0x7f7d541022d0 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.573+0000 7f7d59151700 1 -- 172.21.15.67:0/2538256520 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d50010380 con 0x7f7d541022d0 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.573+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/2538256520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 msgr2=0x7f7d541026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.573+0000 7f7d5c3b7700 1 --2- 172.21.15.67:0/2538256520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d541026e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7d500098e0 tx=0x7f7d50009250 comp rx=0 tx=0).stop 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.574+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/2538256520 shutdown_connections 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.574+0000 7f7d5c3b7700 1 --2- 172.21.15.67:0/2538256520 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d541026e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.574+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/2538256520 >> 172.21.15.67:0/2538256520 conn(0x7f7d540fda50 msgr2=0x7f7d540ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.574+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/2538256520 shutdown_connections 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.574+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/2538256520 wait complete. 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.575+0000 7f7d5c3b7700 1 Processor -- start 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.575+0000 7f7d5c3b7700 1 -- start start 2023-12-05T09:18:30.184 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.575+0000 7f7d5c3b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d54113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.575+0000 7f7d5c3b7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d541138b0 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.575+0000 7f7d5a153700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d54113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.575+0000 7f7d5a153700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d54113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34824/0 (socket says 172.21.15.67:34824) 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.575+0000 7f7d5a153700 1 -- 172.21.15.67:0/1209894927 learned_addr learned my addr 172.21.15.67:0/1209894927 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.576+0000 7f7d5a153700 1 -- 172.21.15.67:0/1209894927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d500094f0 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.576+0000 7f7d5a153700 1 --2- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d54113370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c010 tx=0x7f7d50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.576+0000 7f7d4affd700 1 -- 172.21.15.67:0/1209894927 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d50010960 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.576+0000 7f7d4affd700 1 -- 172.21.15.67:0/1209894927 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d5001a430 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.576+0000 7f7d4affd700 1 -- 172.21.15.67:0/1209894927 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d50019580 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.576+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d54113ab0 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.576+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d54113ec0 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.577+0000 7f7d4affd700 1 -- 172.21.15.67:0/1209894927 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f7d5001a980 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.577+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5404bb80 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.578+0000 7f7d4affd700 1 --2- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f7d40036640 0x7f7d40038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.578+0000 7f7d4affd700 1 -- 172.21.15.67:0/1209894927 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7d5004a5b0 con 0x7f7d541022d0 2023-12-05T09:18:30.185 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.578+0000 7f7d59952700 1 --2- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f7d40036640 0x7f7d40038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.579+0000 7f7d59952700 1 --2- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f7d40036640 0x7f7d40038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009990 tx=0x7f7d44006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.582+0000 7f7d4affd700 1 -- 172.21.15.67:0/1209894927 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7d5002b950 con 0x7f7d541022d0 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.784+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f7d541040b0 con 0x7f7d541022d0 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.785+0000 7f7d4affd700 1 -- 172.21.15.67:0/1209894927 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f7d5002b300 con 0x7f7d541022d0 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f7d40036640 msgr2=0x7f7d40038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 --2- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f7d40036640 0x7f7d40038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009990 tx=0x7f7d44006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 msgr2=0x7f7d54113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 --2- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d54113370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c010 tx=0x7f7d50009250 comp rx=0 tx=0).stop 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 shutdown_connections 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 --2- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f7d40036640 0x7f7d40038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 --2- 172.21.15.67:0/1209894927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7d541022d0 0x7f7d54113370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 >> 172.21.15.67:0/1209894927 conn(0x7f7d540fda50 msgr2=0x7f7d540ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 shutdown_connections 2023-12-05T09:18:30.186 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:29.787+0000 7f7d5c3b7700 1 -- 172.21.15.67:0/1209894927 wait complete. 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.602+0000 7f2ecd487700 1 Processor -- start 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.602+0000 7f2ecd487700 1 -- start start 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.603+0000 7f2ecd487700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.603+0000 7f2ecd487700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec8077fe0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.603+0000 7f2ec6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.603+0000 7f2ec6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec80760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34826/0 (socket says 172.21.15.67:34826) 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.603+0000 7f2ec6ffd700 1 -- 172.21.15.67:0/294293985 learned_addr learned my addr 172.21.15.67:0/294293985 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.603+0000 7f2ec6ffd700 1 -- 172.21.15.67:0/294293985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8076620 con 0x7f2ec8077bd0 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.604+0000 7f2ec6ffd700 1 --2- 172.21.15.67:0/294293985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec80760e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80098e0 tx=0x7f2eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e2a780873c76d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:31.267 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.604+0000 7f2ec5ffb700 1 -- 172.21.15.67:0/294293985 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eb800b860 con 0x7f2ec8077bd0 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.604+0000 7f2ec5ffb700 1 -- 172.21.15.67:0/294293985 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2eb800be70 con 0x7f2ec8077bd0 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.604+0000 7f2ec5ffb700 1 -- 172.21.15.67:0/294293985 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eb8010380 con 0x7f2ec8077bd0 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.605+0000 7f2ecd487700 1 -- 172.21.15.67:0/294293985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 msgr2=0x7f2ec80760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.605+0000 7f2ecd487700 1 --2- 172.21.15.67:0/294293985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec80760e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80098e0 tx=0x7f2eb8009250 comp rx=0 tx=0).stop 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.605+0000 7f2ecd487700 1 -- 172.21.15.67:0/294293985 shutdown_connections 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.605+0000 7f2ecd487700 1 --2- 172.21.15.67:0/294293985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec80760e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.605+0000 7f2ecd487700 1 -- 172.21.15.67:0/294293985 >> 172.21.15.67:0/294293985 conn(0x7f2ec80fda50 msgr2=0x7f2ec80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.605+0000 7f2ecd487700 1 -- 172.21.15.67:0/294293985 shutdown_connections 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.605+0000 7f2ecd487700 1 -- 172.21.15.67:0/294293985 wait complete. 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.606+0000 7f2ecd487700 1 Processor -- start 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.606+0000 7f2ecd487700 1 -- start start 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.607+0000 7f2ecd487700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec8113370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.607+0000 7f2ecd487700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec81138b0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.607+0000 7f2ec6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec8113370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:31.268 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.607+0000 7f2ec6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec8113370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34842/0 (socket says 172.21.15.67:34842) 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.607+0000 7f2ec6ffd700 1 -- 172.21.15.67:0/965281632 learned_addr learned my addr 172.21.15.67:0/965281632 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.607+0000 7f2ec6ffd700 1 -- 172.21.15.67:0/965281632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80094f0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.607+0000 7f2ec6ffd700 1 --2- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec8113370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8006d40 tx=0x7f2eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.608+0000 7f2eaf7fe700 1 -- 172.21.15.67:0/965281632 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eb8010960 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.608+0000 7f2eaf7fe700 1 -- 172.21.15.67:0/965281632 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2eb801a430 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.608+0000 7f2eaf7fe700 1 -- 172.21.15.67:0/965281632 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2eb80245b0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.608+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec8113ab0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.608+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec8113ec0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.609+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec804bb80 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.609+0000 7f2eaf7fe700 1 -- 172.21.15.67:0/965281632 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f2eb801a9f0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.609+0000 7f2eaf7fe700 1 --2- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2eb0036730 0x7f2eb0038be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.609+0000 7f2eaf7fe700 1 -- 172.21.15.67:0/965281632 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2eb804a340 con 0x7f2ec8077bd0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.610+0000 7f2ec67fc700 1 --2- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2eb0036730 0x7f2eb0038be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:31.269 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.610+0000 7f2ec67fc700 1 --2- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2eb0036730 0x7f2eb0038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009990 tx=0x7f2ebc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.614+0000 7f2eaf7fe700 1 -- 172.21.15.67:0/965281632 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2eb802b8c0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.926+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f2ec8108540 con 0x7f2ec8077bd0 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.929+0000 7f2eaf7fe700 1 -- 172.21.15.67:0/965281632 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f2eb802b2f0 con 0x7f2ec8077bd0 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.931+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2eb0036730 msgr2=0x7f2eb0038be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.931+0000 7f2ecd487700 1 --2- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2eb0036730 0x7f2eb0038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009990 tx=0x7f2ebc006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.932+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 msgr2=0x7f2ec8113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.932+0000 7f2ecd487700 1 --2- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec8113370 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8006d40 tx=0x7f2eb8009250 comp rx=0 tx=0).stop 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.932+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 shutdown_connections 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.932+0000 7f2ecd487700 1 --2- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2eb0036730 0x7f2eb0038be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.932+0000 7f2ecd487700 1 --2- 172.21.15.67:0/965281632 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ec8077bd0 0x7f2ec8113370 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.932+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 >> 172.21.15.67:0/965281632 conn(0x7f2ec80fda50 msgr2=0x7f2ec80ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.932+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 shutdown_connections 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr 2023-12-05T09:18:30.932+0000 7f2ecd487700 1 -- 172.21.15.67:0/965281632 wait complete. 2023-12-05T09:18:31.270 INFO:teuthology.orchestra.run.smithi067.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout:Or, if you are only running a single cluster on this host: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: ceph telemetry on 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout:For more information see: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:31.271 INFO:teuthology.orchestra.run.smithi067.stdout:Bootstrap complete. 2023-12-05T09:18:31.323 INFO:tasks.cephadm:Fetching config... 2023-12-05T09:18:31.323 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:18:31.324 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-05T09:18:31.375 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-05T09:18:31.375 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:18:31.376 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-05T09:18:31.423 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-05T09:18:31.423 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:18:31.423 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/keyring of=/dev/stdout 2023-12-05T09:18:31.531 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:31 smithi067 ceph-mon[107174]: mgrmap e13: smithi067.alxtvv(active, since 6s) 2023-12-05T09:18:31.532 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:31 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/965281632' entity='client.admin' 2023-12-05T09:18:31.546 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-05T09:18:31.547 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:18:31.547 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-05T09:18:31.635 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-05T09:18:31.635 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ75w/973i781ZUQfJnLmAZ7xFl39mSnzBpTE7TT3OD+bfpxF9gP+LnSNP/fvyCvsEu70B02gAOBXIpf7olv0CvzwC+V5HzdTQEXc7TuFdKFVC3rWv0DWjHORDp9wQO0Pej+1l0pu6pfL0miI1ZpITVW2wh/MHzGuoJ+yL8f9PC+YAeSs5S5O5FZcscNgmOLJk7klbxlwOFbhA7XGY3w7aPrBmBzBU06NYz1DO1NJVDdPqSSyJ6aZMoCfyyEQYbxZsgTTKWkOiwzSOFnIPmn+eSyZOUKyIiTTFUvC9O4mGj1mRM1B9Rjv1+VbfaIxhuuZyvU94KnXt5O0goFWFao1Wl6/sAgkgwykxa9KbvxAW54gofu4p+yevwCnbayRCmUvQtlN4tX0zky146O9OuBtDEookeSwUrQy39LqUO7AM0/xvII/0duWO6bWoki5U6FP5WIS99FcNzr3zeS9R++VYcnY+yeA/fMoCsBmMEkcxyZR1dyTHNj/okH+mo30mwdU= ceph-f6a41352-934e-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-05T09:18:31.773 INFO:teuthology.orchestra.run.smithi067.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ75w/973i781ZUQfJnLmAZ7xFl39mSnzBpTE7TT3OD+bfpxF9gP+LnSNP/fvyCvsEu70B02gAOBXIpf7olv0CvzwC+V5HzdTQEXc7TuFdKFVC3rWv0DWjHORDp9wQO0Pej+1l0pu6pfL0miI1ZpITVW2wh/MHzGuoJ+yL8f9PC+YAeSs5S5O5FZcscNgmOLJk7klbxlwOFbhA7XGY3w7aPrBmBzBU06NYz1DO1NJVDdPqSSyJ6aZMoCfyyEQYbxZsgTTKWkOiwzSOFnIPmn+eSyZOUKyIiTTFUvC9O4mGj1mRM1B9Rjv1+VbfaIxhuuZyvU94KnXt5O0goFWFao1Wl6/sAgkgwykxa9KbvxAW54gofu4p+yevwCnbayRCmUvQtlN4tX0zky146O9OuBtDEookeSwUrQy39LqUO7AM0/xvII/0duWO6bWoki5U6FP5WIS99FcNzr3zeS9R++VYcnY+yeA/fMoCsBmMEkcxyZR1dyTHNj/okH+mo30mwdU= ceph-f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:18:31.802 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ75w/973i781ZUQfJnLmAZ7xFl39mSnzBpTE7TT3OD+bfpxF9gP+LnSNP/fvyCvsEu70B02gAOBXIpf7olv0CvzwC+V5HzdTQEXc7TuFdKFVC3rWv0DWjHORDp9wQO0Pej+1l0pu6pfL0miI1ZpITVW2wh/MHzGuoJ+yL8f9PC+YAeSs5S5O5FZcscNgmOLJk7klbxlwOFbhA7XGY3w7aPrBmBzBU06NYz1DO1NJVDdPqSSyJ6aZMoCfyyEQYbxZsgTTKWkOiwzSOFnIPmn+eSyZOUKyIiTTFUvC9O4mGj1mRM1B9Rjv1+VbfaIxhuuZyvU94KnXt5O0goFWFao1Wl6/sAgkgwykxa9KbvxAW54gofu4p+yevwCnbayRCmUvQtlN4tX0zky146O9OuBtDEookeSwUrQy39LqUO7AM0/xvII/0duWO6bWoki5U6FP5WIS99FcNzr3zeS9R++VYcnY+yeA/fMoCsBmMEkcxyZR1dyTHNj/okH+mo30mwdU= ceph-f6a41352-934e-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-05T09:18:31.908 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ75w/973i781ZUQfJnLmAZ7xFl39mSnzBpTE7TT3OD+bfpxF9gP+LnSNP/fvyCvsEu70B02gAOBXIpf7olv0CvzwC+V5HzdTQEXc7TuFdKFVC3rWv0DWjHORDp9wQO0Pej+1l0pu6pfL0miI1ZpITVW2wh/MHzGuoJ+yL8f9PC+YAeSs5S5O5FZcscNgmOLJk7klbxlwOFbhA7XGY3w7aPrBmBzBU06NYz1DO1NJVDdPqSSyJ6aZMoCfyyEQYbxZsgTTKWkOiwzSOFnIPmn+eSyZOUKyIiTTFUvC9O4mGj1mRM1B9Rjv1+VbfaIxhuuZyvU94KnXt5O0goFWFao1Wl6/sAgkgwykxa9KbvxAW54gofu4p+yevwCnbayRCmUvQtlN4tX0zky146O9OuBtDEookeSwUrQy39LqUO7AM0/xvII/0duWO6bWoki5U6FP5WIS99FcNzr3zeS9R++VYcnY+yeA/fMoCsBmMEkcxyZR1dyTHNj/okH+mo30mwdU= ceph-f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:18:31.936 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-05T09:18:32.383 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:18:33.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.821+0000 7f5df53df700 1 -- 172.21.15.67:0/477985215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 msgr2=0x7f5df0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:33.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.821+0000 7f5df53df700 1 --2- 172.21.15.67:0/477985215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 0x7f5df0070030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5de00048c0 tx=0x7f5de0009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:33.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.821+0000 7f5df53df700 1 -- 172.21.15.67:0/477985215 shutdown_connections 2023-12-05T09:18:33.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.821+0000 7f5df53df700 1 --2- 172.21.15.67:0/477985215 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 0x7f5df0070030 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:33.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.821+0000 7f5df53df700 1 -- 172.21.15.67:0/477985215 >> 172.21.15.67:0/477985215 conn(0x7f5df00f7f50 msgr2=0x7f5df00fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:33.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.821+0000 7f5df53df700 1 -- 172.21.15.67:0/477985215 shutdown_connections 2023-12-05T09:18:33.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.821+0000 7f5df53df700 1 -- 172.21.15.67:0/477985215 wait complete. 2023-12-05T09:18:33.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.822+0000 7f5df53df700 1 Processor -- start 2023-12-05T09:18:33.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.822+0000 7f5df53df700 1 -- start start 2023-12-05T09:18:33.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.822+0000 7f5df53df700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 0x7f5df0113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:33.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.822+0000 7f5df53df700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df0113580 con 0x7f5df0071bc0 2023-12-05T09:18:33.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.822+0000 7f5deeffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 0x7f5df0113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:33.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.823+0000 7f5deeffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 0x7f5df0113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:34852/0 (socket says 172.21.15.67:34852) 2023-12-05T09:18:33.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.823+0000 7f5deeffd700 1 -- 172.21.15.67:0/1350620995 learned_addr learned my addr 172.21.15.67:0/1350620995 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:33.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.823+0000 7f5deeffd700 1 -- 172.21.15.67:0/1350620995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de0005040 con 0x7f5df0071bc0 2023-12-05T09:18:33.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.823+0000 7f5deeffd700 1 --2- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 0x7f5df0113040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009040 tx=0x7f5de0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:33.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.823+0000 7f5dd77fe700 1 -- 172.21.15.67:0/1350620995 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5de0009620 con 0x7f5df0071bc0 2023-12-05T09:18:33.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.823+0000 7f5dd77fe700 1 -- 172.21.15.67:0/1350620995 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5de0009780 con 0x7f5df0071bc0 2023-12-05T09:18:33.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.823+0000 7f5dd77fe700 1 -- 172.21.15.67:0/1350620995 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5de001c5b0 con 0x7f5df0071bc0 2023-12-05T09:18:33.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.823+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df0113780 con 0x7f5df0071bc0 2023-12-05T09:18:33.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.824+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df0114420 con 0x7f5df0071bc0 2023-12-05T09:18:33.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.825+0000 7f5dd77fe700 1 -- 172.21.15.67:0/1350620995 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f5de0013a60 con 0x7f5df0071bc0 2023-12-05T09:18:33.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.825+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df005f270 con 0x7f5df0071bc0 2023-12-05T09:18:33.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.825+0000 7f5dd77fe700 1 --2- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f5dd80366d0 0x7f5dd8038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:33.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.825+0000 7f5dd77fe700 1 -- 172.21.15.67:0/1350620995 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5de0049900 con 0x7f5df0071bc0 2023-12-05T09:18:33.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.826+0000 7f5dee7fc700 1 --2- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f5dd80366d0 0x7f5dd8038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:33.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.826+0000 7f5dee7fc700 1 --2- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f5dd80366d0 0x7f5dd8038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009990 tx=0x7f5de4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:33.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:33.830+0000 7f5dd77fe700 1 -- 172.21.15.67:0/1350620995 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5de00119c0 con 0x7f5df0071bc0 2023-12-05T09:18:34.040 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.037+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f5df0115000 con 0x7f5df0071bc0 2023-12-05T09:18:34.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.041+0000 7f5dd77fe700 1 -- 172.21.15.67:0/1350620995 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5de0011370 con 0x7f5df0071bc0 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f5dd80366d0 msgr2=0x7f5dd8038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 --2- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f5dd80366d0 0x7f5dd8038b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009990 tx=0x7f5de4006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 msgr2=0x7f5df0113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 --2- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 0x7f5df0113040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009040 tx=0x7f5de0009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 shutdown_connections 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 --2- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f5dd80366d0 0x7f5dd8038b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 --2- 172.21.15.67:0/1350620995 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5df0071bc0 0x7f5df0113040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 >> 172.21.15.67:0/1350620995 conn(0x7f5df00f7f50 msgr2=0x7f5df00f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.043+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 shutdown_connections 2023-12-05T09:18:34.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:34.044+0000 7f5df53df700 1 -- 172.21.15.67:0/1350620995 wait complete. 2023-12-05T09:18:34.457 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-05T09:18:34.598 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-05T09:18:35.069 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:18:35.292 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:35 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1350620995' entity='client.admin' 2023-12-05T09:18:36.498 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:36 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:36.498 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:36 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:36.498 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:36 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:18:36.498 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:36 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:36.499 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:36 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:18:36.499 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:36 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T09:18:36.499 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:36 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:18:36.499 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:36 smithi067 ceph-mon[107174]: Deploying daemon crash.smithi067 on smithi067 2023-12-05T09:18:36.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.519+0000 7f004b6b2700 1 -- 172.21.15.67:0/393732651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 msgr2=0x7f0044070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.519+0000 7f004b6b2700 1 --2- 172.21.15.67:0/393732651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 0x7f0044070030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f00400048c0 tx=0x7f0040009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.519+0000 7f004b6b2700 1 -- 172.21.15.67:0/393732651 shutdown_connections 2023-12-05T09:18:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.519+0000 7f004b6b2700 1 --2- 172.21.15.67:0/393732651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 0x7f0044070030 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.519+0000 7f004b6b2700 1 -- 172.21.15.67:0/393732651 >> 172.21.15.67:0/393732651 conn(0x7f00440f7f50 msgr2=0x7f00440fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.519+0000 7f004b6b2700 1 -- 172.21.15.67:0/393732651 shutdown_connections 2023-12-05T09:18:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.519+0000 7f004b6b2700 1 -- 172.21.15.67:0/393732651 wait complete. 2023-12-05T09:18:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.520+0000 7f004b6b2700 1 Processor -- start 2023-12-05T09:18:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.520+0000 7f004b6b2700 1 -- start start 2023-12-05T09:18:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.520+0000 7f004b6b2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 0x7f004410ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.520+0000 7f004b6b2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004410f250 con 0x7f0044071bc0 2023-12-05T09:18:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.521+0000 7f004944e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 0x7f004410ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.521+0000 7f004944e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 0x7f004410ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45838/0 (socket says 172.21.15.67:45838) 2023-12-05T09:18:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.521+0000 7f004944e700 1 -- 172.21.15.67:0/2777766756 learned_addr learned my addr 172.21.15.67:0/2777766756 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.521+0000 7f004944e700 1 -- 172.21.15.67:0/2777766756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040005040 con 0x7f0044071bc0 2023-12-05T09:18:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.521+0000 7f004944e700 1 --2- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 0x7f004410ed10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f004000b690 tx=0x7f0040009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.522+0000 7f0039ffb700 1 -- 172.21.15.67:0/2777766756 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0040009650 con 0x7f0044071bc0 2023-12-05T09:18:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.522+0000 7f0039ffb700 1 -- 172.21.15.67:0/2777766756 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f00400097b0 con 0x7f0044071bc0 2023-12-05T09:18:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.522+0000 7f0039ffb700 1 -- 172.21.15.67:0/2777766756 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f004001c5b0 con 0x7f0044071bc0 2023-12-05T09:18:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.522+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004410f450 con 0x7f0044071bc0 2023-12-05T09:18:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.522+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004410ffb0 con 0x7f0044071bc0 2023-12-05T09:18:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.523+0000 7f0039ffb700 1 -- 172.21.15.67:0/2777766756 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f0040013a60 con 0x7f0044071bc0 2023-12-05T09:18:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.523+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004404bb80 con 0x7f0044071bc0 2023-12-05T09:18:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.523+0000 7f0039ffb700 1 --2- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0030036720 0x7f0030038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.523+0000 7f0039ffb700 1 -- 172.21.15.67:0/2777766756 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0040049830 con 0x7f0044071bc0 2023-12-05T09:18:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.524+0000 7f0048c4d700 1 --2- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0030036720 0x7f0030038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.524+0000 7f0048c4d700 1 --2- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0030036720 0x7f0030038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0034009990 tx=0x7f0034006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.528+0000 7f0039ffb700 1 -- 172.21.15.67:0/2777766756 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0040011550 con 0x7f0044071bc0 2023-12-05T09:18:36.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.749+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 --> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f0044110140 con 0x7f0030036720 2023-12-05T09:18:36.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.755+0000 7f0039ffb700 1 -- 172.21.15.67:0/2777766756 <== mgr.14164 v2:172.21.15.67:6800/434315882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0044110140 con 0x7f0030036720 2023-12-05T09:18:36.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0030036720 msgr2=0x7f0030038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:36.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 --2- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0030036720 0x7f0030038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0034009990 tx=0x7f0034006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:36.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 msgr2=0x7f004410ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:36.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 --2- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 0x7f004410ed10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f004000b690 tx=0x7f0040009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:36.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 shutdown_connections 2023-12-05T09:18:36.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 --2- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0030036720 0x7f0030038bd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:36.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 --2- 172.21.15.67:0/2777766756 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0044071bc0 0x7f004410ed10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:36.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 >> 172.21.15.67:0/2777766756 conn(0x7f00440f7f50 msgr2=0x7f00440f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:36.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 shutdown_connections 2023-12-05T09:18:36.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:36.758+0000 7f004b6b2700 1 -- 172.21.15.67:0/2777766756 wait complete. 2023-12-05T09:18:37.433 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2023-12-05T09:18:37.434 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:18:37.434 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2023-12-05T09:18:37.485 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:18:37.485 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:18:37.573 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2023-12-05T09:18:37.573 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch host add smithi134 2023-12-05T09:18:37.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:37 smithi067 ceph-mon[107174]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:37.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:37 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:18:39.358 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:39 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:39.359 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:39 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:39.359 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:39 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:39.359 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:39 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:39.359 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:39 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:39.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.826+0000 7ffa48b8a700 1 -- 172.21.15.67:0/2327304166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 msgr2=0x7ffa44070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:39.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.826+0000 7ffa48b8a700 1 --2- 172.21.15.67:0/2327304166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 0x7ffa44070030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffa340048c0 tx=0x7ffa34009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:39.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.826+0000 7ffa48b8a700 1 -- 172.21.15.67:0/2327304166 shutdown_connections 2023-12-05T09:18:39.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.826+0000 7ffa48b8a700 1 --2- 172.21.15.67:0/2327304166 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 0x7ffa44070030 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:39.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.826+0000 7ffa48b8a700 1 -- 172.21.15.67:0/2327304166 >> 172.21.15.67:0/2327304166 conn(0x7ffa440f7f50 msgr2=0x7ffa440fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:39.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.826+0000 7ffa48b8a700 1 -- 172.21.15.67:0/2327304166 shutdown_connections 2023-12-05T09:18:39.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.826+0000 7ffa48b8a700 1 -- 172.21.15.67:0/2327304166 wait complete. 2023-12-05T09:18:39.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.827+0000 7ffa48b8a700 1 Processor -- start 2023-12-05T09:18:39.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.827+0000 7ffa48b8a700 1 -- start start 2023-12-05T09:18:39.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.828+0000 7ffa48b8a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 0x7ffa44113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:39.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.828+0000 7ffa48b8a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa44113580 con 0x7ffa44071bc0 2023-12-05T09:18:39.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.828+0000 7ffa4259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 0x7ffa44113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:39.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.828+0000 7ffa4259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 0x7ffa44113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45858/0 (socket says 172.21.15.67:45858) 2023-12-05T09:18:39.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.828+0000 7ffa4259c700 1 -- 172.21.15.67:0/3570494720 learned_addr learned my addr 172.21.15.67:0/3570494720 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:39.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.828+0000 7ffa4259c700 1 -- 172.21.15.67:0/3570494720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34005040 con 0x7ffa44071bc0 2023-12-05T09:18:39.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.829+0000 7ffa4259c700 1 --2- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 0x7ffa44113040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009040 tx=0x7ffa34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:39.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.829+0000 7ffa32ffd700 1 -- 172.21.15.67:0/3570494720 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa34009620 con 0x7ffa44071bc0 2023-12-05T09:18:39.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.829+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa44113780 con 0x7ffa44071bc0 2023-12-05T09:18:39.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.829+0000 7ffa32ffd700 1 -- 172.21.15.67:0/3570494720 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa34009780 con 0x7ffa44071bc0 2023-12-05T09:18:39.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.829+0000 7ffa32ffd700 1 -- 172.21.15.67:0/3570494720 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa3401c5b0 con 0x7ffa44071bc0 2023-12-05T09:18:39.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.829+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa44114420 con 0x7ffa44071bc0 2023-12-05T09:18:39.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.830+0000 7ffa32ffd700 1 -- 172.21.15.67:0/3570494720 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7ffa3401c870 con 0x7ffa44071bc0 2023-12-05T09:18:39.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.831+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4405f270 con 0x7ffa44071bc0 2023-12-05T09:18:39.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.831+0000 7ffa32ffd700 1 --2- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ffa2c0366d0 0x7ffa2c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:39.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.831+0000 7ffa32ffd700 1 -- 172.21.15.67:0/3570494720 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffa340498f0 con 0x7ffa44071bc0 2023-12-05T09:18:39.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.831+0000 7ffa41d9b700 1 --2- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ffa2c0366d0 0x7ffa2c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:39.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.832+0000 7ffa41d9b700 1 --2- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ffa2c0366d0 0x7ffa2c038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009990 tx=0x7ffa38006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:39.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:39.836+0000 7ffa32ffd700 1 -- 172.21.15.67:0/3570494720 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffa34023300 con 0x7ffa44071bc0 2023-12-05T09:18:40.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:40.079+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 --> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa44115000 con 0x7ffa2c0366d0 2023-12-05T09:18:40.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:40 smithi067 ceph-mon[107174]: Deploying daemon node-exporter.smithi067 on smithi067 2023-12-05T09:18:41.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:41 smithi067 ceph-mon[107174]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:42.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:42 smithi067 ceph-mon[107174]: Deploying cephadm binary to smithi134 2023-12-05T09:18:42.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.808+0000 7ffa32ffd700 1 -- 172.21.15.67:0/3570494720 <== mgr.14164 v2:172.21.15.67:6800/434315882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ffa44115000 con 0x7ffa2c0366d0 2023-12-05T09:18:42.811 INFO:teuthology.orchestra.run.smithi067.stdout:Added host 'smithi134' with addr '172.21.15.134' 2023-12-05T09:18:42.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ffa2c0366d0 msgr2=0x7ffa2c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:42.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 --2- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ffa2c0366d0 0x7ffa2c038b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009990 tx=0x7ffa38006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 msgr2=0x7ffa44113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 --2- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 0x7ffa44113040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009040 tx=0x7ffa34009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 shutdown_connections 2023-12-05T09:18:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 --2- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ffa2c0366d0 0x7ffa2c038b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 --2- 172.21.15.67:0/3570494720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa44071bc0 0x7ffa44113040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 >> 172.21.15.67:0/3570494720 conn(0x7ffa440f7f50 msgr2=0x7ffa440f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 shutdown_connections 2023-12-05T09:18:42.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:42.810+0000 7ffa48b8a700 1 -- 172.21.15.67:0/3570494720 wait complete. 2023-12-05T09:18:43.143 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch host ls --format=json 2023-12-05T09:18:43.587 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:18:44.090 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:43 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:44.090 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:43 smithi067 ceph-mon[107174]: Added host smithi134 2023-12-05T09:18:44.090 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:43 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:44.090 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:43 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:44.090 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:43 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:44.091 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:43 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:44.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.754+0000 7fd283ec3700 1 -- 172.21.15.67:0/922684282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 msgr2=0x7fd27c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:44.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.754+0000 7fd283ec3700 1 --2- 172.21.15.67:0/922684282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 0x7fd27c0fcc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd2780048c0 tx=0x7fd278009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:44.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.755+0000 7fd283ec3700 1 -- 172.21.15.67:0/922684282 shutdown_connections 2023-12-05T09:18:44.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.755+0000 7fd283ec3700 1 --2- 172.21.15.67:0/922684282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 0x7fd27c0fcc80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:44.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.755+0000 7fd283ec3700 1 -- 172.21.15.67:0/922684282 >> 172.21.15.67:0/922684282 conn(0x7fd27c0f7f50 msgr2=0x7fd27c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:44.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.755+0000 7fd283ec3700 1 -- 172.21.15.67:0/922684282 shutdown_connections 2023-12-05T09:18:44.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.755+0000 7fd283ec3700 1 -- 172.21.15.67:0/922684282 wait complete. 2023-12-05T09:18:44.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.756+0000 7fd283ec3700 1 Processor -- start 2023-12-05T09:18:44.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.756+0000 7fd283ec3700 1 -- start start 2023-12-05T09:18:44.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.756+0000 7fd283ec3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 0x7fd27c10ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:44.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.756+0000 7fd283ec3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c10cfd0 con 0x7fd27c0fc870 2023-12-05T09:18:44.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.756+0000 7fd281c5f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 0x7fd27c10ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:44.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.756+0000 7fd281c5f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 0x7fd27c10ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45882/0 (socket says 172.21.15.67:45882) 2023-12-05T09:18:44.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.756+0000 7fd281c5f700 1 -- 172.21.15.67:0/4292383473 learned_addr learned my addr 172.21.15.67:0/4292383473 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:44.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.757+0000 7fd281c5f700 1 -- 172.21.15.67:0/4292383473 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278005040 con 0x7fd27c0fc870 2023-12-05T09:18:44.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.757+0000 7fd281c5f700 1 --2- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 0x7fd27c10ca90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd27800b690 tx=0x7fd278009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:44.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.757+0000 7fd2727fc700 1 -- 172.21.15.67:0/4292383473 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd278009650 con 0x7fd27c0fc870 2023-12-05T09:18:44.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.757+0000 7fd2727fc700 1 -- 172.21.15.67:0/4292383473 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2780097b0 con 0x7fd27c0fc870 2023-12-05T09:18:44.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.757+0000 7fd2727fc700 1 -- 172.21.15.67:0/4292383473 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd27801c5d0 con 0x7fd27c0fc870 2023-12-05T09:18:44.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.758+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c10d1d0 con 0x7fd27c0fc870 2023-12-05T09:18:44.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.758+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c10de70 con 0x7fd27c0fc870 2023-12-05T09:18:44.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.759+0000 7fd2727fc700 1 -- 172.21.15.67:0/4292383473 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fd2780139d0 con 0x7fd27c0fc870 2023-12-05T09:18:44.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.759+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c05f270 con 0x7fd27c0fc870 2023-12-05T09:18:44.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.759+0000 7fd2727fc700 1 --2- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fd2680366d0 0x7fd268038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:44.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.759+0000 7fd2727fc700 1 -- 172.21.15.67:0/4292383473 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd278049370 con 0x7fd27c0fc870 2023-12-05T09:18:44.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.760+0000 7fd28145e700 1 --2- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fd2680366d0 0x7fd268038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:44.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.760+0000 7fd28145e700 1 --2- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fd2680366d0 0x7fd268038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009990 tx=0x7fd26c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:44.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:44.765+0000 7fd2727fc700 1 -- 172.21.15.67:0/4292383473 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd27801bbc0 con 0x7fd27c0fc870 2023-12-05T09:18:45.039 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.037+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 --> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd27c10ea00 con 0x7fd2680366d0 2023-12-05T09:18:45.040 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.038+0000 7fd2727fc700 1 -- 172.21.15.67:0/4292383473 <== mgr.14164 v2:172.21.15.67:6800/434315882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fd27c10ea00 con 0x7fd2680366d0 2023-12-05T09:18:45.041 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:18:45.041 INFO:teuthology.orchestra.run.smithi067.stdout:[{"addr": "172.21.15.67", "hostname": "smithi067", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2023-12-05T09:18:45.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.041+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fd2680366d0 msgr2=0x7fd268038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:45.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.041+0000 7fd283ec3700 1 --2- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fd2680366d0 0x7fd268038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009990 tx=0x7fd26c006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:45.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.041+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 msgr2=0x7fd27c10ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:45.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.041+0000 7fd283ec3700 1 --2- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 0x7fd27c10ca90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd27800b690 tx=0x7fd278009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:45.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.042+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 shutdown_connections 2023-12-05T09:18:45.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.042+0000 7fd283ec3700 1 --2- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fd2680366d0 0x7fd268038b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:45.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.042+0000 7fd283ec3700 1 --2- 172.21.15.67:0/4292383473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd27c0fc870 0x7fd27c10ca90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:45.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.042+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 >> 172.21.15.67:0/4292383473 conn(0x7fd27c0f7f50 msgr2=0x7fd27c0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:45.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.042+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 shutdown_connections 2023-12-05T09:18:45.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:45.042+0000 7fd283ec3700 1 -- 172.21.15.67:0/4292383473 wait complete. 2023-12-05T09:18:45.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:44 smithi067 ceph-mon[107174]: Deploying daemon alertmanager.smithi067 on smithi067 2023-12-05T09:18:45.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:44 smithi067 ceph-mon[107174]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:18:45.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:44 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:46.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:45 smithi067 ceph-mon[107174]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:18:46.688 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-05T09:18:46.688 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd crush tunables default 2023-12-05T09:18:47.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:46 smithi067 ceph-mon[107174]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:18:47.376 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:18:48.981 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:48 smithi067 ceph-mon[107174]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:18:49.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.079+0000 7f66fcb47700 1 -- 172.21.15.67:0/3024503207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 msgr2=0x7f66f806ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.079+0000 7f66fcb47700 1 --2- 172.21.15.67:0/3024503207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 0x7f66f806ffb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f66e80048c0 tx=0x7f66e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.079+0000 7f66fcb47700 1 -- 172.21.15.67:0/3024503207 shutdown_connections 2023-12-05T09:18:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.079+0000 7f66fcb47700 1 --2- 172.21.15.67:0/3024503207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 0x7f66f806ffb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.079+0000 7f66fcb47700 1 -- 172.21.15.67:0/3024503207 >> 172.21.15.67:0/3024503207 conn(0x7f66f80f7f50 msgr2=0x7f66f80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.079+0000 7f66fcb47700 1 -- 172.21.15.67:0/3024503207 shutdown_connections 2023-12-05T09:18:49.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.079+0000 7f66fcb47700 1 -- 172.21.15.67:0/3024503207 wait complete. 2023-12-05T09:18:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.080+0000 7f66fcb47700 1 Processor -- start 2023-12-05T09:18:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.080+0000 7f66fcb47700 1 -- start start 2023-12-05T09:18:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.080+0000 7f66fcb47700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 0x7f66f810ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.080+0000 7f66fcb47700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f810f240 con 0x7f66f8071b40 2023-12-05T09:18:49.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.081+0000 7f66f659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 0x7f66f810ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.081+0000 7f66f659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 0x7f66f810ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52252/0 (socket says 172.21.15.67:52252) 2023-12-05T09:18:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.081+0000 7f66f659c700 1 -- 172.21.15.67:0/1966899656 learned_addr learned my addr 172.21.15.67:0/1966899656 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:18:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.081+0000 7f66f659c700 1 -- 172.21.15.67:0/1966899656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8005040 con 0x7f66f8071b40 2023-12-05T09:18:49.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.081+0000 7f66f659c700 1 --2- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 0x7f66f810ed00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009040 tx=0x7f66e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.081+0000 7f66e6ffd700 1 -- 172.21.15.67:0/1966899656 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e8009620 con 0x7f66f8071b40 2023-12-05T09:18:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.082+0000 7f66e6ffd700 1 -- 172.21.15.67:0/1966899656 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66e8009780 con 0x7f66f8071b40 2023-12-05T09:18:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.082+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f810f440 con 0x7f66f8071b40 2023-12-05T09:18:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.082+0000 7f66e6ffd700 1 -- 172.21.15.67:0/1966899656 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66e801c5b0 con 0x7f66f8071b40 2023-12-05T09:18:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.082+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f810ffa0 con 0x7f66f8071b40 2023-12-05T09:18:49.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.083+0000 7f66e6ffd700 1 -- 172.21.15.67:0/1966899656 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f66e8013a60 con 0x7f66f8071b40 2023-12-05T09:18:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.083+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f805f270 con 0x7f66f8071b40 2023-12-05T09:18:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.083+0000 7f66e6ffd700 1 --2- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f66e0036720 0x7f66e0038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.083+0000 7f66e6ffd700 1 -- 172.21.15.67:0/1966899656 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f66e8049880 con 0x7f66f8071b40 2023-12-05T09:18:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.083+0000 7f66f5d9b700 1 --2- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f66e0036720 0x7f66e0038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:49.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.084+0000 7f66f5d9b700 1 --2- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f66e0036720 0x7f66e0038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009990 tx=0x7f66ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:49.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.088+0000 7f66e6ffd700 1 -- 172.21.15.67:0/1966899656 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f66e8011dd0 con 0x7f66f8071b40 2023-12-05T09:18:49.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.311+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f66f804bb80 con 0x7f66f8071b40 2023-12-05T09:18:49.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.976+0000 7f66e6ffd700 1 -- 172.21.15.67:0/1966899656 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f66e8011370 con 0x7f66f8071b40 2023-12-05T09:18:49.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f66e0036720 msgr2=0x7f66e0038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:49.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 --2- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f66e0036720 0x7f66e0038bd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009990 tx=0x7f66ec006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:49.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 msgr2=0x7f66f810ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:49.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 --2- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 0x7f66f810ed00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009040 tx=0x7f66e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:49.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 shutdown_connections 2023-12-05T09:18:49.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 --2- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f66e0036720 0x7f66e0038bd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:49.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 --2- 172.21.15.67:0/1966899656 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66f8071b40 0x7f66f810ed00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:49.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 >> 172.21.15.67:0/1966899656 conn(0x7f66f80f7f50 msgr2=0x7f66f80f8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:49.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 shutdown_connections 2023-12-05T09:18:49.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:18:49.979+0000 7f66fcb47700 1 -- 172.21.15.67:0/1966899656 wait complete. 2023-12-05T09:18:49.982 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2023-12-05T09:18:50.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:49 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1966899656' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-05T09:18:50.354 INFO:tasks.cephadm:Adding mon.smithi067 on smithi067 2023-12-05T09:18:50.354 INFO:tasks.cephadm:Adding mon.smithi134 on smithi134 2023-12-05T09:18:50.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch apply mon '2;smithi067:172.21.15.67=smithi067;smithi134:172.21.15.134=smithi134' 2023-12-05T09:18:50.764 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:18:50.853 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:18:51.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:50 smithi067 ceph-mon[107174]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:18:51.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:50 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1966899656' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-05T09:18:51.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:50 smithi067 ceph-mon[107174]: osdmap e4: 0 total, 0 up, 0 in 2023-12-05T09:18:51.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:50 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:51.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:50 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:51.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:50 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:51.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:50 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:52.214 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.212+0000 7f676006c700 1 -- 172.21.15.134:0/1766670253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 msgr2=0x7f67580fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:52.215 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.212+0000 7f676006c700 1 --2- 172.21.15.134:0/1766670253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 0x7f67580fcc80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f67540048c0 tx=0x7f6754009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:52.215 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.212+0000 7f676006c700 1 -- 172.21.15.134:0/1766670253 shutdown_connections 2023-12-05T09:18:52.215 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.212+0000 7f676006c700 1 --2- 172.21.15.134:0/1766670253 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 0x7f67580fcc80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:52.215 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.212+0000 7f676006c700 1 -- 172.21.15.134:0/1766670253 >> 172.21.15.134:0/1766670253 conn(0x7f67580f7f50 msgr2=0x7f67580fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:52.215 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.212+0000 7f676006c700 1 -- 172.21.15.134:0/1766670253 shutdown_connections 2023-12-05T09:18:52.215 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.212+0000 7f676006c700 1 -- 172.21.15.134:0/1766670253 wait complete. 2023-12-05T09:18:52.215 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.213+0000 7f676006c700 1 Processor -- start 2023-12-05T09:18:52.215 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.213+0000 7f676006c700 1 -- start start 2023-12-05T09:18:52.216 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.213+0000 7f676006c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 0x7f675810ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:52.216 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.213+0000 7f676006c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675810f270 con 0x7f67580fc870 2023-12-05T09:18:52.216 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.214+0000 7f675de08700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 0x7f675810ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.214+0000 7f675de08700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 0x7f675810ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:40184/0 (socket says 172.21.15.134:40184) 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.214+0000 7f675de08700 1 -- 172.21.15.134:0/947488283 learned_addr learned my addr 172.21.15.134:0/947488283 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.214+0000 7f675de08700 1 -- 172.21.15.134:0/947488283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754005040 con 0x7f67580fc870 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.214+0000 7f675de08700 1 --2- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 0x7f675810ed30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f675400b690 tx=0x7f6754009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.215+0000 7f674e7fc700 1 -- 172.21.15.134:0/947488283 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6754009650 con 0x7f67580fc870 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.215+0000 7f674e7fc700 1 -- 172.21.15.134:0/947488283 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f67540097b0 con 0x7f67580fc870 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.215+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675810f470 con 0x7f67580fc870 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.215+0000 7f674e7fc700 1 -- 172.21.15.134:0/947488283 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f675401c5d0 con 0x7f67580fc870 2023-12-05T09:18:52.217 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.215+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675810ffd0 con 0x7f67580fc870 2023-12-05T09:18:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.216+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675804bb80 con 0x7f67580fc870 2023-12-05T09:18:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.216+0000 7f674e7fc700 1 -- 172.21.15.134:0/947488283 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f67540139d0 con 0x7f67580fc870 2023-12-05T09:18:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.216+0000 7f674e7fc700 1 --2- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f67440366d0 0x7f6744038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.216+0000 7f674e7fc700 1 -- 172.21.15.134:0/947488283 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6754049a20 con 0x7f67580fc870 2023-12-05T09:18:52.218 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.217+0000 7f675d607700 1 --2- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f67440366d0 0x7f6744038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:52.219 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.217+0000 7f675d607700 1 --2- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f67440366d0 0x7f6744038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6748009990 tx=0x7f6748006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:52.223 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.222+0000 7f674e7fc700 1 -- 172.21.15.134:0/947488283 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6754025400 con 0x7f67580fc870 2023-12-05T09:18:52.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:52 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:52.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:52 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:52.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:52 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T09:18:52.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:52 smithi067 ceph-mon[107174]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T09:18:52.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:52 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:52.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:52 smithi067 ceph-mon[107174]: Deploying daemon grafana.smithi067 on smithi067 2023-12-05T09:18:52.424 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.422+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 --> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi067:172.21.15.67=smithi067;smithi134:172.21.15.134=smithi134", "target": ["mon-mgr", ""]}) v1 -- 0x7f67580705c0 con 0x7f67440366d0 2023-12-05T09:18:52.431 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.429+0000 7f674e7fc700 1 -- 172.21.15.134:0/947488283 <== mgr.14164 v2:172.21.15.67:6800/434315882 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f67580705c0 con 0x7f67440366d0 2023-12-05T09:18:52.431 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mon update... 2023-12-05T09:18:52.433 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f67440366d0 msgr2=0x7f6744038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:52.433 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 --2- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f67440366d0 0x7f6744038b80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6748009990 tx=0x7f6748006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:52.433 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 msgr2=0x7f675810ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:52.433 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 --2- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 0x7f675810ed30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f675400b690 tx=0x7f6754009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:52.433 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 shutdown_connections 2023-12-05T09:18:52.433 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 --2- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f67440366d0 0x7f6744038b80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:52.433 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 --2- 172.21.15.134:0/947488283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f67580fc870 0x7f675810ed30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:52.434 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 >> 172.21.15.134:0/947488283 conn(0x7f67580f7f50 msgr2=0x7f675806feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:52.434 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 shutdown_connections 2023-12-05T09:18:52.434 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:52.431+0000 7f676006c700 1 -- 172.21.15.134:0/947488283 wait complete. 2023-12-05T09:18:52.817 DEBUG:teuthology.orchestra.run.smithi134:mon.smithi134> sudo journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi134.service 2023-12-05T09:18:52.822 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:18:52.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:18:52.893 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:-- Logs begin at Tue 2023-12-05 08:57:58 UTC. -- 2023-12-05T09:18:53.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:53 smithi067 ceph-mon[107174]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:18:53.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:53 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:53.254 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:18:53.342 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:18:54.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:54 smithi067 ceph-mon[107174]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi067:172.21.15.67=smithi067;smithi134:172.21.15.134=smithi134", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:18:54.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:54 smithi067 ceph-mon[107174]: Saving service mon spec with placement smithi067:172.21.15.67=smithi067;smithi134:172.21.15.134=smithi134;count:2 2023-12-05T09:18:54.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:54 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:18:54.441 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.439+0000 7fcff4110700 1 -- 172.21.15.134:0/1629382302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 msgr2=0x7fcfec0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:54.441 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.439+0000 7fcff4110700 1 --2- 172.21.15.134:0/1629382302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 0x7fcfec0fcc80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80048c0 tx=0x7fcfe8009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:54.441 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.439+0000 7fcff4110700 1 -- 172.21.15.134:0/1629382302 shutdown_connections 2023-12-05T09:18:54.441 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.439+0000 7fcff4110700 1 --2- 172.21.15.134:0/1629382302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 0x7fcfec0fcc80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:54.441 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.439+0000 7fcff4110700 1 -- 172.21.15.134:0/1629382302 >> 172.21.15.134:0/1629382302 conn(0x7fcfec0f7f50 msgr2=0x7fcfec0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:54.441 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.439+0000 7fcff4110700 1 -- 172.21.15.134:0/1629382302 shutdown_connections 2023-12-05T09:18:54.441 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.439+0000 7fcff4110700 1 -- 172.21.15.134:0/1629382302 wait complete. 2023-12-05T09:18:54.442 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.440+0000 7fcff4110700 1 Processor -- start 2023-12-05T09:18:54.442 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.440+0000 7fcff4110700 1 -- start start 2023-12-05T09:18:54.443 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.440+0000 7fcff4110700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 0x7fcfec071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:54.443 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.440+0000 7fcff4110700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec06ff90 con 0x7fcfec0fc870 2023-12-05T09:18:54.443 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.441+0000 7fcff1eac700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 0x7fcfec071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:54.443 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.441+0000 7fcff1eac700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 0x7fcfec071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:40212/0 (socket says 172.21.15.134:40212) 2023-12-05T09:18:54.443 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.441+0000 7fcff1eac700 1 -- 172.21.15.134:0/2137712920 learned_addr learned my addr 172.21.15.134:0/2137712920 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:18:54.443 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.441+0000 7fcff1eac700 1 -- 172.21.15.134:0/2137712920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe8005040 con 0x7fcfec0fc870 2023-12-05T09:18:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.441+0000 7fcff1eac700 1 --2- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 0x7fcfec071b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009330 tx=0x7fcfe8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.441+0000 7fcfe27fc700 1 -- 172.21.15.134:0/2137712920 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe80096b0 con 0x7fcfec0fc870 2023-12-05T09:18:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.441+0000 7fcfe27fc700 1 -- 172.21.15.134:0/2137712920 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcfe8009810 con 0x7fcfec0fc870 2023-12-05T09:18:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.441+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec070190 con 0x7fcfec0fc870 2023-12-05T09:18:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.442+0000 7fcfe27fc700 1 -- 172.21.15.134:0/2137712920 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfe801c5b0 con 0x7fcfec0fc870 2023-12-05T09:18:54.444 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.442+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec070680 con 0x7fcfec0fc870 2023-12-05T09:18:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.443+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec106500 con 0x7fcfec0fc870 2023-12-05T09:18:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.443+0000 7fcfe27fc700 1 -- 172.21.15.134:0/2137712920 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fcfe8013420 con 0x7fcfec0fc870 2023-12-05T09:18:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.443+0000 7fcfe27fc700 1 --2- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fcfd8036720 0x7fcfd8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.443+0000 7fcfe27fc700 1 -- 172.21.15.134:0/2137712920 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcfe8049a70 con 0x7fcfec0fc870 2023-12-05T09:18:54.445 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.443+0000 7fcff16ab700 1 --2- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fcfd8036720 0x7fcfd8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:54.446 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.444+0000 7fcff16ab700 1 --2- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fcfd8036720 0x7fcfd8038bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009990 tx=0x7fcfdc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:54.455 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.452+0000 7fcfe27fc700 1 -- 172.21.15.134:0/2137712920 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcfe8011db0 con 0x7fcfec0fc870 2023-12-05T09:18:54.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.726+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcfec04bb80 con 0x7fcfec0fc870 2023-12-05T09:18:54.728 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.726+0000 7fcfe27fc700 1 -- 172.21.15.134:0/2137712920 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fcfe8011370 con 0x7fcfec0fc870 2023-12-05T09:18:54.728 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:18:54.728 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:18:54.730 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fcfd8036720 msgr2=0x7fcfd8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 --2- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fcfd8036720 0x7fcfd8038bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009990 tx=0x7fcfdc006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 msgr2=0x7fcfec071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 --2- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 0x7fcfec071b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009330 tx=0x7fcfe8009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 shutdown_connections 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 --2- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fcfd8036720 0x7fcfd8038bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 --2- 172.21.15.134:0/2137712920 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcfec0fc870 0x7fcfec071b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 >> 172.21.15.134:0/2137712920 conn(0x7fcfec0f7f50 msgr2=0x7fcfec0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 shutdown_connections 2023-12-05T09:18:54.731 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:54.729+0000 7fcff4110700 1 -- 172.21.15.134:0/2137712920 wait complete. 2023-12-05T09:18:54.732 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:18:55.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:55 smithi067 ceph-mon[107174]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:18:55.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:55 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/2137712920' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:18:56.124 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:18:56.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:18:56.531 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:18:56.619 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:18:57.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:56 smithi067 ceph-mon[107174]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:18:57.792 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.790+0000 7f59997e8700 1 -- 172.21.15.134:0/4162317054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 msgr2=0x7f59940fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:57.792 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.790+0000 7f59997e8700 1 --2- 172.21.15.134:0/4162317054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 0x7f59940fcc80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f59840048c0 tx=0x7f5984009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:57.792 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.790+0000 7f59997e8700 1 -- 172.21.15.134:0/4162317054 shutdown_connections 2023-12-05T09:18:57.792 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.790+0000 7f59997e8700 1 --2- 172.21.15.134:0/4162317054 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 0x7f59940fcc80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:57.792 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.790+0000 7f59997e8700 1 -- 172.21.15.134:0/4162317054 >> 172.21.15.134:0/4162317054 conn(0x7f59940f7f50 msgr2=0x7f59940fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:57.793 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.790+0000 7f59997e8700 1 -- 172.21.15.134:0/4162317054 shutdown_connections 2023-12-05T09:18:57.793 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.790+0000 7f59997e8700 1 -- 172.21.15.134:0/4162317054 wait complete. 2023-12-05T09:18:57.793 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.791+0000 7f59997e8700 1 Processor -- start 2023-12-05T09:18:57.793 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.791+0000 7f59997e8700 1 -- start start 2023-12-05T09:18:57.793 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.791+0000 7f59997e8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 0x7f599410ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:57.794 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.791+0000 7f59997e8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599410f270 con 0x7f59940fc870 2023-12-05T09:18:57.794 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.791+0000 7f5992ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 0x7f599410ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:57.794 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.792+0000 7f5992ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 0x7f599410ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:34224/0 (socket says 172.21.15.134:34224) 2023-12-05T09:18:57.794 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.792+0000 7f5992ffd700 1 -- 172.21.15.134:0/3003761734 learned_addr learned my addr 172.21.15.134:0/3003761734 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:18:57.794 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.792+0000 7f5992ffd700 1 -- 172.21.15.134:0/3003761734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5984005040 con 0x7f59940fc870 2023-12-05T09:18:57.794 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.792+0000 7f5992ffd700 1 --2- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 0x7f599410ed30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f598400b690 tx=0x7f5984009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:57.795 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.792+0000 7f597b7fe700 1 -- 172.21.15.134:0/3003761734 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5984009650 con 0x7f59940fc870 2023-12-05T09:18:57.795 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.792+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599410f470 con 0x7f59940fc870 2023-12-05T09:18:57.795 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.792+0000 7f597b7fe700 1 -- 172.21.15.134:0/3003761734 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f59840097b0 con 0x7f59940fc870 2023-12-05T09:18:57.795 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.793+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599410ffd0 con 0x7f59940fc870 2023-12-05T09:18:57.795 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.793+0000 7f597b7fe700 1 -- 172.21.15.134:0/3003761734 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5984025560 con 0x7f59940fc870 2023-12-05T09:18:57.796 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.793+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599405f270 con 0x7f59940fc870 2023-12-05T09:18:57.796 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.794+0000 7f597b7fe700 1 -- 172.21.15.134:0/3003761734 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f59840139d0 con 0x7f59940fc870 2023-12-05T09:18:57.796 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.794+0000 7f597b7fe700 1 --2- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f597c0366d0 0x7f597c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:18:57.796 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.794+0000 7f597b7fe700 1 -- 172.21.15.134:0/3003761734 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5984049a40 con 0x7f59940fc870 2023-12-05T09:18:57.796 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.794+0000 7f59927fc700 1 --2- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f597c0366d0 0x7f597c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:18:57.796 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.795+0000 7f59927fc700 1 --2- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f597c0366d0 0x7f597c038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5988009990 tx=0x7f5988006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:18:57.802 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:57.800+0000 7f597b7fe700 1 -- 172.21.15.134:0/3003761734 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f59840256c0 con 0x7f59940fc870 2023-12-05T09:18:58.066 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.065+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f599404bb80 con 0x7f59940fc870 2023-12-05T09:18:58.067 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.065+0000 7f597b7fe700 1 -- 172.21.15.134:0/3003761734 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f598401be60 con 0x7f59940fc870 2023-12-05T09:18:58.067 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:18:58.067 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:18:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f597c0366d0 msgr2=0x7f597c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 --2- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f597c0366d0 0x7f597c038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5988009990 tx=0x7f5988006e40 comp rx=0 tx=0).stop 2023-12-05T09:18:58.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 msgr2=0x7f599410ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:18:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 --2- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 0x7f599410ed30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f598400b690 tx=0x7f5984009e30 comp rx=0 tx=0).stop 2023-12-05T09:18:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 shutdown_connections 2023-12-05T09:18:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 --2- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f597c0366d0 0x7f597c038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 --2- 172.21.15.134:0/3003761734 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f59940fc870 0x7f599410ed30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:18:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 >> 172.21.15.134:0/3003761734 conn(0x7f59940f7f50 msgr2=0x7f599406fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:18:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 shutdown_connections 2023-12-05T09:18:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:18:58.068+0000 7f59997e8700 1 -- 172.21.15.134:0/3003761734 wait complete. 2023-12-05T09:18:58.070 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:18:59.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:58 smithi067 ceph-mon[107174]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:18:59.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:18:58 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3003761734' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:18:59.443 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:18:59.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:18:59.856 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:18:59.944 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:01.042 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.040+0000 7f87e94c9700 1 -- 172.21.15.134:0/2761720710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 msgr2=0x7f87e40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:01.042 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.040+0000 7f87e94c9700 1 --2- 172.21.15.134:0/2761720710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 0x7f87e40fcc80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f87d40048c0 tx=0x7f87d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:01.042 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.040+0000 7f87e94c9700 1 -- 172.21.15.134:0/2761720710 shutdown_connections 2023-12-05T09:19:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.040+0000 7f87e94c9700 1 --2- 172.21.15.134:0/2761720710 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 0x7f87e40fcc80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.040+0000 7f87e94c9700 1 -- 172.21.15.134:0/2761720710 >> 172.21.15.134:0/2761720710 conn(0x7f87e40f7f50 msgr2=0x7f87e40fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.040+0000 7f87e94c9700 1 -- 172.21.15.134:0/2761720710 shutdown_connections 2023-12-05T09:19:01.043 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.040+0000 7f87e94c9700 1 -- 172.21.15.134:0/2761720710 wait complete. 2023-12-05T09:19:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.041+0000 7f87e94c9700 1 Processor -- start 2023-12-05T09:19:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.041+0000 7f87e94c9700 1 -- start start 2023-12-05T09:19:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.042+0000 7f87e94c9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 0x7f87e410ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.042+0000 7f87e94c9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e410f280 con 0x7f87e40fc870 2023-12-05T09:19:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.042+0000 7f87e2ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 0x7f87e410ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.042+0000 7f87e2ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 0x7f87e410ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:34232/0 (socket says 172.21.15.134:34232) 2023-12-05T09:19:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.042+0000 7f87e2ffd700 1 -- 172.21.15.134:0/1343100608 learned_addr learned my addr 172.21.15.134:0/1343100608 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:01.044 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.042+0000 7f87e2ffd700 1 -- 172.21.15.134:0/1343100608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4005040 con 0x7f87e40fc870 2023-12-05T09:19:01.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.043+0000 7f87e2ffd700 1 --2- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 0x7f87e410ed40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f87d400b690 tx=0x7f87d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:01.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.043+0000 7f87cb7fe700 1 -- 172.21.15.134:0/1343100608 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87d4009650 con 0x7f87e40fc870 2023-12-05T09:19:01.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.043+0000 7f87cb7fe700 1 -- 172.21.15.134:0/1343100608 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87d40097b0 con 0x7f87e40fc870 2023-12-05T09:19:01.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.043+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e410f480 con 0x7f87e40fc870 2023-12-05T09:19:01.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.043+0000 7f87cb7fe700 1 -- 172.21.15.134:0/1343100608 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87d401c5d0 con 0x7f87e40fc870 2023-12-05T09:19:01.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.043+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e410ffe0 con 0x7f87e40fc870 2023-12-05T09:19:01.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.044+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e404bb80 con 0x7f87e40fc870 2023-12-05T09:19:01.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.044+0000 7f87cb7fe700 1 -- 172.21.15.134:0/1343100608 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f87d40139d0 con 0x7f87e40fc870 2023-12-05T09:19:01.046 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.044+0000 7f87cb7fe700 1 --2- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f87cc0366d0 0x7f87cc038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:01.046 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.044+0000 7f87cb7fe700 1 -- 172.21.15.134:0/1343100608 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f87d4049a20 con 0x7f87e40fc870 2023-12-05T09:19:01.046 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.045+0000 7f87e27fc700 1 --2- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f87cc0366d0 0x7f87cc038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:01.047 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.045+0000 7f87e27fc700 1 --2- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f87cc0366d0 0x7f87cc038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009990 tx=0x7f87d8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:01.053 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.051+0000 7f87cb7fe700 1 -- 172.21.15.134:0/1343100608 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f87d4025400 con 0x7f87e40fc870 2023-12-05T09:19:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:00 smithi067 ceph-mon[107174]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:01.317 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.315+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f87e4110e60 con 0x7f87e40fc870 2023-12-05T09:19:01.317 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.316+0000 7f87cb7fe700 1 -- 172.21.15.134:0/1343100608 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f87d4011b60 con 0x7f87e40fc870 2023-12-05T09:19:01.317 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:01.317 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f87cc0366d0 msgr2=0x7f87cc038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 --2- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f87cc0366d0 0x7f87cc038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009990 tx=0x7f87d8006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 msgr2=0x7f87e410ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 --2- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 0x7f87e410ed40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f87d400b690 tx=0x7f87d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 shutdown_connections 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 --2- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f87cc0366d0 0x7f87cc038b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 --2- 172.21.15.134:0/1343100608 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87e40fc870 0x7f87e410ed40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 >> 172.21.15.134:0/1343100608 conn(0x7f87e40f7f50 msgr2=0x7f87e40f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 shutdown_connections 2023-12-05T09:19:01.320 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:01.318+0000 7f87e94c9700 1 -- 172.21.15.134:0/1343100608 wait complete. 2023-12-05T09:19:01.321 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:02.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:01 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/1343100608' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:02.754 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:02.755 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:03.161 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:03.247 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:03.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:02 smithi067 ceph-mon[107174]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:04.297 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.295+0000 7f2a99e36700 1 -- 172.21.15.134:0/1510066353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 msgr2=0x7f2a940fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.295+0000 7f2a99e36700 1 --2- 172.21.15.134:0/1510066353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 0x7f2a940fcc80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2a840048c0 tx=0x7f2a84009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.296+0000 7f2a99e36700 1 -- 172.21.15.134:0/1510066353 shutdown_connections 2023-12-05T09:19:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.296+0000 7f2a99e36700 1 --2- 172.21.15.134:0/1510066353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 0x7f2a940fcc80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.296+0000 7f2a99e36700 1 -- 172.21.15.134:0/1510066353 >> 172.21.15.134:0/1510066353 conn(0x7f2a940f7f50 msgr2=0x7f2a940fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.296+0000 7f2a99e36700 1 -- 172.21.15.134:0/1510066353 shutdown_connections 2023-12-05T09:19:04.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.296+0000 7f2a99e36700 1 -- 172.21.15.134:0/1510066353 wait complete. 2023-12-05T09:19:04.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.296+0000 7f2a99e36700 1 Processor -- start 2023-12-05T09:19:04.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.297+0000 7f2a99e36700 1 -- start start 2023-12-05T09:19:04.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.297+0000 7f2a99e36700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 0x7f2a94071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:04.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.297+0000 7f2a99e36700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9406ff90 con 0x7f2a940fc870 2023-12-05T09:19:04.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.297+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 0x7f2a94071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:04.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.297+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 0x7f2a94071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:34262/0 (socket says 172.21.15.134:34262) 2023-12-05T09:19:04.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.297+0000 7f2a937fe700 1 -- 172.21.15.134:0/3292185530 learned_addr learned my addr 172.21.15.134:0/3292185530 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:04.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.297+0000 7f2a937fe700 1 -- 172.21.15.134:0/3292185530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a84005040 con 0x7f2a940fc870 2023-12-05T09:19:04.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.298+0000 7f2a937fe700 1 --2- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 0x7f2a94071b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400b690 tx=0x7f2a84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:04.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.298+0000 7f2a7bfff700 1 -- 172.21.15.134:0/3292185530 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a84009650 con 0x7f2a940fc870 2023-12-05T09:19:04.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.298+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a94070190 con 0x7f2a940fc870 2023-12-05T09:19:04.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.298+0000 7f2a7bfff700 1 -- 172.21.15.134:0/3292185530 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a840097b0 con 0x7f2a940fc870 2023-12-05T09:19:04.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.298+0000 7f2a7bfff700 1 -- 172.21.15.134:0/3292185530 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a8401c5d0 con 0x7f2a940fc870 2023-12-05T09:19:04.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.298+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a94070680 con 0x7f2a940fc870 2023-12-05T09:19:04.301 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.299+0000 7f2a7bfff700 1 -- 172.21.15.134:0/3292185530 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f2a84013420 con 0x7f2a940fc870 2023-12-05T09:19:04.301 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.299+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a94106500 con 0x7f2a940fc870 2023-12-05T09:19:04.301 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.299+0000 7f2a7bfff700 1 --2- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2a7c0366d0 0x7f2a7c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:04.301 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.299+0000 7f2a7bfff700 1 -- 172.21.15.134:0/3292185530 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2a84049a60 con 0x7f2a940fc870 2023-12-05T09:19:04.301 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.300+0000 7f2a92ffd700 1 --2- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2a7c0366d0 0x7f2a7c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:04.302 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.300+0000 7f2a92ffd700 1 --2- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2a7c0366d0 0x7f2a7c038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009990 tx=0x7f2a88006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:04.306 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.304+0000 7f2a7bfff700 1 -- 172.21.15.134:0/3292185530 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2a84025400 con 0x7f2a940fc870 2023-12-05T09:19:04.574 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.573+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2a9404bb80 con 0x7f2a940fc870 2023-12-05T09:19:04.575 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.573+0000 7f2a7bfff700 1 -- 172.21.15.134:0/3292185530 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2a84011370 con 0x7f2a940fc870 2023-12-05T09:19:04.575 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:04.575 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:04.577 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.575+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2a7c0366d0 msgr2=0x7f2a7c038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:04.577 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.575+0000 7f2a99e36700 1 --2- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2a7c0366d0 0x7f2a7c038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2a88009990 tx=0x7f2a88006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:04.577 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.575+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 msgr2=0x7f2a94071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:04.577 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.575+0000 7f2a99e36700 1 --2- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 0x7f2a94071b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400b690 tx=0x7f2a84009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:04.577 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.575+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 shutdown_connections 2023-12-05T09:19:04.577 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.575+0000 7f2a99e36700 1 --2- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f2a7c0366d0 0x7f2a7c038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:04.577 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.575+0000 7f2a99e36700 1 --2- 172.21.15.134:0/3292185530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a940fc870 0x7f2a94071b10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:04.578 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.575+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 >> 172.21.15.134:0/3292185530 conn(0x7f2a940f7f50 msgr2=0x7f2a940f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:04.578 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.576+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 shutdown_connections 2023-12-05T09:19:04.578 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:04.576+0000 7f2a99e36700 1 -- 172.21.15.134:0/3292185530 wait complete. 2023-12-05T09:19:04.578 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:05.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:04 smithi067 ceph-mon[107174]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:05.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:04 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3292185530' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:05.949 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:05.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:06.360 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:06.448 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:07.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:06 smithi067 ceph-mon[107174]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.521+0000 7f0f9b59e700 1 -- 172.21.15.134:0/582883858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 msgr2=0x7f0f9c06ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.521+0000 7f0f9b59e700 1 --2- 172.21.15.134:0/582883858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 0x7f0f9c06ffd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0048c0 tx=0x7f0f8c009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.521+0000 7f0f9b59e700 1 -- 172.21.15.134:0/582883858 shutdown_connections 2023-12-05T09:19:07.524 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.521+0000 7f0f9b59e700 1 --2- 172.21.15.134:0/582883858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 0x7f0f9c06ffd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:07.525 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.521+0000 7f0f9b59e700 1 -- 172.21.15.134:0/582883858 >> 172.21.15.134:0/582883858 conn(0x7f0f9c0f7d70 msgr2=0x7f0f9c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:07.525 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.521+0000 7f0f9b59e700 1 -- 172.21.15.134:0/582883858 shutdown_connections 2023-12-05T09:19:07.525 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.521+0000 7f0f9b59e700 1 -- 172.21.15.134:0/582883858 wait complete. 2023-12-05T09:19:07.526 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.522+0000 7f0f9b59e700 1 Processor -- start 2023-12-05T09:19:07.526 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.522+0000 7f0f9b59e700 1 -- start start 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.522+0000 7f0f9b59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 0x7f0f9c10ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.522+0000 7f0f9b59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c10efc0 con 0x7f0f9c071b60 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.523+0000 7f0f9a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 0x7f0f9c10ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.523+0000 7f0f9a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 0x7f0f9c10ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:60648/0 (socket says 172.21.15.134:60648) 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.523+0000 7f0f9a59c700 1 -- 172.21.15.134:0/1750549974 learned_addr learned my addr 172.21.15.134:0/1750549974 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.523+0000 7f0f9a59c700 1 -- 172.21.15.134:0/1750549974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c005040 con 0x7f0f9c071b60 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.523+0000 7f0f9a59c700 1 --2- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 0x7f0f9c10ea80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00b690 tx=0x7f0f8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.523+0000 7f0f8affd700 1 -- 172.21.15.134:0/1750549974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f8c009650 con 0x7f0f9c071b60 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.524+0000 7f0f8affd700 1 -- 172.21.15.134:0/1750549974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f8c0097b0 con 0x7f0f9c071b60 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.524+0000 7f0f8affd700 1 -- 172.21.15.134:0/1750549974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0f8c01c5b0 con 0x7f0f9c071b60 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.524+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c10f1c0 con 0x7f0f9c071b60 2023-12-05T09:19:07.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.524+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c10fe60 con 0x7f0f9c071b60 2023-12-05T09:19:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.525+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c05f270 con 0x7f0f9c071b60 2023-12-05T09:19:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.525+0000 7f0f8affd700 1 -- 172.21.15.134:0/1750549974 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f0f8c013a60 con 0x7f0f9c071b60 2023-12-05T09:19:07.528 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.525+0000 7f0f8affd700 1 --2- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0f840366d0 0x7f0f84038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:07.529 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.525+0000 7f0f8affd700 1 -- 172.21.15.134:0/1750549974 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0f8c049910 con 0x7f0f9c071b60 2023-12-05T09:19:07.529 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.526+0000 7f0f99d9b700 1 --2- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0f840366d0 0x7f0f84038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:07.529 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.526+0000 7f0f99d9b700 1 --2- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0f840366d0 0x7f0f84038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009990 tx=0x7f0f90006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:07.533 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.530+0000 7f0f8affd700 1 -- 172.21.15.134:0/1750549974 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0f8c011550 con 0x7f0f9c071b60 2023-12-05T09:19:07.803 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.800+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0f9c1109b0 con 0x7f0f9c071b60 2023-12-05T09:19:07.803 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.801+0000 7f0f8affd700 1 -- 172.21.15.134:0/1750549974 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0f8c011370 con 0x7f0f9c071b60 2023-12-05T09:19:07.804 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:07.804 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:07.805 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0f840366d0 msgr2=0x7f0f84038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:07.805 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 --2- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0f840366d0 0x7f0f84038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009990 tx=0x7f0f90006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 msgr2=0x7f0f9c10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 --2- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 0x7f0f9c10ea80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00b690 tx=0x7f0f8c009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 shutdown_connections 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 --2- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f0f840366d0 0x7f0f84038b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 --2- 172.21.15.134:0/1750549974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0f9c071b60 0x7f0f9c10ea80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 >> 172.21.15.134:0/1750549974 conn(0x7f0f9c0f7d70 msgr2=0x7f0f9c0f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 shutdown_connections 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:07.803+0000 7f0f9b59e700 1 -- 172.21.15.134:0/1750549974 wait complete. 2023-12-05T09:19:07.806 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:08.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:08 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:08.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:08 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:08.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:08 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:08.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:08 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:08.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:08 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:08.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:08 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:08.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:08 smithi067 ceph-mon[107174]: Deploying daemon prometheus.smithi067 on smithi067 2023-12-05T09:19:08.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:08 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/1750549974' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:09.171 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:09.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:09.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:09 smithi067 ceph-mon[107174]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:09.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:09 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:09.577 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:10.786 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.778+0000 7f50646c5700 1 -- 172.21.15.134:0/243284753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 msgr2=0x7f505c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:10.786 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.778+0000 7f50646c5700 1 --2- 172.21.15.134:0/243284753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 0x7f505c0fcc80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f50580048c0 tx=0x7f5058009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.778+0000 7f50646c5700 1 -- 172.21.15.134:0/243284753 shutdown_connections 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.778+0000 7f50646c5700 1 --2- 172.21.15.134:0/243284753 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 0x7f505c0fcc80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.778+0000 7f50646c5700 1 -- 172.21.15.134:0/243284753 >> 172.21.15.134:0/243284753 conn(0x7f505c0f7f50 msgr2=0x7f505c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.778+0000 7f50646c5700 1 -- 172.21.15.134:0/243284753 shutdown_connections 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.778+0000 7f50646c5700 1 -- 172.21.15.134:0/243284753 wait complete. 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.779+0000 7f50646c5700 1 Processor -- start 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.779+0000 7f50646c5700 1 -- start start 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.779+0000 7f50646c5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 0x7f505c10ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.779+0000 7f50646c5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c10cfd0 con 0x7f505c0fc870 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.779+0000 7f5062461700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 0x7f505c10ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.779+0000 7f5062461700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 0x7f505c10ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:60668/0 (socket says 172.21.15.134:60668) 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.779+0000 7f5062461700 1 -- 172.21.15.134:0/1903673005 learned_addr learned my addr 172.21.15.134:0/1903673005 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:10.787 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.780+0000 7f5062461700 1 -- 172.21.15.134:0/1903673005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058005040 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.780+0000 7f5062461700 1 --2- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 0x7f505c10ca90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f505800b690 tx=0x7f5058009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.780+0000 7f5052ffd700 1 -- 172.21.15.134:0/1903673005 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5058009650 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.780+0000 7f5052ffd700 1 -- 172.21.15.134:0/1903673005 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f50580097b0 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.780+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505c10d1d0 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.780+0000 7f5052ffd700 1 -- 172.21.15.134:0/1903673005 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f505801c5d0 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.780+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505c10de70 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.781+0000 7f5052ffd700 1 -- 172.21.15.134:0/1903673005 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7f50580139d0 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.781+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505c05f270 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.782+0000 7f5052ffd700 1 --2- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f50480366d0 0x7f5048038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.782+0000 7f5052ffd700 1 -- 172.21.15.134:0/1903673005 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5058049a40 con 0x7f505c0fc870 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.782+0000 7f5061c60700 1 --2- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f50480366d0 0x7f5048038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:10.788 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.783+0000 7f5061c60700 1 --2- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f50480366d0 0x7f5048038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f504c009990 tx=0x7f504c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:10.789 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:10.787+0000 7f5052ffd700 1 -- 172.21.15.134:0/1903673005 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5058025400 con 0x7f505c0fc870 2023-12-05T09:19:11.054 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.051+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f505c10e9c0 con 0x7f505c0fc870 2023-12-05T09:19:11.054 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.052+0000 7f5052ffd700 1 -- 172.21.15.134:0/1903673005 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5058011b60 con 0x7f505c0fc870 2023-12-05T09:19:11.054 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:11.054 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:11.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f50480366d0 msgr2=0x7f5048038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:11.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 --2- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f50480366d0 0x7f5048038b80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f504c009990 tx=0x7f504c006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:11.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 msgr2=0x7f505c10ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:11.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 --2- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 0x7f505c10ca90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f505800b690 tx=0x7f5058009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:11.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 shutdown_connections 2023-12-05T09:19:11.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 --2- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f50480366d0 0x7f5048038b80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:11.057 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 --2- 172.21.15.134:0/1903673005 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f505c0fc870 0x7f505c10ca90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:11.057 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 >> 172.21.15.134:0/1903673005 conn(0x7f505c0f7f50 msgr2=0x7f505c0f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:11.057 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 shutdown_connections 2023-12-05T09:19:11.057 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:11.054+0000 7f50646c5700 1 -- 172.21.15.134:0/1903673005 wait complete. 2023-12-05T09:19:11.058 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:11.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:11 smithi067 ceph-mon[107174]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:11.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:11 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/1903673005' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:12.426 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:12.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:12.832 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:12.920 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:13.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:13 smithi067 ceph-mon[107174]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.027+0000 7fa27c837700 1 -- 172.21.15.134:0/3399908771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 msgr2=0x7fa2780fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:14.030 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.027+0000 7fa27c837700 1 --2- 172.21.15.134:0/3399908771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 0x7fa2780fcc80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2680048c0 tx=0x7fa268009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.027+0000 7fa27c837700 1 -- 172.21.15.134:0/3399908771 shutdown_connections 2023-12-05T09:19:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.027+0000 7fa27c837700 1 --2- 172.21.15.134:0/3399908771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 0x7fa2780fcc80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.027+0000 7fa27c837700 1 -- 172.21.15.134:0/3399908771 >> 172.21.15.134:0/3399908771 conn(0x7fa2780f7f50 msgr2=0x7fa2780fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.028+0000 7fa27c837700 1 -- 172.21.15.134:0/3399908771 shutdown_connections 2023-12-05T09:19:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.028+0000 7fa27c837700 1 -- 172.21.15.134:0/3399908771 wait complete. 2023-12-05T09:19:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.029+0000 7fa27c837700 1 Processor -- start 2023-12-05T09:19:14.031 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.029+0000 7fa27c837700 1 -- start start 2023-12-05T09:19:14.032 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.029+0000 7fa27c837700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 0x7fa278071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:14.032 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.029+0000 7fa27c837700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27806ff90 con 0x7fa2780fc870 2023-12-05T09:19:14.032 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.030+0000 7fa27659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 0x7fa278071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:14.032 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.030+0000 7fa27659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 0x7fa278071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:60696/0 (socket says 172.21.15.134:60696) 2023-12-05T09:19:14.032 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.030+0000 7fa27659c700 1 -- 172.21.15.134:0/23825501 learned_addr learned my addr 172.21.15.134:0/23825501 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:14.033 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.030+0000 7fa27659c700 1 -- 172.21.15.134:0/23825501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268005040 con 0x7fa2780fc870 2023-12-05T09:19:14.033 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.031+0000 7fa27659c700 1 --2- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 0x7fa278071b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa26800b690 tx=0x7fa268009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:14.034 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.031+0000 7fa266ffd700 1 -- 172.21.15.134:0/23825501 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa268009650 con 0x7fa2780fc870 2023-12-05T09:19:14.034 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.031+0000 7fa266ffd700 1 -- 172.21.15.134:0/23825501 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2680097b0 con 0x7fa2780fc870 2023-12-05T09:19:14.034 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.031+0000 7fa266ffd700 1 -- 172.21.15.134:0/23825501 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa26801c5d0 con 0x7fa2780fc870 2023-12-05T09:19:14.034 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.031+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa278070190 con 0x7fa2780fc870 2023-12-05T09:19:14.034 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.031+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa278070680 con 0x7fa2780fc870 2023-12-05T09:19:14.035 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.032+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa278106500 con 0x7fa2780fc870 2023-12-05T09:19:14.035 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.032+0000 7fa266ffd700 1 -- 172.21.15.134:0/23825501 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7fa268013420 con 0x7fa2780fc870 2023-12-05T09:19:14.035 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.032+0000 7fa266ffd700 1 --2- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fa260036720 0x7fa260038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:14.035 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.032+0000 7fa266ffd700 1 -- 172.21.15.134:0/23825501 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa2680499e0 con 0x7fa2780fc870 2023-12-05T09:19:14.035 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.033+0000 7fa275d9b700 1 --2- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fa260036720 0x7fa260038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:14.036 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.034+0000 7fa275d9b700 1 --2- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fa260036720 0x7fa260038bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009990 tx=0x7fa26c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:14.040 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.038+0000 7fa266ffd700 1 -- 172.21.15.134:0/23825501 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa268025400 con 0x7fa2780fc870 2023-12-05T09:19:14.303 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.301+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa27804bb80 con 0x7fa2780fc870 2023-12-05T09:19:14.304 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.301+0000 7fa266ffd700 1 -- 172.21.15.134:0/23825501 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa268011370 con 0x7fa2780fc870 2023-12-05T09:19:14.304 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:14.304 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:14.306 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fa260036720 msgr2=0x7fa260038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:14.306 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 --2- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fa260036720 0x7fa260038bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009990 tx=0x7fa26c006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:14.306 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 msgr2=0x7fa278071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 --2- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 0x7fa278071b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa26800b690 tx=0x7fa268009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 shutdown_connections 2023-12-05T09:19:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 --2- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7fa260036720 0x7fa260038bd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 --2- 172.21.15.134:0/23825501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2780fc870 0x7fa278071b10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 >> 172.21.15.134:0/23825501 conn(0x7fa2780f7f50 msgr2=0x7fa2780f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 shutdown_connections 2023-12-05T09:19:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:14.304+0000 7fa27c837700 1 -- 172.21.15.134:0/23825501 wait complete. 2023-12-05T09:19:14.307 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:15.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:15 smithi067 ceph-mon[107174]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:15.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:15 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/23825501' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:15.701 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:15.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:16.112 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:17.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:16 smithi067 ceph-mon[107174]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:17.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:16 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:17.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:16 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:17.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:16 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:17.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:16 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-05T09:19:17.297 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.294+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4183997294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 msgr2=0x7ff8980fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:17.297 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.294+0000 7ff89c9cd700 1 --2- 172.21.15.134:0/4183997294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 0x7ff8980fcc80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff8880048c0 tx=0x7ff888009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:17.297 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.295+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4183997294 shutdown_connections 2023-12-05T09:19:17.297 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.295+0000 7ff89c9cd700 1 --2- 172.21.15.134:0/4183997294 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 0x7ff8980fcc80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:17.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.295+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4183997294 >> 172.21.15.134:0/4183997294 conn(0x7ff8980f7f50 msgr2=0x7ff8980fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:17.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.295+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4183997294 shutdown_connections 2023-12-05T09:19:17.298 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.295+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4183997294 wait complete. 2023-12-05T09:19:17.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.295+0000 7ff89c9cd700 1 Processor -- start 2023-12-05T09:19:17.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.296+0000 7ff89c9cd700 1 -- start start 2023-12-05T09:19:17.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.296+0000 7ff89c9cd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 0x7ff89810ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:17.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.296+0000 7ff89c9cd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89810f270 con 0x7ff8980fc870 2023-12-05T09:19:17.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.296+0000 7ff89659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 0x7ff89810ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:17.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.296+0000 7ff89659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 0x7ff89810ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:36032/0 (socket says 172.21.15.134:36032) 2023-12-05T09:19:17.299 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.296+0000 7ff89659c700 1 -- 172.21.15.134:0/4155382834 learned_addr learned my addr 172.21.15.134:0/4155382834 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:17.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.297+0000 7ff89659c700 1 -- 172.21.15.134:0/4155382834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff888005040 con 0x7ff8980fc870 2023-12-05T09:19:17.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.297+0000 7ff89659c700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 0x7ff89810ed30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff88800b690 tx=0x7ff888009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:17.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.297+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff888009650 con 0x7ff8980fc870 2023-12-05T09:19:17.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.297+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8880097b0 con 0x7ff8980fc870 2023-12-05T09:19:17.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.297+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89810f470 con 0x7ff8980fc870 2023-12-05T09:19:17.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.297+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff88801c5d0 con 0x7ff8980fc870 2023-12-05T09:19:17.300 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.297+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89810ffd0 con 0x7ff8980fc870 2023-12-05T09:19:17.301 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.298+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89804bb80 con 0x7ff8980fc870 2023-12-05T09:19:17.301 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.298+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 13) v1 ==== 43337+0+0 (secure 0 0 0) 0x7ff8880139d0 con 0x7ff8980fc870 2023-12-05T09:19:17.302 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.299+0000 7ff886ffd700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 0x7ff880038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:17.302 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.299+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff8880499e0 con 0x7ff8980fc870 2023-12-05T09:19:17.302 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.299+0000 7ff895d9b700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 0x7ff880038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:17.302 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.300+0000 7ff895d9b700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 0x7ff880038bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009990 tx=0x7ff88c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:17.306 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.304+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff888025400 con 0x7ff8980fc870 2023-12-05T09:19:17.468 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.466+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7ff888025780 con 0x7ff8980fc870 2023-12-05T09:19:17.542 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.540+0000 7ff895d9b700 1 -- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 msgr2=0x7ff880038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-12-05T09:19:17.543 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.540+0000 7ff895d9b700 1 -- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 msgr2=0x7ff880038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:19:17.543 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.540+0000 7ff895d9b700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 0x7ff880038bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009990 tx=0x7ff88c006e40 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:19:17.543 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.540+0000 7ff895d9b700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 0x7ff880038bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009990 tx=0x7ff88c006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:17.543 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.540+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 msgr2=0x7ff880038bd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-12-05T09:19:17.543 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.541+0000 7ff886ffd700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 0x7ff880038bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:17.589 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.586+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff87c005160 con 0x7ff8980fc870 2023-12-05T09:19:17.589 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.587+0000 7ff886ffd700 1 -- 172.21.15.134:0/4155382834 <== mon.0 v2:172.21.15.67:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff888012a70 con 0x7ff8980fc870 2023-12-05T09:19:17.590 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:17.590 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:17.593 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.591+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 msgr2=0x7ff89810ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:17.594 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.591+0000 7ff89c9cd700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 0x7ff89810ed30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff88800b690 tx=0x7ff888009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:17.594 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.591+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 shutdown_connections 2023-12-05T09:19:17.594 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.591+0000 7ff89c9cd700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7ff880036720 0x7ff880038bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:17.594 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.591+0000 7ff89c9cd700 1 --2- 172.21.15.134:0/4155382834 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff8980fc870 0x7ff89810ed30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:17.594 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.591+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 >> 172.21.15.134:0/4155382834 conn(0x7ff8980f7f50 msgr2=0x7ff89806feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:17.594 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.591+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 shutdown_connections 2023-12-05T09:19:17.594 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:17.591+0000 7ff89c9cd700 1 -- 172.21.15.134:0/4155382834 wait complete. 2023-12-05T09:19:17.595 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:18.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:18 smithi067 ceph-mon[107174]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-05T09:19:18.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:18 smithi067 ceph-mon[107174]: mgrmap e14: smithi067.alxtvv(active, since 53s) 2023-12-05T09:19:18.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:18 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/4155382834' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:18.976 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:18.977 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:19.385 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:19.472 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.551+0000 7f9208cbc700 1 -- 172.21.15.134:0/2990253116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 msgr2=0x7f92040fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.551+0000 7f9208cbc700 1 --2- 172.21.15.134:0/2990253116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 0x7f92040fcc80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f91f40048c0 tx=0x7f91f4009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.551+0000 7f9208cbc700 1 -- 172.21.15.134:0/2990253116 shutdown_connections 2023-12-05T09:19:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.551+0000 7f9208cbc700 1 --2- 172.21.15.134:0/2990253116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 0x7f92040fcc80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.552+0000 7f9208cbc700 1 -- 172.21.15.134:0/2990253116 >> 172.21.15.134:0/2990253116 conn(0x7f92040f7f50 msgr2=0x7f92040fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.552+0000 7f9208cbc700 1 -- 172.21.15.134:0/2990253116 shutdown_connections 2023-12-05T09:19:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.552+0000 7f9208cbc700 1 -- 172.21.15.134:0/2990253116 wait complete. 2023-12-05T09:19:20.559 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.553+0000 7f9208cbc700 1 Processor -- start 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.553+0000 7f9208cbc700 1 -- start start 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.553+0000 7f9208cbc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 0x7f9204071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.553+0000 7f9208cbc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920406ff90 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.553+0000 7f920259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 0x7f9204071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.553+0000 7f920259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 0x7f9204071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:36052/0 (socket says 172.21.15.134:36052) 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.553+0000 7f920259c700 1 -- 172.21.15.134:0/1917844857 learned_addr learned my addr 172.21.15.134:0/1917844857 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.554+0000 7f920259c700 1 -- 172.21.15.134:0/1917844857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f4005040 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.554+0000 7f920259c700 1 --2- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 0x7f9204071b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91f400b690 tx=0x7f91f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.554+0000 7f91f2ffd700 1 -- 172.21.15.134:0/1917844857 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91f4009650 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.554+0000 7f91f2ffd700 1 -- 172.21.15.134:0/1917844857 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91f40097b0 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.554+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9204070190 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.554+0000 7f91f2ffd700 1 -- 172.21.15.134:0/1917844857 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91f401c5d0 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.554+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9204070680 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.556+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9204106500 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.556+0000 7f91f2ffd700 1 -- 172.21.15.134:0/1917844857 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f91f40139d0 con 0x7f92040fc870 2023-12-05T09:19:20.560 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.556+0000 7f91f2ffd700 1 --2- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f91ec036770 0x7f91ec038c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:20.561 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.556+0000 7f91f2ffd700 1 -- 172.21.15.134:0/1917844857 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f91f4049a50 con 0x7f92040fc870 2023-12-05T09:19:20.561 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.556+0000 7f9201d9b700 1 -- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f91ec036770 msgr2=0x7f91ec038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/434315882 2023-12-05T09:19:20.561 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.556+0000 7f9201d9b700 1 --2- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f91ec036770 0x7f91ec038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:19:20.563 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.561+0000 7f91f2ffd700 1 -- 172.21.15.134:0/1917844857 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f91f4025400 con 0x7f92040fc870 2023-12-05T09:19:20.759 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.757+0000 7f9201d9b700 1 -- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f91ec036770 msgr2=0x7f91ec038c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/434315882 2023-12-05T09:19:20.759 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.757+0000 7f9201d9b700 1 --2- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f91ec036770 0x7f91ec038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:19:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.829+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f920404bb80 con 0x7f92040fc870 2023-12-05T09:19:20.834 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.830+0000 7f91f2ffd700 1 -- 172.21.15.134:0/1917844857 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f91f4011b60 con 0x7f92040fc870 2023-12-05T09:19:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:20.834 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:20.835 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.832+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f91ec036770 msgr2=0x7f91ec038c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:19:20.835 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.832+0000 7f9208cbc700 1 --2- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f91ec036770 0x7f91ec038c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:20.835 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.832+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 msgr2=0x7f9204071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:20.835 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.832+0000 7f9208cbc700 1 --2- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 0x7f9204071b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91f400b690 tx=0x7f91f4009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:20.836 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.832+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 shutdown_connections 2023-12-05T09:19:20.836 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.832+0000 7f9208cbc700 1 --2- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f91ec036770 0x7f91ec038c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:20.836 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.832+0000 7f9208cbc700 1 --2- 172.21.15.134:0/1917844857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92040fc870 0x7f9204071b10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:20.836 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.832+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 >> 172.21.15.134:0/1917844857 conn(0x7f92040f7f50 msgr2=0x7f92040f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:20.836 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.833+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 shutdown_connections 2023-12-05T09:19:20.836 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:20.833+0000 7f9208cbc700 1 -- 172.21.15.134:0/1917844857 wait complete. 2023-12-05T09:19:20.836 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:21.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:20 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/1917844857' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:22.215 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:22.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:22.624 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:22.711 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.767+0000 7f65c6e2d700 1 -- 172.21.15.134:0/2177768420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 msgr2=0x7f65c006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:23.770 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.767+0000 7f65c6e2d700 1 --2- 172.21.15.134:0/2177768420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 0x7f65c006ffd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0048c0 tx=0x7f65bc009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.768+0000 7f65c6e2d700 1 -- 172.21.15.134:0/2177768420 shutdown_connections 2023-12-05T09:19:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.768+0000 7f65c6e2d700 1 --2- 172.21.15.134:0/2177768420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 0x7f65c006ffd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.768+0000 7f65c6e2d700 1 -- 172.21.15.134:0/2177768420 >> 172.21.15.134:0/2177768420 conn(0x7f65c00f7d70 msgr2=0x7f65c00fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.768+0000 7f65c6e2d700 1 -- 172.21.15.134:0/2177768420 shutdown_connections 2023-12-05T09:19:23.771 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.768+0000 7f65c6e2d700 1 -- 172.21.15.134:0/2177768420 wait complete. 2023-12-05T09:19:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.768+0000 7f65c6e2d700 1 Processor -- start 2023-12-05T09:19:23.772 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.769+0000 7f65c6e2d700 1 -- start start 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.769+0000 7f65c6e2d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 0x7f65c010ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.769+0000 7f65c6e2d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c010efc0 con 0x7f65c0071b60 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.769+0000 7f65c5e2b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 0x7f65c010ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.769+0000 7f65c5e2b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 0x7f65c010ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:36082/0 (socket says 172.21.15.134:36082) 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.769+0000 7f65c5e2b700 1 -- 172.21.15.134:0/320099187 learned_addr learned my addr 172.21.15.134:0/320099187 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.769+0000 7f65c5e2b700 1 -- 172.21.15.134:0/320099187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc005040 con 0x7f65c0071b60 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.770+0000 7f65c5e2b700 1 --2- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 0x7f65c010ea80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009040 tx=0x7f65bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.770+0000 7f65b67fc700 1 -- 172.21.15.134:0/320099187 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65bc009620 con 0x7f65c0071b60 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.770+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c010f1c0 con 0x7f65c0071b60 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.770+0000 7f65b67fc700 1 -- 172.21.15.134:0/320099187 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65bc009780 con 0x7f65c0071b60 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.770+0000 7f65b67fc700 1 -- 172.21.15.134:0/320099187 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65bc01c5b0 con 0x7f65c0071b60 2023-12-05T09:19:23.773 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.770+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c010fe60 con 0x7f65c0071b60 2023-12-05T09:19:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.771+0000 7f65b67fc700 1 -- 172.21.15.134:0/320099187 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 14) v1 ==== 43351+0+0 (secure 0 0 0) 0x7f65bc013420 con 0x7f65c0071b60 2023-12-05T09:19:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.771+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c005f270 con 0x7f65c0071b60 2023-12-05T09:19:23.774 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.771+0000 7f65b67fc700 1 --2- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f65ac036720 0x7f65ac038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.772+0000 7f65b67fc700 1 -- 172.21.15.134:0/320099187 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f65bc049920 con 0x7f65c0071b60 2023-12-05T09:19:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.772+0000 7f65c562a700 1 -- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f65ac036720 msgr2=0x7f65ac038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/434315882 2023-12-05T09:19:23.775 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.772+0000 7f65c562a700 1 --2- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f65ac036720 0x7f65ac038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:19:23.779 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.777+0000 7f65b67fc700 1 -- 172.21.15.134:0/320099187 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f65bc0117e0 con 0x7f65c0071b60 2023-12-05T09:19:23.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.973+0000 7f65c562a700 1 -- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f65ac036720 msgr2=0x7f65ac038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.67:6800/434315882 2023-12-05T09:19:23.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:23.973+0000 7f65c562a700 1 --2- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f65ac036720 0x7f65ac038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-05T09:19:24.041 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.039+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f65c01109b0 con 0x7f65c0071b60 2023-12-05T09:19:24.042 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.040+0000 7f65b67fc700 1 -- 172.21.15.134:0/320099187 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f65bc01be90 con 0x7f65c0071b60 2023-12-05T09:19:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:24.042 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f65ac036720 msgr2=0x7f65ac038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 --2- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f65ac036720 0x7f65ac038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 msgr2=0x7f65c010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 --2- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 0x7f65c010ea80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009040 tx=0x7f65bc009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 shutdown_connections 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 --2- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:6800/434315882,v1:172.21.15.67:6801/434315882] conn(0x7f65ac036720 0x7f65ac038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 --2- 172.21.15.134:0/320099187 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65c0071b60 0x7f65c010ea80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 >> 172.21.15.134:0/320099187 conn(0x7f65c00f7d70 msgr2=0x7f65c00f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 shutdown_connections 2023-12-05T09:19:24.045 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:24.042+0000 7f65c6e2d700 1 -- 172.21.15.134:0/320099187 wait complete. 2023-12-05T09:19:24.046 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:24.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:24 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/320099187' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:25.413 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:25.413 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:25.814 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:25.903 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:27.053 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.050+0000 7f015ccf5700 1 -- 172.21.15.134:0/798473479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 msgr2=0x7f01580fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:27.053 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.050+0000 7f015ccf5700 1 --2- 172.21.15.134:0/798473479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 0x7f01580fcc80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f01480048c0 tx=0x7f0148009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:27.053 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.050+0000 7f015ccf5700 1 -- 172.21.15.134:0/798473479 shutdown_connections 2023-12-05T09:19:27.053 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.050+0000 7f015ccf5700 1 --2- 172.21.15.134:0/798473479 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 0x7f01580fcc80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:27.053 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.050+0000 7f015ccf5700 1 -- 172.21.15.134:0/798473479 >> 172.21.15.134:0/798473479 conn(0x7f01580f7f50 msgr2=0x7f01580fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:27.053 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.050+0000 7f015ccf5700 1 -- 172.21.15.134:0/798473479 shutdown_connections 2023-12-05T09:19:27.054 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.050+0000 7f015ccf5700 1 -- 172.21.15.134:0/798473479 wait complete. 2023-12-05T09:19:27.054 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.051+0000 7f015ccf5700 1 Processor -- start 2023-12-05T09:19:27.054 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.051+0000 7f015ccf5700 1 -- start start 2023-12-05T09:19:27.055 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.052+0000 7f015ccf5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 0x7f0158071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:27.055 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.052+0000 7f015ccf5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015806ff90 con 0x7f01580fc870 2023-12-05T09:19:27.055 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.052+0000 7f015659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 0x7f0158071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:27.055 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.052+0000 7f015659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 0x7f0158071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:54454/0 (socket says 172.21.15.134:54454) 2023-12-05T09:19:27.055 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.052+0000 7f015659c700 1 -- 172.21.15.134:0/3978800700 learned_addr learned my addr 172.21.15.134:0/3978800700 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:27.055 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.052+0000 7f015659c700 1 -- 172.21.15.134:0/3978800700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0148005040 con 0x7f01580fc870 2023-12-05T09:19:27.055 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.053+0000 7f015659c700 1 --2- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 0x7f0158071b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0148009330 tx=0x7f0148009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.053+0000 7f0146ffd700 1 -- 172.21.15.134:0/3978800700 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01480096b0 con 0x7f01580fc870 2023-12-05T09:19:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.053+0000 7f0146ffd700 1 -- 172.21.15.134:0/3978800700 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0148009810 con 0x7f01580fc870 2023-12-05T09:19:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.053+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0158070190 con 0x7f01580fc870 2023-12-05T09:19:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.053+0000 7f0146ffd700 1 -- 172.21.15.134:0/3978800700 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f014801c5b0 con 0x7f01580fc870 2023-12-05T09:19:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.053+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0158070680 con 0x7f01580fc870 2023-12-05T09:19:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.054+0000 7f0146ffd700 1 -- 172.21.15.134:0/3978800700 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7f0148013420 con 0x7f01580fc870 2023-12-05T09:19:27.056 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.054+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0158106500 con 0x7f01580fc870 2023-12-05T09:19:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.055+0000 7f0146ffd700 1 --2- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0140036560 0x7f0140038a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.055+0000 7f0146ffd700 1 -- 172.21.15.134:0/3978800700 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0148049920 con 0x7f01580fc870 2023-12-05T09:19:27.057 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.055+0000 7f0155d9b700 1 --2- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0140036560 0x7f0140038a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:27.058 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.056+0000 7f0155d9b700 1 --2- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0140036560 0x7f0140038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f014c009990 tx=0x7f014c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:27.064 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.062+0000 7f0146ffd700 1 -- 172.21.15.134:0/3978800700 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f01480119c0 con 0x7f01580fc870 2023-12-05T09:19:27.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: Active manager daemon smithi067.alxtvv restarted 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: mgrmap e15: smithi067.alxtvv(active, starting, since 0.00366132s) 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:19:27.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:27.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:19:27.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:19:27.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:19:27.350 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.347+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f015804bb80 con 0x7f01580fc870 2023-12-05T09:19:27.351 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.348+0000 7f0146ffd700 1 -- 172.21.15.134:0/3978800700 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0148011370 con 0x7f01580fc870 2023-12-05T09:19:27.351 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:27.351 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:27.353 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.350+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0140036560 msgr2=0x7f0140038a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:27.353 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.350+0000 7f015ccf5700 1 --2- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0140036560 0x7f0140038a10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f014c009990 tx=0x7f014c006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:27.353 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.350+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 msgr2=0x7f0158071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:27.353 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.350+0000 7f015ccf5700 1 --2- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 0x7f0158071b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0148009330 tx=0x7f0148009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:27.353 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.351+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 shutdown_connections 2023-12-05T09:19:27.353 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.351+0000 7f015ccf5700 1 --2- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0140036560 0x7f0140038a10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:27.353 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.351+0000 7f015ccf5700 1 --2- 172.21.15.134:0/3978800700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01580fc870 0x7f0158071b10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:27.353 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.351+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 >> 172.21.15.134:0/3978800700 conn(0x7f01580f7f50 msgr2=0x7f01580f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:27.354 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.351+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 shutdown_connections 2023-12-05T09:19:27.354 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:27.351+0000 7f015ccf5700 1 -- 172.21.15.134:0/3978800700 wait complete. 2023-12-05T09:19:27.354 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:28.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:27 smithi067 ceph-mon[107174]: [05/Dec/2023:09:19:26] ENGINE Bus STARTING 2023-12-05T09:19:28.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:27 smithi067 ceph-mon[107174]: [05/Dec/2023:09:19:26] ENGINE Serving on https://172.21.15.67:7150 2023-12-05T09:19:28.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:27 smithi067 ceph-mon[107174]: [05/Dec/2023:09:19:26] ENGINE Bus STARTED 2023-12-05T09:19:28.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:27 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:28.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:27 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:28.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:27 smithi067 ceph-mon[107174]: mgrmap e16: smithi067.alxtvv(active, since 1.00962s) 2023-12-05T09:19:28.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:27 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3978800700' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:28.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:27 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:28.733 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:28.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:29.148 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:29.241 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:30.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:30.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:29 smithi067 ceph-mon[107174]: mgrmap e17: smithi067.alxtvv(active, since 2s) 2023-12-05T09:19:30.673 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.671+0000 7f6553b89700 1 -- 172.21.15.134:0/1503982369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 msgr2=0x7f654c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:30.674 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.671+0000 7f6553b89700 1 --2- 172.21.15.134:0/1503982369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 0x7f654c070030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f65480048c0 tx=0x7f6548009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:30.674 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.672+0000 7f6553b89700 1 -- 172.21.15.134:0/1503982369 shutdown_connections 2023-12-05T09:19:30.674 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.672+0000 7f6553b89700 1 --2- 172.21.15.134:0/1503982369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 0x7f654c070030 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:30.674 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.672+0000 7f6553b89700 1 -- 172.21.15.134:0/1503982369 >> 172.21.15.134:0/1503982369 conn(0x7f654c0f7f50 msgr2=0x7f654c0fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:30.674 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.672+0000 7f6553b89700 1 -- 172.21.15.134:0/1503982369 shutdown_connections 2023-12-05T09:19:30.674 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.672+0000 7f6553b89700 1 -- 172.21.15.134:0/1503982369 wait complete. 2023-12-05T09:19:30.675 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.673+0000 7f6553b89700 1 Processor -- start 2023-12-05T09:19:30.675 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.673+0000 7f6553b89700 1 -- start start 2023-12-05T09:19:30.675 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.673+0000 7f6553b89700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 0x7f654c113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:30.675 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.673+0000 7f6553b89700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c113580 con 0x7f654c071bc0 2023-12-05T09:19:30.675 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f6551925700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 0x7f654c113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:30.675 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f6551925700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 0x7f654c113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:54472/0 (socket says 172.21.15.134:54472) 2023-12-05T09:19:30.676 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f6551925700 1 -- 172.21.15.134:0/2035473331 learned_addr learned my addr 172.21.15.134:0/2035473331 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:30.676 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f6551925700 1 -- 172.21.15.134:0/2035473331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6548005040 con 0x7f654c071bc0 2023-12-05T09:19:30.676 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f6551925700 1 --2- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 0x7f654c113040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6548009040 tx=0x7f6548009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:30.676 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f65427fc700 1 -- 172.21.15.134:0/2035473331 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6548009620 con 0x7f654c071bc0 2023-12-05T09:19:30.676 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f65427fc700 1 -- 172.21.15.134:0/2035473331 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6548009780 con 0x7f654c071bc0 2023-12-05T09:19:30.676 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f65427fc700 1 -- 172.21.15.134:0/2035473331 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f654801c5b0 con 0x7f654c071bc0 2023-12-05T09:19:30.677 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.674+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c113780 con 0x7f654c071bc0 2023-12-05T09:19:30.677 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.675+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c114420 con 0x7f654c071bc0 2023-12-05T09:19:30.677 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.676+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c05f270 con 0x7f654c071bc0 2023-12-05T09:19:30.677 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.676+0000 7f65427fc700 1 -- 172.21.15.134:0/2035473331 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f6548013420 con 0x7f654c071bc0 2023-12-05T09:19:30.677 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.676+0000 7f65427fc700 1 --2- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f65380367c0 0x7f6538038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:30.677 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.676+0000 7f65427fc700 1 -- 172.21.15.134:0/2035473331 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6548049b00 con 0x7f654c071bc0 2023-12-05T09:19:30.678 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.676+0000 7f6551124700 1 --2- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f65380367c0 0x7f6538038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:30.678 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.677+0000 7f6551124700 1 --2- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f65380367c0 0x7f6538038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f653c009990 tx=0x7f653c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.681+0000 7f65427fc700 1 -- 172.21.15.134:0/2035473331 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f65480119c0 con 0x7f654c071bc0 2023-12-05T09:19:30.956 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.955+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f654c114f90 con 0x7f654c071bc0 2023-12-05T09:19:30.958 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.956+0000 7f65427fc700 1 -- 172.21.15.134:0/2035473331 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6548011370 con 0x7f654c071bc0 2023-12-05T09:19:30.958 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:30.958 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f65380367c0 msgr2=0x7f6538038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 --2- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f65380367c0 0x7f6538038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f653c009990 tx=0x7f653c006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 msgr2=0x7f654c113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 --2- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 0x7f654c113040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6548009040 tx=0x7f6548009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 shutdown_connections 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 --2- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f65380367c0 0x7f6538038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 --2- 172.21.15.134:0/2035473331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f654c071bc0 0x7f654c113040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 >> 172.21.15.134:0/2035473331 conn(0x7f654c0f7f50 msgr2=0x7f654c0f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 shutdown_connections 2023-12-05T09:19:30.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:30.958+0000 7f6553b89700 1 -- 172.21.15.134:0/2035473331 wait complete. 2023-12-05T09:19:30.961 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:31 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:31 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:31 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/2035473331' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:32.381 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:32.381 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:32.804 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:32.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:32.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:32.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:19:32.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:32.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:32.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:32.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:32.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:19:32.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:32.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:19:32.897 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-05T09:19:33.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:33 smithi067 ceph-mon[107174]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:19:33.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:33 smithi067 ceph-mon[107174]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:19:34.066 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.064+0000 7fab31c17700 1 -- 172.21.15.134:0/1354174492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 msgr2=0x7fab2c102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:34.066 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.064+0000 7fab31c17700 1 --2- 172.21.15.134:0/1354174492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 0x7fab2c102ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0048c0 tx=0x7fab1c009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:34.066 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.064+0000 7fab31c17700 1 -- 172.21.15.134:0/1354174492 shutdown_connections 2023-12-05T09:19:34.066 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.064+0000 7fab31c17700 1 --2- 172.21.15.134:0/1354174492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 0x7fab2c102ca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:34.066 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.064+0000 7fab31c17700 1 -- 172.21.15.134:0/1354174492 >> 172.21.15.134:0/1354174492 conn(0x7fab2c0f8410 msgr2=0x7fab2c0fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:34.066 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.064+0000 7fab31c17700 1 -- 172.21.15.134:0/1354174492 shutdown_connections 2023-12-05T09:19:34.066 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.064+0000 7fab31c17700 1 -- 172.21.15.134:0/1354174492 wait complete. 2023-12-05T09:19:34.067 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.065+0000 7fab31c17700 1 Processor -- start 2023-12-05T09:19:34.067 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.065+0000 7fab31c17700 1 -- start start 2023-12-05T09:19:34.067 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.066+0000 7fab31c17700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 0x7fab2c114ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:34.067 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.066+0000 7fab31c17700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c115400 con 0x7fab2c1028d0 2023-12-05T09:19:34.067 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.066+0000 7fab2b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 0x7fab2c114ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:34.068 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.066+0000 7fab2b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 0x7fab2c114ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:54484/0 (socket says 172.21.15.134:54484) 2023-12-05T09:19:34.068 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.066+0000 7fab2b7fe700 1 -- 172.21.15.134:0/3822310929 learned_addr learned my addr 172.21.15.134:0/3822310929 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:34.068 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.066+0000 7fab2b7fe700 1 -- 172.21.15.134:0/3822310929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c005040 con 0x7fab2c1028d0 2023-12-05T09:19:34.068 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.067+0000 7fab2b7fe700 1 --2- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 0x7fab2c114ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009040 tx=0x7fab1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:34.068 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.067+0000 7fab13fff700 1 -- 172.21.15.134:0/3822310929 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab1c004e60 con 0x7fab2c1028d0 2023-12-05T09:19:34.068 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.067+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c115600 con 0x7fab2c1028d0 2023-12-05T09:19:34.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.067+0000 7fab13fff700 1 -- 172.21.15.134:0/3822310929 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab1c009650 con 0x7fab2c1028d0 2023-12-05T09:19:34.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.067+0000 7fab13fff700 1 -- 172.21.15.134:0/3822310929 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab1c01c3f0 con 0x7fab2c1028d0 2023-12-05T09:19:34.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.067+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c115a70 con 0x7fab2c1028d0 2023-12-05T09:19:34.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.068+0000 7fab13fff700 1 -- 172.21.15.134:0/3822310929 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fab1c01c6b0 con 0x7fab2c1028d0 2023-12-05T09:19:34.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.068+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c05f270 con 0x7fab2c1028d0 2023-12-05T09:19:34.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.068+0000 7fab13fff700 1 --2- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fab140367c0 0x7fab14038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:34.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.069+0000 7fab13fff700 1 -- 172.21.15.134:0/3822310929 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fab1c049ad0 con 0x7fab2c1028d0 2023-12-05T09:19:34.070 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.069+0000 7fab2affd700 1 --2- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fab140367c0 0x7fab14038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:34.071 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.069+0000 7fab2affd700 1 --2- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fab140367c0 0x7fab14038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab20009990 tx=0x7fab20006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:34.075 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.074+0000 7fab13fff700 1 -- 172.21.15.134:0/3822310929 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fab1c025400 con 0x7fab2c1028d0 2023-12-05T09:19:34.358 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.357+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fab2c110530 con 0x7fab2c1028d0 2023-12-05T09:19:34.358 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.357+0000 7fab13fff700 1 -- 172.21.15.134:0/3822310929 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fab1c011370 con 0x7fab2c1028d0 2023-12-05T09:19:34.359 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:34.359 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:34.362 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.359+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fab140367c0 msgr2=0x7fab14038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:34.362 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.359+0000 7fab31c17700 1 --2- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fab140367c0 0x7fab14038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fab20009990 tx=0x7fab20006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:34.362 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.360+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 msgr2=0x7fab2c114ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:34.362 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.360+0000 7fab31c17700 1 --2- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 0x7fab2c114ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009040 tx=0x7fab1c009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:34.362 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.360+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 shutdown_connections 2023-12-05T09:19:34.362 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.360+0000 7fab31c17700 1 --2- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fab140367c0 0x7fab14038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:34.363 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.360+0000 7fab31c17700 1 --2- 172.21.15.134:0/3822310929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab2c1028d0 0x7fab2c114ec0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:34.363 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.360+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 >> 172.21.15.134:0/3822310929 conn(0x7fab2c0f8410 msgr2=0x7fab2c0fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:34.363 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.360+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 shutdown_connections 2023-12-05T09:19:34.363 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:34.360+0000 7fab31c17700 1 -- 172.21.15.134:0/3822310929 wait complete. 2023-12-05T09:19:34.364 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:34.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:34 smithi067 ceph-mon[107174]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:34.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:34 smithi067 ceph-mon[107174]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:34.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:34 smithi067 ceph-mon[107174]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:19:34.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:34 smithi067 ceph-mon[107174]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:19:34.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:34 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3822310929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:35.743 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:35.744 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:35.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:19:35.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:19:35.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:35.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:35.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:35.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:35.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:35.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:19:35.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T09:19:35.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:35.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:35 smithi067 ceph-mon[107174]: Deploying daemon crash.smithi134 on smithi134 2023-12-05T09:19:36.241 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.662+0000 7fe002f7b700 1 -- 172.21.15.134:0/3116824657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 msgr2=0x7fdffc0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.662+0000 7fe002f7b700 1 --2- 172.21.15.134:0/3116824657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 0x7fdffc0703b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdff80048c0 tx=0x7fdff8009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.662+0000 7fe002f7b700 1 -- 172.21.15.134:0/3116824657 shutdown_connections 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.662+0000 7fe002f7b700 1 --2- 172.21.15.134:0/3116824657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 0x7fdffc0703b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.662+0000 7fe002f7b700 1 -- 172.21.15.134:0/3116824657 >> 172.21.15.134:0/3116824657 conn(0x7fdffc0f8260 msgr2=0x7fdffc0fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.662+0000 7fe002f7b700 1 -- 172.21.15.134:0/3116824657 shutdown_connections 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.662+0000 7fe002f7b700 1 -- 172.21.15.134:0/3116824657 wait complete. 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.663+0000 7fe002f7b700 1 Processor -- start 2023-12-05T09:19:37.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.663+0000 7fe002f7b700 1 -- start start 2023-12-05T09:19:37.666 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.664+0000 7fe002f7b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 0x7fdffc114c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:37.666 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.664+0000 7fe002f7b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc115160 con 0x7fdffc06ffe0 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.664+0000 7fe001f79700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 0x7fdffc114c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.664+0000 7fe001f79700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 0x7fdffc114c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:36446/0 (socket says 172.21.15.134:36446) 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.664+0000 7fe001f79700 1 -- 172.21.15.134:0/1956557237 learned_addr learned my addr 172.21.15.134:0/1956557237 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.665+0000 7fe001f79700 1 -- 172.21.15.134:0/1956557237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8005040 con 0x7fdffc06ffe0 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.665+0000 7fe001f79700 1 --2- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 0x7fdffc114c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009040 tx=0x7fdff8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.665+0000 7fdff27fc700 1 -- 172.21.15.134:0/1956557237 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdff8004e60 con 0x7fdffc06ffe0 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.665+0000 7fdff27fc700 1 -- 172.21.15.134:0/1956557237 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdff8009650 con 0x7fdffc06ffe0 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.665+0000 7fdff27fc700 1 -- 172.21.15.134:0/1956557237 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdff801c3f0 con 0x7fdffc06ffe0 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.665+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc115360 con 0x7fdffc06ffe0 2023-12-05T09:19:37.667 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.665+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc1157d0 con 0x7fdffc06ffe0 2023-12-05T09:19:37.668 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.667+0000 7fdff27fc700 1 -- 172.21.15.134:0/1956557237 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7fdff80097c0 con 0x7fdffc06ffe0 2023-12-05T09:19:37.668 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.667+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc05f270 con 0x7fdffc06ffe0 2023-12-05T09:19:37.668 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.667+0000 7fdff27fc700 1 --2- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fdfe80367c0 0x7fdfe8038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:37.669 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.667+0000 7fdff27fc700 1 -- 172.21.15.134:0/1956557237 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdff8049a80 con 0x7fdffc06ffe0 2023-12-05T09:19:37.669 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.668+0000 7fe001778700 1 --2- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fdfe80367c0 0x7fdfe8038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:37.670 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.669+0000 7fe001778700 1 --2- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fdfe80367c0 0x7fdfe8038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009990 tx=0x7fdfec006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:37.674 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.673+0000 7fdff27fc700 1 -- 172.21.15.134:0/1956557237 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdff8011940 con 0x7fdffc06ffe0 2023-12-05T09:19:37.958 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.954+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdffc108ad0 con 0x7fdffc06ffe0 2023-12-05T09:19:37.958 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.955+0000 7fdff27fc700 1 -- 172.21.15.134:0/1956557237 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fdff8011370 con 0x7fdffc06ffe0 2023-12-05T09:19:37.958 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:37.958 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:37.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.957+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fdfe80367c0 msgr2=0x7fdfe8038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:37.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.957+0000 7fe002f7b700 1 --2- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fdfe80367c0 0x7fdfe8038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009990 tx=0x7fdfec006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:37.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.957+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 msgr2=0x7fdffc114c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:37.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.958+0000 7fe002f7b700 1 --2- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 0x7fdffc114c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009040 tx=0x7fdff8009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:37.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.958+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 shutdown_connections 2023-12-05T09:19:37.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.958+0000 7fe002f7b700 1 --2- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fdfe80367c0 0x7fdfe8038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:37.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.958+0000 7fe002f7b700 1 --2- 172.21.15.134:0/1956557237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdffc06ffe0 0x7fdffc114c20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:37.959 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.958+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 >> 172.21.15.134:0/1956557237 conn(0x7fdffc0f8260 msgr2=0x7fdffc103220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:37.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.958+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 shutdown_connections 2023-12-05T09:19:37.960 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:37.958+0000 7fe002f7b700 1 -- 172.21.15.134:0/1956557237 wait complete. 2023-12-05T09:19:37.960 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:38 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:38 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:38 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:38 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:39.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:38 smithi067 ceph-mon[107174]: Deploying daemon node-exporter.smithi134 on smithi134 2023-12-05T09:19:39.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:38 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/1956557237' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:39.337 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:39.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:39.742 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.713+0000 7f8769e34700 1 -- 172.21.15.134:0/1867199543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 msgr2=0x7f8764102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.713+0000 7f8769e34700 1 --2- 172.21.15.134:0/1867199543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 0x7f8764102ca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f87540048c0 tx=0x7f8754009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.713+0000 7f8769e34700 1 -- 172.21.15.134:0/1867199543 shutdown_connections 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.713+0000 7f8769e34700 1 --2- 172.21.15.134:0/1867199543 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 0x7f8764102ca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.713+0000 7f8769e34700 1 -- 172.21.15.134:0/1867199543 >> 172.21.15.134:0/1867199543 conn(0x7f87640f8410 msgr2=0x7f87640fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.713+0000 7f8769e34700 1 -- 172.21.15.134:0/1867199543 shutdown_connections 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.713+0000 7f8769e34700 1 -- 172.21.15.134:0/1867199543 wait complete. 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.714+0000 7f8769e34700 1 Processor -- start 2023-12-05T09:19:41.715 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.714+0000 7f8769e34700 1 -- start start 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.714+0000 7f8769e34700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 0x7f8764114df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.714+0000 7f8769e34700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8764115330 con 0x7f87641028d0 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.714+0000 7f87637fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 0x7f8764114df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.714+0000 7f87637fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 0x7f8764114df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:36458/0 (socket says 172.21.15.134:36458) 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.714+0000 7f87637fe700 1 -- 172.21.15.134:0/4202311899 learned_addr learned my addr 172.21.15.134:0/4202311899 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.715+0000 7f87637fe700 1 -- 172.21.15.134:0/4202311899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754005040 con 0x7f87641028d0 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.715+0000 7f87637fe700 1 --2- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 0x7f8764114df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8754009040 tx=0x7f8754009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.715+0000 7f874bfff700 1 -- 172.21.15.134:0/4202311899 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8754004e60 con 0x7f87641028d0 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.715+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8764115530 con 0x7f87641028d0 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.715+0000 7f874bfff700 1 -- 172.21.15.134:0/4202311899 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8754009650 con 0x7f87641028d0 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.715+0000 7f874bfff700 1 -- 172.21.15.134:0/4202311899 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f875401c3f0 con 0x7f87641028d0 2023-12-05T09:19:41.717 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.716+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87641159a0 con 0x7f87641028d0 2023-12-05T09:19:41.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.716+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876405f270 con 0x7f87641028d0 2023-12-05T09:19:41.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.717+0000 7f874bfff700 1 -- 172.21.15.134:0/4202311899 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f87540097c0 con 0x7f87641028d0 2023-12-05T09:19:41.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.717+0000 7f874bfff700 1 --2- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f874c036810 0x7f874c038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:41.718 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.717+0000 7f874bfff700 1 -- 172.21.15.134:0/4202311899 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f8754049a50 con 0x7f87641028d0 2023-12-05T09:19:41.719 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.717+0000 7f8762ffd700 1 --2- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f874c036810 0x7f874c038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:41.719 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.718+0000 7f8762ffd700 1 --2- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f874c036810 0x7f874c038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8758009990 tx=0x7f8758006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:41.724 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:41.723+0000 7f874bfff700 1 -- 172.21.15.134:0/4202311899 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8754011940 con 0x7f87641028d0 2023-12-05T09:19:42.004 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.002+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8764106a80 con 0x7f87641028d0 2023-12-05T09:19:42.004 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.003+0000 7f874bfff700 1 -- 172.21.15.134:0/4202311899 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8754011370 con 0x7f87641028d0 2023-12-05T09:19:42.004 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:42.004 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f874c036810 msgr2=0x7f874c038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 --2- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f874c036810 0x7f874c038cc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8758009990 tx=0x7f8758006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 msgr2=0x7f8764114df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 --2- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 0x7f8764114df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8754009040 tx=0x7f8754009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 shutdown_connections 2023-12-05T09:19:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 --2- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f874c036810 0x7f874c038cc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:42.007 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 --2- 172.21.15.134:0/4202311899 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87641028d0 0x7f8764114df0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:42.008 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 >> 172.21.15.134:0/4202311899 conn(0x7f87640f8410 msgr2=0x7f876406fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:42.008 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 shutdown_connections 2023-12-05T09:19:42.008 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:42.006+0000 7f8769e34700 1 -- 172.21.15.134:0/4202311899 wait complete. 2023-12-05T09:19:42.008 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:42.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:42 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:42.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:42 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:19:42.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:42 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/4202311899' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:43.416 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:43.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:43.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:43.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:43.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:43.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:43.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:19:43.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-05T09:19:43.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:19:43.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:43.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:43 smithi067 ceph-mon[107174]: Deploying daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:19:44.066 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.411+0000 7f215ece5700 1 -- 172.21.15.134:0/1369016923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 msgr2=0x7f2158102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.411+0000 7f215ece5700 1 --2- 172.21.15.134:0/1369016923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 0x7f2158102ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f214c0048c0 tx=0x7f214c009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.411+0000 7f215ece5700 1 -- 172.21.15.134:0/1369016923 shutdown_connections 2023-12-05T09:19:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.411+0000 7f215ece5700 1 --2- 172.21.15.134:0/1369016923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 0x7f2158102ca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.411+0000 7f215ece5700 1 -- 172.21.15.134:0/1369016923 >> 172.21.15.134:0/1369016923 conn(0x7f21580f8410 msgr2=0x7f21580fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.411+0000 7f215ece5700 1 -- 172.21.15.134:0/1369016923 shutdown_connections 2023-12-05T09:19:45.413 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.411+0000 7f215ece5700 1 -- 172.21.15.134:0/1369016923 wait complete. 2023-12-05T09:19:45.414 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.412+0000 7f215ece5700 1 Processor -- start 2023-12-05T09:19:45.414 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.413+0000 7f215ece5700 1 -- start start 2023-12-05T09:19:45.414 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.413+0000 7f215ece5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 0x7f2158112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:45.414 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.413+0000 7f215ece5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21581130a0 con 0x7f21581028d0 2023-12-05T09:19:45.415 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.414+0000 7f215ca81700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 0x7f2158112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:45.415 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.414+0000 7f215ca81700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 0x7f2158112b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:36488/0 (socket says 172.21.15.134:36488) 2023-12-05T09:19:45.415 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.414+0000 7f215ca81700 1 -- 172.21.15.134:0/1990829076 learned_addr learned my addr 172.21.15.134:0/1990829076 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:45.415 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.414+0000 7f215ca81700 1 -- 172.21.15.134:0/1990829076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c005040 con 0x7f21581028d0 2023-12-05T09:19:45.415 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.414+0000 7f215ca81700 1 --2- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 0x7f2158112b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f214c009040 tx=0x7f214c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:45.416 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.415+0000 7f21557fa700 1 -- 172.21.15.134:0/1990829076 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c004e60 con 0x7f21581028d0 2023-12-05T09:19:45.416 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.415+0000 7f21557fa700 1 -- 172.21.15.134:0/1990829076 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f214c009650 con 0x7f21581028d0 2023-12-05T09:19:45.416 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.415+0000 7f21557fa700 1 -- 172.21.15.134:0/1990829076 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f214c01c3f0 con 0x7f21581028d0 2023-12-05T09:19:45.416 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.415+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21581132a0 con 0x7f21581028d0 2023-12-05T09:19:45.416 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.415+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215810ca20 con 0x7f21581028d0 2023-12-05T09:19:45.417 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.416+0000 7f21557fa700 1 -- 172.21.15.134:0/1990829076 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 17) v1 ==== 43394+0+0 (secure 0 0 0) 0x7f214c0097c0 con 0x7f21581028d0 2023-12-05T09:19:45.417 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.416+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215805f270 con 0x7f21581028d0 2023-12-05T09:19:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.416+0000 7f21557fa700 1 --2- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2148036810 0x7f2148038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.417+0000 7f21557fa700 1 -- 172.21.15.134:0/1990829076 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f214c049a50 con 0x7f21581028d0 2023-12-05T09:19:45.418 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.417+0000 7f2157fff700 1 --2- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2148036810 0x7f2148038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:45.419 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.418+0000 7f2157fff700 1 --2- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2148036810 0x7f2148038cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2144009990 tx=0x7f2144006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:45.423 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.422+0000 7f21557fa700 1 -- 172.21.15.134:0/1990829076 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f214c011940 con 0x7f21581028d0 2023-12-05T09:19:45.719 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.717+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f215810e140 con 0x7f21581028d0 2023-12-05T09:19:45.719 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.718+0000 7f21557fa700 1 -- 172.21.15.134:0/1990829076 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f214c011370 con 0x7f21581028d0 2023-12-05T09:19:45.719 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:45.720 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:17:18.966266Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.720+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2148036810 msgr2=0x7f2148038cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.720+0000 7f215ece5700 1 --2- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2148036810 0x7f2148038cc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2144009990 tx=0x7f2144006e40 comp rx=0 tx=0).stop 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.720+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 msgr2=0x7f2158112b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.720+0000 7f215ece5700 1 --2- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 0x7f2158112b60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f214c009040 tx=0x7f214c009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.721+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 shutdown_connections 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.721+0000 7f215ece5700 1 --2- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2148036810 0x7f2148038cc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.721+0000 7f215ece5700 1 --2- 172.21.15.134:0/1990829076 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f21581028d0 0x7f2158112b60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.721+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 >> 172.21.15.134:0/1990829076 conn(0x7f21580f8410 msgr2=0x7f21580fa3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:45.722 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.721+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 shutdown_connections 2023-12-05T09:19:45.723 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:45.721+0000 7f215ece5700 1 -- 172.21.15.134:0/1990829076 wait complete. 2023-12-05T09:19:45.723 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2023-12-05T09:19:46.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:46.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:46.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:46.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:46.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:19:46.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:46.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:45 smithi067 ceph-mon[107174]: Deploying daemon mon.smithi134 on smithi134 2023-12-05T09:19:46.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:45 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/1990829076' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:47.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:47 smithi067 ceph-mon[107174]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:47.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:47 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:47.416 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-05T09:19:47.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-05T09:19:47.590 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:47 smithi134 systemd[1]: Starting Ceph mon.smithi134 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:19:47.930 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi134/config 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 bash[116193]: 5969c837b156686cb5b33586e59cae7fbb029d026a3e4ef00dc94c58491daec8 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 systemd[1]: Started Ceph mon.smithi134 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable), process ceph-mon, pid 8 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pidfile_write: ignore empty --pid-file 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: load: jerasure load: lrc 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: RocksDB version: 6.15.5 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Compile date Dec 4 2023 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: DB SUMMARY 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: DB Session ID: VCQTB3D2VVJMOR8K7317 2023-12-05T09:19:48.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: CURRENT file: CURRENT 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 0, files: 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000004.log size: 511 ; 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.error_if_exists: 0 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.create_if_missing: 0 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.paranoid_checks: 1 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.env: 0x564074ff5a80 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.fs: Posix File System 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.info_log: 0x564076e84780 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T09:19:48.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.statistics: (nil) 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.use_fsync: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_log_file_size: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.allow_fallocate: 1 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.use_direct_reads: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.db_log_dir: 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi134/store.db 2023-12-05T09:19:48.383 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.write_buffer_manager: 0x564077bf49f0 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T09:19:48.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.unordered_write: 0 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.row_cache: None 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.wal_filter: None 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.preserve_deletes: 0 2023-12-05T09:19:48.385 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.two_write_queues: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.atomic_flush: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.log_readahead_size: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_background_jobs: 2 2023-12-05T09:19:48.386 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_background_compactions: -1 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_subcompactions: 1 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_open_files: -1 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_background_flushes: -1 2023-12-05T09:19:48.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Compression algorithms supported: 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: kZSTD supported: 0 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: kXpressCompression supported: 0 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: kZlibCompression supported: 1 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: kSnappyCompression supported: 1 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: kLZ4Compression supported: 1 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: kBZip2Compression supported: 0 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000003 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.merge_operator: 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_filter: None 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T09:19:48.388 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564076ed4f90) 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: hash_index_allow_collision: 1 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 1 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x564076f07090 2023-12-05T09:19:48.389 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-05T09:19:48.390 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 4 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compression: NoCompression 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.num_levels: 7 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T09:19:48.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T09:19:48.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T09:19:48.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T09:19:48.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:19:48.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T09:19:48.393 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T09:19:48.394 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.arena_block_size: 4194304 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T09:19:48.395 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.table_properties_collectors: 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.inplace_update_support: 0 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.bloom_locality: 0 2023-12-05T09:19:48.396 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.max_successive_merges: 0 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.ttl: 2592000 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.enable_blob_files: false 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.min_blob_size: 0 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2023-12-05T09:19:48.397 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701767988263391, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701767988264083, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701767988, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "ca10c269-5413-4ba3-afb1-fa3b564fe00c", "db_session_id": "VCQTB3D2VVJMOR8K7317"}} 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701767988264881, "job": 1, "event": "recovery_finished"} 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x564076e9b180 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: DB pointer 0x564076f70000 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:19:48.398 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2023-12-05T09:19:48.399 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2023-12-05T09:19:48.400 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.3 0.00 0.00 1 0.001 0 0 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:19:48.401 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 0.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134 does not exist in monmap, will attempt to join an existing cluster 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: using public_addr v2:172.21.15.134:0/0 -> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: starting mon.smithi134 rank -1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(???) e0 preinit fsid f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).mds e1 new map 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).mds e1 print_map 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e1 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:19:48.402 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: -1 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: No filesystems configured 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-05T09:19:48.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Deploying cephadm binary to smithi134 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Added host smithi134 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Deploying daemon alertmanager.smithi067 on smithi067 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/1966899656' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/1966899656' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-05T09:19:48.404 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: osdmap e4: 0 total, 0 up, 0 in 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Deploying daemon grafana.smithi067 on smithi067 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi067:172.21.15.67=smithi067;smithi134:172.21.15.134=smithi134", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Saving service mon spec with placement smithi067:172.21.15.67=smithi067;smithi134:172.21.15.134=smithi134;count:2 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.405 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/2137712920' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3003761734' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/1343100608' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3292185530' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.406 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Deploying daemon prometheus.smithi067 on smithi067 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/1750549974' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/1903673005' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/23825501' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14164 172.21.15.67:0/2174850947' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mgrmap e14: smithi067.alxtvv(active, since 53s) 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/4155382834' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/1917844857' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/320099187' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Active manager daemon smithi067.alxtvv restarted 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mgrmap e15: smithi067.alxtvv(active, starting, since 0.00366132s) 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:19:48.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: [05/Dec/2023:09:19:26] ENGINE Bus STARTING 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: [05/Dec/2023:09:19:26] ENGINE Serving on https://172.21.15.67:7150 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: [05/Dec/2023:09:19:26] ENGINE Bus STARTED 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.409 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mgrmap e16: smithi067.alxtvv(active, since 1.00962s) 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3978800700' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mgrmap e17: smithi067.alxtvv(active, since 2s) 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/2035473331' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.410 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3822310929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Deploying daemon crash.smithi134 on smithi134 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Deploying daemon node-exporter.smithi134 on smithi134 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/1956557237' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/4202311899' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Deploying daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: Deploying daemon mon.smithi134 on smithi134 2023-12-05T09:19:48.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/1990829076' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:48.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:48.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:48.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-05T09:19:48.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:48 smithi134 ceph-mon[116304]: mon.smithi134@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-05T09:19:53.518 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.515+0000 7f09cc255700 1 -- 172.21.15.134:0/176161369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09b0003580 msgr2=0x7f09b0005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:53.518 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.515+0000 7f09cc255700 1 --2- 172.21.15.134:0/176161369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09b0003580 0x7f09b0005a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f09c40fc8c0 tx=0x7f09c0002040 comp rx=0 tx=0).stop 2023-12-05T09:19:53.519 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.515+0000 7f09cc255700 1 -- 172.21.15.134:0/176161369 shutdown_connections 2023-12-05T09:19:53.519 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.515+0000 7f09cc255700 1 --2- 172.21.15.134:0/176161369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09b0003580 0x7f09b0005a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:53.519 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.515+0000 7f09cc255700 1 -- 172.21.15.134:0/176161369 >> 172.21.15.134:0/176161369 conn(0x7f09c40f8510 msgr2=0x7f09c40fa920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:53.519 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.515+0000 7f09cc255700 1 -- 172.21.15.134:0/176161369 shutdown_connections 2023-12-05T09:19:53.519 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.515+0000 7f09cc255700 1 -- 172.21.15.134:0/176161369 wait complete. 2023-12-05T09:19:53.519 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.516+0000 7f09cc255700 1 Processor -- start 2023-12-05T09:19:53.519 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.516+0000 7f09cc255700 1 -- start start 2023-12-05T09:19:53.519 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.516+0000 7f09cc255700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 0x7f09c406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:53.520 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.516+0000 7f09cc255700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c4070480 0x7f09c40708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:53.520 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.516+0000 7f09cc255700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4118fb0 con 0x7f09c4070480 2023-12-05T09:19:53.520 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.516+0000 7f09cc255700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c41190f0 con 0x7f09b0003580 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c97f0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c4070480 0x7f09c40708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c97f0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c4070480 0x7f09c40708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.134:58750/0 (socket says 172.21.15.134:58750) 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c97f0700 1 -- 172.21.15.134:0/3157557942 learned_addr learned my addr 172.21.15.134:0/3157557942 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c9ff1700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 0x7f09c406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c9ff1700 1 -- 172.21.15.134:0/3157557942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 msgr2=0x7f09c406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c9ff1700 1 -- 172.21.15.134:0/3157557942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 msgr2=0x7f09c406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c9ff1700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 0x7f09c406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c9ff1700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 0x7f09c406ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:19:53.522 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c97f0700 1 -- 172.21.15.134:0/3157557942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 msgr2=0x7f09c406ff40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:19:53.523 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c97f0700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 0x7f09c406ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:53.523 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c97f0700 1 -- 172.21.15.134:0/3157557942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c0005040 con 0x7f09c4070480 2023-12-05T09:19:53.523 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.517+0000 7f09c97f0700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c4070480 0x7f09c40708d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f09b400b790 tx=0x7f09b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:53.523 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.518+0000 7f09ba7fc700 1 -- 172.21.15.134:0/3157557942 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09b4010870 con 0x7f09c4070480 2023-12-05T09:19:53.523 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.518+0000 7f09ba7fc700 1 -- 172.21.15.134:0/3157557942 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f09b4010e80 con 0x7f09c4070480 2023-12-05T09:19:53.523 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.518+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c4119380 con 0x7f09c4070480 2023-12-05T09:19:53.523 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.518+0000 7f09ba7fc700 1 -- 172.21.15.134:0/3157557942 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09b400d3b0 con 0x7f09c4070480 2023-12-05T09:19:53.523 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.518+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c41198c0 con 0x7f09c4070480 2023-12-05T09:19:53.524 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.519+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c405f270 con 0x7f09c4070480 2023-12-05T09:19:53.524 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.520+0000 7f09ba7fc700 1 -- 172.21.15.134:0/3157557942 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f09b400f3e0 con 0x7f09c4070480 2023-12-05T09:19:53.524 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.520+0000 7f09ba7fc700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f09a8069020 0x7f09a806b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:53.524 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.521+0000 7f09ba7fc700 1 -- 172.21.15.134:0/3157557942 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f09b40862a0 con 0x7f09c4070480 2023-12-05T09:19:53.525 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.521+0000 7f09c9ff1700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f09a8069020 0x7f09a806b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:53.525 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.521+0000 7f09c9ff1700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f09a8069020 0x7f09a806b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f09c00047e0 tx=0x7f09c0019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:53.527 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.525+0000 7f09ba7fc700 1 -- 172.21.15.134:0/3157557942 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f09b40537b0 con 0x7f09c4070480 2023-12-05T09:19:53.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:53.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:19:53.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: mon.smithi067 calling monitor election 2023-12-05T09:19:53.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:53.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: mon.smithi134 calling monitor election 2023-12-05T09:19:53.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:53.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/1516786688' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:19:53.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: mon.smithi067 is new leader, mons smithi067,smithi134 in quorum (ranks 0,1) 2023-12-05T09:19:53.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: monmap e2: 2 mons at {smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:19:53.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: fsmap 2023-12-05T09:19:53.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T09:19:53.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: mgrmap e17: smithi067.alxtvv(active, since 27s) 2023-12-05T09:19:53.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: Standby manager daemon smithi134.yfqkak started 2023-12-05T09:19:53.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/1516786688' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:19:53.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: overall HEALTH_OK 2023-12-05T09:19:53.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/1516786688' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:19:53.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/1516786688' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:19:53.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:53.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:53 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:53.829 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.826+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f09c4119b90 con 0x7f09c4070480 2023-12-05T09:19:53.830 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.827+0000 7f09ba7fc700 1 -- 172.21.15.134:0/3157557942 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f09b4014410 con 0x7f09c4070480 2023-12-05T09:19:53.830 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-05T09:19:53.830 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","modified":"2023-12-05T09:19:48.316652Z","created":"2023-12-05T09:17:18.966266Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-05T09:19:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f09a8069020 msgr2=0x7f09a806b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f09a8069020 0x7f09a806b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f09c00047e0 tx=0x7f09c0019040 comp rx=0 tx=0).stop 2023-12-05T09:19:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c4070480 msgr2=0x7f09c40708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c4070480 0x7f09c40708d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f09b400b790 tx=0x7f09b4009250 comp rx=0 tx=0).stop 2023-12-05T09:19:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 shutdown_connections 2023-12-05T09:19:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f09a8069020 0x7f09a806b4d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09b0003580 0x7f09c406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:53.833 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 --2- 172.21.15.134:0/3157557942 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09c4070480 0x7f09c40708d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 >> 172.21.15.134:0/3157557942 conn(0x7f09c40f8510 msgr2=0x7f09c40fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 shutdown_connections 2023-12-05T09:19:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:19:53.830+0000 7f09cc255700 1 -- 172.21.15.134:0/3157557942 wait complete. 2023-12-05T09:19:53.834 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2023-12-05T09:19:53.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:53.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:19:53.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: mon.smithi067 calling monitor election 2023-12-05T09:19:53.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:53.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.873 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: mon.smithi134 calling monitor election 2023-12-05T09:19:53.873 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.873 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:53.873 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.873 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/1516786688' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:19:53.873 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:53.873 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: mon.smithi067 is new leader, mons smithi067,smithi134 in quorum (ranks 0,1) 2023-12-05T09:19:53.874 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: monmap e2: 2 mons at {smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:19:53.874 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: fsmap 2023-12-05T09:19:53.874 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: osdmap e5: 0 total, 0 up, 0 in 2023-12-05T09:19:53.874 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: mgrmap e17: smithi067.alxtvv(active, since 27s) 2023-12-05T09:19:53.874 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: Standby manager daemon smithi134.yfqkak started 2023-12-05T09:19:53.874 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/1516786688' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:19:53.875 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: overall HEALTH_OK 2023-12-05T09:19:53.875 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/1516786688' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:19:53.875 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/1516786688' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:19:53.875 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:53.875 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:53 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:54.198 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-05T09:19:54.198 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph config generate-minimal-conf 2023-12-05T09:19:54.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:54 smithi067 ceph-mon[107174]: mgrmap e18: smithi067.alxtvv(active, since 27s), standbys: smithi134.yfqkak 2023-12-05T09:19:54.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:54 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.yfqkak", "id": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:19:54.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:54 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:54.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:54 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:54.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:54 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:54.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:54 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:19:54.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:54 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3157557942' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:54.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:54 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:54.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:54 smithi134 ceph-mon[116304]: mgrmap e18: smithi067.alxtvv(active, since 27s), standbys: smithi134.yfqkak 2023-12-05T09:19:54.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:54 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.yfqkak", "id": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:19:54.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:54 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:54.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:54 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:54.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:54 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:54.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:54 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:19:54.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:54 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3157557942' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-05T09:19:54.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:54 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:19:54.637 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:19:55.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:55 smithi067 ceph-mon[107174]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.833+0000 7f0bf189f700 1 -- 172.21.15.67:0/2718503584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec1028d0 msgr2=0x7f0bec102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.833+0000 7f0bf189f700 1 --2- 172.21.15.67:0/2718503584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec1028d0 0x7f0bec102ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0048c0 tx=0x7f0bdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.833+0000 7f0bf189f700 1 -- 172.21.15.67:0/2718503584 shutdown_connections 2023-12-05T09:19:55.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.833+0000 7f0bf189f700 1 --2- 172.21.15.67:0/2718503584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec1028d0 0x7f0bec102ca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:55.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.833+0000 7f0bf189f700 1 -- 172.21.15.67:0/2718503584 >> 172.21.15.67:0/2718503584 conn(0x7f0bec0f8410 msgr2=0x7f0bec0fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:55.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.833+0000 7f0bf189f700 1 -- 172.21.15.67:0/2718503584 shutdown_connections 2023-12-05T09:19:55.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.833+0000 7f0bf189f700 1 -- 172.21.15.67:0/2718503584 wait complete. 2023-12-05T09:19:55.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.834+0000 7f0bf189f700 1 Processor -- start 2023-12-05T09:19:55.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.835+0000 7f0bf189f700 1 -- start start 2023-12-05T09:19:55.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.835+0000 7f0bf189f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 0x7f0bec06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:55.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.835+0000 7f0bf189f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec070480 0x7f0bec0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:55.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.835+0000 7f0bf189f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec118f70 con 0x7f0bec070480 2023-12-05T09:19:55.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.835+0000 7f0bf189f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec1190b0 con 0x7f0bec1028d0 2023-12-05T09:19:55.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0bea7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec070480 0x7f0bec0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:55.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0bea7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec070480 0x7f0bec0708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39426/0 (socket says 172.21.15.67:39426) 2023-12-05T09:19:55.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0bea7fc700 1 -- 172.21.15.67:0/1386954887 learned_addr learned my addr 172.21.15.67:0/1386954887 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:19:55.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0beaffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 0x7f0bec06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0beaffd700 1 -- 172.21.15.67:0/1386954887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 msgr2=0x7f0bec06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0beaffd700 1 -- 172.21.15.67:0/1386954887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 msgr2=0x7f0bec06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0beaffd700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 0x7f0bec06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0beaffd700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 0x7f0bec06ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0bea7fc700 1 -- 172.21.15.67:0/1386954887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 msgr2=0x7f0bec06ff40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0bea7fc700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 0x7f0bec06ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0bea7fc700 1 -- 172.21.15.67:0/1386954887 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc005040 con 0x7f0bec070480 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.836+0000 7f0bea7fc700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec070480 0x7f0bec0708f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0be000b790 tx=0x7f0be0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.837+0000 7f0bd37fe700 1 -- 172.21.15.67:0/1386954887 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be0010870 con 0x7f0bec070480 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.837+0000 7f0bd37fe700 1 -- 172.21.15.67:0/1386954887 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0be0010e80 con 0x7f0bec070480 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.837+0000 7f0bd37fe700 1 -- 172.21.15.67:0/1386954887 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be000d3b0 con 0x7f0bec070480 2023-12-05T09:19:55.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.837+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec119310 con 0x7f0bec070480 2023-12-05T09:19:55.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.837+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec1198a0 con 0x7f0bec070480 2023-12-05T09:19:55.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.838+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec05f270 con 0x7f0bec070480 2023-12-05T09:19:55.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.839+0000 7f0bd37fe700 1 -- 172.21.15.67:0/1386954887 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f0be000f3e0 con 0x7f0bec070480 2023-12-05T09:19:55.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.840+0000 7f0bd37fe700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0bd4069040 0x7f0bd406b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:19:55.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.840+0000 7f0bd37fe700 1 -- 172.21.15.67:0/1386954887 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0be00861f0 con 0x7f0bec070480 2023-12-05T09:19:55.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.840+0000 7f0beaffd700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0bd4069040 0x7f0bd406b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:19:55.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.841+0000 7f0beaffd700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0bd4069040 0x7f0bd406b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00b3b0 tx=0x7f0bdc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:19:55.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:55.844+0000 7f0bd37fe700 1 -- 172.21.15.67:0/1386954887 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0be00537a0 con 0x7f0bec070480 2023-12-05T09:19:55.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:55 smithi134 ceph-mon[116304]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:56.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.070+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f0bec106a80 con 0x7f0bec070480 2023-12-05T09:19:56.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.070+0000 7f0bd37fe700 1 -- 172.21.15.67:0/1386954887 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f0be0014100 con 0x7f0bec070480 2023-12-05T09:19:56.072 INFO:teuthology.orchestra.run.smithi067.stdout:# minimal ceph.conf for f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:19:56.072 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2023-12-05T09:19:56.072 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:19:56.072 INFO:teuthology.orchestra.run.smithi067.stdout: mon_host = [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2023-12-05T09:19:56.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.072+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0bd4069040 msgr2=0x7f0bd406b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:56.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.072+0000 7f0bf189f700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0bd4069040 0x7f0bd406b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00b3b0 tx=0x7f0bdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:19:56.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.072+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec070480 msgr2=0x7f0bec0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:19:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.072+0000 7f0bf189f700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec070480 0x7f0bec0708f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0be000b790 tx=0x7f0be0009250 comp rx=0 tx=0).stop 2023-12-05T09:19:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.073+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 shutdown_connections 2023-12-05T09:19:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.073+0000 7f0bf189f700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0bd4069040 0x7f0bd406b4f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.073+0000 7f0bf189f700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0bec1028d0 0x7f0bec06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.073+0000 7f0bf189f700 1 --2- 172.21.15.67:0/1386954887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0bec070480 0x7f0bec0708f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:19:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.073+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 >> 172.21.15.67:0/1386954887 conn(0x7f0bec0f8410 msgr2=0x7f0bec0f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:19:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.073+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 shutdown_connections 2023-12-05T09:19:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:19:56.073+0000 7f0bf189f700 1 -- 172.21.15.67:0/1386954887 wait complete. 2023-12-05T09:19:56.526 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-05T09:19:56.526 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:19:56.526 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.conf 2023-12-05T09:19:56.605 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:19:56.605 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:19:56.720 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:19:56.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2023-12-05T09:19:56.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:56.784 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:56.785 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:56.785 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:19:56.785 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:19:56.785 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:19:56.785 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/1386954887' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:56.785 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:19:56.785 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:56.793 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:19:56.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:19:56.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:56.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:56.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:56.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:19:56.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:19:56.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:19:56.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1386954887' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:56.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:19:56.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:56.904 INFO:tasks.cephadm:Deploying OSDs... 2023-12-05T09:19:56.904 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:19:56.904 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2023-12-05T09:19:56.951 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-05T09:19:56.951 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-12-05 09:19:15.680020749 +0000 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-12-05 09:10:55.153243678 +0000 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-12-05 09:10:55.153243678 +0000 2023-12-05T09:19:57.040 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2023-12-05 09:10:55.123244318 +0000 2023-12-05T09:19:57.041 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-05T09:19:57.109 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-12-05T09:19:57.110 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-12-05T09:19:57.110 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000296605 s, 1.7 MB/s 2023-12-05T09:19:57.112 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-05T09:19:57.162 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2023-12-05T09:19:57.208 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-05T09:19:57.208 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:19:57.209 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-12-05T09:19:57.209 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:19:57.209 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:19:57.209 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-12-05 09:19:15.680020749 +0000 2023-12-05T09:19:57.209 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-12-05 09:10:56.043224713 +0000 2023-12-05T09:19:57.209 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-12-05 09:10:56.043224713 +0000 2023-12-05T09:19:57.209 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2023-12-05 09:10:56.017225267 +0000 2023-12-05T09:19:57.209 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-05T09:19:57.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-12-05T09:19:57.278 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-12-05T09:19:57.278 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000292333 s, 1.8 MB/s 2023-12-05T09:19:57.280 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-05T09:19:57.331 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2023-12-05T09:19:57.380 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-05T09:19:57.380 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:19:57.381 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-12-05T09:19:57.381 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:19:57.381 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:19:57.381 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-12-05 09:19:15.680020749 +0000 2023-12-05T09:19:57.381 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-12-05 09:10:56.934205726 +0000 2023-12-05T09:19:57.381 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-12-05 09:10:56.934205726 +0000 2023-12-05T09:19:57.381 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2023-12-05 09:10:56.908206280 +0000 2023-12-05T09:19:57.381 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-05T09:19:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-12-05T09:19:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-12-05T09:19:57.453 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000288598 s, 1.8 MB/s 2023-12-05T09:19:57.455 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-05T09:19:57.504 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-12-05 09:19:15.680020749 +0000 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-12-05 09:10:57.782187655 +0000 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-12-05 09:10:57.782187655 +0000 2023-12-05T09:19:57.557 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2023-12-05 09:10:57.758188167 +0000 2023-12-05T09:19:57.558 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-05T09:19:57.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-12-05T09:19:57.630 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-12-05T09:19:57.630 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000283234 s, 1.8 MB/s 2023-12-05T09:19:57.633 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-05T09:19:57.685 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:19:57.685 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2023-12-05T09:19:57.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:57.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:19:57.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:57.736 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-05T09:19:57.736 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2023-12-05T09:19:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-05T09:19:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:19:57.786 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-12-05T09:19:57.786 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:19:57.786 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:19:57.786 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-05 09:19:47.448046626 +0000 2023-12-05T09:19:57.786 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-05 09:10:44.447268603 +0000 2023-12-05T09:19:57.786 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-05 09:10:44.447268603 +0000 2023-12-05T09:19:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-05 09:10:44.423269146 +0000 2023-12-05T09:19:57.786 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-05T09:19:57.848 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:19:57.849 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-05T09:19:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-05T09:19:57.854 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000309568 s, 1.7 MB/s 2023-12-05T09:19:57.856 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-05T09:19:57.905 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2023-12-05T09:19:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-05T09:19:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:19:57.951 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-12-05T09:19:57.951 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:19:57.951 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:19:57.952 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-05 09:19:47.448046626 +0000 2023-12-05T09:19:57.952 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-05 09:10:45.514244474 +0000 2023-12-05T09:19:57.952 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-05 09:10:45.514244474 +0000 2023-12-05T09:19:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-05 09:10:45.486245107 +0000 2023-12-05T09:19:57.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-05T09:19:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-05T09:19:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-05T09:19:58.058 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000294513 s, 1.7 MB/s 2023-12-05T09:19:58.061 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-05T09:19:58.108 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-05 09:19:47.448046626 +0000 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-05 09:10:46.362225298 +0000 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-05 09:10:46.362225298 +0000 2023-12-05T09:19:58.155 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-05 09:10:46.335225909 +0000 2023-12-05T09:19:58.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-05T09:19:58.262 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-05T09:19:58.262 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-05T09:19:58.262 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000289886 s, 1.8 MB/s 2023-12-05T09:19:58.264 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-05T09:19:58.314 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2023-12-05T09:19:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-05T09:19:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-05T09:19:58.361 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-12-05T09:19:58.361 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:19:58.361 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-12-05T09:19:58.361 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-05 09:19:47.448046626 +0000 2023-12-05T09:19:58.361 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-05 09:10:47.218205941 +0000 2023-12-05T09:19:58.361 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-05 09:10:47.218205941 +0000 2023-12-05T09:19:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-05 09:10:47.195206461 +0000 2023-12-05T09:19:58.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-05T09:19:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-05T09:19:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-05T09:19:58.468 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000285844 s, 1.8 MB/s 2023-12-05T09:19:58.470 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-05T09:19:58.520 INFO:tasks.cephadm:Deploying osd.0 on smithi067 with /dev/vg_nvme/lv_4... 2023-12-05T09:19:58.520 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-05T09:19:58.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:58 smithi067 ceph-mon[107174]: Reconfiguring mon.smithi067 (unknown last config time)... 2023-12-05T09:19:58.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:58 smithi067 ceph-mon[107174]: Reconfiguring daemon mon.smithi067 on smithi067 2023-12-05T09:19:58.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:58 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:58.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:58 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:58.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:58 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.alxtvv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:19:58.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:58 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:19:58.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:58 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:58.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:58 smithi134 ceph-mon[116304]: Reconfiguring mon.smithi067 (unknown last config time)... 2023-12-05T09:19:58.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:58 smithi134 ceph-mon[116304]: Reconfiguring daemon mon.smithi067 on smithi067 2023-12-05T09:19:58.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:58 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:58.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:58 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:58.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:58 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.alxtvv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:19:58.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:58 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:19:58.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:58 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:59.355 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:19:59.856 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:59 smithi067 ceph-mon[107174]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:59.856 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:59 smithi067 ceph-mon[107174]: Reconfiguring mgr.smithi067.alxtvv (unknown last config time)... 2023-12-05T09:19:59.856 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:59 smithi067 ceph-mon[107174]: Reconfiguring daemon mgr.smithi067.alxtvv on smithi067 2023-12-05T09:19:59.856 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:59 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:59.856 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:59 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:59.856 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:59 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:19:59.856 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:19:59 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:19:59.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:59 smithi134 ceph-mon[116304]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:19:59.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:59 smithi134 ceph-mon[116304]: Reconfiguring mgr.smithi067.alxtvv (unknown last config time)... 2023-12-05T09:19:59.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:59 smithi134 ceph-mon[116304]: Reconfiguring daemon mgr.smithi067.alxtvv on smithi067 2023-12-05T09:19:59.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:59 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:59.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:59 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:19:59.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:59 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:19:59.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:19:59 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:00.718 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:00 smithi067 ceph-mon[107174]: Reconfiguring crash.smithi067 (monmap changed)... 2023-12-05T09:20:00.718 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:00 smithi067 ceph-mon[107174]: Reconfiguring daemon crash.smithi067 on smithi067 2023-12-05T09:20:00.718 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:00 smithi067 ceph-mon[107174]: overall HEALTH_OK 2023-12-05T09:20:00.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:00 smithi134 ceph-mon[116304]: Reconfiguring crash.smithi067 (monmap changed)... 2023-12-05T09:20:00.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:00 smithi134 ceph-mon[116304]: Reconfiguring daemon crash.smithi067 on smithi067 2023-12-05T09:20:00.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:00 smithi134 ceph-mon[116304]: overall HEALTH_OK 2023-12-05T09:20:01.306 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-05T09:20:01.307 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-05T09:20:01.307 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2023-12-05T09:20:01.307 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2023-12-05T09:20:01.307 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0586432 s, 179 MB/s 2023-12-05T09:20:01.307 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2023-12-05T09:20:01.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:01 smithi067 ceph-mon[107174]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:01.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:01 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:01.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:01 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:01.759 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi067:vg_nvme/lv_4 2023-12-05T09:20:01.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:01 smithi134 ceph-mon[116304]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:01.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:01 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:01.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:01 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:02.466 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:20:02.861 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:02 smithi067 ceph-mon[107174]: Reconfiguring alertmanager.smithi067 (dependencies changed)... 2023-12-05T09:20:02.862 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:02 smithi067 ceph-mon[107174]: Reconfiguring daemon alertmanager.smithi067 on smithi067 2023-12-05T09:20:02.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:02 smithi134 ceph-mon[116304]: Reconfiguring alertmanager.smithi067 (dependencies changed)... 2023-12-05T09:20:02.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:02 smithi134 ceph-mon[116304]: Reconfiguring daemon alertmanager.smithi067 on smithi067 2023-12-05T09:20:03.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:03 smithi067 ceph-mon[107174]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:03.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:03 smithi134 ceph-mon[116304]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:04.613 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.610+0000 7fe06fcaa700 1 -- 172.21.15.67:0/3879977923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 msgr2=0x7fe0680fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.610+0000 7fe06fcaa700 1 --2- 172.21.15.67:0/3879977923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 0x7fe0680fe250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe058004940 tx=0x7fe058009e30 comp rx=0 tx=0).stop 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.610+0000 7fe06fcaa700 1 -- 172.21.15.67:0/3879977923 shutdown_connections 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.610+0000 7fe06fcaa700 1 --2- 172.21.15.67:0/3879977923 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 0x7fe0680fe250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.610+0000 7fe06fcaa700 1 --2- 172.21.15.67:0/3879977923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0680fcbf0 0x7fe0680fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.610+0000 7fe06fcaa700 1 -- 172.21.15.67:0/3879977923 >> 172.21.15.67:0/3879977923 conn(0x7fe0680f82d0 msgr2=0x7fe0680fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.610+0000 7fe06fcaa700 1 -- 172.21.15.67:0/3879977923 shutdown_connections 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.610+0000 7fe06fcaa700 1 -- 172.21.15.67:0/3879977923 wait complete. 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06fcaa700 1 Processor -- start 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06fcaa700 1 -- start start 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06fcaa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0680fcbf0 0x7fe06810f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06fcaa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 0x7fe06810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06fcaa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068110310 con 0x7fe0680fde00 2023-12-05T09:20:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06fcaa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068110b60 con 0x7fe0680fcbf0 2023-12-05T09:20:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06d245700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 0x7fe06810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06d245700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 0x7fe06810fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39440/0 (socket says 172.21.15.67:39440) 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.611+0000 7fe06d245700 1 -- 172.21.15.67:0/1279061747 learned_addr learned my addr 172.21.15.67:0/1279061747 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe06d245700 1 -- 172.21.15.67:0/1279061747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0680fcbf0 msgr2=0x7fe06810f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe06d245700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0680fcbf0 0x7fe06810f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe06d245700 1 -- 172.21.15.67:0/1279061747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe058005040 con 0x7fe0680fde00 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe06d245700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 0x7fe06810fd10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe058009fd0 tx=0x7fe058009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe05e7fc700 1 -- 172.21.15.67:0/1279061747 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe05800e040 con 0x7fe0680fde00 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe05e7fc700 1 -- 172.21.15.67:0/1279061747 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe058004290 con 0x7fe0680fde00 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe05e7fc700 1 -- 172.21.15.67:0/1279061747 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe05801c3f0 con 0x7fe0680fde00 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe068110de0 con 0x7fe0680fde00 2023-12-05T09:20:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.612+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe068111320 con 0x7fe0680fde00 2023-12-05T09:20:04.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.613+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe068101ea0 con 0x7fe0680fde00 2023-12-05T09:20:04.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.614+0000 7fe05e7fc700 1 -- 172.21.15.67:0/1279061747 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7fe058013420 con 0x7fe0680fde00 2023-12-05T09:20:04.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.616+0000 7fe05e7fc700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe054068ed0 0x7fe05406b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:04.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.616+0000 7fe05e7fc700 1 -- 172.21.15.67:0/1279061747 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe0580870f0 con 0x7fe0680fde00 2023-12-05T09:20:04.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.616+0000 7fe06da46700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe054068ed0 0x7fe05406b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:20:04.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.617+0000 7fe06da46700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe054068ed0 0x7fe05406b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe0680fdc60 tx=0x7fe064009ce0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:20:04.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.621+0000 7fe05e7fc700 1 -- 172.21.15.67:0/1279061747 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe058058090 con 0x7fe0680fde00 2023-12-05T09:20:04.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:04.864+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0681116a0 con 0x7fe054068ed0 2023-12-05T09:20:05.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:05 smithi067 ceph-mon[107174]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:05.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:20:05.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:20:05.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:05.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:05.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:05.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:05 smithi134 ceph-mon[116304]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:05.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:20:05.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:20:05.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:05.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:05.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:06.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:06 smithi067 ceph-mon[107174]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:20:06.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:06 smithi067 ceph-mon[107174]: Reconfiguring grafana.smithi067 (dependencies changed)... 2023-12-05T09:20:06.575 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:06 smithi067 ceph-mon[107174]: Reconfiguring daemon grafana.smithi067 on smithi067 2023-12-05T09:20:06.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:06 smithi134 ceph-mon[116304]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:20:06.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:06 smithi134 ceph-mon[116304]: Reconfiguring grafana.smithi067 (dependencies changed)... 2023-12-05T09:20:06.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:06 smithi134 ceph-mon[116304]: Reconfiguring daemon grafana.smithi067 on smithi067 2023-12-05T09:20:07.694 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:07 smithi067 ceph-mon[107174]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:07.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:07 smithi134 ceph-mon[116304]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:09.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:09 smithi067 ceph-mon[107174]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:09.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:09 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:09.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:09 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:09.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:09 smithi134 ceph-mon[116304]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:09.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:09 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:09.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:09 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:10 smithi067 ceph-mon[107174]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2023-12-05T09:20:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:10 smithi067 ceph-mon[107174]: Reconfiguring daemon prometheus.smithi067 on smithi067 2023-12-05T09:20:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:10 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3318385057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73d6a29a-57c6-4943-9a9b-1bb55401f054"}]: dispatch 2023-12-05T09:20:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:10 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3318385057' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73d6a29a-57c6-4943-9a9b-1bb55401f054"}]': finished 2023-12-05T09:20:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:10 smithi067 ceph-mon[107174]: osdmap e6: 1 total, 0 up, 1 in 2023-12-05T09:20:10.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:10 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:10.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:10 smithi134 ceph-mon[116304]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2023-12-05T09:20:10.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:10 smithi134 ceph-mon[116304]: Reconfiguring daemon prometheus.smithi067 on smithi067 2023-12-05T09:20:10.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:10 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3318385057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73d6a29a-57c6-4943-9a9b-1bb55401f054"}]: dispatch 2023-12-05T09:20:10.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:10 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3318385057' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73d6a29a-57c6-4943-9a9b-1bb55401f054"}]': finished 2023-12-05T09:20:10.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:10 smithi134 ceph-mon[116304]: osdmap e6: 1 total, 0 up, 1 in 2023-12-05T09:20:10.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:10 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:11.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:11 smithi067 ceph-mon[107174]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:11.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:11 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:20:11.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:11 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/4262811037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:20:11.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:11 smithi134 ceph-mon[116304]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:11.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:11 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:20:11.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:11 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/4262811037' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:20:13.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:13 smithi067 ceph-mon[107174]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:13.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:13 smithi134 ceph-mon[116304]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:15.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:15 smithi067 ceph-mon[107174]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:15.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:15 smithi134 ceph-mon[116304]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:17.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:16 smithi134 ceph-mon[116304]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:17.195 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:16 smithi067 ceph-mon[107174]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:19.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:19 smithi067 ceph-mon[107174]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:19.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:19 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:19.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:19 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:19.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:19 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:20:19.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:19 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:19.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:19 smithi134 ceph-mon[116304]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:19.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:19 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:19.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:19 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:19.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:19 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:20:19.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:19 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:20.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: Reconfiguring crash.smithi134 (monmap changed)... 2023-12-05T09:20:20.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: Reconfiguring daemon crash.smithi134 on smithi134 2023-12-05T09:20:20.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:20:20.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:20.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:20.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:20.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:20:20.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:20:20.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:20 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:20.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: Reconfiguring crash.smithi134 (monmap changed)... 2023-12-05T09:20:20.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: Reconfiguring daemon crash.smithi134 on smithi134 2023-12-05T09:20:20.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:20:20.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:20.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:20.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:20.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:20:20.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:20:20.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:20 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:21.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:21 smithi134 ceph-mon[116304]: Deploying daemon osd.0 on smithi067 2023-12-05T09:20:21.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:21 smithi134 ceph-mon[116304]: Reconfiguring mgr.smithi134.yfqkak (monmap changed)... 2023-12-05T09:20:21.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:21 smithi134 ceph-mon[116304]: Reconfiguring daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:20:21.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:21 smithi134 ceph-mon[116304]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:21.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:21 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:21.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:21 smithi067 ceph-mon[107174]: Deploying daemon osd.0 on smithi067 2023-12-05T09:20:21.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:21 smithi067 ceph-mon[107174]: Reconfiguring mgr.smithi134.yfqkak (monmap changed)... 2023-12-05T09:20:21.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:21 smithi067 ceph-mon[107174]: Reconfiguring daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:20:21.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:21 smithi067 ceph-mon[107174]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:21.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:21 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:22.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:22.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:22 smithi067 ceph-mon[107174]: Reconfiguring mon.smithi134 (monmap changed)... 2023-12-05T09:20:22.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:20:22.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:20:22.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:22.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:22 smithi067 ceph-mon[107174]: Reconfiguring daemon mon.smithi134 on smithi134 2023-12-05T09:20:22.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:22.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:22 smithi134 ceph-mon[116304]: Reconfiguring mon.smithi134 (monmap changed)... 2023-12-05T09:20:22.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:20:22.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:20:22.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:22.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:22 smithi134 ceph-mon[116304]: Reconfiguring daemon mon.smithi134 on smithi134 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi067.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi067.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi067.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T09:20:23.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi067.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T09:20:23.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:20:23.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:20:23.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi067.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T09:20:23.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi067.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T09:20:23.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:20:23.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:23.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi067.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi067.front.sepia.ceph.com:9093"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi067.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi067.front.sepia.ceph.com:3000"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi067.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi067.front.sepia.ceph.com:9095"}]: dispatch 2023-12-05T09:20:23.560 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:23.561 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:20:25.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:25.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:25.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:24 smithi067 ceph-mon[107174]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:25.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:25.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:25.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:24 smithi134 ceph-mon[116304]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:27.177 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.177 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.177 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:27.177 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:20:27.177 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.177 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.178 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:27.178 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:20:27.178 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.178 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:20:27.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:27.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:20:28.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.636+0000 7fe05e7fc700 1 -- 172.21.15.67:0/1279061747 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe0681116a0 con 0x7fe054068ed0 2023-12-05T09:20:28.637 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 0 on host 'smithi067' 2023-12-05T09:20:28.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe054068ed0 msgr2=0x7fe05406b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe054068ed0 0x7fe05406b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe0680fdc60 tx=0x7fe064009ce0 comp rx=0 tx=0).stop 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 msgr2=0x7fe06810fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 0x7fe06810fd10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe058009fd0 tx=0x7fe058009e30 comp rx=0 tx=0).stop 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 shutdown_connections 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe054068ed0 0x7fe05406b380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0680fcbf0 0x7fe06810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 --2- 172.21.15.67:0/1279061747 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0680fde00 0x7fe06810fd10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 >> 172.21.15.67:0/1279061747 conn(0x7fe0680f82d0 msgr2=0x7fe0680ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.638+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 shutdown_connections 2023-12-05T09:20:28.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:28.639+0000 7fe06fcaa700 1 -- 172.21.15.67:0/1279061747 wait complete. 2023-12-05T09:20:29.317 DEBUG:teuthology.orchestra.run.smithi067:osd.0> sudo journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.0.service 2023-12-05T09:20:29.326 INFO:tasks.cephadm:Deploying osd.1 on smithi067 with /dev/vg_nvme/lv_3... 2023-12-05T09:20:29.326 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-05T09:20:29.403 INFO:journalctl@ceph.osd.0.smithi067.stdout:-- Logs begin at Tue 2023-12-05 08:57:36 UTC. -- 2023-12-05T09:20:29.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:29 smithi067 ceph-mon[107174]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:29.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:29.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:29.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:29.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:29.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:29 smithi134 ceph-mon[116304]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:29.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:29.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:29.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:29.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:29.871 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:20:29 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[130141]: 2023-12-05T09:20:29.778+0000 7fb0b8eb2540 -1 osd.0 0 log_to_monitors true 2023-12-05T09:20:30.284 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:20:30.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:30 smithi067 ceph-mon[107174]: from='osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T09:20:30.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:30 smithi134 ceph-mon[116304]: from='osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T09:20:31.570 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:20:31 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[130141]: 2023-12-05T09:20:31.345+0000 7fb0af697700 -1 osd.0 0 waiting for initial osdmap 2023-12-05T09:20:31.570 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:20:31 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[130141]: 2023-12-05T09:20:31.351+0000 7fb0abc95700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:20:31.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:31 smithi067 ceph-mon[107174]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:31.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:31 smithi067 ceph-mon[107174]: from='osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T09:20:31.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:31 smithi067 ceph-mon[107174]: osdmap e7: 1 total, 0 up, 1 in 2023-12-05T09:20:31.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:31 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:31.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:31 smithi067 ceph-mon[107174]: from='osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:20:31.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:31 smithi134 ceph-mon[116304]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:31.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:31 smithi134 ceph-mon[116304]: from='osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T09:20:31.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:31 smithi134 ceph-mon[116304]: osdmap e7: 1 total, 0 up, 1 in 2023-12-05T09:20:31.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:31 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:31.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:31 smithi134 ceph-mon[116304]: from='osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:20:32.340 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-05T09:20:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-05T09:20:32.341 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2023-12-05T09:20:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2023-12-05T09:20:32.341 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0565964 s, 185 MB/s 2023-12-05T09:20:32.341 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2023-12-05T09:20:32.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:32 smithi067 ceph-mon[107174]: from='osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2023-12-05T09:20:32.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:32 smithi067 ceph-mon[107174]: osdmap e8: 1 total, 0 up, 1 in 2023-12-05T09:20:32.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:32.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:32.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:32.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:32.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:32 smithi134 ceph-mon[116304]: from='osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2023-12-05T09:20:32.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:32 smithi134 ceph-mon[116304]: osdmap e8: 1 total, 0 up, 1 in 2023-12-05T09:20:32.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:32.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:32.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:32.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:32.774 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi067:vg_nvme/lv_3 2023-12-05T09:20:33.468 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:20:33.560 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:33 smithi067 ceph-mon[107174]: purged_snaps scrub starts 2023-12-05T09:20:33.560 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:33 smithi067 ceph-mon[107174]: purged_snaps scrub ok 2023-12-05T09:20:33.560 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:33 smithi067 ceph-mon[107174]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:33.560 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:33 smithi067 ceph-mon[107174]: osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] boot 2023-12-05T09:20:33.560 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:33 smithi067 ceph-mon[107174]: osdmap e9: 1 total, 1 up, 1 in 2023-12-05T09:20:33.560 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:33.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:33 smithi134 ceph-mon[116304]: purged_snaps scrub starts 2023-12-05T09:20:33.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:33 smithi134 ceph-mon[116304]: purged_snaps scrub ok 2023-12-05T09:20:33.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:33 smithi134 ceph-mon[116304]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-05T09:20:33.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:33 smithi134 ceph-mon[116304]: osd.0 [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] boot 2023-12-05T09:20:33.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:33 smithi134 ceph-mon[116304]: osdmap e9: 1 total, 1 up, 1 in 2023-12-05T09:20:33.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:20:34.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.962+0000 7efd08a17700 1 -- 172.21.15.67:0/2965890637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fcbf0 msgr2=0x7efd040fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:34.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.962+0000 7efd08a17700 1 --2- 172.21.15.67:0/2965890637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fcbf0 0x7efd040fd000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efcf4004940 tx=0x7efcf4009e30 comp rx=0 tx=0).stop 2023-12-05T09:20:34.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.962+0000 7efd08a17700 1 -- 172.21.15.67:0/2965890637 shutdown_connections 2023-12-05T09:20:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.962+0000 7efd08a17700 1 --2- 172.21.15.67:0/2965890637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd040fde00 0x7efd040fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.962+0000 7efd08a17700 1 --2- 172.21.15.67:0/2965890637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fcbf0 0x7efd040fd000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.962+0000 7efd08a17700 1 -- 172.21.15.67:0/2965890637 >> 172.21.15.67:0/2965890637 conn(0x7efd040f82d0 msgr2=0x7efd040fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:20:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.962+0000 7efd08a17700 1 -- 172.21.15.67:0/2965890637 shutdown_connections 2023-12-05T09:20:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.962+0000 7efd08a17700 1 -- 172.21.15.67:0/2965890637 wait complete. 2023-12-05T09:20:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.963+0000 7efd08a17700 1 Processor -- start 2023-12-05T09:20:34.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.963+0000 7efd08a17700 1 -- start start 2023-12-05T09:20:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.963+0000 7efd08a17700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd040fcbf0 0x7efd0410f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd08a17700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fde00 0x7efd0410fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd08a17700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd04110280 con 0x7efd040fde00 2023-12-05T09:20:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd08a17700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd04110b20 con 0x7efd040fcbf0 2023-12-05T09:20:34.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd01d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fde00 0x7efd0410fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd01d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fde00 0x7efd0410fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41602/0 (socket says 172.21.15.67:41602) 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd01d9b700 1 -- 172.21.15.67:0/67726279 learned_addr learned my addr 172.21.15.67:0/67726279 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd0259c700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd040fcbf0 0x7efd0410f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd01d9b700 1 -- 172.21.15.67:0/67726279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd040fcbf0 msgr2=0x7efd0410f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd01d9b700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd040fcbf0 0x7efd0410f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.964+0000 7efd01d9b700 1 -- 172.21.15.67:0/67726279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4005040 con 0x7efd040fde00 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.965+0000 7efd01d9b700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fde00 0x7efd0410fc80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efcf800c8c0 tx=0x7efcf80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.965+0000 7efcf2ffd700 1 -- 172.21.15.67:0/67726279 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf800a760 con 0x7efd040fde00 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.965+0000 7efcf2ffd700 1 -- 172.21.15.67:0/67726279 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efcf800ad70 con 0x7efd040fde00 2023-12-05T09:20:34.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.965+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd04110e00 con 0x7efd040fde00 2023-12-05T09:20:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.965+0000 7efcf2ffd700 1 -- 172.21.15.67:0/67726279 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf80113a0 con 0x7efd040fde00 2023-12-05T09:20:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.965+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd04111340 con 0x7efd040fde00 2023-12-05T09:20:34.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.966+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd04101ea0 con 0x7efd040fde00 2023-12-05T09:20:34.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.968+0000 7efcf2ffd700 1 -- 172.21.15.67:0/67726279 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7efcf8012400 con 0x7efd040fde00 2023-12-05T09:20:34.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.969+0000 7efcf2ffd700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7efcec068ed0 0x7efcec06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:34.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.969+0000 7efcf2ffd700 1 -- 172.21.15.67:0/67726279 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7efcf8085f30 con 0x7efd040fde00 2023-12-05T09:20:34.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.969+0000 7efd0259c700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7efcec068ed0 0x7efcec06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:20:34.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.970+0000 7efd0259c700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7efcec068ed0 0x7efcec06b380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efcf400b3b0 tx=0x7efcf4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:20:34.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:34.974+0000 7efcf2ffd700 1 -- 172.21.15.67:0/67726279 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7efcf8056cf0 con 0x7efd040fde00 2023-12-05T09:20:35.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:34 smithi067 ceph-mon[107174]: osdmap e10: 1 total, 1 up, 1 in 2023-12-05T09:20:35.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:34 smithi067 ceph-mon[107174]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:34 smithi134 ceph-mon[116304]: osdmap e10: 1 total, 1 up, 1 in 2023-12-05T09:20:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:34 smithi134 ceph-mon[116304]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:35.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:35.187+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7efd041116b0 con 0x7efcec068ed0 2023-12-05T09:20:35.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:35 smithi067 ceph-mon[107174]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:20:35.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:20:35.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:20:35.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:35 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:36.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:35 smithi134 ceph-mon[116304]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:20:36.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:35 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:20:36.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:35 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:20:36.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:35 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: Detected new or changed devices on smithi067 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: Adjusting osd_memory_target on smithi067 to 13047M 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:37.349 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:37.350 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: Detected new or changed devices on smithi067 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: Adjusting osd_memory_target on smithi067 to 13047M 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:37.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:20:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:38 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:38 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:38 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2746397770' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21d6b362-1d8c-4508-b7df-5a156074fc8c"}]: dispatch 2023-12-05T09:20:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:38 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2746397770' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21d6b362-1d8c-4508-b7df-5a156074fc8c"}]': finished 2023-12-05T09:20:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:38 smithi067 ceph-mon[107174]: osdmap e11: 2 total, 1 up, 2 in 2023-12-05T09:20:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:38 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:39.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:38 smithi067 ceph-mon[107174]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:39.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:38 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:39.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:38 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:39.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:38 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2746397770' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21d6b362-1d8c-4508-b7df-5a156074fc8c"}]: dispatch 2023-12-05T09:20:39.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:38 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2746397770' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21d6b362-1d8c-4508-b7df-5a156074fc8c"}]': finished 2023-12-05T09:20:39.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:38 smithi134 ceph-mon[116304]: osdmap e11: 2 total, 1 up, 2 in 2023-12-05T09:20:39.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:38 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:39.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:38 smithi134 ceph-mon[116304]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:40.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:39 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2310238391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:20:40.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:39 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2310238391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:20:41.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:41 smithi067 ceph-mon[107174]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:41.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:41.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:41.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:41.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:20:41.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:41.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:20:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:41 smithi134 ceph-mon[116304]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:41.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:41.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:41.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:20:41.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:41.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:20:43.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:43 smithi067 ceph-mon[107174]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:43.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:43 smithi134 ceph-mon[116304]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:45.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:45 smithi067 ceph-mon[107174]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:45.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:45 smithi134 ceph-mon[116304]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:46.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:46 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:20:46.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:46 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:46.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:46 smithi067 ceph-mon[107174]: Deploying daemon osd.1 on smithi067 2023-12-05T09:20:46.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:46 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:20:46.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:46 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:20:46.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:46 smithi134 ceph-mon[116304]: Deploying daemon osd.1 on smithi067 2023-12-05T09:20:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:47 smithi067 ceph-mon[107174]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:47 smithi134 ceph-mon[116304]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:49.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:49 smithi067 ceph-mon[107174]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:49.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:49 smithi134 ceph-mon[116304]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:51.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:51 smithi067 ceph-mon[107174]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:51.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:51 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:51.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:51 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:51.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:51 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:20:51.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:51 smithi134 ceph-mon[116304]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:51.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:51 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:51.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:51 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:51.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:51 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:20:53.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:53 smithi067 ceph-mon[107174]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:53.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:53 smithi134 ceph-mon[116304]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:53.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.891+0000 7efcf2ffd700 1 -- 172.21.15.67:0/67726279 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efd041116b0 con 0x7efcec068ed0 2023-12-05T09:20:53.894 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 1 on host 'smithi067' 2023-12-05T09:20:53.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.893+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7efcec068ed0 msgr2=0x7efcec06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:53.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.893+0000 7efd08a17700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7efcec068ed0 0x7efcec06b380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efcf400b3b0 tx=0x7efcf4009e30 comp rx=0 tx=0).stop 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.893+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fde00 msgr2=0x7efd0410fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.893+0000 7efd08a17700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fde00 0x7efd0410fc80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efcf800c8c0 tx=0x7efcf80044c0 comp rx=0 tx=0).stop 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.894+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 shutdown_connections 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.894+0000 7efd08a17700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7efcec068ed0 0x7efcec06b380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.894+0000 7efd08a17700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd040fcbf0 0x7efd0410f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.894+0000 7efd08a17700 1 --2- 172.21.15.67:0/67726279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efd040fde00 0x7efd0410fc80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.894+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 >> 172.21.15.67:0/67726279 conn(0x7efd040f82d0 msgr2=0x7efd040ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.894+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 shutdown_connections 2023-12-05T09:20:53.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:53.894+0000 7efd08a17700 1 -- 172.21.15.67:0/67726279 wait complete. 2023-12-05T09:20:54.417 DEBUG:teuthology.orchestra.run.smithi067:osd.1> sudo journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.1.service 2023-12-05T09:20:54.422 INFO:tasks.cephadm:Deploying osd.2 on smithi067 with /dev/vg_nvme/lv_2... 2023-12-05T09:20:54.422 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-05T09:20:54.502 INFO:journalctl@ceph.osd.1.smithi067.stdout:-- Logs begin at Tue 2023-12-05 08:57:36 UTC. -- 2023-12-05T09:20:54.870 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:20:54 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[139715]: 2023-12-05T09:20:54.650+0000 7f94b831c540 -1 osd.1 0 log_to_monitors true 2023-12-05T09:20:55.158 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:20:55.359 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:54 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:55.359 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:54 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:55.359 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:54 smithi067 ceph-mon[107174]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:55.359 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:54 smithi067 ceph-mon[107174]: from='osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T09:20:55.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:54 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:55.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:54 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:55.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:54 smithi134 ceph-mon[116304]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:55.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:54 smithi134 ceph-mon[116304]: from='osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T09:20:56.121 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:20:55 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[139715]: 2023-12-05T09:20:55.903+0000 7f94b0304700 -1 osd.1 0 waiting for initial osdmap 2023-12-05T09:20:56.121 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:20:55 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[139715]: 2023-12-05T09:20:55.908+0000 7f94a78f8700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:20:56.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:55 smithi067 ceph-mon[107174]: from='osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T09:20:56.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:55 smithi067 ceph-mon[107174]: osdmap e12: 2 total, 1 up, 2 in 2023-12-05T09:20:56.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:55 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:56.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:55 smithi067 ceph-mon[107174]: from='osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:20:56.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:55 smithi134 ceph-mon[116304]: from='osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T09:20:56.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:55 smithi134 ceph-mon[116304]: osdmap e12: 2 total, 1 up, 2 in 2023-12-05T09:20:56.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:55 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:56.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:55 smithi134 ceph-mon[116304]: from='osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:20:57.180 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-05T09:20:57.180 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-05T09:20:57.180 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2023-12-05T09:20:57.180 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2023-12-05T09:20:57.180 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.055641 s, 188 MB/s 2023-12-05T09:20:57.180 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2023-12-05T09:20:57.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:56 smithi067 ceph-mon[107174]: from='osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2023-12-05T09:20:57.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:56 smithi067 ceph-mon[107174]: osdmap e13: 2 total, 1 up, 2 in 2023-12-05T09:20:57.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:57.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:57.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:56 smithi067 ceph-mon[107174]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:57.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:20:57.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:57.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:57.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:56 smithi134 ceph-mon[116304]: from='osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2023-12-05T09:20:57.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:56 smithi134 ceph-mon[116304]: osdmap e13: 2 total, 1 up, 2 in 2023-12-05T09:20:57.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:57.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:57.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:56 smithi134 ceph-mon[116304]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-05T09:20:57.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:20:57.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:57.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:20:57.796 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi067:vg_nvme/lv_2 2023-12-05T09:20:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:20:58.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:57 smithi067 ceph-mon[107174]: purged_snaps scrub starts 2023-12-05T09:20:58.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:57 smithi067 ceph-mon[107174]: purged_snaps scrub ok 2023-12-05T09:20:58.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:57 smithi067 ceph-mon[107174]: osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] boot 2023-12-05T09:20:58.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:57 smithi067 ceph-mon[107174]: osdmap e14: 2 total, 2 up, 2 in 2023-12-05T09:20:58.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:58.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:57 smithi134 ceph-mon[116304]: purged_snaps scrub starts 2023-12-05T09:20:58.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:57 smithi134 ceph-mon[116304]: purged_snaps scrub ok 2023-12-05T09:20:58.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:57 smithi134 ceph-mon[116304]: osd.1 [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] boot 2023-12-05T09:20:58.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:57 smithi134 ceph-mon[116304]: osdmap e14: 2 total, 2 up, 2 in 2023-12-05T09:20:58.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:20:59.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:58 smithi067 ceph-mon[107174]: osdmap e15: 2 total, 2 up, 2 in 2023-12-05T09:20:59.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:20:58 smithi067 ceph-mon[107174]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:20:59.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:58 smithi134 ceph-mon[116304]: osdmap e15: 2 total, 2 up, 2 in 2023-12-05T09:20:59.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:20:58 smithi134 ceph-mon[116304]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:20:59.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.644+0000 7f4538527700 1 -- 172.21.15.67:0/3713093752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530071bc0 msgr2=0x7f4530070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:59.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.644+0000 7f4538527700 1 --2- 172.21.15.67:0/3713093752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530071bc0 0x7f4530070030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f452c004940 tx=0x7f452c009e30 comp rx=0 tx=0).stop 2023-12-05T09:20:59.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.644+0000 7f4538527700 1 -- 172.21.15.67:0/3713093752 shutdown_connections 2023-12-05T09:20:59.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.644+0000 7f4538527700 1 --2- 172.21.15.67:0/3713093752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4530070570 0x7f45300709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:59.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.644+0000 7f4538527700 1 --2- 172.21.15.67:0/3713093752 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530071bc0 0x7f4530070030 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:59.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.644+0000 7f4538527700 1 -- 172.21.15.67:0/3713093752 >> 172.21.15.67:0/3713093752 conn(0x7f45300f82d0 msgr2=0x7f45300fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:20:59.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.644+0000 7f4538527700 1 -- 172.21.15.67:0/3713093752 shutdown_connections 2023-12-05T09:20:59.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.644+0000 7f4538527700 1 -- 172.21.15.67:0/3713093752 wait complete. 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.645+0000 7f4538527700 1 Processor -- start 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.645+0000 7f4538527700 1 -- start start 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f4538527700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530070570 0x7f453010f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f4538527700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4530071bc0 0x7f453010fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f4538527700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45301102d0 con 0x7f4530070570 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f4538527700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4530110b70 con 0x7f4530071bc0 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f45362c3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530070570 0x7f453010f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f45362c3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530070570 0x7f453010f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48034/0 (socket says 172.21.15.67:48034) 2023-12-05T09:20:59.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f45362c3700 1 -- 172.21.15.67:0/3336134820 learned_addr learned my addr 172.21.15.67:0/3336134820 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:20:59.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f45362c3700 1 -- 172.21.15.67:0/3336134820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4530071bc0 msgr2=0x7f453010fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:20:59.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f45362c3700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4530071bc0 0x7f453010fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:20:59.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.646+0000 7f45362c3700 1 -- 172.21.15.67:0/3336134820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c005040 con 0x7f4530070570 2023-12-05T09:20:59.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.647+0000 7f45362c3700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530070570 0x7f453010f790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f452c009fd0 tx=0x7f452c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:20:59.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.647+0000 7f4526ffd700 1 -- 172.21.15.67:0/3336134820 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f452c021070 con 0x7f4530070570 2023-12-05T09:20:59.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.647+0000 7f4526ffd700 1 -- 172.21.15.67:0/3336134820 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f452c01c400 con 0x7f4530070570 2023-12-05T09:20:59.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.647+0000 7f4526ffd700 1 -- 172.21.15.67:0/3336134820 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f452c00e070 con 0x7f4530070570 2023-12-05T09:20:59.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.647+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4530110df0 con 0x7f4530070570 2023-12-05T09:20:59.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.647+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45301112d0 con 0x7f4530070570 2023-12-05T09:20:59.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.648+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453004bb80 con 0x7f4530070570 2023-12-05T09:20:59.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.649+0000 7f4526ffd700 1 -- 172.21.15.67:0/3336134820 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f452c01c570 con 0x7f4530070570 2023-12-05T09:20:59.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.650+0000 7f4526ffd700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f451c068ed0 0x7f451c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:20:59.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.650+0000 7f4526ffd700 1 -- 172.21.15.67:0/3336134820 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f452c087250 con 0x7f4530070570 2023-12-05T09:20:59.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.650+0000 7f4535ac2700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f451c068ed0 0x7f451c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:20:59.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.651+0000 7f4535ac2700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f451c068ed0 0x7f451c06b380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4520009fd0 tx=0x7f452000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:20:59.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.655+0000 7f4526ffd700 1 -- 172.21.15.67:0/3336134820 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f452c057e60 con 0x7f4530070570 2023-12-05T09:20:59.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:20:59.873+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f45301041a0 con 0x7f451c068ed0 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: Detected new or changed devices on smithi067 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: Adjusting osd_memory_target on smithi067 to 6523M 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:01.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:21:01.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:01.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:21:01.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:01.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:01.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:01.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:01.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: Detected new or changed devices on smithi067 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: Adjusting osd_memory_target on smithi067 to 6523M 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:21:01.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:01.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:01.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:01.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:01.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:03.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:03 smithi067 ceph-mon[107174]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:03.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:03 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/959420417' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "214bcc5f-be74-4b12-b23e-c325bae6a18f"}]: dispatch 2023-12-05T09:21:03.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:03 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/959420417' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "214bcc5f-be74-4b12-b23e-c325bae6a18f"}]': finished 2023-12-05T09:21:03.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:03 smithi067 ceph-mon[107174]: osdmap e16: 3 total, 2 up, 3 in 2023-12-05T09:21:03.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:03 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:03.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:03 smithi134 ceph-mon[116304]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:03.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:03 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/959420417' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "214bcc5f-be74-4b12-b23e-c325bae6a18f"}]: dispatch 2023-12-05T09:21:03.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:03 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/959420417' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "214bcc5f-be74-4b12-b23e-c325bae6a18f"}]': finished 2023-12-05T09:21:03.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:03 smithi134 ceph-mon[116304]: osdmap e16: 3 total, 2 up, 3 in 2023-12-05T09:21:03.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:03 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:04.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:04 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/128112108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:21:04.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:04 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/128112108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:21:05.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:05 smithi067 ceph-mon[107174]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:05.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:05.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:05.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:05.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:05.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:05 smithi134 ceph-mon[116304]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:05.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:05.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:05.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:05.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:07.196 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:06 smithi067 ceph-mon[107174]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:07.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:06 smithi134 ceph-mon[116304]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:09.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:09 smithi067 ceph-mon[107174]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:09.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:09 smithi134 ceph-mon[116304]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:10.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:10 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:21:10.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:10 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:10.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:10 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:21:10.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:10 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:11.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:11 smithi134 ceph-mon[116304]: Deploying daemon osd.2 on smithi067 2023-12-05T09:21:11.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:11 smithi134 ceph-mon[116304]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:11.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:11 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:21:11.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:11 smithi067 ceph-mon[107174]: Deploying daemon osd.2 on smithi067 2023-12-05T09:21:11.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:11 smithi067 ceph-mon[107174]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:11.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:11 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:21:13.327 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:13 smithi067 ceph-mon[107174]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:13.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:13 smithi134 ceph-mon[116304]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:15.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:15 smithi067 ceph-mon[107174]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:15.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:15 smithi134 ceph-mon[116304]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:16.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:16 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:16.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:16 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:16.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:16 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:16.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:16 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:16.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:16 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:16.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:16 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:17.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:17 smithi067 ceph-mon[107174]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:17.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:17 smithi134 ceph-mon[116304]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:18.488 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 2 on host 'smithi067' 2023-12-05T09:21:18.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.486+0000 7f4526ffd700 1 -- 172.21.15.67:0/3336134820 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f45301041a0 con 0x7f451c068ed0 2023-12-05T09:21:18.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f451c068ed0 msgr2=0x7f451c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:21:18.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f451c068ed0 0x7f451c06b380 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4520009fd0 tx=0x7f452000b040 comp rx=0 tx=0).stop 2023-12-05T09:21:18.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530070570 msgr2=0x7f453010f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:21:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530070570 0x7f453010f790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f452c009fd0 tx=0x7f452c009e30 comp rx=0 tx=0).stop 2023-12-05T09:21:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 shutdown_connections 2023-12-05T09:21:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f451c068ed0 0x7f451c06b380 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4530070570 0x7f453010f790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 --2- 172.21.15.67:0/3336134820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4530071bc0 0x7f453010fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 >> 172.21.15.67:0/3336134820 conn(0x7f45300f82d0 msgr2=0x7f4530102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:21:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.489+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 shutdown_connections 2023-12-05T09:21:18.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:21:18.490+0000 7f4538527700 1 -- 172.21.15.67:0/3336134820 wait complete. 2023-12-05T09:21:18.945 DEBUG:teuthology.orchestra.run.smithi067:osd.2> sudo journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.2.service 2023-12-05T09:21:18.949 INFO:tasks.cephadm:Deploying osd.3 on smithi134 with /dev/vg_nvme/lv_4... 2023-12-05T09:21:18.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-05T09:21:19.027 INFO:journalctl@ceph.osd.2.smithi067.stdout:-- Logs begin at Tue 2023-12-05 08:57:36 UTC. -- 2023-12-05T09:21:19.370 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi134/config 2023-12-05T09:21:19.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:19 smithi134 ceph-mon[116304]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:19.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:19 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:19.816 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:19 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:19.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:19 smithi067 ceph-mon[107174]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:19.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:19 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:19.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:19 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:19.871 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:19 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[148526]: 2023-12-05T09:21:19.466+0000 7fac9a0fe540 -1 osd.2 0 log_to_monitors true 2023-12-05T09:21:20.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:20 smithi067 ceph-mon[107174]: from='osd.2 [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T09:21:20.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:20 smithi067 ceph-mon[107174]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T09:21:20.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:20 smithi134 ceph-mon[116304]: from='osd.2 [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T09:21:20.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:20 smithi134 ceph-mon[116304]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T09:21:20.883 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-05T09:21:20.883 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-05T09:21:20.883 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2023-12-05T09:21:20.883 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2023-12-05T09:21:20.883 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0319721 s, 328 MB/s 2023-12-05T09:21:20.883 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2023-12-05T09:21:21.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2023-12-05T09:21:21.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:21 smithi134 ceph-mon[116304]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:21.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:21 smithi134 ceph-mon[116304]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T09:21:21.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:21 smithi134 ceph-mon[116304]: osdmap e17: 3 total, 2 up, 3 in 2023-12-05T09:21:21.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:21 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:21.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:21 smithi134 ceph-mon[116304]: from='osd.2 [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:21:21.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:21 smithi134 ceph-mon[116304]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:21:21.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:21 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:21.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:21 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:21.703 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi134/config 2023-12-05T09:21:21.738 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-mon[107174]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:21.738 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-mon[107174]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T09:21:21.738 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-mon[107174]: osdmap e17: 3 total, 2 up, 3 in 2023-12-05T09:21:21.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:21.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-mon[107174]: from='osd.2 [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:21:21.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-mon[107174]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:21:21.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:21.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:21.739 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[148526]: 2023-12-05T09:21:21.448+0000 7fac908e3700 -1 osd.2 0 waiting for initial osdmap 2023-12-05T09:21:21.739 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:21 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[148526]: 2023-12-05T09:21:21.454+0000 7fac8aedd700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:21:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.744+0000 7f8a56081700 1 -- 172.21.15.134:0/2302649529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50071bc0 msgr2=0x7f8a50070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:21:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.744+0000 7f8a56081700 1 --2- 172.21.15.134:0/2302649529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50071bc0 0x7f8a50070030 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8a40004940 tx=0x7f8a40009e30 comp rx=0 tx=0).stop 2023-12-05T09:21:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.744+0000 7f8a56081700 1 -- 172.21.15.134:0/2302649529 shutdown_connections 2023-12-05T09:21:22.746 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.744+0000 7f8a56081700 1 --2- 172.21.15.134:0/2302649529 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a50070570 0x7f8a500709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.744+0000 7f8a56081700 1 --2- 172.21.15.134:0/2302649529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50071bc0 0x7f8a50070030 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.744+0000 7f8a56081700 1 -- 172.21.15.134:0/2302649529 >> 172.21.15.134:0/2302649529 conn(0x7f8a500f82d0 msgr2=0x7f8a500fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:21:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.744+0000 7f8a56081700 1 -- 172.21.15.134:0/2302649529 shutdown_connections 2023-12-05T09:21:22.747 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.744+0000 7f8a56081700 1 -- 172.21.15.134:0/2302649529 wait complete. 2023-12-05T09:21:22.748 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.745+0000 7f8a56081700 1 Processor -- start 2023-12-05T09:21:22.748 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.745+0000 7f8a56081700 1 -- start start 2023-12-05T09:21:22.748 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.745+0000 7f8a56081700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50070570 0x7f8a50113b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.745+0000 7f8a56081700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a50071bc0 0x7f8a50114080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.745+0000 7f8a56081700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50114680 con 0x7f8a50071bc0 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.745+0000 7f8a56081700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50114f20 con 0x7f8a50070570 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a4f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50070570 0x7f8a50113b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a4f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50070570 0x7f8a50113b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60292/0 (socket says 172.21.15.134:60292) 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a4f7fe700 1 -- 172.21.15.134:0/4188941662 learned_addr learned my addr 172.21.15.134:0/4188941662 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a4effd700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a50071bc0 0x7f8a50114080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a4f7fe700 1 -- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a50071bc0 msgr2=0x7f8a50114080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a4f7fe700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a50071bc0 0x7f8a50114080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a4f7fe700 1 -- 172.21.15.134:0/4188941662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40005040 con 0x7f8a50070570 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a4f7fe700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50070570 0x7f8a50113b40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8a40000c00 tx=0x7f8a40009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a37fff700 1 -- 172.21.15.134:0/4188941662 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a40021070 con 0x7f8a50070570 2023-12-05T09:21:22.750 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a37fff700 1 -- 172.21.15.134:0/4188941662 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a4001c400 con 0x7f8a50070570 2023-12-05T09:21:22.750 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.746+0000 7f8a37fff700 1 -- 172.21.15.134:0/4188941662 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a4000e070 con 0x7f8a50070570 2023-12-05T09:21:22.750 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.747+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a501151a0 con 0x7f8a50070570 2023-12-05T09:21:22.750 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.747+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a50115680 con 0x7f8a50070570 2023-12-05T09:21:22.750 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.748+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5004bb80 con 0x7f8a50070570 2023-12-05T09:21:22.750 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.749+0000 7f8a37fff700 1 -- 172.21.15.134:0/4188941662 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 86391+0+0 (secure 0 0 0) 0x7f8a4001c9c0 con 0x7f8a50070570 2023-12-05T09:21:22.751 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.749+0000 7f8a37fff700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8a38068ed0 0x7f8a3806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:21:22.751 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.750+0000 7f8a37fff700 1 -- 172.21.15.134:0/4188941662 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2842+0+0 (secure 0 0 0) 0x7f8a40087420 con 0x7f8a50070570 2023-12-05T09:21:22.751 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.750+0000 7f8a4effd700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8a38068ed0 0x7f8a3806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:21:22.751 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.750+0000 7f8a4effd700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8a38068ed0 0x7f8a3806b380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009b80 tx=0x7f8a4400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:21:22.756 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.755+0000 7f8a37fff700 1 -- 172.21.15.134:0/4188941662 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8a40057e80 con 0x7f8a50070570 2023-12-05T09:21:22.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:22 smithi067 ceph-mon[107174]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2023-12-05T09:21:22.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:22 smithi067 ceph-mon[107174]: osdmap e18: 3 total, 2 up, 3 in 2023-12-05T09:21:22.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:22.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:22.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:22 smithi134 ceph-mon[116304]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2023-12-05T09:21:22.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:22 smithi134 ceph-mon[116304]: osdmap e18: 3 total, 2 up, 3 in 2023-12-05T09:21:22.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:22.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:22.957 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:22.955+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a50115db0 con 0x7f8a38068ed0 2023-12-05T09:21:23.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: purged_snaps scrub starts 2023-12-05T09:21:23.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: purged_snaps scrub ok 2023-12-05T09:21:23.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:23.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:23.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: osd.2 [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] boot 2023-12-05T09:21:23.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: osdmap e19: 3 total, 3 up, 3 in 2023-12-05T09:21:23.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:23.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:21:23.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:21:23.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:23 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: purged_snaps scrub starts 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: purged_snaps scrub ok 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: osd.2 [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] boot 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: osdmap e19: 3 total, 3 up, 3 in 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:21:23.743 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:23 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:25.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: osdmap e20: 3 total, 3 up, 3 in 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:25.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:24 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:21:25.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: osdmap e20: 3 total, 3 up, 3 in 2023-12-05T09:21:25.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:25.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:25.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:25.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:25.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:25.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:24 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: Detected new or changed devices on smithi067 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: Adjusting osd_memory_target on smithi067 to 4349M 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: pgmap v67: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-05T09:21:25.948 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: osdmap e21: 3 total, 3 up, 3 in 2023-12-05T09:21:25.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-05T09:21:25.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/840031166' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bce7967-b081-4a08-ac54-9552edf45ca4"}]: dispatch 2023-12-05T09:21:25.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bce7967-b081-4a08-ac54-9552edf45ca4"}]: dispatch 2023-12-05T09:21:25.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-05T09:21:25.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bce7967-b081-4a08-ac54-9552edf45ca4"}]': finished 2023-12-05T09:21:25.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: osdmap e22: 4 total, 3 up, 4 in 2023-12-05T09:21:25.949 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:26.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: Detected new or changed devices on smithi067 2023-12-05T09:21:26.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: Adjusting osd_memory_target on smithi067 to 4349M 2023-12-05T09:21:26.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: pgmap v67: 0 pgs: ; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: osdmap e21: 3 total, 3 up, 3 in 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/840031166' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bce7967-b081-4a08-ac54-9552edf45ca4"}]: dispatch 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bce7967-b081-4a08-ac54-9552edf45ca4"}]: dispatch 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bce7967-b081-4a08-ac54-9552edf45ca4"}]': finished 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: osdmap e22: 4 total, 3 up, 4 in 2023-12-05T09:21:26.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:27.370 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:21:27 smithi067 sudo[154433]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:21:27.371 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:21:27 smithi067 sudo[154433]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:27.371 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:21:27 smithi067 sudo[154433]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:27.371 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:21:27 smithi067 sudo[154433]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:27.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:26 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3373770494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:21:27.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:26 smithi067 ceph-mon[107174]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:27.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:21:27.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:26 smithi067 ceph-mon[107174]: osdmap e23: 4 total, 3 up, 4 in 2023-12-05T09:21:27.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:27.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:26 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3373770494' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:21:27.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:26 smithi134 ceph-mon[116304]: pgmap v70: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:27.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:21:27.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:26 smithi134 ceph-mon[116304]: osdmap e23: 4 total, 3 up, 4 in 2023-12-05T09:21:27.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:28.120 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:21:27 smithi067 sudo[154436]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:21:28.120 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:21:27 smithi067 sudo[154436]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:28.120 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:21:27 smithi067 sudo[154436]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:28.120 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:21:27 smithi067 sudo[154436]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:28.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:28 smithi067 ceph-mon[107174]: osdmap e24: 4 total, 3 up, 4 in 2023-12-05T09:21:28.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:28.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:28.621 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:21:28 smithi067 sudo[154439]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:21:28.621 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:21:28 smithi067 sudo[154439]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:28.621 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:21:28 smithi067 sudo[154439]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:28.621 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:21:28 smithi067 sudo[154439]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:28.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:28 smithi134 ceph-mon[116304]: osdmap e24: 4 total, 3 up, 4 in 2023-12-05T09:21:28.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:28.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:28.711 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:28.709+0000 7f8a37fff700 1 -- 172.21.15.134:0/4188941662 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8a400547c0 con 0x7f8a50070570 2023-12-05T09:21:29.120 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:21:28 smithi067 sudo[154442]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:21:29.120 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:21:28 smithi067 sudo[154442]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:29.120 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:21:28 smithi067 sudo[154442]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:29.120 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:21:28 smithi067 sudo[154442]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:29.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:29 smithi067 ceph-mon[107174]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:29.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:29 smithi067 ceph-mon[107174]: mgrmap e19: smithi067.alxtvv(active, since 2m), standbys: smithi134.yfqkak 2023-12-05T09:21:29.621 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:29 smithi067 sudo[154445]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:21:29.621 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:29 smithi067 sudo[154445]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:29.621 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:29 smithi067 sudo[154445]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:29.621 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:29 smithi067 sudo[154445]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:29 smithi134 ceph-mon[116304]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:29 smithi134 ceph-mon[116304]: mgrmap e19: smithi067.alxtvv(active, since 2m), standbys: smithi134.yfqkak 2023-12-05T09:21:30.120 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:29 smithi067 sudo[154448]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:21:30.120 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:29 smithi067 sudo[154448]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:30.120 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:29 smithi067 sudo[154448]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:30.121 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:21:29 smithi067 sudo[154448]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:30.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:30 smithi067 sudo[154451]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:21:30.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:30 smithi067 sudo[154451]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:30.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:30 smithi067 sudo[154451]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:30.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:30 smithi067 sudo[154451]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:31.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:30 smithi067 sudo[154454]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:21:31.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:30 smithi067 sudo[154454]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:31.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:30 smithi067 sudo[154454]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:31.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:30 smithi067 sudo[154454]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:31.838 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:31 smithi134 sudo[121932]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-05T09:21:31.839 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:31 smithi134 sudo[121932]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:31.839 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:31 smithi134 sudo[121932]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:31.839 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:31 smithi134 sudo[121932]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 sudo[121960]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-05T09:21:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 sudo[121960]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-05T09:21:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 sudo[121960]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-05T09:21:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 sudo[121960]: pam_unix(sudo:session): session closed for user root 2023-12-05T09:21:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 ceph-mon[116304]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T09:21:32.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 ceph-mon[116304]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:32.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 ceph-mon[116304]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T09:21:32.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:21:32.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:21:32.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:21:32.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:21:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:32 smithi067 ceph-mon[107174]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T09:21:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:32 smithi067 ceph-mon[107174]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:32 smithi067 ceph-mon[107174]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T09:21:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:21:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:21:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:21:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:21:33.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:33 smithi067 ceph-mon[107174]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T09:21:33.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:21:33.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:33.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:33 smithi067 ceph-mon[107174]: Deploying daemon osd.3 on smithi134 2023-12-05T09:21:33.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:33 smithi067 ceph-mon[107174]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T09:21:33.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:33.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:33 smithi067 ceph-mon[107174]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:33 smithi134 ceph-mon[116304]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-05T09:21:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:21:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:33 smithi134 ceph-mon[116304]: Deploying daemon osd.3 on smithi134 2023-12-05T09:21:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:33 smithi134 ceph-mon[116304]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-05T09:21:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:33 smithi134 ceph-mon[116304]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-05T09:21:35.332 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:35 smithi134 ceph-mon[116304]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-05T09:21:35.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:35 smithi067 ceph-mon[107174]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-12-05T09:21:37.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:36 smithi134 ceph-mon[116304]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-05T09:21:37.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:37.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:36 smithi067 ceph-mon[107174]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2023-12-05T09:21:37.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:38.112 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:37 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:38.112 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:37 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:38.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:37 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:38.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:37 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:39.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:38 smithi134 ceph-mon[116304]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-05T09:21:39.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:38 smithi067 ceph-mon[107174]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-05T09:21:40.069 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.069+0000 7f8a37fff700 1 -- 172.21.15.134:0/4188941662 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8a4400f040 con 0x7f8a38068ed0 2023-12-05T09:21:40.069 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 3 on host 'smithi134' 2023-12-05T09:21:40.072 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8a38068ed0 msgr2=0x7f8a3806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:21:40.072 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8a38068ed0 0x7f8a3806b380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009b80 tx=0x7f8a4400b040 comp rx=0 tx=0).stop 2023-12-05T09:21:40.072 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50070570 msgr2=0x7f8a50113b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:21:40.073 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50070570 0x7f8a50113b40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8a40000c00 tx=0x7f8a40009e30 comp rx=0 tx=0).stop 2023-12-05T09:21:40.073 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 shutdown_connections 2023-12-05T09:21:40.073 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8a38068ed0 0x7f8a3806b380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:40.073 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a50070570 0x7f8a50113b40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:40.073 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 --2- 172.21.15.134:0/4188941662 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a50071bc0 0x7f8a50114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:40.073 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 >> 172.21.15.134:0/4188941662 conn(0x7f8a500f82d0 msgr2=0x7f8a500fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:21:40.073 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 shutdown_connections 2023-12-05T09:21:40.073 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:40.072+0000 7f8a56081700 1 -- 172.21.15.134:0/4188941662 wait complete. 2023-12-05T09:21:40.401 DEBUG:teuthology.orchestra.run.smithi134:osd.3> sudo journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.3.service 2023-12-05T09:21:40.406 INFO:tasks.cephadm:Deploying osd.4 on smithi134 with /dev/vg_nvme/lv_3... 2023-12-05T09:21:40.406 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-05T09:21:40.482 INFO:journalctl@ceph.osd.3.smithi134.stdout:-- Logs begin at Tue 2023-12-05 08:57:58 UTC. -- 2023-12-05T09:21:40.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:40.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:40.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:40.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:40.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:40.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:40.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:40.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:41.124 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi134/config 2023-12-05T09:21:41.333 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:21:40 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[122627]: 2023-12-05T09:21:40.958+0000 7f81646e3540 -1 osd.3 0 log_to_monitors true 2023-12-05T09:21:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:41 smithi134 ceph-mon[116304]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-12-05T09:21:41.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:41 smithi134 ceph-mon[116304]: from='osd.3 [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:21:41.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:41 smithi134 ceph-mon[116304]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:21:41.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:21:41.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:41 smithi067 ceph-mon[107174]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-12-05T09:21:41.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:41 smithi067 ceph-mon[107174]: from='osd.3 [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:21:41.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:41 smithi067 ceph-mon[107174]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:21:41.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:21:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-05T09:21:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-05T09:21:43.010 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2023-12-05T09:21:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2023-12-05T09:21:43.010 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0409019 s, 256 MB/s 2023-12-05T09:21:43.011 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 2023-12-05T09:21:43.011 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2023-12-05T09:21:43.271 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:21:42 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[122627]: 2023-12-05T09:21:42.968+0000 7f815aec8700 -1 osd.3 0 waiting for initial osdmap 2023-12-05T09:21:43.271 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:21:42 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[122627]: 2023-12-05T09:21:42.979+0000 7f8157cc7700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:21:43.272 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:42 smithi134 ceph-mon[116304]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T09:21:43.272 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:42 smithi134 ceph-mon[116304]: osdmap e25: 4 total, 3 up, 4 in 2023-12-05T09:21:43.272 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:42 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:43.272 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:42 smithi134 ceph-mon[116304]: from='osd.3 [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:21:43.272 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:42 smithi134 ceph-mon[116304]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:21:43.272 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:42 smithi134 ceph-mon[116304]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-05T09:21:43.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:42 smithi067 ceph-mon[107174]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T09:21:43.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:42 smithi067 ceph-mon[107174]: osdmap e25: 4 total, 3 up, 4 in 2023-12-05T09:21:43.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:42 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:43.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:42 smithi067 ceph-mon[107174]: from='osd.3 [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:21:43.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:42 smithi067 ceph-mon[107174]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:21:43.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:42 smithi067 ceph-mon[107174]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-12-05T09:21:43.512 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2023-12-05T09:21:43.990 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi134/config 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: purged_snaps scrub starts 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: purged_snaps scrub ok 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: osdmap e26: 4 total, 3 up, 4 in 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:44.266 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:44.267 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:44.267 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:44.267 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:44.267 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: osd.3 [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] boot 2023-12-05T09:21:44.267 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: osdmap e27: 4 total, 4 up, 4 in 2023-12-05T09:21:44.267 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:43 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:44.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: purged_snaps scrub starts 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: purged_snaps scrub ok 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: osdmap e26: 4 total, 3 up, 4 in 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: osd.3 [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] boot 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: osdmap e27: 4 total, 4 up, 4 in 2023-12-05T09:21:44.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:43 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:21:45.151 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.150+0000 7fef1c33c700 1 -- 172.21.15.134:0/459518394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fcbf0 msgr2=0x7fef140fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:21:45.152 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.150+0000 7fef1c33c700 1 --2- 172.21.15.134:0/459518394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fcbf0 0x7fef140fd000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef10004940 tx=0x7fef10009e30 comp rx=0 tx=0).stop 2023-12-05T09:21:45.152 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.150+0000 7fef1c33c700 1 -- 172.21.15.134:0/459518394 shutdown_connections 2023-12-05T09:21:45.152 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.150+0000 7fef1c33c700 1 --2- 172.21.15.134:0/459518394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef140fde00 0x7fef140fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:45.152 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.150+0000 7fef1c33c700 1 --2- 172.21.15.134:0/459518394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fcbf0 0x7fef140fd000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:45.152 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.150+0000 7fef1c33c700 1 -- 172.21.15.134:0/459518394 >> 172.21.15.134:0/459518394 conn(0x7fef140f82d0 msgr2=0x7fef140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:21:45.152 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.150+0000 7fef1c33c700 1 -- 172.21.15.134:0/459518394 shutdown_connections 2023-12-05T09:21:45.152 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.151+0000 7fef1c33c700 1 -- 172.21.15.134:0/459518394 wait complete. 2023-12-05T09:21:45.152 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.151+0000 7fef1c33c700 1 Processor -- start 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.151+0000 7fef1c33c700 1 -- start start 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef1c33c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef140fcbf0 0x7fef1410f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef1c33c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fde00 0x7fef1410fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef1c33c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef141102a0 con 0x7fef140fcbf0 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef1c33c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef14110b40 con 0x7fef140fde00 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef198d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fde00 0x7fef1410fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef198d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fde00 0x7fef1410fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:48760/0 (socket says 172.21.15.134:48760) 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef198d7700 1 -- 172.21.15.134:0/949579497 learned_addr learned my addr 172.21.15.134:0/949579497 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:21:45.154 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef1a0d8700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef140fcbf0 0x7fef1410f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef198d7700 1 -- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef140fcbf0 msgr2=0x7fef1410f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef198d7700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef140fcbf0 0x7fef1410f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef198d7700 1 -- 172.21.15.134:0/949579497 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef10005040 con 0x7fef140fde00 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.152+0000 7fef1a0d8700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef140fcbf0 0x7fef1410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.153+0000 7fef198d7700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fde00 0x7fef1410fca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c830 tx=0x7fef04004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.153+0000 7fef0affd700 1 -- 172.21.15.134:0/949579497 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef0400a760 con 0x7fef140fde00 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.153+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef14110e20 con 0x7fef140fde00 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.153+0000 7fef0affd700 1 -- 172.21.15.134:0/949579497 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef0400ad70 con 0x7fef140fde00 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.153+0000 7fef0affd700 1 -- 172.21.15.134:0/949579497 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef040113a0 con 0x7fef140fde00 2023-12-05T09:21:45.155 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.153+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef14111360 con 0x7fef140fde00 2023-12-05T09:21:45.156 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.154+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef14101ea0 con 0x7fef140fde00 2023-12-05T09:21:45.156 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.155+0000 7fef0affd700 1 -- 172.21.15.134:0/949579497 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fef04012400 con 0x7fef140fde00 2023-12-05T09:21:45.156 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.156+0000 7fef0affd700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fef00068f70 0x7fef0006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:21:45.156 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.156+0000 7fef0affd700 1 -- 172.21.15.134:0/949579497 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3799+0+0 (secure 0 0 0) 0x7fef04086790 con 0x7fef140fde00 2023-12-05T09:21:45.157 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.156+0000 7fef1a0d8700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fef00068f70 0x7fef0006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:21:45.157 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.157+0000 7fef1a0d8700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fef00068f70 0x7fef0006b420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef10004f90 tx=0x7fef10009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:21:45.161 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.161+0000 7fef0affd700 1 -- 172.21.15.134:0/949579497 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fef04056d70 con 0x7fef140fde00 2023-12-05T09:21:45.360 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:21:45.360+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fef14111650 con 0x7fef00068f70 2023-12-05T09:21:45.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:44 smithi067 ceph-mon[107174]: Detected new or changed devices on smithi134 2023-12-05T09:21:45.373 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:44 smithi067 ceph-mon[107174]: Adjusting osd_memory_target on smithi134 to 16119M 2023-12-05T09:21:45.373 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:44 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:45.373 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:44 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:45.373 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:44 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:45.373 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:44 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:45.373 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:44 smithi067 ceph-mon[107174]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:21:45.373 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:44 smithi067 ceph-mon[107174]: osdmap e28: 4 total, 4 up, 4 in 2023-12-05T09:21:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:44 smithi134 ceph-mon[116304]: Detected new or changed devices on smithi134 2023-12-05T09:21:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:44 smithi134 ceph-mon[116304]: Adjusting osd_memory_target on smithi134 to 16119M 2023-12-05T09:21:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:44 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:21:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:44 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:44 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:21:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:44 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:21:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:44 smithi134 ceph-mon[116304]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:21:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:44 smithi134 ceph-mon[116304]: osdmap e28: 4 total, 4 up, 4 in 2023-12-05T09:21:46.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:46 smithi067 ceph-mon[107174]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:21:46.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:46 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:21:46.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:46 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:21:46.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:46 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:46.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:46 smithi067 ceph-mon[107174]: osdmap e29: 4 total, 4 up, 4 in 2023-12-05T09:21:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:46 smithi134 ceph-mon[116304]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:21:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:46 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:21:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:46 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:21:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:46 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:46 smithi134 ceph-mon[116304]: osdmap e29: 4 total, 4 up, 4 in 2023-12-05T09:21:47.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:47 smithi067 ceph-mon[107174]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:21:47.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:47 smithi067 ceph-mon[107174]: osdmap e30: 4 total, 4 up, 4 in 2023-12-05T09:21:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:47 smithi134 ceph-mon[116304]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:21:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:47 smithi134 ceph-mon[116304]: osdmap e30: 4 total, 4 up, 4 in 2023-12-05T09:21:48.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:48 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3873478262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d1c05dc-2b50-493a-9e5e-d0b16d911091"}]: dispatch 2023-12-05T09:21:48.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:48 smithi067 ceph-mon[107174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d1c05dc-2b50-493a-9e5e-d0b16d911091"}]: dispatch 2023-12-05T09:21:48.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:48 smithi067 ceph-mon[107174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d1c05dc-2b50-493a-9e5e-d0b16d911091"}]': finished 2023-12-05T09:21:48.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:48 smithi067 ceph-mon[107174]: osdmap e31: 5 total, 4 up, 5 in 2023-12-05T09:21:48.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:48 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:21:48.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:48 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3873478262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d1c05dc-2b50-493a-9e5e-d0b16d911091"}]: dispatch 2023-12-05T09:21:48.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:48 smithi134 ceph-mon[116304]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d1c05dc-2b50-493a-9e5e-d0b16d911091"}]: dispatch 2023-12-05T09:21:48.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:48 smithi134 ceph-mon[116304]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d1c05dc-2b50-493a-9e5e-d0b16d911091"}]': finished 2023-12-05T09:21:48.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:48 smithi134 ceph-mon[116304]: osdmap e31: 5 total, 4 up, 5 in 2023-12-05T09:21:48.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:21:49.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:49 smithi067 ceph-mon[107174]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-05T09:21:49.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:49 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/4045207130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:21:49.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:49 smithi134 ceph-mon[116304]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-05T09:21:49.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:49 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/4045207130' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:21:51.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:51 smithi134 ceph-mon[116304]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2023-12-05T09:21:51.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:51 smithi067 ceph-mon[107174]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2023-12-05T09:21:53.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:53 smithi134 ceph-mon[116304]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2023-12-05T09:21:53.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:53 smithi067 ceph-mon[107174]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2023-12-05T09:21:55.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:55 smithi134 ceph-mon[116304]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-05T09:21:55.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:55 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:21:55.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:55 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:55.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:55 smithi134 ceph-mon[116304]: Deploying daemon osd.4 on smithi134 2023-12-05T09:21:55.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:55 smithi067 ceph-mon[107174]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-05T09:21:55.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:55 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:21:55.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:55 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:21:55.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:55 smithi067 ceph-mon[107174]: Deploying daemon osd.4 on smithi134 2023-12-05T09:21:57.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:56 smithi134 ceph-mon[116304]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-12-05T09:21:57.342 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:21:57.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:56 smithi067 ceph-mon[107174]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-12-05T09:21:57.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:21:59.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:21:59 smithi134 ceph-mon[116304]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-12-05T09:21:59.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:21:59 smithi067 ceph-mon[107174]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-12-05T09:22:00.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:00.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:00.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:00 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:22:00.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:00.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:00.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:00 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:22:01.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:01 smithi067 ceph-mon[107174]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:22:01.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:01 smithi134 ceph-mon[116304]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:22:02.178 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 4 on host 'smithi134' 2023-12-05T09:22:02.179 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.176+0000 7fef0affd700 1 -- 172.21.15.134:0/949579497 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fef14111650 con 0x7fef00068f70 2023-12-05T09:22:02.180 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fef00068f70 msgr2=0x7fef0006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fef00068f70 0x7fef0006b420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fef10004f90 tx=0x7fef10009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fde00 msgr2=0x7fef1410fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fde00 0x7fef1410fca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c830 tx=0x7fef04004470 comp rx=0 tx=0).stop 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 shutdown_connections 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fef00068f70 0x7fef0006b420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fef140fcbf0 0x7fef1410f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 --2- 172.21.15.134:0/949579497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef140fde00 0x7fef1410fca0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 >> 172.21.15.134:0/949579497 conn(0x7fef140f82d0 msgr2=0x7fef140ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 shutdown_connections 2023-12-05T09:22:02.181 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:02.179+0000 7fef1c33c700 1 -- 172.21.15.134:0/949579497 wait complete. 2023-12-05T09:22:02.586 DEBUG:teuthology.orchestra.run.smithi134:osd.4> sudo journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.4.service 2023-12-05T09:22:02.592 INFO:tasks.cephadm:Deploying osd.5 on smithi134 with /dev/vg_nvme/lv_2... 2023-12-05T09:22:02.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-05T09:22:02.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:02 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:02 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:02 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:02.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:02 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:22:02.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:02 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:02 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:02 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:02 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:22:02.674 INFO:journalctl@ceph.osd.4.smithi134.stdout:-- Logs begin at Tue 2023-12-05 08:57:58 UTC. -- 2023-12-05T09:22:02.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:02 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:02 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:02 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:02.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:02 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:22:02.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:02 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:02 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:02 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:02.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:02 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:22:03.393 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi134/config 2023-12-05T09:22:03.588 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:22:03 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[130583]: 2023-12-05T09:22:03.329+0000 7fa583b76540 -1 osd.4 0 log_to_monitors true 2023-12-05T09:22:03.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:03 smithi134 ceph-mon[116304]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:22:03.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:03 smithi134 ceph-mon[116304]: from='osd.4 [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:22:03.588 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:03 smithi134 ceph-mon[116304]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:22:03.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:03 smithi067 ceph-mon[107174]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:22:03.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:03 smithi067 ceph-mon[107174]: from='osd.4 [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:22:03.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:03 smithi067 ceph-mon[107174]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:22:04.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:04 smithi067 ceph-mon[107174]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T09:22:04.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:04 smithi067 ceph-mon[107174]: osdmap e32: 5 total, 4 up, 5 in 2023-12-05T09:22:04.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:04 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:22:04.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:04 smithi067 ceph-mon[107174]: from='osd.4 [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:22:04.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:04 smithi067 ceph-mon[107174]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:22:04.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:04 smithi134 ceph-mon[116304]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T09:22:04.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:04 smithi134 ceph-mon[116304]: osdmap e32: 5 total, 4 up, 5 in 2023-12-05T09:22:04.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:04 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:22:04.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:04 smithi134 ceph-mon[116304]: from='osd.4 [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:22:04.880 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:04 smithi134 ceph-mon[116304]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:22:04.880 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:22:04 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[130583]: 2023-12-05T09:22:04.549+0000 7fa57a35b700 -1 osd.4 0 waiting for initial osdmap 2023-12-05T09:22:04.880 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:22:04 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[130583]: 2023-12-05T09:22:04.560+0000 7fa575156700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:22:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-05T09:22:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-05T09:22:05.286 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2023-12-05T09:22:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2023-12-05T09:22:05.286 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0442065 s, 237 MB/s 2023-12-05T09:22:05.286 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2023-12-05T09:22:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:05 smithi134 ceph-mon[116304]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:22:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:05 smithi134 ceph-mon[116304]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2023-12-05T09:22:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:05 smithi134 ceph-mon[116304]: osdmap e33: 5 total, 4 up, 5 in 2023-12-05T09:22:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:22:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:05 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:22:05.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2023-12-05T09:22:05.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:05 smithi067 ceph-mon[107174]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-05T09:22:05.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:05 smithi067 ceph-mon[107174]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2023-12-05T09:22:05.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:05 smithi067 ceph-mon[107174]: osdmap e33: 5 total, 4 up, 5 in 2023-12-05T09:22:05.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:22:05.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:05 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:22:06.249 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi134/config 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: purged_snaps scrub starts 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: purged_snaps scrub ok 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: osd.4 [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] boot 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: osdmap e34: 5 total, 5 up, 5 in 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:06.717 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:06.718 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:22:06.718 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:06 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:06.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: purged_snaps scrub starts 2023-12-05T09:22:06.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: purged_snaps scrub ok 2023-12-05T09:22:06.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: osd.4 [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] boot 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: osdmap e34: 5 total, 5 up, 5 in 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:22:06.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:06 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:07.357 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.355+0000 7f3e9a55a700 1 -- 172.21.15.134:0/2393642712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 msgr2=0x7f3e940fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:07.357 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.355+0000 7f3e9a55a700 1 --2- 172.21.15.134:0/2393642712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 0x7f3e940fe250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3e88004940 tx=0x7f3e88009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:07.357 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.356+0000 7f3e9a55a700 1 -- 172.21.15.134:0/2393642712 shutdown_connections 2023-12-05T09:22:07.358 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.356+0000 7f3e9a55a700 1 --2- 172.21.15.134:0/2393642712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 0x7f3e940fe250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:07.358 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.356+0000 7f3e9a55a700 1 --2- 172.21.15.134:0/2393642712 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e940fcbf0 0x7f3e940fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:07.358 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.356+0000 7f3e9a55a700 1 -- 172.21.15.134:0/2393642712 >> 172.21.15.134:0/2393642712 conn(0x7f3e940f82d0 msgr2=0x7f3e940fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:07.358 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.356+0000 7f3e9a55a700 1 -- 172.21.15.134:0/2393642712 shutdown_connections 2023-12-05T09:22:07.358 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.356+0000 7f3e9a55a700 1 -- 172.21.15.134:0/2393642712 wait complete. 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.357+0000 7f3e9a55a700 1 Processor -- start 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.357+0000 7f3e9a55a700 1 -- start start 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.357+0000 7f3e9a55a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e940fcbf0 0x7f3e9410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e9a55a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 0x7f3e9410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e9a55a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9410e010 con 0x7f3e940fcbf0 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e9a55a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9410e8b0 con 0x7f3e940fde00 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e937fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 0x7f3e9410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e937fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 0x7f3e9410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:43768/0 (socket says 172.21.15.134:43768) 2023-12-05T09:22:07.359 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e937fe700 1 -- 172.21.15.134:0/3061690821 learned_addr learned my addr 172.21.15.134:0/3061690821 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:22:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e93fff700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e940fcbf0 0x7f3e9410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:07.360 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e937fe700 1 -- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e940fcbf0 msgr2=0x7f3e9410d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e937fe700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e940fcbf0 0x7f3e9410d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e937fe700 1 -- 172.21.15.134:0/3061690821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e88005040 con 0x7f3e940fde00 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.358+0000 7f3e937fe700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 0x7f3e9410da10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009fd0 tx=0x7f3e88009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.359+0000 7f3e90ff9700 1 -- 172.21.15.134:0/3061690821 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e88021070 con 0x7f3e940fde00 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.359+0000 7f3e90ff9700 1 -- 172.21.15.134:0/3061690821 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e8801c400 con 0x7f3e940fde00 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.359+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9410eb30 con 0x7f3e940fde00 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.359+0000 7f3e90ff9700 1 -- 172.21.15.134:0/3061690821 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8800e070 con 0x7f3e940fde00 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.359+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9410f010 con 0x7f3e940fde00 2023-12-05T09:22:07.361 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.360+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9404bb80 con 0x7f3e940fde00 2023-12-05T09:22:07.362 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.361+0000 7f3e90ff9700 1 -- 172.21.15.134:0/3061690821 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3e8801c570 con 0x7f3e940fde00 2023-12-05T09:22:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.362+0000 7f3e90ff9700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3e7c068f70 0x7f3e7c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.362+0000 7f3e90ff9700 1 -- 172.21.15.134:0/3061690821 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f3e88087b00 con 0x7f3e940fde00 2023-12-05T09:22:07.363 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.362+0000 7f3e93fff700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3e7c068f70 0x7f3e7c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:07.364 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.363+0000 7f3e93fff700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3e7c068f70 0x7f3e7c06b420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e84004600 tx=0x7f3e8400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:07.367 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.366+0000 7f3e90ff9700 1 -- 172.21.15.134:0/3061690821 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3e88057f30 con 0x7f3e940fde00 2023-12-05T09:22:07.563 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:07.562+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e9410f530 con 0x7f3e7c068f70 2023-12-05T09:22:07.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:07 smithi067 ceph-mon[107174]: Detected new or changed devices on smithi134 2023-12-05T09:22:07.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:07 smithi067 ceph-mon[107174]: Adjusting osd_memory_target on smithi134 to 8059M 2023-12-05T09:22:07.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:07 smithi067 ceph-mon[107174]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:07.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:07 smithi067 ceph-mon[107174]: osdmap e35: 5 total, 5 up, 5 in 2023-12-05T09:22:07.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:07 smithi134 ceph-mon[116304]: Detected new or changed devices on smithi134 2023-12-05T09:22:07.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:07 smithi134 ceph-mon[116304]: Adjusting osd_memory_target on smithi134 to 8059M 2023-12-05T09:22:07.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:07 smithi134 ceph-mon[116304]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:07.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:07 smithi134 ceph-mon[116304]: osdmap e35: 5 total, 5 up, 5 in 2023-12-05T09:22:08.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:08 smithi067 ceph-mon[107174]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:22:08.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:08 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:22:08.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:08 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:22:08.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:08 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:08.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:08 smithi134 ceph-mon[116304]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:22:08.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:08 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-05T09:22:08.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:08 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-05T09:22:08.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:08 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:09.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:09 smithi067 ceph-mon[107174]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:09.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:09 smithi134 ceph-mon[116304]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:10.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:10 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/2479115563' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43ae157e-59ef-448e-b33f-5ebfadf73ce6"}]: dispatch 2023-12-05T09:22:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:10 smithi067 ceph-mon[107174]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43ae157e-59ef-448e-b33f-5ebfadf73ce6"}]: dispatch 2023-12-05T09:22:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:10 smithi067 ceph-mon[107174]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43ae157e-59ef-448e-b33f-5ebfadf73ce6"}]': finished 2023-12-05T09:22:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:10 smithi067 ceph-mon[107174]: osdmap e36: 6 total, 5 up, 6 in 2023-12-05T09:22:10.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:10 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:10.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:10 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/2479115563' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43ae157e-59ef-448e-b33f-5ebfadf73ce6"}]: dispatch 2023-12-05T09:22:10.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:10 smithi134 ceph-mon[116304]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43ae157e-59ef-448e-b33f-5ebfadf73ce6"}]: dispatch 2023-12-05T09:22:10.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:10 smithi134 ceph-mon[116304]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43ae157e-59ef-448e-b33f-5ebfadf73ce6"}]': finished 2023-12-05T09:22:10.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:10 smithi134 ceph-mon[116304]: osdmap e36: 6 total, 5 up, 6 in 2023-12-05T09:22:10.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:10 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:11.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:11 smithi067 ceph-mon[107174]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:11.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:11 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3311524121' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:22:11.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:11 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:22:11.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:11 smithi134 ceph-mon[116304]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:11.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:11 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3311524121' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-05T09:22:11.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:11 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:22:13.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:13 smithi067 ceph-mon[107174]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:13.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:13 smithi134 ceph-mon[116304]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:15.842 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:15 smithi134 ceph-mon[116304]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:15.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:15 smithi067 ceph-mon[107174]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:17.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:16 smithi067 ceph-mon[107174]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:17.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:16 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:22:17.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:16 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:17.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:16 smithi134 ceph-mon[116304]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:17.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:16 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:22:17.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:16 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:17 smithi134 ceph-mon[116304]: Deploying daemon osd.5 on smithi134 2023-12-05T09:22:18.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:17 smithi067 ceph-mon[107174]: Deploying daemon osd.5 on smithi134 2023-12-05T09:22:19.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:18 smithi067 ceph-mon[107174]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:19.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:18 smithi134 ceph-mon[116304]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:21.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:21 smithi134 ceph-mon[116304]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:21.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:21 smithi067 ceph-mon[107174]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:22.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:22:22.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:22.550 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:22.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:22:22.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:22.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:23.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:23 smithi134 ceph-mon[116304]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:23.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:23 smithi067 ceph-mon[107174]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:24.733 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.732+0000 7f3e90ff9700 1 -- 172.21.15.134:0/3061690821 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3e9410f530 con 0x7f3e7c068f70 2023-12-05T09:22:24.733 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 5 on host 'smithi134' 2023-12-05T09:22:24.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3e7c068f70 msgr2=0x7f3e7c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:24.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3e7c068f70 0x7f3e7c06b420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e84004600 tx=0x7f3e8400b040 comp rx=0 tx=0).stop 2023-12-05T09:22:24.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 msgr2=0x7f3e9410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:24.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 0x7f3e9410da10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009fd0 tx=0x7f3e88009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:24.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 shutdown_connections 2023-12-05T09:22:24.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3e7c068f70 0x7f3e7c06b420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:24.735 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3e940fcbf0 0x7f3e9410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:24.736 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 --2- 172.21.15.134:0/3061690821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940fde00 0x7f3e9410da10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:24.736 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 >> 172.21.15.134:0/3061690821 conn(0x7f3e940f82d0 msgr2=0x7f3e94101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:24.736 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 shutdown_connections 2023-12-05T09:22:24.736 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:24.735+0000 7f3e9a55a700 1 -- 172.21.15.134:0/3061690821 wait complete. 2023-12-05T09:22:25.111 DEBUG:teuthology.orchestra.run.smithi134:osd.5> sudo journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.5.service 2023-12-05T09:22:25.116 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-05T09:22:25.116 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-05T09:22:25.181 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:25 smithi134 ceph-mon[116304]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:25.181 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:25.181 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:25.181 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:25.181 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:25.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:-- Logs begin at Tue 2023-12-05 08:57:58 UTC. -- 2023-12-05T09:22:25.564 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:25.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:25 smithi067 ceph-mon[107174]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:25.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:25.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:25.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:25.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:26.129 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:22:25 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[138430]: 2023-12-05T09:22:25.800+0000 7f2e3411c540 -1 osd.5 0 log_to_monitors true 2023-12-05T09:22:26.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:26 smithi067 ceph-mon[107174]: from='osd.5 [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:22:26.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:26 smithi067 ceph-mon[107174]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:22:26.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:22:26.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:26 smithi134 ceph-mon[116304]: from='osd.5 [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:22:26.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:26 smithi134 ceph-mon[116304]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:22:26.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:22:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.826+0000 7f2993722700 1 -- 172.21.15.67:0/2305372831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fcbf0 msgr2=0x7f298c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.826+0000 7f2993722700 1 --2- 172.21.15.67:0/2305372831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fcbf0 0x7f298c0fd000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2988004940 tx=0x7f2988009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.826+0000 7f2993722700 1 -- 172.21.15.67:0/2305372831 shutdown_connections 2023-12-05T09:22:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.826+0000 7f2993722700 1 --2- 172.21.15.67:0/2305372831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f298c0fde00 0x7f298c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.826+0000 7f2993722700 1 --2- 172.21.15.67:0/2305372831 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fcbf0 0x7f298c0fd000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.826+0000 7f2993722700 1 -- 172.21.15.67:0/2305372831 >> 172.21.15.67:0/2305372831 conn(0x7f298c0f82d0 msgr2=0x7f298c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.826+0000 7f2993722700 1 -- 172.21.15.67:0/2305372831 shutdown_connections 2023-12-05T09:22:26.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.826+0000 7f2993722700 1 -- 172.21.15.67:0/2305372831 wait complete. 2023-12-05T09:22:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.827+0000 7f2993722700 1 Processor -- start 2023-12-05T09:22:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.827+0000 7f2993722700 1 -- start start 2023-12-05T09:22:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.827+0000 7f2993722700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f298c0fcbf0 0x7f298c10f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.827+0000 7f2993722700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fde00 0x7f298c10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.827+0000 7f2993722700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c110220 con 0x7f298c0fde00 2023-12-05T09:22:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.827+0000 7f2993722700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c110ac0 con 0x7f298c0fcbf0 2023-12-05T09:22:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f2990cbd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fde00 0x7f298c10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:26.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f2990cbd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fde00 0x7f298c10fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55820/0 (socket says 172.21.15.67:55820) 2023-12-05T09:22:26.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f2990cbd700 1 -- 172.21.15.67:0/3035148279 learned_addr learned my addr 172.21.15.67:0/3035148279 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:26.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f29914be700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f298c0fcbf0 0x7f298c10f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:26.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f2990cbd700 1 -- 172.21.15.67:0/3035148279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f298c0fcbf0 msgr2=0x7f298c10f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f2990cbd700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f298c0fcbf0 0x7f298c10f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f2990cbd700 1 -- 172.21.15.67:0/3035148279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988005040 con 0x7f298c0fde00 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f2990cbd700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fde00 0x7f298c10fc20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f297c00eb40 tx=0x7f297c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.828+0000 7f2981ffb700 1 -- 172.21.15.67:0/3035148279 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297c007cc0 con 0x7f298c0fde00 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.829+0000 7f2981ffb700 1 -- 172.21.15.67:0/3035148279 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f297c00f040 con 0x7f298c0fde00 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.829+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c110d40 con 0x7f298c0fde00 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.829+0000 7f2981ffb700 1 -- 172.21.15.67:0/3035148279 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297c00c990 con 0x7f298c0fde00 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.829+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c111280 con 0x7f298c0fde00 2023-12-05T09:22:26.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.830+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c101ea0 con 0x7f298c0fde00 2023-12-05T09:22:26.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.831+0000 7f2981ffb700 1 -- 172.21.15.67:0/3035148279 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f297c00cc00 con 0x7f298c0fde00 2023-12-05T09:22:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.831+0000 7f2981ffb700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2978068f60 0x7f297806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.832+0000 7f2981ffb700 1 -- 172.21.15.67:0/3035148279 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4338+0+0 (secure 0 0 0) 0x7f297c0865d0 con 0x7f298c0fde00 2023-12-05T09:22:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.832+0000 7f29914be700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2978068f60 0x7f297806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:26.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.832+0000 7f29914be700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2978068f60 0x7f297806b410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29880045a0 tx=0x7f2988009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:26.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:26.837+0000 7f2981ffb700 1 -- 172.21.15.67:0/3035148279 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f297c04da00 con 0x7f298c0fde00 2023-12-05T09:22:27.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.043+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f298c1018c0 con 0x7f298c0fde00 2023-12-05T09:22:27.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.044+0000 7f2981ffb700 1 -- 172.21.15.67:0/3035148279 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f297c056920 con 0x7f298c0fde00 2023-12-05T09:22:27.045 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2978068f60 msgr2=0x7f297806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2978068f60 0x7f297806b410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29880045a0 tx=0x7f2988009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fde00 msgr2=0x7f298c10fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fde00 0x7f298c10fc20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f297c00eb40 tx=0x7f297c00b040 comp rx=0 tx=0).stop 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 shutdown_connections 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2978068f60 0x7f297806b410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f298c0fcbf0 0x7f298c10f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 --2- 172.21.15.67:0/3035148279 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f298c0fde00 0x7f298c10fc20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 >> 172.21.15.67:0/3035148279 conn(0x7f298c0f82d0 msgr2=0x7f298c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 shutdown_connections 2023-12-05T09:22:27.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:27.046+0000 7f2993722700 1 -- 172.21.15.67:0/3035148279 wait complete. 2023-12-05T09:22:27.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:27 smithi067 ceph-mon[107174]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:27.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:27 smithi067 ceph-mon[107174]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T09:22:27.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:27 smithi067 ceph-mon[107174]: osdmap e37: 6 total, 5 up, 6 in 2023-12-05T09:22:27.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:27 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:27.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:27 smithi067 ceph-mon[107174]: from='osd.5 [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:22:27.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:27 smithi067 ceph-mon[107174]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:22:27.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:27 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3035148279' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T09:22:27.515 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1701768125,"num_in_osds":6,"osd_in_since":1701768129,"num_remapped_pgs":0} 2023-12-05T09:22:27.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-mon[116304]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:27.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-mon[116304]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T09:22:27.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-mon[116304]: osdmap e37: 6 total, 5 up, 6 in 2023-12-05T09:22:27.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:27.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-mon[116304]: from='osd.5 [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:22:27.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-mon[116304]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:22:27.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3035148279' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T09:22:27.631 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[138430]: 2023-12-05T09:22:27.154+0000 7f2e2a901700 -1 osd.5 0 waiting for initial osdmap 2023-12-05T09:22:27.631 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:22:27 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[138430]: 2023-12-05T09:22:27.164+0000 7f2e24efb700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: osdmap e38: 6 total, 5 up, 6 in 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:28.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:22:28.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:28.516 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-05T09:22:28.581 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2023-12-05T09:22:28.581 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: osdmap e38: 6 total, 5 up, 6 in 2023-12-05T09:22:28.581 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:28.581 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:28.581 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:28.582 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:28.582 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:28.582 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:28.582 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:22:28.582 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:28.582 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:28.582 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:22:28.582 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:28.950 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: purged_snaps scrub starts 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: purged_snaps scrub ok 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: Detected new or changed devices on smithi134 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: Adjusting osd_memory_target on smithi134 to 5373M 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: osd.5 [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] boot 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: osdmap e39: 6 total, 6 up, 6 in 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:22:29.425 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:29.426 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:22:29.426 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: purged_snaps scrub starts 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: purged_snaps scrub ok 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: Detected new or changed devices on smithi134 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: Adjusting osd_memory_target on smithi134 to 5373M 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: osd.5 [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] boot 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: osdmap e39: 6 total, 6 up, 6 in 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:22:29.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:22:29.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:22:29.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:22:29.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.469+0000 7f2a315ca700 1 -- 172.21.15.67:0/2557395439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 msgr2=0x7f2a2c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.469+0000 7f2a315ca700 1 --2- 172.21.15.67:0/2557395439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 0x7f2a2c0fd000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c004940 tx=0x7f2a1c009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.469+0000 7f2a315ca700 1 -- 172.21.15.67:0/2557395439 shutdown_connections 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.469+0000 7f2a315ca700 1 --2- 172.21.15.67:0/2557395439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a2c0fde00 0x7f2a2c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.469+0000 7f2a315ca700 1 --2- 172.21.15.67:0/2557395439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 0x7f2a2c0fd000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.469+0000 7f2a315ca700 1 -- 172.21.15.67:0/2557395439 >> 172.21.15.67:0/2557395439 conn(0x7f2a2c0f82d0 msgr2=0x7f2a2c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.469+0000 7f2a315ca700 1 -- 172.21.15.67:0/2557395439 shutdown_connections 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.469+0000 7f2a315ca700 1 -- 172.21.15.67:0/2557395439 wait complete. 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.470+0000 7f2a315ca700 1 Processor -- start 2023-12-05T09:22:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.470+0000 7f2a315ca700 1 -- start start 2023-12-05T09:22:30.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a315ca700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 0x7f2a2c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:30.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a315ca700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a2c0fde00 0x7f2a2c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a315ca700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c10e0a0 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a315ca700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c10e940 con 0x7f2a2c0fde00 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 0x7f2a2c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 0x7f2a2c10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55842/0 (socket says 172.21.15.67:55842) 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a2affd700 1 -- 172.21.15.67:0/235472059 learned_addr learned my addr 172.21.15.67:0/235472059 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a2a7fc700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a2c0fde00 0x7f2a2c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a2affd700 1 -- 172.21.15.67:0/235472059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a2c0fde00 msgr2=0x7f2a2c10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a2affd700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a2c0fde00 0x7f2a2c10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.471+0000 7f2a2affd700 1 -- 172.21.15.67:0/235472059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c005040 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.472+0000 7f2a2affd700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 0x7f2a2c10d560 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000c00 tx=0x7f2a1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.472+0000 7f2a137fe700 1 -- 172.21.15.67:0/235472059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a1c00e040 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.472+0000 7f2a137fe700 1 -- 172.21.15.67:0/235472059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a1c013420 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.472+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c10ebc0 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.472+0000 7f2a137fe700 1 -- 172.21.15.67:0/235472059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a1c01c630 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.472+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c10f100 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.474 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.473+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c04bb80 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.474 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.474+0000 7f2a137fe700 1 -- 172.21.15.67:0/235472059 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f2a1c013590 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.475+0000 7f2a137fe700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2a14068f70 0x7f2a1406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:30.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.475+0000 7f2a137fe700 1 -- 172.21.15.67:0/235472059 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2a1c087cb0 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.475+0000 7f2a2a7fc700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2a14068f70 0x7f2a1406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:30.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.476+0000 7f2a2a7fc700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2a14068f70 0x7f2a1406b420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2a20004f40 tx=0x7f2a2000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.480+0000 7f2a137fe700 1 -- 172.21.15.67:0/235472059 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2a1c057f30 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:30 smithi067 ceph-mon[107174]: osdmap e40: 6 total, 6 up, 6 in 2023-12-05T09:22:30.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:30 smithi134 ceph-mon[116304]: osdmap e40: 6 total, 6 up, 6 in 2023-12-05T09:22:30.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.685+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f2a2c105590 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.686+0000 7f2a137fe700 1 -- 172.21.15.67:0/235472059 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f2a1c013840 con 0x7f2a2c0fcbf0 2023-12-05T09:22:30.686 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:22:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2a14068f70 msgr2=0x7f2a1406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2a14068f70 0x7f2a1406b420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2a20004f40 tx=0x7f2a2000b040 comp rx=0 tx=0).stop 2023-12-05T09:22:30.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 msgr2=0x7f2a2c10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:30.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 0x7f2a2c10d560 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000c00 tx=0x7f2a1c009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:30.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 shutdown_connections 2023-12-05T09:22:30.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2a14068f70 0x7f2a1406b420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:30.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a2c0fcbf0 0x7f2a2c10d560 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:30.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 --2- 172.21.15.67:0/235472059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a2c0fde00 0x7f2a2c10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:30.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 >> 172.21.15.67:0/235472059 conn(0x7f2a2c0f82d0 msgr2=0x7f2a2c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:30.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 shutdown_connections 2023-12-05T09:22:30.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:30.688+0000 7f2a315ca700 1 -- 172.21.15.67:0/235472059 wait complete. 2023-12-05T09:22:31.144 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1701768148,"num_in_osds":6,"osd_in_since":1701768129,"num_remapped_pgs":0} 2023-12-05T09:22:31.144 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T09:22:31.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:31 smithi067 ceph-mon[107174]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:31.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:31 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/235472059' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T09:22:31.582 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:31 smithi134 ceph-mon[116304]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:31 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/235472059' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-05T09:22:32.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.817+0000 7f29c76a8700 1 -- 172.21.15.67:0/2529004621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c006ffe0 msgr2=0x7f29c00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.817+0000 7f29c76a8700 1 --2- 172.21.15.67:0/2529004621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c006ffe0 0x7f29c00703b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f29bc004970 tx=0x7f29bc009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.817+0000 7f29c76a8700 1 -- 172.21.15.67:0/2529004621 shutdown_connections 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.817+0000 7f29c76a8700 1 --2- 172.21.15.67:0/2529004621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c00708f0 0x7f29c0108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.817+0000 7f29c76a8700 1 --2- 172.21.15.67:0/2529004621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c006ffe0 0x7f29c00703b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.817+0000 7f29c76a8700 1 -- 172.21.15.67:0/2529004621 >> 172.21.15.67:0/2529004621 conn(0x7f29c00f8790 msgr2=0x7f29c00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.817+0000 7f29c76a8700 1 -- 172.21.15.67:0/2529004621 shutdown_connections 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.817+0000 7f29c76a8700 1 -- 172.21.15.67:0/2529004621 wait complete. 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.818+0000 7f29c76a8700 1 Processor -- start 2023-12-05T09:22:32.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.818+0000 7f29c76a8700 1 -- start start 2023-12-05T09:22:32.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c76a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c006ffe0 0x7f29c01157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c76a8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c00708f0 0x7f29c0115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c76a8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0116380 con 0x7f29c00708f0 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c76a8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c010f6b0 con 0x7f29c006ffe0 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c4c43700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c00708f0 0x7f29c0115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c4c43700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c00708f0 0x7f29c0115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55860/0 (socket says 172.21.15.67:55860) 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c4c43700 1 -- 172.21.15.67:0/3137498536 learned_addr learned my addr 172.21.15.67:0/3137498536 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c5444700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c006ffe0 0x7f29c01157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c4c43700 1 -- 172.21.15.67:0/3137498536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c006ffe0 msgr2=0x7f29c01157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c4c43700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c006ffe0 0x7f29c01157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c4c43700 1 -- 172.21.15.67:0/3137498536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc005040 con 0x7f29c00708f0 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.819+0000 7f29c5444700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c006ffe0 0x7f29c01157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.820+0000 7f29c4c43700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c00708f0 0x7f29c0115d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f29b000eb70 tx=0x7f29b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:32.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.820+0000 7f29b5ffb700 1 -- 172.21.15.67:0/3137498536 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b0007cc0 con 0x7f29c00708f0 2023-12-05T09:22:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.820+0000 7f29b5ffb700 1 -- 172.21.15.67:0/3137498536 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29b000f040 con 0x7f29c00708f0 2023-12-05T09:22:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.820+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c010f930 con 0x7f29c00708f0 2023-12-05T09:22:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.820+0000 7f29b5ffb700 1 -- 172.21.15.67:0/3137498536 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b00095f0 con 0x7f29c00708f0 2023-12-05T09:22:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.820+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c010fe70 con 0x7f29c00708f0 2023-12-05T09:22:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.821+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c01065d0 con 0x7f29c00708f0 2023-12-05T09:22:32.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.822+0000 7f29b5ffb700 1 -- 172.21.15.67:0/3137498536 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f29b0009750 con 0x7f29c00708f0 2023-12-05T09:22:32.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.823+0000 7f29b5ffb700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f29ac068f70 0x7f29ac06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:32.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.823+0000 7f29b5ffb700 1 -- 172.21.15.67:0/3137498536 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f29b00867a0 con 0x7f29c00708f0 2023-12-05T09:22:32.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.823+0000 7f29c5444700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f29ac068f70 0x7f29ac06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:32.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.824+0000 7f29c5444700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f29ac068f70 0x7f29ac06b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009fd0 tx=0x7f29bc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:32.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:32.828+0000 7f29b5ffb700 1 -- 172.21.15.67:0/3137498536 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f29b0056920 con 0x7f29c00708f0 2023-12-05T09:22:33.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.029+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29c010bdd0 con 0x7f29c00708f0 2023-12-05T09:22:33.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.030+0000 7f29b5ffb700 1 -- 172.21.15.67:0/3137498536 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11070 (secure 0 0 0) 0x7f29b00564b0 con 0x7f29c00708f0 2023-12-05T09:22:33.031 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:22:33.031 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","created":"2023-12-05T09:17:21.700862+0000","modified":"2023-12-05T09:22:29.331366+0000","last_up_change":"2023-12-05T09:22:28.150617+0000","last_in_change":"2023-12-05T09:22:09.939138+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:21:24.629667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"73d6a29a-57c6-4943-9a9b-1bb55401f054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6803","nonce":1759558727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6805","nonce":1759558727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6809","nonce":1759558727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6807","nonce":1759558727}]},"public_addr":"172.21.15.67:6803/1759558727","cluster_addr":"172.21.15.67:6805/1759558727","heartbeat_back_addr":"172.21.15.67:6809/1759558727","heartbeat_front_addr":"172.21.15.67:6807/1759558727","state":["exists","up"]},{"osd":1,"uuid":"21d6b362-1d8c-4508-b7df-5a156074fc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6811","nonce":565202870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6813","nonce":565202870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6817","nonce":565202870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6815","nonce":565202870}]},"public_addr":"172.21.15.67:6811/565202870","cluster_addr":"172.21.15.67:6813/565202870","heartbeat_back_addr":"172.21.15.67:6817/565202870","heartbeat_front_addr":"172.21.15.67:6815/565202870","state":["exists","up"]},{"osd":2,"uuid":"214bcc5f-be74-4b12-b23e-c325bae6a18f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6819","nonce":3402999571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6821","nonce":3402999571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6825","nonce":3402999571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6823","nonce":3402999571}]},"public_addr":"172.21.15.67:6819/3402999571","cluster_addr":"172.21.15.67:6821/3402999571","heartbeat_back_addr":"172.21.15.67:6825/3402999571","heartbeat_front_addr":"172.21.15.67:6823/3402999571","state":["exists","up"]},{"osd":3,"uuid":"6bce7967-b081-4a08-ac54-9552edf45ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6801","nonce":3069496213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6803","nonce":3069496213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6807","nonce":3069496213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6805","nonce":3069496213}]},"public_addr":"172.21.15.134:6801/3069496213","cluster_addr":"172.21.15.134:6803/3069496213","heartbeat_back_addr":"172.21.15.134:6807/3069496213","heartbeat_front_addr":"172.21.15.134:6805/3069496213","state":["exists","up"]},{"osd":4,"uuid":"5d1c05dc-2b50-493a-9e5e-d0b16d911091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6809","nonce":548117417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6811","nonce":548117417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6815","nonce":548117417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6813","nonce":548117417}]},"public_addr":"172.21.15.134:6809/548117417","cluster_addr":"172.21.15.134:6811/548117417","heartbeat_back_addr":"172.21.15.134:6815/548117417","heartbeat_front_addr":"172.21.15.134:6813/548117417","state":["exists","up"]},{"osd":5,"uuid":"43ae157e-59ef-448e-b33f-5ebfadf73ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6817","nonce":2682778910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6819","nonce":2682778910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6823","nonce":2682778910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6821","nonce":2682778910}]},"public_addr":"172.21.15.134:6817/2682778910","cluster_addr":"172.21.15.134:6819/2682778910","heartbeat_back_addr":"172.21.15.134:6823/2682778910","heartbeat_front_addr":"172.21.15.134:6821/2682778910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:30.796950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:55.649954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:20.496287+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:41.995990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:04.343494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:26.824683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:0/3434626511":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6801/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6800/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/1134257028":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/266329309":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6801/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6800/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6800/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:6801/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3210428255":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/3754244083":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/2190646552":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3189096558":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/2057389438":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/2132118036":"2023-12-06T09:18:23.902584+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:22:33.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f29ac068f70 msgr2=0x7f29ac06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:33.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f29ac068f70 0x7f29ac06b420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009fd0 tx=0x7f29bc009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:33.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c00708f0 msgr2=0x7f29c0115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:33.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c00708f0 0x7f29c0115d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f29b000eb70 tx=0x7f29b000b040 comp rx=0 tx=0).stop 2023-12-05T09:22:33.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 shutdown_connections 2023-12-05T09:22:33.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f29ac068f70 0x7f29ac06b420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:33.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29c006ffe0 0x7f29c01157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:33.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 --2- 172.21.15.67:0/3137498536 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29c00708f0 0x7f29c0115d30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:33.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.032+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 >> 172.21.15.67:0/3137498536 conn(0x7f29c00f8790 msgr2=0x7f29c0103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:33.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.033+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 shutdown_connections 2023-12-05T09:22:33.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:33.033+0000 7f29c76a8700 1 -- 172.21.15.67:0/3137498536 wait complete. 2023-12-05T09:22:33.523 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T09:21:24.629667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-05T09:22:33.523 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-05T09:22:33.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:33 smithi067 ceph-mon[107174]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:33.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:33 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3137498536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:22:33.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:33 smithi134 ceph-mon[116304]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:33.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:33 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3137498536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:22:33.958 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:35.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.204+0000 7fe155e98700 1 -- 172.21.15.67:0/1980722142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 msgr2=0x7fe150102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:35.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.204+0000 7fe155e98700 1 --2- 172.21.15.67:0/1980722142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 0x7fe150102fd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe140004940 tx=0x7fe140009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:35.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.204+0000 7fe155e98700 1 -- 172.21.15.67:0/1980722142 shutdown_connections 2023-12-05T09:22:35.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.204+0000 7fe155e98700 1 --2- 172.21.15.67:0/1980722142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1501035a0 0x7fe1500fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:35.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.204+0000 7fe155e98700 1 --2- 172.21.15.67:0/1980722142 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 0x7fe150102fd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:35.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.204+0000 7fe155e98700 1 -- 172.21.15.67:0/1980722142 >> 172.21.15.67:0/1980722142 conn(0x7fe1500f8790 msgr2=0x7fe1500faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:35.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.204+0000 7fe155e98700 1 -- 172.21.15.67:0/1980722142 shutdown_connections 2023-12-05T09:22:35.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.204+0000 7fe155e98700 1 -- 172.21.15.67:0/1980722142 wait complete. 2023-12-05T09:22:35.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.205+0000 7fe155e98700 1 Processor -- start 2023-12-05T09:22:35.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.205+0000 7fe155e98700 1 -- start start 2023-12-05T09:22:35.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.205+0000 7fe155e98700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 0x7fe150113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:35.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.205+0000 7fe155e98700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1501035a0 0x7fe150113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.205+0000 7fe155e98700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1501141e0 con 0x7fe150102c00 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.205+0000 7fe155e98700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15010d4d0 con 0x7fe1501035a0 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 0x7fe150113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 0x7fe150113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55870/0 (socket says 172.21.15.67:55870) 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14f7fe700 1 -- 172.21.15.67:0/38505223 learned_addr learned my addr 172.21.15.67:0/38505223 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14effd700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1501035a0 0x7fe150113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14f7fe700 1 -- 172.21.15.67:0/38505223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1501035a0 msgr2=0x7fe150113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14f7fe700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1501035a0 0x7fe150113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14f7fe700 1 -- 172.21.15.67:0/38505223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140005040 con 0x7fe150102c00 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14effd700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1501035a0 0x7fe150113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.206+0000 7fe14f7fe700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 0x7fe150113610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe140009fd0 tx=0x7fe140009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.207+0000 7fe137fff700 1 -- 172.21.15.67:0/38505223 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe14000e040 con 0x7fe150102c00 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.207+0000 7fe137fff700 1 -- 172.21.15.67:0/38505223 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe14000bc50 con 0x7fe150102c00 2023-12-05T09:22:35.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.207+0000 7fe137fff700 1 -- 172.21.15.67:0/38505223 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe140013ea0 con 0x7fe150102c00 2023-12-05T09:22:35.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.207+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15010d700 con 0x7fe150102c00 2023-12-05T09:22:35.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.207+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15010dc40 con 0x7fe150102c00 2023-12-05T09:22:35.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.208+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1500fff10 con 0x7fe150102c00 2023-12-05T09:22:35.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.209+0000 7fe137fff700 1 -- 172.21.15.67:0/38505223 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe140013420 con 0x7fe150102c00 2023-12-05T09:22:35.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.210+0000 7fe137fff700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe138068f70 0x7fe13806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:35.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.210+0000 7fe137fff700 1 -- 172.21.15.67:0/38505223 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe140087f90 con 0x7fe150102c00 2023-12-05T09:22:35.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.210+0000 7fe14effd700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe138068f70 0x7fe13806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:35.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.211+0000 7fe14effd700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe138068f70 0x7fe13806b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe144007fd0 tx=0x7fe144009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:35.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.214+0000 7fe137fff700 1 -- 172.21.15.67:0/38505223 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe140058190 con 0x7fe150102c00 2023-12-05T09:22:35.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.419+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe15010ebf0 con 0x7fe150102c00 2023-12-05T09:22:35.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.419+0000 7fe137fff700 1 -- 172.21.15.67:0/38505223 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe140057d20 con 0x7fe150102c00 2023-12-05T09:22:35.420 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-12-05T09:22:35.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe138068f70 msgr2=0x7fe13806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:35.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe138068f70 0x7fe13806b420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe144007fd0 tx=0x7fe144009040 comp rx=0 tx=0).stop 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 msgr2=0x7fe150113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 0x7fe150113610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe140009fd0 tx=0x7fe140009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 shutdown_connections 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe138068f70 0x7fe13806b420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe150102c00 0x7fe150113610 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 --2- 172.21.15.67:0/38505223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1501035a0 0x7fe150113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 >> 172.21.15.67:0/38505223 conn(0x7fe1500f8790 msgr2=0x7fe1500fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 shutdown_connections 2023-12-05T09:22:35.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:35.422+0000 7fe155e98700 1 -- 172.21.15.67:0/38505223 wait complete. 2023-12-05T09:22:35.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:35 smithi067 ceph-mon[107174]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:35 smithi134 ceph-mon[116304]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:35.821 INFO:tasks.cephadm:Setting up client nodes... 2023-12-05T09:22:35.822 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-05T09:22:36.258 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:36.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:36 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/38505223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:22:36.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:36 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/38505223' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:22:37.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.533+0000 7fbbeb440700 1 -- 172.21.15.67:0/1072017761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fcbf0 msgr2=0x7fbbe40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.533+0000 7fbbeb440700 1 --2- 172.21.15.67:0/1072017761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fcbf0 0x7fbbe40fd000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0004940 tx=0x7fbbe0009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.533+0000 7fbbeb440700 1 -- 172.21.15.67:0/1072017761 shutdown_connections 2023-12-05T09:22:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.533+0000 7fbbeb440700 1 --2- 172.21.15.67:0/1072017761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe40fde00 0x7fbbe40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.533+0000 7fbbeb440700 1 --2- 172.21.15.67:0/1072017761 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fcbf0 0x7fbbe40fd000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.533+0000 7fbbeb440700 1 -- 172.21.15.67:0/1072017761 >> 172.21.15.67:0/1072017761 conn(0x7fbbe40f82d0 msgr2=0x7fbbe40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.533+0000 7fbbeb440700 1 -- 172.21.15.67:0/1072017761 shutdown_connections 2023-12-05T09:22:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.533+0000 7fbbeb440700 1 -- 172.21.15.67:0/1072017761 wait complete. 2023-12-05T09:22:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.534+0000 7fbbeb440700 1 Processor -- start 2023-12-05T09:22:37.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbeb440700 1 -- start start 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbeb440700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe40fcbf0 0x7fbbe4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbeb440700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fde00 0x7fbbe406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbeb440700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4070590 con 0x7fbbe40fde00 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbeb440700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4070700 con 0x7fbbe40fcbf0 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbe89db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fde00 0x7fbbe406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbe89db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fde00 0x7fbbe406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45254/0 (socket says 172.21.15.67:45254) 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbe89db700 1 -- 172.21.15.67:0/2836638844 learned_addr learned my addr 172.21.15.67:0/2836638844 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.535+0000 7fbbe91dc700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe40fcbf0 0x7fbbe4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbe89db700 1 -- 172.21.15.67:0/2836638844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe40fcbf0 msgr2=0x7fbbe4071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbe89db700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe40fcbf0 0x7fbbe4071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbe89db700 1 -- 172.21.15.67:0/2836638844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe0005040 con 0x7fbbe40fde00 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbe89db700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fde00 0x7fbbe406ff90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4002a50 tx=0x7fbbd40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbd9ffb700 1 -- 172.21.15.67:0/2836638844 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd4007cc0 con 0x7fbbe40fde00 2023-12-05T09:22:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbd9ffb700 1 -- 172.21.15.67:0/2836638844 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbbd400f040 con 0x7fbbe40fde00 2023-12-05T09:22:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe40709e0 con 0x7fbbe40fde00 2023-12-05T09:22:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbd9ffb700 1 -- 172.21.15.67:0/2836638844 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbd400d9c0 con 0x7fbbe40fde00 2023-12-05T09:22:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.536+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe4115590 con 0x7fbbe40fde00 2023-12-05T09:22:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.537+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe404bb80 con 0x7fbbe40fde00 2023-12-05T09:22:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.538+0000 7fbbd9ffb700 1 -- 172.21.15.67:0/2836638844 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbbd400db20 con 0x7fbbe40fde00 2023-12-05T09:22:37.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.539+0000 7fbbd9ffb700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbbd0068f70 0x7fbbd006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:37.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.539+0000 7fbbd9ffb700 1 -- 172.21.15.67:0/2836638844 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbbd4086830 con 0x7fbbe40fde00 2023-12-05T09:22:37.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.539+0000 7fbbe91dc700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbbd0068f70 0x7fbbd006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:37.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.540+0000 7fbbe91dc700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbbd0068f70 0x7fbbd006b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000b7d0 tx=0x7fbbe0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:37.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.544+0000 7fbbd9ffb700 1 -- 172.21.15.67:0/2836638844 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbbd40569b0 con 0x7fbbe40fde00 2023-12-05T09:22:37.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:37 smithi067 ceph-mon[107174]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:37.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:37 smithi134 ceph-mon[116304]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.827+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fbbe4105590 con 0x7fbbe40fde00 2023-12-05T09:22:37.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.831+0000 7fbbd9ffb700 1 -- 172.21.15.67:0/2836638844 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fbbd4056540 con 0x7fbbe40fde00 2023-12-05T09:22:37.832 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2023-12-05T09:22:37.832 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDd625lawdqMRAAJZps6zXBfaxsOo01RuA7Ww== 2023-12-05T09:22:37.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbbd0068f70 msgr2=0x7fbbd006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbbd0068f70 0x7fbbd006b420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000b7d0 tx=0x7fbbe0009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fde00 msgr2=0x7fbbe406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fde00 0x7fbbe406ff90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4002a50 tx=0x7fbbd40046b0 comp rx=0 tx=0).stop 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 shutdown_connections 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbbd0068f70 0x7fbbd006b420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbbe40fcbf0 0x7fbbe4071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 --2- 172.21.15.67:0/2836638844 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbbe40fde00 0x7fbbe406ff90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 >> 172.21.15.67:0/2836638844 conn(0x7fbbe40f82d0 msgr2=0x7fbbe4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 shutdown_connections 2023-12-05T09:22:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:37.834+0000 7fbbeb440700 1 -- 172.21.15.67:0/2836638844 wait complete. 2023-12-05T09:22:38.309 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:22:38.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-05T09:22:38.309 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-05T09:22:38.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-05T09:22:38.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:38 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2836638844' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:22:38.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:38 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2836638844' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T09:22:38.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:38 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2836638844' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:22:38.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:38 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2836638844' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T09:22:38.838 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi134/config 2023-12-05T09:22:39.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:39 smithi067 ceph-mon[107174]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:39.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:39 smithi134 ceph-mon[116304]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.972+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/1668167140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fdd90 msgr2=0x7fb7d80fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.972+0000 7fb7dd7d8700 1 --2- 172.21.15.134:0/1668167140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fdd90 0x7fb7d80fe1e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc004940 tx=0x7fb7cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.972+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/1668167140 shutdown_connections 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.972+0000 7fb7dd7d8700 1 --2- 172.21.15.134:0/1668167140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fdd90 0x7fb7d80fe1e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.972+0000 7fb7dd7d8700 1 --2- 172.21.15.134:0/1668167140 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d80fcb80 0x7fb7d80fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.972+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/1668167140 >> 172.21.15.134:0/1668167140 conn(0x7fb7d80f8240 msgr2=0x7fb7d80fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.972+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/1668167140 shutdown_connections 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.972+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/1668167140 wait complete. 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.973+0000 7fb7dd7d8700 1 Processor -- start 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.973+0000 7fb7dd7d8700 1 -- start start 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.973+0000 7fb7dd7d8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fcb80 0x7fb7d810d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:39.975 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.973+0000 7fb7dd7d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d80fdd90 0x7fb7d810d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.973+0000 7fb7dd7d8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d810df80 con 0x7fb7d80fdd90 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.973+0000 7fb7dd7d8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d810e820 con 0x7fb7d80fcb80 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.973+0000 7fb7d6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fcb80 0x7fb7d810d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7d6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fcb80 0x7fb7d810d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33494/0 (socket says 172.21.15.134:33494) 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7d6ffd700 1 -- 172.21.15.134:0/3270522917 learned_addr learned my addr 172.21.15.134:0/3270522917 (peer_addr_for_me v2:172.21.15.134:0/0) 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7d67fc700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d80fdd90 0x7fb7d810d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7d6ffd700 1 -- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d80fdd90 msgr2=0x7fb7d810d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7d6ffd700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d80fdd90 0x7fb7d810d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:39.976 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7d6ffd700 1 -- 172.21.15.134:0/3270522917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc005040 con 0x7fb7d80fcb80 2023-12-05T09:22:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7d6ffd700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fcb80 0x7fb7d810d440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8002a80 tx=0x7fb7c8004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7bf7fe700 1 -- 172.21.15.134:0/3270522917 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c8007cc0 con 0x7fb7d80fcb80 2023-12-05T09:22:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7bf7fe700 1 -- 172.21.15.134:0/3270522917 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7c800f040 con 0x7fb7d80fcb80 2023-12-05T09:22:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d810eb00 con 0x7fb7d80fcb80 2023-12-05T09:22:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.974+0000 7fb7bf7fe700 1 -- 172.21.15.134:0/3270522917 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c800da20 con 0x7fb7d80fcb80 2023-12-05T09:22:39.977 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.975+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d810f040 con 0x7fb7d80fcb80 2023-12-05T09:22:39.978 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.975+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d804bb80 con 0x7fb7d80fcb80 2023-12-05T09:22:39.978 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.976+0000 7fb7bf7fe700 1 -- 172.21.15.134:0/3270522917 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb7c800db80 con 0x7fb7d80fcb80 2023-12-05T09:22:39.978 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.978+0000 7fb7bf7fe700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb7c0068f60 0x7fb7c006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.978+0000 7fb7bf7fe700 1 -- 172.21.15.134:0/3270522917 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb7c8086820 con 0x7fb7d80fcb80 2023-12-05T09:22:39.979 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.978+0000 7fb7d67fc700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb7c0068f60 0x7fb7c006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:39.980 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.979+0000 7fb7d67fc700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb7c0068f60 0x7fb7c006b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00b3b0 tx=0x7fb7cc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:39.983 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:39.982+0000 7fb7bf7fe700 1 -- 172.21.15.134:0/3270522917 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb7c8056a20 con 0x7fb7d80fcb80 2023-12-05T09:22:40.250 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.249+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb7d810f4f0 con 0x7fb7d80fcb80 2023-12-05T09:22:40.255 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.254+0000 7fb7bf7fe700 1 -- 172.21.15.134:0/3270522917 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb7c80565b0 con 0x7fb7d80fcb80 2023-12-05T09:22:40.256 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2023-12-05T09:22:40.256 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDg625lyQcCDxAAEgopZX6AumJaLwWeMKEmCg== 2023-12-05T09:22:40.258 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb7c0068f60 msgr2=0x7fb7c006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:40.258 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb7c0068f60 0x7fb7c006b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00b3b0 tx=0x7fb7cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:40.258 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fcb80 msgr2=0x7fb7d810d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:40.258 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fcb80 0x7fb7d810d440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8002a80 tx=0x7fb7c8004600 comp rx=0 tx=0).stop 2023-12-05T09:22:40.258 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 shutdown_connections 2023-12-05T09:22:40.258 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb7c0068f60 0x7fb7c006b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:40.259 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7d80fcb80 0x7fb7d810d440 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:40.259 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 --2- 172.21.15.134:0/3270522917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb7d80fdd90 0x7fb7d810d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:40.259 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 >> 172.21.15.134:0/3270522917 conn(0x7fb7d80f8240 msgr2=0x7fb7d8100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:40.259 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 shutdown_connections 2023-12-05T09:22:40.259 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-05T09:22:40.257+0000 7fb7dd7d8700 1 -- 172.21.15.134:0/3270522917 wait complete. 2023-12-05T09:22:40.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:40 smithi134 ceph-mon[116304]: from='client.? 172.21.15.134:0/3270522917' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:22:40.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:40 smithi134 ceph-mon[116304]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:22:40.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:40 smithi134 ceph-mon[116304]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T09:22:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:40 smithi067 ceph-mon[107174]: from='client.? 172.21.15.134:0/3270522917' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:22:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:40 smithi067 ceph-mon[107174]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-05T09:22:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:40 smithi067 ceph-mon[107174]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-05T09:22:40.629 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:22:40.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-05T09:22:40.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-05T09:22:40.728 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-05T09:22:40.728 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-05T09:22:40.729 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph mgr dump --format=json 2023-12-05T09:22:41.169 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:41 smithi067 ceph-mon[107174]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:22:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:41 smithi134 ceph-mon[116304]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:22:42.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.442+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2890426871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 msgr2=0x7f1d3c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:42.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.442+0000 7f1d42eb4700 1 --2- 172.21.15.67:0/2890426871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 0x7f1d3c0fcc10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d28004940 tx=0x7f1d28009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:42.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.442+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2890426871 shutdown_connections 2023-12-05T09:22:42.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.442+0000 7f1d42eb4700 1 --2- 172.21.15.67:0/2890426871 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 0x7f1d3c0fcc10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:42.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.442+0000 7f1d42eb4700 1 --2- 172.21.15.67:0/2890426871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d3c102c00 0x7f1d3c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:42.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.442+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2890426871 >> 172.21.15.67:0/2890426871 conn(0x7f1d3c0f8790 msgr2=0x7f1d3c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:42.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.442+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2890426871 shutdown_connections 2023-12-05T09:22:42.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.442+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2890426871 wait complete. 2023-12-05T09:22:42.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.443+0000 7f1d42eb4700 1 Processor -- start 2023-12-05T09:22:42.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.443+0000 7f1d42eb4700 1 -- start start 2023-12-05T09:22:42.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.443+0000 7f1d42eb4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d3c102c00 0x7f1d3c115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:42.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.443+0000 7f1d42eb4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 0x7f1d3c115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:42.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.443+0000 7f1d42eb4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c1163c0 con 0x7f1d3c1035a0 2023-12-05T09:22:42.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.443+0000 7f1d42eb4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c10f6f0 con 0x7f1d3c102c00 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.444+0000 7f1d3bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 0x7f1d3c115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.444+0000 7f1d3bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 0x7f1d3c115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45280/0 (socket says 172.21.15.67:45280) 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.444+0000 7f1d3bfff700 1 -- 172.21.15.67:0/2457002200 learned_addr learned my addr 172.21.15.67:0/2457002200 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.444+0000 7f1d40c50700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d3c102c00 0x7f1d3c115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.444+0000 7f1d3bfff700 1 -- 172.21.15.67:0/2457002200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d3c102c00 msgr2=0x7f1d3c115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.444+0000 7f1d3bfff700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d3c102c00 0x7f1d3c115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.444+0000 7f1d3bfff700 1 -- 172.21.15.67:0/2457002200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28005040 con 0x7f1d3c1035a0 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.444+0000 7f1d3bfff700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 0x7f1d3c115d70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009380 tx=0x7f1d28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.445+0000 7f1d397fa700 1 -- 172.21.15.67:0/2457002200 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d2800e040 con 0x7f1d3c1035a0 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.445+0000 7f1d397fa700 1 -- 172.21.15.67:0/2457002200 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d2800bc50 con 0x7f1d3c1035a0 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.445+0000 7f1d397fa700 1 -- 172.21.15.67:0/2457002200 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d2801c3f0 con 0x7f1d3c1035a0 2023-12-05T09:22:42.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.445+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c10f970 con 0x7f1d3c1035a0 2023-12-05T09:22:42.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.445+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c10feb0 con 0x7f1d3c1035a0 2023-12-05T09:22:42.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.446+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c0fc390 con 0x7f1d3c1035a0 2023-12-05T09:22:42.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.447+0000 7f1d397fa700 1 -- 172.21.15.67:0/2457002200 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1d28013420 con 0x7f1d3c1035a0 2023-12-05T09:22:42.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.448+0000 7f1d397fa700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1d2c068f60 0x7f1d2c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:42.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.448+0000 7f1d397fa700 1 -- 172.21.15.67:0/2457002200 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1d28087e60 con 0x7f1d3c1035a0 2023-12-05T09:22:42.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.448+0000 7f1d40c50700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1d2c068f60 0x7f1d2c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:42.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.449+0000 7f1d40c50700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1d2c068f60 0x7f1d2c06b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d30004990 tx=0x7f1d30009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:42.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.453+0000 7f1d397fa700 1 -- 172.21.15.67:0/2457002200 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1d280580e0 con 0x7f1d3c1035a0 2023-12-05T09:22:42.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.708+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1d3c04bb80 con 0x7f1d3c1035a0 2023-12-05T09:22:42.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.712+0000 7f1d397fa700 1 -- 172.21.15.67:0/2457002200 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166776 (secure 0 0 0) 0x7f1d28057c70 con 0x7f1d3c1035a0 2023-12-05T09:22:42.715 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:22:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.714+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1d2c068f60 msgr2=0x7f1d2c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.714+0000 7f1d42eb4700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1d2c068f60 0x7f1d2c06b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d30004990 tx=0x7f1d30009ee0 comp rx=0 tx=0).stop 2023-12-05T09:22:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 msgr2=0x7f1d3c115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 0x7f1d3c115d70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009380 tx=0x7f1d28009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 shutdown_connections 2023-12-05T09:22:42.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1d2c068f60 0x7f1d2c06b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d3c102c00 0x7f1d3c115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 --2- 172.21.15.67:0/2457002200 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1d3c1035a0 0x7f1d3c115d70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 >> 172.21.15.67:0/2457002200 conn(0x7f1d3c0f8790 msgr2=0x7f1d3c0fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 shutdown_connections 2023-12-05T09:22:42.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:42.715+0000 7f1d42eb4700 1 -- 172.21.15.67:0/2457002200 wait complete. 2023-12-05T09:22:43.190 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":19,"active_gid":14214,"active_name":"smithi067.alxtvv","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3666384983},{"type":"v1","addr":"172.21.15.67:6801","nonce":3666384983}]},"active_addr":"172.21.15.67:6801/3666384983","active_change":"2023-12-05T09:19:26.041476+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14236,"name":"smithi134.yfqkak","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.67:8443/","prometheus":"http://172.21.15.67:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":2936759595}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":440859058}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3864088954}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":4207254869}]}]} 2023-12-05T09:22:43.194 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-05T09:22:43.194 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-05T09:22:43.194 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T09:22:43.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:43 smithi067 ceph-mon[107174]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:43.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:43 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2457002200' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-05T09:22:43.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:43 smithi134 ceph-mon[116304]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:43.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:43 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2457002200' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-05T09:22:43.637 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:44.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.891+0000 7f6f8de1d700 1 -- 172.21.15.67:0/1324659282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 msgr2=0x7f6f880fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.891+0000 7f6f8de1d700 1 --2- 172.21.15.67:0/1324659282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f880fcc10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c004940 tx=0x7f6f7c009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.891+0000 7f6f8de1d700 1 -- 172.21.15.67:0/1324659282 shutdown_connections 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.891+0000 7f6f8de1d700 1 --2- 172.21.15.67:0/1324659282 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f880fcc10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.891+0000 7f6f8de1d700 1 --2- 172.21.15.67:0/1324659282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f88102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.891+0000 7f6f8de1d700 1 -- 172.21.15.67:0/1324659282 >> 172.21.15.67:0/1324659282 conn(0x7f6f880f8790 msgr2=0x7f6f880faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.891+0000 7f6f8de1d700 1 -- 172.21.15.67:0/1324659282 shutdown_connections 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.891+0000 7f6f8de1d700 1 -- 172.21.15.67:0/1324659282 wait complete. 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.892+0000 7f6f8de1d700 1 Processor -- start 2023-12-05T09:22:44.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.892+0000 7f6f8de1d700 1 -- start start 2023-12-05T09:22:44.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f8de1d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f88113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:44.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f8de1d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f8de1d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88114210 con 0x7f6f881035a0 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f8de1d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8810d500 con 0x7f6f88102c00 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f86ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f86ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:45290/0 (socket says 172.21.15.67:45290) 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f86ffd700 1 -- 172.21.15.67:0/2186563906 learned_addr learned my addr 172.21.15.67:0/2186563906 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f877fe700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f88113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f86ffd700 1 -- 172.21.15.67:0/2186563906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 msgr2=0x7f6f88113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f86ffd700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f88113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.893+0000 7f6f86ffd700 1 -- 172.21.15.67:0/2186563906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c005040 con 0x7f6f881035a0 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.894+0000 7f6f86ffd700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88113bc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009360 tx=0x7f6f7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.894+0000 7f6f6ffff700 1 -- 172.21.15.67:0/2186563906 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c00e040 con 0x7f6f881035a0 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.894+0000 7f6f6ffff700 1 -- 172.21.15.67:0/2186563906 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f7c00bc50 con 0x7f6f881035a0 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.894+0000 7f6f6ffff700 1 -- 172.21.15.67:0/2186563906 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c01c630 con 0x7f6f881035a0 2023-12-05T09:22:44.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.894+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8810d780 con 0x7f6f881035a0 2023-12-05T09:22:44.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.894+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8810dcc0 con 0x7f6f881035a0 2023-12-05T09:22:44.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.895+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f88113310 con 0x7f6f881035a0 2023-12-05T09:22:44.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.896+0000 7f6f6ffff700 1 -- 172.21.15.67:0/2186563906 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6f7c013420 con 0x7f6f881035a0 2023-12-05T09:22:44.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.897+0000 7f6f6ffff700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f6f70068f70 0x7f6f7006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:44.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.897+0000 7f6f6ffff700 1 -- 172.21.15.67:0/2186563906 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6f7c087eb0 con 0x7f6f881035a0 2023-12-05T09:22:44.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.897+0000 7f6f877fe700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f6f70068f70 0x7f6f7006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:44.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.898+0000 7f6f877fe700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f6f70068f70 0x7f6f7006b420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f78007fd0 tx=0x7f6f78009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:44.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:44.901+0000 7f6f6ffff700 1 -- 172.21.15.67:0/2186563906 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6f7c058130 con 0x7f6f881035a0 2023-12-05T09:22:45.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.106+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f881050d0 con 0x7f6f881035a0 2023-12-05T09:22:45.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.107+0000 7f6f6ffff700 1 -- 172.21.15.67:0/2186563906 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11070 (secure 0 0 0) 0x7f6f7c057cc0 con 0x7f6f881035a0 2023-12-05T09:22:45.108 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:22:45.108 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","created":"2023-12-05T09:17:21.700862+0000","modified":"2023-12-05T09:22:29.331366+0000","last_up_change":"2023-12-05T09:22:28.150617+0000","last_in_change":"2023-12-05T09:22:09.939138+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:21:24.629667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"73d6a29a-57c6-4943-9a9b-1bb55401f054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6803","nonce":1759558727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6805","nonce":1759558727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6809","nonce":1759558727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6807","nonce":1759558727}]},"public_addr":"172.21.15.67:6803/1759558727","cluster_addr":"172.21.15.67:6805/1759558727","heartbeat_back_addr":"172.21.15.67:6809/1759558727","heartbeat_front_addr":"172.21.15.67:6807/1759558727","state":["exists","up"]},{"osd":1,"uuid":"21d6b362-1d8c-4508-b7df-5a156074fc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6811","nonce":565202870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6813","nonce":565202870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6817","nonce":565202870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6815","nonce":565202870}]},"public_addr":"172.21.15.67:6811/565202870","cluster_addr":"172.21.15.67:6813/565202870","heartbeat_back_addr":"172.21.15.67:6817/565202870","heartbeat_front_addr":"172.21.15.67:6815/565202870","state":["exists","up"]},{"osd":2,"uuid":"214bcc5f-be74-4b12-b23e-c325bae6a18f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6819","nonce":3402999571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6821","nonce":3402999571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6825","nonce":3402999571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6823","nonce":3402999571}]},"public_addr":"172.21.15.67:6819/3402999571","cluster_addr":"172.21.15.67:6821/3402999571","heartbeat_back_addr":"172.21.15.67:6825/3402999571","heartbeat_front_addr":"172.21.15.67:6823/3402999571","state":["exists","up"]},{"osd":3,"uuid":"6bce7967-b081-4a08-ac54-9552edf45ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6801","nonce":3069496213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6803","nonce":3069496213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6807","nonce":3069496213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6805","nonce":3069496213}]},"public_addr":"172.21.15.134:6801/3069496213","cluster_addr":"172.21.15.134:6803/3069496213","heartbeat_back_addr":"172.21.15.134:6807/3069496213","heartbeat_front_addr":"172.21.15.134:6805/3069496213","state":["exists","up"]},{"osd":4,"uuid":"5d1c05dc-2b50-493a-9e5e-d0b16d911091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6809","nonce":548117417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6811","nonce":548117417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6815","nonce":548117417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6813","nonce":548117417}]},"public_addr":"172.21.15.134:6809/548117417","cluster_addr":"172.21.15.134:6811/548117417","heartbeat_back_addr":"172.21.15.134:6815/548117417","heartbeat_front_addr":"172.21.15.134:6813/548117417","state":["exists","up"]},{"osd":5,"uuid":"43ae157e-59ef-448e-b33f-5ebfadf73ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6817","nonce":2682778910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6819","nonce":2682778910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6823","nonce":2682778910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6821","nonce":2682778910}]},"public_addr":"172.21.15.134:6817/2682778910","cluster_addr":"172.21.15.134:6819/2682778910","heartbeat_back_addr":"172.21.15.134:6823/2682778910","heartbeat_front_addr":"172.21.15.134:6821/2682778910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:30.796950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:55.649954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:20.496287+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:41.995990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:04.343494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:26.824683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:0/3434626511":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6801/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6800/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/1134257028":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/266329309":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6801/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6800/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6800/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:6801/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3210428255":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/3754244083":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/2190646552":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3189096558":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/2057389438":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/2132118036":"2023-12-06T09:18:23.902584+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:22:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.109+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f6f70068f70 msgr2=0x7f6f7006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.109+0000 7f6f8de1d700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f6f70068f70 0x7f6f7006b420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f78007fd0 tx=0x7f6f78009040 comp rx=0 tx=0).stop 2023-12-05T09:22:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.109+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 msgr2=0x7f6f88113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:45.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.109+0000 7f6f8de1d700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88113bc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009360 tx=0x7f6f7c009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.110+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 shutdown_connections 2023-12-05T09:22:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.110+0000 7f6f8de1d700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f6f70068f70 0x7f6f7006b420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.110+0000 7f6f8de1d700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f88113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.110+0000 7f6f8de1d700 1 --2- 172.21.15.67:0/2186563906 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88113bc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.110+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 >> 172.21.15.67:0/2186563906 conn(0x7f6f880f8790 msgr2=0x7f6f880fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.110+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 shutdown_connections 2023-12-05T09:22:45.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:45.110+0000 7f6f8de1d700 1 -- 172.21.15.67:0/2186563906 wait complete. 2023-12-05T09:22:45.543 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:45 smithi067 ceph-mon[107174]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:45.543 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:45 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2186563906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:22:45.567 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-05T09:22:45.567 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-05T09:22:45.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:45 smithi134 ceph-mon[116304]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:45.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:45 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2186563906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:22:46.002 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:47.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.286+0000 7f2609f54700 1 -- 172.21.15.67:0/2877586103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604103540 msgr2=0x7f26040fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:47.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.286+0000 7f2609f54700 1 --2- 172.21.15.67:0/2877586103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604103540 0x7f26040fcbb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f25f8004940 tx=0x7f25f8009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:47.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.286+0000 7f2609f54700 1 -- 172.21.15.67:0/2877586103 shutdown_connections 2023-12-05T09:22:47.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.286+0000 7f2609f54700 1 --2- 172.21.15.67:0/2877586103 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604103540 0x7f26040fcbb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:47.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.286+0000 7f2609f54700 1 --2- 172.21.15.67:0/2877586103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2604102ba0 0x7f2604102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:47.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.286+0000 7f2609f54700 1 -- 172.21.15.67:0/2877586103 >> 172.21.15.67:0/2877586103 conn(0x7f26040f8730 msgr2=0x7f26040fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:47.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.286+0000 7f2609f54700 1 -- 172.21.15.67:0/2877586103 shutdown_connections 2023-12-05T09:22:47.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.286+0000 7f2609f54700 1 -- 172.21.15.67:0/2877586103 wait complete. 2023-12-05T09:22:47.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.287+0000 7f2609f54700 1 Processor -- start 2023-12-05T09:22:47.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.287+0000 7f2609f54700 1 -- start start 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.288+0000 7f2609f54700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604102ba0 0x7f260406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.288+0000 7f2609f54700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2604103540 0x7f2604070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.288+0000 7f2609f54700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2604070a80 con 0x7f2604102ba0 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.288+0000 7f2609f54700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2604070bf0 con 0x7f2604103540 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.288+0000 7f26037fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604102ba0 0x7f260406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.288+0000 7f26037fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604102ba0 0x7f260406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47444/0 (socket says 172.21.15.67:47444) 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.288+0000 7f26037fe700 1 -- 172.21.15.67:0/503475618 learned_addr learned my addr 172.21.15.67:0/503475618 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.288+0000 7f2602ffd700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2604103540 0x7f2604070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f26037fe700 1 -- 172.21.15.67:0/503475618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2604103540 msgr2=0x7f2604070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f26037fe700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2604103540 0x7f2604070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:47.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f26037fe700 1 -- 172.21.15.67:0/503475618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8005040 con 0x7f2604102ba0 2023-12-05T09:22:47.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f26037fe700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604102ba0 0x7f260406ff40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f25f4002a50 tx=0x7f25f40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:47.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f25ebfff700 1 -- 172.21.15.67:0/503475618 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f4007cc0 con 0x7f2604102ba0 2023-12-05T09:22:47.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f25ebfff700 1 -- 172.21.15.67:0/503475618 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f25f400f040 con 0x7f2604102ba0 2023-12-05T09:22:47.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26041197d0 con 0x7f2604102ba0 2023-12-05T09:22:47.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f25ebfff700 1 -- 172.21.15.67:0/503475618 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f4009540 con 0x7f2604102ba0 2023-12-05T09:22:47.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.289+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2604119d00 con 0x7f2604102ba0 2023-12-05T09:22:47.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.290+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2604105070 con 0x7f2604102ba0 2023-12-05T09:22:47.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.292+0000 7f25ebfff700 1 -- 172.21.15.67:0/503475618 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f25f40096a0 con 0x7f2604102ba0 2023-12-05T09:22:47.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.292+0000 7f25ebfff700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f25ec068f70 0x7f25ec06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:47.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.293+0000 7f25ebfff700 1 -- 172.21.15.67:0/503475618 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f25f4086820 con 0x7f2604102ba0 2023-12-05T09:22:47.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.293+0000 7f2602ffd700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f25ec068f70 0x7f25ec06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:47.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.293+0000 7f2602ffd700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f25ec068f70 0x7f25ec06b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2604072050 tx=0x7f25f8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:47.297 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.297+0000 7f25ebfff700 1 -- 172.21.15.67:0/503475618 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f25f4052f90 con 0x7f2604102ba0 2023-12-05T09:22:47.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:46 smithi067 ceph-mon[107174]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:46 smithi134 ceph-mon[116304]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:47.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.501+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2604071680 con 0x7f2604102ba0 2023-12-05T09:22:47.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.502+0000 7f25ebfff700 1 -- 172.21.15.67:0/503475618 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11070 (secure 0 0 0) 0x7f25f40565b0 con 0x7f2604102ba0 2023-12-05T09:22:47.502 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:22:47.502 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":40,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","created":"2023-12-05T09:17:21.700862+0000","modified":"2023-12-05T09:22:29.331366+0000","last_up_change":"2023-12-05T09:22:28.150617+0000","last_in_change":"2023-12-05T09:22:09.939138+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:21:24.629667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"73d6a29a-57c6-4943-9a9b-1bb55401f054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6803","nonce":1759558727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6805","nonce":1759558727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6809","nonce":1759558727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6807","nonce":1759558727}]},"public_addr":"172.21.15.67:6803/1759558727","cluster_addr":"172.21.15.67:6805/1759558727","heartbeat_back_addr":"172.21.15.67:6809/1759558727","heartbeat_front_addr":"172.21.15.67:6807/1759558727","state":["exists","up"]},{"osd":1,"uuid":"21d6b362-1d8c-4508-b7df-5a156074fc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6811","nonce":565202870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6813","nonce":565202870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6817","nonce":565202870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6815","nonce":565202870}]},"public_addr":"172.21.15.67:6811/565202870","cluster_addr":"172.21.15.67:6813/565202870","heartbeat_back_addr":"172.21.15.67:6817/565202870","heartbeat_front_addr":"172.21.15.67:6815/565202870","state":["exists","up"]},{"osd":2,"uuid":"214bcc5f-be74-4b12-b23e-c325bae6a18f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6819","nonce":3402999571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6821","nonce":3402999571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6825","nonce":3402999571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6823","nonce":3402999571}]},"public_addr":"172.21.15.67:6819/3402999571","cluster_addr":"172.21.15.67:6821/3402999571","heartbeat_back_addr":"172.21.15.67:6825/3402999571","heartbeat_front_addr":"172.21.15.67:6823/3402999571","state":["exists","up"]},{"osd":3,"uuid":"6bce7967-b081-4a08-ac54-9552edf45ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6801","nonce":3069496213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6803","nonce":3069496213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6807","nonce":3069496213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6805","nonce":3069496213}]},"public_addr":"172.21.15.134:6801/3069496213","cluster_addr":"172.21.15.134:6803/3069496213","heartbeat_back_addr":"172.21.15.134:6807/3069496213","heartbeat_front_addr":"172.21.15.134:6805/3069496213","state":["exists","up"]},{"osd":4,"uuid":"5d1c05dc-2b50-493a-9e5e-d0b16d911091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6809","nonce":548117417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6811","nonce":548117417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6815","nonce":548117417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6813","nonce":548117417}]},"public_addr":"172.21.15.134:6809/548117417","cluster_addr":"172.21.15.134:6811/548117417","heartbeat_back_addr":"172.21.15.134:6815/548117417","heartbeat_front_addr":"172.21.15.134:6813/548117417","state":["exists","up"]},{"osd":5,"uuid":"43ae157e-59ef-448e-b33f-5ebfadf73ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6817","nonce":2682778910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6819","nonce":2682778910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6823","nonce":2682778910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6821","nonce":2682778910}]},"public_addr":"172.21.15.134:6817/2682778910","cluster_addr":"172.21.15.134:6819/2682778910","heartbeat_back_addr":"172.21.15.134:6823/2682778910","heartbeat_front_addr":"172.21.15.134:6821/2682778910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:30.796950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:55.649954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:20.496287+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:41.995990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:04.343494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:26.824683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:0/3434626511":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6801/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6800/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/1134257028":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/266329309":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6801/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6800/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6800/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:6801/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3210428255":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/3754244083":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/2190646552":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3189096558":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/2057389438":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/2132118036":"2023-12-06T09:18:23.902584+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f25ec068f70 msgr2=0x7f25ec06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f25ec068f70 0x7f25ec06b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2604072050 tx=0x7f25f8009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604102ba0 msgr2=0x7f260406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604102ba0 0x7f260406ff40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f25f4002a50 tx=0x7f25f40046b0 comp rx=0 tx=0).stop 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 shutdown_connections 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f25ec068f70 0x7f25ec06b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2604102ba0 0x7f260406ff40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 --2- 172.21.15.67:0/503475618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2604103540 0x7f2604070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 >> 172.21.15.67:0/503475618 conn(0x7f26040f8730 msgr2=0x7f26040fa270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 shutdown_connections 2023-12-05T09:22:47.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:47.504+0000 7f2609f54700 1 -- 172.21.15.67:0/503475618 wait complete. 2023-12-05T09:22:47.972 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-05T09:22:47.973 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-05T09:22:47.973 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-05T09:22:47.974 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-05T09:22:47.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-05T09:22:47.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-05T09:22:48.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:47 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/503475618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:22:48.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:47 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/503475618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:22:48.518 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:48.864 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:49.235 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:48 smithi067 ceph-mon[107174]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:49.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:48 smithi134 ceph-mon[116304]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:49.421 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:49.803 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:49.930 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:51.006 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:51.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:51 smithi067 ceph-mon[107174]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:51.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.488+0000 7fe7e61e0700 1 -- 172.21.15.67:0/261051526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e0070870 msgr2=0x7fe7e0108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.488+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/261051526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e0070870 0x7fe7e0108f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4004940 tx=0x7fe7d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:51.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.488+0000 7fe7e61e0700 1 -- 172.21.15.67:0/261051526 shutdown_connections 2023-12-05T09:22:51.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.488+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/261051526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e0070870 0x7fe7e0108f90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.488+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/261051526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e006ff60 0x7fe7e0070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.488+0000 7fe7e61e0700 1 -- 172.21.15.67:0/261051526 >> 172.21.15.67:0/261051526 conn(0x7fe7e00f8790 msgr2=0x7fe7e00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:51.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.489+0000 7fe7e61e0700 1 -- 172.21.15.67:0/261051526 shutdown_connections 2023-12-05T09:22:51.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.489+0000 7fe7e61e0700 1 -- 172.21.15.67:0/261051526 wait complete. 2023-12-05T09:22:51.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.490+0000 7fe7e61e0700 1 Processor -- start 2023-12-05T09:22:51.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.490+0000 7fe7e61e0700 1 -- start start 2023-12-05T09:22:51.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.490+0000 7fe7e61e0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e006ff60 0x7fe7e01158b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:51.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7e61e0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e0070870 0x7fe7e0115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:51.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7e61e0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0116440 con 0x7fe7e006ff60 2023-12-05T09:22:51.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7e61e0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e010f770 con 0x7fe7e0070870 2023-12-05T09:22:51.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7df7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e006ff60 0x7fe7e01158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:51.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7df7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e006ff60 0x7fe7e01158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47464/0 (socket says 172.21.15.67:47464) 2023-12-05T09:22:51.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7df7fe700 1 -- 172.21.15.67:0/1363026101 learned_addr learned my addr 172.21.15.67:0/1363026101 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:51.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7deffd700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e0070870 0x7fe7e0115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:51.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7df7fe700 1 -- 172.21.15.67:0/1363026101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e0070870 msgr2=0x7fe7e0115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7df7fe700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e0070870 0x7fe7e0115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7df7fe700 1 -- 172.21.15.67:0/1363026101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4005040 con 0x7fe7e006ff60 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.491+0000 7fe7deffd700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e0070870 0x7fe7e0115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.492+0000 7fe7df7fe700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e006ff60 0x7fe7e01158b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0002a50 tx=0x7fe7d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.492+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d0007cc0 con 0x7fe7e006ff60 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.492+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7d000f040 con 0x7fe7e006ff60 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.492+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e010fa50 con 0x7fe7e006ff60 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.492+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d0009540 con 0x7fe7e006ff60 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.492+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e010ff90 con 0x7fe7e006ff60 2023-12-05T09:22:51.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.493+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7e0110540 con 0x7fe7e006ff60 2023-12-05T09:22:51.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.494+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe7d00096c0 con 0x7fe7e006ff60 2023-12-05T09:22:51.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.495+0000 7fe7c7fff700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe7c8068f70 0x7fe7c806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:51.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.495+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe7d0087200 con 0x7fe7e006ff60 2023-12-05T09:22:51.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.495+0000 7fe7deffd700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe7c8068f70 0x7fe7c806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:51.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.496+0000 7fe7c7fff700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] conn(0x7fe7c806ec40 0x7fe7c8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:51.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.496+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 --> [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7c8071700 con 0x7fe7c806ec40 2023-12-05T09:22:51.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.496+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d00875e0 con 0x7fe7e006ff60 2023-12-05T09:22:51.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.496+0000 7fe7dffff700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] conn(0x7fe7c806ec40 0x7fe7c8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:51.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.496+0000 7fe7deffd700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe7c8068f70 0x7fe7c806b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400b3b0 tx=0x7fe7d4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:51.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.497+0000 7fe7dffff700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] conn(0x7fe7c806ec40 0x7fe7c8071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:51.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.497+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 <== osd.0 v2:172.21.15.67:6802/1759558727 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe7c8071700 con 0x7fe7c806ec40 2023-12-05T09:22:51.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.513+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 --> [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7e010fbe0 con 0x7fe7c806ec40 2023-12-05T09:22:51.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.514+0000 7fe7c7fff700 1 -- 172.21.15.67:0/1363026101 <== osd.0 v2:172.21.15.67:6802/1759558727 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7e010fbe0 con 0x7fe7c806ec40 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.514+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] conn(0x7fe7c806ec40 msgr2=0x7fe7c8071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.514+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] conn(0x7fe7c806ec40 0x7fe7c8071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.514+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe7c8068f70 msgr2=0x7fe7c806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.514+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe7c8068f70 0x7fe7c806b420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400b3b0 tx=0x7fe7d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.514+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e006ff60 msgr2=0x7fe7e01158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.514+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e006ff60 0x7fe7e01158b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0002a50 tx=0x7fe7d00046b0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.515+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 shutdown_connections 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.515+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6802/1759558727,v1:172.21.15.67:6803/1759558727] conn(0x7fe7c806ec40 0x7fe7c8071050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.515+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe7c8068f70 0x7fe7c806b420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.515+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7e006ff60 0x7fe7e01158b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.515+0000 7fe7e61e0700 1 --2- 172.21.15.67:0/1363026101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e0070870 0x7fe7e0115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.515+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 >> 172.21.15.67:0/1363026101 conn(0x7fe7e00f8790 msgr2=0x7fe7e01037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:51.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.515+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 shutdown_connections 2023-12-05T09:22:51.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.515+0000 7fe7e61e0700 1 -- 172.21.15.67:0/1363026101 wait complete. 2023-12-05T09:22:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.620+0000 7f80042c2700 1 -- 172.21.15.67:0/3562334587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 msgr2=0x7f7ffc06ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.620+0000 7f80042c2700 1 --2- 172.21.15.67:0/3562334587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 0x7f7ffc06ffe0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8004970 tx=0x7f7ff8009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.620+0000 7f80042c2700 1 -- 172.21.15.67:0/3562334587 shutdown_connections 2023-12-05T09:22:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.620+0000 7f80042c2700 1 --2- 172.21.15.67:0/3562334587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc070520 0x7f7ffc070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.620+0000 7f80042c2700 1 --2- 172.21.15.67:0/3562334587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 0x7f7ffc06ffe0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.620+0000 7f80042c2700 1 -- 172.21.15.67:0/3562334587 >> 172.21.15.67:0/3562334587 conn(0x7f7ffc0f8790 msgr2=0x7f7ffc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:51.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.620+0000 7f80042c2700 1 -- 172.21.15.67:0/3562334587 shutdown_connections 2023-12-05T09:22:51.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.620+0000 7f80042c2700 1 -- 172.21.15.67:0/3562334587 wait complete. 2023-12-05T09:22:51.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.621+0000 7f80042c2700 1 Processor -- start 2023-12-05T09:22:51.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.621+0000 7f80042c2700 1 -- start start 2023-12-05T09:22:51.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.621+0000 7f80042c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc070520 0x7f7ffc119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:51.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.621+0000 7f80042c2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 0x7f7ffc11a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:51.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.621+0000 7f80042c2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc11a870 con 0x7f7ffc071c10 2023-12-05T09:22:51.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.621+0000 7f80042c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc113bc0 con 0x7f7ffc070520 2023-12-05T09:22:51.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.622+0000 7f800185d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 0x7f7ffc11a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:51.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.622+0000 7f800185d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 0x7f7ffc11a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47476/0 (socket says 172.21.15.67:47476) 2023-12-05T09:22:51.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.622+0000 7f800185d700 1 -- 172.21.15.67:0/760690980 learned_addr learned my addr 172.21.15.67:0/760690980 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:51.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.622+0000 7f800205e700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc070520 0x7f7ffc119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:51.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.622+0000 7f800205e700 1 -- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 msgr2=0x7f7ffc11a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.622+0000 7f800205e700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 0x7f7ffc11a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.622+0000 7f800205e700 1 -- 172.21.15.67:0/760690980 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff8005040 con 0x7f7ffc070520 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.622+0000 7f800185d700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 0x7f7ffc11a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.623+0000 7f800205e700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc070520 0x7f7ffc119ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8005010 tx=0x7f7ff8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.623+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff800e040 con 0x7f7ffc070520 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.623+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ff8009930 con 0x7f7ffc070520 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.623+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc113e40 con 0x7f7ffc070520 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.623+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff801c3f0 con 0x7f7ffc070520 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.623+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc114380 con 0x7f7ffc070520 2023-12-05T09:22:51.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.624+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ffc114870 con 0x7f7ffc070520 2023-12-05T09:22:51.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.625+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7ff8013420 con 0x7f7ffc070520 2023-12-05T09:22:51.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.626+0000 7f7ff2ffd700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7fe8068f70 0x7f7fe806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:51.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.626+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7ff8087ea0 con 0x7f7ffc070520 2023-12-05T09:22:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.626+0000 7f800185d700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7fe8068f70 0x7f7fe806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.626+0000 7f7ff2ffd700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] conn(0x7f7fe806ec40 0x7f7fe8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.626+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 --> [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fe8071700 con 0x7f7fe806ec40 2023-12-05T09:22:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.626+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ff8088210 con 0x7f7ffc070520 2023-12-05T09:22:51.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.627+0000 7f800285f700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] conn(0x7f7fe806ec40 0x7f7fe8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:51.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.627+0000 7f800185d700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7fe8068f70 0x7f7fe806b420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc1155c0 tx=0x7f7fec00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:51.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.627+0000 7f800285f700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] conn(0x7f7fe806ec40 0x7f7fe8071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:51.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:51 smithi134 ceph-mon[116304]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:51.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.629+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 <== osd.2 v2:172.21.15.67:6818/3402999571 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7fe8071700 con 0x7f7fe806ec40 2023-12-05T09:22:51.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.648+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 --> [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ffc05e2f0 con 0x7f7fe806ec40 2023-12-05T09:22:51.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f7ff2ffd700 1 -- 172.21.15.67:0/760690980 <== osd.2 v2:172.21.15.67:6818/3402999571 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ffc05e2f0 con 0x7f7fe806ec40 2023-12-05T09:22:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] conn(0x7f7fe806ec40 msgr2=0x7f7fe8071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] conn(0x7f7fe806ec40 0x7f7fe8071050 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7fe8068f70 msgr2=0x7f7fe806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7fe8068f70 0x7f7fe806b420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc1155c0 tx=0x7f7fec00b040 comp rx=0 tx=0).stop 2023-12-05T09:22:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc070520 msgr2=0x7f7ffc119ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc070520 0x7f7ffc119ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8005010 tx=0x7f7ff8009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 shutdown_connections 2023-12-05T09:22:51.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7fe8068f70 0x7f7fe806b420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ffc070520 0x7f7ffc119ce0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:6818/3402999571,v1:172.21.15.67:6819/3402999571] conn(0x7f7fe806ec40 0x7f7fe8071050 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 --2- 172.21.15.67:0/760690980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7ffc071c10 0x7f7ffc11a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.649+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 >> 172.21.15.67:0/760690980 conn(0x7f7ffc0f8790 msgr2=0x7f7ffc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.650+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 shutdown_connections 2023-12-05T09:22:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:51.650+0000 7f80042c2700 1 -- 172.21.15.67:0/760690980 wait complete. 2023-12-05T09:22:52.842 INFO:teuthology.orchestra.run.smithi067.stdout:81604378644 2023-12-05T09:22:52.842 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-05T09:22:53.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.125+0000 7f60dffff700 1 -- 172.21.15.67:0/3250212177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0071c10 msgr2=0x7f60e006ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.125+0000 7f60dffff700 1 --2- 172.21.15.67:0/3250212177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0071c10 0x7f60e006ffe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60d0004970 tx=0x7f60d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.125+0000 7f60dffff700 1 -- 172.21.15.67:0/3250212177 shutdown_connections 2023-12-05T09:22:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.125+0000 7f60dffff700 1 --2- 172.21.15.67:0/3250212177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60e0070520 0x7f60e0070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.126+0000 7f60dffff700 1 --2- 172.21.15.67:0/3250212177 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0071c10 0x7f60e006ffe0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.126+0000 7f60dffff700 1 -- 172.21.15.67:0/3250212177 >> 172.21.15.67:0/3250212177 conn(0x7f60e00f8560 msgr2=0x7f60e00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.126+0000 7f60dffff700 1 -- 172.21.15.67:0/3250212177 shutdown_connections 2023-12-05T09:22:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.126+0000 7f60dffff700 1 -- 172.21.15.67:0/3250212177 wait complete. 2023-12-05T09:22:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.127+0000 7f60dffff700 1 Processor -- start 2023-12-05T09:22:53.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.127+0000 7f60dffff700 1 -- start start 2023-12-05T09:22:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60dffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0070520 0x7f60e0119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60dffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60e0071c10 0x7f60e011a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60dffff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e011a690 con 0x7f60e0070520 2023-12-05T09:22:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60dffff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01139c0 con 0x7f60e0071c10 2023-12-05T09:22:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60deffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0070520 0x7f60e0119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60deffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0070520 0x7f60e0119b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47508/0 (socket says 172.21.15.67:47508) 2023-12-05T09:22:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60deffd700 1 -- 172.21.15.67:0/3333267873 learned_addr learned my addr 172.21.15.67:0/3333267873 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60de7fc700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60e0071c10 0x7f60e011a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60deffd700 1 -- 172.21.15.67:0/3333267873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60e0071c10 msgr2=0x7f60e011a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60deffd700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60e0071c10 0x7f60e011a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.128+0000 7f60deffd700 1 -- 172.21.15.67:0/3333267873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d0005040 con 0x7f60e0070520 2023-12-05T09:22:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.129+0000 7f60deffd700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0070520 0x7f60e0119b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f60d0000c00 tx=0x7f60d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.129+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d000e040 con 0x7f60e0070520 2023-12-05T09:22:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.129+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60d0004290 con 0x7f60e0070520 2023-12-05T09:22:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.129+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60d0013e80 con 0x7f60e0070520 2023-12-05T09:22:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.129+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e0113c40 con 0x7f60e0070520 2023-12-05T09:22:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.129+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e0114180 con 0x7f60e0070520 2023-12-05T09:22:53.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.130+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60e0114730 con 0x7f60e0070520 2023-12-05T09:22:53.131 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.131+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f60d0009480 con 0x7f60e0070520 2023-12-05T09:22:53.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.132+0000 7f60c77fe700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f60c8068f70 0x7f60c806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.133+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f60d0087d50 con 0x7f60e0070520 2023-12-05T09:22:53.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.133+0000 7f60de7fc700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f60c8068f70 0x7f60c806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.133+0000 7f60c77fe700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] conn(0x7f60c806ec40 0x7f60c8071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.133+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 --> [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60c8071700 con 0x7f60c806ec40 2023-12-05T09:22:53.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.133+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60d008a2a0 con 0x7f60e0070520 2023-12-05T09:22:53.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.133+0000 7f60df7fe700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] conn(0x7f60c806ec40 0x7f60c8071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.133+0000 7f60de7fc700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f60c8068f70 0x7f60c806b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f60e0115330 tx=0x7f60d400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.134+0000 7f60df7fe700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] conn(0x7f60c806ec40 0x7f60c8071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.136 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.135+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 <== osd.1 v2:172.21.15.67:6810/565202870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f60c8071700 con 0x7f60c806ec40 2023-12-05T09:22:53.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.153+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 --> [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60e0113dd0 con 0x7f60c806ec40 2023-12-05T09:22:53.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.154+0000 7f60c77fe700 1 -- 172.21.15.67:0/3333267873 <== osd.1 v2:172.21.15.67:6810/565202870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f60e0113dd0 con 0x7f60c806ec40 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.154+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] conn(0x7f60c806ec40 msgr2=0x7f60c8071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.154+0000 7f60dffff700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] conn(0x7f60c806ec40 0x7f60c8071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.154+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f60c8068f70 msgr2=0x7f60c806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.154+0000 7f60dffff700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f60c8068f70 0x7f60c806b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f60e0115330 tx=0x7f60d400b040 comp rx=0 tx=0).stop 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.154+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0070520 msgr2=0x7f60e0119b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.154+0000 7f60dffff700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0070520 0x7f60e0119b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f60d0000c00 tx=0x7f60d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.155+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 shutdown_connections 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.155+0000 7f60dffff700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f60c8068f70 0x7f60c806b420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.155+0000 7f60dffff700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:6810/565202870,v1:172.21.15.67:6811/565202870] conn(0x7f60c806ec40 0x7f60c8071050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.155+0000 7f60dffff700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60e0070520 0x7f60e0119b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.155+0000 7f60dffff700 1 --2- 172.21.15.67:0/3333267873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60e0071c10 0x7f60e011a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.155+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 >> 172.21.15.67:0/3333267873 conn(0x7f60e00f8560 msgr2=0x7f60e010bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:53.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.155+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 shutdown_connections 2023-12-05T09:22:53.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.155+0000 7f60dffff700 1 -- 172.21.15.67:0/3333267873 wait complete. 2023-12-05T09:22:53.224 INFO:teuthology.orchestra.run.smithi067.stdout:38654705694 2023-12-05T09:22:53.225 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-05T09:22:53.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.701+0000 7f229e4b9700 1 -- 172.21.15.67:0/1645886370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22981035a0 msgr2=0x7f22980fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.701+0000 7f229e4b9700 1 --2- 172.21.15.67:0/1645886370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22981035a0 0x7f22980fcc10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f228c004940 tx=0x7f228c009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.701+0000 7f229e4b9700 1 -- 172.21.15.67:0/1645886370 shutdown_connections 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.701+0000 7f229e4b9700 1 --2- 172.21.15.67:0/1645886370 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22981035a0 0x7f22980fcc10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.701+0000 7f229e4b9700 1 --2- 172.21.15.67:0/1645886370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2298102c00 0x7f2298102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.701+0000 7f229e4b9700 1 -- 172.21.15.67:0/1645886370 >> 172.21.15.67:0/1645886370 conn(0x7f22980f8790 msgr2=0x7f22980faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.701+0000 7f229e4b9700 1 -- 172.21.15.67:0/1645886370 shutdown_connections 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.701+0000 7f229e4b9700 1 -- 172.21.15.67:0/1645886370 wait complete. 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.702+0000 7f229e4b9700 1 Processor -- start 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.702+0000 7f229e4b9700 1 -- start start 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f229e4b9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298102c00 0x7f2298113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f229e4b9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22981035a0 0x7f2298113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f229e4b9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298114210 con 0x7f2298102c00 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f229e4b9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229810d500 con 0x7f22981035a0 2023-12-05T09:22:53.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f2297fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298102c00 0x7f2298113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f2297fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298102c00 0x7f2298113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47492/0 (socket says 172.21.15.67:47492) 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f2297fff700 1 -- 172.21.15.67:0/835485013 learned_addr learned my addr 172.21.15.67:0/835485013 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f22977fe700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22981035a0 0x7f2298113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f2297fff700 1 -- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22981035a0 msgr2=0x7f2298113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f2297fff700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22981035a0 0x7f2298113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.703+0000 7f2297fff700 1 -- 172.21.15.67:0/835485013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c005040 con 0x7f2298102c00 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.704+0000 7f2297fff700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298102c00 0x7f2298113680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2288002a50 tx=0x7f22880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.704+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2288007cc0 con 0x7f2298102c00 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.704+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f228800f040 con 0x7f2298102c00 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.704+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229810d7e0 con 0x7f2298102c00 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.704+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228800d9c0 con 0x7f2298102c00 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.704+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229810dd20 con 0x7f2298102c00 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.705+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f229810e210 con 0x7f2298102c00 2023-12-05T09:22:53.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.706+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f228800db20 con 0x7f2298102c00 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.707+0000 7f2294ff9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2280068f70 0x7f228006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.707+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2288086740 con 0x7f2298102c00 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.707+0000 7f22977fe700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2280068f70 0x7f228006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.708+0000 7f2294ff9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] conn(0x7f228006ec40 0x7f2280071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.708+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 --> [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2280071700 con 0x7f228006ec40 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.708+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2288088c90 con 0x7f2298102c00 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.708+0000 7f22977fe700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2280068f70 0x7f228006b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f229810eee0 tx=0x7f228c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.708+0000 7f229ca56700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] conn(0x7f228006ec40 0x7f2280071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.709+0000 7f229ca56700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] conn(0x7f228006ec40 0x7f2280071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.710+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 <== osd.3 v2:172.21.15.134:6800/3069496213 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2280071700 con 0x7f228006ec40 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.726+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 --> [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f229805e2f0 con 0x7f228006ec40 2023-12-05T09:22:53.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f2294ff9700 1 -- 172.21.15.67:0/835485013 <== osd.3 v2:172.21.15.134:6800/3069496213 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f229805e2f0 con 0x7f228006ec40 2023-12-05T09:22:53.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] conn(0x7f228006ec40 msgr2=0x7f2280071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] conn(0x7f228006ec40 0x7f2280071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2280068f70 msgr2=0x7f228006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2280068f70 0x7f228006b420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f229810eee0 tx=0x7f228c009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298102c00 msgr2=0x7f2298113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298102c00 0x7f2298113680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2288002a50 tx=0x7f22880046b0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 shutdown_connections 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2280068f70 0x7f228006b420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:6800/3069496213,v1:172.21.15.134:6801/3069496213] conn(0x7f228006ec40 0x7f2280071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298102c00 0x7f2298113680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 --2- 172.21.15.67:0/835485013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22981035a0 0x7f2298113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 >> 172.21.15.67:0/835485013 conn(0x7f22980f8790 msgr2=0x7f22980fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 shutdown_connections 2023-12-05T09:22:53.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:52.727+0000 7f229e4b9700 1 -- 172.21.15.67:0/835485013 wait complete. 2023-12-05T09:22:53.554 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:53 smithi067 ceph-mon[107174]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:53.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:53 smithi134 ceph-mon[116304]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:53.786 INFO:teuthology.orchestra.run.smithi067.stdout:115964117007 2023-12-05T09:22:53.787 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-05T09:22:53.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.949+0000 7f1f102c1700 1 -- 172.21.15.67:0/2153074704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f08102c00 msgr2=0x7f1f08102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.949+0000 7f1f102c1700 1 --2- 172.21.15.67:0/2153074704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f08102c00 0x7f1f08102fd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f04004940 tx=0x7f1f04009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:53.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.949+0000 7f1f102c1700 1 -- 172.21.15.67:0/2153074704 shutdown_connections 2023-12-05T09:22:53.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.949+0000 7f1f102c1700 1 --2- 172.21.15.67:0/2153074704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f081035a0 0x7f1f080fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.949+0000 7f1f102c1700 1 --2- 172.21.15.67:0/2153074704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f08102c00 0x7f1f08102fd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.949+0000 7f1f102c1700 1 -- 172.21.15.67:0/2153074704 >> 172.21.15.67:0/2153074704 conn(0x7f1f080f8790 msgr2=0x7f1f080faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:53.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.949+0000 7f1f102c1700 1 -- 172.21.15.67:0/2153074704 shutdown_connections 2023-12-05T09:22:53.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.949+0000 7f1f102c1700 1 -- 172.21.15.67:0/2153074704 wait complete. 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.950+0000 7f1f102c1700 1 Processor -- start 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.950+0000 7f1f102c1700 1 -- start start 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f102c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f08102c00 0x7f1f08115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f102c1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f081035a0 0x7f1f08115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f102c1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f081163d0 con 0x7f1f081035a0 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f102c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0810f700 con 0x7f1f08102c00 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f0d85c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f081035a0 0x7f1f08115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f0d85c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f081035a0 0x7f1f08115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47530/0 (socket says 172.21.15.67:47530) 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f0d85c700 1 -- 172.21.15.67:0/4015456353 learned_addr learned my addr 172.21.15.67:0/4015456353 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:53.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f0e05d700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f08102c00 0x7f1f08115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f0d85c700 1 -- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f08102c00 msgr2=0x7f1f08115840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f0d85c700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f08102c00 0x7f1f08115840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.951+0000 7f1f0d85c700 1 -- 172.21.15.67:0/4015456353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04005040 con 0x7f1f081035a0 2023-12-05T09:22:53.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.952+0000 7f1f0d85c700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f081035a0 0x7f1f08115d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8002a50 tx=0x7f1ef8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.952+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef8007cc0 con 0x7f1f081035a0 2023-12-05T09:22:53.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.952+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ef800f040 con 0x7f1f081035a0 2023-12-05T09:22:53.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.952+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0810f9e0 con 0x7f1f081035a0 2023-12-05T09:22:53.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.952+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef800d920 con 0x7f1f081035a0 2023-12-05T09:22:53.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.952+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0810ff20 con 0x7f1f081035a0 2023-12-05T09:22:53.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.953+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f08110490 con 0x7f1f081035a0 2023-12-05T09:22:53.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.955+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f1ef8009680 con 0x7f1f081035a0 2023-12-05T09:22:53.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.956+0000 7f1efeffd700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1ef4068f70 0x7f1ef406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.956+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1ef8086750 con 0x7f1f081035a0 2023-12-05T09:22:53.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.956+0000 7f1f0e05d700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1ef4068f70 0x7f1ef406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.956+0000 7f1efeffd700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] conn(0x7f1ef406ec40 0x7f1ef4071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:53.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.956+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 --> [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ef4071700 con 0x7f1ef406ec40 2023-12-05T09:22:53.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.956+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ef8088ca0 con 0x7f1f081035a0 2023-12-05T09:22:53.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.957+0000 7f1f0e85e700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] conn(0x7f1ef406ec40 0x7f1ef4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:53.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.957+0000 7f1f0e05d700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1ef4068f70 0x7f1ef406b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f040043d0 tx=0x7f1f04009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.957+0000 7f1f0e85e700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] conn(0x7f1ef406ec40 0x7f1ef4071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:53.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.958+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 <== osd.5 v2:172.21.15.134:6816/2682778910 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1ef4071700 con 0x7f1ef406ec40 2023-12-05T09:22:53.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.974+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 --> [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f080fab20 con 0x7f1ef406ec40 2023-12-05T09:22:53.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.975+0000 7f1efeffd700 1 -- 172.21.15.67:0/4015456353 <== osd.5 v2:172.21.15.134:6816/2682778910 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1f080fab20 con 0x7f1ef406ec40 2023-12-05T09:22:53.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.975+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] conn(0x7f1ef406ec40 msgr2=0x7f1ef4071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.975+0000 7f1f102c1700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] conn(0x7f1ef406ec40 0x7f1ef4071050 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.975+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1ef4068f70 msgr2=0x7f1ef406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.975+0000 7f1f102c1700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1ef4068f70 0x7f1ef406b420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f040043d0 tx=0x7f1f04009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.975+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f081035a0 msgr2=0x7f1f08115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.975+0000 7f1f102c1700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f081035a0 0x7f1f08115d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8002a50 tx=0x7f1ef8004600 comp rx=0 tx=0).stop 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.976+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 shutdown_connections 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.976+0000 7f1f102c1700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:6816/2682778910,v1:172.21.15.134:6817/2682778910] conn(0x7f1ef406ec40 0x7f1ef4071050 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.976+0000 7f1f102c1700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1ef4068f70 0x7f1ef406b420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.976+0000 7f1f102c1700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f08102c00 0x7f1f08115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.976+0000 7f1f102c1700 1 --2- 172.21.15.67:0/4015456353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1f081035a0 0x7f1f08115d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.976+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 >> 172.21.15.67:0/4015456353 conn(0x7f1f080f8790 msgr2=0x7f1f080fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.976+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 shutdown_connections 2023-12-05T09:22:53.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:53.976+0000 7f1f102c1700 1 -- 172.21.15.67:0/4015456353 wait complete. 2023-12-05T09:22:54.539 INFO:teuthology.orchestra.run.smithi067.stdout:167503724550 2023-12-05T09:22:54.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-05T09:22:54.591 INFO:teuthology.orchestra.run.smithi067.stdout:60129542169 2023-12-05T09:22:54.591 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-05T09:22:55.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.048+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/1892799958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 msgr2=0x7fc8f8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.048+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/1892799958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 0x7fc8f8102ff0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4004880 tx=0x7fc8f4009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.048+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/1892799958 shutdown_connections 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.048+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/1892799958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f8065390 0x7fc8f8065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.048+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/1892799958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 0x7fc8f8102ff0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.048+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/1892799958 >> 172.21.15.67:0/1892799958 conn(0x7fc8f80719b0 msgr2=0x7fc8f8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.048+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/1892799958 shutdown_connections 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.049+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/1892799958 wait complete. 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.049+0000 7fc8ff6c5700 1 Processor -- start 2023-12-05T09:22:55.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.049+0000 7fc8ff6c5700 1 -- start start 2023-12-05T09:22:55.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8ff6c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f8065390 0x7fc8f81157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:55.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8ff6c5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 0x7fc8f8115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8ff6c5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f8116370 con 0x7fc8f8102c20 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8ff6c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f810f6a0 con 0x7fc8f8065390 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8fcc60700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 0x7fc8f8115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8fcc60700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 0x7fc8f8115d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47548/0 (socket says 172.21.15.67:47548) 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8fcc60700 1 -- 172.21.15.67:0/3969665176 learned_addr learned my addr 172.21.15.67:0/3969665176 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8fd461700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f8065390 0x7fc8f81157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8fcc60700 1 -- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f8065390 msgr2=0x7fc8f81157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8fcc60700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f8065390 0x7fc8f81157e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.050+0000 7fc8fcc60700 1 -- 172.21.15.67:0/3969665176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e8005040 con 0x7fc8f8102c20 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.051+0000 7fc8fcc60700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 0x7fc8f8115d20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80096b0 tx=0x7fc8e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.051+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e8017070 con 0x7fc8f8102c20 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.051+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8e800f040 con 0x7fc8f8102c20 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.051+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f4005040 con 0x7fc8f8102c20 2023-12-05T09:22:55.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.051+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e8013b70 con 0x7fc8f8102c20 2023-12-05T09:22:55.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.051+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f810fcd0 con 0x7fc8f8102c20 2023-12-05T09:22:55.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.052+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8f81101c0 con 0x7fc8f8102c20 2023-12-05T09:22:55.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.053+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc8e800e840 con 0x7fc8f8102c20 2023-12-05T09:22:55.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.054+0000 7fc8edffb700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc8e4068f70 0x7fc8e406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:55.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.054+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc8e8086810 con 0x7fc8f8102c20 2023-12-05T09:22:55.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.054+0000 7fc8fd461700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc8e4068f70 0x7fc8e406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:55.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.054+0000 7fc8edffb700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] conn(0x7fc8e406ec40 0x7fc8e4071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:55.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.055+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 --> [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8e4071700 con 0x7fc8e406ec40 2023-12-05T09:22:55.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.055+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8e8088d60 con 0x7fc8f8102c20 2023-12-05T09:22:55.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.055+0000 7fc8fd461700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc8e4068f70 0x7fc8e406b420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009fd0 tx=0x7fc8f4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:55.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.055+0000 7fc8fdc62700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] conn(0x7fc8e406ec40 0x7fc8e4071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:55.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.056+0000 7fc8fdc62700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] conn(0x7fc8e406ec40 0x7fc8e4071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:55.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.057+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 <== osd.4 v2:172.21.15.134:6808/548117417 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc8e4071700 con 0x7fc8e406ec40 2023-12-05T09:22:55.074 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:55.079 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:55.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.083+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 --> [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8f80734d0 con 0x7fc8e406ec40 2023-12-05T09:22:55.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8edffb700 1 -- 172.21.15.67:0/3969665176 <== osd.4 v2:172.21.15.134:6808/548117417 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc8f80734d0 con 0x7fc8e406ec40 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] conn(0x7fc8e406ec40 msgr2=0x7fc8e4071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] conn(0x7fc8e406ec40 0x7fc8e4071050 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc8e4068f70 msgr2=0x7fc8e406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc8e4068f70 0x7fc8e406b420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009fd0 tx=0x7fc8f4009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 msgr2=0x7fc8f8115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 0x7fc8f8115d20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80096b0 tx=0x7fc8e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 shutdown_connections 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:6808/548117417,v1:172.21.15.134:6809/548117417] conn(0x7fc8e406ec40 0x7fc8e4071050 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc8e4068f70 0x7fc8e406b420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:55.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8f8065390 0x7fc8f81157e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:55.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 --2- 172.21.15.67:0/3969665176 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f8102c20 0x7fc8f8115d20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:55.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.084+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 >> 172.21.15.67:0/3969665176 conn(0x7fc8f80719b0 msgr2=0x7fc8f80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:55.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.085+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 shutdown_connections 2023-12-05T09:22:55.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:55.085+0000 7fc8ff6c5700 1 -- 172.21.15.67:0/3969665176 wait complete. 2023-12-05T09:22:55.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:55 smithi067 ceph-mon[107174]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:55.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:55 smithi134 ceph-mon[116304]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:56.089 INFO:teuthology.orchestra.run.smithi067.stdout:146028888076 2023-12-05T09:22:56.090 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-05T09:22:56.234 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:56.288 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:56.528 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:57.189 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:56 smithi067 ceph-mon[107174]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:57.190 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:56 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:22:57.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:56 smithi134 ceph-mon[116304]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:57.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:56 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:22:57.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.780+0000 7ffab862e700 1 -- 172.21.15.67:0/1131025117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 msgr2=0x7ffab00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:57.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.780+0000 7ffab862e700 1 --2- 172.21.15.67:0/1131025117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 0x7ffab00703b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffaac004970 tx=0x7ffaac009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:57.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.780+0000 7ffab862e700 1 -- 172.21.15.67:0/1131025117 shutdown_connections 2023-12-05T09:22:57.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.780+0000 7ffab862e700 1 --2- 172.21.15.67:0/1131025117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab00708f0 0x7ffab0108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.780+0000 7ffab862e700 1 --2- 172.21.15.67:0/1131025117 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 0x7ffab00703b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.780+0000 7ffab862e700 1 -- 172.21.15.67:0/1131025117 >> 172.21.15.67:0/1131025117 conn(0x7ffab00f8790 msgr2=0x7ffab00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.780+0000 7ffab862e700 1 -- 172.21.15.67:0/1131025117 shutdown_connections 2023-12-05T09:22:57.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.781+0000 7ffab862e700 1 -- 172.21.15.67:0/1131025117 wait complete. 2023-12-05T09:22:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.781+0000 7ffab862e700 1 Processor -- start 2023-12-05T09:22:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab862e700 1 -- start start 2023-12-05T09:22:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab862e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 0x7ffab01157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab862e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab00708f0 0x7ffab0115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab862e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0116380 con 0x7ffab006ffe0 2023-12-05T09:22:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab862e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab010f6b0 con 0x7ffab00708f0 2023-12-05T09:22:57.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab63ca700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 0x7ffab01157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab63ca700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 0x7ffab01157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39264/0 (socket says 172.21.15.67:39264) 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab63ca700 1 -- 172.21.15.67:0/254672161 learned_addr learned my addr 172.21.15.67:0/254672161 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.782+0000 7ffab5bc9700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab00708f0 0x7ffab0115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.783+0000 7ffab63ca700 1 -- 172.21.15.67:0/254672161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab00708f0 msgr2=0x7ffab0115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.783+0000 7ffab63ca700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab00708f0 0x7ffab0115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.783+0000 7ffab63ca700 1 -- 172.21.15.67:0/254672161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac005040 con 0x7ffab006ffe0 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.783+0000 7ffab63ca700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 0x7ffab01157f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffaac004f50 tx=0x7ffaac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.783+0000 7ffaa6ffd700 1 -- 172.21.15.67:0/254672161 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaac00e040 con 0x7ffab006ffe0 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.783+0000 7ffaa6ffd700 1 -- 172.21.15.67:0/254672161 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffaac013420 con 0x7ffab006ffe0 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.783+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab010f930 con 0x7ffab006ffe0 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.783+0000 7ffaa6ffd700 1 -- 172.21.15.67:0/254672161 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaac01c630 con 0x7ffab006ffe0 2023-12-05T09:22:57.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.784+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab010fe70 con 0x7ffab006ffe0 2023-12-05T09:22:57.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.785+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab01065d0 con 0x7ffab006ffe0 2023-12-05T09:22:57.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.786+0000 7ffaa6ffd700 1 -- 172.21.15.67:0/254672161 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ffaac013a00 con 0x7ffab006ffe0 2023-12-05T09:22:57.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.787+0000 7ffaa6ffd700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffa9c068f70 0x7ffa9c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:57.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.787+0000 7ffaa6ffd700 1 -- 172.21.15.67:0/254672161 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffaac087d80 con 0x7ffab006ffe0 2023-12-05T09:22:57.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.787+0000 7ffab5bc9700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffa9c068f70 0x7ffa9c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:57.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.787+0000 7ffab5bc9700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffa9c068f70 0x7ffa9c06b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffab0111020 tx=0x7ffaa000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:57.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.792+0000 7ffaa6ffd700 1 -- 172.21.15.67:0/254672161 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffaac057f80 con 0x7ffab006ffe0 2023-12-05T09:22:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.902+0000 7fccd668f700 1 -- 172.21.15.67:0/1550762472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0102c20 msgr2=0x7fccd0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.902+0000 7fccd668f700 1 --2- 172.21.15.67:0/1550762472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0102c20 0x7fccd0102ff0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fccc0004940 tx=0x7fccc0009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.902+0000 7fccd668f700 1 -- 172.21.15.67:0/1550762472 shutdown_connections 2023-12-05T09:22:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.902+0000 7fccd668f700 1 --2- 172.21.15.67:0/1550762472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd0065390 0x7fccd0065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.902+0000 7fccd668f700 1 --2- 172.21.15.67:0/1550762472 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0102c20 0x7fccd0102ff0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.902+0000 7fccd668f700 1 -- 172.21.15.67:0/1550762472 >> 172.21.15.67:0/1550762472 conn(0x7fccd00719b0 msgr2=0x7fccd0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:57.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.902+0000 7fccd668f700 1 -- 172.21.15.67:0/1550762472 shutdown_connections 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.903+0000 7fccd668f700 1 -- 172.21.15.67:0/1550762472 wait complete. 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.903+0000 7fccd668f700 1 Processor -- start 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.903+0000 7fccd668f700 1 -- start start 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fccd668f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0065390 0x7fccd01157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fccd668f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd0102c20 0x7fccd0115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fccd668f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd0116370 con 0x7fccd0065390 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fccd668f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd010f6a0 con 0x7fccd0102c20 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fcccffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0065390 0x7fccd01157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fcccffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0065390 0x7fccd01157e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39276/0 (socket says 172.21.15.67:39276) 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fcccffff700 1 -- 172.21.15.67:0/78834621 learned_addr learned my addr 172.21.15.67:0/78834621 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fcccf7fe700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd0102c20 0x7fccd0115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fcccffff700 1 -- 172.21.15.67:0/78834621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd0102c20 msgr2=0x7fccd0115d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fcccffff700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd0102c20 0x7fccd0115d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:57.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.904+0000 7fcccffff700 1 -- 172.21.15.67:0/78834621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc0005040 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.905+0000 7fcccffff700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0065390 0x7fccd01157e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fccc00040d0 tx=0x7fccc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.905+0000 7fccccff9700 1 -- 172.21.15.67:0/78834621 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc0021070 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.905+0000 7fccccff9700 1 -- 172.21.15.67:0/78834621 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fccc001c400 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.905+0000 7fccccff9700 1 -- 172.21.15.67:0/78834621 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc000e070 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.905+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd010f920 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.905+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd010fe60 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.906+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd00734d0 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.908+0000 7fccccff9700 1 -- 172.21.15.67:0/78834621 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fccc001c9c0 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.909+0000 7fccccff9700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fccb8068f70 0x7fccb806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.909+0000 7fccccff9700 1 -- 172.21.15.67:0/78834621 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fccc0088770 con 0x7fccd0065390 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.910+0000 7fcccf7fe700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fccb8068f70 0x7fccb806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.910+0000 7fcccf7fe700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fccb8068f70 0x7fccb806b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fccd0111010 tx=0x7fccc400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:57.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:57.913+0000 7fccccff9700 1 -- 172.21.15.67:0/78834621 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fccc00589f0 con 0x7fccd0065390 2023-12-05T09:22:58.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.003+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffab004bb80 con 0x7ffab006ffe0 2023-12-05T09:22:58.004 INFO:teuthology.orchestra.run.smithi067.stdout:115964117008 2023-12-05T09:22:58.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.003+0000 7ffaa6ffd700 1 -- 172.21.15.67:0/254672161 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffaac057b10 con 0x7ffab006ffe0 2023-12-05T09:22:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffa9c068f70 msgr2=0x7ffa9c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffa9c068f70 0x7ffa9c06b420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffab0111020 tx=0x7ffaa000b040 comp rx=0 tx=0).stop 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 msgr2=0x7ffab01157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 0x7ffab01157f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffaac004f50 tx=0x7ffaac009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 shutdown_connections 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffa9c068f70 0x7ffa9c06b420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffab006ffe0 0x7ffab01157f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 --2- 172.21.15.67:0/254672161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffab00708f0 0x7ffab0115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 >> 172.21.15.67:0/254672161 conn(0x7ffab00f8790 msgr2=0x7ffab0103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 shutdown_connections 2023-12-05T09:22:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.007+0000 7ffab862e700 1 -- 172.21.15.67:0/254672161 wait complete. 2023-12-05T09:22:58.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.138+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fccd0109bd0 con 0x7fccd0065390 2023-12-05T09:22:58.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.139+0000 7fccccff9700 1 -- 172.21.15.67:0/78834621 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccc0058580 con 0x7fccd0065390 2023-12-05T09:22:58.139 INFO:teuthology.orchestra.run.smithi067.stdout:38654705695 2023-12-05T09:22:58.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fccb8068f70 msgr2=0x7fccb806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:58.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fccb8068f70 0x7fccb806b420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fccd0111010 tx=0x7fccc400b040 comp rx=0 tx=0).stop 2023-12-05T09:22:58.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0065390 msgr2=0x7fccd01157e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:58.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0065390 0x7fccd01157e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fccc00040d0 tx=0x7fccc0009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:58.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 shutdown_connections 2023-12-05T09:22:58.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fccb8068f70 0x7fccb806b420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:58.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fccd0065390 0x7fccd01157e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:58.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 --2- 172.21.15.67:0/78834621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd0102c20 0x7fccd0115d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:58.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 >> 172.21.15.67:0/78834621 conn(0x7fccd00719b0 msgr2=0x7fccd00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:58.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.142+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 shutdown_connections 2023-12-05T09:22:58.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:58.143+0000 7fccd668f700 1 -- 172.21.15.67:0/78834621 wait complete. 2023-12-05T09:22:58.201 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:58 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/254672161' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-05T09:22:58.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:58 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/254672161' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-05T09:22:58.896 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:22:58.924 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.0 2023-12-05T09:22:58.924 DEBUG:teuthology.parallel:result is None 2023-12-05T09:22:59.204 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:59 smithi067 ceph-mon[107174]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:59.204 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:22:59 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/78834621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-05T09:22:59.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:59 smithi134 ceph-mon[116304]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:22:59.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:22:59 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/78834621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-05T09:22:59.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.378+0000 7fad13db8700 1 -- 172.21.15.67:0/3755390349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 msgr2=0x7fad0c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:59.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.378+0000 7fad13db8700 1 --2- 172.21.15.67:0/3755390349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 0x7fad0c0fcc10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7facfc004940 tx=0x7facfc009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:59.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.379+0000 7fad13db8700 1 -- 172.21.15.67:0/3755390349 shutdown_connections 2023-12-05T09:22:59.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.379+0000 7fad13db8700 1 --2- 172.21.15.67:0/3755390349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 0x7fad0c0fcc10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:59.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.379+0000 7fad13db8700 1 --2- 172.21.15.67:0/3755390349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c102c00 0x7fad0c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:59.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.379+0000 7fad13db8700 1 -- 172.21.15.67:0/3755390349 >> 172.21.15.67:0/3755390349 conn(0x7fad0c0f8790 msgr2=0x7fad0c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:59.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.379+0000 7fad13db8700 1 -- 172.21.15.67:0/3755390349 shutdown_connections 2023-12-05T09:22:59.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.379+0000 7fad13db8700 1 -- 172.21.15.67:0/3755390349 wait complete. 2023-12-05T09:22:59.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad13db8700 1 Processor -- start 2023-12-05T09:22:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad13db8700 1 -- start start 2023-12-05T09:22:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad13db8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c102c00 0x7fad0c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad13db8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 0x7fad0c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad13db8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c070a80 con 0x7fad0c1035a0 2023-12-05T09:22:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad13db8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c070bf0 con 0x7fad0c102c00 2023-12-05T09:22:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad11353700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 0x7fad0c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad11353700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 0x7fad0c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39288/0 (socket says 172.21.15.67:39288) 2023-12-05T09:22:59.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.380+0000 7fad11353700 1 -- 172.21.15.67:0/91805610 learned_addr learned my addr 172.21.15.67:0/91805610 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:22:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad11b54700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c102c00 0x7fad0c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad11353700 1 -- 172.21.15.67:0/91805610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c102c00 msgr2=0x7fad0c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad11353700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c102c00 0x7fad0c06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad11353700 1 -- 172.21.15.67:0/91805610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc005040 con 0x7fad0c1035a0 2023-12-05T09:22:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad11353700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 0x7fad0c070480 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facfc009fd0 tx=0x7facfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad027fc700 1 -- 172.21.15.67:0/91805610 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facfc021070 con 0x7fad0c1035a0 2023-12-05T09:22:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad027fc700 1 -- 172.21.15.67:0/91805610 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7facfc01c400 con 0x7fad0c1035a0 2023-12-05T09:22:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c1198c0 con 0x7fad0c1035a0 2023-12-05T09:22:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad027fc700 1 -- 172.21.15.67:0/91805610 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facfc00e070 con 0x7fad0c1035a0 2023-12-05T09:22:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.381+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c119cc0 con 0x7fad0c1035a0 2023-12-05T09:22:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.383+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c1050d0 con 0x7fad0c1035a0 2023-12-05T09:22:59.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.384+0000 7fad027fc700 1 -- 172.21.15.67:0/91805610 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7facfc01c570 con 0x7fad0c1035a0 2023-12-05T09:22:59.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.384+0000 7fad027fc700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7facf8068f70 0x7facf806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:22:59.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.385+0000 7fad027fc700 1 -- 172.21.15.67:0/91805610 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7facfc087b30 con 0x7fad0c1035a0 2023-12-05T09:22:59.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.385+0000 7fad11b54700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7facf8068f70 0x7facf806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:22:59.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.385+0000 7fad11b54700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7facf8068f70 0x7facf806b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad08004600 tx=0x7fad0800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:22:59.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.389+0000 7fad027fc700 1 -- 172.21.15.67:0/91805610 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7facfc0543e0 con 0x7fad0c1035a0 2023-12-05T09:22:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.602+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fad0c071680 con 0x7fad0c1035a0 2023-12-05T09:22:59.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.602+0000 7fad027fc700 1 -- 172.21.15.67:0/91805610 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7facfc057a00 con 0x7fad0c1035a0 2023-12-05T09:22:59.603 INFO:teuthology.orchestra.run.smithi067.stdout:60129542170 2023-12-05T09:22:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7facf8068f70 msgr2=0x7facf806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7facf8068f70 0x7facf806b420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fad08004600 tx=0x7fad0800b040 comp rx=0 tx=0).stop 2023-12-05T09:22:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 msgr2=0x7fad0c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:22:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 0x7fad0c070480 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facfc009fd0 tx=0x7facfc009e30 comp rx=0 tx=0).stop 2023-12-05T09:22:59.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 shutdown_connections 2023-12-05T09:22:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7facf8068f70 0x7facf806b420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad0c102c00 0x7fad0c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 --2- 172.21.15.67:0/91805610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fad0c1035a0 0x7fad0c070480 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:22:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 >> 172.21.15.67:0/91805610 conn(0x7fad0c0f8790 msgr2=0x7fad0c0fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:22:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 shutdown_connections 2023-12-05T09:22:59.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:22:59.605+0000 7fad13db8700 1 -- 172.21.15.67:0/91805610 wait complete. 2023-12-05T09:22:59.877 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117007 got 115964117008 for osd.3 2023-12-05T09:22:59.877 DEBUG:teuthology.parallel:result is None 2023-12-05T09:23:00.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:00 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/91805610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-05T09:23:00.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.140+0000 7fc7f717a700 1 -- 172.21.15.67:0/185485686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 msgr2=0x7fc7f0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.140+0000 7fc7f717a700 1 --2- 172.21.15.67:0/185485686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 0x7fc7f0102fd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4004940 tx=0x7fc7e4009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.140+0000 7fc7f717a700 1 -- 172.21.15.67:0/185485686 shutdown_connections 2023-12-05T09:23:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.140+0000 7fc7f717a700 1 --2- 172.21.15.67:0/185485686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01035a0 0x7fc7f00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.140+0000 7fc7f717a700 1 --2- 172.21.15.67:0/185485686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 0x7fc7f0102fd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.140+0000 7fc7f717a700 1 -- 172.21.15.67:0/185485686 >> 172.21.15.67:0/185485686 conn(0x7fc7f00f8790 msgr2=0x7fc7f00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.140+0000 7fc7f717a700 1 -- 172.21.15.67:0/185485686 shutdown_connections 2023-12-05T09:23:00.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.140+0000 7fc7f717a700 1 -- 172.21.15.67:0/185485686 wait complete. 2023-12-05T09:23:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.141+0000 7fc7f717a700 1 Processor -- start 2023-12-05T09:23:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.141+0000 7fc7f717a700 1 -- start start 2023-12-05T09:23:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f717a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 0x7fc7f0113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f717a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01035a0 0x7fc7f0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f717a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f01141e0 con 0x7fc7f0102c00 2023-12-05T09:23:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f717a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f010d4d0 con 0x7fc7f01035a0 2023-12-05T09:23:00.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f4f16700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 0x7fc7f0113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:00.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f4f16700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 0x7fc7f0113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39304/0 (socket says 172.21.15.67:39304) 2023-12-05T09:23:00.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f4f16700 1 -- 172.21.15.67:0/1572277718 learned_addr learned my addr 172.21.15.67:0/1572277718 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:00.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7effff700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01035a0 0x7fc7f0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f4f16700 1 -- 172.21.15.67:0/1572277718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01035a0 msgr2=0x7fc7f0113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f4f16700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01035a0 0x7fc7f0113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.142+0000 7fc7f4f16700 1 -- 172.21.15.67:0/1572277718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4005040 con 0x7fc7f0102c00 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.143+0000 7fc7f4f16700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 0x7fc7f0113610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009360 tx=0x7fc7e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.143+0000 7fc7ed7fa700 1 -- 172.21.15.67:0/1572277718 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e400e040 con 0x7fc7f0102c00 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.143+0000 7fc7ed7fa700 1 -- 172.21.15.67:0/1572277718 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc7e400bc50 con 0x7fc7f0102c00 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.143+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f010d700 con 0x7fc7f0102c00 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.143+0000 7fc7ed7fa700 1 -- 172.21.15.67:0/1572277718 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e401c630 con 0x7fc7f0102c00 2023-12-05T09:23:00.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.143+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f010dc40 con 0x7fc7f0102c00 2023-12-05T09:23:00.145 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.144+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f00fff10 con 0x7fc7f0102c00 2023-12-05T09:23:00.145 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.145+0000 7fc7ed7fa700 1 -- 172.21.15.67:0/1572277718 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc7e4013420 con 0x7fc7f0102c00 2023-12-05T09:23:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.146+0000 7fc7ed7fa700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc7e0068f70 0x7fc7e006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:00.146 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.146+0000 7fc7ed7fa700 1 -- 172.21.15.67:0/1572277718 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc7e4087c80 con 0x7fc7f0102c00 2023-12-05T09:23:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.146+0000 7fc7effff700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc7e0068f70 0x7fc7e006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:00.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.147+0000 7fc7effff700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc7e0068f70 0x7fc7e006b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7f010eeb0 tx=0x7fc7dc009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:00.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.151+0000 7fc7ed7fa700 1 -- 172.21.15.67:0/1572277718 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc7e4057fc0 con 0x7fc7f0102c00 2023-12-05T09:23:00.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.212+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/141770320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80708f0 msgr2=0x7ff9d8108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:00.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.212+0000 7ff9dd3d8700 1 --2- 172.21.15.67:0/141770320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80708f0 0x7ff9d8108f10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc004970 tx=0x7ff9cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:00.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.212+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/141770320 shutdown_connections 2023-12-05T09:23:00.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.212+0000 7ff9dd3d8700 1 --2- 172.21.15.67:0/141770320 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d80708f0 0x7ff9d8108f10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.212+0000 7ff9dd3d8700 1 --2- 172.21.15.67:0/141770320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d806ffe0 0x7ff9d80703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.212+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/141770320 >> 172.21.15.67:0/141770320 conn(0x7ff9d80f8790 msgr2=0x7ff9d80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:00.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.212+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/141770320 shutdown_connections 2023-12-05T09:23:00.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.213+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/141770320 wait complete. 2023-12-05T09:23:00.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.214+0000 7ff9dd3d8700 1 Processor -- start 2023-12-05T09:23:00.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.214+0000 7ff9dd3d8700 1 -- start start 2023-12-05T09:23:00.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.214+0000 7ff9dd3d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d806ffe0 0x7ff9d8115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:00.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9dd3d8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d80708f0 0x7ff9d8115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:00.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9dd3d8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81163a0 con 0x7ff9d806ffe0 2023-12-05T09:23:00.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9dd3d8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d810f6d0 con 0x7ff9d80708f0 2023-12-05T09:23:00.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9d6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d806ffe0 0x7ff9d8115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:00.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9d6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d806ffe0 0x7ff9d8115810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39334/0 (socket says 172.21.15.67:39334) 2023-12-05T09:23:00.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9d6ffd700 1 -- 172.21.15.67:0/3887122194 learned_addr learned my addr 172.21.15.67:0/3887122194 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:00.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9d67fc700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d80708f0 0x7ff9d8115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:00.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9d6ffd700 1 -- 172.21.15.67:0/3887122194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d80708f0 msgr2=0x7ff9d8115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:00.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9d6ffd700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d80708f0 0x7ff9d8115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.215+0000 7ff9d6ffd700 1 -- 172.21.15.67:0/3887122194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc005040 con 0x7ff9d806ffe0 2023-12-05T09:23:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.216+0000 7ff9d6ffd700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d806ffe0 0x7ff9d8115810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8002a50 tx=0x7ff9c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.216+0000 7ff9bf7fe700 1 -- 172.21.15.67:0/3887122194 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9c8007cc0 con 0x7ff9d806ffe0 2023-12-05T09:23:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.216+0000 7ff9bf7fe700 1 -- 172.21.15.67:0/3887122194 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9c800f040 con 0x7ff9d806ffe0 2023-12-05T09:23:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.216+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d810f9b0 con 0x7ff9d806ffe0 2023-12-05T09:23:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.216+0000 7ff9bf7fe700 1 -- 172.21.15.67:0/3887122194 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9c8009540 con 0x7ff9d806ffe0 2023-12-05T09:23:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.216+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d810fec0 con 0x7ff9d806ffe0 2023-12-05T09:23:00.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.217+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d81065d0 con 0x7ff9d806ffe0 2023-12-05T09:23:00.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.218+0000 7ff9bf7fe700 1 -- 172.21.15.67:0/3887122194 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff9c80096a0 con 0x7ff9d806ffe0 2023-12-05T09:23:00.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.219+0000 7ff9bf7fe700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff9c0068f70 0x7ff9c006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:00.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.219+0000 7ff9bf7fe700 1 -- 172.21.15.67:0/3887122194 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff9c80867b0 con 0x7ff9d806ffe0 2023-12-05T09:23:00.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.219+0000 7ff9d67fc700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff9c0068f70 0x7ff9c006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:00.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.220+0000 7ff9d67fc700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff9c0068f70 0x7ff9c006b420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8110a00 tx=0x7ff9cc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:00.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.223+0000 7ff9bf7fe700 1 -- 172.21.15.67:0/3887122194 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff9c8056a50 con 0x7ff9d806ffe0 2023-12-05T09:23:00.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.378+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc7f010ebf0 con 0x7fc7f0102c00 2023-12-05T09:23:00.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.378+0000 7fc7ed7fa700 1 -- 172.21.15.67:0/1572277718 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7e4057b50 con 0x7fc7f0102c00 2023-12-05T09:23:00.379 INFO:teuthology.orchestra.run.smithi067.stdout:167503724551 2023-12-05T09:23:00.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:00 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/91805610' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-05T09:23:00.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc7e0068f70 msgr2=0x7fc7e006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:00.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc7e0068f70 0x7fc7e006b420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc7f010eeb0 tx=0x7fc7dc009ee0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 msgr2=0x7fc7f0113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:00.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 0x7fc7f0113610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009360 tx=0x7fc7e4009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:00.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 shutdown_connections 2023-12-05T09:23:00.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc7e0068f70 0x7fc7e006b420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc7f0102c00 0x7fc7f0113610 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 --2- 172.21.15.67:0/1572277718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01035a0 0x7fc7f0113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 >> 172.21.15.67:0/1572277718 conn(0x7fc7f00f8790 msgr2=0x7fc7f00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:00.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 shutdown_connections 2023-12-05T09:23:00.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.381+0000 7fc7f717a700 1 -- 172.21.15.67:0/1572277718 wait complete. 2023-12-05T09:23:00.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.439+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9d804bb80 con 0x7ff9d806ffe0 2023-12-05T09:23:00.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.440+0000 7ff9bf7fe700 1 -- 172.21.15.67:0/3887122194 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9c80565e0 con 0x7ff9d806ffe0 2023-12-05T09:23:00.441 INFO:teuthology.orchestra.run.smithi067.stdout:81604378645 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff9c0068f70 msgr2=0x7ff9c006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff9c0068f70 0x7ff9c006b420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8110a00 tx=0x7ff9cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d806ffe0 msgr2=0x7ff9d8115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d806ffe0 0x7ff9d8115810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8002a50 tx=0x7ff9c80046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 shutdown_connections 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff9c0068f70 0x7ff9c006b420 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d806ffe0 0x7ff9d8115810 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 --2- 172.21.15.67:0/3887122194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9d80708f0 0x7ff9d8115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 >> 172.21.15.67:0/3887122194 conn(0x7ff9d80f8790 msgr2=0x7ff9d8103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.442+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 shutdown_connections 2023-12-05T09:23:00.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:00.443+0000 7ff9dd3d8700 1 -- 172.21.15.67:0/3887122194 wait complete. 2023-12-05T09:23:00.940 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724550 got 167503724551 for osd.5 2023-12-05T09:23:00.940 DEBUG:teuthology.parallel:result is None 2023-12-05T09:23:01.184 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:01 smithi067 ceph-mon[107174]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:01.184 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:01 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1572277718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-05T09:23:01.184 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:01 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3887122194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-05T09:23:01.187 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542169 got 60129542170 for osd.1 2023-12-05T09:23:01.187 DEBUG:teuthology.parallel:result is None 2023-12-05T09:23:01.358 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378644 got 81604378645 for osd.2 2023-12-05T09:23:01.359 DEBUG:teuthology.parallel:result is None 2023-12-05T09:23:01.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:01 smithi134 ceph-mon[116304]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:01.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:01 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/1572277718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-05T09:23:01.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:01 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3887122194' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-05T09:23:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.706+0000 7f71eb59e700 1 -- 172.21.15.67:0/3292731946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 msgr2=0x7f71ec102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.706+0000 7f71eb59e700 1 --2- 172.21.15.67:0/3292731946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 0x7f71ec102e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f71dc004940 tx=0x7f71dc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.706+0000 7f71eb59e700 1 -- 172.21.15.67:0/3292731946 shutdown_connections 2023-12-05T09:23:01.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.706+0000 7f71eb59e700 1 --2- 172.21.15.67:0/3292731946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec0fca00 0x7f71ec0fce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:01.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.706+0000 7f71eb59e700 1 --2- 172.21.15.67:0/3292731946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 0x7f71ec102e10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:01.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.706+0000 7f71eb59e700 1 -- 172.21.15.67:0/3292731946 >> 172.21.15.67:0/3292731946 conn(0x7f71ec0f8560 msgr2=0x7f71ec0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:01.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.707+0000 7f71eb59e700 1 -- 172.21.15.67:0/3292731946 shutdown_connections 2023-12-05T09:23:01.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.707+0000 7f71eb59e700 1 -- 172.21.15.67:0/3292731946 wait complete. 2023-12-05T09:23:01.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.707+0000 7f71eb59e700 1 Processor -- start 2023-12-05T09:23:01.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71eb59e700 1 -- start start 2023-12-05T09:23:01.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71eb59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec0fca00 0x7f71ec06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:01.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71eb59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 0x7f71ec0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:01.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71eb59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec070af0 con 0x7f71ec102a40 2023-12-05T09:23:01.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71eb59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec070c60 con 0x7f71ec0fca00 2023-12-05T09:23:01.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71e9d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 0x7f71ec0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:01.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71e9d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 0x7f71ec0704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39346/0 (socket says 172.21.15.67:39346) 2023-12-05T09:23:01.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71e9d9b700 1 -- 172.21.15.67:0/3538087131 learned_addr learned my addr 172.21.15.67:0/3538087131 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:01.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.708+0000 7f71ea59c700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec0fca00 0x7f71ec06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:01.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71e9d9b700 1 -- 172.21.15.67:0/3538087131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec0fca00 msgr2=0x7f71ec06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:01.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71e9d9b700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec0fca00 0x7f71ec06ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:01.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71e9d9b700 1 -- 172.21.15.67:0/3538087131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc005040 con 0x7f71ec102a40 2023-12-05T09:23:01.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71e9d9b700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 0x7f71ec0704a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f71e0002a50 tx=0x7f71e00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:01.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71daffd700 1 -- 172.21.15.67:0/3538087131 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e0007cc0 con 0x7f71ec102a40 2023-12-05T09:23:01.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71daffd700 1 -- 172.21.15.67:0/3538087131 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71e000f040 con 0x7f71ec102a40 2023-12-05T09:23:01.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71daffd700 1 -- 172.21.15.67:0/3538087131 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e000d9c0 con 0x7f71ec102a40 2023-12-05T09:23:01.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec119620 con 0x7f71ec102a40 2023-12-05T09:23:01.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.709+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec119b60 con 0x7f71ec102a40 2023-12-05T09:23:01.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.710+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec104ec0 con 0x7f71ec102a40 2023-12-05T09:23:01.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.711+0000 7f71daffd700 1 -- 172.21.15.67:0/3538087131 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f71e000db20 con 0x7f71ec102a40 2023-12-05T09:23:01.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.712+0000 7f71daffd700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f71d4068f70 0x7f71d406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:01.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.712+0000 7f71daffd700 1 -- 172.21.15.67:0/3538087131 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f71e0086740 con 0x7f71ec102a40 2023-12-05T09:23:01.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.713+0000 7f71ea59c700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f71d4068f70 0x7f71d406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:01.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.713+0000 7f71ea59c700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f71d4068f70 0x7f71d406b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0043d0 tx=0x7f71dc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:01.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.717+0000 7f71daffd700 1 -- 172.21.15.67:0/3538087131 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f71e0052eb0 con 0x7f71ec102a40 2023-12-05T09:23:01.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.919+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f71ec04bc10 con 0x7f71ec102a40 2023-12-05T09:23:01.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.919+0000 7f71daffd700 1 -- 172.21.15.67:0/3538087131 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71e00564d0 con 0x7f71ec102a40 2023-12-05T09:23:01.920 INFO:teuthology.orchestra.run.smithi067.stdout:146028888077 2023-12-05T09:23:01.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f71d4068f70 msgr2=0x7f71d406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:01.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f71d4068f70 0x7f71d406b420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0043d0 tx=0x7f71dc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:01.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 msgr2=0x7f71ec0704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:01.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 0x7f71ec0704a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f71e0002a50 tx=0x7f71e00046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:01.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 shutdown_connections 2023-12-05T09:23:01.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f71d4068f70 0x7f71d406b420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:01.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71ec0fca00 0x7f71ec06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:01.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 --2- 172.21.15.67:0/3538087131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71ec102a40 0x7f71ec0704a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:01.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 >> 172.21.15.67:0/3538087131 conn(0x7f71ec0f8560 msgr2=0x7f71ec0fa050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:01.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 shutdown_connections 2023-12-05T09:23:01.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:01.922+0000 7f71eb59e700 1 -- 172.21.15.67:0/3538087131 wait complete. 2023-12-05T09:23:02.342 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:02 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3538087131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-05T09:23:02.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:02 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3538087131' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-05T09:23:02.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888076 got 146028888077 for osd.4 2023-12-05T09:23:02.366 DEBUG:teuthology.parallel:result is None 2023-12-05T09:23:02.366 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-05T09:23:02.367 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-05T09:23:02.801 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:03.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:03 smithi067 ceph-mon[107174]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:03.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:03 smithi134 ceph-mon[116304]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:04.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.109+0000 7fcbf4215700 1 -- 172.21.15.67:0/115174083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec103590 msgr2=0x7fcbec0fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:04.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.109+0000 7fcbf4215700 1 --2- 172.21.15.67:0/115174083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec103590 0x7fcbec0fcc00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc004940 tx=0x7fcbdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:04.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.110+0000 7fcbf4215700 1 -- 172.21.15.67:0/115174083 shutdown_connections 2023-12-05T09:23:04.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.110+0000 7fcbf4215700 1 --2- 172.21.15.67:0/115174083 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec103590 0x7fcbec0fcc00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:04.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.110+0000 7fcbf4215700 1 --2- 172.21.15.67:0/115174083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec102bf0 0x7fcbec102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:04.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.110+0000 7fcbf4215700 1 -- 172.21.15.67:0/115174083 >> 172.21.15.67:0/115174083 conn(0x7fcbec0f87a0 msgr2=0x7fcbec0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:04.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.110+0000 7fcbf4215700 1 -- 172.21.15.67:0/115174083 shutdown_connections 2023-12-05T09:23:04.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.110+0000 7fcbf4215700 1 -- 172.21.15.67:0/115174083 wait complete. 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.110+0000 7fcbf4215700 1 Processor -- start 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf4215700 1 -- start start 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf4215700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec102bf0 0x7fcbec1158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf4215700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec103590 0x7fcbec115e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf4215700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec1164e0 con 0x7fcbec102bf0 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf4215700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec10f780 con 0x7fcbec103590 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf1fb1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec102bf0 0x7fcbec1158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf1fb1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec102bf0 0x7fcbec1158c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39368/0 (socket says 172.21.15.67:39368) 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf1fb1700 1 -- 172.21.15.67:0/2786075047 learned_addr learned my addr 172.21.15.67:0/2786075047 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.111+0000 7fcbf17b0700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec103590 0x7fcbec115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbf1fb1700 1 -- 172.21.15.67:0/2786075047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec103590 msgr2=0x7fcbec115e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:04.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbf1fb1700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec103590 0x7fcbec115e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbf1fb1700 1 -- 172.21.15.67:0/2786075047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc005040 con 0x7fcbec102bf0 2023-12-05T09:23:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbf1fb1700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec102bf0 0x7fcbec1158c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800b790 tx=0x7fcbe8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbe27fc700 1 -- 172.21.15.67:0/2786075047 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe800f6f0 con 0x7fcbec102bf0 2023-12-05T09:23:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbe27fc700 1 -- 172.21.15.67:0/2786075047 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcbe800fd00 con 0x7fcbec102bf0 2023-12-05T09:23:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec10fa60 con 0x7fcbec102bf0 2023-12-05T09:23:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbe27fc700 1 -- 172.21.15.67:0/2786075047 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe80103a0 con 0x7fcbec102bf0 2023-12-05T09:23:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.112+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec10ff70 con 0x7fcbec102bf0 2023-12-05T09:23:04.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.114+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec0fc3a0 con 0x7fcbec102bf0 2023-12-05T09:23:04.115 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.114+0000 7fcbe27fc700 1 -- 172.21.15.67:0/2786075047 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcbe800f850 con 0x7fcbec102bf0 2023-12-05T09:23:04.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.116+0000 7fcbe27fc700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcbd8068f70 0x7fcbd806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:04.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.116+0000 7fcbe27fc700 1 -- 172.21.15.67:0/2786075047 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcbe8086840 con 0x7fcbec102bf0 2023-12-05T09:23:04.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.116+0000 7fcbf17b0700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcbd8068f70 0x7fcbd806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:04.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.117+0000 7fcbf17b0700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcbd8068f70 0x7fcbd806b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbec110ab0 tx=0x7fcbdc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:04.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.120+0000 7fcbe27fc700 1 -- 172.21.15.67:0/2786075047 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcbe8056ac0 con 0x7fcbec102bf0 2023-12-05T09:23:04.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.318+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbec110ea0 con 0x7fcbd8068f70 2023-12-05T09:23:04.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.319+0000 7fcbe27fc700 1 -- 172.21.15.67:0/2786075047 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24802 (secure 0 0 0) 0x7fcbec110ea0 con 0x7fcbd8068f70 2023-12-05T09:23:04.320 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcbd8068f70 msgr2=0x7fcbd806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcbd8068f70 0x7fcbd806b420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbec110ab0 tx=0x7fcbdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec102bf0 msgr2=0x7fcbec1158c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec102bf0 0x7fcbec1158c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800b790 tx=0x7fcbe8009250 comp rx=0 tx=0).stop 2023-12-05T09:23:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 shutdown_connections 2023-12-05T09:23:04.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcbd8068f70 0x7fcbd806b420 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:04.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcbec102bf0 0x7fcbec1158c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:04.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 --2- 172.21.15.67:0/2786075047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbec103590 0x7fcbec115e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:04.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 >> 172.21.15.67:0/2786075047 conn(0x7fcbec0f87a0 msgr2=0x7fcbec0fa060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:04.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 shutdown_connections 2023-12-05T09:23:04.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:04.322+0000 7fcbf4215700 1 -- 172.21.15.67:0/2786075047 wait complete. 2023-12-05T09:23:04.323 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-12-05T09:23:04.763 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-12-05T09:23:04.084326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2602074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001859"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-05T09:22:28.158909+0000","last_change":"2023-12-05T09:22:05.557584+0000","last_active":"2023-12-05T09:22:28.158909+0000","last_peered":"2023-12-05T09:22:28.158909+0000","last_clean":"2023-12-05T09:22:28.158909+0000","last_became_active":"2023-12-05T09:22:05.557136+0000","last_became_peered":"2023-12-05T09:22:05.557136+0000","last_unstale":"2023-12-05T09:22:28.158909+0000","last_undegraded":"2023-12-05T09:22:28.158909+0000","last_fullsized":"2023-12-05T09:22:28.158909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-05T09:21:25.003310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-05T09:21:25.003310+0000","last_clean_scrub_stamp":"2023-12-05T09:21:25.003310+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-06T17:31:14.860427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46500000000000002}]},{"osd":1,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.501}]},{"osd":2,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Dec 5 09:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.433},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 5 09:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40999999999999998,"15min":0.41099999999999998},"min":{"1min":0.27000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.318,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Tue Dec 5 09:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.379}]},{"osd":3,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.753},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.40500000000000003},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61899999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.309},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.433,"15min":0.42399999999999999},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.33500000000000002}]},{"osd":2,"last update":"Tue Dec 5 09:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Dec 5 09:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-05T09:23:04.764 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-05T09:23:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:05.432 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:05 smithi067 ceph-mon[107174]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:05.433 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:05 smithi067 ceph-mon[107174]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:23:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:05 smithi134 ceph-mon[116304]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:05.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:05 smithi134 ceph-mon[116304]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:23:06.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.556+0000 7f07e8491700 1 -- 172.21.15.67:0/192884400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e006ffe0 msgr2=0x7f07e00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:06.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.556+0000 7f07e8491700 1 --2- 172.21.15.67:0/192884400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e006ffe0 0x7f07e00703b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f07dc004970 tx=0x7f07dc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:06.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.556+0000 7f07e8491700 1 -- 172.21.15.67:0/192884400 shutdown_connections 2023-12-05T09:23:06.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.556+0000 7f07e8491700 1 --2- 172.21.15.67:0/192884400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07e00708f0 0x7f07e0108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:06.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.556+0000 7f07e8491700 1 --2- 172.21.15.67:0/192884400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e006ffe0 0x7f07e00703b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:06.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.556+0000 7f07e8491700 1 -- 172.21.15.67:0/192884400 >> 172.21.15.67:0/192884400 conn(0x7f07e00f8790 msgr2=0x7f07e00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:06.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.556+0000 7f07e8491700 1 -- 172.21.15.67:0/192884400 shutdown_connections 2023-12-05T09:23:06.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.556+0000 7f07e8491700 1 -- 172.21.15.67:0/192884400 wait complete. 2023-12-05T09:23:06.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.557+0000 7f07e8491700 1 Processor -- start 2023-12-05T09:23:06.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.557+0000 7f07e8491700 1 -- start start 2023-12-05T09:23:06.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e8491700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07e006ffe0 0x7f07e01157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:06.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e8491700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e00708f0 0x7f07e0115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:06.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e8491700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0116380 con 0x7f07e00708f0 2023-12-05T09:23:06.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e8491700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e010f6b0 con 0x7f07e006ffe0 2023-12-05T09:23:06.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e5a2c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e00708f0 0x7f07e0115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:06.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e5a2c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e00708f0 0x7f07e0115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54474/0 (socket says 172.21.15.67:54474) 2023-12-05T09:23:06.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e5a2c700 1 -- 172.21.15.67:0/2433096135 learned_addr learned my addr 172.21.15.67:0/2433096135 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:06.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e622d700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07e006ffe0 0x7f07e01157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e5a2c700 1 -- 172.21.15.67:0/2433096135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07e006ffe0 msgr2=0x7f07e01157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e5a2c700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07e006ffe0 0x7f07e01157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.558+0000 7f07e5a2c700 1 -- 172.21.15.67:0/2433096135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc005040 con 0x7f07e00708f0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.559+0000 7f07e5a2c700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e00708f0 0x7f07e0115d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07d0002a50 tx=0x7f07d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.559+0000 7f07d6ffd700 1 -- 172.21.15.67:0/2433096135 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d0007cc0 con 0x7f07e00708f0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.559+0000 7f07d6ffd700 1 -- 172.21.15.67:0/2433096135 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07d000f040 con 0x7f07e00708f0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.559+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e010f990 con 0x7f07e00708f0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.559+0000 7f07d6ffd700 1 -- 172.21.15.67:0/2433096135 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07d0009540 con 0x7f07e00708f0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.559+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e010fed0 con 0x7f07e00708f0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.560+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e01065d0 con 0x7f07e00708f0 2023-12-05T09:23:06.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.561+0000 7f07d6ffd700 1 -- 172.21.15.67:0/2433096135 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f07d00096a0 con 0x7f07e00708f0 2023-12-05T09:23:06.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.562+0000 7f07d6ffd700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f07cc068f70 0x7f07cc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:06.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.562+0000 7f07d6ffd700 1 -- 172.21.15.67:0/2433096135 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f07d0086820 con 0x7f07e00708f0 2023-12-05T09:23:06.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.562+0000 7f07e622d700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f07cc068f70 0x7f07cc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:06.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.563+0000 7f07e622d700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f07cc068f70 0x7f07cc06b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009fd0 tx=0x7f07dc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:06.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.567+0000 7f07d6ffd700 1 -- 172.21.15.67:0/2433096135 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f07d0056a20 con 0x7f07e00708f0 2023-12-05T09:23:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.769+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07e01154c0 con 0x7f07cc068f70 2023-12-05T09:23:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.770+0000 7f07d6ffd700 1 -- 172.21.15.67:0/2433096135 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24816 (secure 0 0 0) 0x7f07e01154c0 con 0x7f07cc068f70 2023-12-05T09:23:06.771 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.772+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f07cc068f70 msgr2=0x7f07cc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.772+0000 7f07e8491700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f07cc068f70 0x7f07cc06b420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009fd0 tx=0x7f07dc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.772+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e00708f0 msgr2=0x7f07e0115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.772+0000 7f07e8491700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e00708f0 0x7f07e0115d30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f07d0002a50 tx=0x7f07d00046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.773+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 shutdown_connections 2023-12-05T09:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.773+0000 7f07e8491700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f07cc068f70 0x7f07cc06b420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.773+0000 7f07e8491700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07e006ffe0 0x7f07e01157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.773+0000 7f07e8491700 1 --2- 172.21.15.67:0/2433096135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e00708f0 0x7f07e0115d30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.773+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 >> 172.21.15.67:0/2433096135 conn(0x7f07e00f8790 msgr2=0x7f07e0103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.773+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 shutdown_connections 2023-12-05T09:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:06.773+0000 7f07e8491700 1 -- 172.21.15.67:0/2433096135 wait complete. 2023-12-05T09:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-12-05T09:23:07.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:06 smithi067 ceph-mon[107174]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:07.249 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2023-12-05T09:23:06.084666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2602074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001928"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-05T09:22:28.158909+0000","last_change":"2023-12-05T09:22:05.557584+0000","last_active":"2023-12-05T09:22:28.158909+0000","last_peered":"2023-12-05T09:22:28.158909+0000","last_clean":"2023-12-05T09:22:28.158909+0000","last_became_active":"2023-12-05T09:22:05.557136+0000","last_became_peered":"2023-12-05T09:22:05.557136+0000","last_unstale":"2023-12-05T09:22:28.158909+0000","last_undegraded":"2023-12-05T09:22:28.158909+0000","last_fullsized":"2023-12-05T09:22:28.158909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-05T09:21:25.003310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-05T09:21:25.003310+0000","last_clean_scrub_stamp":"2023-12-05T09:21:25.003310+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-06T17:31:14.860427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":4,"up_from":34,"seq":146028888079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46500000000000002}]},{"osd":1,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.501}]},{"osd":2,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":138495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Dec 5 09:22:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.433},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 5 09:23:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40999999999999998,"15min":0.41099999999999998},"min":{"1min":0.27000000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.41299999999999998},"min":{"1min":0.318,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Tue Dec 5 09:22:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.379}]},{"osd":3,"last update":"Tue Dec 5 09:22:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.753},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":728863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 5 09:23:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40699999999999997,"15min":0.40500000000000003},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61899999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.309},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.433,"15min":0.42399999999999999},"min":{"1min":0.312,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.33500000000000002}]},{"osd":2,"last update":"Tue Dec 5 09:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Dec 5 09:22:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-05T09:23:07.250 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-05T09:23:07.250 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-05T09:23:07.250 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-05T09:23:07.250 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph health --format=json 2023-12-05T09:23:07.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:06 smithi134 ceph-mon[116304]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:07.683 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:08.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:07 smithi067 ceph-mon[107174]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:23:08.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:07 smithi134 ceph-mon[116304]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-05T09:23:08.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.963+0000 7f83aac20700 1 -- 172.21.15.67:0/2397008052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 msgr2=0x7f83a4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:08.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.963+0000 7f83aac20700 1 --2- 172.21.15.67:0/2397008052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 0x7f83a4102fd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8398004940 tx=0x7f8398009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:08.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.963+0000 7f83aac20700 1 -- 172.21.15.67:0/2397008052 shutdown_connections 2023-12-05T09:23:08.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.963+0000 7f83aac20700 1 --2- 172.21.15.67:0/2397008052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a41035a0 0x7f83a40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:08.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.963+0000 7f83aac20700 1 --2- 172.21.15.67:0/2397008052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 0x7f83a4102fd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:08.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.963+0000 7f83aac20700 1 -- 172.21.15.67:0/2397008052 >> 172.21.15.67:0/2397008052 conn(0x7f83a40f8790 msgr2=0x7f83a40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:08.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.963+0000 7f83aac20700 1 -- 172.21.15.67:0/2397008052 shutdown_connections 2023-12-05T09:23:08.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.963+0000 7f83aac20700 1 -- 172.21.15.67:0/2397008052 wait complete. 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.964+0000 7f83aac20700 1 Processor -- start 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.964+0000 7f83aac20700 1 -- start start 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.965+0000 7f83aac20700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 0x7f83a4115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.965+0000 7f83aac20700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a41035a0 0x7f83a4115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.965+0000 7f83aac20700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a41163e0 con 0x7f83a4102c00 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.965+0000 7f83aac20700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a410f710 con 0x7f83a41035a0 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.965+0000 7f83a89bc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 0x7f83a4115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.965+0000 7f83a89bc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 0x7f83a4115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54492/0 (socket says 172.21.15.67:54492) 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.965+0000 7f83a89bc700 1 -- 172.21.15.67:0/266052653 learned_addr learned my addr 172.21.15.67:0/266052653 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.965+0000 7f83a3fff700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a41035a0 0x7f83a4115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83a89bc700 1 -- 172.21.15.67:0/266052653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a41035a0 msgr2=0x7f83a4115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83a89bc700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a41035a0 0x7f83a4115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:08.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83a89bc700 1 -- 172.21.15.67:0/266052653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398005040 con 0x7f83a4102c00 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83a3fff700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a41035a0 0x7f83a4115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83a89bc700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 0x7f83a4115850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8398009fd0 tx=0x7f8398009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83a17fa700 1 -- 172.21.15.67:0/266052653 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f839800e040 con 0x7f83a4102c00 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83a17fa700 1 -- 172.21.15.67:0/266052653 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f839800bc50 con 0x7f83a4102c00 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a410f990 con 0x7f83a4102c00 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83a17fa700 1 -- 172.21.15.67:0/266052653 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8398013ea0 con 0x7f83a4102c00 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.966+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a410fed0 con 0x7f83a4102c00 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.967+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a40fc390 con 0x7f83a4102c00 2023-12-05T09:23:08.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.968+0000 7f83a17fa700 1 -- 172.21.15.67:0/266052653 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8398013420 con 0x7f83a4102c00 2023-12-05T09:23:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.969+0000 7f83a17fa700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8394068f70 0x7f839406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.970+0000 7f83a17fa700 1 -- 172.21.15.67:0/266052653 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8398088060 con 0x7f83a4102c00 2023-12-05T09:23:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.970+0000 7f83a3fff700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8394068f70 0x7f839406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:08.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.970+0000 7f83a3fff700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8394068f70 0x7f839406b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8390009fd0 tx=0x7f8390009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:08.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:08.974+0000 7f83a17fa700 1 -- 172.21.15.67:0/266052653 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f83980581e0 con 0x7f83a4102c00 2023-12-05T09:23:09.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.222+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f83a4110e30 con 0x7f83a4102c00 2023-12-05T09:23:09.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.222+0000 7f83a17fa700 1 -- 172.21.15.67:0/266052653 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8398057d70 con 0x7f83a4102c00 2023-12-05T09:23:09.224 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:09.224 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8394068f70 msgr2=0x7f839406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8394068f70 0x7f839406b420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8390009fd0 tx=0x7f8390009ee0 comp rx=0 tx=0).stop 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 msgr2=0x7f83a4115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 0x7f83a4115850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8398009fd0 tx=0x7f8398009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 shutdown_connections 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8394068f70 0x7f839406b420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f83a4102c00 0x7f83a4115850 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 --2- 172.21.15.67:0/266052653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a41035a0 0x7f83a4115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 >> 172.21.15.67:0/266052653 conn(0x7f83a40f8790 msgr2=0x7f83a40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 shutdown_connections 2023-12-05T09:23:09.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:09.224+0000 7f83aac20700 1 -- 172.21.15.67:0/266052653 wait complete. 2023-12-05T09:23:09.247 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:08 smithi067 ceph-mon[107174]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:09.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:08 smithi134 ceph-mon[116304]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:09.627 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-05T09:23:09.627 INFO:tasks.cephadm:Setup complete, yielding 2023-12-05T09:23:09.627 INFO:teuthology.run_tasks:Running task print... 2023-12-05T09:23:09.639 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-05T09:23:09.640 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:23:09.648 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:23:09.649 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-05T09:23:10.083 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:10.237 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:09 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/266052653' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-05T09:23:10.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:09 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/266052653' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-05T09:23:11.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:10 smithi067 ceph-mon[107174]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:11.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.369+0000 7f9f0c611700 1 -- 172.21.15.67:0/2843272248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 msgr2=0x7f9f040fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:11.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.369+0000 7f9f0c611700 1 --2- 172.21.15.67:0/2843272248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 0x7f9f040fe250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4004940 tx=0x7f9ef4009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.369+0000 7f9f0c611700 1 -- 172.21.15.67:0/2843272248 shutdown_connections 2023-12-05T09:23:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.369+0000 7f9f0c611700 1 --2- 172.21.15.67:0/2843272248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 0x7f9f040fe250 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.369+0000 7f9f0c611700 1 --2- 172.21.15.67:0/2843272248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f040fcbf0 0x7f9f040fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.369+0000 7f9f0c611700 1 -- 172.21.15.67:0/2843272248 >> 172.21.15.67:0/2843272248 conn(0x7f9f040f82d0 msgr2=0x7f9f040fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.369+0000 7f9f0c611700 1 -- 172.21.15.67:0/2843272248 shutdown_connections 2023-12-05T09:23:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.369+0000 7f9f0c611700 1 -- 172.21.15.67:0/2843272248 wait complete. 2023-12-05T09:23:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.370+0000 7f9f0c611700 1 Processor -- start 2023-12-05T09:23:11.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.370+0000 7f9f0c611700 1 -- start start 2023-12-05T09:23:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.371+0000 7f9f0c611700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f040fcbf0 0x7f9f0410d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.371+0000 7f9f0c611700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 0x7f9f0410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.371+0000 7f9f0c611700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0410e030 con 0x7f9f040fde00 2023-12-05T09:23:11.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.371+0000 7f9f0c611700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0410e8d0 con 0x7f9f040fcbf0 2023-12-05T09:23:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.371+0000 7f9f09bac700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 0x7f9f0410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.371+0000 7f9f09bac700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 0x7f9f0410da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54510/0 (socket says 172.21.15.67:54510) 2023-12-05T09:23:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.371+0000 7f9f09bac700 1 -- 172.21.15.67:0/1560314109 learned_addr learned my addr 172.21.15.67:0/1560314109 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.371+0000 7f9f0a3ad700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f040fcbf0 0x7f9f0410d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9f09bac700 1 -- 172.21.15.67:0/1560314109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f040fcbf0 msgr2=0x7f9f0410d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9f09bac700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f040fcbf0 0x7f9f0410d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9f09bac700 1 -- 172.21.15.67:0/1560314109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4005040 con 0x7f9f040fde00 2023-12-05T09:23:11.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9f09bac700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 0x7f9f0410da30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009fd0 tx=0x7f9ef4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9efaffd700 1 -- 172.21.15.67:0/1560314109 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef4021070 con 0x7f9f040fde00 2023-12-05T09:23:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9efaffd700 1 -- 172.21.15.67:0/1560314109 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ef401c400 con 0x7f9f040fde00 2023-12-05T09:23:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0410eb50 con 0x7f9f040fde00 2023-12-05T09:23:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9efaffd700 1 -- 172.21.15.67:0/1560314109 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef400e070 con 0x7f9f040fde00 2023-12-05T09:23:11.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.372+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0410f090 con 0x7f9f040fde00 2023-12-05T09:23:11.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.373+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0404bb80 con 0x7f9f040fde00 2023-12-05T09:23:11.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.374+0000 7f9efaffd700 1 -- 172.21.15.67:0/1560314109 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9ef401c570 con 0x7f9f040fde00 2023-12-05T09:23:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.376+0000 7f9efaffd700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9ef0068f70 0x7f9ef006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.376+0000 7f9efaffd700 1 -- 172.21.15.67:0/1560314109 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9ef4087cd0 con 0x7f9f040fde00 2023-12-05T09:23:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.376+0000 7f9f0a3ad700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9ef0068f70 0x7f9ef006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:11.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.376+0000 7f9f0a3ad700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9ef0068f70 0x7f9ef006b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009b80 tx=0x7f9f0000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:11.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:10 smithi134 ceph-mon[116304]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:11.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.380+0000 7f9efaffd700 1 -- 172.21.15.67:0/1560314109 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9ef4057f50 con 0x7f9f040fde00 2023-12-05T09:23:11.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.582+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f9f04105590 con 0x7f9f040fde00 2023-12-05T09:23:11.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.587+0000 7f9efaffd700 1 -- 172.21.15.67:0/1560314109 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f9ef4057ae0 con 0x7f9f040fde00 2023-12-05T09:23:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.589+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9ef0068f70 msgr2=0x7f9ef006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.589+0000 7f9f0c611700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9ef0068f70 0x7f9ef006b420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009b80 tx=0x7f9f0000b040 comp rx=0 tx=0).stop 2023-12-05T09:23:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.589+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 msgr2=0x7f9f0410da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.589+0000 7f9f0c611700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 0x7f9f0410da30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009fd0 tx=0x7f9ef4009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.590+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 shutdown_connections 2023-12-05T09:23:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.590+0000 7f9f0c611700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9ef0068f70 0x7f9ef006b420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.590+0000 7f9f0c611700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f040fcbf0 0x7f9f0410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.590+0000 7f9f0c611700 1 --2- 172.21.15.67:0/1560314109 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9f040fde00 0x7f9f0410da30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:11.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.590+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 >> 172.21.15.67:0/1560314109 conn(0x7f9f040f82d0 msgr2=0x7f9f04101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:11.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.590+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 shutdown_connections 2023-12-05T09:23:11.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:11.590+0000 7f9f0c611700 1 -- 172.21.15.67:0/1560314109 wait complete. 2023-12-05T09:23:12.017 INFO:teuthology.run_tasks:Running task print... 2023-12-05T09:23:12.027 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-05T09:23:12.027 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:23:12.064 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:23:12.064 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph orch status' 2023-12-05T09:23:12.353 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:11 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:23:12.353 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:11 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/1560314109' entity='client.admin' 2023-12-05T09:23:12.353 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:11 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:23:12.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:11 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:23:12.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:11 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1560314109' entity='client.admin' 2023-12-05T09:23:12.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:11 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:23:12.512 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:13.291 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:12 smithi067 ceph-mon[107174]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:13.292 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:12 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:13.292 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:12 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:23:13.292 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:12 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:13.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:12 smithi134 ceph-mon[116304]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:13.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:12 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:13.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:12 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:23:13.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:12 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.822+0000 7f8c44af5700 1 -- 172.21.15.67:0/1298242638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 msgr2=0x7f8c400fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.822+0000 7f8c44af5700 1 --2- 172.21.15.67:0/1298242638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 0x7f8c400fd000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c30004940 tx=0x7f8c30009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.823+0000 7f8c44af5700 1 -- 172.21.15.67:0/1298242638 shutdown_connections 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.823+0000 7f8c44af5700 1 --2- 172.21.15.67:0/1298242638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c400fde00 0x7f8c400fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.823+0000 7f8c44af5700 1 --2- 172.21.15.67:0/1298242638 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 0x7f8c400fd000 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.823+0000 7f8c44af5700 1 -- 172.21.15.67:0/1298242638 >> 172.21.15.67:0/1298242638 conn(0x7f8c400f82d0 msgr2=0x7f8c400fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.823+0000 7f8c44af5700 1 -- 172.21.15.67:0/1298242638 shutdown_connections 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.823+0000 7f8c44af5700 1 -- 172.21.15.67:0/1298242638 wait complete. 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.823+0000 7f8c44af5700 1 Processor -- start 2023-12-05T09:23:13.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c44af5700 1 -- start start 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c44af5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 0x7f8c4010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c44af5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c400fde00 0x7f8c4010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c44af5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4010e0a0 con 0x7f8c400fcbf0 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c44af5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4010e940 con 0x7f8c400fde00 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c3e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 0x7f8c4010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c3e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 0x7f8c4010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:54518/0 (socket says 172.21.15.67:54518) 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c3e59c700 1 -- 172.21.15.67:0/562875327 learned_addr learned my addr 172.21.15.67:0/562875327 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.824+0000 7f8c3dd9b700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c400fde00 0x7f8c4010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c3e59c700 1 -- 172.21.15.67:0/562875327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c400fde00 msgr2=0x7f8c4010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c3e59c700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c400fde00 0x7f8c4010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c3e59c700 1 -- 172.21.15.67:0/562875327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30005040 con 0x7f8c400fcbf0 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c3e59c700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 0x7f8c4010d560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c30000c00 tx=0x7f8c30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c2effd700 1 -- 172.21.15.67:0/562875327 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c3000e040 con 0x7f8c400fcbf0 2023-12-05T09:23:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c2effd700 1 -- 172.21.15.67:0/562875327 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c30013420 con 0x7f8c400fcbf0 2023-12-05T09:23:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c2effd700 1 -- 172.21.15.67:0/562875327 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c3001c630 con 0x7f8c400fcbf0 2023-12-05T09:23:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4010ebc0 con 0x7f8c400fcbf0 2023-12-05T09:23:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.825+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4010f100 con 0x7f8c400fcbf0 2023-12-05T09:23:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.826+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4004bb80 con 0x7f8c400fcbf0 2023-12-05T09:23:13.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.827+0000 7f8c2effd700 1 -- 172.21.15.67:0/562875327 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8c30013590 con 0x7f8c400fcbf0 2023-12-05T09:23:13.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.828+0000 7f8c2effd700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8c28068f70 0x7f8c2806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:13.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.828+0000 7f8c2effd700 1 -- 172.21.15.67:0/562875327 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8c30087bf0 con 0x7f8c400fcbf0 2023-12-05T09:23:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.828+0000 7f8c3dd9b700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8c28068f70 0x7f8c2806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:13.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.829+0000 7f8c3dd9b700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8c28068f70 0x7f8c2806b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c34007fd0 tx=0x7f8c34009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:13.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:13.834+0000 7f8c2effd700 1 -- 172.21.15.67:0/562875327 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8c30057f30 con 0x7f8c400fcbf0 2023-12-05T09:23:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.049+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c4004bb80 con 0x7f8c28068f70 2023-12-05T09:23:14.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.051+0000 7f8c2effd700 1 -- 172.21.15.67:0/562875327 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8c4004bb80 con 0x7f8c28068f70 2023-12-05T09:23:14.052 INFO:teuthology.orchestra.run.smithi067.stdout:Backend: cephadm 2023-12-05T09:23:14.052 INFO:teuthology.orchestra.run.smithi067.stdout:Available: Yes 2023-12-05T09:23:14.052 INFO:teuthology.orchestra.run.smithi067.stdout:Paused: No 2023-12-05T09:23:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8c28068f70 msgr2=0x7f8c2806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8c28068f70 0x7f8c2806b420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c34007fd0 tx=0x7f8c34009040 comp rx=0 tx=0).stop 2023-12-05T09:23:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 msgr2=0x7f8c4010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 0x7f8c4010d560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c30000c00 tx=0x7f8c30009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 shutdown_connections 2023-12-05T09:23:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8c28068f70 0x7f8c2806b420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c400fcbf0 0x7f8c4010d560 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 --2- 172.21.15.67:0/562875327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c400fde00 0x7f8c4010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 >> 172.21.15.67:0/562875327 conn(0x7f8c400f82d0 msgr2=0x7f8c40101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 shutdown_connections 2023-12-05T09:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:14.053+0000 7f8c44af5700 1 -- 172.21.15.67:0/562875327 wait complete. 2023-12-05T09:23:14.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-05T09:23:14.947 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:15.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:15 smithi067 ceph-mon[107174]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:15.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:15 smithi067 ceph-mon[107174]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:15.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:15 smithi134 ceph-mon[116304]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:15.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:15 smithi134 ceph-mon[116304]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:16.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.273+0000 7f86666a8700 1 -- 172.21.15.67:0/1502593721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 msgr2=0x7f86600709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:16.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.273+0000 7f86666a8700 1 --2- 172.21.15.67:0/1502593721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 0x7f86600709c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8654004940 tx=0x7f8654009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:16.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.273+0000 7f86666a8700 1 -- 172.21.15.67:0/1502593721 shutdown_connections 2023-12-05T09:23:16.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.273+0000 7f86666a8700 1 --2- 172.21.15.67:0/1502593721 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 0x7f86600709c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:16.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.273+0000 7f86666a8700 1 --2- 172.21.15.67:0/1502593721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8660071bc0 0x7f8660070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:16.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.273+0000 7f86666a8700 1 -- 172.21.15.67:0/1502593721 >> 172.21.15.67:0/1502593721 conn(0x7f86600f82d0 msgr2=0x7f86600fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:16.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.273+0000 7f86666a8700 1 -- 172.21.15.67:0/1502593721 shutdown_connections 2023-12-05T09:23:16.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.273+0000 7f86666a8700 1 -- 172.21.15.67:0/1502593721 wait complete. 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.274+0000 7f86666a8700 1 Processor -- start 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.274+0000 7f86666a8700 1 -- start start 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.274+0000 7f86666a8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 0x7f866010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.274+0000 7f86666a8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8660071bc0 0x7f866010fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.274+0000 7f86666a8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86601102e0 con 0x7f8660070570 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.274+0000 7f86666a8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660110b80 con 0x7f8660071bc0 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 0x7f866010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 0x7f866010f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58218/0 (socket says 172.21.15.67:58218) 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865ffff700 1 -- 172.21.15.67:0/2630822953 learned_addr learned my addr 172.21.15.67:0/2630822953 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865f7fe700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8660071bc0 0x7f866010fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865ffff700 1 -- 172.21.15.67:0/2630822953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8660071bc0 msgr2=0x7f866010fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865ffff700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8660071bc0 0x7f866010fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:16.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865ffff700 1 -- 172.21.15.67:0/2630822953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654005040 con 0x7f8660070570 2023-12-05T09:23:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865f7fe700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8660071bc0 0x7f866010fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:23:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865ffff700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 0x7f866010f7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8650002a50 tx=0x7f86500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865cff9700 1 -- 172.21.15.67:0/2630822953 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8650007cc0 con 0x7f8660070570 2023-12-05T09:23:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865cff9700 1 -- 172.21.15.67:0/2630822953 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f865000f040 con 0x7f8660070570 2023-12-05T09:23:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8660110e60 con 0x7f8660070570 2023-12-05T09:23:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.275+0000 7f865cff9700 1 -- 172.21.15.67:0/2630822953 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f865000da70 con 0x7f8660070570 2023-12-05T09:23:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.276+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86601113a0 con 0x7f8660070570 2023-12-05T09:23:16.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.277+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86601097e0 con 0x7f8660070570 2023-12-05T09:23:16.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.277+0000 7f865cff9700 1 -- 172.21.15.67:0/2630822953 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f865000dc10 con 0x7f8660070570 2023-12-05T09:23:16.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.279+0000 7f865cff9700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8648068f60 0x7f864806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:16.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.279+0000 7f865cff9700 1 -- 172.21.15.67:0/2630822953 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8650086250 con 0x7f8660070570 2023-12-05T09:23:16.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.279+0000 7f865f7fe700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8648068f60 0x7f864806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:16.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.279+0000 7f865f7fe700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8648068f60 0x7f864806b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f865400b3b0 tx=0x7f8654009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:16.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.283+0000 7f865cff9700 1 -- 172.21.15.67:0/2630822953 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f86500563d0 con 0x7f8660070570 2023-12-05T09:23:16.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.495+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8660111630 con 0x7f8648068f60 2023-12-05T09:23:16.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.504+0000 7f865cff9700 1 -- 172.21.15.67:0/2630822953 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f8660111630 con 0x7f8648068f60 2023-12-05T09:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (3m) 116s ago 4m 14.5M - 0.25.0 c8568f914cd2 705e76e175ab 2023-12-05T09:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (4m) 116s ago 4m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (3m) 51s ago 3m - - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (3m) 116s ago 4m 77.9M - 9.4.7 2c41d148cca3 110448c1bfef 2023-12-05T09:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:9283 running (5m) 116s ago 5m 491M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 01173e871e1b 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283 running (3m) 51s ago 3m - - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dc026bba702 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (5m) 116s ago 5m 56.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (3m) 51s ago 3m - 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (4m) 116s ago 4m 8619k - 1.5.0 0da6a335fe13 7d8553eb4b47 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 51s ago 3m - - 1.5.0 0da6a335fe13 2301b35d1166 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (2m) 116s ago 2m 40.1M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (2m) 116s ago 2m 39.9M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (2m) 116s ago 2m 11.9M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (99s) 51s ago 99s - 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (77s) 51s ago 77s - 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (55s) 51s ago 54s - 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (2m) 116s ago 4m 33.2M - 2.43.0 a07b618ecd1d a79077dfa046 2023-12-05T09:23:16.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8648068f60 msgr2=0x7f864806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8648068f60 0x7f864806b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f865400b3b0 tx=0x7f8654009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 msgr2=0x7f866010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 0x7f866010f7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8650002a50 tx=0x7f86500046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 shutdown_connections 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8648068f60 0x7f864806b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8660070570 0x7f866010f7a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 --2- 172.21.15.67:0/2630822953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8660071bc0 0x7f866010fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 >> 172.21.15.67:0/2630822953 conn(0x7f86600f82d0 msgr2=0x7f86600fa580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 shutdown_connections 2023-12-05T09:23:16.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:16.506+0000 7f86666a8700 1 -- 172.21.15.67:0/2630822953 wait complete. 2023-12-05T09:23:16.979 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-05T09:23:17.045 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:16 smithi067 ceph-mon[107174]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:17.045 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:16 smithi067 ceph-mon[107174]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:17.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:16 smithi134 ceph-mon[116304]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:17.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:16 smithi134 ceph-mon[116304]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:17.412 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.654+0000 7f89f99de700 1 -- 172.21.15.67:0/3724811678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4070570 msgr2=0x7f89f40709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.655+0000 7f89f99de700 1 --2- 172.21.15.67:0/3724811678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4070570 0x7f89f40709c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89e8004940 tx=0x7f89e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.655+0000 7f89f99de700 1 -- 172.21.15.67:0/3724811678 shutdown_connections 2023-12-05T09:23:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.655+0000 7f89f99de700 1 --2- 172.21.15.67:0/3724811678 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4070570 0x7f89f40709c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.655+0000 7f89f99de700 1 --2- 172.21.15.67:0/3724811678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4071bc0 0x7f89f4070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.655+0000 7f89f99de700 1 -- 172.21.15.67:0/3724811678 >> 172.21.15.67:0/3724811678 conn(0x7f89f40f82d0 msgr2=0x7f89f40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.655+0000 7f89f99de700 1 -- 172.21.15.67:0/3724811678 shutdown_connections 2023-12-05T09:23:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.655+0000 7f89f99de700 1 -- 172.21.15.67:0/3724811678 wait complete. 2023-12-05T09:23:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f99de700 1 Processor -- start 2023-12-05T09:23:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f99de700 1 -- start start 2023-12-05T09:23:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f99de700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4070570 0x7f89f410f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f99de700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4071bc0 0x7f89f410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f99de700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f41103a0 con 0x7f89f4071bc0 2023-12-05T09:23:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f99de700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f4110c40 con 0x7f89f4070570 2023-12-05T09:23:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f27fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4071bc0 0x7f89f410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f27fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4071bc0 0x7f89f410fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58236/0 (socket says 172.21.15.67:58236) 2023-12-05T09:23:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.656+0000 7f89f27fc700 1 -- 172.21.15.67:0/1630699905 learned_addr learned my addr 172.21.15.67:0/1630699905 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89f2ffd700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4070570 0x7f89f410f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89f27fc700 1 -- 172.21.15.67:0/1630699905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4070570 msgr2=0x7f89f410f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89f27fc700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4070570 0x7f89f410f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89f27fc700 1 -- 172.21.15.67:0/1630699905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8005040 con 0x7f89f4071bc0 2023-12-05T09:23:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89f2ffd700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4070570 0x7f89f410f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:23:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89f27fc700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4071bc0 0x7f89f410fda0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009fd0 tx=0x7f89e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:18.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89db7fe700 1 -- 172.21.15.67:0/1630699905 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89e800e040 con 0x7f89f4071bc0 2023-12-05T09:23:18.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89db7fe700 1 -- 172.21.15.67:0/1630699905 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89e8004290 con 0x7f89f4071bc0 2023-12-05T09:23:18.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f4110ec0 con 0x7f89f4071bc0 2023-12-05T09:23:18.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.657+0000 7f89db7fe700 1 -- 172.21.15.67:0/1630699905 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89e801c630 con 0x7f89f4071bc0 2023-12-05T09:23:18.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.658+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f4111400 con 0x7f89f4071bc0 2023-12-05T09:23:18.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.659+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f41096f0 con 0x7f89f4071bc0 2023-12-05T09:23:18.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.660+0000 7f89db7fe700 1 -- 172.21.15.67:0/1630699905 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f89e800bc70 con 0x7f89f4071bc0 2023-12-05T09:23:18.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.661+0000 7f89db7fe700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f89dc068f70 0x7f89dc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:18.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.661+0000 7f89db7fe700 1 -- 172.21.15.67:0/1630699905 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f89e8087f40 con 0x7f89f4071bc0 2023-12-05T09:23:18.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.661+0000 7f89f2ffd700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f89dc068f70 0x7f89dc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:18.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.661+0000 7f89f2ffd700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f89dc068f70 0x7f89dc06b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009fd0 tx=0x7f89e4009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:18.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.665+0000 7f89db7fe700 1 -- 172.21.15.67:0/1630699905 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f89e80b9a00 con 0x7f89f4071bc0 2023-12-05T09:23:18.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.875+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f89f4111620 con 0x7f89dc068f70 2023-12-05T09:23:18.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.879+0000 7f89db7fe700 1 -- 172.21.15.67:0/1630699905 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f89f4111620 con 0x7f89dc068f70 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager ?:9093,9094 1/1 118s ago 5m count:1 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:crash 2/2 118s ago 5m * 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:grafana ?:3000 1/1 118s ago 5m count:1 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:mgr 2/2 118s ago 5m count:2 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:mon 2/2 118s ago 4m smithi067:172.21.15.67=smithi067;smithi134:172.21.15.134=smithi134;count:2 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter ?:9100 2/2 118s ago 5m * 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:osd 6 118s ago - 2023-12-05T09:23:18.880 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus ?:9095 1/1 118s ago 5m count:1 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f89dc068f70 msgr2=0x7f89dc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f89dc068f70 0x7f89dc06b420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009fd0 tx=0x7f89e4009ee0 comp rx=0 tx=0).stop 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4071bc0 msgr2=0x7f89f410fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4071bc0 0x7f89f410fda0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009fd0 tx=0x7f89e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 shutdown_connections 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f89dc068f70 0x7f89dc06b420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4070570 0x7f89f410f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 --2- 172.21.15.67:0/1630699905 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89f4071bc0 0x7f89f410fda0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:18.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 >> 172.21.15.67:0/1630699905 conn(0x7f89f40f82d0 msgr2=0x7f89f4103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:18.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 shutdown_connections 2023-12-05T09:23:18.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:18.882+0000 7f89f99de700 1 -- 172.21.15.67:0/1630699905 wait complete. 2023-12-05T09:23:19.160 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:19 smithi067 ceph-mon[107174]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:19.341 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-05T09:23:19.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:19 smithi134 ceph-mon[116304]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:19.775 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:20.358 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:20 smithi067 ceph-mon[107174]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:20.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:20 smithi134 ceph-mon[116304]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:21.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.100+0000 7f28b3800700 1 -- 172.21.15.67:0/4069204758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 msgr2=0x7f28ac0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:21.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.100+0000 7f28b3800700 1 --2- 172.21.15.67:0/4069204758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 0x7f28ac0fe250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f289c004940 tx=0x7f289c009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:21.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.100+0000 7f28b3800700 1 -- 172.21.15.67:0/4069204758 shutdown_connections 2023-12-05T09:23:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.100+0000 7f28b3800700 1 --2- 172.21.15.67:0/4069204758 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 0x7f28ac0fe250 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.100+0000 7f28b3800700 1 --2- 172.21.15.67:0/4069204758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ac0fcbf0 0x7f28ac0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.100+0000 7f28b3800700 1 -- 172.21.15.67:0/4069204758 >> 172.21.15.67:0/4069204758 conn(0x7f28ac0f82d0 msgr2=0x7f28ac0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.101+0000 7f28b3800700 1 -- 172.21.15.67:0/4069204758 shutdown_connections 2023-12-05T09:23:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.101+0000 7f28b3800700 1 -- 172.21.15.67:0/4069204758 wait complete. 2023-12-05T09:23:21.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.101+0000 7f28b3800700 1 Processor -- start 2023-12-05T09:23:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b3800700 1 -- start start 2023-12-05T09:23:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b3800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ac0fcbf0 0x7f28ac10f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:21.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b3800700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 0x7f28ac10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b3800700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac110220 con 0x7f28ac0fde00 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b3800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac110ac0 con 0x7f28ac0fcbf0 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b0d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 0x7f28ac10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b0d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 0x7f28ac10fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58256/0 (socket says 172.21.15.67:58256) 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b0d9b700 1 -- 172.21.15.67:0/480458501 learned_addr learned my addr 172.21.15.67:0/480458501 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.102+0000 7f28b159c700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ac0fcbf0 0x7f28ac10f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28b0d9b700 1 -- 172.21.15.67:0/480458501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ac0fcbf0 msgr2=0x7f28ac10f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28b0d9b700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ac0fcbf0 0x7f28ac10f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28b0d9b700 1 -- 172.21.15.67:0/480458501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c005040 con 0x7f28ac0fde00 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28b0d9b700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 0x7f28ac10fc20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f289c009fd0 tx=0x7f289c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28a1ffb700 1 -- 172.21.15.67:0/480458501 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f289c021070 con 0x7f28ac0fde00 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28a1ffb700 1 -- 172.21.15.67:0/480458501 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f289c01c400 con 0x7f28ac0fde00 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac110d40 con 0x7f28ac0fde00 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28a1ffb700 1 -- 172.21.15.67:0/480458501 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f289c00e070 con 0x7f28ac0fde00 2023-12-05T09:23:21.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.103+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac111220 con 0x7f28ac0fde00 2023-12-05T09:23:21.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.104+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac101ea0 con 0x7f28ac0fde00 2023-12-05T09:23:21.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.105+0000 7f28a1ffb700 1 -- 172.21.15.67:0/480458501 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f289c01ca00 con 0x7f28ac0fde00 2023-12-05T09:23:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.106+0000 7f28a1ffb700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2898068f60 0x7f289806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.106+0000 7f28a1ffb700 1 -- 172.21.15.67:0/480458501 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f289c087cf0 con 0x7f28ac0fde00 2023-12-05T09:23:21.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.106+0000 7f28b159c700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2898068f60 0x7f289806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:21.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.107+0000 7f28b159c700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2898068f60 0x7f289806b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009b80 tx=0x7f28a800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:21.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.111+0000 7f28a1ffb700 1 -- 172.21.15.67:0/480458501 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f289c057ef0 con 0x7f28ac0fde00 2023-12-05T09:23:21.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.321+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f28ac02b150 con 0x7f2898068f60 2023-12-05T09:23:21.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.323+0000 7f28a1ffb700 1 -- 172.21.15.67:0/480458501 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f28ac02b150 con 0x7f2898068f60 2023-12-05T09:23:21.323 INFO:teuthology.orchestra.run.smithi067.stdout:HOST ADDR LABELS STATUS 2023-12-05T09:23:21.323 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067 172.21.15.67 2023-12-05T09:23:21.323 INFO:teuthology.orchestra.run.smithi067.stdout:smithi134 172.21.15.134 2023-12-05T09:23:21.323 INFO:teuthology.orchestra.run.smithi067.stdout:2 hosts in cluster 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2898068f60 msgr2=0x7f289806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2898068f60 0x7f289806b410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009b80 tx=0x7f28a800b040 comp rx=0 tx=0).stop 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 msgr2=0x7f28ac10fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 0x7f28ac10fc20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f289c009fd0 tx=0x7f289c009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 shutdown_connections 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f2898068f60 0x7f289806b410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28ac0fcbf0 0x7f28ac10f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 --2- 172.21.15.67:0/480458501 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f28ac0fde00 0x7f28ac10fc20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 >> 172.21.15.67:0/480458501 conn(0x7f28ac0f82d0 msgr2=0x7f28ac0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.325+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 shutdown_connections 2023-12-05T09:23:21.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:21.326+0000 7f28b3800700 1 -- 172.21.15.67:0/480458501 wait complete. 2023-12-05T09:23:21.521 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:21 smithi067 ceph-mon[107174]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:21.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:21 smithi134 ceph-mon[116304]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:21.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-05T09:23:22.133 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:22.450 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:22 smithi067 ceph-mon[107174]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:22.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:22 smithi134 ceph-mon[116304]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.341+0000 7f3b24b88700 1 -- 172.21.15.67:0/750678527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fcbf0 msgr2=0x7f3b200fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.341+0000 7f3b24b88700 1 --2- 172.21.15.67:0/750678527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fcbf0 0x7f3b200fd000 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3b10004940 tx=0x7f3b10009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.341+0000 7f3b24b88700 1 -- 172.21.15.67:0/750678527 shutdown_connections 2023-12-05T09:23:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.341+0000 7f3b24b88700 1 --2- 172.21.15.67:0/750678527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b200fde00 0x7f3b200fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.341+0000 7f3b24b88700 1 --2- 172.21.15.67:0/750678527 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fcbf0 0x7f3b200fd000 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.341+0000 7f3b24b88700 1 -- 172.21.15.67:0/750678527 >> 172.21.15.67:0/750678527 conn(0x7f3b200f82d0 msgr2=0x7f3b200fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:23.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.341+0000 7f3b24b88700 1 -- 172.21.15.67:0/750678527 shutdown_connections 2023-12-05T09:23:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.341+0000 7f3b24b88700 1 -- 172.21.15.67:0/750678527 wait complete. 2023-12-05T09:23:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b24b88700 1 Processor -- start 2023-12-05T09:23:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b24b88700 1 -- start start 2023-12-05T09:23:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b24b88700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b200fcbf0 0x7f3b2010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b24b88700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fde00 0x7f3b2010fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b24b88700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b201102e0 con 0x7f3b200fde00 2023-12-05T09:23:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b24b88700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20110b80 con 0x7f3b200fcbf0 2023-12-05T09:23:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b1dd9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fde00 0x7f3b2010fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b1dd9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fde00 0x7f3b2010fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58278/0 (socket says 172.21.15.67:58278) 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b1dd9b700 1 -- 172.21.15.67:0/3656466148 learned_addr learned my addr 172.21.15.67:0/3656466148 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.342+0000 7f3b1e59c700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b200fcbf0 0x7f3b2010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b1dd9b700 1 -- 172.21.15.67:0/3656466148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b200fcbf0 msgr2=0x7f3b2010f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b1dd9b700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b200fcbf0 0x7f3b2010f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b1dd9b700 1 -- 172.21.15.67:0/3656466148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b10005040 con 0x7f3b200fde00 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b1e59c700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b200fcbf0 0x7f3b2010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b1dd9b700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fde00 0x7f3b2010fce0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3b14002a50 tx=0x7f3b140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b0effd700 1 -- 172.21.15.67:0/3656466148 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b14007cc0 con 0x7f3b200fde00 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b0effd700 1 -- 172.21.15.67:0/3656466148 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b1400f040 con 0x7f3b200fde00 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b20110e60 con 0x7f3b200fde00 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b0effd700 1 -- 172.21.15.67:0/3656466148 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b1400da70 con 0x7f3b200fde00 2023-12-05T09:23:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.343+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b201113a0 con 0x7f3b200fde00 2023-12-05T09:23:23.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.344+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b20101ea0 con 0x7f3b200fde00 2023-12-05T09:23:23.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.345+0000 7f3b0effd700 1 -- 172.21.15.67:0/3656466148 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f3b1400dc10 con 0x7f3b200fde00 2023-12-05T09:23:23.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.346+0000 7f3b0effd700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3b08068f70 0x7f3b0806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:23.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.346+0000 7f3b0effd700 1 -- 172.21.15.67:0/3656466148 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3b14086250 con 0x7f3b200fde00 2023-12-05T09:23:23.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.347+0000 7f3b1e59c700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3b08068f70 0x7f3b0806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:23.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.347+0000 7f3b1e59c700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3b08068f70 0x7f3b0806b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b10004f90 tx=0x7f3b10009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:23.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.350+0000 7f3b0effd700 1 -- 172.21.15.67:0/3656466148 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3b140563d0 con 0x7f3b200fde00 2023-12-05T09:23:23.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.564+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b20111630 con 0x7f3b08068f70 2023-12-05T09:23:23.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.566+0000 7f3b0effd700 1 -- 172.21.15.67:0/3656466148 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f3b20111630 con 0x7f3b08068f70 2023-12-05T09:23:23.566 INFO:teuthology.orchestra.run.smithi067.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-05T09:23:23.566 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53440042400BGN 372G No 119s ago Has a FileSystem, LVM detected 2023-12-05T09:23:23.566 INFO:teuthology.orchestra.run.smithi067.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 55s ago Has a FileSystem, LVM detected 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3b08068f70 msgr2=0x7f3b0806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3b08068f70 0x7f3b0806b420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3b10004f90 tx=0x7f3b10009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fde00 msgr2=0x7f3b2010fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fde00 0x7f3b2010fce0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3b14002a50 tx=0x7f3b140046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 shutdown_connections 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f3b08068f70 0x7f3b0806b420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b200fcbf0 0x7f3b2010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 --2- 172.21.15.67:0/3656466148 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b200fde00 0x7f3b2010fce0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:23.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.568+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 >> 172.21.15.67:0/3656466148 conn(0x7f3b200f82d0 msgr2=0x7f3b200ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:23.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.569+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 shutdown_connections 2023-12-05T09:23:23.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:23.569+0000 7f3b24b88700 1 -- 172.21.15.67:0/3656466148 wait complete. 2023-12-05T09:23:23.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:23 smithi067 ceph-mon[107174]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:23.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:23 smithi134 ceph-mon[116304]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:23.997 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:23:24.008 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:23:24.008 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-05T09:23:24.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:24 smithi067 ceph-mon[107174]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:24.443 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:24.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:24 smithi134 ceph-mon[116304]: from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:25.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:25 smithi067 ceph-mon[107174]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:25.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:25 smithi134 ceph-mon[116304]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:25.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 -- 172.21.15.67:0/2911539078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 msgr2=0x7ffb000709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:25.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 --2- 172.21.15.67:0/2911539078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 0x7ffb000709c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4004940 tx=0x7ffaf4009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:25.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 -- 172.21.15.67:0/2911539078 shutdown_connections 2023-12-05T09:23:25.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 --2- 172.21.15.67:0/2911539078 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 0x7ffb000709c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:25.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 --2- 172.21.15.67:0/2911539078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb00071bc0 0x7ffb00070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:25.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 -- 172.21.15.67:0/2911539078 >> 172.21.15.67:0/2911539078 conn(0x7ffb000f82d0 msgr2=0x7ffb000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:25.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 -- 172.21.15.67:0/2911539078 shutdown_connections 2023-12-05T09:23:25.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 -- 172.21.15.67:0/2911539078 wait complete. 2023-12-05T09:23:25.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.750+0000 7ffb04aa4700 1 Processor -- start 2023-12-05T09:23:25.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.751+0000 7ffb04aa4700 1 -- start start 2023-12-05T09:23:25.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.751+0000 7ffb04aa4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 0x7ffb0010f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:25.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.751+0000 7ffb04aa4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb00071bc0 0x7ffb0010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:25.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.751+0000 7ffb04aa4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb001103a0 con 0x7ffb00070570 2023-12-05T09:23:25.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.751+0000 7ffb04aa4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb00110c40 con 0x7ffb00071bc0 2023-12-05T09:23:25.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.751+0000 7ffafe59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 0x7ffb0010f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:25.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.751+0000 7ffafe59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 0x7ffb0010f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:58300/0 (socket says 172.21.15.67:58300) 2023-12-05T09:23:25.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.751+0000 7ffafe59c700 1 -- 172.21.15.67:0/1678344688 learned_addr learned my addr 172.21.15.67:0/1678344688 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:25.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffafdd9b700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb00071bc0 0x7ffb0010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:25.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffafe59c700 1 -- 172.21.15.67:0/1678344688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb00071bc0 msgr2=0x7ffb0010fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:25.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffafe59c700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb00071bc0 0x7ffb0010fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:25.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffafe59c700 1 -- 172.21.15.67:0/1678344688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4005040 con 0x7ffb00070570 2023-12-05T09:23:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffafe59c700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 0x7ffb0010f860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0002a50 tx=0x7ffaf00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffaeeffd700 1 -- 172.21.15.67:0/1678344688 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf0007cc0 con 0x7ffb00070570 2023-12-05T09:23:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffaeeffd700 1 -- 172.21.15.67:0/1678344688 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffaf000f040 con 0x7ffb00070570 2023-12-05T09:23:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb00110f20 con 0x7ffb00070570 2023-12-05T09:23:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffaeeffd700 1 -- 172.21.15.67:0/1678344688 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf0009540 con 0x7ffb00070570 2023-12-05T09:23:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.752+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb00111460 con 0x7ffb00070570 2023-12-05T09:23:25.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.753+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb001096f0 con 0x7ffb00070570 2023-12-05T09:23:25.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.754+0000 7ffaeeffd700 1 -- 172.21.15.67:0/1678344688 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ffaf00096a0 con 0x7ffb00070570 2023-12-05T09:23:25.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.755+0000 7ffaeeffd700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffae8068f70 0x7ffae806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:25.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.755+0000 7ffaeeffd700 1 -- 172.21.15.67:0/1678344688 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffaf0086820 con 0x7ffb00070570 2023-12-05T09:23:25.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.755+0000 7ffafdd9b700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffae8068f70 0x7ffae806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:25.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.756+0000 7ffafdd9b700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffae8068f70 0x7ffae806b420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400b3b0 tx=0x7ffaf4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:25.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.759+0000 7ffaeeffd700 1 -- 172.21.15.67:0/1678344688 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffaf0056a20 con 0x7ffb00070570 2023-12-05T09:23:25.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:25.992+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb001116d0 con 0x7ffae8068f70 2023-12-05T09:23:27.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:26 smithi067 ceph-mon[107174]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:27.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-05T09:23:27.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:26 smithi067 ceph-mon[107174]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:27.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:23:27.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:26 smithi134 ceph-mon[116304]: from='client.14474 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:23:27.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-05T09:23:27.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:26 smithi134 ceph-mon[116304]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:27.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:23:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.024+0000 7ffaeeffd700 1 -- 172.21.15.67:0/1678344688 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ffb001116d0 con 0x7ffae8068f70 2023-12-05T09:23:28.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.026+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffae8068f70 msgr2=0x7ffae806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:28.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.026+0000 7ffb04aa4700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffae8068f70 0x7ffae806b420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400b3b0 tx=0x7ffaf4009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.026+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 msgr2=0x7ffb0010f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.026+0000 7ffb04aa4700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 0x7ffb0010f860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0002a50 tx=0x7ffaf00046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.027+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 shutdown_connections 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.027+0000 7ffb04aa4700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ffae8068f70 0x7ffae806b420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.027+0000 7ffb04aa4700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffb00070570 0x7ffb0010f860 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.027+0000 7ffb04aa4700 1 --2- 172.21.15.67:0/1678344688 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb00071bc0 0x7ffb0010fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.027+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 >> 172.21.15.67:0/1678344688 conn(0x7ffb000f82d0 msgr2=0x7ffb00103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.027+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 shutdown_connections 2023-12-05T09:23:28.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:28.027+0000 7ffb04aa4700 1 -- 172.21.15.67:0/1678344688 wait complete. 2023-12-05T09:23:28.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:27 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-05T09:23:28.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:27 smithi067 ceph-mon[107174]: osdmap e41: 6 total, 6 up, 6 in 2023-12-05T09:23:28.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:27 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-05T09:23:28.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067[107151]: 2023-12-05T09:23:27.999+0000 7f6d9bed1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T09:23:28.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:27 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-05T09:23:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:27 smithi134 ceph-mon[116304]: osdmap e41: 6 total, 6 up, 6 in 2023-12-05T09:23:28.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:27 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-05T09:23:28.489 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: osdmap e42: 6 total, 6 up, 6 in 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: osdmap e43: 6 total, 6 up, 6 in 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: fsmap cephfs:0 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: Saving service mds.cephfs spec with placement count:4 2023-12-05T09:23:29.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.kyspon", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.kyspon", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: Deploying daemon mds.cephfs.smithi067.kyspon on smithi067 2023-12-05T09:23:29.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:28 smithi067 ceph-mon[107174]: pgmap v152: 65 pgs: 7 creating+peering, 1 active+clean, 57 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: osdmap e42: 6 total, 6 up, 6 in 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: osdmap e43: 6 total, 6 up, 6 in 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: fsmap cephfs:0 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: Saving service mds.cephfs spec with placement count:4 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:23:29.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:29.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:23:29.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:29.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.kyspon", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:23:29.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.kyspon", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:23:29.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:29.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: Deploying daemon mds.cephfs.smithi067.kyspon on smithi067 2023-12-05T09:23:29.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:28 smithi134 ceph-mon[116304]: pgmap v152: 65 pgs: 7 creating+peering, 1 active+clean, 57 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:29.480 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:30.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:30 smithi067 ceph-mon[107174]: osdmap e44: 6 total, 6 up, 6 in 2023-12-05T09:23:30.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:30 smithi134 ceph-mon[116304]: osdmap e44: 6 total, 6 up, 6 in 2023-12-05T09:23:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.218+0000 7f0263c1d700 1 -- 172.21.15.67:0/3331727325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 msgr2=0x7f025c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.218+0000 7f0263c1d700 1 --2- 172.21.15.67:0/3331727325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 0x7f025c0fd000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0258004940 tx=0x7f0258009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.218+0000 7f0263c1d700 1 -- 172.21.15.67:0/3331727325 shutdown_connections 2023-12-05T09:23:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.218+0000 7f0263c1d700 1 --2- 172.21.15.67:0/3331727325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0fde00 0x7f025c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.218+0000 7f0263c1d700 1 --2- 172.21.15.67:0/3331727325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 0x7f025c0fd000 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.218+0000 7f0263c1d700 1 -- 172.21.15.67:0/3331727325 >> 172.21.15.67:0/3331727325 conn(0x7f025c0f82d0 msgr2=0x7f025c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:31.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.218+0000 7f0263c1d700 1 -- 172.21.15.67:0/3331727325 shutdown_connections 2023-12-05T09:23:31.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.218+0000 7f0263c1d700 1 -- 172.21.15.67:0/3331727325 wait complete. 2023-12-05T09:23:31.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.219+0000 7f0263c1d700 1 Processor -- start 2023-12-05T09:23:31.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.219+0000 7f0263c1d700 1 -- start start 2023-12-05T09:23:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.219+0000 7f0263c1d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 0x7f025c10f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.219+0000 7f0263c1d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0fde00 0x7f025c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.219+0000 7f0263c1d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c110200 con 0x7f025c0fcbf0 2023-12-05T09:23:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.219+0000 7f0263c1d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c110aa0 con 0x7f025c0fde00 2023-12-05T09:23:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.220+0000 7f02619b9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 0x7f025c10f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:31.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.220+0000 7f02619b9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 0x7f025c10f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41128/0 (socket says 172.21.15.67:41128) 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.220+0000 7f02619b9700 1 -- 172.21.15.67:0/3400291102 learned_addr learned my addr 172.21.15.67:0/3400291102 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.220+0000 7f02611b8700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0fde00 0x7f025c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.220+0000 7f02619b9700 1 -- 172.21.15.67:0/3400291102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0fde00 msgr2=0x7f025c10fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.220+0000 7f02619b9700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0fde00 0x7f025c10fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.220+0000 7f02619b9700 1 -- 172.21.15.67:0/3400291102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258005040 con 0x7f025c0fcbf0 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.221+0000 7f02619b9700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 0x7f025c10f6c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0258000c00 tx=0x7f0258009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.221+0000 7f02527fc700 1 -- 172.21.15.67:0/3400291102 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0258021070 con 0x7f025c0fcbf0 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.221+0000 7f02527fc700 1 -- 172.21.15.67:0/3400291102 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f025801c400 con 0x7f025c0fcbf0 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.221+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c110d20 con 0x7f025c0fcbf0 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.221+0000 7f02527fc700 1 -- 172.21.15.67:0/3400291102 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025800e070 con 0x7f025c0fcbf0 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.221+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c111200 con 0x7f025c0fcbf0 2023-12-05T09:23:31.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.222+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c101ea0 con 0x7f025c0fcbf0 2023-12-05T09:23:31.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.223+0000 7f02527fc700 1 -- 172.21.15.67:0/3400291102 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f025801ca00 con 0x7f025c0fcbf0 2023-12-05T09:23:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.225+0000 7f02527fc700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0248068f60 0x7f024806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.225+0000 7f02527fc700 1 -- 172.21.15.67:0/3400291102 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0258087f70 con 0x7f025c0fcbf0 2023-12-05T09:23:31.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.225+0000 7f02611b8700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0248068f60 0x7f024806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:31.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.226+0000 7f02611b8700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0248068f60 0x7f024806b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f024c009b80 tx=0x7f024c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:31.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.230+0000 7f02527fc700 1 -- 172.21.15.67:0/3400291102 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0258057eb0 con 0x7f025c0fcbf0 2023-12-05T09:23:31.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:31 smithi067 ceph-mon[107174]: osdmap e45: 6 total, 6 up, 6 in 2023-12-05T09:23:31.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:31 smithi067 ceph-mon[107174]: pgmap v155: 65 pgs: 36 active+clean, 1 creating+activating, 17 creating+peering, 11 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:31.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:31 smithi134 ceph-mon[116304]: osdmap e45: 6 total, 6 up, 6 in 2023-12-05T09:23:31.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:31 smithi134 ceph-mon[116304]: pgmap v155: 65 pgs: 36 active+clean, 1 creating+activating, 17 creating+peering, 11 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:31.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.478+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f025c111530 con 0x7f025c0fcbf0 2023-12-05T09:23:31.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.479+0000 7f02527fc700 1 -- 172.21.15.67:0/3400291102 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f0258057a40 con 0x7f025c0fcbf0 2023-12-05T09:23:31.479 INFO:teuthology.orchestra.run.smithi067.stdout:e2 2023-12-05T09:23:31.479 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:23:31.479 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:23:31.479 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 2 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:23:28.000546+0000 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 0 2023-12-05T09:23:31.480 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 1 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:in 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:up {} 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 0 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:31.481 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:31.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0248068f60 msgr2=0x7f024806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:31.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0248068f60 0x7f024806b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f024c009b80 tx=0x7f024c00b040 comp rx=0 tx=0).stop 2023-12-05T09:23:31.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 msgr2=0x7f025c10f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:31.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 0x7f025c10f6c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0258000c00 tx=0x7f0258009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 shutdown_connections 2023-12-05T09:23:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0248068f60 0x7f024806b410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f025c0fcbf0 0x7f025c10f6c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 --2- 172.21.15.67:0/3400291102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f025c0fde00 0x7f025c10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 >> 172.21.15.67:0/3400291102 conn(0x7f025c0f82d0 msgr2=0x7f025c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 shutdown_connections 2023-12-05T09:23:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:31.481+0000 7f0263c1d700 1 -- 172.21.15.67:0/3400291102 wait complete. 2023-12-05T09:23:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2023-12-05T09:23:31.871 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:23:31.884 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:23:31.884 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-12-05T09:23:32.329 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vvbmln", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vvbmln", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: Deploying daemon mds.cephfs.smithi134.vvbmln on smithi134 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3400291102' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] up:boot 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: daemon mds.cephfs.smithi067.kyspon assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-05T09:23:32.354 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-05T09:23:32.355 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-05T09:23:32.355 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: Cluster is now healthy 2023-12-05T09:23:32.355 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: fsmap cephfs:0 1 up:standby 2023-12-05T09:23:32.355 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.kyspon"}]: dispatch 2023-12-05T09:23:32.355 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: fsmap cephfs:1 {0=cephfs.smithi067.kyspon=up:creating} 2023-12-05T09:23:32.355 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:32 smithi134 ceph-mon[116304]: daemon mds.cephfs.smithi067.kyspon is now active in filesystem cephfs as rank 0 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vvbmln", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vvbmln", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: Deploying daemon mds.cephfs.smithi134.vvbmln on smithi134 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3400291102' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] up:boot 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: daemon mds.cephfs.smithi067.kyspon assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-05T09:23:32.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: Cluster is now healthy 2023-12-05T09:23:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: fsmap cephfs:0 1 up:standby 2023-12-05T09:23:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.kyspon"}]: dispatch 2023-12-05T09:23:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: fsmap cephfs:1 {0=cephfs.smithi067.kyspon=up:creating} 2023-12-05T09:23:32.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:32 smithi067 ceph-mon[107174]: daemon mds.cephfs.smithi067.kyspon is now active in filesystem cephfs as rank 0 2023-12-05T09:23:33.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:33 smithi067 ceph-mon[107174]: pgmap v156: 65 pgs: 42 active+clean, 1 creating+activating, 17 creating+peering, 5 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:33.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:33 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] up:active 2023-12-05T09:23:33.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:33 smithi067 ceph-mon[107174]: fsmap cephfs:1 {0=cephfs.smithi067.kyspon=up:active} 2023-12-05T09:23:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:33 smithi134 ceph-mon[116304]: pgmap v156: 65 pgs: 42 active+clean, 1 creating+activating, 17 creating+peering, 5 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:23:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:33 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] up:active 2023-12-05T09:23:33.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:33 smithi134 ceph-mon[116304]: fsmap cephfs:1 {0=cephfs.smithi067.kyspon=up:active} 2023-12-05T09:23:33.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.659+0000 7f04b8366700 1 -- 172.21.15.67:0/4251557883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 msgr2=0x7f04b00709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:33.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.659+0000 7f04b8366700 1 --2- 172.21.15.67:0/4251557883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 0x7f04b00709c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f04a0004940 tx=0x7f04a0009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:33.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.659+0000 7f04b8366700 1 -- 172.21.15.67:0/4251557883 shutdown_connections 2023-12-05T09:23:33.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.659+0000 7f04b8366700 1 --2- 172.21.15.67:0/4251557883 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 0x7f04b00709c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:33.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.659+0000 7f04b8366700 1 --2- 172.21.15.67:0/4251557883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0071bc0 0x7f04b0070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:33.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.659+0000 7f04b8366700 1 -- 172.21.15.67:0/4251557883 >> 172.21.15.67:0/4251557883 conn(0x7f04b00f82d0 msgr2=0x7f04b00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:33.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.659+0000 7f04b8366700 1 -- 172.21.15.67:0/4251557883 shutdown_connections 2023-12-05T09:23:33.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.659+0000 7f04b8366700 1 -- 172.21.15.67:0/4251557883 wait complete. 2023-12-05T09:23:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.660+0000 7f04b8366700 1 Processor -- start 2023-12-05T09:23:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.660+0000 7f04b8366700 1 -- start start 2023-12-05T09:23:33.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.660+0000 7f04b8366700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 0x7f04b010f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.660+0000 7f04b8366700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0071bc0 0x7f04b010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.660+0000 7f04b8366700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01103a0 con 0x7f04b0070570 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.660+0000 7f04b8366700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0110c40 con 0x7f04b0071bc0 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.661+0000 7f04b6102700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 0x7f04b010f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.661+0000 7f04b6102700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 0x7f04b010f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41142/0 (socket says 172.21.15.67:41142) 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.661+0000 7f04b6102700 1 -- 172.21.15.67:0/3658001829 learned_addr learned my addr 172.21.15.67:0/3658001829 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.661+0000 7f04b5901700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0071bc0 0x7f04b010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.661+0000 7f04b6102700 1 -- 172.21.15.67:0/3658001829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0071bc0 msgr2=0x7f04b010fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.661+0000 7f04b6102700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0071bc0 0x7f04b010fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.661+0000 7f04b6102700 1 -- 172.21.15.67:0/3658001829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0005040 con 0x7f04b0070570 2023-12-05T09:23:33.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.661+0000 7f04b6102700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 0x7f04b010f860 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c8c0 tx=0x7f04ac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:33.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.662+0000 7f04a6ffd700 1 -- 172.21.15.67:0/3658001829 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04ac00a760 con 0x7f04b0070570 2023-12-05T09:23:33.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.662+0000 7f04a6ffd700 1 -- 172.21.15.67:0/3658001829 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04ac00ad70 con 0x7f04b0070570 2023-12-05T09:23:33.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.662+0000 7f04a6ffd700 1 -- 172.21.15.67:0/3658001829 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04ac0113a0 con 0x7f04b0070570 2023-12-05T09:23:33.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.662+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b0110f20 con 0x7f04b0070570 2023-12-05T09:23:33.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.662+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b0111460 con 0x7f04b0070570 2023-12-05T09:23:33.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.663+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b01096f0 con 0x7f04b0070570 2023-12-05T09:23:33.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.664+0000 7f04a6ffd700 1 -- 172.21.15.67:0/3658001829 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f04ac012400 con 0x7f04b0070570 2023-12-05T09:23:33.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.666+0000 7f04a6ffd700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f049c068f70 0x7f049c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:33.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.666+0000 7f04a6ffd700 1 -- 172.21.15.67:0/3658001829 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f04ac086dd0 con 0x7f04b0070570 2023-12-05T09:23:33.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.666+0000 7f04b5901700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f049c068f70 0x7f049c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:33.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.667+0000 7f04b5901700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f049c068f70 0x7f049c06b420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009fd0 tx=0x7f04a0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:33.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.670+0000 7f04a6ffd700 1 -- 172.21.15.67:0/3658001829 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f04ac056d10 con 0x7f04b0070570 2023-12-05T09:23:33.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:33.921+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f04b0107780 con 0x7f04b0070570 2023-12-05T09:23:34.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.099+0000 7f04a6ffd700 1 -- 172.21.15.67:0/3658001829 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f04ac0568a0 con 0x7f04b0070570 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f049c068f70 msgr2=0x7f049c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f049c068f70 0x7f049c06b420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009fd0 tx=0x7f04a0009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 msgr2=0x7f04b010f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 0x7f04b010f860 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c8c0 tx=0x7f04ac0044c0 comp rx=0 tx=0).stop 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 shutdown_connections 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f049c068f70 0x7f049c06b420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04b0070570 0x7f04b010f860 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 --2- 172.21.15.67:0/3658001829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b0071bc0 0x7f04b010fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 >> 172.21.15.67:0/3658001829 conn(0x7f04b00f82d0 msgr2=0x7f04b0103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 shutdown_connections 2023-12-05T09:23:34.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:34.102+0000 7f04b8366700 1 -- 172.21.15.67:0/3658001829 wait complete. 2023-12-05T09:23:34.795 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.qaibsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.qaibsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: Deploying daemon mds.cephfs.smithi067.qaibsa on smithi067 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3658001829' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.134:6824/3151035948,v1:172.21.15.134:6825/3151035948] up:boot 2023-12-05T09:23:34.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3658001829' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-05T09:23:34.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: daemon mds.cephfs.smithi134.vvbmln assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-05T09:23:34.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-05T09:23:34.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-05T09:23:34.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: fsmap cephfs:1 {0=cephfs.smithi067.kyspon=up:active} 1 up:standby 2023-12-05T09:23:34.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:23:34.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:creating} 2023-12-05T09:23:34.797 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:34 smithi067 ceph-mon[107174]: daemon mds.cephfs.smithi134.vvbmln is now active in filesystem cephfs as rank 1 2023-12-05T09:23:34.819 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:23:34.829 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:23:34.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2023-12-05T09:23:34.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:34.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.qaibsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.qaibsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: Deploying daemon mds.cephfs.smithi067.qaibsa on smithi067 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3658001829' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.134:6824/3151035948,v1:172.21.15.134:6825/3151035948] up:boot 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3658001829' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: daemon mds.cephfs.smithi134.vvbmln assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: fsmap cephfs:1 {0=cephfs.smithi067.kyspon=up:active} 1 up:standby 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:creating} 2023-12-05T09:23:34.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:34 smithi134 ceph-mon[116304]: daemon mds.cephfs.smithi134.vvbmln is now active in filesystem cephfs as rank 1 2023-12-05T09:23:35.336 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:35.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:35 smithi067 ceph-mon[107174]: pgmap v157: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2023-12-05T09:23:35.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:35 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.134:6824/3151035948,v1:172.21.15.134:6825/3151035948] up:active 2023-12-05T09:23:35.668 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:35 smithi067 ceph-mon[107174]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:active} 2023-12-05T09:23:35.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:35 smithi134 ceph-mon[116304]: pgmap v157: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2023-12-05T09:23:35.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:35 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.134:6824/3151035948,v1:172.21.15.134:6825/3151035948] up:active 2023-12-05T09:23:35.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:35 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:active} 2023-12-05T09:23:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.811+0000 7fb4527e2700 1 -- 172.21.15.67:0/1002543082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fde00 msgr2=0x7fb44c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.811+0000 7fb4527e2700 1 --2- 172.21.15.67:0/1002543082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fde00 0x7fb44c0fe250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb440004940 tx=0x7fb440009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.811+0000 7fb4527e2700 1 -- 172.21.15.67:0/1002543082 shutdown_connections 2023-12-05T09:23:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.811+0000 7fb4527e2700 1 --2- 172.21.15.67:0/1002543082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fde00 0x7fb44c0fe250 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.811+0000 7fb4527e2700 1 --2- 172.21.15.67:0/1002543082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb44c0fcbf0 0x7fb44c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:36.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.811+0000 7fb4527e2700 1 -- 172.21.15.67:0/1002543082 >> 172.21.15.67:0/1002543082 conn(0x7fb44c0f82d0 msgr2=0x7fb44c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:36.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.811+0000 7fb4527e2700 1 -- 172.21.15.67:0/1002543082 shutdown_connections 2023-12-05T09:23:36.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.811+0000 7fb4527e2700 1 -- 172.21.15.67:0/1002543082 wait complete. 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb4527e2700 1 Processor -- start 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb4527e2700 1 -- start start 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb4527e2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fcbf0 0x7fb44c10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb4527e2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb44c0fde00 0x7fb44c10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb4527e2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c10e030 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb4527e2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c10e8d0 con 0x7fb44c0fde00 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb44bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fcbf0 0x7fb44c10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb44bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fcbf0 0x7fb44c10d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56100/0 (socket says 172.21.15.67:56100) 2023-12-05T09:23:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb44bfff700 1 -- 172.21.15.67:0/3626162972 learned_addr learned my addr 172.21.15.67:0/3626162972 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.812+0000 7fb44b7fe700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb44c0fde00 0x7fb44c10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb44bfff700 1 -- 172.21.15.67:0/3626162972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb44c0fde00 msgr2=0x7fb44c10da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb44bfff700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb44c0fde00 0x7fb44c10da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb44bfff700 1 -- 172.21.15.67:0/3626162972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440005040 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb44bfff700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fcbf0 0x7fb44c10d4f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00eb70 tx=0x7fb43c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb448ff9700 1 -- 172.21.15.67:0/3626162972 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43c007cc0 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb448ff9700 1 -- 172.21.15.67:0/3626162972 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb43c00f040 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c10eb50 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb448ff9700 1 -- 172.21.15.67:0/3626162972 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43c00c9d0 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.813+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c10f090 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.814+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c04bb80 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.815+0000 7fb448ff9700 1 -- 172.21.15.67:0/3626162972 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb43c00cb30 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.818+0000 7fb448ff9700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb434068f60 0x7fb43406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.818+0000 7fb448ff9700 1 -- 172.21.15.67:0/3626162972 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb43c086850 con 0x7fb44c0fcbf0 2023-12-05T09:23:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.818+0000 7fb44b7fe700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb434068f60 0x7fb43406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.818+0000 7fb44b7fe700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb434068f60 0x7fb43406b410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb440013600 tx=0x7fb440009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:36.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:36.822+0000 7fb448ff9700 1 -- 172.21.15.67:0/3626162972 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb43c04da00 con 0x7fb44c0fcbf0 2023-12-05T09:23:37.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.075+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb44c105590 con 0x7fb44c0fcbf0 2023-12-05T09:23:37.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:36 smithi067 ceph-mon[107174]: pgmap v158: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 6 op/s 2023-12-05T09:23:37.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:37.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:37.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:37.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vmnpaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:23:37.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vmnpaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:23:37.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:36 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:37.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:36 smithi134 ceph-mon[116304]: pgmap v158: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 6 op/s 2023-12-05T09:23:37.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:37.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:37.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:37.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vmnpaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:23:37.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vmnpaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-05T09:23:37.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:36 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.988+0000 7fb448ff9700 1 -- 172.21.15.67:0/3626162972 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb43c0567c0 con 0x7fb44c0fcbf0 2023-12-05T09:23:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.991+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb434068f60 msgr2=0x7fb43406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.991+0000 7fb4527e2700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb434068f60 0x7fb43406b410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb440013600 tx=0x7fb440009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.991+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fcbf0 msgr2=0x7fb44c10d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.991+0000 7fb4527e2700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fcbf0 0x7fb44c10d4f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00eb70 tx=0x7fb43c00b040 comp rx=0 tx=0).stop 2023-12-05T09:23:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.992+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 shutdown_connections 2023-12-05T09:23:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.992+0000 7fb4527e2700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb434068f60 0x7fb43406b410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.992+0000 7fb4527e2700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb44c0fcbf0 0x7fb44c10d4f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.992+0000 7fb4527e2700 1 --2- 172.21.15.67:0/3626162972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb44c0fde00 0x7fb44c10da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.992+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 >> 172.21.15.67:0/3626162972 conn(0x7fb44c0f82d0 msgr2=0x7fb44c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.992+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 shutdown_connections 2023-12-05T09:23:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:37.992+0000 7fb4527e2700 1 -- 172.21.15.67:0/3626162972 wait complete. 2023-12-05T09:23:38.244 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:37 smithi067 ceph-mon[107174]: Deploying daemon mds.cephfs.smithi134.vmnpaq on smithi134 2023-12-05T09:23:38.244 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:37 smithi067 ceph-mon[107174]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-05T09:23:38.244 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:37 smithi067 ceph-mon[107174]: Cluster is now healthy 2023-12-05T09:23:38.244 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:37 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:boot 2023-12-05T09:23:38.244 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:37 smithi067 ceph-mon[107174]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:active} 1 up:standby 2023-12-05T09:23:38.245 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:37 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.qaibsa"}]: dispatch 2023-12-05T09:23:38.245 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:37 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3626162972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-05T09:23:38.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:37 smithi134 ceph-mon[116304]: Deploying daemon mds.cephfs.smithi134.vmnpaq on smithi134 2023-12-05T09:23:38.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:37 smithi134 ceph-mon[116304]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-05T09:23:38.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:37 smithi134 ceph-mon[116304]: Cluster is now healthy 2023-12-05T09:23:38.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:37 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:boot 2023-12-05T09:23:38.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:37 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:active} 1 up:standby 2023-12-05T09:23:38.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:37 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.qaibsa"}]: dispatch 2023-12-05T09:23:38.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:37 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3626162972' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2023-12-05T09:23:38.453 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:23:38.464 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:23:38.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2023-12-05T09:23:38.905 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:39.274 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:38 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3626162972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-05T09:23:39.274 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:38 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:active} 1 up:standby 2023-12-05T09:23:39.274 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:38 smithi134 ceph-mon[116304]: pgmap v159: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s wr, 6 op/s 2023-12-05T09:23:39.361 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:38 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3626162972' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2023-12-05T09:23:39.361 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:38 smithi067 ceph-mon[107174]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:active} 1 up:standby 2023-12-05T09:23:39.361 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:38 smithi067 ceph-mon[107174]: pgmap v159: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s wr, 6 op/s 2023-12-05T09:23:40.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.175+0000 7fe3f72bd700 1 -- 172.21.15.67:0/1875666353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 msgr2=0x7fe3f00709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:40.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.175+0000 7fe3f72bd700 1 --2- 172.21.15.67:0/1875666353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 0x7fe3f00709c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0004940 tx=0x7fe3e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:40.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.175+0000 7fe3f72bd700 1 -- 172.21.15.67:0/1875666353 shutdown_connections 2023-12-05T09:23:40.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.175+0000 7fe3f72bd700 1 --2- 172.21.15.67:0/1875666353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 0x7fe3f00709c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:40.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.175+0000 7fe3f72bd700 1 --2- 172.21.15.67:0/1875666353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f0071bc0 0x7fe3f0070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:40.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.175+0000 7fe3f72bd700 1 -- 172.21.15.67:0/1875666353 >> 172.21.15.67:0/1875666353 conn(0x7fe3f00f82d0 msgr2=0x7fe3f00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:40.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.175+0000 7fe3f72bd700 1 -- 172.21.15.67:0/1875666353 shutdown_connections 2023-12-05T09:23:40.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.175+0000 7fe3f72bd700 1 -- 172.21.15.67:0/1875666353 wait complete. 2023-12-05T09:23:40.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.176+0000 7fe3f72bd700 1 Processor -- start 2023-12-05T09:23:40.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f72bd700 1 -- start start 2023-12-05T09:23:40.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f72bd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 0x7fe3f010f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:40.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f72bd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f0071bc0 0x7fe3f010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:40.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f72bd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01103a0 con 0x7fe3f0070570 2023-12-05T09:23:40.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f72bd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f0110c40 con 0x7fe3f0071bc0 2023-12-05T09:23:40.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f5059700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 0x7fe3f010f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:40.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f5059700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 0x7fe3f010f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56128/0 (socket says 172.21.15.67:56128) 2023-12-05T09:23:40.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f5059700 1 -- 172.21.15.67:0/2865449692 learned_addr learned my addr 172.21.15.67:0/2865449692 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:40.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.177+0000 7fe3f4858700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f0071bc0 0x7fe3f010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:40.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.178+0000 7fe3f5059700 1 -- 172.21.15.67:0/2865449692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f0071bc0 msgr2=0x7fe3f010fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:40.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.178+0000 7fe3f5059700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f0071bc0 0x7fe3f010fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:40.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.178+0000 7fe3f5059700 1 -- 172.21.15.67:0/2865449692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0005040 con 0x7fe3f0070570 2023-12-05T09:23:40.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.178+0000 7fe3f5059700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 0x7fe3f010f860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00eb40 tx=0x7fe3ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:40.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.178+0000 7fe3e5ffb700 1 -- 172.21.15.67:0/2865449692 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3ec007cc0 con 0x7fe3f0070570 2023-12-05T09:23:40.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.178+0000 7fe3e5ffb700 1 -- 172.21.15.67:0/2865449692 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe3ec00f040 con 0x7fe3f0070570 2023-12-05T09:23:40.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.178+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f0110ec0 con 0x7fe3f0070570 2023-12-05T09:23:40.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.178+0000 7fe3e5ffb700 1 -- 172.21.15.67:0/2865449692 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3ec00c990 con 0x7fe3f0070570 2023-12-05T09:23:40.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.179+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f0111400 con 0x7fe3f0070570 2023-12-05T09:23:40.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.180+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f01096f0 con 0x7fe3f0070570 2023-12-05T09:23:40.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.181+0000 7fe3e5ffb700 1 -- 172.21.15.67:0/2865449692 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe3ec00caf0 con 0x7fe3f0070570 2023-12-05T09:23:40.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.181+0000 7fe3e5ffb700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe3dc068f70 0x7fe3dc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:40.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.182+0000 7fe3e5ffb700 1 -- 172.21.15.67:0/2865449692 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe3ec086970 con 0x7fe3f0070570 2023-12-05T09:23:40.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.182+0000 7fe3f4858700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe3dc068f70 0x7fe3dc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:40.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.183+0000 7fe3f4858700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe3dc068f70 0x7fe3dc06b420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000b0d0 tx=0x7fe3e0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:40.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.186+0000 7fe3e5ffb700 1 -- 172.21.15.67:0/2865449692 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe3ec04da00 con 0x7fe3f0070570 2023-12-05T09:23:40.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.454+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7fe3f004bb80 con 0x7fe3f0070570 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] up:boot 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:active} 2 up:standby 2023-12-05T09:23:40.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:40 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vmnpaq"}]: dispatch 2023-12-05T09:23:40.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:40.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:23:40.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] up:boot 2023-12-05T09:23:40.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi134.vvbmln=up:active} 2 up:standby 2023-12-05T09:23:40.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:40 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vmnpaq"}]: dispatch 2023-12-05T09:23:40.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.984+0000 7fe3e5ffb700 1 -- 172.21.15.67:0/2865449692 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe3ec0568e0 con 0x7fe3f0070570 2023-12-05T09:23:40.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe3dc068f70 msgr2=0x7fe3dc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:40.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe3dc068f70 0x7fe3dc06b420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000b0d0 tx=0x7fe3e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:40.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 msgr2=0x7fe3f010f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:40.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 0x7fe3f010f860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00eb40 tx=0x7fe3ec00b040 comp rx=0 tx=0).stop 2023-12-05T09:23:40.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 shutdown_connections 2023-12-05T09:23:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe3dc068f70 0x7fe3dc06b420 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3f0070570 0x7fe3f010f860 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 --2- 172.21.15.67:0/2865449692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe3f0071bc0 0x7fe3f010fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 >> 172.21.15.67:0/2865449692 conn(0x7fe3f00f82d0 msgr2=0x7fe3f0103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 shutdown_connections 2023-12-05T09:23:40.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:40.988+0000 7fe3f72bd700 1 -- 172.21.15.67:0/2865449692 wait complete. 2023-12-05T09:23:40.990 INFO:teuthology.orchestra.run.smithi067.stderr:inline data disabled 2023-12-05T09:23:41.413 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-05T09:23:41.425 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:23:41.425 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: pgmap v160: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2865449692' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: Dropping low affinity active daemon mds.cephfs.smithi134.vvbmln in favor of higher affinity standby. 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: Replacing daemon mds.cephfs.smithi134.vvbmln as rank 1 with standby daemon mds.cephfs.smithi067.qaibsa 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: osdmap e46: 6 total, 6 up, 6 in 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] up:active 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2865449692' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:standby 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: fsmap cephfs:2/2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:replay} 1 up:standby 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:23:41.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:41.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: pgmap v160: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-05T09:23:41.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2865449692' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: Dropping low affinity active daemon mds.cephfs.smithi134.vvbmln in favor of higher affinity standby. 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: Replacing daemon mds.cephfs.smithi134.vvbmln as rank 1 with standby daemon mds.cephfs.smithi067.qaibsa 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: osdmap e46: 6 total, 6 up, 6 in 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] up:active 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2865449692' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:standby 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: fsmap cephfs:2/2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:replay} 1 up:standby 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:23:41.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:42.150 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:43.086 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:42 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:43.086 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:42 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:43.086 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:42 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:resolve 2023-12-05T09:23:43.087 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:42 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] up:boot 2023-12-05T09:23:43.087 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:42 smithi067 ceph-mon[107174]: fsmap cephfs:2/2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:resolve} 2 up:standby 2023-12-05T09:23:43.087 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:42 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:23:43.087 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:42 smithi067 ceph-mon[107174]: pgmap v162: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-05T09:23:43.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:42 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:43.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:42 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:43.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:42 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:resolve 2023-12-05T09:23:43.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:42 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] up:boot 2023-12-05T09:23:43.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:42 smithi134 ceph-mon[116304]: fsmap cephfs:2/2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:resolve} 2 up:standby 2023-12-05T09:23:43.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:42 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:23:43.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:42 smithi134 ceph-mon[116304]: pgmap v162: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2023-12-05T09:23:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.793+0000 7faa3221a700 1 -- 172.21.15.67:0/1866682198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 msgr2=0x7faa2c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.793+0000 7faa3221a700 1 --2- 172.21.15.67:0/1866682198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 0x7faa2c102430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faa20004940 tx=0x7faa20009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.793+0000 7faa3221a700 1 -- 172.21.15.67:0/1866682198 shutdown_connections 2023-12-05T09:23:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.793+0000 7faa3221a700 1 --2- 172.21.15.67:0/1866682198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 0x7faa2c102430 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.793+0000 7faa3221a700 1 --2- 172.21.15.67:0/1866682198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa2c0fd730 0x7faa2c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.793+0000 7faa3221a700 1 -- 172.21.15.67:0/1866682198 >> 172.21.15.67:0/1866682198 conn(0x7faa2c0f7190 msgr2=0x7faa2c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.793+0000 7faa3221a700 1 -- 172.21.15.67:0/1866682198 shutdown_connections 2023-12-05T09:23:43.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.794+0000 7faa3221a700 1 -- 172.21.15.67:0/1866682198 wait complete. 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.794+0000 7faa3221a700 1 Processor -- start 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa3221a700 1 -- start start 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa3221a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa2c0fd730 0x7faa2c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa3221a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 0x7faa2c0fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa3221a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c0fbc40 con 0x7faa2c100050 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa3221a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c0fbdb0 con 0x7faa2c0fd730 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa2affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 0x7faa2c0fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa2affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 0x7faa2c0fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56144/0 (socket says 172.21.15.67:56144) 2023-12-05T09:23:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa2affd700 1 -- 172.21.15.67:0/2020135243 learned_addr learned my addr 172.21.15.67:0/2020135243 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:43.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.795+0000 7faa2b7fe700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa2c0fd730 0x7faa2c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:43.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa2affd700 1 -- 172.21.15.67:0/2020135243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa2c0fd730 msgr2=0x7faa2c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:43.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa2affd700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa2c0fd730 0x7faa2c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa2affd700 1 -- 172.21.15.67:0/2020135243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20005040 con 0x7faa2c100050 2023-12-05T09:23:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa2affd700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 0x7faa2c0fb640 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa20009fd0 tx=0x7faa20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa13fff700 1 -- 172.21.15.67:0/2020135243 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa2000e040 con 0x7faa2c100050 2023-12-05T09:23:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa13fff700 1 -- 172.21.15.67:0/2020135243 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa20004290 con 0x7faa2c100050 2023-12-05T09:23:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c0fc030 con 0x7faa2c100050 2023-12-05T09:23:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa13fff700 1 -- 172.21.15.67:0/2020135243 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa2001c3f0 con 0x7faa2c100050 2023-12-05T09:23:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.796+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c115560 con 0x7faa2c100050 2023-12-05T09:23:43.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.797+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2c1075c0 con 0x7faa2c100050 2023-12-05T09:23:43.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.798+0000 7faa13fff700 1 -- 172.21.15.67:0/2020135243 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7faa2000bc50 con 0x7faa2c100050 2023-12-05T09:23:43.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.799+0000 7faa13fff700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7faa14068f70 0x7faa1406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:43.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.799+0000 7faa13fff700 1 -- 172.21.15.67:0/2020135243 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faa20088090 con 0x7faa2c100050 2023-12-05T09:23:43.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.800+0000 7faa2b7fe700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7faa14068f70 0x7faa1406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:43.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.800+0000 7faa2b7fe700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7faa14068f70 0x7faa1406b420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0fcf50 tx=0x7faa1c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:43.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:43.808+0000 7faa13fff700 1 -- 172.21.15.67:0/2020135243 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faa20058040 con 0x7faa2c100050 2023-12-05T09:23:44.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.071+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faa2c04bb80 con 0x7faa2c100050 2023-12-05T09:23:44.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.072+0000 7faa13fff700 1 -- 172.21.15.67:0/2020135243 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1820 (secure 0 0 0) 0x7faa20057bd0 con 0x7faa2c100050 2023-12-05T09:23:44.072 INFO:teuthology.orchestra.run.smithi067.stdout:e15 2023-12-05T09:23:44.072 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 15 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:23:43.995853+0000 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:23:44.073 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:23:44.074 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:rejoin seq 5 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:23:44.075 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7faa14068f70 msgr2=0x7faa1406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7faa14068f70 0x7faa1406b420 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0fcf50 tx=0x7faa1c00b040 comp rx=0 tx=0).stop 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 msgr2=0x7faa2c0fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 0x7faa2c0fb640 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa20009fd0 tx=0x7faa20009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 shutdown_connections 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7faa14068f70 0x7faa1406b420 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa2c0fd730 0x7faa2c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 --2- 172.21.15.67:0/2020135243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faa2c100050 0x7faa2c0fb640 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.074+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 >> 172.21.15.67:0/2020135243 conn(0x7faa2c0f7190 msgr2=0x7faa2c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.075+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 shutdown_connections 2023-12-05T09:23:44.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:44.075+0000 7faa3221a700 1 -- 172.21.15.67:0/2020135243 wait complete. 2023-12-05T09:23:44.077 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 15 2023-12-05T09:23:44.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:43 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:reconnect 2023-12-05T09:23:44.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:43 smithi067 ceph-mon[107174]: fsmap cephfs:2/2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:reconnect} 2 up:standby 2023-12-05T09:23:44.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:43 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:reconnect 2023-12-05T09:23:44.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:43 smithi134 ceph-mon[116304]: fsmap cephfs:2/2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:reconnect} 2 up:standby 2023-12-05T09:23:44.801 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-05T09:23:45.283 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:45.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:rejoin 2023-12-05T09:23:45.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] up:standby 2023-12-05T09:23:45.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: fsmap cephfs:2/2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:rejoin} 2 up:standby 2023-12-05T09:23:45.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: daemon mds.cephfs.smithi067.qaibsa is now active in filesystem cephfs as rank 1 2023-12-05T09:23:45.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2020135243' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:23:45.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: pgmap v163: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1.2 KiB/s wr, 5 op/s 2023-12-05T09:23:45.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:45.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:45.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:45.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:23:45.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:45 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:45.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:rejoin 2023-12-05T09:23:45.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] up:standby 2023-12-05T09:23:45.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: fsmap cephfs:2/2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:rejoin} 2 up:standby 2023-12-05T09:23:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: daemon mds.cephfs.smithi067.qaibsa is now active in filesystem cephfs as rank 1 2023-12-05T09:23:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2020135243' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:23:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: pgmap v163: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1.2 KiB/s wr, 5 op/s 2023-12-05T09:23:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:23:45.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:45 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:46.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:46 smithi067 ceph-mon[107174]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-05T09:23:46.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:46 smithi067 ceph-mon[107174]: Cluster is now healthy 2023-12-05T09:23:46.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:46 smithi067 ceph-mon[107174]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:active 2023-12-05T09:23:46.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:46 smithi067 ceph-mon[107174]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:23:46.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:46 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:23:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:46 smithi134 ceph-mon[116304]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-05T09:23:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:46 smithi134 ceph-mon[116304]: Cluster is now healthy 2023-12-05T09:23:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:46 smithi134 ceph-mon[116304]: mds.? [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] up:active 2023-12-05T09:23:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:46 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:23:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:46 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:23:46.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.712+0000 7fb2a42fd700 1 -- 172.21.15.67:0/1548947939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fcbf0 msgr2=0x7fb29c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:46.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.712+0000 7fb2a42fd700 1 --2- 172.21.15.67:0/1548947939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fcbf0 0x7fb29c0fd000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb298004940 tx=0x7fb298009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:46.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.712+0000 7fb2a42fd700 1 -- 172.21.15.67:0/1548947939 shutdown_connections 2023-12-05T09:23:46.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.712+0000 7fb2a42fd700 1 --2- 172.21.15.67:0/1548947939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb29c0fde00 0x7fb29c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:46.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.712+0000 7fb2a42fd700 1 --2- 172.21.15.67:0/1548947939 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fcbf0 0x7fb29c0fd000 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:46.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.712+0000 7fb2a42fd700 1 -- 172.21.15.67:0/1548947939 >> 172.21.15.67:0/1548947939 conn(0x7fb29c0f82d0 msgr2=0x7fb29c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:46.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.712+0000 7fb2a42fd700 1 -- 172.21.15.67:0/1548947939 shutdown_connections 2023-12-05T09:23:46.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.712+0000 7fb2a42fd700 1 -- 172.21.15.67:0/1548947939 wait complete. 2023-12-05T09:23:46.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.713+0000 7fb2a42fd700 1 Processor -- start 2023-12-05T09:23:46.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.713+0000 7fb2a42fd700 1 -- start start 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a42fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb29c0fcbf0 0x7fb29c10f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a42fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fde00 0x7fb29c10fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a42fd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1102a0 con 0x7fb29c0fde00 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a42fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c110b40 con 0x7fb29c0fcbf0 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a1898700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fde00 0x7fb29c10fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a1898700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fde00 0x7fb29c10fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39040/0 (socket says 172.21.15.67:39040) 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a1898700 1 -- 172.21.15.67:0/61484256 learned_addr learned my addr 172.21.15.67:0/61484256 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a2099700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb29c0fcbf0 0x7fb29c10f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a1898700 1 -- 172.21.15.67:0/61484256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb29c0fcbf0 msgr2=0x7fb29c10f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a1898700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb29c0fcbf0 0x7fb29c10f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.714+0000 7fb2a1898700 1 -- 172.21.15.67:0/61484256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298005040 con 0x7fb29c0fde00 2023-12-05T09:23:46.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.715+0000 7fb2a1898700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fde00 0x7fb29c10fca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb28c002a50 tx=0x7fb28c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:46.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.715+0000 7fb292ffd700 1 -- 172.21.15.67:0/61484256 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb28c007cc0 con 0x7fb29c0fde00 2023-12-05T09:23:46.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.715+0000 7fb292ffd700 1 -- 172.21.15.67:0/61484256 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb28c00f040 con 0x7fb29c0fde00 2023-12-05T09:23:46.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.715+0000 7fb292ffd700 1 -- 172.21.15.67:0/61484256 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb28c00d9c0 con 0x7fb29c0fde00 2023-12-05T09:23:46.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.715+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c110e20 con 0x7fb29c0fde00 2023-12-05T09:23:46.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.715+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c111360 con 0x7fb29c0fde00 2023-12-05T09:23:46.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.716+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c101ea0 con 0x7fb29c0fde00 2023-12-05T09:23:46.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.717+0000 7fb292ffd700 1 -- 172.21.15.67:0/61484256 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb28c00db20 con 0x7fb29c0fde00 2023-12-05T09:23:46.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.718+0000 7fb292ffd700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb288068f70 0x7fb28806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:46.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.718+0000 7fb292ffd700 1 -- 172.21.15.67:0/61484256 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb28c086ad0 con 0x7fb29c0fde00 2023-12-05T09:23:46.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.718+0000 7fb2a2099700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb288068f70 0x7fb28806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:46.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.719+0000 7fb2a2099700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb288068f70 0x7fb28806b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb29800b7d0 tx=0x7fb298009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:46.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.723+0000 7fb292ffd700 1 -- 172.21.15.67:0/61484256 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb28c056940 con 0x7fb29c0fde00 2023-12-05T09:23:46.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.984+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb29c04bb80 con 0x7fb29c0fde00 2023-12-05T09:23:46.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.985+0000 7fb292ffd700 1 -- 172.21.15.67:0/61484256 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fb29c04bb80 con 0x7fb29c0fde00 2023-12-05T09:23:46.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb288068f70 msgr2=0x7fb28806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:46.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb288068f70 0x7fb28806b420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb29800b7d0 tx=0x7fb298009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:46.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fde00 msgr2=0x7fb29c10fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:46.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fde00 0x7fb29c10fca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb28c002a50 tx=0x7fb28c0046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:46.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 shutdown_connections 2023-12-05T09:23:46.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb288068f70 0x7fb28806b420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:46.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb29c0fcbf0 0x7fb29c10f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:46.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 --2- 172.21.15.67:0/61484256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb29c0fde00 0x7fb29c10fca0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:46.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.987+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 >> 172.21.15.67:0/61484256 conn(0x7fb29c0f82d0 msgr2=0x7fb29c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:46.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.988+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 shutdown_connections 2023-12-05T09:23:46.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:46.988+0000 7fb2a42fd700 1 -- 172.21.15.67:0/61484256 wait complete. 2023-12-05T09:23:46.989 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2023-12-05T09:23:47.002 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:23:47.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:47 smithi067 ceph-mon[107174]: pgmap v164: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 4 op/s 2023-12-05T09:23:47.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:47 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/61484256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T09:23:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:47 smithi134 ceph-mon[116304]: pgmap v164: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 4 op/s 2023-12-05T09:23:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:47 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/61484256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T09:23:47.417 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-05T09:23:47.901 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:48.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:48 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:48.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:48 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:48.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:48.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:49.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.587+0000 7f0583a56700 1 -- 172.21.15.67:0/2040300197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0737a0 msgr2=0x7f057c073c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:49.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.587+0000 7f0583a56700 1 --2- 172.21.15.67:0/2040300197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0737a0 0x7f057c073c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f056c004940 tx=0x7f056c009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:49.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.587+0000 7f0583a56700 1 -- 172.21.15.67:0/2040300197 shutdown_connections 2023-12-05T09:23:49.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.587+0000 7f0583a56700 1 --2- 172.21.15.67:0/2040300197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c0737a0 0x7f057c073c10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:49.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.587+0000 7f0583a56700 1 --2- 172.21.15.67:0/2040300197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f057c072540 0x7f057c072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:49.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.587+0000 7f0583a56700 1 -- 172.21.15.67:0/2040300197 >> 172.21.15.67:0/2040300197 conn(0x7f057c0fa5d0 msgr2=0x7f057c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:49.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.587+0000 7f0583a56700 1 -- 172.21.15.67:0/2040300197 shutdown_connections 2023-12-05T09:23:49.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.588+0000 7f0583a56700 1 -- 172.21.15.67:0/2040300197 wait complete. 2023-12-05T09:23:49.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.589+0000 7f0583a56700 1 Processor -- start 2023-12-05T09:23:49.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.589+0000 7f0583a56700 1 -- start start 2023-12-05T09:23:49.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.589+0000 7f0583a56700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c072540 0x7f057c113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:49.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.589+0000 7f0583a56700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f057c0737a0 0x7f057c1140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:49.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.589+0000 7f0583a56700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c1146c0 con 0x7f057c072540 2023-12-05T09:23:49.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.589+0000 7f0583a56700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c114f60 con 0x7f057c0737a0 2023-12-05T09:23:49.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.590+0000 7f05817f2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c072540 0x7f057c113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:49.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.590+0000 7f05817f2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c072540 0x7f057c113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39056/0 (socket says 172.21.15.67:39056) 2023-12-05T09:23:49.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.590+0000 7f05817f2700 1 -- 172.21.15.67:0/467215406 learned_addr learned my addr 172.21.15.67:0/467215406 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.590+0000 7f0580ff1700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f057c0737a0 0x7f057c1140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.590+0000 7f05817f2700 1 -- 172.21.15.67:0/467215406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f057c0737a0 msgr2=0x7f057c1140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.590+0000 7f05817f2700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f057c0737a0 0x7f057c1140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.590+0000 7f05817f2700 1 -- 172.21.15.67:0/467215406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c005040 con 0x7f057c072540 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.591+0000 7f05817f2700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c072540 0x7f057c113b80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0578002a50 tx=0x7f05780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.591+0000 7f0571ffb700 1 -- 172.21.15.67:0/467215406 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0578007cc0 con 0x7f057c072540 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.591+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c115240 con 0x7f057c072540 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.591+0000 7f0571ffb700 1 -- 172.21.15.67:0/467215406 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f057800f040 con 0x7f057c072540 2023-12-05T09:23:49.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.591+0000 7f0571ffb700 1 -- 172.21.15.67:0/467215406 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057800da70 con 0x7f057c072540 2023-12-05T09:23:49.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.591+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c115780 con 0x7f057c072540 2023-12-05T09:23:49.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.592+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c04bb80 con 0x7f057c072540 2023-12-05T09:23:49.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.593+0000 7f0571ffb700 1 -- 172.21.15.67:0/467215406 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f057800dcb0 con 0x7f057c072540 2023-12-05T09:23:49.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.594+0000 7f0571ffb700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0568068f60 0x7f056806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:49.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.594+0000 7f0571ffb700 1 -- 172.21.15.67:0/467215406 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0578086500 con 0x7f057c072540 2023-12-05T09:23:49.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.594+0000 7f0580ff1700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0568068f60 0x7f056806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:49.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.595+0000 7f0580ff1700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0568068f60 0x7f056806b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f056c00b3b0 tx=0x7f056c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:49.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.598+0000 7f0571ffb700 1 -- 172.21.15.67:0/467215406 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0578056370 con 0x7f057c072540 2023-12-05T09:23:49.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:49 smithi067 ceph-mon[107174]: pgmap v165: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 3 op/s 2023-12-05T09:23:49.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:49 smithi134 ceph-mon[116304]: pgmap v165: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 3 op/s 2023-12-05T09:23:49.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.887+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f057c10bbb0 con 0x7f057c072540 2023-12-05T09:23:49.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.887+0000 7f0571ffb700 1 -- 172.21.15.67:0/467215406 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+99 (secure 0 0 0) 0x7f0578055f00 con 0x7f057c072540 2023-12-05T09:23:49.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0568068f60 msgr2=0x7f056806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:49.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0568068f60 0x7f056806b410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f056c00b3b0 tx=0x7f056c009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:49.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c072540 msgr2=0x7f057c113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:49.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c072540 0x7f057c113b80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0578002a50 tx=0x7f05780046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:49.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 shutdown_connections 2023-12-05T09:23:49.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f0568068f60 0x7f056806b410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:49.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f057c072540 0x7f057c113b80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:49.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 --2- 172.21.15.67:0/467215406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f057c0737a0 0x7f057c1140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:49.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 >> 172.21.15.67:0/467215406 conn(0x7f057c0fa5d0 msgr2=0x7f057c109110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:49.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 shutdown_connections 2023-12-05T09:23:49.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:49.890+0000 7f0583a56700 1 -- 172.21.15.67:0/467215406 wait complete. 2023-12-05T09:23:49.905 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:23:50.552 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:50 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/467215406' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-05T09:23:50.554 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-05T09:23:50.567 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T09:23:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.791+0000 7f402cbff700 1 -- 172.21.15.67:0/327901446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028070570 msgr2=0x7f40280709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.791+0000 7f402cbff700 1 --2- 172.21.15.67:0/327901446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028070570 0x7f40280709c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f401c004940 tx=0x7f401c009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.792+0000 7f402cbff700 1 -- 172.21.15.67:0/327901446 shutdown_connections 2023-12-05T09:23:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.792+0000 7f402cbff700 1 --2- 172.21.15.67:0/327901446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028070570 0x7f40280709c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.792+0000 7f402cbff700 1 --2- 172.21.15.67:0/327901446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4028071bc0 0x7f4028070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.792+0000 7f402cbff700 1 -- 172.21.15.67:0/327901446 >> 172.21.15.67:0/327901446 conn(0x7f40280f8100 msgr2=0x7f40280fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.792+0000 7f402cbff700 1 -- 172.21.15.67:0/327901446 shutdown_connections 2023-12-05T09:23:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.792+0000 7f402cbff700 1 -- 172.21.15.67:0/327901446 wait complete. 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f402cbff700 1 Processor -- start 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f402cbff700 1 -- start start 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f402cbff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4028070570 0x7f4028113830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f402cbff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028071bc0 0x7f4028113d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f402cbff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4028114370 con 0x7f4028071bc0 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f402cbff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40281144e0 con 0x7f4028070570 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f4025d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028071bc0 0x7f4028113d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f4025d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028071bc0 0x7f4028113d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39070/0 (socket says 172.21.15.67:39070) 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f4025d9b700 1 -- 172.21.15.67:0/2522375848 learned_addr learned my addr 172.21.15.67:0/2522375848 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:50.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.793+0000 7f402659c700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4028070570 0x7f4028113830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.794+0000 7f4025d9b700 1 -- 172.21.15.67:0/2522375848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4028070570 msgr2=0x7f4028113830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.794+0000 7f4025d9b700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4028070570 0x7f4028113830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.794+0000 7f4025d9b700 1 -- 172.21.15.67:0/2522375848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c005040 con 0x7f4028071bc0 2023-12-05T09:23:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.794+0000 7f4025d9b700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028071bc0 0x7f4028113d70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f401c009fd0 tx=0x7f401c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.794+0000 7f4016ffd700 1 -- 172.21.15.67:0/2522375848 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f401c021070 con 0x7f4028071bc0 2023-12-05T09:23:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.794+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4028118f30 con 0x7f4028071bc0 2023-12-05T09:23:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.794+0000 7f4016ffd700 1 -- 172.21.15.67:0/2522375848 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f401c01c400 con 0x7f4028071bc0 2023-12-05T09:23:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.794+0000 7f4016ffd700 1 -- 172.21.15.67:0/2522375848 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f401c00e070 con 0x7f4028071bc0 2023-12-05T09:23:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.795+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40281194c0 con 0x7f4028071bc0 2023-12-05T09:23:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.796+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402810ba20 con 0x7f4028071bc0 2023-12-05T09:23:50.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.797+0000 7f4016ffd700 1 -- 172.21.15.67:0/2522375848 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f401c01c570 con 0x7f4028071bc0 2023-12-05T09:23:50.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.798+0000 7f4016ffd700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4010068f70 0x7f401006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:50.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.798+0000 7f4016ffd700 1 -- 172.21.15.67:0/2522375848 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f401c088060 con 0x7f4028071bc0 2023-12-05T09:23:50.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.798+0000 7f402659c700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4010068f70 0x7f401006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:50.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.799+0000 7f402659c700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4010068f70 0x7f401006b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4018009b80 tx=0x7f401800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:50.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:50.802+0000 7f4016ffd700 1 -- 172.21.15.67:0/2522375848 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f401c057f50 con 0x7f4028071bc0 2023-12-05T09:23:50.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:50 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/467215406' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-05T09:23:51.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.021+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4028119bc0 con 0x7f4028071bc0 2023-12-05T09:23:51.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.022+0000 7f4016ffd700 1 -- 172.21.15.67:0/2522375848 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14387 (secure 0 0 0) 0x7f401c057ae0 con 0x7f4028071bc0 2023-12-05T09:23:51.023 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:51.023 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":46,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","created":"2023-12-05T09:17:21.700862+0000","modified":"2023-12-05T09:23:40.978206+0000","last_up_change":"2023-12-05T09:22:28.150617+0000","last_in_change":"2023-12-05T09:22:09.939138+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:21:24.629667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T09:23:26.505239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T09:23:27.500572+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"73d6a29a-57c6-4943-9a9b-1bb55401f054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6803","nonce":1759558727}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6805","nonce":1759558727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6809","nonce":1759558727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1759558727},{"type":"v1","addr":"172.21.15.67:6807","nonce":1759558727}]},"public_addr":"172.21.15.67:6803/1759558727","cluster_addr":"172.21.15.67:6805/1759558727","heartbeat_back_addr":"172.21.15.67:6809/1759558727","heartbeat_front_addr":"172.21.15.67:6807/1759558727","state":["exists","up"]},{"osd":1,"uuid":"21d6b362-1d8c-4508-b7df-5a156074fc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6811","nonce":565202870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6813","nonce":565202870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6817","nonce":565202870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":565202870},{"type":"v1","addr":"172.21.15.67:6815","nonce":565202870}]},"public_addr":"172.21.15.67:6811/565202870","cluster_addr":"172.21.15.67:6813/565202870","heartbeat_back_addr":"172.21.15.67:6817/565202870","heartbeat_front_addr":"172.21.15.67:6815/565202870","state":["exists","up"]},{"osd":2,"uuid":"214bcc5f-be74-4b12-b23e-c325bae6a18f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6819","nonce":3402999571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6821","nonce":3402999571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6825","nonce":3402999571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":3402999571},{"type":"v1","addr":"172.21.15.67:6823","nonce":3402999571}]},"public_addr":"172.21.15.67:6819/3402999571","cluster_addr":"172.21.15.67:6821/3402999571","heartbeat_back_addr":"172.21.15.67:6825/3402999571","heartbeat_front_addr":"172.21.15.67:6823/3402999571","state":["exists","up"]},{"osd":3,"uuid":"6bce7967-b081-4a08-ac54-9552edf45ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6801","nonce":3069496213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6803","nonce":3069496213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6807","nonce":3069496213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3069496213},{"type":"v1","addr":"172.21.15.134:6805","nonce":3069496213}]},"public_addr":"172.21.15.134:6801/3069496213","cluster_addr":"172.21.15.134:6803/3069496213","heartbeat_back_addr":"172.21.15.134:6807/3069496213","heartbeat_front_addr":"172.21.15.134:6805/3069496213","state":["exists","up"]},{"osd":4,"uuid":"5d1c05dc-2b50-493a-9e5e-d0b16d911091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6809","nonce":548117417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6811","nonce":548117417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6815","nonce":548117417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":548117417},{"type":"v1","addr":"172.21.15.134:6813","nonce":548117417}]},"public_addr":"172.21.15.134:6809/548117417","cluster_addr":"172.21.15.134:6811/548117417","heartbeat_back_addr":"172.21.15.134:6815/548117417","heartbeat_front_addr":"172.21.15.134:6813/548117417","state":["exists","up"]},{"osd":5,"uuid":"43ae157e-59ef-448e-b33f-5ebfadf73ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6817","nonce":2682778910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6819","nonce":2682778910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6823","nonce":2682778910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":2682778910},{"type":"v1","addr":"172.21.15.134:6821","nonce":2682778910}]},"public_addr":"172.21.15.134:6817/2682778910","cluster_addr":"172.21.15.134:6819/2682778910","heartbeat_back_addr":"172.21.15.134:6823/2682778910","heartbeat_front_addr":"172.21.15.134:6821/2682778910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:30.796950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:55.649954+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:20.496287+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:41.995990+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:04.343494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:26.824683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6825/3151035948":"2023-12-06T09:23:40.978176+0000","172.21.15.67:0/2132118036":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/3189096558":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3754244083":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/3210428255":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6801/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.134:6824/3151035948":"2023-12-06T09:23:40.978176+0000","172.21.15.67:0/2057389438":"2023-12-06T09:17:56.446884+0000","172.21.15.67:6800/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:6800/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6801/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/266329309":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/1134257028":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6800/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6801/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/2190646552":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3434626511":"2023-12-06T09:19:26.041323+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:23:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4010068f70 msgr2=0x7f401006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4010068f70 0x7f401006b420 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4018009b80 tx=0x7f401800b040 comp rx=0 tx=0).stop 2023-12-05T09:23:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028071bc0 msgr2=0x7f4028113d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028071bc0 0x7f4028113d70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f401c009fd0 tx=0x7f401c009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 shutdown_connections 2023-12-05T09:23:51.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4010068f70 0x7f401006b420 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4028070570 0x7f4028113830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 --2- 172.21.15.67:0/2522375848 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4028071bc0 0x7f4028113d70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 >> 172.21.15.67:0/2522375848 conn(0x7f40280f8100 msgr2=0x7f40280fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 shutdown_connections 2023-12-05T09:23:51.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.025+0000 7f402cbff700 1 -- 172.21.15.67:0/2522375848 wait complete. 2023-12-05T09:23:51.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T09:21:24.629667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T09:23:26.505239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T09:23:27.500572+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-05T09:23:51.046 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T09:23:51.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.248+0000 7f68297ff700 1 -- 172.21.15.67:0/4174147956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 msgr2=0x7f68240fdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.248+0000 7f68297ff700 1 --2- 172.21.15.67:0/4174147956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 0x7f68240fdd90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6818004940 tx=0x7f6818009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:51.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.248+0000 7f68297ff700 1 -- 172.21.15.67:0/4174147956 shutdown_connections 2023-12-05T09:23:51.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.248+0000 7f68297ff700 1 --2- 172.21.15.67:0/4174147956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 0x7f68240fdd90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.248+0000 7f68297ff700 1 --2- 172.21.15.67:0/4174147956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68240fca40 0x7f68240fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.248+0000 7f68297ff700 1 -- 172.21.15.67:0/4174147956 >> 172.21.15.67:0/4174147956 conn(0x7f68240f81c0 msgr2=0x7f68240fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:51.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.248+0000 7f68297ff700 1 -- 172.21.15.67:0/4174147956 shutdown_connections 2023-12-05T09:23:51.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.248+0000 7f68297ff700 1 -- 172.21.15.67:0/4174147956 wait complete. 2023-12-05T09:23:51.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.249+0000 7f68297ff700 1 Processor -- start 2023-12-05T09:23:51.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.249+0000 7f68297ff700 1 -- start start 2023-12-05T09:23:51.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.249+0000 7f68297ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68240fca40 0x7f6824071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:51.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68297ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 0x7f682406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:51.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68297ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824071f30 con 0x7f68240fd390 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68297ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824070500 con 0x7f68240fca40 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68227fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 0x7f682406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68227fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 0x7f682406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39088/0 (socket says 172.21.15.67:39088) 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68227fc700 1 -- 172.21.15.67:0/296947178 learned_addr learned my addr 172.21.15.67:0/296947178 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f6822ffd700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68240fca40 0x7f6824071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68227fc700 1 -- 172.21.15.67:0/296947178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68240fca40 msgr2=0x7f6824071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68227fc700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68240fca40 0x7f6824071930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68227fc700 1 -- 172.21.15.67:0/296947178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818005040 con 0x7f68240fd390 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.250+0000 7f68227fc700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 0x7f682406ff90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f681800b3b0 tx=0x7f6818009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.251+0000 7f680b7fe700 1 -- 172.21.15.67:0/296947178 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f681800e040 con 0x7f68240fd390 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.251+0000 7f680b7fe700 1 -- 172.21.15.67:0/296947178 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f681800bc50 con 0x7f68240fd390 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.251+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6824070780 con 0x7f68240fd390 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.251+0000 7f680b7fe700 1 -- 172.21.15.67:0/296947178 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f681801c630 con 0x7f68240fd390 2023-12-05T09:23:51.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.251+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6824070d40 con 0x7f68240fd390 2023-12-05T09:23:51.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.252+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6824105410 con 0x7f68240fd390 2023-12-05T09:23:51.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.253+0000 7f680b7fe700 1 -- 172.21.15.67:0/296947178 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f6818013420 con 0x7f68240fd390 2023-12-05T09:23:51.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.254+0000 7f680b7fe700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f680c068f70 0x7f680c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:51.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.254+0000 7f680b7fe700 1 -- 172.21.15.67:0/296947178 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f68180881f0 con 0x7f68240fd390 2023-12-05T09:23:51.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.254+0000 7f6822ffd700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f680c068f70 0x7f680c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:51.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.255+0000 7f6822ffd700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f680c068f70 0x7f680c06b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6814009fd0 tx=0x7f681400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:51.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.259+0000 7f680b7fe700 1 -- 172.21.15.67:0/296947178 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f68180580e0 con 0x7f68240fd390 2023-12-05T09:23:51.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.465+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6824115390 con 0x7f68240fd390 2023-12-05T09:23:51.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.465+0000 7f680b7fe700 1 -- 172.21.15.67:0/296947178 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6818057c70 con 0x7f68240fd390 2023-12-05T09:23:51.465 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.467+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f680c068f70 msgr2=0x7f680c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.467+0000 7f68297ff700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f680c068f70 0x7f680c06b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6814009fd0 tx=0x7f681400b040 comp rx=0 tx=0).stop 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.467+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 msgr2=0x7f682406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.467+0000 7f68297ff700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 0x7f682406ff90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f681800b3b0 tx=0x7f6818009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.468+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 shutdown_connections 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.468+0000 7f68297ff700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f680c068f70 0x7f680c06b420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.468+0000 7f68297ff700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68240fca40 0x7f6824071930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.468+0000 7f68297ff700 1 --2- 172.21.15.67:0/296947178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f68240fd390 0x7f682406ff90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.468+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 >> 172.21.15.67:0/296947178 conn(0x7f68240f81c0 msgr2=0x7f6824100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:51.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.468+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 shutdown_connections 2023-12-05T09:23:51.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.468+0000 7f68297ff700 1 -- 172.21.15.67:0/296947178 wait complete. 2023-12-05T09:23:51.486 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T09:23:51.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.685+0000 7f9a6bdff700 1 -- 172.21.15.67:0/1355494231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 msgr2=0x7f9a640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.685+0000 7f9a6bdff700 1 --2- 172.21.15.67:0/1355494231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 0x7f9a640709e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9a54004940 tx=0x7f9a54009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:51.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.685+0000 7f9a6bdff700 1 -- 172.21.15.67:0/1355494231 shutdown_connections 2023-12-05T09:23:51.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.685+0000 7f9a6bdff700 1 --2- 172.21.15.67:0/1355494231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 0x7f9a640709e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.685+0000 7f9a6bdff700 1 --2- 172.21.15.67:0/1355494231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64071b30 0x7f9a64070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.685+0000 7f9a6bdff700 1 -- 172.21.15.67:0/1355494231 >> 172.21.15.67:0/1355494231 conn(0x7f9a640f81c0 msgr2=0x7f9a640fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:51.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.685+0000 7f9a6bdff700 1 -- 172.21.15.67:0/1355494231 shutdown_connections 2023-12-05T09:23:51.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.685+0000 7f9a6bdff700 1 -- 172.21.15.67:0/1355494231 wait complete. 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.686+0000 7f9a6bdff700 1 Processor -- start 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.686+0000 7f9a6bdff700 1 -- start start 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.686+0000 7f9a6bdff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 0x7f9a6410f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.686+0000 7f9a6bdff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64071b30 0x7f9a6410f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.686+0000 7f9a6bdff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6410ffe0 con 0x7f9a64070570 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a6bdff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a64110150 con 0x7f9a64071b30 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a69b9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 0x7f9a6410f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a69b9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 0x7f9a6410f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39096/0 (socket says 172.21.15.67:39096) 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a69b9b700 1 -- 172.21.15.67:0/746928960 learned_addr learned my addr 172.21.15.67:0/746928960 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:51.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a6939a700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64071b30 0x7f9a6410f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a69b9b700 1 -- 172.21.15.67:0/746928960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64071b30 msgr2=0x7f9a6410f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a69b9b700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64071b30 0x7f9a6410f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a69b9b700 1 -- 172.21.15.67:0/746928960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54005040 con 0x7f9a64070570 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.687+0000 7f9a69b9b700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 0x7f9a6410f4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9a60002a50 tx=0x7f9a60004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.688+0000 7f9a5a7fc700 1 -- 172.21.15.67:0/746928960 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a60007cc0 con 0x7f9a64070570 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.688+0000 7f9a5a7fc700 1 -- 172.21.15.67:0/746928960 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a6000f040 con 0x7f9a64070570 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.688+0000 7f9a5a7fc700 1 -- 172.21.15.67:0/746928960 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a6000d990 con 0x7f9a64070570 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.688+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a64114c00 con 0x7f9a64070570 2023-12-05T09:23:51.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.688+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a641150f0 con 0x7f9a64070570 2023-12-05T09:23:51.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.689+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a64107640 con 0x7f9a64070570 2023-12-05T09:23:51.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.690+0000 7f9a5a7fc700 1 -- 172.21.15.67:0/746928960 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f9a60009710 con 0x7f9a64070570 2023-12-05T09:23:51.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.691+0000 7f9a5a7fc700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9a50068f70 0x7f9a5006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:51.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.691+0000 7f9a5a7fc700 1 -- 172.21.15.67:0/746928960 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9a60086b60 con 0x7f9a64070570 2023-12-05T09:23:51.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.691+0000 7f9a6939a700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9a50068f70 0x7f9a5006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:51.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.692+0000 7f9a6939a700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9a50068f70 0x7f9a5006b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a54004f90 tx=0x7f9a54009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:51.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.695+0000 7f9a5a7fc700 1 -- 172.21.15.67:0/746928960 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9a600569f0 con 0x7f9a64070570 2023-12-05T09:23:51.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:51 smithi067 ceph-mon[107174]: pgmap v166: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:23:51.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:51 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:51.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:51 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:51.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:51 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:51.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:51 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:23:51.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:51 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:51.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:51 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2522375848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:23:51.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:51 smithi134 ceph-mon[116304]: pgmap v166: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:23:51.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:51 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:51.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:51 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:51.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:51 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:23:51.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:51 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:23:51.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:51 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:51.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:51 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2522375848' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:23:51.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.897+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f9a64115650 con 0x7f9a64070570 2023-12-05T09:23:51.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.898+0000 7f9a5a7fc700 1 -- 172.21.15.67:0/746928960 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9a60056580 con 0x7f9a64070570 2023-12-05T09:23:51.898 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-12-05T09:23:51.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9a50068f70 msgr2=0x7f9a5006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9a50068f70 0x7f9a5006b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9a54004f90 tx=0x7f9a54009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:51.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 msgr2=0x7f9a6410f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:51.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 0x7f9a6410f4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9a60002a50 tx=0x7f9a60004600 comp rx=0 tx=0).stop 2023-12-05T09:23:51.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 shutdown_connections 2023-12-05T09:23:51.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9a50068f70 0x7f9a5006b420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a64070570 0x7f9a6410f4a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 --2- 172.21.15.67:0/746928960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a64071b30 0x7f9a6410f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:51.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 >> 172.21.15.67:0/746928960 conn(0x7f9a640f81c0 msgr2=0x7f9a641029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:51.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 shutdown_connections 2023-12-05T09:23:51.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:51.900+0000 7f9a6bdff700 1 -- 172.21.15.67:0/746928960 wait complete. 2023-12-05T09:23:51.918 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T09:23:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.122+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/2069977121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fd390 msgr2=0x7fcb080fdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.122+0000 7fcb0d3ff700 1 --2- 172.21.15.67:0/2069977121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fd390 0x7fcb080fdd90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcafc004940 tx=0x7fcafc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.122+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/2069977121 shutdown_connections 2023-12-05T09:23:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.122+0000 7fcb0d3ff700 1 --2- 172.21.15.67:0/2069977121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fd390 0x7fcb080fdd90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.122+0000 7fcb0d3ff700 1 --2- 172.21.15.67:0/2069977121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb080fca40 0x7fcb080fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.122+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/2069977121 >> 172.21.15.67:0/2069977121 conn(0x7fcb080f81c0 msgr2=0x7fcb080fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.122+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/2069977121 shutdown_connections 2023-12-05T09:23:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.122+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/2069977121 wait complete. 2023-12-05T09:23:52.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.123+0000 7fcb0d3ff700 1 Processor -- start 2023-12-05T09:23:52.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.123+0000 7fcb0d3ff700 1 -- start start 2023-12-05T09:23:52.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb0d3ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fca40 0x7fcb08071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:52.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb0d3ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb080fd390 0x7fcb0806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:52.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb0d3ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080704d0 con 0x7fcb080fca40 2023-12-05T09:23:52.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb0d3ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08070640 con 0x7fcb080fd390 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb06ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fca40 0x7fcb08071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb06ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fca40 0x7fcb08071930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39110/0 (socket says 172.21.15.67:39110) 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb06ffd700 1 -- 172.21.15.67:0/392423255 learned_addr learned my addr 172.21.15.67:0/392423255 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb06ffd700 1 -- 172.21.15.67:0/392423255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb080fd390 msgr2=0x7fcb0806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb06ffd700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb080fd390 0x7fcb0806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb06ffd700 1 -- 172.21.15.67:0/392423255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc005040 con 0x7fcb080fca40 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.124+0000 7fcb06ffd700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fca40 0x7fcb08071930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800b790 tx=0x7fcaf8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.125+0000 7fcaef7fe700 1 -- 172.21.15.67:0/392423255 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf800f6f0 con 0x7fcb080fca40 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.125+0000 7fcaef7fe700 1 -- 172.21.15.67:0/392423255 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcaf800fd00 con 0x7fcb080fca40 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.125+0000 7fcaef7fe700 1 -- 172.21.15.67:0/392423255 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaf80103a0 con 0x7fcb080fca40 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.125+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb08070920 con 0x7fcb080fca40 2023-12-05T09:23:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.125+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb081153a0 con 0x7fcb080fca40 2023-12-05T09:23:52.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.126+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb081054b0 con 0x7fcb080fca40 2023-12-05T09:23:52.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.127+0000 7fcaef7fe700 1 -- 172.21.15.67:0/392423255 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fcaf800f850 con 0x7fcb080fca40 2023-12-05T09:23:52.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.128+0000 7fcaef7fe700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcaf0068f70 0x7fcaf006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:52.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.128+0000 7fcaef7fe700 1 -- 172.21.15.67:0/392423255 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcaf8086c10 con 0x7fcb080fca40 2023-12-05T09:23:52.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.128+0000 7fcb067fc700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcaf0068f70 0x7fcaf006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:52.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.128+0000 7fcb067fc700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcaf0068f70 0x7fcaf006b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcafc000c00 tx=0x7fcafc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:52.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.132+0000 7fcaef7fe700 1 -- 172.21.15.67:0/392423255 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcaf8056a80 con 0x7fcb080fca40 2023-12-05T09:23:52.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.334+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fcb08115770 con 0x7fcb080fca40 2023-12-05T09:23:52.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.334+0000 7fcaef7fe700 1 -- 172.21.15.67:0/392423255 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcaf8056610 con 0x7fcb080fca40 2023-12-05T09:23:52.335 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.336+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcaf0068f70 msgr2=0x7fcaf006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.336+0000 7fcb0d3ff700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcaf0068f70 0x7fcaf006b420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcafc000c00 tx=0x7fcafc009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.336+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fca40 msgr2=0x7fcb08071930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.336+0000 7fcb0d3ff700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fca40 0x7fcb08071930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800b790 tx=0x7fcaf8009220 comp rx=0 tx=0).stop 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.337+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 shutdown_connections 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.337+0000 7fcb0d3ff700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fcaf0068f70 0x7fcaf006b420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.337+0000 7fcb0d3ff700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcb080fca40 0x7fcb08071930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.337+0000 7fcb0d3ff700 1 --2- 172.21.15.67:0/392423255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb080fd390 0x7fcb0806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.337+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 >> 172.21.15.67:0/392423255 conn(0x7fcb080f81c0 msgr2=0x7fcb08100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.337+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 shutdown_connections 2023-12-05T09:23:52.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.337+0000 7fcb0d3ff700 1 -- 172.21.15.67:0/392423255 wait complete. 2023-12-05T09:23:52.355 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-05T09:23:52.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.555+0000 7f7120fff700 1 -- 172.21.15.67:0/226159145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 msgr2=0x7f711c0fe0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:52.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.555+0000 7f7120fff700 1 --2- 172.21.15.67:0/226159145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 0x7f711c0fe0e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7110004940 tx=0x7f7110009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:52.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.556+0000 7f7120fff700 1 -- 172.21.15.67:0/226159145 shutdown_connections 2023-12-05T09:23:52.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.556+0000 7f7120fff700 1 --2- 172.21.15.67:0/226159145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 0x7f711c0fe0e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.556+0000 7f7120fff700 1 --2- 172.21.15.67:0/226159145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f711c0fca80 0x7f711c0fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.556+0000 7f7120fff700 1 -- 172.21.15.67:0/226159145 >> 172.21.15.67:0/226159145 conn(0x7f711c0f8100 msgr2=0x7f711c0fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:52.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.556+0000 7f7120fff700 1 -- 172.21.15.67:0/226159145 shutdown_connections 2023-12-05T09:23:52.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.556+0000 7f7120fff700 1 -- 172.21.15.67:0/226159145 wait complete. 2023-12-05T09:23:52.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.557+0000 7f7120fff700 1 Processor -- start 2023-12-05T09:23:52.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.557+0000 7f7120fff700 1 -- start start 2023-12-05T09:23:52.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.557+0000 7f7120fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f711c0fca80 0x7f711c10d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:52.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.557+0000 7f7120fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 0x7f711c10d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:52.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7120fff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c10de70 con 0x7f711c0fdc90 2023-12-05T09:23:52.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7120fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c10dfe0 con 0x7f711c0fca80 2023-12-05T09:23:52.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7119d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 0x7f711c10d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:52.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7119d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 0x7f711c10d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39134/0 (socket says 172.21.15.67:39134) 2023-12-05T09:23:52.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7119d9b700 1 -- 172.21.15.67:0/3918363824 learned_addr learned my addr 172.21.15.67:0/3918363824 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:52.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f711a59c700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f711c0fca80 0x7f711c10d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:52.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7119d9b700 1 -- 172.21.15.67:0/3918363824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f711c0fca80 msgr2=0x7f711c10d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:52.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7119d9b700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f711c0fca80 0x7f711c10d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7119d9b700 1 -- 172.21.15.67:0/3918363824 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110005040 con 0x7f711c0fdc90 2023-12-05T09:23:52.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.558+0000 7f7119d9b700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 0x7f711c10d870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f711000b3b0 tx=0x7f7110009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:52.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.559+0000 7f710affd700 1 -- 172.21.15.67:0/3918363824 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711000e040 con 0x7f711c0fdc90 2023-12-05T09:23:52.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.559+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c112a30 con 0x7f711c0fdc90 2023-12-05T09:23:52.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.559+0000 7f710affd700 1 -- 172.21.15.67:0/3918363824 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f711000bcd0 con 0x7f711c0fdc90 2023-12-05T09:23:52.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.559+0000 7f710affd700 1 -- 172.21.15.67:0/3918363824 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f711001c630 con 0x7f711c0fdc90 2023-12-05T09:23:52.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.559+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c112ff0 con 0x7f711c0fdc90 2023-12-05T09:23:52.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.560+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c105440 con 0x7f711c0fdc90 2023-12-05T09:23:52.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.561+0000 7f710affd700 1 -- 172.21.15.67:0/3918363824 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7110013420 con 0x7f711c0fdc90 2023-12-05T09:23:52.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.561+0000 7f710affd700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7104068f70 0x7f710406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:52.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.562+0000 7f710affd700 1 -- 172.21.15.67:0/3918363824 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f71100882d0 con 0x7f711c0fdc90 2023-12-05T09:23:52.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.562+0000 7f711a59c700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7104068f70 0x7f710406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:52.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.562+0000 7f711a59c700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7104068f70 0x7f710406b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f711c0fdaf0 tx=0x7f710c009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:52.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.566+0000 7f710affd700 1 -- 172.21.15.67:0/3918363824 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7110058100 con 0x7f711c0fdc90 2023-12-05T09:23:52.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:52 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/296947178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:23:52.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:52 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/746928960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T09:23:52.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:52 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/392423255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T09:23:52.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:52 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/296947178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:23:52.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:52 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/746928960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T09:23:52.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:52 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/392423255' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T09:23:52.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.815+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f711c113240 con 0x7f711c0fdc90 2023-12-05T09:23:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.815+0000 7f710affd700 1 -- 172.21.15.67:0/3918363824 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f7110057c90 con 0x7f711c0fdc90 2023-12-05T09:23:52.816 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:23:52.816 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24331,"name":"cephfs.smithi134.vmnpaq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.134:6827/1595650402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1595650402},{"type":"v1","addr":"172.21.15.134:6827","nonce":1595650402}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24339,"name":"cephfs.smithi134.vvbmln","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/2708731143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":2708731143},{"type":"v1","addr":"172.21.15.134:6825","nonce":2708731143}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-05T09:23:28.000471+0000","modified":"2023-12-05T09:23:45.001739+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14478,"mds_1":14494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14478":{"gid":14478,"name":"cephfs.smithi067.kyspon","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.67:6827/4061541911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":4061541911},{"type":"v1","addr":"172.21.15.67:6827","nonce":4061541911}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14494":{"gid":14494,"name":"cephfs.smithi067.qaibsa","rank":1,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.67:6829/1160981491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":1160981491},{"type":"v1","addr":"172.21.15.67:6829","nonce":1160981491}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-05T09:23:52.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7104068f70 msgr2=0x7f710406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:52.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7104068f70 0x7f710406b420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f711c0fdaf0 tx=0x7f710c009ee0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 msgr2=0x7f711c10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:52.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 0x7f711c10d870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f711000b3b0 tx=0x7f7110009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:52.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 shutdown_connections 2023-12-05T09:23:52.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7104068f70 0x7f710406b420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f711c0fca80 0x7f711c10d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 --2- 172.21.15.67:0/3918363824 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f711c0fdc90 0x7f711c10d870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:52.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 >> 172.21.15.67:0/3918363824 conn(0x7f711c0f8100 msgr2=0x7f711c100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:52.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 shutdown_connections 2023-12-05T09:23:52.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:52.818+0000 7f7120fff700 1 -- 172.21.15.67:0/3918363824 wait complete. 2023-12-05T09:23:52.819 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2023-12-05T09:23:52.836 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 2, 'flags': 18} 2023-12-05T09:23:52.837 INFO:teuthology.run_tasks:Running task kclient... 2023-12-05T09:23:52.863 INFO:tasks.kclient:Mounting kernel clients... 2023-12-05T09:23:52.863 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-05T09:23:52.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:52.863 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-12-05T09:23:52.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:52.911 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-12-05T09:23:52.986 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2023-12-05T09:23:52.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:23:52.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:52.990 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-05T09:23:53.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:53.046 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2023-12-05T09:23:53.125 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2023-12-05T09:23:53.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:23:53.128 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-05T09:23:53.129 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-05T09:23:53.129 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-05T09:23:53.129 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-05T09:23:53.563 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:23:53.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:53 smithi067 ceph-mon[107174]: pgmap v167: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:23:53.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:53 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3918363824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T09:23:53.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:53 smithi134 ceph-mon[116304]: pgmap v167: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-05T09:23:53.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:53 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3918363824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.875+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/1917279552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a81035a0 msgr2=0x7ff7a80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.875+0000 7ff7ae6f7700 1 --2- 172.21.15.67:0/1917279552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a81035a0 0x7ff7a80fcc10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff79c004940 tx=0x7ff79c009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.875+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/1917279552 shutdown_connections 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.875+0000 7ff7ae6f7700 1 --2- 172.21.15.67:0/1917279552 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a81035a0 0x7ff7a80fcc10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.875+0000 7ff7ae6f7700 1 --2- 172.21.15.67:0/1917279552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a8102c00 0x7ff7a8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.875+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/1917279552 >> 172.21.15.67:0/1917279552 conn(0x7ff7a80f8790 msgr2=0x7ff7a80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.875+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/1917279552 shutdown_connections 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.876+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/1917279552 wait complete. 2023-12-05T09:23:54.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.876+0000 7ff7ae6f7700 1 Processor -- start 2023-12-05T09:23:54.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.876+0000 7ff7ae6f7700 1 -- start start 2023-12-05T09:23:54.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7ae6f7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a8102c00 0x7ff7a81136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:54.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7ae6f7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a81035a0 0x7ff7a8113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:54.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7ae6f7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8114280 con 0x7ff7a8102c00 2023-12-05T09:23:54.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7ae6f7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a810d570 con 0x7ff7a81035a0 2023-12-05T09:23:54.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7a7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a8102c00 0x7ff7a81136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:54.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7a7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a8102c00 0x7ff7a81136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39150/0 (socket says 172.21.15.67:39150) 2023-12-05T09:23:54.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7a7fff700 1 -- 172.21.15.67:0/2251495843 learned_addr learned my addr 172.21.15.67:0/2251495843 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:23:54.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7a77fe700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a81035a0 0x7ff7a8113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:54.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7a7fff700 1 -- 172.21.15.67:0/2251495843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a81035a0 msgr2=0x7ff7a8113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:54.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.877+0000 7ff7a7fff700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a81035a0 0x7ff7a8113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:54.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.878+0000 7ff7a7fff700 1 -- 172.21.15.67:0/2251495843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c005040 con 0x7ff7a8102c00 2023-12-05T09:23:54.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.878+0000 7ff7a7fff700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a8102c00 0x7ff7a81136f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff798002a50 tx=0x7ff7980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:54.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.878+0000 7ff7a4ff9700 1 -- 172.21.15.67:0/2251495843 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff798007cc0 con 0x7ff7a8102c00 2023-12-05T09:23:54.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.878+0000 7ff7a4ff9700 1 -- 172.21.15.67:0/2251495843 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff79800f040 con 0x7ff7a8102c00 2023-12-05T09:23:54.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.878+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a810d850 con 0x7ff7a8102c00 2023-12-05T09:23:54.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.878+0000 7ff7a4ff9700 1 -- 172.21.15.67:0/2251495843 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff79800d9c0 con 0x7ff7a8102c00 2023-12-05T09:23:54.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.878+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a810dd90 con 0x7ff7a8102c00 2023-12-05T09:23:54.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.879+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a81133a0 con 0x7ff7a8102c00 2023-12-05T09:23:54.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.880+0000 7ff7a4ff9700 1 -- 172.21.15.67:0/2251495843 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7ff79800db60 con 0x7ff7a8102c00 2023-12-05T09:23:54.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.882+0000 7ff7a4ff9700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff790068f70 0x7ff79006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:23:54.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.882+0000 7ff7a4ff9700 1 -- 172.21.15.67:0/2251495843 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff7980863b0 con 0x7ff7a8102c00 2023-12-05T09:23:54.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.882+0000 7ff7a77fe700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff790068f70 0x7ff79006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:23:54.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.882+0000 7ff7a77fe700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff790068f70 0x7ff79006b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff7a810ef50 tx=0x7ff79c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:23:54.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:54.886+0000 7ff7a4ff9700 1 -- 172.21.15.67:0/2251495843 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff79804ca00 con 0x7ff7a8102c00 2023-12-05T09:23:55.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.133+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff7a81050d0 con 0x7ff7a8102c00 2023-12-05T09:23:55.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.133+0000 7ff7a4ff9700 1 -- 172.21.15.67:0/2251495843 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7ff7980562c0 con 0x7ff7a8102c00 2023-12-05T09:23:55.134 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff790068f70 msgr2=0x7ff79006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff790068f70 0x7ff79006b420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff7a810ef50 tx=0x7ff79c009e30 comp rx=0 tx=0).stop 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a8102c00 msgr2=0x7ff7a81136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a8102c00 0x7ff7a81136f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff798002a50 tx=0x7ff7980046b0 comp rx=0 tx=0).stop 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 shutdown_connections 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7ff790068f70 0x7ff79006b420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff7a8102c00 0x7ff7a81136f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 --2- 172.21.15.67:0/2251495843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7a81035a0 0x7ff7a8113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 >> 172.21.15.67:0/2251495843 conn(0x7ff7a80f8790 msgr2=0x7ff7a80fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 shutdown_connections 2023-12-05T09:23:55.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:23:55.136+0000 7ff7ae6f7700 1 -- 172.21.15.67:0/2251495843 wait complete. 2023-12-05T09:23:55.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-05T09:23:55.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-05T09:23:55.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-12-05T09:23:55.621 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-05T09:23:55.621 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-05T09:23:55.621 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-05T09:23:55.621 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-05T09:23:55.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-05T09:23:55.621 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-05T09:23:55.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:55.621 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-12-05T09:23:55.669 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-05T09:23:55.669 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-05T09:23:55.669 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-12-05T09:23:55.669 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:23:55.669 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-12-05T09:23:55.669 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f0 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: altname enp7s0f1 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 41637sec preferred_lft 41637sec 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::ec4:7aff:feb6:fc0b/64 scope link 2023-12-05T09:23:55.670 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:23:55.672 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-05T09:23:55.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:55.672 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-12-05T09:23:55.672 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-12-05T09:23:55.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2023-12-05T09:23:55.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2023-12-05T09:23:55.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2023-12-05T09:23:55.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-05T09:23:55.672 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-12-05T09:23:55.778 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:55 smithi067 ceph-mon[107174]: pgmap v168: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-05T09:23:55.778 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:55 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2251495843' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T09:23:55.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:55 smithi134 ceph-mon[116304]: pgmap v168: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.8 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-05T09:23:55.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:55 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2251495843' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T09:23:56.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:56.112 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-05T09:23:56.184 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-12-05T09:23:56.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:56.188 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-12-05T09:23:56.255 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-12-05T09:23:56.255 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-05T09:23:56.255 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-05T09:23:56.256 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-05T09:23:56.256 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-05T09:23:56.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:56.257 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-12-05T09:23:56.257 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-12-05T09:23:56.257 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-05T09:23:56.257 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-05T09:23:56.257 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-05T09:23:56.257 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-12-05T09:23:57.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:57.020 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-12-05T09:23:57.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:57.068 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2023-12-05T09:23:57.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:57.116 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-12-05T09:23:57.116 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-12-05T09:23:57.116 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-05T09:23:57.116 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-05T09:23:57.117 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-12-05T09:23:57.264 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-05T09:23:57.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:57.264 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-12-05T09:23:57.264 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-12-05T09:23:57.264 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-05T09:23:57.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-05T09:23:57.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-05T09:23:57.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-05T09:23:57.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-05T09:23:57.265 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-12-05T09:23:57.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:57 smithi067 ceph-mon[107174]: pgmap v169: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-05T09:23:57.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:57.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:23:57.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:57 smithi134 ceph-mon[116304]: pgmap v169: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 3 op/s 2023-12-05T09:23:57.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:23:57.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:23:57.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:57.555 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-12-05T09:23:57.555 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-12-05T09:23:57.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-12-05T09:23:57.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2023-12-05T09:23:57.555 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-12-05T09:23:57.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T09:23:57.732 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-05T09:23:57.779 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-05T09:23:57.779 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T09:23:57.779 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-05T09:23:57.825 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-05T09:23:57.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:57.825 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T09:23:57.982 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T09:23:57.982 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T09:23:57.982 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2023-12-05T09:23:58.440 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T09:23:58.440 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T09:23:58.440 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2023-12-05T09:23:58.441 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.134:3300" 2023-12-05T09:23:58.441 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T09:23:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-05T09:23:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-05T09:23:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:invalid new device string format 2023-12-05T09:23:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.134:3300" 2023-12-05T09:23:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T09:23:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.134:6789" 2023-12-05T09:23:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.134:6789:/ 2023-12-05T09:23:58.468 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f6a41352-934e-11ee-95a2-87774f69a715" will pass to kernel 2023-12-05T09:23:58.474 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-05T09:23:58.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:58.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-05T09:23:58.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:58.548 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:23:58.653 INFO:teuthology.orchestra.run.smithi067.stdout:client24373 2023-12-05T09:23:58.653 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:23:58.653 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T09:23:58.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:58.701 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:23:58.843 INFO:teuthology.orchestra.run.smithi067.stdout:client24373 2023-12-05T09:23:58.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:58.843 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:23:58.944 INFO:teuthology.orchestra.run.smithi067.stdout:client24373 2023-12-05T09:23:58.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:23:58.945 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f6a41352-934e-11ee-95a2-87774f69a715.client24373/status') 2023-12-05T09:23:59.071 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.24373 (3)172.21.15.67:0/2783008818 2023-12-05T09:23:59.071 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2023-12-05T09:23:59.071 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2023-12-05T09:23:59.071 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2023-12-05T09:23:59.071 INFO:teuthology.orchestra.run.smithi067.stderr:71 bytes copied, 6.6955e-05 s, 1.1 MB/s 2023-12-05T09:23:59.074 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-05T09:23:59.074 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-05T09:23:59.074 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-05T09:23:59.074 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f6a41352-934e-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-05T09:23:59.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:23:59 smithi067 ceph-mon[107174]: pgmap v170: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 2 op/s 2023-12-05T09:23:59.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:23:59 smithi134 ceph-mon[116304]: pgmap v170: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 2 op/s 2023-12-05T09:23:59.511 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:24:00.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.745+0000 7f8e6f73c700 1 -- 172.21.15.67:0/544922174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e681035a0 msgr2=0x7f8e680fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:00.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.745+0000 7f8e6f73c700 1 --2- 172.21.15.67:0/544922174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e681035a0 0x7f8e680fcc10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e58004940 tx=0x7f8e58009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:00.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.745+0000 7f8e6f73c700 1 -- 172.21.15.67:0/544922174 shutdown_connections 2023-12-05T09:24:00.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.745+0000 7f8e6f73c700 1 --2- 172.21.15.67:0/544922174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e681035a0 0x7f8e680fcc10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:00.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.745+0000 7f8e6f73c700 1 --2- 172.21.15.67:0/544922174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e68102c00 0x7f8e68102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.745+0000 7f8e6f73c700 1 -- 172.21.15.67:0/544922174 >> 172.21.15.67:0/544922174 conn(0x7f8e680f8790 msgr2=0x7f8e680faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.745+0000 7f8e6f73c700 1 -- 172.21.15.67:0/544922174 shutdown_connections 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.745+0000 7f8e6f73c700 1 -- 172.21.15.67:0/544922174 wait complete. 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.746+0000 7f8e6f73c700 1 Processor -- start 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.746+0000 7f8e6f73c700 1 -- start start 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.746+0000 7f8e6f73c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e68102c00 0x7f8e6806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.746+0000 7f8e6f73c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e681035a0 0x7f8e680704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.746+0000 7f8e6f73c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68070af0 con 0x7f8e68102c00 2023-12-05T09:24:00.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.746+0000 7f8e6f73c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68070c60 con 0x7f8e681035a0 2023-12-05T09:24:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.747+0000 7f8e6d4d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e68102c00 0x7f8e6806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.747+0000 7f8e6d4d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e68102c00 0x7f8e6806ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40748/0 (socket says 172.21.15.67:40748) 2023-12-05T09:24:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.747+0000 7f8e6d4d8700 1 -- 172.21.15.67:0/388864002 learned_addr learned my addr 172.21.15.67:0/388864002 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.747+0000 7f8e6ccd7700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e681035a0 0x7f8e680704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.747+0000 7f8e6d4d8700 1 -- 172.21.15.67:0/388864002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e681035a0 msgr2=0x7f8e680704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.747+0000 7f8e6d4d8700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e681035a0 0x7f8e680704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:00.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.747+0000 7f8e6d4d8700 1 -- 172.21.15.67:0/388864002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58005040 con 0x7f8e68102c00 2023-12-05T09:24:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.747+0000 7f8e6d4d8700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e68102c00 0x7f8e6806ff40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e64002a50 tx=0x7f8e640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.748+0000 7f8e5dffb700 1 -- 172.21.15.67:0/388864002 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e64007cc0 con 0x7f8e68102c00 2023-12-05T09:24:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.748+0000 7f8e5dffb700 1 -- 172.21.15.67:0/388864002 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e6400f040 con 0x7f8e68102c00 2023-12-05T09:24:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.748+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e68119880 con 0x7f8e68102c00 2023-12-05T09:24:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.748+0000 7f8e5dffb700 1 -- 172.21.15.67:0/388864002 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e64009540 con 0x7f8e68102c00 2023-12-05T09:24:00.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.748+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e68119dc0 con 0x7f8e68102c00 2023-12-05T09:24:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.749+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e681050d0 con 0x7f8e68102c00 2023-12-05T09:24:00.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.750+0000 7f8e5dffb700 1 -- 172.21.15.67:0/388864002 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f8e640096a0 con 0x7f8e68102c00 2023-12-05T09:24:00.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.751+0000 7f8e5dffb700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8e54068f70 0x7f8e5406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:00.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.751+0000 7f8e5dffb700 1 -- 172.21.15.67:0/388864002 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8e64086cc0 con 0x7f8e68102c00 2023-12-05T09:24:00.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.751+0000 7f8e6ccd7700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8e54068f70 0x7f8e5406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:00.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.752+0000 7f8e6ccd7700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8e54068f70 0x7f8e5406b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800b020 tx=0x7f8e58009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:00.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:00.755+0000 7f8e5dffb700 1 -- 172.21.15.67:0/388864002 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8e6408c020 con 0x7f8e68102c00 2023-12-05T09:24:01.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.002+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8e6804bbb0 con 0x7f8e68102c00 2023-12-05T09:24:01.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.002+0000 7f8e5dffb700 1 -- 172.21.15.67:0/388864002 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f8e64053020 con 0x7f8e68102c00 2023-12-05T09:24:01.003 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8e54068f70 msgr2=0x7f8e5406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8e54068f70 0x7f8e5406b420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800b020 tx=0x7f8e58009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e68102c00 msgr2=0x7f8e6806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e68102c00 0x7f8e6806ff40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e64002a50 tx=0x7f8e640046b0 comp rx=0 tx=0).stop 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 shutdown_connections 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f8e54068f70 0x7f8e5406b420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8e68102c00 0x7f8e6806ff40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 --2- 172.21.15.67:0/388864002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e681035a0 0x7f8e680704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 >> 172.21.15.67:0/388864002 conn(0x7f8e680f8790 msgr2=0x7f8e680fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 shutdown_connections 2023-12-05T09:24:01.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:01.005+0000 7f8e6f73c700 1 -- 172.21.15.67:0/388864002 wait complete. 2023-12-05T09:24:01.365 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:01 smithi067 ceph-mon[107174]: pgmap v171: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 2 op/s 2023-12-05T09:24:01.366 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:01 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/388864002' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T09:24:01.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:01 smithi134 ceph-mon[116304]: pgmap v171: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 2 op/s 2023-12-05T09:24:01.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:01 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/388864002' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-05T09:24:01.392 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-05T09:24:01.392 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-05T09:24:01.392 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2023-12-05T09:24:01.392 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-05T09:24:01.392 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-05T09:24:01.393 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-05T09:24:01.393 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-05T09:24:01.393 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-05T09:24:01.393 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-05T09:24:01.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:01.393 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2023-12-05T09:24:01.446 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-05T09:24:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-05T09:24:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2023-12-05T09:24:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:24:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2023-12-05T09:24:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:24:01.446 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:24:01.446 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 41654sec preferred_lft 41654sec 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2023-12-05T09:24:01.447 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2023-12-05T09:24:01.447 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-05T09:24:01.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:01.448 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-05T09:24:01.448 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-05T09:24:01.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2023-12-05T09:24:01.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2023-12-05T09:24:01.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2023-12-05T09:24:01.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-05T09:24:01.448 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-05T09:24:01.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:01.903 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-05T09:24:01.975 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-05T09:24:01.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:01.979 DEBUG:teuthology.orchestra.run.smithi134:> route 2023-12-05T09:24:02.048 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2023-12-05T09:24:02.069 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-05T09:24:02.069 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-05T09:24:02.069 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-05T09:24:02.069 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-05T09:24:02.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:02.070 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-05T09:24:02.070 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-05T09:24:02.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-05T09:24:02.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-05T09:24:02.070 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-05T09:24:02.070 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-05T09:24:02.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:02.750 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-05T09:24:02.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:02.798 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2023-12-05T09:24:02.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:02.845 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-05T09:24:02.845 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-05T09:24:02.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-05T09:24:02.846 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-05T09:24:02.846 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-05T09:24:02.991 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-05T09:24:02.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:02.991 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-05T09:24:02.991 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-05T09:24:02.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-05T09:24:02.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-05T09:24:02.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-05T09:24:02.992 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-05T09:24:02.992 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-05T09:24:02.992 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-05T09:24:03.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:03.264 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2023-12-05T09:24:03.264 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2023-12-05T09:24:03.264 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2023-12-05T09:24:03.264 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2023-12-05T09:24:03.264 DEBUG:teuthology.orchestra.run.smithi134:> ') 2023-12-05T09:24:03.368 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:03 smithi134 ceph-mon[116304]: pgmap v172: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:24:03.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:03 smithi067 ceph-mon[107174]: pgmap v172: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:24:03.438 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T09:24:03.439 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-05T09:24:03.485 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-05T09:24:03.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-05T09:24:03.485 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-05T09:24:03.571 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-05T09:24:03.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:03.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T09:24:03.722 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T09:24:03.722 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T09:24:03.723 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-12-05T09:24:04.149 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T09:24:04.150 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T09:24:04.150 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-12-05T09:24:04.150 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.134:3300" 2023-12-05T09:24:04.150 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T09:24:04.175 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-05T09:24:04.175 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-05T09:24:04.175 INFO:teuthology.orchestra.run.smithi134.stdout:invalid new device string format 2023-12-05T09:24:04.175 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.134:3300" 2023-12-05T09:24:04.175 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-05T09:24:04.175 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.134:6789" 2023-12-05T09:24:04.175 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.134:6789:/ 2023-12-05T09:24:04.175 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f6a41352-934e-11ee-95a2-87774f69a715" will pass to kernel 2023-12-05T09:24:04.180 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-05T09:24:04.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:04.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-05T09:24:04.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:04.251 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:24:04.350 INFO:teuthology.orchestra.run.smithi134.stdout:client24379 2023-12-05T09:24:04.350 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:24:04.350 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T09:24:04.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:04.397 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:24:04.526 INFO:teuthology.orchestra.run.smithi134.stdout:client24379 2023-12-05T09:24:04.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:04.527 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-05T09:24:04.616 INFO:teuthology.orchestra.run.smithi134.stdout:client24379 2023-12-05T09:24:04.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:24:04.616 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f6a41352-934e-11ee-95a2-87774f69a715.client24379/status') 2023-12-05T09:24:04.725 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.24379 (3)192.168.0.1:0/2454302128 2023-12-05T09:24:04.725 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2023-12-05T09:24:04.725 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2023-12-05T09:24:04.725 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2023-12-05T09:24:04.726 INFO:teuthology.orchestra.run.smithi134.stderr:70 bytes copied, 6.5062e-05 s, 1.1 MB/s 2023-12-05T09:24:04.728 INFO:teuthology.run_tasks:Running task print... 2023-12-05T09:24:04.738 INFO:teuthology.task.print:**** done client 2023-12-05T09:24:04.738 INFO:teuthology.run_tasks:Running task parallel... 2023-12-05T09:24:04.754 INFO:teuthology.task.parallel:starting parallel... 2023-12-05T09:24:04.754 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-05T09:24:04.755 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T09:24:04.755 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:24:04.755 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-05T09:24:04.756 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-05T09:24:04.756 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-05T09:24:04.759 INFO:tasks.workunit:Pulling workunits from ref 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:24:04.759 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-05T09:24:04.759 INFO:tasks.workunit:timeout=3h 2023-12-05T09:24:04.760 INFO:tasks.workunit:cleanup=True 2023-12-05T09:24:04.760 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-05T09:24:04.818 INFO:teuthology.orchestra.run.smithi067.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-05T09:24:04.818 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-05T09:24:04.818 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 96h/150d Inode: 1 Links: 2 2023-12-05T09:24:04.818 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:24:04.818 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-05T09:24:04.818 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-05T09:24:04.818 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-12-05 09:23:31.987607168 +0000 2023-12-05T09:24:04.818 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-12-05 09:23:58.542925837 +0000 2023-12-05T09:24:04.819 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2023-12-05 09:23:31.987607168 +0000 2023-12-05T09:24:04.819 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-05T09:24:04.819 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-05T09:24:04.939 DEBUG:teuthology.orchestra.run.smithi134:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 75h/117d Inode: 1 Links: 3 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-05 09:24:04.930788256 +0000 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-05 09:24:04.930788256 +0000 2023-12-05T09:24:04.988 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2023-12-05 09:23:31.987607168 +0000 2023-12-05T09:24:04.989 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-05T09:24:04.989 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-05T09:24:05.069 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:24:05.069 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:24:05.119 INFO:tasks.workunit.client.1.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-05T09:24:05.124 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-05T09:24:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:24:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:05 smithi134 ceph-mon[116304]: pgmap v173: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:24:05.379 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:05 smithi067 ceph-mon[107174]: pgmap v173: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:24:06.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.489+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/2450395410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fde00 msgr2=0x7fbb080fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:06.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.489+0000 7fbb0cbe1700 1 --2- 172.21.15.67:0/2450395410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fde00 0x7fbb080fe250 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbafc004940 tx=0x7fbafc009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.489+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/2450395410 shutdown_connections 2023-12-05T09:24:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.489+0000 7fbb0cbe1700 1 --2- 172.21.15.67:0/2450395410 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fde00 0x7fbb080fe250 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.489+0000 7fbb0cbe1700 1 --2- 172.21.15.67:0/2450395410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080fcbf0 0x7fbb080fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.489+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/2450395410 >> 172.21.15.67:0/2450395410 conn(0x7fbb080f82d0 msgr2=0x7fbb080fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.489+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/2450395410 shutdown_connections 2023-12-05T09:24:06.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.489+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/2450395410 wait complete. 2023-12-05T09:24:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.490+0000 7fbb0cbe1700 1 Processor -- start 2023-12-05T09:24:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.490+0000 7fbb0cbe1700 1 -- start start 2023-12-05T09:24:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.490+0000 7fbb0cbe1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fcbf0 0x7fbb0810f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.490+0000 7fbb0cbe1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080fde00 0x7fbb0810fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.490+0000 7fbb0cbe1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08110310 con 0x7fbb080fcbf0 2023-12-05T09:24:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.490+0000 7fbb0cbe1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08110b60 con 0x7fbb080fde00 2023-12-05T09:24:06.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.491+0000 7fbb0659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fcbf0 0x7fbb0810f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.491+0000 7fbb0659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fcbf0 0x7fbb0810f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35142/0 (socket says 172.21.15.67:35142) 2023-12-05T09:24:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.491+0000 7fbb0659c700 1 -- 172.21.15.67:0/4175139251 learned_addr learned my addr 172.21.15.67:0/4175139251 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.491+0000 7fbb05d9b700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080fde00 0x7fbb0810fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.491+0000 7fbb0659c700 1 -- 172.21.15.67:0/4175139251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080fde00 msgr2=0x7fbb0810fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.491+0000 7fbb0659c700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080fde00 0x7fbb0810fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.491+0000 7fbb0659c700 1 -- 172.21.15.67:0/4175139251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc005040 con 0x7fbb080fcbf0 2023-12-05T09:24:06.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.491+0000 7fbb0659c700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fcbf0 0x7fbb0810f7d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8002a80 tx=0x7fbaf8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:06.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.492+0000 7fbaf6ffd700 1 -- 172.21.15.67:0/4175139251 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaf8007cc0 con 0x7fbb080fcbf0 2023-12-05T09:24:06.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.492+0000 7fbaf6ffd700 1 -- 172.21.15.67:0/4175139251 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbaf800f040 con 0x7fbb080fcbf0 2023-12-05T09:24:06.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.492+0000 7fbaf6ffd700 1 -- 172.21.15.67:0/4175139251 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaf800da20 con 0x7fbb080fcbf0 2023-12-05T09:24:06.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.492+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb08110e40 con 0x7fbb080fcbf0 2023-12-05T09:24:06.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.492+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb08111380 con 0x7fbb080fcbf0 2023-12-05T09:24:06.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.493+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb08101ea0 con 0x7fbb080fcbf0 2023-12-05T09:24:06.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.494+0000 7fbaf6ffd700 1 -- 172.21.15.67:0/4175139251 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fbaf800db80 con 0x7fbb080fcbf0 2023-12-05T09:24:06.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.495+0000 7fbaf6ffd700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbaf0068f70 0x7fbaf006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:06.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.495+0000 7fbaf6ffd700 1 -- 172.21.15.67:0/4175139251 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbaf8086bb0 con 0x7fbb080fcbf0 2023-12-05T09:24:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.495+0000 7fbb05d9b700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbaf0068f70 0x7fbaf006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:06.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.495+0000 7fbb05d9b700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbaf0068f70 0x7fbaf006b420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbafc004f90 tx=0x7fbafc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:06.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.499+0000 7fbaf6ffd700 1 -- 172.21.15.67:0/4175139251 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbaf8056a20 con 0x7fbb080fcbf0 2023-12-05T09:24:06.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.702+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fbb0804bb80 con 0x7fbb080fcbf0 2023-12-05T09:24:06.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.702+0000 7fbaf6ffd700 1 -- 172.21.15.67:0/4175139251 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fbaf80565b0 con 0x7fbb080fcbf0 2023-12-05T09:24:06.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbaf0068f70 msgr2=0x7fbaf006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:06.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbaf0068f70 0x7fbaf006b420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbafc004f90 tx=0x7fbafc009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:06.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fcbf0 msgr2=0x7fbb0810f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:06.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fcbf0 0x7fbb0810f7d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8002a80 tx=0x7fbaf8004600 comp rx=0 tx=0).stop 2023-12-05T09:24:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 shutdown_connections 2023-12-05T09:24:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fbaf0068f70 0x7fbaf006b420 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb080fcbf0 0x7fbb0810f7d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 --2- 172.21.15.67:0/4175139251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb080fde00 0x7fbb0810fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 >> 172.21.15.67:0/4175139251 conn(0x7fbb080f82d0 msgr2=0x7fbb080ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 shutdown_connections 2023-12-05T09:24:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:06.704+0000 7fbb0cbe1700 1 -- 172.21.15.67:0/4175139251 wait complete. 2023-12-05T09:24:07.134 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-05T09:24:07.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:06 smithi067 ceph-mon[107174]: pgmap v174: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:24:07.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:06 smithi134 ceph-mon[116304]: pgmap v174: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:24:07.573 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.847+0000 7fc91c29d700 1 -- 172.21.15.67:0/2030090363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fcbf0 msgr2=0x7fc9140fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.847+0000 7fc91c29d700 1 --2- 172.21.15.67:0/2030090363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fcbf0 0x7fc9140fd000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc910004940 tx=0x7fc910009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.847+0000 7fc91c29d700 1 -- 172.21.15.67:0/2030090363 shutdown_connections 2023-12-05T09:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.847+0000 7fc91c29d700 1 --2- 172.21.15.67:0/2030090363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9140fde00 0x7fc9140fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.847+0000 7fc91c29d700 1 --2- 172.21.15.67:0/2030090363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fcbf0 0x7fc9140fd000 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.847+0000 7fc91c29d700 1 -- 172.21.15.67:0/2030090363 >> 172.21.15.67:0/2030090363 conn(0x7fc9140f82d0 msgr2=0x7fc9140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.848+0000 7fc91c29d700 1 -- 172.21.15.67:0/2030090363 shutdown_connections 2023-12-05T09:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.848+0000 7fc91c29d700 1 -- 172.21.15.67:0/2030090363 wait complete. 2023-12-05T09:24:08.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.848+0000 7fc91c29d700 1 Processor -- start 2023-12-05T09:24:08.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc91c29d700 1 -- start start 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc91c29d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9140fcbf0 0x7fc91410d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc91c29d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fde00 0x7fc91410daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc91c29d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91410e0a0 con 0x7fc9140fde00 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc91c29d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91410e940 con 0x7fc9140fcbf0 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc919838700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fde00 0x7fc91410daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc919838700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fde00 0x7fc91410daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35150/0 (socket says 172.21.15.67:35150) 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc919838700 1 -- 172.21.15.67:0/3190231122 learned_addr learned my addr 172.21.15.67:0/3190231122 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.849+0000 7fc91a039700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9140fcbf0 0x7fc91410d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc919838700 1 -- 172.21.15.67:0/3190231122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9140fcbf0 msgr2=0x7fc91410d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc919838700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9140fcbf0 0x7fc91410d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc919838700 1 -- 172.21.15.67:0/3190231122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910005040 con 0x7fc9140fde00 2023-12-05T09:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc919838700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fde00 0x7fc91410daa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc904002a50 tx=0x7fc9040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc90affd700 1 -- 172.21.15.67:0/3190231122 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc904007cc0 con 0x7fc9140fde00 2023-12-05T09:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91410ec20 con 0x7fc9140fde00 2023-12-05T09:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc90affd700 1 -- 172.21.15.67:0/3190231122 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc90400f040 con 0x7fc9140fde00 2023-12-05T09:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc90affd700 1 -- 172.21.15.67:0/3190231122 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc90400d9c0 con 0x7fc9140fde00 2023-12-05T09:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.850+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91410f160 con 0x7fc9140fde00 2023-12-05T09:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.851+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91404bb80 con 0x7fc9140fde00 2023-12-05T09:24:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.852+0000 7fc90affd700 1 -- 172.21.15.67:0/3190231122 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fc90400db20 con 0x7fc9140fde00 2023-12-05T09:24:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.853+0000 7fc90affd700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc900068f70 0x7fc90006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.853+0000 7fc90affd700 1 -- 172.21.15.67:0/3190231122 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc904086bc0 con 0x7fc9140fde00 2023-12-05T09:24:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.853+0000 7fc91a039700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc900068f70 0x7fc90006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.854+0000 7fc91a039700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc900068f70 0x7fc90006b420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc91000b3b0 tx=0x7fc910009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:08.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:08.857+0000 7fc90affd700 1 -- 172.21.15.67:0/3190231122 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc9040569b0 con 0x7fc9140fde00 2023-12-05T09:24:09.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.063+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc914105590 con 0x7fc9140fde00 2023-12-05T09:24:09.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.063+0000 7fc90affd700 1 -- 172.21.15.67:0/3190231122 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc904056540 con 0x7fc9140fde00 2023-12-05T09:24:09.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc900068f70 msgr2=0x7fc90006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc900068f70 0x7fc90006b420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc91000b3b0 tx=0x7fc910009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fde00 msgr2=0x7fc91410daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fde00 0x7fc91410daa0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc904002a50 tx=0x7fc9040046b0 comp rx=0 tx=0).stop 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 shutdown_connections 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fc900068f70 0x7fc90006b420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9140fcbf0 0x7fc91410d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 --2- 172.21.15.67:0/3190231122 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc9140fde00 0x7fc91410daa0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.065+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 >> 172.21.15.67:0/3190231122 conn(0x7fc9140f82d0 msgr2=0x7fc914101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.066+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 shutdown_connections 2023-12-05T09:24:09.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:09.066+0000 7fc91c29d700 1 -- 172.21.15.67:0/3190231122 wait complete. 2023-12-05T09:24:09.338 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:09 smithi067 ceph-mon[107174]: pgmap v175: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:24:09.521 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-05T09:24:09.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:09 smithi134 ceph-mon[116304]: pgmap v175: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:24:09.959 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:24:11.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.277+0000 7f9746474700 1 -- 172.21.15.67:0/389997046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fcbf0 msgr2=0x7f97400fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:11.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.277+0000 7f9746474700 1 --2- 172.21.15.67:0/389997046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fcbf0 0x7f97400fd000 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9730004940 tx=0x7f9730009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:11.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.278+0000 7f9746474700 1 -- 172.21.15.67:0/389997046 shutdown_connections 2023-12-05T09:24:11.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.278+0000 7f9746474700 1 --2- 172.21.15.67:0/389997046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97400fde00 0x7f97400fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:11.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.278+0000 7f9746474700 1 --2- 172.21.15.67:0/389997046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fcbf0 0x7f97400fd000 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:11.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.278+0000 7f9746474700 1 -- 172.21.15.67:0/389997046 >> 172.21.15.67:0/389997046 conn(0x7f97400f82d0 msgr2=0x7f97400fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:11.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.278+0000 7f9746474700 1 -- 172.21.15.67:0/389997046 shutdown_connections 2023-12-05T09:24:11.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.278+0000 7f9746474700 1 -- 172.21.15.67:0/389997046 wait complete. 2023-12-05T09:24:11.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.279+0000 7f9746474700 1 Processor -- start 2023-12-05T09:24:11.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.279+0000 7f9746474700 1 -- start start 2023-12-05T09:24:11.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.279+0000 7f9746474700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97400fcbf0 0x7f974010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:11.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.279+0000 7f9746474700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fde00 0x7f974010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:11.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f9746474700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974010e0a0 con 0x7f97400fde00 2023-12-05T09:24:11.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f9746474700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974010e940 con 0x7f97400fcbf0 2023-12-05T09:24:11.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fde00 0x7f974010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:11.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fde00 0x7f974010daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35180/0 (socket says 172.21.15.67:35180) 2023-12-05T09:24:11.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973f7fe700 1 -- 172.21.15.67:0/41804387 learned_addr learned my addr 172.21.15.67:0/41804387 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:11.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973ffff700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97400fcbf0 0x7f974010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:11.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973f7fe700 1 -- 172.21.15.67:0/41804387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97400fcbf0 msgr2=0x7f974010d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:11.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973f7fe700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97400fcbf0 0x7f974010d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:11.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973f7fe700 1 -- 172.21.15.67:0/41804387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9730005040 con 0x7f97400fde00 2023-12-05T09:24:11.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973ffff700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97400fcbf0 0x7f974010d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:24:11.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.280+0000 7f973f7fe700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fde00 0x7f974010daa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9734002a50 tx=0x7f97340046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:11.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.281+0000 7f973cff9700 1 -- 172.21.15.67:0/41804387 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9734007cc0 con 0x7f97400fde00 2023-12-05T09:24:11.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.281+0000 7f973cff9700 1 -- 172.21.15.67:0/41804387 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f973400f040 con 0x7f97400fde00 2023-12-05T09:24:11.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.281+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974010ec20 con 0x7f97400fde00 2023-12-05T09:24:11.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.281+0000 7f973cff9700 1 -- 172.21.15.67:0/41804387 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9734009540 con 0x7f97400fde00 2023-12-05T09:24:11.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.281+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974010f160 con 0x7f97400fde00 2023-12-05T09:24:11.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.282+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974004bb80 con 0x7f97400fde00 2023-12-05T09:24:11.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.283+0000 7f973cff9700 1 -- 172.21.15.67:0/41804387 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f97340096a0 con 0x7f97400fde00 2023-12-05T09:24:11.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.284+0000 7f973cff9700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9728068f70 0x7f972806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:11.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.284+0000 7f973cff9700 1 -- 172.21.15.67:0/41804387 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9734086b10 con 0x7f97400fde00 2023-12-05T09:24:11.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.285+0000 7f973ffff700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9728068f70 0x7f972806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:11.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.285+0000 7f973ffff700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9728068f70 0x7f972806b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9730004f90 tx=0x7f9730009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:11.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.289+0000 7f973cff9700 1 -- 172.21.15.67:0/41804387 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9734056a20 con 0x7f97400fde00 2023-12-05T09:24:11.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:11 smithi067 ceph-mon[107174]: pgmap v176: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-05T09:24:11.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:11 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:24:11.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.490+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f9740105590 con 0x7f97400fde00 2023-12-05T09:24:11.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.490+0000 7f973cff9700 1 -- 172.21.15.67:0/41804387 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f97340565b0 con 0x7f97400fde00 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9728068f70 msgr2=0x7f972806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9728068f70 0x7f972806b420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9730004f90 tx=0x7f9730009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fde00 msgr2=0x7f974010daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fde00 0x7f974010daa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9734002a50 tx=0x7f97340046b0 comp rx=0 tx=0).stop 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 shutdown_connections 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9728068f70 0x7f972806b420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97400fcbf0 0x7f974010d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 --2- 172.21.15.67:0/41804387 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97400fde00 0x7f974010daa0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:11.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 >> 172.21.15.67:0/41804387 conn(0x7f97400f82d0 msgr2=0x7f9740101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 shutdown_connections 2023-12-05T09:24:11.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:11.493+0000 7f9746474700 1 -- 172.21.15.67:0/41804387 wait complete. 2023-12-05T09:24:11.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:11 smithi134 ceph-mon[116304]: pgmap v176: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2023-12-05T09:24:11.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:11 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:24:11.910 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2023-12-05T09:24:12.348 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:24:13.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.598+0000 7f7e04ed2700 1 -- 172.21.15.67:0/831128884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fde00 msgr2=0x7f7e000fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.598+0000 7f7e04ed2700 1 --2- 172.21.15.67:0/831128884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fde00 0x7f7e000fe250 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7df4004940 tx=0x7f7df4009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.598+0000 7f7e04ed2700 1 -- 172.21.15.67:0/831128884 shutdown_connections 2023-12-05T09:24:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.598+0000 7f7e04ed2700 1 --2- 172.21.15.67:0/831128884 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fde00 0x7f7e000fe250 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.598+0000 7f7e04ed2700 1 --2- 172.21.15.67:0/831128884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e000fcbf0 0x7f7e000fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.598+0000 7f7e04ed2700 1 -- 172.21.15.67:0/831128884 >> 172.21.15.67:0/831128884 conn(0x7f7e000f82d0 msgr2=0x7f7e000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.598+0000 7f7e04ed2700 1 -- 172.21.15.67:0/831128884 shutdown_connections 2023-12-05T09:24:13.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.598+0000 7f7e04ed2700 1 -- 172.21.15.67:0/831128884 wait complete. 2023-12-05T09:24:13.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.599+0000 7f7e04ed2700 1 Processor -- start 2023-12-05T09:24:13.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.599+0000 7f7e04ed2700 1 -- start start 2023-12-05T09:24:13.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7e04ed2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fcbf0 0x7f7e0010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:13.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7e04ed2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e000fde00 0x7f7e0010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:13.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7e04ed2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0010e0c0 con 0x7f7e000fcbf0 2023-12-05T09:24:13.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7e04ed2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0010e960 con 0x7f7e000fde00 2023-12-05T09:24:13.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7dfe59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fcbf0 0x7f7e0010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:13.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7dfe59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fcbf0 0x7f7e0010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35196/0 (socket says 172.21.15.67:35196) 2023-12-05T09:24:13.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7dfe59c700 1 -- 172.21.15.67:0/815980439 learned_addr learned my addr 172.21.15.67:0/815980439 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:13.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7dfdd9b700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e000fde00 0x7f7e0010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:13.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.600+0000 7f7dfe59c700 1 -- 172.21.15.67:0/815980439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e000fde00 msgr2=0x7f7e0010dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:13.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.601+0000 7f7dfe59c700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e000fde00 0x7f7e0010dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:13.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.601+0000 7f7dfe59c700 1 -- 172.21.15.67:0/815980439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4005040 con 0x7f7e000fcbf0 2023-12-05T09:24:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.601+0000 7f7dfe59c700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fcbf0 0x7f7e0010d580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7df0002a80 tx=0x7f7df0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.601+0000 7f7deeffd700 1 -- 172.21.15.67:0/815980439 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7df0007cc0 con 0x7f7e000fcbf0 2023-12-05T09:24:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.601+0000 7f7deeffd700 1 -- 172.21.15.67:0/815980439 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7df000f040 con 0x7f7e000fcbf0 2023-12-05T09:24:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.601+0000 7f7deeffd700 1 -- 172.21.15.67:0/815980439 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7df000d9c0 con 0x7f7e000fcbf0 2023-12-05T09:24:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.601+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0010ec40 con 0x7f7e000fcbf0 2023-12-05T09:24:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.601+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0010f130 con 0x7f7e000fcbf0 2023-12-05T09:24:13.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.602+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0004bb80 con 0x7f7e000fcbf0 2023-12-05T09:24:13.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.603+0000 7f7deeffd700 1 -- 172.21.15.67:0/815980439 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7df000db20 con 0x7f7e000fcbf0 2023-12-05T09:24:13.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.604+0000 7f7deeffd700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7de8068f60 0x7f7de806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:13.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.604+0000 7f7deeffd700 1 -- 172.21.15.67:0/815980439 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7df0086bb0 con 0x7f7e000fcbf0 2023-12-05T09:24:13.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.604+0000 7f7dfdd9b700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7de8068f60 0x7f7de806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:13.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.605+0000 7f7dfdd9b700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7de8068f60 0x7f7de806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7df4004890 tx=0x7f7df4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:13.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.608+0000 7f7deeffd700 1 -- 172.21.15.67:0/815980439 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7df00569a0 con 0x7f7e000fcbf0 2023-12-05T09:24:13.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:13 smithi067 ceph-mon[107174]: pgmap v177: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-05T09:24:13.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:13 smithi134 ceph-mon[116304]: pgmap v177: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-05T09:24:13.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:13.827+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e0010f5d0 con 0x7f7de8068f60 2023-12-05T09:24:15.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:15 smithi067 ceph-mon[107174]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:15.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:15 smithi067 ceph-mon[107174]: pgmap v178: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-05T09:24:15.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:15 smithi134 ceph-mon[116304]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:15.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:15 smithi134 ceph-mon[116304]: pgmap v178: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2023-12-05T09:24:17.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:16 smithi067 ceph-mon[107174]: pgmap v179: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-05T09:24:17.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:16 smithi134 ceph-mon[116304]: pgmap v179: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-05T09:24:19.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:19 smithi067 ceph-mon[107174]: pgmap v180: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-05T09:24:19.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:19 smithi134 ceph-mon[116304]: pgmap v180: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2023-12-05T09:24:21.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:21 smithi067 ceph-mon[107174]: pgmap v181: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:24:21.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:21 smithi134 ceph-mon[116304]: pgmap v181: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:24:23.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:23 smithi067 ceph-mon[107174]: pgmap v182: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:23.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:23 smithi134 ceph-mon[116304]: pgmap v182: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:25.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:25 smithi067 ceph-mon[107174]: pgmap v183: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:25.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:25 smithi134 ceph-mon[116304]: pgmap v183: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:27.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:26 smithi067 ceph-mon[107174]: pgmap v184: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:27.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:26 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:24:27.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:26 smithi134 ceph-mon[116304]: pgmap v184: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:27.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:26 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:24:29.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:29 smithi067 ceph-mon[107174]: pgmap v185: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:29.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:29 smithi134 ceph-mon[116304]: pgmap v185: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:31 smithi067 ceph-mon[107174]: pgmap v186: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:31 smithi134 ceph-mon[116304]: pgmap v186: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:33.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:33 smithi067 ceph-mon[107174]: pgmap v187: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:33.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:33 smithi134 ceph-mon[116304]: pgmap v187: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:35.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:35 smithi067 ceph-mon[107174]: pgmap v188: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:35.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:35 smithi134 ceph-mon[116304]: pgmap v188: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:37.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:36 smithi067 ceph-mon[107174]: pgmap v189: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:37.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:37 smithi134 ceph-mon[116304]: pgmap v189: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:39.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:39 smithi067 ceph-mon[107174]: pgmap v190: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:39.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:39 smithi134 ceph-mon[116304]: pgmap v190: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:24:41.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:41 smithi067 ceph-mon[107174]: pgmap v191: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:24:41.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:41 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:24:41.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:41 smithi134 ceph-mon[116304]: pgmap v191: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:24:41.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:41 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:24:43.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:43 smithi067 ceph-mon[107174]: pgmap v192: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:24:43.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:43 smithi134 ceph-mon[116304]: pgmap v192: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:24:45.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:45 smithi067 ceph-mon[107174]: pgmap v193: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:24:45.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:45 smithi134 ceph-mon[116304]: pgmap v193: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:24:47.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:47 smithi067 ceph-mon[107174]: pgmap v194: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:24:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:47 smithi134 ceph-mon[116304]: pgmap v194: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2023-12-05T09:24:47.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.852+0000 7f7deeffd700 1 -- 172.21.15.67:0/815980439 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f7e0010f5d0 con 0x7f7de8068f60 2023-12-05T09:24:47.853 INFO:teuthology.orchestra.run.smithi067.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7de8068f60 msgr2=0x7f7de806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7de8068f60 0x7f7de806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7df4004890 tx=0x7f7df4009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fcbf0 msgr2=0x7f7e0010d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fcbf0 0x7f7e0010d580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7df0002a80 tx=0x7f7df0004600 comp rx=0 tx=0).stop 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 shutdown_connections 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7de8068f60 0x7f7de806b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e000fcbf0 0x7f7e0010d580 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 --2- 172.21.15.67:0/815980439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e000fde00 0x7f7e0010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 >> 172.21.15.67:0/815980439 conn(0x7f7e000f82d0 msgr2=0x7f7e00101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 shutdown_connections 2023-12-05T09:24:47.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:47.856+0000 7f7e04ed2700 1 -- 172.21.15.67:0/815980439 wait complete. 2023-12-05T09:24:48.288 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2023-12-05T09:24:48.858 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:48 smithi067 ceph-mon[107174]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:24:48.858 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:48 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:24:48.858 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:48 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:24:48.858 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:48 smithi067 ceph-mon[107174]: pgmap v195: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:24:48.914 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:24:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:48 smithi134 ceph-mon[116304]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:24:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:24:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:48 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:24:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:48 smithi134 ceph-mon[116304]: pgmap v195: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:24:50.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:49 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:24:50.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:49 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:24:50.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:49 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:24:50.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:49 smithi067 ceph-mon[107174]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:24:50.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:49 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:24:50.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:49 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:24:50.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:49 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:24:50.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:49 smithi134 ceph-mon[116304]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:24:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.509+0000 7f134c8bd700 1 -- 172.21.15.67:0/64657247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1348066070 msgr2=0x7f13480ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.509+0000 7f134c8bd700 1 --2- 172.21.15.67:0/64657247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1348066070 0x7f13480ff7c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1338004940 tx=0x7f1338009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.509+0000 7f134c8bd700 1 -- 172.21.15.67:0/64657247 shutdown_connections 2023-12-05T09:24:50.509 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.509+0000 7f134c8bd700 1 --2- 172.21.15.67:0/64657247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13480ffd90 0x7f13481021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.509+0000 7f134c8bd700 1 --2- 172.21.15.67:0/64657247 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1348066070 0x7f13480ff7c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.509+0000 7f134c8bd700 1 -- 172.21.15.67:0/64657247 >> 172.21.15.67:0/64657247 conn(0x7f13480f7190 msgr2=0x7f13480f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.509+0000 7f134c8bd700 1 -- 172.21.15.67:0/64657247 shutdown_connections 2023-12-05T09:24:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.510+0000 7f134c8bd700 1 -- 172.21.15.67:0/64657247 wait complete. 2023-12-05T09:24:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.510+0000 7f134c8bd700 1 Processor -- start 2023-12-05T09:24:50.510 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.511+0000 7f134c8bd700 1 -- start start 2023-12-05T09:24:50.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.511+0000 7f134c8bd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1348066070 0x7f134810f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:50.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.511+0000 7f134c8bd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13480ffd90 0x7f134810fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:50.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.511+0000 7f134c8bd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348110240 con 0x7f13480ffd90 2023-12-05T09:24:50.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.511+0000 7f134c8bd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348110ae0 con 0x7f1348066070 2023-12-05T09:24:50.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.511+0000 7f134659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1348066070 0x7f134810f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:50.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.511+0000 7f134659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1348066070 0x7f134810f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:43612/0 (socket says 172.21.15.67:43612) 2023-12-05T09:24:50.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.512+0000 7f134659c700 1 -- 172.21.15.67:0/2568548335 learned_addr learned my addr 172.21.15.67:0/2568548335 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:50.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.512+0000 7f1345d9b700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13480ffd90 0x7f134810fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:50.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.512+0000 7f134659c700 1 -- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13480ffd90 msgr2=0x7f134810fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:50.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.512+0000 7f134659c700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13480ffd90 0x7f134810fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:50.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.512+0000 7f134659c700 1 -- 172.21.15.67:0/2568548335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338005040 con 0x7f1348066070 2023-12-05T09:24:50.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.512+0000 7f134659c700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1348066070 0x7f134810f700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1338004890 tx=0x7f1338009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:50.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.513+0000 7f1336ffd700 1 -- 172.21.15.67:0/2568548335 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133800e070 con 0x7f1348066070 2023-12-05T09:24:50.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.513+0000 7f1336ffd700 1 -- 172.21.15.67:0/2568548335 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1338004290 con 0x7f1348066070 2023-12-05T09:24:50.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.513+0000 7f1336ffd700 1 -- 172.21.15.67:0/2568548335 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f133800b410 con 0x7f1348066070 2023-12-05T09:24:50.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.514+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1348110d60 con 0x7f1348066070 2023-12-05T09:24:50.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.514+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1348111210 con 0x7f1348066070 2023-12-05T09:24:50.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.515+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134804bb80 con 0x7f1348066070 2023-12-05T09:24:50.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.517+0000 7f1336ffd700 1 -- 172.21.15.67:0/2568548335 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f133801c400 con 0x7f1348066070 2023-12-05T09:24:50.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.518+0000 7f1336ffd700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1330068fc0 0x7f133006b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:50.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.519+0000 7f1336ffd700 1 -- 172.21.15.67:0/2568548335 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1338087af0 con 0x7f1348066070 2023-12-05T09:24:50.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.519+0000 7f1345d9b700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1330068fc0 0x7f133006b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:50.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.520+0000 7f1345d9b700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1330068fc0 0x7f133006b470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f133c004600 tx=0x7f133c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:50.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.524+0000 7f1336ffd700 1 -- 172.21.15.67:0/2568548335 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f13380579e0 con 0x7f1348066070 2023-12-05T09:24:50.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.901+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13481118c0 con 0x7f1330068fc0 2023-12-05T09:24:50.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.902+0000 7f1336ffd700 1 -- 172.21.15.67:0/2568548335 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f13481118c0 con 0x7f1330068fc0 2023-12-05T09:24:50.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1330068fc0 msgr2=0x7f133006b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:50.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1330068fc0 0x7f133006b470 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f133c004600 tx=0x7f133c00b040 comp rx=0 tx=0).stop 2023-12-05T09:24:50.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1348066070 msgr2=0x7f134810f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:50.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1348066070 0x7f134810f700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1338004890 tx=0x7f1338009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:50.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 shutdown_connections 2023-12-05T09:24:50.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f1330068fc0 0x7f133006b470 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:50.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1348066070 0x7f134810f700 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:50.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 --2- 172.21.15.67:0/2568548335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f13480ffd90 0x7f134810fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:50.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 >> 172.21.15.67:0/2568548335 conn(0x7f13480f7190 msgr2=0x7f13480f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:50.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.905+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 shutdown_connections 2023-12-05T09:24:50.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:50.906+0000 7f134c8bd700 1 -- 172.21.15.67:0/2568548335 wait complete. 2023-12-05T09:24:50.921 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:24:51.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.082+0000 7f488f18c700 1 -- 172.21.15.67:0/223483508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880fb320 msgr2=0x7f48880fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:51.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.082+0000 7f488f18c700 1 --2- 172.21.15.67:0/223483508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880fb320 0x7f48880fd740 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4884004940 tx=0x7f4884009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:51.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.082+0000 7f488f18c700 1 -- 172.21.15.67:0/223483508 shutdown_connections 2023-12-05T09:24:51.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.082+0000 7f488f18c700 1 --2- 172.21.15.67:0/223483508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fdc80 0x7f4888100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.082+0000 7f488f18c700 1 --2- 172.21.15.67:0/223483508 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880fb320 0x7f48880fd740 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.082+0000 7f488f18c700 1 -- 172.21.15.67:0/223483508 >> 172.21.15.67:0/223483508 conn(0x7f48880f6f70 msgr2=0x7f48880f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:51.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.082+0000 7f488f18c700 1 -- 172.21.15.67:0/223483508 shutdown_connections 2023-12-05T09:24:51.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.082+0000 7f488f18c700 1 -- 172.21.15.67:0/223483508 wait complete. 2023-12-05T09:24:51.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.083+0000 7f488f18c700 1 Processor -- start 2023-12-05T09:24:51.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.084+0000 7f488f18c700 1 -- start start 2023-12-05T09:24:51.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.084+0000 7f488f18c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fb320 0x7f4888113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:51.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.084+0000 7f488f18c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880fdc80 0x7f4888113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.084+0000 7f488f18c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4888114440 con 0x7f48880fdc80 2023-12-05T09:24:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.084+0000 7f488f18c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4888114ce0 con 0x7f48880fb320 2023-12-05T09:24:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.085+0000 7f488e18a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fb320 0x7f4888113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.085+0000 7f488e18a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fb320 0x7f4888113900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:43632/0 (socket says 172.21.15.67:43632) 2023-12-05T09:24:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.085+0000 7f488e18a700 1 -- 172.21.15.67:0/1050423965 learned_addr learned my addr 172.21.15.67:0/1050423965 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.085+0000 7f488d989700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880fdc80 0x7f4888113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:51.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.086+0000 7f488e18a700 1 -- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880fdc80 msgr2=0x7f4888113e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:51.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.086+0000 7f488e18a700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880fdc80 0x7f4888113e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.086+0000 7f488e18a700 1 -- 172.21.15.67:0/1050423965 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884005040 con 0x7f48880fb320 2023-12-05T09:24:51.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.086+0000 7f488e18a700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fb320 0x7f4888113900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4884009fd0 tx=0x7f4884009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.087+0000 7f487effd700 1 -- 172.21.15.67:0/1050423965 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f488400e040 con 0x7f48880fb320 2023-12-05T09:24:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.087+0000 7f487effd700 1 -- 172.21.15.67:0/1050423965 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4884004290 con 0x7f48880fb320 2023-12-05T09:24:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.087+0000 7f487effd700 1 -- 172.21.15.67:0/1050423965 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f488401c3f0 con 0x7f48880fb320 2023-12-05T09:24:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.087+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4888114f60 con 0x7f48880fb320 2023-12-05T09:24:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.087+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48881154a0 con 0x7f48880fb320 2023-12-05T09:24:51.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.089+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488804bb80 con 0x7f48880fb320 2023-12-05T09:24:51.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.090+0000 7f487effd700 1 -- 172.21.15.67:0/1050423965 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f488400bc50 con 0x7f48880fb320 2023-12-05T09:24:51.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.092+0000 7f487effd700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4874069020 0x7f487406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:51.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.092+0000 7f487effd700 1 -- 172.21.15.67:0/1050423965 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4884088150 con 0x7f48880fb320 2023-12-05T09:24:51.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.093+0000 7f488d989700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4874069020 0x7f487406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:51.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.094+0000 7f488d989700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4874069020 0x7f487406b4d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4878004f40 tx=0x7f487800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:51.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.099+0000 7f487effd700 1 -- 172.21.15.67:0/1050423965 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4884058040 con 0x7f48880fb320 2023-12-05T09:24:51.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:50 smithi067 ceph-mon[107174]: pgmap v196: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:24:51.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:50 smithi134 ceph-mon[116304]: pgmap v196: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2023-12-05T09:24:51.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.476+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4888115b40 con 0x7f4874069020 2023-12-05T09:24:51.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.478+0000 7f487effd700 1 -- 172.21.15.67:0/1050423965 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f4888115b40 con 0x7f4874069020 2023-12-05T09:24:51.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4874069020 msgr2=0x7f487406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:51.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4874069020 0x7f487406b4d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4878004f40 tx=0x7f487800b040 comp rx=0 tx=0).stop 2023-12-05T09:24:51.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fb320 msgr2=0x7f4888113900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:51.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fb320 0x7f4888113900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4884009fd0 tx=0x7f4884009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:51.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 shutdown_connections 2023-12-05T09:24:51.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4874069020 0x7f487406b4d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fb320 0x7f4888113900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 --2- 172.21.15.67:0/1050423965 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48880fdc80 0x7f4888113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.480+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 >> 172.21.15.67:0/1050423965 conn(0x7f48880f6f70 msgr2=0x7f48880f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:51.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.481+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 shutdown_connections 2023-12-05T09:24:51.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.481+0000 7f488f18c700 1 -- 172.21.15.67:0/1050423965 wait complete. 2023-12-05T09:24:51.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.657+0000 7f99409bd700 1 -- 172.21.15.67:0/1287387846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c100050 msgr2=0x7f993c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:51.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.657+0000 7f99409bd700 1 --2- 172.21.15.67:0/1287387846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c100050 0x7f993c102430 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9930004940 tx=0x7f9930009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:51.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.658+0000 7f99409bd700 1 -- 172.21.15.67:0/1287387846 shutdown_connections 2023-12-05T09:24:51.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.658+0000 7f99409bd700 1 --2- 172.21.15.67:0/1287387846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c100050 0x7f993c102430 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.658+0000 7f99409bd700 1 --2- 172.21.15.67:0/1287387846 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f993c0fd730 0x7f993c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.658+0000 7f99409bd700 1 -- 172.21.15.67:0/1287387846 >> 172.21.15.67:0/1287387846 conn(0x7f993c0f7190 msgr2=0x7f993c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:51.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.658+0000 7f99409bd700 1 -- 172.21.15.67:0/1287387846 shutdown_connections 2023-12-05T09:24:51.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.658+0000 7f99409bd700 1 -- 172.21.15.67:0/1287387846 wait complete. 2023-12-05T09:24:51.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.659+0000 7f99409bd700 1 Processor -- start 2023-12-05T09:24:51.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.659+0000 7f99409bd700 1 -- start start 2023-12-05T09:24:51.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.660+0000 7f99409bd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c0fd730 0x7f993c10f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:51.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.660+0000 7f99409bd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f993c100050 0x7f993c10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:51.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.660+0000 7f99409bd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c1101f0 con 0x7f993c0fd730 2023-12-05T09:24:51.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.660+0000 7f99409bd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c110a90 con 0x7f993c100050 2023-12-05T09:24:51.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.660+0000 7f993a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c0fd730 0x7f993c10f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:51.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.660+0000 7f993a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c0fd730 0x7f993c10f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39540/0 (socket says 172.21.15.67:39540) 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.660+0000 7f993a59c700 1 -- 172.21.15.67:0/2934218404 learned_addr learned my addr 172.21.15.67:0/2934218404 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f9939d9b700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f993c100050 0x7f993c10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f993a59c700 1 -- 172.21.15.67:0/2934218404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f993c100050 msgr2=0x7f993c10fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f993a59c700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f993c100050 0x7f993c10fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f993a59c700 1 -- 172.21.15.67:0/2934218404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9930005040 con 0x7f993c0fd730 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f9939d9b700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f993c100050 0x7f993c10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f993a59c700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c0fd730 0x7f993c10f6b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f992c00eb40 tx=0x7f992c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f992affd700 1 -- 172.21.15.67:0/2934218404 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992c007cc0 con 0x7f993c0fd730 2023-12-05T09:24:51.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f992affd700 1 -- 172.21.15.67:0/2934218404 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f992c00f040 con 0x7f993c0fd730 2023-12-05T09:24:51.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f992affd700 1 -- 172.21.15.67:0/2934218404 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f992c009570 con 0x7f993c0fd730 2023-12-05T09:24:51.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.661+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c110d10 con 0x7f993c0fd730 2023-12-05T09:24:51.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.662+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c111250 con 0x7f993c0fd730 2023-12-05T09:24:51.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.663+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c0f8d30 con 0x7f993c0fd730 2023-12-05T09:24:51.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.665+0000 7f992affd700 1 -- 172.21.15.67:0/2934218404 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f992c0096d0 con 0x7f993c0fd730 2023-12-05T09:24:51.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.666+0000 7f992affd700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9924068f70 0x7f992406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:51.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.667+0000 7f992affd700 1 -- 172.21.15.67:0/2934218404 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f992c0868e0 con 0x7f993c0fd730 2023-12-05T09:24:51.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.667+0000 7f9939d9b700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9924068f70 0x7f992406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:51.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.668+0000 7f9939d9b700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9924068f70 0x7f992406b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9930004560 tx=0x7f9930009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:51.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.674+0000 7f992affd700 1 -- 172.21.15.67:0/2934218404 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f992c0567f0 con 0x7f993c0fd730 2023-12-05T09:24:51.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.926+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f993c111690 con 0x7f9924068f70 2023-12-05T09:24:51.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.936+0000 7f992affd700 1 -- 172.21.15.67:0/2934218404 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f993c111690 con 0x7f9924068f70 2023-12-05T09:24:51.936 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:24:51.936 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (4m) 61s ago 6m 14.7M - 0.25.0 c8568f914cd2 705e76e175ab 2023-12-05T09:24:51.936 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (6m) 61s ago 6m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:24:51.936 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (5m) 64s ago 5m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (4m) 61s ago 5m 79.9M - 9.4.7 2c41d148cca3 110448c1bfef 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (81s) 61s ago 80s 15.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (75s) 61s ago 75s 14.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (72s) 64s ago 72s 11.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (78s) 64s ago 78s 12.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:9283 running (7m) 61s ago 7m 503M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 01173e871e1b 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283 running (5m) 64s ago 5m 442M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dc026bba702 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (7m) 61s ago 7m 72.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (5m) 64s ago 5m 49.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (6m) 61s ago 6m 8652k - 1.5.0 0da6a335fe13 7d8553eb4b47 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 64s ago 5m 8782k - 1.5.0 0da6a335fe13 2301b35d1166 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (4m) 61s ago 4m 55.2M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (4m) 61s ago 4m 60.8M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (3m) 61s ago 3m 55.0M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:24:51.937 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (3m) 64s ago 3m 54.4M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:24:51.938 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (2m) 64s ago 2m 49.6M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:24:51.938 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (2m) 64s ago 2m 50.1M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:24:51.938 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (4m) 61s ago 5m 42.5M - 2.43.0 a07b618ecd1d a79077dfa046 2023-12-05T09:24:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9924068f70 msgr2=0x7f992406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9924068f70 0x7f992406b420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9930004560 tx=0x7f9930009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c0fd730 msgr2=0x7f993c10f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c0fd730 0x7f993c10f6b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f992c00eb40 tx=0x7f992c00b040 comp rx=0 tx=0).stop 2023-12-05T09:24:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 shutdown_connections 2023-12-05T09:24:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f9924068f70 0x7f992406b420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f993c0fd730 0x7f993c10f6b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 --2- 172.21.15.67:0/2934218404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f993c100050 0x7f993c10fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:51.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 >> 172.21.15.67:0/2934218404 conn(0x7f993c0f7190 msgr2=0x7f993c100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:51.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 shutdown_connections 2023-12-05T09:24:51.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:51.940+0000 7f99409bd700 1 -- 172.21.15.67:0/2934218404 wait complete. 2023-12-05T09:24:52.002 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:52 smithi067 ceph-mon[107174]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:52.002 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:52 smithi067 ceph-mon[107174]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:52.002 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:52 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:24:52.002 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:52 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:24:52.002 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:52 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:24:52.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.119+0000 7f40bd872700 1 -- 172.21.15.67:0/4054982448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fdc20 msgr2=0x7f40b80fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:52.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.119+0000 7f40bd872700 1 --2- 172.21.15.67:0/4054982448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fdc20 0x7f40b80fe070 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f40a4004940 tx=0x7f40a4009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:52.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.120+0000 7f40bd872700 1 -- 172.21.15.67:0/4054982448 shutdown_connections 2023-12-05T09:24:52.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.120+0000 7f40bd872700 1 --2- 172.21.15.67:0/4054982448 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fdc20 0x7f40b80fe070 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.120+0000 7f40bd872700 1 --2- 172.21.15.67:0/4054982448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b80fca10 0x7f40b80fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.120+0000 7f40bd872700 1 -- 172.21.15.67:0/4054982448 >> 172.21.15.67:0/4054982448 conn(0x7f40b80f80d0 msgr2=0x7f40b80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:52.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.120+0000 7f40bd872700 1 -- 172.21.15.67:0/4054982448 shutdown_connections 2023-12-05T09:24:52.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.120+0000 7f40bd872700 1 -- 172.21.15.67:0/4054982448 wait complete. 2023-12-05T09:24:52.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.121+0000 7f40bd872700 1 Processor -- start 2023-12-05T09:24:52.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.121+0000 7f40bd872700 1 -- start start 2023-12-05T09:24:52.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.121+0000 7f40bd872700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fca10 0x7f40b810f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:52.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.121+0000 7f40bd872700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b80fdc20 0x7f40b810f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:52.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.122+0000 7f40bd872700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b810ffd0 con 0x7f40b80fca10 2023-12-05T09:24:52.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.122+0000 7f40bd872700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8110870 con 0x7f40b80fdc20 2023-12-05T09:24:52.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.122+0000 7f40bc870700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fca10 0x7f40b810f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:52.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.122+0000 7f40b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b80fdc20 0x7f40b810f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:52.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.122+0000 7f40b7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b80fdc20 0x7f40b810f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:43666/0 (socket says 172.21.15.67:43666) 2023-12-05T09:24:52.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.122+0000 7f40bc870700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fca10 0x7f40b810f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39572/0 (socket says 172.21.15.67:39572) 2023-12-05T09:24:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.122+0000 7f40b7fff700 1 -- 172.21.15.67:0/1775984687 learned_addr learned my addr 172.21.15.67:0/1775984687 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.122+0000 7f40bc870700 1 -- 172.21.15.67:0/1775984687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b80fdc20 msgr2=0x7f40b810f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.123+0000 7f40bc870700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b80fdc20 0x7f40b810f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.123+0000 7f40bc870700 1 -- 172.21.15.67:0/1775984687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a4005040 con 0x7f40b80fca10 2023-12-05T09:24:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.123+0000 7f40bc870700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fca10 0x7f40b810f490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f40b80fda80 tx=0x7f40ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.123+0000 7f40b57fa700 1 -- 172.21.15.67:0/1775984687 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40ac004e90 con 0x7f40b80fca10 2023-12-05T09:24:52.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.123+0000 7f40b57fa700 1 -- 172.21.15.67:0/1775984687 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f40ac00f040 con 0x7f40b80fca10 2023-12-05T09:24:52.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.123+0000 7f40b57fa700 1 -- 172.21.15.67:0/1775984687 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40ac00c890 con 0x7f40b80fca10 2023-12-05T09:24:52.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.123+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b8110af0 con 0x7f40b80fca10 2023-12-05T09:24:52.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.123+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b8111030 con 0x7f40b80fca10 2023-12-05T09:24:52.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.125+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b8101cc0 con 0x7f40b80fca10 2023-12-05T09:24:52.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.126+0000 7f40b57fa700 1 -- 172.21.15.67:0/1775984687 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f40ac00ca10 con 0x7f40b80fca10 2023-12-05T09:24:52.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.127+0000 7f40b57fa700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f40a8068f70 0x7f40a806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:52.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.127+0000 7f40b57fa700 1 -- 172.21.15.67:0/1775984687 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f40ac0867b0 con 0x7f40b80fca10 2023-12-05T09:24:52.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.128+0000 7f40b7fff700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f40a8068f70 0x7f40a806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:52.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.129+0000 7f40b7fff700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f40a8068f70 0x7f40a806b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40a40136a0 tx=0x7f40a4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:52.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.132+0000 7f40b57fa700 1 -- 172.21.15.67:0/1775984687 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f40ac04da00 con 0x7f40b80fca10 2023-12-05T09:24:52.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:52 smithi134 ceph-mon[116304]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:52.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:52 smithi134 ceph-mon[116304]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:52.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:52 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:24:52.352 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:52 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:24:52.353 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:52 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:24:52.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.602+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40b81053b0 con 0x7f40b80fca10 2023-12-05T09:24:52.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.603+0000 7f40b57fa700 1 -- 172.21.15.67:0/1775984687 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f40ac0566d0 con 0x7f40b80fca10 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:24:52.604 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 14 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.605+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f40a8068f70 msgr2=0x7f40a806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.605+0000 7f40bd872700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f40a8068f70 0x7f40a806b420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f40a40136a0 tx=0x7f40a4009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.605+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fca10 msgr2=0x7f40b810f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.605+0000 7f40bd872700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fca10 0x7f40b810f490 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f40b80fda80 tx=0x7f40ac00b040 comp rx=0 tx=0).stop 2023-12-05T09:24:52.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.606+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 shutdown_connections 2023-12-05T09:24:52.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.606+0000 7f40bd872700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f40a8068f70 0x7f40a806b420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.606+0000 7f40bd872700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40b80fca10 0x7f40b810f490 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.606+0000 7f40bd872700 1 --2- 172.21.15.67:0/1775984687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40b80fdc20 0x7f40b810f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.606+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 >> 172.21.15.67:0/1775984687 conn(0x7f40b80f80d0 msgr2=0x7f40b80fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:52.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.606+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 shutdown_connections 2023-12-05T09:24:52.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.606+0000 7f40bd872700 1 -- 172.21.15.67:0/1775984687 wait complete. 2023-12-05T09:24:52.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.813+0000 7fb469e9d700 1 -- 172.21.15.67:0/1653596583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb464100050 msgr2=0x7fb464102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:52.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.813+0000 7fb469e9d700 1 --2- 172.21.15.67:0/1653596583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb464100050 0x7fb464102430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb458004940 tx=0x7fb458009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:52.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.813+0000 7fb469e9d700 1 -- 172.21.15.67:0/1653596583 shutdown_connections 2023-12-05T09:24:52.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.813+0000 7fb469e9d700 1 --2- 172.21.15.67:0/1653596583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb464100050 0x7fb464102430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.813+0000 7fb469e9d700 1 --2- 172.21.15.67:0/1653596583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4640fd730 0x7fb4640ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.813+0000 7fb469e9d700 1 -- 172.21.15.67:0/1653596583 >> 172.21.15.67:0/1653596583 conn(0x7fb4640f7190 msgr2=0x7fb4640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:52.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.813+0000 7fb469e9d700 1 -- 172.21.15.67:0/1653596583 shutdown_connections 2023-12-05T09:24:52.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.813+0000 7fb469e9d700 1 -- 172.21.15.67:0/1653596583 wait complete. 2023-12-05T09:24:52.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.815+0000 7fb469e9d700 1 Processor -- start 2023-12-05T09:24:52.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.815+0000 7fb469e9d700 1 -- start start 2023-12-05T09:24:52.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.815+0000 7fb469e9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4640fd730 0x7fb46410d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:52.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.815+0000 7fb469e9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb464100050 0x7fb46410d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:52.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.815+0000 7fb469e9d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46410dfa0 con 0x7fb464100050 2023-12-05T09:24:52.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.815+0000 7fb469e9d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46410e840 con 0x7fb4640fd730 2023-12-05T09:24:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.816+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4640fd730 0x7fb46410d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.816+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4640fd730 0x7fb46410d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:43688/0 (socket says 172.21.15.67:43688) 2023-12-05T09:24:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.816+0000 7fb4637fe700 1 -- 172.21.15.67:0/3413945230 learned_addr learned my addr 172.21.15.67:0/3413945230 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:24:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.816+0000 7fb462ffd700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb464100050 0x7fb46410d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.816+0000 7fb462ffd700 1 -- 172.21.15.67:0/3413945230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4640fd730 msgr2=0x7fb46410d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.816+0000 7fb462ffd700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4640fd730 0x7fb46410d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.816+0000 7fb462ffd700 1 -- 172.21.15.67:0/3413945230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458005040 con 0x7fb464100050 2023-12-05T09:24:52.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.817+0000 7fb462ffd700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb464100050 0x7fb46410d9a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb45800b0d0 tx=0x7fb458009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:52.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.817+0000 7fb44bfff700 1 -- 172.21.15.67:0/3413945230 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45800e070 con 0x7fb464100050 2023-12-05T09:24:52.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.817+0000 7fb44bfff700 1 -- 172.21.15.67:0/3413945230 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb45801c400 con 0x7fb464100050 2023-12-05T09:24:52.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.817+0000 7fb44bfff700 1 -- 172.21.15.67:0/3413945230 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45800b650 con 0x7fb464100050 2023-12-05T09:24:52.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.817+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46410eac0 con 0x7fb464100050 2023-12-05T09:24:52.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.817+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46410efa0 con 0x7fb464100050 2023-12-05T09:24:52.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.819+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46404bb80 con 0x7fb464100050 2023-12-05T09:24:52.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.820+0000 7fb44bfff700 1 -- 172.21.15.67:0/3413945230 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fb45801c9e0 con 0x7fb464100050 2023-12-05T09:24:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.821+0000 7fb44bfff700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb44c068f60 0x7fb44c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:24:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.821+0000 7fb44bfff700 1 -- 172.21.15.67:0/3413945230 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb4580880d0 con 0x7fb464100050 2023-12-05T09:24:52.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.822+0000 7fb4637fe700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb44c068f60 0x7fb44c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:24:52.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.822+0000 7fb4637fe700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb44c068f60 0x7fb44c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb454008fd0 tx=0x7fb45400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:24:52.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:52.826+0000 7fb44bfff700 1 -- 172.21.15.67:0/3413945230 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb458057fc0 con 0x7fb464100050 2023-12-05T09:24:53.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.109+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb46410f4d0 con 0x7fb44c068f60 2023-12-05T09:24:53.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.110+0000 7fb44bfff700 1 -- 172.21.15.67:0/3413945230 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fb46410f4d0 con 0x7fb44c068f60 2023-12-05T09:24:53.110 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:24:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:24:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:24:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:24:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2023-12-05T09:24:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "0/2 daemons upgraded", 2023-12-05T09:24:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459 image on host smithi134", 2023-12-05T09:24:53.110 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:24:53.111 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:24:53.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.112+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb44c068f60 msgr2=0x7fb44c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.112+0000 7fb469e9d700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb44c068f60 0x7fb44c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb454008fd0 tx=0x7fb45400b040 comp rx=0 tx=0).stop 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.112+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb464100050 msgr2=0x7fb46410d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.112+0000 7fb469e9d700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb464100050 0x7fb46410d9a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb45800b0d0 tx=0x7fb458009e30 comp rx=0 tx=0).stop 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.113+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 shutdown_connections 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.113+0000 7fb469e9d700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fb44c068f60 0x7fb44c06b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.113+0000 7fb469e9d700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4640fd730 0x7fb46410d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.113+0000 7fb469e9d700 1 --2- 172.21.15.67:0/3413945230 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb464100050 0x7fb46410d9a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.113+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 >> 172.21.15.67:0/3413945230 conn(0x7fb4640f7190 msgr2=0x7fb4640f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.113+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 shutdown_connections 2023-12-05T09:24:53.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:24:53.113+0000 7fb469e9d700 1 -- 172.21.15.67:0/3413945230 wait complete. 2023-12-05T09:24:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:53 smithi067 ceph-mon[107174]: Upgrade: Target is version 19.0.0-11-g3fe8d441 (unknown) 2023-12-05T09:24:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:53 smithi067 ceph-mon[107174]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459'] 2023-12-05T09:24:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:53 smithi067 ceph-mon[107174]: Upgrade: Need to upgrade myself (mgr.smithi067.alxtvv) 2023-12-05T09:24:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:53 smithi067 ceph-mon[107174]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:53.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:53 smithi067 ceph-mon[107174]: pgmap v197: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:24:53.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:53 smithi067 ceph-mon[107174]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459 on smithi134 2023-12-05T09:24:53.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:53 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1775984687' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:24:53.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:53 smithi134 ceph-mon[116304]: Upgrade: Target is version 19.0.0-11-g3fe8d441 (unknown) 2023-12-05T09:24:53.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:53 smithi134 ceph-mon[116304]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459'] 2023-12-05T09:24:53.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:53 smithi134 ceph-mon[116304]: Upgrade: Need to upgrade myself (mgr.smithi067.alxtvv) 2023-12-05T09:24:53.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:53 smithi134 ceph-mon[116304]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:53.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:53 smithi134 ceph-mon[116304]: pgmap v197: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:24:53.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:53 smithi134 ceph-mon[116304]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459 on smithi134 2023-12-05T09:24:53.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:53 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/1775984687' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:24:54.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:54 smithi067 ceph-mon[107174]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:54.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:54 smithi134 ceph-mon[116304]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:24:55.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:55 smithi067 ceph-mon[107174]: pgmap v198: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:24:55.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:55 smithi134 ceph-mon[116304]: pgmap v198: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2023-12-05T09:24:57.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:57 smithi067 ceph-mon[107174]: pgmap v199: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:24:57.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:57 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:24:57.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:57 smithi134 ceph-mon[116304]: pgmap v199: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:24:57.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:57 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:24:59.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:24:59 smithi067 ceph-mon[107174]: pgmap v200: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:24:59.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:24:59 smithi134 ceph-mon[116304]: pgmap v200: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:25:01.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:01 smithi067 ceph-mon[107174]: pgmap v201: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:01.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:01 smithi134 ceph-mon[116304]: pgmap v201: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:03.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:03 smithi067 ceph-mon[107174]: pgmap v202: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:03.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:03 smithi134 ceph-mon[116304]: pgmap v202: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:05.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:05 smithi067 ceph-mon[107174]: pgmap v203: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:05.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:05 smithi134 ceph-mon[116304]: pgmap v203: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:07.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:07 smithi067 ceph-mon[107174]: pgmap v204: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:07.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:07 smithi134 ceph-mon[116304]: pgmap v204: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:09.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:09 smithi067 ceph-mon[107174]: pgmap v205: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:09.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:09 smithi134 ceph-mon[116304]: pgmap v205: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:11.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:11 smithi067 ceph-mon[107174]: pgmap v206: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:11.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:11 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:25:11.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:11 smithi134 ceph-mon[116304]: pgmap v206: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:11.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:11 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:25:13.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:13 smithi067 ceph-mon[107174]: pgmap v207: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:13.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:13 smithi134 ceph-mon[116304]: pgmap v207: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:15.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:15 smithi067 ceph-mon[107174]: pgmap v208: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:15.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:15 smithi134 ceph-mon[116304]: pgmap v208: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:17.368 INFO:tasks.workunit.client.0.smithi067.stderr:Updating files: 63% (7655/12123) Updating files: 64% (7759/12123) Updating files: 65% (7880/12123) Updating files: 66% (8002/12123) Updating files: 67% (8123/12123) Updating files: 68% (8244/12123) Updating files: 69% (8365/12123) Updating files: 70% (8487/12123) Updating files: 71% (8608/12123) Updating files: 72% (8729/12123) Updating files: 73% (8850/12123) Updating files: 74% (8972/12123) Updating files: 75% (9093/12123) Updating files: 76% (9214/12123) Updating files: 77% (9335/12123) Updating files: 78% (9456/12123) Updating files: 79% (9578/12123) Updating files: 80% (9699/12123) Updating files: 81% (9820/12123) Updating files: 82% (9941/12123) Updating files: 83% (10063/12123) Updating files: 84% (10184/12123) Updating files: 85% (10305/12123) Updating files: 86% (10426/12123) Updating files: 87% (10548/12123) Updating files: 88% (10669/12123) Updating files: 89% (10790/12123) Updating files: 90% (10911/12123) Updating files: 91% (11032/12123) Updating files: 92% (11154/12123) Updating files: 93% (11275/12123) Updating files: 94% (11396/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-05T09:25:17.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:17 smithi067 ceph-mon[107174]: pgmap v209: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:17.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:17 smithi134 ceph-mon[116304]: pgmap v209: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:17.702 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'. 2023-12-05T09:25:17.703 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-12-05T09:25:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-05T09:25:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-05T09:25:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2023-12-05T09:25:17.703 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-12-05T09:25:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-05T09:25:17.703 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-05T09:25:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-12-05T09:25:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2023-12-05T09:25:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-12-05T09:25:17.704 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2023-12-05T09:25:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-12-05T09:25:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2023-12-05T09:25:17.704 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-12-05T09:25:17.704 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-05T09:25:17.705 INFO:tasks.workunit.client.0.smithi067.stderr: 2023-12-05T09:25:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at 3fe8d441c2f Merge PR #53564 into wip-mchangir-testing-20231205.064351 2023-12-05T09:25:17.710 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-05T09:25:17.763 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-05T09:25:17.768 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-05T09:25:17.768 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-05T09:25:18.475 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-05T09:25:18.569 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-05T09:25:18.635 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-05T09:25:18.639 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-05T09:25:18.639 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-05T09:25:18.705 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-05T09:25:18.712 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:25:18.712 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-05T09:25:18.759 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-05T09:25:18.760 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-05T09:25:18.760 DEBUG:teuthology.orchestra.run.smithi067:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-05T09:25:18.859 INFO:tasks.workunit.client.0.smithi067.stderr:+ mkdir -p fsstress 2023-12-05T09:25:18.862 INFO:tasks.workunit.client.0.smithi067.stderr:+ pushd fsstress 2023-12-05T09:25:18.862 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T09:25:18.863 INFO:tasks.workunit.client.0.smithi067.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-05T09:25:19.424 INFO:tasks.workunit.client.0.smithi067.stderr:+ tar xzf ltp-full.tgz 2023-12-05T09:25:19.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:19 smithi067 ceph-mon[107174]: pgmap v210: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:19.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:19 smithi134 ceph-mon[116304]: pgmap v210: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:20.812 INFO:tasks.workunit.client.1.smithi134.stderr:Updating files: 57% (7006/12123) Updating files: 58% (7032/12123) Updating files: 59% (7153/12123) Updating files: 60% (7274/12123) Updating files: 61% (7396/12123) Updating files: 62% (7517/12123) Updating files: 63% (7638/12123) Updating files: 64% (7759/12123) Updating files: 65% (7880/12123) Updating files: 66% (8002/12123) Updating files: 67% (8123/12123) Updating files: 68% (8244/12123) Updating files: 69% (8365/12123) Updating files: 70% (8487/12123) Updating files: 71% (8608/12123) Updating files: 72% (8729/12123) Updating files: 73% (8850/12123) Updating files: 74% (8972/12123) Updating files: 75% (9093/12123) Updating files: 76% (9214/12123) Updating files: 77% (9335/12123) Updating files: 78% (9456/12123) Updating files: 79% (9578/12123) Updating files: 80% (9699/12123) Updating files: 81% (9820/12123) Updating files: 82% (9941/12123) Updating files: 83% (10063/12123) Updating files: 84% (10184/12123) Updating files: 85% (10305/12123) Updating files: 86% (10426/12123) Updating files: 87% (10548/12123) Updating files: 88% (10669/12123) Updating files: 89% (10790/12123) Updating files: 90% (10911/12123) Updating files: 91% (11032/12123) Updating files: 92% (11154/12123) Updating files: 93% (11275/12123) Updating files: 94% (11396/12123) Updating files: 94% (11401/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-05T09:25:21.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:21 smithi134 ceph-mon[116304]: pgmap v211: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:21.421 INFO:tasks.workunit.client.1.smithi134.stderr:Note: switching to '3fe8d441c2f973bfe963ba4dd30ba8eac9f36227'. 2023-12-05T09:25:21.421 INFO:tasks.workunit.client.1.smithi134.stderr: 2023-12-05T09:25:21.421 INFO:tasks.workunit.client.1.smithi134.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-05T09:25:21.421 INFO:tasks.workunit.client.1.smithi134.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr:state without impacting any branches by switching back to a branch. 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr: 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr: 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr: git switch -c 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr: 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr:Or undo this operation with: 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr: 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr: git switch - 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr: 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr: 2023-12-05T09:25:21.422 INFO:tasks.workunit.client.1.smithi134.stderr:HEAD is now at 3fe8d441c2f Merge PR #53564 into wip-mchangir-testing-20231205.064351 2023-12-05T09:25:21.428 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-05T09:25:21.488 INFO:tasks.workunit.client.1.smithi134.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-05T09:25:21.493 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-05T09:25:21.493 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-05T09:25:21.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:21 smithi067 ceph-mon[107174]: pgmap v211: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:22.267 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-05T09:25:22.370 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-05T09:25:22.438 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-05T09:25:22.442 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-05T09:25:22.442 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-05T09:25:22.509 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-05T09:25:22.516 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:25:22.516 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-05T09:25:22.567 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-05T09:25:22.569 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-05T09:25:22.569 DEBUG:teuthology.orchestra.run.smithi134:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-05T09:25:22.633 INFO:tasks.workunit.client.1.smithi134.stderr:+ mkdir -p fsstress 2023-12-05T09:25:22.637 INFO:tasks.workunit.client.1.smithi134.stderr:+ pushd fsstress 2023-12-05T09:25:22.637 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T09:25:22.638 INFO:tasks.workunit.client.1.smithi134.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-05T09:25:23.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.271+0000 7f7833b4b700 1 -- 172.21.15.67:0/1950886887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 msgr2=0x7f782c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:23.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.271+0000 7f7833b4b700 1 --2- 172.21.15.67:0/1950886887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 0x7f782c0fd000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7828004940 tx=0x7f7828009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:23.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.271+0000 7f7833b4b700 1 -- 172.21.15.67:0/1950886887 shutdown_connections 2023-12-05T09:25:23.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.271+0000 7f7833b4b700 1 --2- 172.21.15.67:0/1950886887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0fde00 0x7f782c0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.271+0000 7f7833b4b700 1 --2- 172.21.15.67:0/1950886887 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 0x7f782c0fd000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.271+0000 7f7833b4b700 1 -- 172.21.15.67:0/1950886887 >> 172.21.15.67:0/1950886887 conn(0x7f782c0f82d0 msgr2=0x7f782c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:23.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.271+0000 7f7833b4b700 1 -- 172.21.15.67:0/1950886887 shutdown_connections 2023-12-05T09:25:23.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.272+0000 7f7833b4b700 1 -- 172.21.15.67:0/1950886887 wait complete. 2023-12-05T09:25:23.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.272+0000 7f7833b4b700 1 Processor -- start 2023-12-05T09:25:23.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f7833b4b700 1 -- start start 2023-12-05T09:25:23.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f7833b4b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 0x7f782c10f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:23.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f7833b4b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0fde00 0x7f782c10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:23.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f7833b4b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c110220 con 0x7f782c0fcbf0 2023-12-05T09:25:23.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f7833b4b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c110ac0 con 0x7f782c0fde00 2023-12-05T09:25:23.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f78318e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 0x7f782c10f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:23.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f78318e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 0x7f782c10f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48750/0 (socket says 172.21.15.67:48750) 2023-12-05T09:25:23.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f78310e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0fde00 0x7f782c10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:23.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.273+0000 7f78318e7700 1 -- 172.21.15.67:0/3634218869 learned_addr learned my addr 172.21.15.67:0/3634218869 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:23.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.274+0000 7f78318e7700 1 -- 172.21.15.67:0/3634218869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0fde00 msgr2=0x7f782c10fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:23.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.274+0000 7f78318e7700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0fde00 0x7f782c10fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.274+0000 7f78318e7700 1 -- 172.21.15.67:0/3634218869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828005040 con 0x7f782c0fcbf0 2023-12-05T09:25:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.274+0000 7f78318e7700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 0x7f782c10f6e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7828009fd0 tx=0x7f7828009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.274+0000 7f78227fc700 1 -- 172.21.15.67:0/3634218869 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7828021070 con 0x7f782c0fcbf0 2023-12-05T09:25:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.275+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c110d40 con 0x7f782c0fcbf0 2023-12-05T09:25:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.275+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c111280 con 0x7f782c0fcbf0 2023-12-05T09:25:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.275+0000 7f78227fc700 1 -- 172.21.15.67:0/3634218869 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f782801c400 con 0x7f782c0fcbf0 2023-12-05T09:25:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.275+0000 7f78227fc700 1 -- 172.21.15.67:0/3634218869 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f782800e070 con 0x7f782c0fcbf0 2023-12-05T09:25:23.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.276+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78100052e0 con 0x7f782c0fcbf0 2023-12-05T09:25:23.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.277+0000 7f78227fc700 1 -- 172.21.15.67:0/3634218869 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f782801c9c0 con 0x7f782c0fcbf0 2023-12-05T09:25:23.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.278+0000 7f78227fc700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7818068f70 0x7f781806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:23.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.278+0000 7f78227fc700 1 -- 172.21.15.67:0/3634218869 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7828087d40 con 0x7f782c0fcbf0 2023-12-05T09:25:23.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.278+0000 7f78310e6700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7818068f70 0x7f781806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:23.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.279+0000 7f78310e6700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7818068f70 0x7f781806b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f781c009b80 tx=0x7f781c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:23.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.284+0000 7f78227fc700 1 -- 172.21.15.67:0/3634218869 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7828057cf0 con 0x7f782c0fcbf0 2023-12-05T09:25:23.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:22 smithi134 ceph-mon[116304]: Upgrade: Updating mgr.smithi134.yfqkak 2023-12-05T09:25:23.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:23.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:25:23.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:25:23.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:22 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:25:23.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:22 smithi134 ceph-mon[116304]: Deploying daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:25:23.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:22 smithi134 ceph-mon[116304]: pgmap v212: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:23.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:22 smithi067 ceph-mon[107174]: Upgrade: Updating mgr.smithi134.yfqkak 2023-12-05T09:25:23.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:23.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:25:23.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:25:23.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:22 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:25:23.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:22 smithi067 ceph-mon[107174]: Deploying daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:25:23.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:22 smithi067 ceph-mon[107174]: pgmap v212: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:25:23.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.534+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7810000bf0 con 0x7f7818068f70 2023-12-05T09:25:23.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.535+0000 7f78227fc700 1 -- 172.21.15.67:0/3634218869 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f7810000bf0 con 0x7f7818068f70 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7818068f70 msgr2=0x7f781806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7818068f70 0x7f781806b420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f781c009b80 tx=0x7f781c00b040 comp rx=0 tx=0).stop 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 msgr2=0x7f782c10f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 0x7f782c10f6e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7828009fd0 tx=0x7f7828009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 shutdown_connections 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7818068f70 0x7f781806b420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f782c0fcbf0 0x7f782c10f6e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 --2- 172.21.15.67:0/3634218869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f782c0fde00 0x7f782c10fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 >> 172.21.15.67:0/3634218869 conn(0x7f782c0f82d0 msgr2=0x7f782c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 shutdown_connections 2023-12-05T09:25:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.537+0000 7f7833b4b700 1 -- 172.21.15.67:0/3634218869 wait complete. 2023-12-05T09:25:23.559 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:25:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.703+0000 7f47a06ef700 1 -- 172.21.15.67:0/258083936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fcbf0 msgr2=0x7f47980fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.703+0000 7f47a06ef700 1 --2- 172.21.15.67:0/258083936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fcbf0 0x7f47980fd000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4794004940 tx=0x7f4794009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.703+0000 7f47a06ef700 1 -- 172.21.15.67:0/258083936 shutdown_connections 2023-12-05T09:25:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.703+0000 7f47a06ef700 1 --2- 172.21.15.67:0/258083936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47980fde00 0x7f47980fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.703+0000 7f47a06ef700 1 --2- 172.21.15.67:0/258083936 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fcbf0 0x7f47980fd000 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.703+0000 7f47a06ef700 1 -- 172.21.15.67:0/258083936 >> 172.21.15.67:0/258083936 conn(0x7f47980f82d0 msgr2=0x7f47980fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.703+0000 7f47a06ef700 1 -- 172.21.15.67:0/258083936 shutdown_connections 2023-12-05T09:25:23.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.703+0000 7f47a06ef700 1 -- 172.21.15.67:0/258083936 wait complete. 2023-12-05T09:25:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.704+0000 7f47a06ef700 1 Processor -- start 2023-12-05T09:25:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.704+0000 7f47a06ef700 1 -- start start 2023-12-05T09:25:23.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.704+0000 7f47a06ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47980fcbf0 0x7f479810f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:23.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.704+0000 7f47a06ef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fde00 0x7f479810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:23.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.704+0000 7f47a06ef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4798110200 con 0x7f47980fde00 2023-12-05T09:25:23.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.704+0000 7f47a06ef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4798110aa0 con 0x7f47980fcbf0 2023-12-05T09:25:23.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.705+0000 7f479dc8a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fde00 0x7f479810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:23.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.705+0000 7f479dc8a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fde00 0x7f479810fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48764/0 (socket says 172.21.15.67:48764) 2023-12-05T09:25:23.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.705+0000 7f479dc8a700 1 -- 172.21.15.67:0/2225153473 learned_addr learned my addr 172.21.15.67:0/2225153473 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:23.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.705+0000 7f479e48b700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47980fcbf0 0x7f479810f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.705+0000 7f479dc8a700 1 -- 172.21.15.67:0/2225153473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47980fcbf0 msgr2=0x7f479810f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.705+0000 7f479dc8a700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47980fcbf0 0x7f479810f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.705+0000 7f479dc8a700 1 -- 172.21.15.67:0/2225153473 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794005040 con 0x7f47980fde00 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.706+0000 7f479dc8a700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fde00 0x7f479810fc00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f478800eb40 tx=0x7f478800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.706+0000 7f478effd700 1 -- 172.21.15.67:0/2225153473 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4788007cc0 con 0x7f47980fde00 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.706+0000 7f478effd700 1 -- 172.21.15.67:0/2225153473 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f478800f040 con 0x7f47980fde00 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.706+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4798110d20 con 0x7f47980fde00 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.706+0000 7f478effd700 1 -- 172.21.15.67:0/2225153473 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f478800c990 con 0x7f47980fde00 2023-12-05T09:25:23.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.706+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4798111260 con 0x7f47980fde00 2023-12-05T09:25:23.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.707+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4798101ea0 con 0x7f47980fde00 2023-12-05T09:25:23.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.708+0000 7f478effd700 1 -- 172.21.15.67:0/2225153473 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f478800caf0 con 0x7f47980fde00 2023-12-05T09:25:23.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.709+0000 7f478effd700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4784068f70 0x7f478406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:23.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.709+0000 7f478effd700 1 -- 172.21.15.67:0/2225153473 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f47880868e0 con 0x7f47980fde00 2023-12-05T09:25:23.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.710+0000 7f479e48b700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4784068f70 0x7f478406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:23.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.710+0000 7f479e48b700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4784068f70 0x7f478406b420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f479400b0d0 tx=0x7f4794009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:23.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:23.715+0000 7f478effd700 1 -- 172.21.15.67:0/2225153473 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f478804da00 con 0x7f47980fde00 2023-12-05T09:25:24.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.015+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4798111590 con 0x7f4784068f70 2023-12-05T09:25:24.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.017+0000 7f478effd700 1 -- 172.21.15.67:0/2225153473 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f4798111590 con 0x7f4784068f70 2023-12-05T09:25:24.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.019+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4784068f70 msgr2=0x7f478406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:24.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.019+0000 7f47a06ef700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4784068f70 0x7f478406b420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f479400b0d0 tx=0x7f4794009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:24.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.019+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fde00 msgr2=0x7f479810fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:24.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.019+0000 7f47a06ef700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fde00 0x7f479810fc00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f478800eb40 tx=0x7f478800b040 comp rx=0 tx=0).stop 2023-12-05T09:25:24.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.019+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 shutdown_connections 2023-12-05T09:25:24.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.020+0000 7f47a06ef700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f4784068f70 0x7f478406b420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.020+0000 7f47a06ef700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47980fcbf0 0x7f479810f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.020+0000 7f47a06ef700 1 --2- 172.21.15.67:0/2225153473 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47980fde00 0x7f479810fc00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.020+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 >> 172.21.15.67:0/2225153473 conn(0x7f47980f82d0 msgr2=0x7f47980ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:24.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.020+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 shutdown_connections 2023-12-05T09:25:24.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.020+0000 7f47a06ef700 1 -- 172.21.15.67:0/2225153473 wait complete. 2023-12-05T09:25:24.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:23 smithi134 ceph-mon[116304]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:24.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.161+0000 7f54546d5700 1 -- 172.21.15.67:0/2294352369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 msgr2=0x7f544c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:24.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.161+0000 7f54546d5700 1 --2- 172.21.15.67:0/2294352369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 0x7f544c0fe250 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f543c004940 tx=0x7f543c009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:24.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.161+0000 7f54546d5700 1 -- 172.21.15.67:0/2294352369 shutdown_connections 2023-12-05T09:25:24.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.161+0000 7f54546d5700 1 --2- 172.21.15.67:0/2294352369 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 0x7f544c0fe250 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.161+0000 7f54546d5700 1 --2- 172.21.15.67:0/2294352369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f544c0fcbf0 0x7f544c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.161+0000 7f54546d5700 1 -- 172.21.15.67:0/2294352369 >> 172.21.15.67:0/2294352369 conn(0x7f544c0f82d0 msgr2=0x7f544c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:24.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.161+0000 7f54546d5700 1 -- 172.21.15.67:0/2294352369 shutdown_connections 2023-12-05T09:25:24.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.161+0000 7f54546d5700 1 -- 172.21.15.67:0/2294352369 wait complete. 2023-12-05T09:25:24.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.162+0000 7f54546d5700 1 Processor -- start 2023-12-05T09:25:24.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.162+0000 7f54546d5700 1 -- start start 2023-12-05T09:25:24.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.163+0000 7f54546d5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f544c0fcbf0 0x7f544c10f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:24.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.163+0000 7f54546d5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 0x7f544c10fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:24.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.163+0000 7f54546d5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c1102a0 con 0x7f544c0fde00 2023-12-05T09:25:24.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.163+0000 7f54546d5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c110af0 con 0x7f544c0fcbf0 2023-12-05T09:25:24.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.163+0000 7f5451c70700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 0x7f544c10fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:24.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.163+0000 7f5452471700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f544c0fcbf0 0x7f544c10f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:24.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.163+0000 7f5452471700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f544c0fcbf0 0x7f544c10f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:33416/0 (socket says 172.21.15.67:33416) 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.163+0000 7f5452471700 1 -- 172.21.15.67:0/1589925599 learned_addr learned my addr 172.21.15.67:0/1589925599 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f5451c70700 1 -- 172.21.15.67:0/1589925599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f544c0fcbf0 msgr2=0x7f544c10f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f5451c70700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f544c0fcbf0 0x7f544c10f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f5451c70700 1 -- 172.21.15.67:0/1589925599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c005040 con 0x7f544c0fde00 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f5452471700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f544c0fcbf0 0x7f544c10f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f5451c70700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 0x7f544c10fca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f543c000c00 tx=0x7f543c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f5442ffd700 1 -- 172.21.15.67:0/1589925599 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543c00e040 con 0x7f544c0fde00 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f5442ffd700 1 -- 172.21.15.67:0/1589925599 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f543c004290 con 0x7f544c0fde00 2023-12-05T09:25:24.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544c110d70 con 0x7f544c0fde00 2023-12-05T09:25:24.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.164+0000 7f5442ffd700 1 -- 172.21.15.67:0/1589925599 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543c01c3f0 con 0x7f544c0fde00 2023-12-05T09:25:24.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.165+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c1112b0 con 0x7f544c0fde00 2023-12-05T09:25:24.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.166+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c101ea0 con 0x7f544c0fde00 2023-12-05T09:25:24.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.167+0000 7f5442ffd700 1 -- 172.21.15.67:0/1589925599 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f543c013420 con 0x7f544c0fde00 2023-12-05T09:25:24.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.168+0000 7f5442ffd700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f5438068f70 0x7f543806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:24.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.168+0000 7f5442ffd700 1 -- 172.21.15.67:0/1589925599 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f543c0880a0 con 0x7f544c0fde00 2023-12-05T09:25:24.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.168+0000 7f5452471700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f5438068f70 0x7f543806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:24.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.169+0000 7f5452471700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f5438068f70 0x7f543806b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f544800e560 tx=0x7f544800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:24.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.176+0000 7f5442ffd700 1 -- 172.21.15.67:0/1589925599 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f543c057f90 con 0x7f544c0fde00 2023-12-05T09:25:24.177 INFO:tasks.workunit.client.1.smithi134.stderr:+ tar xzf ltp-full.tgz 2023-12-05T09:25:24.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:23 smithi067 ceph-mon[107174]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:24.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.535+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f544c111520 con 0x7f5438068f70 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.553+0000 7f5442ffd700 1 -- 172.21.15.67:0/1589925599 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f544c111520 con 0x7f5438068f70 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (5m) 93s ago 6m 14.7M - 0.25.0 c8568f914cd2 705e76e175ab 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (6m) 93s ago 6m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (5m) 97s ago 5m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (5m) 93s ago 6m 79.9M - 9.4.7 2c41d148cca3 110448c1bfef 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (113s) 93s ago 113s 15.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (108s) 93s ago 107s 14.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (105s) 97s ago 105s 11.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (111s) 97s ago 111s 12.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:9283 running (7m) 93s ago 7m 503M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 01173e871e1b 2023-12-05T09:25:24.553 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283 running (5m) 97s ago 5m 442M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dc026bba702 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (7m) 93s ago 8m 72.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (5m) 97s ago 5m 49.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (6m) 93s ago 6m 8652k - 1.5.0 0da6a335fe13 7d8553eb4b47 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 97s ago 5m 8782k - 1.5.0 0da6a335fe13 2301b35d1166 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (4m) 93s ago 4m 55.2M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (4m) 93s ago 4m 60.8M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (4m) 93s ago 4m 55.0M 4349M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (3m) 97s ago 3m 54.4M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (3m) 97s ago 3m 49.6M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (3m) 97s ago 3m 50.1M 5373M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:25:24.554 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (5m) 93s ago 6m 42.5M - 2.43.0 a07b618ecd1d a79077dfa046 2023-12-05T09:25:24.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.555+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f5438068f70 msgr2=0x7f543806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:24.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.555+0000 7f54546d5700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f5438068f70 0x7f543806b420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f544800e560 tx=0x7f544800b040 comp rx=0 tx=0).stop 2023-12-05T09:25:24.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.555+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 msgr2=0x7f544c10fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:24.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.555+0000 7f54546d5700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 0x7f544c10fca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f543c000c00 tx=0x7f543c009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:24.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.556+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 shutdown_connections 2023-12-05T09:25:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.556+0000 7f54546d5700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f5438068f70 0x7f543806b420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.556+0000 7f54546d5700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f544c0fcbf0 0x7f544c10f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.556+0000 7f54546d5700 1 --2- 172.21.15.67:0/1589925599 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f544c0fde00 0x7f544c10fca0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.556+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 >> 172.21.15.67:0/1589925599 conn(0x7f544c0f82d0 msgr2=0x7f544c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.556+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 shutdown_connections 2023-12-05T09:25:24.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.556+0000 7f54546d5700 1 -- 172.21.15.67:0/1589925599 wait complete. 2023-12-05T09:25:24.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.713+0000 7f7e27859700 1 -- 172.21.15.67:0/2465481679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e20100050 msgr2=0x7f7e20102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:24.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.713+0000 7f7e27859700 1 --2- 172.21.15.67:0/2465481679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e20100050 0x7f7e20102430 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7e10004940 tx=0x7f7e10009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:24.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.713+0000 7f7e27859700 1 -- 172.21.15.67:0/2465481679 shutdown_connections 2023-12-05T09:25:24.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.713+0000 7f7e27859700 1 --2- 172.21.15.67:0/2465481679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e20100050 0x7f7e20102430 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.713+0000 7f7e27859700 1 --2- 172.21.15.67:0/2465481679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e200fd730 0x7f7e200ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.713+0000 7f7e27859700 1 -- 172.21.15.67:0/2465481679 >> 172.21.15.67:0/2465481679 conn(0x7f7e200f7190 msgr2=0x7f7e200f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:24.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.713+0000 7f7e27859700 1 -- 172.21.15.67:0/2465481679 shutdown_connections 2023-12-05T09:25:24.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.713+0000 7f7e27859700 1 -- 172.21.15.67:0/2465481679 wait complete. 2023-12-05T09:25:24.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.714+0000 7f7e27859700 1 Processor -- start 2023-12-05T09:25:24.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.714+0000 7f7e27859700 1 -- start start 2023-12-05T09:25:24.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e27859700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e200fd730 0x7f7e2010f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:24.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e27859700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e20100050 0x7f7e2010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:24.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e27859700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e201101f0 con 0x7f7e200fd730 2023-12-05T09:25:24.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e27859700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20110a90 con 0x7f7e20100050 2023-12-05T09:25:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e255f5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e200fd730 0x7f7e2010f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e255f5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e200fd730 0x7f7e2010f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48798/0 (socket says 172.21.15.67:48798) 2023-12-05T09:25:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e255f5700 1 -- 172.21.15.67:0/4017283202 learned_addr learned my addr 172.21.15.67:0/4017283202 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e24df4700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e20100050 0x7f7e2010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e255f5700 1 -- 172.21.15.67:0/4017283202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e20100050 msgr2=0x7f7e2010fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e255f5700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e20100050 0x7f7e2010fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.715+0000 7f7e255f5700 1 -- 172.21.15.67:0/4017283202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10005040 con 0x7f7e200fd730 2023-12-05T09:25:24.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.716+0000 7f7e255f5700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e200fd730 0x7f7e2010f6b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00eb40 tx=0x7f7e1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:24.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.716+0000 7f7e15ffb700 1 -- 172.21.15.67:0/4017283202 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e1c007cc0 con 0x7f7e200fd730 2023-12-05T09:25:24.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.716+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e20110d10 con 0x7f7e200fd730 2023-12-05T09:25:24.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.716+0000 7f7e15ffb700 1 -- 172.21.15.67:0/4017283202 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7e1c00f040 con 0x7f7e200fd730 2023-12-05T09:25:24.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.716+0000 7f7e15ffb700 1 -- 172.21.15.67:0/4017283202 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e1c00c990 con 0x7f7e200fd730 2023-12-05T09:25:24.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.716+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e20111250 con 0x7f7e200fd730 2023-12-05T09:25:24.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.718+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2004bb80 con 0x7f7e200fd730 2023-12-05T09:25:24.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.718+0000 7f7e15ffb700 1 -- 172.21.15.67:0/4017283202 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7f7e1c00cc00 con 0x7f7e200fd730 2023-12-05T09:25:24.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.719+0000 7f7e15ffb700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7e0c068f70 0x7f7e0c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:24.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.719+0000 7f7e15ffb700 1 -- 172.21.15.67:0/4017283202 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7e1c086a80 con 0x7f7e200fd730 2023-12-05T09:25:24.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.720+0000 7f7e24df4700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7e0c068f70 0x7f7e0c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:24.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.720+0000 7f7e24df4700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7e0c068f70 0x7f7e0c06b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7e10013680 tx=0x7f7e10009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:24.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:24.724+0000 7f7e15ffb700 1 -- 172.21.15.67:0/4017283202 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7e1c04da00 con 0x7f7e200fd730 2023-12-05T09:25:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.100+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7e20111600 con 0x7f7e200fd730 2023-12-05T09:25:25.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.101+0000 7f7e15ffb700 1 -- 172.21.15.67:0/4017283202 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f7e1c056920 con 0x7f7e200fd730 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:25:25.101 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:25:25.102 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:25:25.102 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 14 2023-12-05T09:25:25.102 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:25:25.102 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:25:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.104+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7e0c068f70 msgr2=0x7f7e0c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.104+0000 7f7e27859700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7e0c068f70 0x7f7e0c06b420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7e10013680 tx=0x7f7e10009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.104+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e200fd730 msgr2=0x7f7e2010f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:25.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.104+0000 7f7e27859700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e200fd730 0x7f7e2010f6b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00eb40 tx=0x7f7e1c00b040 comp rx=0 tx=0).stop 2023-12-05T09:25:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.105+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 shutdown_connections 2023-12-05T09:25:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.105+0000 7f7e27859700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7f7e0c068f70 0x7f7e0c06b420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.105+0000 7f7e27859700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e200fd730 0x7f7e2010f6b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.105+0000 7f7e27859700 1 --2- 172.21.15.67:0/4017283202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e20100050 0x7f7e2010fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.105+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 >> 172.21.15.67:0/4017283202 conn(0x7f7e200f7190 msgr2=0x7f7e200fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.105+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 shutdown_connections 2023-12-05T09:25:25.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.105+0000 7f7e27859700 1 -- 172.21.15.67:0/4017283202 wait complete. 2023-12-05T09:25:25.281 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:24 smithi134 ceph-mon[116304]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:25.281 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:24 smithi134 ceph-mon[116304]: pgmap v213: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s wr, 1 op/s 2023-12-05T09:25:25.281 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:24 smithi134 ceph-mon[116304]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:25.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.312+0000 7fe151a73700 1 -- 172.21.15.67:0/3319640927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 msgr2=0x7fe14c0fcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.312+0000 7fe151a73700 1 --2- 172.21.15.67:0/3319640927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 0x7fe14c0fcf90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe13c004940 tx=0x7fe13c009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.312+0000 7fe151a73700 1 -- 172.21.15.67:0/3319640927 shutdown_connections 2023-12-05T09:25:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.312+0000 7fe151a73700 1 --2- 172.21.15.67:0/3319640927 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe14c0fdd90 0x7fe14c0fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.312+0000 7fe151a73700 1 --2- 172.21.15.67:0/3319640927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 0x7fe14c0fcf90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.312+0000 7fe151a73700 1 -- 172.21.15.67:0/3319640927 >> 172.21.15.67:0/3319640927 conn(0x7fe14c0f8240 msgr2=0x7fe14c0fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.312+0000 7fe151a73700 1 -- 172.21.15.67:0/3319640927 shutdown_connections 2023-12-05T09:25:25.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.312+0000 7fe151a73700 1 -- 172.21.15.67:0/3319640927 wait complete. 2023-12-05T09:25:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.313+0000 7fe151a73700 1 Processor -- start 2023-12-05T09:25:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.313+0000 7fe151a73700 1 -- start start 2023-12-05T09:25:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.313+0000 7fe151a73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 0x7fe14c10f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe151a73700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe14c0fdd90 0x7fe14c10fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe151a73700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c1101b0 con 0x7fe14c0fcb80 2023-12-05T09:25:25.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe151a73700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c110a50 con 0x7fe14c0fdd90 2023-12-05T09:25:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe14b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 0x7fe14c10f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe14b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 0x7fe14c10f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48816/0 (socket says 172.21.15.67:48816) 2023-12-05T09:25:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe14b7fe700 1 -- 172.21.15.67:0/4189392300 learned_addr learned my addr 172.21.15.67:0/4189392300 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe14affd700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe14c0fdd90 0x7fe14c10fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe14b7fe700 1 -- 172.21.15.67:0/4189392300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe14c0fdd90 msgr2=0x7fe14c10fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:25.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe14b7fe700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe14c0fdd90 0x7fe14c10fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.314+0000 7fe14b7fe700 1 -- 172.21.15.67:0/4189392300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c005040 con 0x7fe14c0fcb80 2023-12-05T09:25:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.315+0000 7fe14b7fe700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 0x7fe14c10f670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009360 tx=0x7fe13c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.315+0000 7fe133fff700 1 -- 172.21.15.67:0/4189392300 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13c00e040 con 0x7fe14c0fcb80 2023-12-05T09:25:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.315+0000 7fe133fff700 1 -- 172.21.15.67:0/4189392300 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe13c004290 con 0x7fe14c0fcb80 2023-12-05T09:25:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.315+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c110cd0 con 0x7fe14c0fcb80 2023-12-05T09:25:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.315+0000 7fe133fff700 1 -- 172.21.15.67:0/4189392300 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13c01c3f0 con 0x7fe14c0fcb80 2023-12-05T09:25:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.315+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c111210 con 0x7fe14c0fcb80 2023-12-05T09:25:25.316 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.317+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c101e30 con 0x7fe14c0fcb80 2023-12-05T09:25:25.317 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.318+0000 7fe133fff700 1 -- 172.21.15.67:0/4189392300 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 19) v1 ==== 86447+0+0 (secure 0 0 0) 0x7fe13c0137e0 con 0x7fe14c0fcb80 2023-12-05T09:25:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.319+0000 7fe133fff700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe134068f70 0x7fe13406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.319+0000 7fe133fff700 1 -- 172.21.15.67:0/4189392300 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe13c0880a0 con 0x7fe14c0fcb80 2023-12-05T09:25:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.320+0000 7fe14affd700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe134068f70 0x7fe13406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:25.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.320+0000 7fe14affd700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe134068f70 0x7fe13406b420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe140004f40 tx=0x7fe14000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:25.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.325+0000 7fe133fff700 1 -- 172.21.15.67:0/4189392300 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe13c057f10 con 0x7fe14c0fcb80 2023-12-05T09:25:25.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:24 smithi067 ceph-mon[107174]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:25.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:24 smithi067 ceph-mon[107174]: pgmap v213: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s wr, 1 op/s 2023-12-05T09:25:25.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:24 smithi067 ceph-mon[107174]: from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:25.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.619+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 --> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe14c02b1f0 con 0x7fe134068f70 2023-12-05T09:25:25.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.620+0000 7fe133fff700 1 -- 172.21.15.67:0/4189392300 <== mgr.14214 v2:172.21.15.67:6800/3666384983 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fe14c02b1f0 con 0x7fe134068f70 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "", 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mgr daemons", 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:25:25.620 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:25:25.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.623+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe134068f70 msgr2=0x7fe13406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.623+0000 7fe151a73700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe134068f70 0x7fe13406b420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe140004f40 tx=0x7fe14000b040 comp rx=0 tx=0).stop 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.623+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 msgr2=0x7fe14c10f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.623+0000 7fe151a73700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 0x7fe14c10f670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009360 tx=0x7fe13c009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.624+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 shutdown_connections 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.624+0000 7fe151a73700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:6800/3666384983,v1:172.21.15.67:6801/3666384983] conn(0x7fe134068f70 0x7fe13406b420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.624+0000 7fe151a73700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe14c0fcb80 0x7fe14c10f670 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.624+0000 7fe151a73700 1 --2- 172.21.15.67:0/4189392300 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe14c0fdd90 0x7fe14c10fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.624+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 >> 172.21.15.67:0/4189392300 conn(0x7fe14c0f8240 msgr2=0x7fe14c0fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.624+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 shutdown_connections 2023-12-05T09:25:25.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:25.624+0000 7fe151a73700 1 -- 172.21.15.67:0/4189392300 wait complete. 2023-12-05T09:25:26.235 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:25 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/4017283202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:25:26.235 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:26.235 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:26.235 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:25 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:25:26.235 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:25 smithi134 ceph-mon[116304]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:26.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:25 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/4017283202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:25:26.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:26.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:26.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:25 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:25:26.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:25 smithi067 ceph-mon[107174]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:27.310 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:27 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:25:27.311 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:27 smithi134 ceph-mon[116304]: pgmap v214: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s wr, 6 op/s 2023-12-05T09:25:27.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:27 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:25:27.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:27 smithi067 ceph-mon[107174]: pgmap v214: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s wr, 6 op/s 2023-12-05T09:25:28.018 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:28 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:25:28.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:28 smithi067 ceph-mon[107174]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:25:29.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:29.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:29 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:29.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:29 smithi067 ceph-mon[107174]: pgmap v215: 65 pgs: 65 active+clean; 13 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s wr, 19 op/s 2023-12-05T09:25:29.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:29.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:29 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:29.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:29 smithi134 ceph-mon[116304]: pgmap v215: 65 pgs: 65 active+clean; 13 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s wr, 19 op/s 2023-12-05T09:25:30.972 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:30 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:30.972 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:30 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:30.972 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:30 smithi134 ceph-mon[116304]: pgmap v216: 65 pgs: 65 active+clean; 46 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s wr, 162 op/s 2023-12-05T09:25:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:30 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:30 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:30 smithi067 ceph-mon[107174]: pgmap v216: 65 pgs: 65 active+clean; 46 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.9 MiB/s wr, 162 op/s 2023-12-05T09:25:33.373 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:33 smithi134 ceph-mon[116304]: pgmap v217: 65 pgs: 65 active+clean; 47 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s wr, 193 op/s 2023-12-05T09:25:33.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:33.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:33.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:25:33.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:25:33.374 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:33 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:33.593 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:33 smithi067 ceph-mon[107174]: pgmap v217: 65 pgs: 65 active+clean; 47 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 4.0 MiB/s wr, 193 op/s 2023-12-05T09:25:33.593 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:33.594 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:33.594 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:25:33.594 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:25:33.594 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:33 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' 2023-12-05T09:25:34.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:25:34.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr fail", "who": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:25:34.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:34 smithi134 ceph-mon[116304]: osdmap e47: 6 total, 6 up, 6 in 2023-12-05T09:25:34.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:34 smithi134 ceph-mon[116304]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "mgr fail", "who": "smithi067.alxtvv"}]': finished 2023-12-05T09:25:34.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:34 smithi134 ceph-mon[116304]: mgrmap e20: smithi134.yfqkak(active, starting, since 0.0114881s) 2023-12-05T09:25:34.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:25:34.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr fail", "who": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:25:34.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:34 smithi067 ceph-mon[107174]: osdmap e47: 6 total, 6 up, 6 in 2023-12-05T09:25:34.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:34 smithi067 ceph-mon[107174]: from='mgr.14214 172.21.15.67:0/4021317696' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "mgr fail", "who": "smithi067.alxtvv"}]': finished 2023-12-05T09:25:34.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:34 smithi067 ceph-mon[107174]: mgrmap e20: smithi134.yfqkak(active, starting, since 0.0114881s) 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: Active manager daemon smithi134.yfqkak restarted 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: Activating manager daemon smithi134.yfqkak 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: osdmap e48: 6 total, 6 up, 6 in 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: mgrmap e21: smithi134.yfqkak(active, starting, since 0.00632146s) 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.kyspon"}]: dispatch 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.qaibsa"}]: dispatch 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vmnpaq"}]: dispatch 2023-12-05T09:25:35.456 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr metadata", "who": "smithi134.yfqkak", "id": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:25:35.457 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: Manager daemon smithi134.yfqkak is now available 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.yfqkak/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.yfqkak/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.yfqkak/trash_purge_schedule"}]: dispatch 2023-12-05T09:25:35.458 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:35 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.yfqkak/trash_purge_schedule"}]: dispatch 2023-12-05T09:25:35.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: Active manager daemon smithi134.yfqkak restarted 2023-12-05T09:25:35.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: Activating manager daemon smithi134.yfqkak 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: osdmap e48: 6 total, 6 up, 6 in 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: mgrmap e21: smithi134.yfqkak(active, starting, since 0.00632146s) 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.kyspon"}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.qaibsa"}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vmnpaq"}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr metadata", "who": "smithi134.yfqkak", "id": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:25:35.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: Manager daemon smithi134.yfqkak is now available 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:25:35.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:25:35.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.yfqkak/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:25:35.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.yfqkak/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:25:35.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.yfqkak/trash_purge_schedule"}]: dispatch 2023-12-05T09:25:35.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:35 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.yfqkak/trash_purge_schedule"}]: dispatch 2023-12-05T09:25:36.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:36 smithi067 ceph-mon[107174]: Deploying cephadm binary to smithi134 2023-12-05T09:25:36.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:36 smithi067 ceph-mon[107174]: Deploying cephadm binary to smithi067 2023-12-05T09:25:36.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:36 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:36.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:36 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:36.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:36 smithi067 ceph-mon[107174]: mgrmap e22: smithi134.yfqkak(active, since 1.01217s) 2023-12-05T09:25:36.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:36 smithi067 ceph-mon[107174]: pgmap v3: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:25:36.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:36 smithi067 ceph-mon[107174]: [05/Dec/2023:09:25:36] ENGINE Bus STARTING 2023-12-05T09:25:37.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:36 smithi134 ceph-mon[116304]: Deploying cephadm binary to smithi134 2023-12-05T09:25:37.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:36 smithi134 ceph-mon[116304]: Deploying cephadm binary to smithi067 2023-12-05T09:25:37.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:36 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:37.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:36 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:37.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:36 smithi134 ceph-mon[116304]: mgrmap e22: smithi134.yfqkak(active, since 1.01217s) 2023-12-05T09:25:37.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:36 smithi134 ceph-mon[116304]: pgmap v3: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:25:37.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:36 smithi134 ceph-mon[116304]: [05/Dec/2023:09:25:36] ENGINE Bus STARTING 2023-12-05T09:25:38.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:37 smithi134 ceph-mon[116304]: [05/Dec/2023:09:25:36] ENGINE Serving on http://172.21.15.134:8765 2023-12-05T09:25:38.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:37 smithi134 ceph-mon[116304]: [05/Dec/2023:09:25:36] ENGINE Serving on https://172.21.15.134:7150 2023-12-05T09:25:38.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:37 smithi134 ceph-mon[116304]: [05/Dec/2023:09:25:36] ENGINE Bus STARTED 2023-12-05T09:25:38.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:37 smithi134 ceph-mon[116304]: pgmap v4: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:25:38.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:37 smithi134 ceph-mon[116304]: mgrmap e23: smithi134.yfqkak(active, since 2s) 2023-12-05T09:25:38.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:37 smithi067 ceph-mon[107174]: [05/Dec/2023:09:25:36] ENGINE Serving on http://172.21.15.134:8765 2023-12-05T09:25:38.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:37 smithi067 ceph-mon[107174]: [05/Dec/2023:09:25:36] ENGINE Serving on https://172.21.15.134:7150 2023-12-05T09:25:38.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:37 smithi067 ceph-mon[107174]: [05/Dec/2023:09:25:36] ENGINE Bus STARTED 2023-12-05T09:25:38.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:37 smithi067 ceph-mon[107174]: pgmap v4: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:25:38.133 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:37 smithi067 ceph-mon[107174]: mgrmap e23: smithi134.yfqkak(active, since 2s) 2023-12-05T09:25:40.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:39 smithi067 ceph-mon[107174]: pgmap v5: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:25:40.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:39 smithi067 ceph-mon[107174]: mgrmap e24: smithi134.yfqkak(active, since 4s) 2023-12-05T09:25:40.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:39 smithi134 ceph-mon[116304]: pgmap v5: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:25:40.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:39 smithi134 ceph-mon[116304]: mgrmap e24: smithi134.yfqkak(active, since 4s) 2023-12-05T09:25:42.353 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:42 smithi134 ceph-mon[116304]: pgmap v6: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:25:42.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:42 smithi067 ceph-mon[107174]: pgmap v6: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:25:44.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:44 smithi067 ceph-mon[107174]: pgmap v7: 65 pgs: 65 active+clean; 116 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 587 op/s 2023-12-05T09:25:44.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:44 smithi134 ceph-mon[116304]: pgmap v7: 65 pgs: 65 active+clean; 116 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 5.3 MiB/s wr, 587 op/s 2023-12-05T09:25:46.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:46 smithi067 ceph-mon[107174]: pgmap v8: 65 pgs: 65 active+clean; 116 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 4.2 MiB/s wr, 456 op/s 2023-12-05T09:25:46.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:46 smithi067 ceph-mon[107174]: Standby manager daemon smithi067.alxtvv started 2023-12-05T09:25:46.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:46 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.67:0/2907663951' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.alxtvv/crt"}]: dispatch 2023-12-05T09:25:46.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:46 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.67:0/2907663951' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:25:46.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:46 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.67:0/2907663951' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.alxtvv/key"}]: dispatch 2023-12-05T09:25:46.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:46 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.67:0/2907663951' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:25:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:46 smithi134 ceph-mon[116304]: pgmap v8: 65 pgs: 65 active+clean; 116 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 4.2 MiB/s wr, 456 op/s 2023-12-05T09:25:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:46 smithi134 ceph-mon[116304]: Standby manager daemon smithi067.alxtvv started 2023-12-05T09:25:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:46 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.67:0/2907663951' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.alxtvv/crt"}]: dispatch 2023-12-05T09:25:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:46 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.67:0/2907663951' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:25:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:46 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.67:0/2907663951' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.alxtvv/key"}]: dispatch 2023-12-05T09:25:46.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:46 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.67:0/2907663951' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:25:47.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:47 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:25:47.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:47 smithi067 ceph-mon[107174]: mgrmap e25: smithi134.yfqkak(active, since 11s), standbys: smithi067.alxtvv 2023-12-05T09:25:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:47 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:25:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:47 smithi134 ceph-mon[116304]: mgrmap e25: smithi134.yfqkak(active, since 11s), standbys: smithi067.alxtvv 2023-12-05T09:25:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:48 smithi067 ceph-mon[107174]: pgmap v9: 65 pgs: 65 active+clean; 146 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 613 op/s 2023-12-05T09:25:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:48 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:48 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:48.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:48 smithi134 ceph-mon[116304]: pgmap v9: 65 pgs: 65 active+clean; 146 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 613 op/s 2023-12-05T09:25:48.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:48 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:48.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:48 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:49.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:49 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:49.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:49 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:49.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:49 smithi067 ceph-mon[107174]: pgmap v10: 65 pgs: 65 active+clean; 146 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2023-12-05T09:25:49.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:49 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:49.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:49 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:49.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:49 smithi134 ceph-mon[116304]: pgmap v10: 65 pgs: 65 active+clean; 146 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2023-12-05T09:25:50.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:50 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:25:50.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:50 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: pgmap v11: 65 pgs: 65 active+clean; 146 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:52 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: pgmap v11: 65 pgs: 65 active+clean; 146 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:52.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:52 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:53 smithi067 ceph-mon[107174]: Adjusting osd_memory_target on smithi134 to 2642M 2023-12-05T09:25:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:53 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:53 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:53.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:53 smithi134 ceph-mon[116304]: Adjusting osd_memory_target on smithi134 to 2642M 2023-12-05T09:25:53.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:53 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:53.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:53 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:54.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:54 smithi067 ceph-mon[107174]: pgmap v12: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 644 op/s 2023-12-05T09:25:54.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:54 smithi134 ceph-mon[116304]: pgmap v12: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 644 op/s 2023-12-05T09:25:54.688 INFO:tasks.workunit.client.0.smithi067.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-05T09:25:54.710 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T09:25:54.710 INFO:tasks.workunit.client.0.smithi067.stderr:+ make 2023-12-05T09:25:55.322 INFO:tasks.workunit.client.0.smithi067.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-05T09:25:55.746 INFO:tasks.workunit.client.0.smithi067.stderr:++ readlink -f fsstress 2023-12-05T09:25:55.749 INFO:tasks.workunit.client.0.smithi067.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-05T09:25:55.749 INFO:tasks.workunit.client.0.smithi067.stderr:+ popd 2023-12-05T09:25:55.749 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-05T09:25:55.750 INFO:tasks.workunit.client.0.smithi067.stderr:+ popd 2023-12-05T09:25:55.750 INFO:tasks.workunit.client.0.smithi067.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-05T09:25:55.750 INFO:tasks.workunit.client.0.smithi067.stderr:++ mktemp -d -p . 2023-12-05T09:25:55.754 INFO:tasks.workunit.client.0.smithi067.stderr:+ T=./tmp.ORNZR6WClK 2023-12-05T09:25:55.754 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ORNZR6WClK -l 1 -n 1000 -p 10 -v 2023-12-05T09:25:55.758 INFO:tasks.workunit.client.0.smithi067.stdout:seed = 1701148456 2023-12-05T09:25:55.763 INFO:tasks.workunit.client.0.smithi067.stdout:0/0: write - no filename 2023-12-05T09:25:55.763 INFO:tasks.workunit.client.0.smithi067.stdout:0/1: dread - no filename 2023-12-05T09:25:55.763 INFO:tasks.workunit.client.0.smithi067.stdout:0/2: readlink - no filename 2023-12-05T09:25:55.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/0: write - no filename 2023-12-05T09:25:55.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/1: rename - no filename 2023-12-05T09:25:55.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/2: fsync - no filename 2023-12-05T09:25:55.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/3: truncate - no filename 2023-12-05T09:25:55.766 INFO:tasks.workunit.client.0.smithi067.stdout:0/3: creat f0 x:0 0 0 2023-12-05T09:25:55.766 INFO:tasks.workunit.client.0.smithi067.stdout:0/4: creat f1 x:0 0 0 2023-12-05T09:25:55.766 INFO:tasks.workunit.client.0.smithi067.stdout:0/5: creat f2 x:0 0 0 2023-12-05T09:25:55.766 INFO:tasks.workunit.client.0.smithi067.stdout:0/6: dread - f2 zero size 2023-12-05T09:25:55.766 INFO:tasks.workunit.client.0.smithi067.stdout:0/7: truncate f2 670684 0 2023-12-05T09:25:55.768 INFO:tasks.workunit.client.0.smithi067.stdout:4/4: mkdir d0 0 2023-12-05T09:25:55.773 INFO:tasks.workunit.client.0.smithi067.stdout:0/8: mkdir d3 0 2023-12-05T09:25:55.773 INFO:tasks.workunit.client.0.smithi067.stdout:0/9: read - f0 zero size 2023-12-05T09:25:55.773 INFO:tasks.workunit.client.0.smithi067.stdout:0/10: readlink - no filename 2023-12-05T09:25:55.773 INFO:tasks.workunit.client.0.smithi067.stdout:0/11: truncate f0 782054 0 2023-12-05T09:25:55.773 INFO:tasks.workunit.client.0.smithi067.stdout:1/0: symlink l0 0 2023-12-05T09:25:55.776 INFO:tasks.workunit.client.0.smithi067.stdout:1/1: creat f1 x:0 0 0 2023-12-05T09:25:55.776 INFO:tasks.workunit.client.0.smithi067.stdout:1/2: write f1 [178246,126580] 0 2023-12-05T09:25:55.778 INFO:tasks.workunit.client.0.smithi067.stdout:2/0: mkdir d0 0 2023-12-05T09:25:55.780 INFO:tasks.workunit.client.0.smithi067.stdout:1/3: mkdir d2 0 2023-12-05T09:25:55.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/1: creat d0/f1 x:0 0 0 2023-12-05T09:25:55.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/2: stat d0/f1 0 2023-12-05T09:25:55.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/3: dread - d0/f1 zero size 2023-12-05T09:25:55.787 INFO:tasks.workunit.client.0.smithi067.stdout:3/0: creat f0 x:0 0 0 2023-12-05T09:25:55.787 INFO:tasks.workunit.client.0.smithi067.stdout:3/1: write f0 [722,16325] 0 2023-12-05T09:25:55.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/2: creat f1 x:0 0 0 2023-12-05T09:25:55.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/3: truncate f1 676049 0 2023-12-05T09:25:55.791 INFO:tasks.workunit.client.0.smithi067.stdout:1/4: mkdir d2/d3 0 2023-12-05T09:25:55.791 INFO:tasks.workunit.client.0.smithi067.stdout:1/5: chown f1 0 1 2023-12-05T09:25:55.791 INFO:tasks.workunit.client.0.smithi067.stdout:1/6: chown l0 19 1 2023-12-05T09:25:55.791 INFO:tasks.workunit.client.0.smithi067.stdout:1/7: rename d2 to d2/d3/d4 22 2023-12-05T09:25:55.792 INFO:tasks.workunit.client.0.smithi067.stdout:5/0: fsync - no filename 2023-12-05T09:25:55.793 INFO:tasks.workunit.client.0.smithi067.stdout:5/1: rename - no filename 2023-12-05T09:25:55.793 INFO:tasks.workunit.client.0.smithi067.stdout:5/2: rename - no filename 2023-12-05T09:25:55.793 INFO:tasks.workunit.client.0.smithi067.stdout:5/3: write - no filename 2023-12-05T09:25:55.799 INFO:tasks.workunit.client.0.smithi067.stdout:3/4: symlink l2 0 2023-12-05T09:25:55.799 INFO:tasks.workunit.client.0.smithi067.stdout:1/8: mkdir d2/d5 0 2023-12-05T09:25:55.803 INFO:tasks.workunit.client.0.smithi067.stdout:5/4: creat f0 x:0 0 0 2023-12-05T09:25:55.803 INFO:tasks.workunit.client.0.smithi067.stdout:5/5: creat f1 x:0 0 0 2023-12-05T09:25:55.803 INFO:tasks.workunit.client.0.smithi067.stdout:5/6: write f1 [464581,84059] 0 2023-12-05T09:25:55.804 INFO:tasks.workunit.client.0.smithi067.stdout:1/9: symlink d2/l6 0 2023-12-05T09:25:55.808 INFO:tasks.workunit.client.0.smithi067.stdout:3/5: unlink f1 0 2023-12-05T09:25:55.809 INFO:tasks.workunit.client.0.smithi067.stdout:7/0: mkdir d0 0 2023-12-05T09:25:55.809 INFO:tasks.workunit.client.0.smithi067.stdout:7/1: chown d0 513512791 1 2023-12-05T09:25:55.809 INFO:tasks.workunit.client.0.smithi067.stdout:7/2: dwrite - no filename 2023-12-05T09:25:55.809 INFO:tasks.workunit.client.0.smithi067.stdout:7/3: chown d0 938016975 1 2023-12-05T09:25:55.810 INFO:tasks.workunit.client.0.smithi067.stdout:5/7: mknod c2 0 2023-12-05T09:25:55.810 INFO:tasks.workunit.client.0.smithi067.stdout:5/8: creat f3 x:0 0 0 2023-12-05T09:25:55.811 INFO:tasks.workunit.client.0.smithi067.stdout:1/10: mkdir d2/d5/d7 0 2023-12-05T09:25:55.814 INFO:tasks.workunit.client.0.smithi067.stdout:6/0: link - no file 2023-12-05T09:25:55.814 INFO:tasks.workunit.client.0.smithi067.stdout:6/1: dread - no filename 2023-12-05T09:25:55.814 INFO:tasks.workunit.client.0.smithi067.stdout:6/2: write - no filename 2023-12-05T09:25:55.815 INFO:tasks.workunit.client.0.smithi067.stdout:7/4: symlink d0/l1 0 2023-12-05T09:25:55.815 INFO:tasks.workunit.client.0.smithi067.stdout:7/5: truncate - no filename 2023-12-05T09:25:55.815 INFO:tasks.workunit.client.0.smithi067.stdout:7/6: readlink d0/l1 0 2023-12-05T09:25:55.815 INFO:tasks.workunit.client.0.smithi067.stdout:7/7: truncate - no filename 2023-12-05T09:25:55.826 INFO:tasks.workunit.client.0.smithi067.stdout:5/9: rename f0 to f4 0 2023-12-05T09:25:55.826 INFO:tasks.workunit.client.0.smithi067.stdout:1/11: mkdir d2/d5/d7/d8 0 2023-12-05T09:25:55.827 INFO:tasks.workunit.client.0.smithi067.stdout:5/10: creat f5 x:0 0 0 2023-12-05T09:25:55.827 INFO:tasks.workunit.client.0.smithi067.stdout:8/0: read - no filename 2023-12-05T09:25:55.827 INFO:tasks.workunit.client.0.smithi067.stdout:8/1: write - no filename 2023-12-05T09:25:55.828 INFO:tasks.workunit.client.0.smithi067.stdout:8/2: chown . 91940 1 2023-12-05T09:25:55.833 INFO:tasks.workunit.client.0.smithi067.stdout:7/8: creat d0/f2 x:0 0 0 2023-12-05T09:25:55.833 INFO:tasks.workunit.client.0.smithi067.stdout:7/9: write d0/f2 [392744,32987] 0 2023-12-05T09:25:55.836 INFO:tasks.workunit.client.0.smithi067.stdout:1/12: link d2/l6 d2/d5/l9 0 2023-12-05T09:25:55.846 INFO:tasks.workunit.client.0.smithi067.stdout:5/11: rename f3 to f6 0 2023-12-05T09:25:55.846 INFO:tasks.workunit.client.0.smithi067.stdout:8/3: symlink l0 0 2023-12-05T09:25:55.846 INFO:tasks.workunit.client.0.smithi067.stdout:8/4: write - no filename 2023-12-05T09:25:55.848 INFO:tasks.workunit.client.0.smithi067.stdout:7/10: mknod d0/c3 0 2023-12-05T09:25:55.848 INFO:tasks.workunit.client.0.smithi067.stdout:1/13: symlink d2/la 0 2023-12-05T09:25:55.849 INFO:tasks.workunit.client.0.smithi067.stdout:1/14: truncate f1 1323083 0 2023-12-05T09:25:55.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.849+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/410580209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fde80 msgr2=0x7fe2d0100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:55.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.849+0000 7fe2d5c3d700 1 --2- 172.21.15.67:0/410580209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fde80 0x7fe2d0100300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0004940 tx=0x7fe2c0009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:55.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.851+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/410580209 shutdown_connections 2023-12-05T09:25:55.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.851+0000 7fe2d5c3d700 1 --2- 172.21.15.67:0/410580209 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fde80 0x7fe2d0100300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:55.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.851+0000 7fe2d5c3d700 1 --2- 172.21.15.67:0/410580209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d00fb520 0x7fe2d00fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:55.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.851+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/410580209 >> 172.21.15.67:0/410580209 conn(0x7fe2d00f7190 msgr2=0x7fe2d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:55.851 INFO:tasks.workunit.client.0.smithi067.stdout:8/5: creat f1 x:0 0 0 2023-12-05T09:25:55.851 INFO:tasks.workunit.client.0.smithi067.stdout:8/6: creat f2 x:0 0 0 2023-12-05T09:25:55.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.853+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/410580209 shutdown_connections 2023-12-05T09:25:55.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.853+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/410580209 wait complete. 2023-12-05T09:25:55.855 INFO:tasks.workunit.client.0.smithi067.stdout:9/0: symlink l0 0 2023-12-05T09:25:55.855 INFO:tasks.workunit.client.0.smithi067.stdout:9/1: write - no filename 2023-12-05T09:25:55.855 INFO:tasks.workunit.client.0.smithi067.stdout:9/2: read - no filename 2023-12-05T09:25:55.855 INFO:tasks.workunit.client.0.smithi067.stdout:9/3: rmdir - no directory 2023-12-05T09:25:55.856 INFO:tasks.workunit.client.0.smithi067.stdout:1/15: mknod d2/d5/d7/cb 0 2023-12-05T09:25:55.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.859+0000 7fe2d5c3d700 1 Processor -- start 2023-12-05T09:25:55.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.860+0000 7fe2d5c3d700 1 -- start start 2023-12-05T09:25:55.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.861+0000 7fe2d5c3d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fb520 0x7fe2d0113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:55.861 INFO:tasks.workunit.client.0.smithi067.stdout:8/7: mknod c3 0 2023-12-05T09:25:55.861 INFO:tasks.workunit.client.0.smithi067.stdout:1/16: symlink d2/d5/lc 0 2023-12-05T09:25:55.861 INFO:tasks.workunit.client.0.smithi067.stdout:1/17: truncate f1 1594418 0 2023-12-05T09:25:55.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.862+0000 7fe2d5c3d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d00fde80 0x7fe2d0114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:55.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.862+0000 7fe2d5c3d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01146f0 con 0x7fe2d00fb520 2023-12-05T09:25:55.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.862+0000 7fe2d5c3d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0114f30 con 0x7fe2d00fde80 2023-12-05T09:25:55.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.863+0000 7fe2cf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fb520 0x7fe2d0113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:55.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.863+0000 7fe2cf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fb520 0x7fe2d0113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57284/0 (socket says 172.21.15.67:57284) 2023-12-05T09:25:55.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.863+0000 7fe2cf7fe700 1 -- 172.21.15.67:0/327005541 learned_addr learned my addr 172.21.15.67:0/327005541 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:55.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.865+0000 7fe2cf7fe700 1 -- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d00fde80 msgr2=0x7fe2d0114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:55.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.865+0000 7fe2cf7fe700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d00fde80 0x7fe2d0114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:55.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.865+0000 7fe2cf7fe700 1 -- 172.21.15.67:0/327005541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0005040 con 0x7fe2d00fb520 2023-12-05T09:25:55.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.866+0000 7fe2cf7fe700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fb520 0x7fe2d0113b20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400b790 tx=0x7fe2c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:55.867 INFO:tasks.workunit.client.0.smithi067.stdout:1/18: symlink d2/d3/ld 0 2023-12-05T09:25:55.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.868+0000 7fe2b7fff700 1 -- 172.21.15.67:0/327005541 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c400f770 con 0x7fe2d00fb520 2023-12-05T09:25:55.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.869+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d0115210 con 0x7fe2d00fb520 2023-12-05T09:25:55.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.869+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d0115750 con 0x7fe2d00fb520 2023-12-05T09:25:55.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.870+0000 7fe2b7fff700 1 -- 172.21.15.67:0/327005541 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe2c400fd80 con 0x7fe2d00fb520 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: Adjusting osd_memory_target on smithi067 to 1618M 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:55.871 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:25:55.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:25:55.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:25:55.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:25:55.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: pgmap v13: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 302 op/s 2023-12-05T09:25:55.872 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:55 smithi067 ceph-mon[107174]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:25:55.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.870+0000 7fe2b7fff700 1 -- 172.21.15.67:0/327005541 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c400d310 con 0x7fe2d00fb520 2023-12-05T09:25:55.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.873+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2bc0052e0 con 0x7fe2d00fb520 2023-12-05T09:25:55.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.878+0000 7fe2b7fff700 1 -- 172.21.15.67:0/327005541 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fe2c400f8d0 con 0x7fe2d00fb520 2023-12-05T09:25:55.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:55.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:55.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: Adjusting osd_memory_target on smithi067 to 1618M 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: pgmap v13: 65 pgs: 65 active+clean; 168 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 302 op/s 2023-12-05T09:25:55.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:55 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:25:55.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.882+0000 7fe2b7fff700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe2b806afd0 0x7fe2b806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:55.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.882+0000 7fe2b7fff700 1 -- 172.21.15.67:0/327005541 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe2c4089890 con 0x7fe2d00fb520 2023-12-05T09:25:55.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.885+0000 7fe2ceffd700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe2b806afd0 0x7fe2b806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:55.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.887+0000 7fe2ceffd700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe2b806afd0 0x7fe2b806d480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000b3b0 tx=0x7fe2c0009e30 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:55.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:55.894+0000 7fe2b7fff700 1 -- 172.21.15.67:0/327005541 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe2c4057810 con 0x7fe2d00fb520 2023-12-05T09:25:56.082 INFO:tasks.workunit.client.0.smithi067.stdout:0/12: dwrite f1 [0,4194304] 0 2023-12-05T09:25:56.244 INFO:tasks.workunit.client.0.smithi067.stdout:5/12: link f6 f7 0 2023-12-05T09:25:56.244 INFO:tasks.workunit.client.0.smithi067.stdout:5/13: creat f8 x:0 0 0 2023-12-05T09:25:56.253 INFO:tasks.workunit.client.0.smithi067.stdout:9/4: getdents . 0 2023-12-05T09:25:56.256 INFO:tasks.workunit.client.0.smithi067.stdout:5/14: link f8 f9 0 2023-12-05T09:25:56.261 INFO:tasks.workunit.client.0.smithi067.stdout:9/5: mkdir d1 0 2023-12-05T09:25:56.275 INFO:tasks.workunit.client.0.smithi067.stdout:9/6: rmdir d1 0 2023-12-05T09:25:56.276 INFO:tasks.workunit.client.0.smithi067.stdout:9/7: read - no filename 2023-12-05T09:25:56.281 INFO:tasks.workunit.client.0.smithi067.stdout:9/8: symlink l2 0 2023-12-05T09:25:56.286 INFO:tasks.workunit.client.0.smithi067.stdout:9/9: rename l2 to l3 0 2023-12-05T09:25:56.289 INFO:tasks.workunit.client.0.smithi067.stdout:9/10: mknod c4 0 2023-12-05T09:25:56.289 INFO:tasks.workunit.client.0.smithi067.stdout:9/11: dread - no filename 2023-12-05T09:25:56.289 INFO:tasks.workunit.client.0.smithi067.stdout:9/12: dread - no filename 2023-12-05T09:25:56.395 INFO:tasks.workunit.client.0.smithi067.stdout:3/6: dread f0 [0,4194304] 0 2023-12-05T09:25:56.403 INFO:tasks.workunit.client.0.smithi067.stdout:1/19: dread f1 [0,4194304] 0 2023-12-05T09:25:56.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/7: dread f0 [0,4194304] 0 2023-12-05T09:25:56.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/8: truncate f0 243477 0 2023-12-05T09:25:56.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/9: chown f0 0 1 2023-12-05T09:25:56.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/10: write f0 [354791,46773] 0 2023-12-05T09:25:56.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/11: creat f3 x:0 0 0 2023-12-05T09:25:56.419 INFO:tasks.workunit.client.0.smithi067.stdout:1/20: rmdir d2/d3 39 2023-12-05T09:25:56.419 INFO:tasks.workunit.client.0.smithi067.stdout:0/13: write f1 [3886350,102510] 0 2023-12-05T09:25:56.419 INFO:tasks.workunit.client.0.smithi067.stdout:0/14: readlink - no filename 2023-12-05T09:25:56.427 INFO:tasks.workunit.client.0.smithi067.stdout:0/15: write f0 [663578,37994] 0 2023-12-05T09:25:56.446 INFO:tasks.workunit.client.0.smithi067.stdout:5/15: getdents . 0 2023-12-05T09:25:56.454 INFO:tasks.workunit.client.0.smithi067.stdout:0/16: creat d3/f4 x:0 0 0 2023-12-05T09:25:56.454 INFO:tasks.workunit.client.0.smithi067.stdout:0/17: write f0 [1538722,72] 0 2023-12-05T09:25:56.454 INFO:tasks.workunit.client.0.smithi067.stdout:0/18: dread - d3/f4 zero size 2023-12-05T09:25:56.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.454+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2bc000bf0 con 0x7fe2b806afd0 2023-12-05T09:25:56.455 INFO:tasks.workunit.client.0.smithi067.stdout:0/19: write d3/f4 [437291,88270] 0 2023-12-05T09:25:56.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.456+0000 7fe2b7fff700 1 -- 172.21.15.67:0/327005541 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe2bc000bf0 con 0x7fe2b806afd0 2023-12-05T09:25:56.459 INFO:tasks.workunit.client.0.smithi067.stdout:0/20: fsync f2 0 2023-12-05T09:25:56.459 INFO:tasks.workunit.client.0.smithi067.stdout:5/16: mknod ca 0 2023-12-05T09:25:56.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.460+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe2b806afd0 msgr2=0x7fe2b806d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:56.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.460+0000 7fe2d5c3d700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe2b806afd0 0x7fe2b806d480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000b3b0 tx=0x7fe2c0009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:56.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.460+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fb520 msgr2=0x7fe2d0113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:56.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.460+0000 7fe2d5c3d700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fb520 0x7fe2d0113b20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400b790 tx=0x7fe2c4009250 comp rx=0 tx=0).stop 2023-12-05T09:25:56.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.461+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 shutdown_connections 2023-12-05T09:25:56.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.461+0000 7fe2d5c3d700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe2b806afd0 0x7fe2b806d480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:56.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.461+0000 7fe2d5c3d700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe2d00fb520 0x7fe2d0113b20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:56.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.461+0000 7fe2d5c3d700 1 --2- 172.21.15.67:0/327005541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d00fde80 0x7fe2d0114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:56.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.461+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 >> 172.21.15.67:0/327005541 conn(0x7fe2d00f7190 msgr2=0x7fe2d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:56.464 INFO:tasks.workunit.client.0.smithi067.stdout:5/17: mkdir db 0 2023-12-05T09:25:56.468 INFO:tasks.workunit.client.0.smithi067.stdout:5/18: creat db/fc x:0 0 0 2023-12-05T09:25:56.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.469+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 shutdown_connections 2023-12-05T09:25:56.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.470+0000 7fe2d5c3d700 1 -- 172.21.15.67:0/327005541 wait complete. 2023-12-05T09:25:56.477 INFO:tasks.workunit.client.0.smithi067.stdout:5/19: rename f8 to db/fd 0 2023-12-05T09:25:56.477 INFO:tasks.workunit.client.0.smithi067.stdout:5/20: write f9 [736559,2703] 0 2023-12-05T09:25:56.477 INFO:tasks.workunit.client.0.smithi067.stdout:5/21: creat db/fe x:0 0 0 2023-12-05T09:25:56.486 INFO:tasks.workunit.client.0.smithi067.stdout:7/11: dread d0/f2 [0,4194304] 0 2023-12-05T09:25:56.488 INFO:tasks.workunit.client.0.smithi067.stdout:7/12: stat d0/f2 0 2023-12-05T09:25:56.499 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:25:56.558 INFO:tasks.workunit.client.0.smithi067.stdout:9/13: link l3 l5 0 2023-12-05T09:25:56.558 INFO:tasks.workunit.client.0.smithi067.stdout:9/14: chown l0 451316342 1 2023-12-05T09:25:56.558 INFO:tasks.workunit.client.0.smithi067.stdout:9/15: read - no filename 2023-12-05T09:25:56.559 INFO:tasks.workunit.client.0.smithi067.stdout:1/21: dwrite f1 [0,4194304] 0 2023-12-05T09:25:56.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/16: mkdir d6 0 2023-12-05T09:25:56.574 INFO:tasks.workunit.client.0.smithi067.stdout:1/22: mkdir d2/d5/d7/de 0 2023-12-05T09:25:56.581 INFO:tasks.workunit.client.0.smithi067.stdout:9/17: unlink l3 0 2023-12-05T09:25:56.581 INFO:tasks.workunit.client.0.smithi067.stdout:9/18: chown l0 129 1 2023-12-05T09:25:56.582 INFO:tasks.workunit.client.0.smithi067.stdout:9/19: chown c4 784 1 2023-12-05T09:25:56.592 INFO:tasks.workunit.client.0.smithi067.stdout:1/23: write f1 [1136944,25245] 0 2023-12-05T09:25:56.613 INFO:tasks.workunit.client.0.smithi067.stdout:9/20: rmdir d6 0 2023-12-05T09:25:56.619 INFO:tasks.workunit.client.0.smithi067.stdout:9/21: creat f7 x:0 0 0 2023-12-05T09:25:56.621 INFO:tasks.workunit.client.0.smithi067.stdout:9/22: write f7 [628609,35355] 0 2023-12-05T09:25:56.644 INFO:tasks.workunit.client.0.smithi067.stdout:1/24: fdatasync f1 0 2023-12-05T09:25:56.644 INFO:tasks.workunit.client.0.smithi067.stdout:1/25: write f1 [554095,10463] 0 2023-12-05T09:25:56.646 INFO:tasks.workunit.client.0.smithi067.stdout:1/26: symlink d2/d5/lf 0 2023-12-05T09:25:56.697 INFO:tasks.workunit.client.0.smithi067.stdout:3/12: truncate f0 335499 0 2023-12-05T09:25:56.707 INFO:tasks.workunit.client.0.smithi067.stdout:8/8: dwrite f1 [0,4194304] 0 2023-12-05T09:25:56.718 INFO:tasks.workunit.client.0.smithi067.stdout:8/9: unlink f1 0 2023-12-05T09:25:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.743+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/445282101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 msgr2=0x7fe1f406dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.743+0000 7fe1fa3e9700 1 --2- 172.21.15.67:0/445282101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 0x7fe1f406dea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4004940 tx=0x7fe1e4009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.743+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/445282101 shutdown_connections 2023-12-05T09:25:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.743+0000 7fe1fa3e9700 1 --2- 172.21.15.67:0/445282101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f406e470 0x7fe1f406e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.743+0000 7fe1fa3e9700 1 --2- 172.21.15.67:0/445282101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 0x7fe1f406dea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.743+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/445282101 >> 172.21.15.67:0/445282101 conn(0x7fe1f4069b70 msgr2=0x7fe1f406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.744+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/445282101 shutdown_connections 2023-12-05T09:25:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.744+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/445282101 wait complete. 2023-12-05T09:25:56.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.745+0000 7fe1fa3e9700 1 Processor -- start 2023-12-05T09:25:56.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.746+0000 7fe1fa3e9700 1 -- start start 2023-12-05T09:25:56.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.747+0000 7fe1fa3e9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f406e470 0x7fe1f4113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:56.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.747+0000 7fe1fa3e9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 0x7fe1f4113d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:56.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.747+0000 7fe1fa3e9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4114470 con 0x7fe1f406e470 2023-12-05T09:25:56.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.747+0000 7fe1fa3e9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4117ed0 con 0x7fe1f406fa30 2023-12-05T09:25:56.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.749+0000 7fe1f8be6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 0x7fe1f4113d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:56.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.749+0000 7fe1f8be6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 0x7fe1f4113d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:46138/0 (socket says 172.21.15.67:46138) 2023-12-05T09:25:56.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.749+0000 7fe1f8be6700 1 -- 172.21.15.67:0/4042800509 learned_addr learned my addr 172.21.15.67:0/4042800509 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:56.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.749+0000 7fe1f93e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f406e470 0x7fe1f4113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.750+0000 7fe1f93e7700 1 -- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 msgr2=0x7fe1f4113d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.750+0000 7fe1f93e7700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 0x7fe1f4113d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.750+0000 7fe1f93e7700 1 -- 172.21.15.67:0/4042800509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4005040 con 0x7fe1f406e470 2023-12-05T09:25:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.752+0000 7fe1f93e7700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f406e470 0x7fe1f4113850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009fd0 tx=0x7fe1e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:56.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.754+0000 7fe1e9ffb700 1 -- 172.21.15.67:0/4042800509 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e400e070 con 0x7fe1f406e470 2023-12-05T09:25:56.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.755+0000 7fe1e9ffb700 1 -- 172.21.15.67:0/4042800509 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1e4004290 con 0x7fe1f406e470 2023-12-05T09:25:56.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.755+0000 7fe1e9ffb700 1 -- 172.21.15.67:0/4042800509 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e401c640 con 0x7fe1f406e470 2023-12-05T09:25:56.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.755+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f4118150 con 0x7fe1f406e470 2023-12-05T09:25:56.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.755+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f4118710 con 0x7fe1f406e470 2023-12-05T09:25:56.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.757+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f404bb80 con 0x7fe1f406e470 2023-12-05T09:25:56.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.764+0000 7fe1e9ffb700 1 -- 172.21.15.67:0/4042800509 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fe1e400bd20 con 0x7fe1f406e470 2023-12-05T09:25:56.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.765+0000 7fe1e9ffb700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe1e006af50 0x7fe1e006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:56.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.766+0000 7fe1f8be6700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe1e006af50 0x7fe1e006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:56.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.766+0000 7fe1e9ffb700 1 -- 172.21.15.67:0/4042800509 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe1e4059f60 con 0x7fe1f406e470 2023-12-05T09:25:56.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.768+0000 7fe1f8be6700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe1e006af50 0x7fe1e006d400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009b30 tx=0x7fe1f0008040 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:56.771 INFO:tasks.workunit.client.0.smithi067.stdout:3/13: link f0 f4 0 2023-12-05T09:25:56.773 INFO:tasks.workunit.client.0.smithi067.stdout:3/14: mknod c5 0 2023-12-05T09:25:56.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:56.801+0000 7fe1e9ffb700 1 -- 172.21.15.67:0/4042800509 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe1e4055ba0 con 0x7fe1f406e470 2023-12-05T09:25:56.857 INFO:tasks.workunit.client.0.smithi067.stdout:1/27: dwrite f1 [4194304,4194304] 0 2023-12-05T09:25:56.858 INFO:tasks.workunit.client.0.smithi067.stdout:9/23: write f7 [412935,68047] 0 2023-12-05T09:25:56.864 INFO:tasks.workunit.client.0.smithi067.stdout:1/28: rename d2/d5/d7/d8 to d2/d5/d7/de/d10 0 2023-12-05T09:25:56.864 INFO:tasks.workunit.client.0.smithi067.stdout:1/29: write f1 [1801514,35243] 0 2023-12-05T09:25:56.873 INFO:tasks.workunit.client.0.smithi067.stdout:3/15: dwrite f4 [0,4194304] 0 2023-12-05T09:25:56.873 INFO:tasks.workunit.client.0.smithi067.stdout:3/16: creat f6 x:0 0 0 2023-12-05T09:25:56.874 INFO:tasks.workunit.client.0.smithi067.stdout:1/30: rename d2/la to d2/d3/l11 0 2023-12-05T09:25:56.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/10: dwrite f2 [0,4194304] 0 2023-12-05T09:25:56.879 INFO:tasks.workunit.client.0.smithi067.stdout:9/24: unlink l0 0 2023-12-05T09:25:56.894 INFO:tasks.workunit.client.0.smithi067.stdout:9/25: creat f8 x:0 0 0 2023-12-05T09:25:56.903 INFO:tasks.workunit.client.0.smithi067.stdout:8/11: write f2 [3788781,89463] 0 2023-12-05T09:25:56.914 INFO:tasks.workunit.client.0.smithi067.stdout:0/21: dwrite f2 [0,4194304] 0 2023-12-05T09:25:56.922 INFO:tasks.workunit.client.0.smithi067.stdout:9/26: dread f7 [0,4194304] 0 2023-12-05T09:25:56.929 INFO:tasks.workunit.client.0.smithi067.stdout:7/13: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:25:56.929 INFO:tasks.workunit.client.0.smithi067.stdout:7/14: stat d0/l1 0 2023-12-05T09:25:56.931 INFO:tasks.workunit.client.0.smithi067.stdout:5/22: dread f9 [0,4194304] 0 2023-12-05T09:25:56.936 INFO:tasks.workunit.client.0.smithi067.stdout:1/31: rename d2/d3/l11 to d2/d5/d7/l12 0 2023-12-05T09:25:56.956 INFO:tasks.workunit.client.0.smithi067.stdout:5/23: mkdir db/df 0 2023-12-05T09:25:56.956 INFO:tasks.workunit.client.0.smithi067.stdout:5/24: truncate db/fe 886692 0 2023-12-05T09:25:56.956 INFO:tasks.workunit.client.0.smithi067.stdout:5/25: write f1 [1089575,37017] 0 2023-12-05T09:25:56.956 INFO:tasks.workunit.client.0.smithi067.stdout:5/26: write f5 [670791,31079] 0 2023-12-05T09:25:56.956 INFO:tasks.workunit.client.0.smithi067.stdout:3/17: getdents . 0 2023-12-05T09:25:56.962 INFO:tasks.workunit.client.0.smithi067.stdout:9/27: getdents . 0 2023-12-05T09:25:56.962 INFO:tasks.workunit.client.0.smithi067.stdout:9/28: readlink l5 0 2023-12-05T09:25:56.965 INFO:tasks.workunit.client.0.smithi067.stdout:5/27: mknod db/df/c10 0 2023-12-05T09:25:56.997 INFO:tasks.workunit.client.0.smithi067.stdout:7/15: write d0/f2 [2712215,84215] 0 2023-12-05T09:25:57.015 INFO:tasks.workunit.client.0.smithi067.stdout:1/32: dread f1 [0,4194304] 0 2023-12-05T09:25:57.030 INFO:tasks.workunit.client.0.smithi067.stdout:5/28: getdents db 0 2023-12-05T09:25:57.069 INFO:tasks.workunit.client.0.smithi067.stdout:0/22: dwrite f2 [4194304,4194304] 0 2023-12-05T09:25:57.070 INFO:tasks.workunit.client.0.smithi067.stdout:0/23: creat d3/f5 x:0 0 0 2023-12-05T09:25:57.070 INFO:tasks.workunit.client.0.smithi067.stdout:9/29: dwrite f8 [0,4194304] 0 2023-12-05T09:25:57.070 INFO:tasks.workunit.client.0.smithi067.stdout:1/33: dread f1 [4194304,4194304] 0 2023-12-05T09:25:57.082 INFO:tasks.workunit.client.0.smithi067.stdout:7/16: truncate d0/f2 272107 0 2023-12-05T09:25:57.092 INFO:tasks.workunit.client.0.smithi067.stdout:9/30: creat f9 x:0 0 0 2023-12-05T09:25:57.092 INFO:tasks.workunit.client.0.smithi067.stdout:9/31: dread - f9 zero size 2023-12-05T09:25:57.095 INFO:tasks.workunit.client.0.smithi067.stdout:7/17: symlink d0/l4 0 2023-12-05T09:25:57.095 INFO:tasks.workunit.client.0.smithi067.stdout:7/18: creat d0/f5 x:0 0 0 2023-12-05T09:25:57.116 INFO:tasks.workunit.client.0.smithi067.stdout:8/12: dwrite f2 [0,4194304] 0 2023-12-05T09:25:57.117 INFO:tasks.workunit.client.0.smithi067.stdout:8/13: rename l0 to l4 0 2023-12-05T09:25:57.117 INFO:tasks.workunit.client.0.smithi067.stdout:8/14: mkdir d5 0 2023-12-05T09:25:57.117 INFO:tasks.workunit.client.0.smithi067.stdout:8/15: symlink d5/l6 0 2023-12-05T09:25:57.148 INFO:tasks.workunit.client.0.smithi067.stdout:5/29: dwrite db/fd [0,4194304] 0 2023-12-05T09:25:57.154 INFO:tasks.workunit.client.0.smithi067.stdout:9/32: fsync f9 0 2023-12-05T09:25:57.154 INFO:tasks.workunit.client.0.smithi067.stdout:9/33: creat fa x:0 0 0 2023-12-05T09:25:57.163 INFO:tasks.workunit.client.0.smithi067.stdout:5/30: mknod db/c11 0 2023-12-05T09:25:57.165 INFO:tasks.workunit.client.0.smithi067.stdout:5/31: creat db/df/f12 x:0 0 0 2023-12-05T09:25:57.180 INFO:tasks.workunit.client.0.smithi067.stdout:9/34: dread f8 [0,4194304] 0 2023-12-05T09:25:57.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/35: unlink l5 0 2023-12-05T09:25:57.189 INFO:tasks.workunit.client.0.smithi067.stdout:8/16: dwrite f2 [0,4194304] 0 2023-12-05T09:25:57.194 INFO:tasks.workunit.client.0.smithi067.stdout:0/24: dwrite f0 [0,4194304] 0 2023-12-05T09:25:57.195 INFO:tasks.workunit.client.0.smithi067.stdout:1/34: dwrite f1 [4194304,4194304] 0 2023-12-05T09:25:57.195 INFO:tasks.workunit.client.0.smithi067.stdout:1/35: fsync f1 0 2023-12-05T09:25:57.195 INFO:tasks.workunit.client.0.smithi067.stdout:1/36: chown d2/d5/d7/de 10 1 2023-12-05T09:25:57.213 INFO:tasks.workunit.client.0.smithi067.stdout:9/36: getdents . 0 2023-12-05T09:25:57.214 INFO:tasks.workunit.client.0.smithi067.stdout:8/17: write f2 [3442636,64173] 0 2023-12-05T09:25:57.218 INFO:tasks.workunit.client.0.smithi067.stdout:8/18: mknod d5/c7 0 2023-12-05T09:25:57.221 INFO:tasks.workunit.client.0.smithi067.stdout:7/19: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:25:57.227 INFO:tasks.workunit.client.0.smithi067.stdout:7/20: rename d0/f5 to d0/f6 0 2023-12-05T09:25:57.233 INFO:tasks.workunit.client.0.smithi067.stdout:9/37: write f8 [988203,61725] 0 2023-12-05T09:25:57.235 INFO:tasks.workunit.client.0.smithi067.stdout:0/25: dwrite d3/f5 [0,4194304] 0 2023-12-05T09:25:57.235 INFO:tasks.workunit.client.0.smithi067.stdout:0/26: chown f1 890 1 2023-12-05T09:25:57.236 INFO:tasks.workunit.client.0.smithi067.stdout:0/27: stat f0 0 2023-12-05T09:25:57.236 INFO:tasks.workunit.client.0.smithi067.stdout:9/38: rename f8 to fb 0 2023-12-05T09:25:57.236 INFO:tasks.workunit.client.0.smithi067.stdout:9/39: stat f9 0 2023-12-05T09:25:57.238 INFO:tasks.workunit.client.0.smithi067.stdout:0/28: link d3/f5 d3/f6 0 2023-12-05T09:25:57.238 INFO:tasks.workunit.client.0.smithi067.stdout:9/40: creat fc x:0 0 0 2023-12-05T09:25:57.239 INFO:tasks.workunit.client.0.smithi067.stdout:9/41: rmdir - no directory 2023-12-05T09:25:57.239 INFO:tasks.workunit.client.0.smithi067.stdout:0/29: mkdir d3/d7 0 2023-12-05T09:25:57.241 INFO:tasks.workunit.client.0.smithi067.stdout:9/42: mknod cd 0 2023-12-05T09:25:57.241 INFO:tasks.workunit.client.0.smithi067.stdout:9/43: chown cd 1781257 1 2023-12-05T09:25:57.252 INFO:tasks.workunit.client.0.smithi067.stdout:0/30: fsync d3/f5 0 2023-12-05T09:25:57.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/31: dread d3/f4 [0,4194304] 0 2023-12-05T09:25:57.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/32: rename f0 to d3/d7/f8 0 2023-12-05T09:25:57.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/33: stat f1 0 2023-12-05T09:25:57.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/34: chown d3/d7 464222382 1 2023-12-05T09:25:57.281 INFO:tasks.workunit.client.0.smithi067.stdout:0/35: dread d3/f6 [0,4194304] 0 2023-12-05T09:25:57.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.292+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1f410a580 con 0x7fe1e006af50 2023-12-05T09:25:57.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.293+0000 7fe1e9ffb700 1 -- 172.21.15.67:0/4042800509 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe1f410a580 con 0x7fe1e006af50 2023-12-05T09:25:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.297+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe1e006af50 msgr2=0x7fe1e006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:57.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.297+0000 7fe1fa3e9700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe1e006af50 0x7fe1e006d400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009b30 tx=0x7fe1f0008040 comp rx=0 tx=0).stop 2023-12-05T09:25:57.297 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.297+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f406e470 msgr2=0x7fe1f4113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:57.297 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.297+0000 7fe1fa3e9700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f406e470 0x7fe1f4113850 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009fd0 tx=0x7fe1e4009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:57.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.299+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 shutdown_connections 2023-12-05T09:25:57.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.299+0000 7fe1fa3e9700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fe1e006af50 0x7fe1e006d400 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.299+0000 7fe1fa3e9700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1f406e470 0x7fe1f4113850 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.299+0000 7fe1fa3e9700 1 --2- 172.21.15.67:0/4042800509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1f406fa30 0x7fe1f4113d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.299+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 >> 172.21.15.67:0/4042800509 conn(0x7fe1f4069b70 msgr2=0x7fe1f4108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:57.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.299+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 shutdown_connections 2023-12-05T09:25:57.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.299+0000 7fe1fa3e9700 1 -- 172.21.15.67:0/4042800509 wait complete. 2023-12-05T09:25:57.299 INFO:tasks.workunit.client.0.smithi067.stdout:0/36: dread f2 [4194304,4194304] 0 2023-12-05T09:25:57.299 INFO:tasks.workunit.client.0.smithi067.stdout:0/37: rename d3 to d3/d9 22 2023-12-05T09:25:57.299 INFO:tasks.workunit.client.0.smithi067.stdout:0/38: creat d3/fa x:0 0 0 2023-12-05T09:25:57.303 INFO:tasks.workunit.client.0.smithi067.stdout:0/39: unlink f2 0 2023-12-05T09:25:57.304 INFO:tasks.workunit.client.0.smithi067.stdout:0/40: creat d3/fb x:0 0 0 2023-12-05T09:25:57.307 INFO:tasks.workunit.client.0.smithi067.stdout:0/41: creat d3/d7/fc x:0 0 0 2023-12-05T09:25:57.307 INFO:tasks.workunit.client.0.smithi067.stdout:0/42: readlink - no filename 2023-12-05T09:25:57.346 INFO:tasks.workunit.client.0.smithi067.stdout:8/19: dwrite f2 [0,4194304] 0 2023-12-05T09:25:57.363 INFO:tasks.workunit.client.0.smithi067.stdout:8/20: write f2 [3570013,46536] 0 2023-12-05T09:25:57.364 INFO:tasks.workunit.client.0.smithi067.stdout:8/21: getdents d5 0 2023-12-05T09:25:57.365 INFO:tasks.workunit.client.0.smithi067.stdout:8/22: chown l4 0 1 2023-12-05T09:25:57.366 INFO:tasks.workunit.client.0.smithi067.stdout:8/23: mknod d5/c8 0 2023-12-05T09:25:57.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:57 smithi067 ceph-mon[107174]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:25:57.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:57 smithi067 ceph-mon[107174]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:25:57.370 INFO:tasks.workunit.client.0.smithi067.stdout:8/24: rename d5/c7 to d5/c9 0 2023-12-05T09:25:57.372 INFO:tasks.workunit.client.0.smithi067.stdout:7/21: dwrite d0/f6 [0,4194304] 0 2023-12-05T09:25:57.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:57 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:25:57.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:57 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:25:57.381 INFO:tasks.workunit.client.0.smithi067.stdout:7/22: rename d0/f2 to d0/f7 0 2023-12-05T09:25:57.384 INFO:tasks.workunit.client.0.smithi067.stdout:8/25: getdents d5 0 2023-12-05T09:25:57.386 INFO:tasks.workunit.client.0.smithi067.stdout:8/26: mkdir d5/da 0 2023-12-05T09:25:57.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/44: dwrite fc [0,4194304] 0 2023-12-05T09:25:57.398 INFO:tasks.workunit.client.0.smithi067.stdout:7/23: truncate d0/f6 457996 0 2023-12-05T09:25:57.398 INFO:tasks.workunit.client.0.smithi067.stdout:7/24: chown d0/f6 49 1 2023-12-05T09:25:57.399 INFO:tasks.workunit.client.0.smithi067.stdout:8/27: truncate f2 4063422 0 2023-12-05T09:25:57.401 INFO:tasks.workunit.client.0.smithi067.stdout:9/45: rename cd to ce 0 2023-12-05T09:25:57.404 INFO:tasks.workunit.client.0.smithi067.stdout:7/25: rename d0/l1 to d0/l8 0 2023-12-05T09:25:57.404 INFO:tasks.workunit.client.0.smithi067.stdout:8/28: write f2 [2394416,65931] 0 2023-12-05T09:25:57.404 INFO:tasks.workunit.client.0.smithi067.stdout:8/29: write f2 [4519618,54569] 0 2023-12-05T09:25:57.404 INFO:tasks.workunit.client.0.smithi067.stdout:8/30: read f2 [3594354,18624] 0 2023-12-05T09:25:57.406 INFO:tasks.workunit.client.0.smithi067.stdout:8/31: creat d5/fb x:0 0 0 2023-12-05T09:25:57.407 INFO:tasks.workunit.client.0.smithi067.stdout:8/32: write d5/fb [758054,125782] 0 2023-12-05T09:25:57.407 INFO:tasks.workunit.client.0.smithi067.stdout:7/26: read d0/f6 [323156,42271] 0 2023-12-05T09:25:57.407 INFO:tasks.workunit.client.0.smithi067.stdout:7/27: write d0/f6 [1208536,41395] 0 2023-12-05T09:25:57.409 INFO:tasks.workunit.client.0.smithi067.stdout:7/28: mkdir d0/d9 0 2023-12-05T09:25:57.410 INFO:tasks.workunit.client.0.smithi067.stdout:8/33: read d5/fb [720696,50675] 0 2023-12-05T09:25:57.411 INFO:tasks.workunit.client.0.smithi067.stdout:7/29: rename d0/l4 to d0/la 0 2023-12-05T09:25:57.413 INFO:tasks.workunit.client.0.smithi067.stdout:7/30: symlink d0/lb 0 2023-12-05T09:25:57.414 INFO:tasks.workunit.client.0.smithi067.stdout:7/31: creat d0/d9/fc x:0 0 0 2023-12-05T09:25:57.414 INFO:tasks.workunit.client.0.smithi067.stdout:7/32: creat d0/d9/fd x:0 0 0 2023-12-05T09:25:57.419 INFO:tasks.workunit.client.0.smithi067.stdout:7/33: rename d0/d9/fc to d0/d9/fe 0 2023-12-05T09:25:57.419 INFO:tasks.workunit.client.0.smithi067.stdout:7/34: chown d0/l8 49901280 1 2023-12-05T09:25:57.419 INFO:tasks.workunit.client.0.smithi067.stdout:7/35: creat d0/d9/ff x:0 0 0 2023-12-05T09:25:57.419 INFO:tasks.workunit.client.0.smithi067.stdout:7/36: chown d0/f6 15080309 1 2023-12-05T09:25:57.422 INFO:tasks.workunit.client.0.smithi067.stdout:7/37: mkdir d0/d9/d10 0 2023-12-05T09:25:57.426 INFO:tasks.workunit.client.0.smithi067.stdout:7/38: rename d0/d9/fd to d0/f11 0 2023-12-05T09:25:57.427 INFO:tasks.workunit.client.0.smithi067.stdout:7/39: write d0/f11 [995886,107996] 0 2023-12-05T09:25:57.430 INFO:tasks.workunit.client.0.smithi067.stdout:7/40: symlink d0/d9/d10/l12 0 2023-12-05T09:25:57.430 INFO:tasks.workunit.client.0.smithi067.stdout:7/41: chown d0/lb 246 1 2023-12-05T09:25:57.432 INFO:tasks.workunit.client.0.smithi067.stdout:8/34: dread f2 [0,4194304] 0 2023-12-05T09:25:57.432 INFO:tasks.workunit.client.0.smithi067.stdout:8/35: read d5/fb [545607,90260] 0 2023-12-05T09:25:57.432 INFO:tasks.workunit.client.0.smithi067.stdout:8/36: readlink l4 0 2023-12-05T09:25:57.444 INFO:tasks.workunit.client.0.smithi067.stdout:7/42: fsync d0/f11 0 2023-12-05T09:25:57.445 INFO:tasks.workunit.client.0.smithi067.stdout:7/43: readlink d0/lb 0 2023-12-05T09:25:57.446 INFO:tasks.workunit.client.0.smithi067.stdout:7/44: mknod d0/c13 0 2023-12-05T09:25:57.446 INFO:tasks.workunit.client.0.smithi067.stdout:7/45: readlink d0/la 0 2023-12-05T09:25:57.446 INFO:tasks.workunit.client.0.smithi067.stdout:7/46: creat d0/d9/f14 x:0 0 0 2023-12-05T09:25:57.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/47: stat d0/l8 0 2023-12-05T09:25:57.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/48: truncate d0/d9/ff 165454 0 2023-12-05T09:25:57.448 INFO:tasks.workunit.client.0.smithi067.stdout:7/49: truncate d0/f7 4235722 0 2023-12-05T09:25:57.450 INFO:tasks.workunit.client.0.smithi067.stdout:8/37: dread d5/fb [0,4194304] 0 2023-12-05T09:25:57.456 INFO:tasks.workunit.client.0.smithi067.stdout:7/50: truncate d0/f6 545513 0 2023-12-05T09:25:57.456 INFO:tasks.workunit.client.0.smithi067.stdout:7/51: stat d0/f11 0 2023-12-05T09:25:57.472 INFO:tasks.workunit.client.0.smithi067.stdout:7/52: dread d0/d9/ff [0,4194304] 0 2023-12-05T09:25:57.473 INFO:tasks.workunit.client.0.smithi067.stdout:7/53: fsync d0/f6 0 2023-12-05T09:25:57.473 INFO:tasks.workunit.client.0.smithi067.stdout:7/54: write d0/f6 [1557988,84856] 0 2023-12-05T09:25:57.476 INFO:tasks.workunit.client.0.smithi067.stdout:7/55: rmdir d0/d9 39 2023-12-05T09:25:57.476 INFO:tasks.workunit.client.0.smithi067.stdout:7/56: truncate d0/f7 4550009 0 2023-12-05T09:25:57.478 INFO:tasks.workunit.client.0.smithi067.stdout:7/57: unlink d0/d9/fe 0 2023-12-05T09:25:57.481 INFO:tasks.workunit.client.0.smithi067.stdout:7/58: symlink d0/l15 0 2023-12-05T09:25:57.482 INFO:tasks.workunit.client.0.smithi067.stdout:7/59: truncate d0/f6 2233845 0 2023-12-05T09:25:57.482 INFO:tasks.workunit.client.0.smithi067.stdout:7/60: creat d0/f16 x:0 0 0 2023-12-05T09:25:57.484 INFO:tasks.workunit.client.0.smithi067.stdout:9/46: dwrite fb [0,4194304] 0 2023-12-05T09:25:57.484 INFO:tasks.workunit.client.0.smithi067.stdout:9/47: stat f9 0 2023-12-05T09:25:57.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/48: chown fc 613631 1 2023-12-05T09:25:57.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/49: creat ff x:0 0 0 2023-12-05T09:25:57.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/50: read f7 [395169,82977] 0 2023-12-05T09:25:57.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/51: truncate ff 22064 0 2023-12-05T09:25:57.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/52: rmdir - no directory 2023-12-05T09:25:57.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/53: write f9 [785850,22484] 0 2023-12-05T09:25:57.486 INFO:tasks.workunit.client.0.smithi067.stdout:9/54: creat f10 x:0 0 0 2023-12-05T09:25:57.486 INFO:tasks.workunit.client.0.smithi067.stdout:9/55: write f7 [1608633,44887] 0 2023-12-05T09:25:57.488 INFO:tasks.workunit.client.0.smithi067.stdout:7/61: mknod d0/d9/c17 0 2023-12-05T09:25:57.493 INFO:tasks.workunit.client.0.smithi067.stdout:9/56: link ff f11 0 2023-12-05T09:25:57.495 INFO:tasks.workunit.client.0.smithi067.stdout:9/57: mknod c12 0 2023-12-05T09:25:57.514 INFO:tasks.workunit.client.0.smithi067.stdout:7/62: getdents d0 0 2023-12-05T09:25:57.515 INFO:tasks.workunit.client.0.smithi067.stdout:8/38: dwrite f2 [0,4194304] 0 2023-12-05T09:25:57.516 INFO:tasks.workunit.client.0.smithi067.stdout:8/39: readlink d5/l6 0 2023-12-05T09:25:57.516 INFO:tasks.workunit.client.0.smithi067.stdout:7/63: unlink d0/d9/c17 0 2023-12-05T09:25:57.519 INFO:tasks.workunit.client.0.smithi067.stdout:7/64: rename d0/f16 to d0/d9/f18 0 2023-12-05T09:25:57.520 INFO:tasks.workunit.client.0.smithi067.stdout:8/40: rmdir d5 39 2023-12-05T09:25:57.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/41: mkdir d5/dc 0 2023-12-05T09:25:57.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/42: chown d5/fb 65383072 1 2023-12-05T09:25:57.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/43: readlink d5/l6 0 2023-12-05T09:25:57.533 INFO:tasks.workunit.client.0.smithi067.stdout:8/44: dread d5/fb [0,4194304] 0 2023-12-05T09:25:57.533 INFO:tasks.workunit.client.0.smithi067.stdout:8/45: write f2 [4695772,83002] 0 2023-12-05T09:25:57.533 INFO:tasks.workunit.client.0.smithi067.stdout:8/46: readlink l4 0 2023-12-05T09:25:57.536 INFO:tasks.workunit.client.0.smithi067.stdout:8/47: symlink d5/dc/ld 0 2023-12-05T09:25:57.540 INFO:tasks.workunit.client.0.smithi067.stdout:7/65: read d0/f7 [370444,50413] 0 2023-12-05T09:25:57.541 INFO:tasks.workunit.client.0.smithi067.stdout:7/66: stat d0 0 2023-12-05T09:25:57.544 INFO:tasks.workunit.client.0.smithi067.stdout:7/67: link d0/lb d0/d9/d10/l19 0 2023-12-05T09:25:57.544 INFO:tasks.workunit.client.0.smithi067.stdout:7/68: truncate d0/d9/f18 437002 0 2023-12-05T09:25:57.547 INFO:tasks.workunit.client.0.smithi067.stdout:7/69: creat d0/d9/d10/f1a x:0 0 0 2023-12-05T09:25:57.555 INFO:tasks.workunit.client.0.smithi067.stdout:9/58: dwrite fb [0,4194304] 0 2023-12-05T09:25:57.556 INFO:tasks.workunit.client.0.smithi067.stdout:9/59: symlink l13 0 2023-12-05T09:25:57.562 INFO:tasks.workunit.client.0.smithi067.stdout:7/70: dread d0/f6 [0,4194304] 0 2023-12-05T09:25:57.562 INFO:tasks.workunit.client.0.smithi067.stdout:7/71: write d0/f6 [2964789,34626] 0 2023-12-05T09:25:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.564+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/3531336587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd00fff70 msgr2=0x7fbdd01003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.564+0000 7fbdd6d6a700 1 --2- 172.21.15.67:0/3531336587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd00fff70 0x7fbdd01003e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0004940 tx=0x7fbdc0009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.564+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/3531336587 shutdown_connections 2023-12-05T09:25:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.564+0000 7fbdd6d6a700 1 --2- 172.21.15.67:0/3531336587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd00fff70 0x7fbdd01003e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.564+0000 7fbdd6d6a700 1 --2- 172.21.15.67:0/3531336587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd00fee00 0x7fbdd00ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.564+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/3531336587 >> 172.21.15.67:0/3531336587 conn(0x7fbdd00fa5d0 msgr2=0x7fbdd00fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:57.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.565+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/3531336587 shutdown_connections 2023-12-05T09:25:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.565+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/3531336587 wait complete. 2023-12-05T09:25:57.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.566+0000 7fbdd6d6a700 1 Processor -- start 2023-12-05T09:25:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.566+0000 7fbdd6d6a700 1 -- start start 2023-12-05T09:25:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.567+0000 7fbdd6d6a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd00fee00 0x7fbdd006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.567+0000 7fbdd6d6a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd00fff70 0x7fbdd006f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.567+0000 7fbdd6d6a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd006f850 con 0x7fbdd00fee00 2023-12-05T09:25:57.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.567+0000 7fbdd6d6a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0119340 con 0x7fbdd00fff70 2023-12-05T09:25:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.567+0000 7fbdd4b06700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd00fee00 0x7fbdd006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.567+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd00fff70 0x7fbdd006f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.567+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd00fff70 0x7fbdd006f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:46150/0 (socket says 172.21.15.67:46150) 2023-12-05T09:25:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.567+0000 7fbdcffff700 1 -- 172.21.15.67:0/2861367383 learned_addr learned my addr 172.21.15.67:0/2861367383 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.568+0000 7fbdcffff700 1 -- 172.21.15.67:0/2861367383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd00fee00 msgr2=0x7fbdd006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:57.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.568+0000 7fbdcffff700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd00fee00 0x7fbdd006ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.568+0000 7fbdcffff700 1 -- 172.21.15.67:0/2861367383 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc0005040 con 0x7fbdd00fff70 2023-12-05T09:25:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.568+0000 7fbdcffff700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd00fff70 0x7fbdd006f200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000b3b0 tx=0x7fbdc0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.569+0000 7fbdcd7fa700 1 -- 172.21.15.67:0/2861367383 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdc000e070 con 0x7fbdd00fff70 2023-12-05T09:25:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.569+0000 7fbdcd7fa700 1 -- 172.21.15.67:0/2861367383 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbdc0004290 con 0x7fbdd00fff70 2023-12-05T09:25:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.569+0000 7fbdcd7fa700 1 -- 172.21.15.67:0/2861367383 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdc001c400 con 0x7fbdd00fff70 2023-12-05T09:25:57.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.569+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd01195c0 con 0x7fbdd00fff70 2023-12-05T09:25:57.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.569+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd0119b00 con 0x7fbdd00fff70 2023-12-05T09:25:57.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.570+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc0052e0 con 0x7fbdd00fff70 2023-12-05T09:25:57.572 INFO:tasks.workunit.client.0.smithi067.stdout:7/72: rmdir d0/d9/d10 39 2023-12-05T09:25:57.573 INFO:tasks.workunit.client.0.smithi067.stdout:7/73: mkdir d0/d9/d1b 0 2023-12-05T09:25:57.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.574+0000 7fbdcd7fa700 1 -- 172.21.15.67:0/2861367383 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fbdc000bb80 con 0x7fbdd00fff70 2023-12-05T09:25:57.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.575+0000 7fbdcd7fa700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fbdb806b020 0x7fbdb806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:57.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.575+0000 7fbdcd7fa700 1 -- 172.21.15.67:0/2861367383 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbdc008b2d0 con 0x7fbdd00fff70 2023-12-05T09:25:57.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.576+0000 7fbdd4b06700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fbdb806b020 0x7fbdb806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:57.576 INFO:tasks.workunit.client.0.smithi067.stdout:7/74: symlink d0/d9/l1c 0 2023-12-05T09:25:57.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.578+0000 7fbdcd7fa700 1 -- 172.21.15.67:0/2861367383 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fbdc00555f0 con 0x7fbdd00fff70 2023-12-05T09:25:57.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.578+0000 7fbdd4b06700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fbdb806b020 0x7fbdb806d4d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbdd006ea50 tx=0x7fbdc8009da0 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:57.578 INFO:tasks.workunit.client.0.smithi067.stdout:7/75: mkdir d0/d9/d10/d1d 0 2023-12-05T09:25:57.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/76: creat d0/d9/d1b/f1e x:0 0 0 2023-12-05T09:25:57.609 INFO:tasks.workunit.client.0.smithi067.stdout:9/60: dwrite f7 [0,4194304] 0 2023-12-05T09:25:57.609 INFO:tasks.workunit.client.0.smithi067.stdout:9/61: creat f14 x:0 0 0 2023-12-05T09:25:57.616 INFO:tasks.workunit.client.0.smithi067.stdout:9/62: mkdir d15 0 2023-12-05T09:25:57.617 INFO:tasks.workunit.client.0.smithi067.stdout:9/63: rmdir d15 0 2023-12-05T09:25:57.618 INFO:tasks.workunit.client.0.smithi067.stdout:9/64: creat f16 x:0 0 0 2023-12-05T09:25:57.618 INFO:tasks.workunit.client.0.smithi067.stdout:9/65: chown f11 93224511 1 2023-12-05T09:25:57.618 INFO:tasks.workunit.client.0.smithi067.stdout:9/66: write f14 [173719,110417] 0 2023-12-05T09:25:57.619 INFO:tasks.workunit.client.0.smithi067.stdout:9/67: creat f17 x:0 0 0 2023-12-05T09:25:57.687 INFO:tasks.workunit.client.0.smithi067.stdout:9/68: dwrite f14 [0,4194304] 0 2023-12-05T09:25:57.707 INFO:tasks.workunit.client.0.smithi067.stdout:9/69: write f14 [412404,104007] 0 2023-12-05T09:25:57.708 INFO:tasks.workunit.client.0.smithi067.stdout:9/70: mknod c18 0 2023-12-05T09:25:57.772 INFO:tasks.workunit.client.0.smithi067.stdout:9/71: dwrite fa [0,4194304] 0 2023-12-05T09:25:57.773 INFO:tasks.workunit.client.0.smithi067.stdout:9/72: stat fb 0 2023-12-05T09:25:57.782 INFO:tasks.workunit.client.0.smithi067.stdout:9/73: dread ff [0,4194304] 0 2023-12-05T09:25:57.782 INFO:tasks.workunit.client.0.smithi067.stdout:9/74: chown f17 89324811 1 2023-12-05T09:25:57.784 INFO:tasks.workunit.client.0.smithi067.stdout:9/75: rename f17 to f19 0 2023-12-05T09:25:57.784 INFO:tasks.workunit.client.0.smithi067.stdout:9/76: stat ff 0 2023-12-05T09:25:57.793 INFO:tasks.workunit.client.0.smithi067.stdout:9/77: truncate f14 1316348 0 2023-12-05T09:25:57.794 INFO:tasks.workunit.client.0.smithi067.stdout:9/78: fsync fa 0 2023-12-05T09:25:57.794 INFO:tasks.workunit.client.0.smithi067.stdout:9/79: readlink l13 0 2023-12-05T09:25:57.794 INFO:tasks.workunit.client.0.smithi067.stdout:9/80: write f11 [240922,89737] 0 2023-12-05T09:25:57.794 INFO:tasks.workunit.client.0.smithi067.stdout:9/81: write f10 [76605,63819] 0 2023-12-05T09:25:57.864 INFO:tasks.workunit.client.0.smithi067.stdout:9/82: dwrite fb [0,4194304] 0 2023-12-05T09:25:57.866 INFO:tasks.workunit.client.0.smithi067.stdout:9/83: mknod c1a 0 2023-12-05T09:25:57.910 INFO:tasks.workunit.client.0.smithi067.stdout:9/84: dwrite f10 [0,4194304] 0 2023-12-05T09:25:57.915 INFO:tasks.workunit.client.0.smithi067.stdout:9/85: mkdir d1b 0 2023-12-05T09:25:57.915 INFO:tasks.workunit.client.0.smithi067.stdout:9/86: fdatasync fa 0 2023-12-05T09:25:57.965 INFO:tasks.workunit.client.0.smithi067.stdout:9/87: dwrite f14 [0,4194304] 0 2023-12-05T09:25:57.966 INFO:tasks.workunit.client.0.smithi067.stdout:9/88: creat d1b/f1c x:0 0 0 2023-12-05T09:25:57.967 INFO:tasks.workunit.client.0.smithi067.stdout:9/89: symlink d1b/l1d 0 2023-12-05T09:25:57.967 INFO:tasks.workunit.client.0.smithi067.stdout:9/90: stat d1b 0 2023-12-05T09:25:57.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.979+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdbc000bf0 con 0x7fbdb806b020 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.992+0000 7fbdcd7fa700 1 -- 172.21.15.67:0/2861367383 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fbdbc000bf0 con 0x7fbdb806b020 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (5m) 5s ago 7m 14.6M - 0.25.0 c8568f914cd2 705e76e175ab 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (7m) 5s ago 7m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (6m) 10s ago 6m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (5m) 5s ago 6m 80.0M - 9.4.7 2c41d148cca3 110448c1bfef 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (2m) 5s ago 2m 1602M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (2m) 5s ago 2m 451M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (2m) 10s ago 2m 12.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:25:57.992 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (2m) 10s ago 2m 13.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:9283 running (8m) 5s ago 8m 345M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 01173e871e1b 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283 running (33s) 10s ago 6m 495M - 19.0.0-11-g3fe8d441 56dea28e5206 86a20ad48d27 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (8m) 5s ago 8m 80.9M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (6m) 10s ago 6m 56.7M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (7m) 5s ago 7m 8795k - 1.5.0 0da6a335fe13 7d8553eb4b47 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 10s ago 6m 8753k - 1.5.0 0da6a335fe13 2301b35d1166 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (5m) 5s ago 5m 189M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (5m) 5s ago 5m 205M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (4m) 5s ago 4m 163M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (4m) 10s ago 4m 208M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (3m) 10s ago 3m 173M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (3m) 10s ago 3m 187M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:25:57.993 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (5m) 5s ago 6m 48.1M - 2.43.0 a07b618ecd1d a79077dfa046 2023-12-05T09:25:57.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fbdb806b020 msgr2=0x7fbdb806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:57.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fbdb806b020 0x7fbdb806d4d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbdd006ea50 tx=0x7fbdc8009da0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd00fff70 msgr2=0x7fbdd006f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd00fff70 0x7fbdd006f200 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000b3b0 tx=0x7fbdc0009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 shutdown_connections 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fbdb806b020 0x7fbdb806d4d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd00fee00 0x7fbdd006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 --2- 172.21.15.67:0/2861367383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbdd00fff70 0x7fbdd006f200 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000b3b0 tx=0x7fbdc0009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 >> 172.21.15.67:0/2861367383 conn(0x7fbdd00fa5d0 msgr2=0x7fbdd0103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 shutdown_connections 2023-12-05T09:25:57.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:57.995+0000 7fbdd6d6a700 1 -- 172.21.15.67:0/2861367383 wait complete. 2023-12-05T09:25:58.046 INFO:tasks.workunit.client.0.smithi067.stdout:9/91: dwrite fc [0,4194304] 0 2023-12-05T09:25:58.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/92: fdatasync ff 0 2023-12-05T09:25:58.054 INFO:tasks.workunit.client.0.smithi067.stdout:9/93: rmdir d1b 39 2023-12-05T09:25:58.056 INFO:tasks.workunit.client.0.smithi067.stdout:9/94: symlink d1b/l1e 0 2023-12-05T09:25:58.058 INFO:tasks.workunit.client.0.smithi067.stdout:9/95: rename ff to d1b/f1f 0 2023-12-05T09:25:58.060 INFO:tasks.workunit.client.0.smithi067.stdout:9/96: creat d1b/f20 x:0 0 0 2023-12-05T09:25:58.060 INFO:tasks.workunit.client.0.smithi067.stdout:9/97: fdatasync f14 0 2023-12-05T09:25:58.060 INFO:tasks.workunit.client.0.smithi067.stdout:9/98: creat d1b/f21 x:0 0 0 2023-12-05T09:25:58.074 INFO:tasks.workunit.client.0.smithi067.stdout:9/99: write f7 [2509501,125983] 0 2023-12-05T09:25:58.075 INFO:tasks.workunit.client.0.smithi067.stdout:9/100: symlink d1b/l22 0 2023-12-05T09:25:58.086 INFO:tasks.workunit.client.0.smithi067.stdout:9/101: dread d1b/f1f [0,4194304] 0 2023-12-05T09:25:58.095 INFO:tasks.workunit.client.0.smithi067.stdout:9/102: getdents d1b 0 2023-12-05T09:25:58.297 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.186+0000 7f1dfb59e700 1 -- 172.21.15.67:0/828766055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc071b60 msgr2=0x7f1dfc06ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:58.297 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.186+0000 7f1dfb59e700 1 --2- 172.21.15.67:0/828766055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc071b60 0x7f1dfc06ffd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1dec004940 tx=0x7f1dec009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.187+0000 7f1dfb59e700 1 -- 172.21.15.67:0/828766055 shutdown_connections 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.187+0000 7f1dfb59e700 1 --2- 172.21.15.67:0/828766055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dfc070510 0x7f1dfc070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.187+0000 7f1dfb59e700 1 --2- 172.21.15.67:0/828766055 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc071b60 0x7f1dfc06ffd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.187+0000 7f1dfb59e700 1 -- 172.21.15.67:0/828766055 >> 172.21.15.67:0/828766055 conn(0x7f1dfc0f8090 msgr2=0x7f1dfc0fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.187+0000 7f1dfb59e700 1 -- 172.21.15.67:0/828766055 shutdown_connections 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.187+0000 7f1dfb59e700 1 -- 172.21.15.67:0/828766055 wait complete. 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.188+0000 7f1dfb59e700 1 Processor -- start 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.188+0000 7f1dfb59e700 1 -- start start 2023-12-05T09:25:58.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfb59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc070510 0x7f1dfc10f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfb59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dfc071b60 0x7f1dfc10fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfb59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1100c0 con 0x7f1dfc070510 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfb59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc110900 con 0x7f1dfc071b60 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfa59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc070510 0x7f1dfc10f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfa59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc070510 0x7f1dfc10f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57330/0 (socket says 172.21.15.67:57330) 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfa59c700 1 -- 172.21.15.67:0/3840617223 learned_addr learned my addr 172.21.15.67:0/3840617223 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1df9d9b700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dfc071b60 0x7f1dfc10fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfa59c700 1 -- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dfc071b60 msgr2=0x7f1dfc10fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfa59c700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dfc071b60 0x7f1dfc10fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.189+0000 7f1dfa59c700 1 -- 172.21.15.67:0/3840617223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec005040 con 0x7f1dfc070510 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.190+0000 7f1dfa59c700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc070510 0x7f1dfc10f4f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009fd0 tx=0x7f1dec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.190+0000 7f1deaffd700 1 -- 172.21.15.67:0/3840617223 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dec00e040 con 0x7f1dfc070510 2023-12-05T09:25:58.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.190+0000 7f1deaffd700 1 -- 172.21.15.67:0/3840617223 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1dec004290 con 0x7f1dfc070510 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.190+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc110b80 con 0x7f1dfc070510 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.190+0000 7f1deaffd700 1 -- 172.21.15.67:0/3840617223 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dec01c3f0 con 0x7f1dfc070510 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.190+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc111140 con 0x7f1dfc070510 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.191+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc04bb80 con 0x7f1dfc070510 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.192+0000 7f1deaffd700 1 -- 172.21.15.67:0/3840617223 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f1dec013420 con 0x7f1dfc070510 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.193+0000 7f1deaffd700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f1de406ae40 0x7f1de406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.193+0000 7f1deaffd700 1 -- 172.21.15.67:0/3840617223 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1dec08ac80 con 0x7f1dfc070510 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.193+0000 7f1df9d9b700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f1de406ae40 0x7f1de406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.194+0000 7f1df9d9b700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f1de406ae40 0x7f1de406d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1df0006fd0 tx=0x7f1df0008040 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:58.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.197+0000 7f1deaffd700 1 -- 172.21.15.67:0/3840617223 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f1dec0589b0 con 0x7f1dfc070510 2023-12-05T09:25:58.309 INFO:tasks.workunit.client.0.smithi067.stdout:9/103: dwrite fa [0,4194304] 0 2023-12-05T09:25:58.310 INFO:tasks.workunit.client.0.smithi067.stdout:9/104: creat d1b/f23 x:0 0 0 2023-12-05T09:25:58.313 INFO:tasks.workunit.client.0.smithi067.stdout:9/105: rename d1b/f21 to d1b/f24 0 2023-12-05T09:25:58.314 INFO:tasks.workunit.client.0.smithi067.stdout:9/106: mkdir d1b/d25 0 2023-12-05T09:25:58.317 INFO:tasks.workunit.client.0.smithi067.stdout:9/107: rename d1b/f23 to d1b/d25/f26 0 2023-12-05T09:25:58.318 INFO:tasks.workunit.client.0.smithi067.stdout:9/108: mknod d1b/c27 0 2023-12-05T09:25:58.318 INFO:tasks.workunit.client.0.smithi067.stdout:9/109: write d1b/d25/f26 [517289,108504] 0 2023-12-05T09:25:58.319 INFO:tasks.workunit.client.0.smithi067.stdout:9/110: rmdir d1b/d25 39 2023-12-05T09:25:58.319 INFO:tasks.workunit.client.0.smithi067.stdout:9/111: chown d1b/f24 19238629 1 2023-12-05T09:25:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:58 smithi067 ceph-mon[107174]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:25:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:58 smithi067 ceph-mon[107174]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:58 smithi067 ceph-mon[107174]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:25:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:58 smithi067 ceph-mon[107174]: pgmap v14: 65 pgs: 65 active+clean; 188 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 404 op/s 2023-12-05T09:25:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:58 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:58 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:58.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:58 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:25:58.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:58 smithi134 ceph-mon[116304]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:58.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:58 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:25:58.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:58 smithi134 ceph-mon[116304]: pgmap v14: 65 pgs: 65 active+clean; 188 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 404 op/s 2023-12-05T09:25:58.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:58 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:58.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:58 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:58.381 INFO:tasks.workunit.client.0.smithi067.stdout:9/112: dwrite fa [0,4194304] 0 2023-12-05T09:25:58.390 INFO:tasks.workunit.client.0.smithi067.stdout:9/113: dread d1b/f1f [0,4194304] 0 2023-12-05T09:25:58.473 INFO:tasks.workunit.client.0.smithi067.stdout:9/114: dwrite f16 [0,4194304] 0 2023-12-05T09:25:58.475 INFO:tasks.workunit.client.0.smithi067.stdout:9/115: mknod d1b/c28 0 2023-12-05T09:25:58.475 INFO:tasks.workunit.client.0.smithi067.stdout:9/116: chown f7 2138422712 1 2023-12-05T09:25:58.476 INFO:tasks.workunit.client.0.smithi067.stdout:9/117: symlink d1b/d25/l29 0 2023-12-05T09:25:58.477 INFO:tasks.workunit.client.0.smithi067.stdout:9/118: mknod d1b/d25/c2a 0 2023-12-05T09:25:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.637+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1dfc1075f0 con 0x7f1dfc070510 2023-12-05T09:25:58.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.638+0000 7f1deaffd700 1 -- 172.21.15.67:0/3840617223 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f1dec058540 con 0x7f1dfc070510 2023-12-05T09:25:58.638 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:25:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:25:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:25:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:25:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:25:58.638 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 13, 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:25:58.639 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:25:58.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.641+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f1de406ae40 msgr2=0x7f1de406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:58.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.641+0000 7f1dfb59e700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f1de406ae40 0x7f1de406d2f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1df0006fd0 tx=0x7f1df0008040 comp rx=0 tx=0).stop 2023-12-05T09:25:58.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc070510 msgr2=0x7f1dfc10f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:58.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc070510 0x7f1dfc10f4f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009fd0 tx=0x7f1dec009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:58.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 shutdown_connections 2023-12-05T09:25:58.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f1de406ae40 0x7f1de406d2f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1dfc070510 0x7f1dfc10f4f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 --2- 172.21.15.67:0/3840617223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1dfc071b60 0x7f1dfc10fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 >> 172.21.15.67:0/3840617223 conn(0x7f1dfc0f8090 msgr2=0x7f1dfc1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:58.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 shutdown_connections 2023-12-05T09:25:58.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.642+0000 7f1dfb59e700 1 -- 172.21.15.67:0/3840617223 wait complete. 2023-12-05T09:25:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.799+0000 7f3c08832700 1 -- 172.21.15.67:0/3819460843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fde00 msgr2=0x7f3c040fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.799+0000 7f3c08832700 1 --2- 172.21.15.67:0/3819460843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fde00 0x7f3c040fe250 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8004940 tx=0x7f3bf8009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:58.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.800+0000 7f3c08832700 1 -- 172.21.15.67:0/3819460843 shutdown_connections 2023-12-05T09:25:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.800+0000 7f3c08832700 1 --2- 172.21.15.67:0/3819460843 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fde00 0x7f3c040fe250 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.800+0000 7f3c08832700 1 --2- 172.21.15.67:0/3819460843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c040fcbf0 0x7f3c040fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.800+0000 7f3c08832700 1 -- 172.21.15.67:0/3819460843 >> 172.21.15.67:0/3819460843 conn(0x7f3c040f82d0 msgr2=0x7f3c040fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.800+0000 7f3c08832700 1 -- 172.21.15.67:0/3819460843 shutdown_connections 2023-12-05T09:25:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.800+0000 7f3c08832700 1 -- 172.21.15.67:0/3819460843 wait complete. 2023-12-05T09:25:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.801+0000 7f3c08832700 1 Processor -- start 2023-12-05T09:25:58.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.801+0000 7f3c08832700 1 -- start start 2023-12-05T09:25:58.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.801+0000 7f3c08832700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fcbf0 0x7f3c0410f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:58.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.801+0000 7f3c08832700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c040fde00 0x7f3c0410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:58.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.801+0000 7f3c08832700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c04110230 con 0x7f3c040fcbf0 2023-12-05T09:25:58.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.801+0000 7f3c08832700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c04110ad0 con 0x7f3c040fde00 2023-12-05T09:25:58.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.802+0000 7f3c0259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fcbf0 0x7f3c0410f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:58.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.802+0000 7f3c0259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fcbf0 0x7f3c0410f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57354/0 (socket says 172.21.15.67:57354) 2023-12-05T09:25:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.802+0000 7f3c0259c700 1 -- 172.21.15.67:0/3858261610 learned_addr learned my addr 172.21.15.67:0/3858261610 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:25:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.803+0000 7f3c0259c700 1 -- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c040fde00 msgr2=0x7f3c0410fc30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-05T09:25:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.803+0000 7f3c01d9b700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c040fde00 0x7f3c0410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:58.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.803+0000 7f3c0259c700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c040fde00 0x7f3c0410fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:58.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.803+0000 7f3c0259c700 1 -- 172.21.15.67:0/3858261610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8005040 con 0x7f3c040fcbf0 2023-12-05T09:25:58.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.803+0000 7f3c0259c700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fcbf0 0x7f3c0410f6f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400eb70 tx=0x7f3bf400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:58.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.804+0000 7f3bf2ffd700 1 -- 172.21.15.67:0/3858261610 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf4007cc0 con 0x7f3c040fcbf0 2023-12-05T09:25:58.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.804+0000 7f3bf2ffd700 1 -- 172.21.15.67:0/3858261610 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3bf400f040 con 0x7f3c040fcbf0 2023-12-05T09:25:58.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.804+0000 7f3bf2ffd700 1 -- 172.21.15.67:0/3858261610 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bf400caa0 con 0x7f3c040fcbf0 2023-12-05T09:25:58.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.804+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c04110d50 con 0x7f3c040fcbf0 2023-12-05T09:25:58.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.804+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c04111290 con 0x7f3c040fcbf0 2023-12-05T09:25:58.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.806+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c04101ea0 con 0x7f3c040fcbf0 2023-12-05T09:25:58.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.807+0000 7f3bf2ffd700 1 -- 172.21.15.67:0/3858261610 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f3bf400cc00 con 0x7f3c040fcbf0 2023-12-05T09:25:58.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.808+0000 7f3bf2ffd700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f3bec06af10 0x7f3bec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:25:58.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.808+0000 7f3bf2ffd700 1 -- 172.21.15.67:0/3858261610 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3bf4089340 con 0x7f3c040fcbf0 2023-12-05T09:25:58.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.809+0000 7f3c01d9b700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f3bec06af10 0x7f3bec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:25:58.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.811+0000 7f3c01d9b700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f3bec06af10 0x7f3bec06d3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8000c00 tx=0x7f3bf8009e30 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:25:58.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:58.814+0000 7f3bf2ffd700 1 -- 172.21.15.67:0/3858261610 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3bf404ece0 con 0x7f3c040fcbf0 2023-12-05T09:25:59.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.076+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c04111680 con 0x7f3bec06af10 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.077+0000 7f3bf2ffd700 1 -- 172.21.15.67:0/3858261610 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f3c04111680 con 0x7f3bec06af10 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "1/2 daemons upgraded", 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:25:59.077 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:25:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.079+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f3bec06af10 msgr2=0x7f3bec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.079+0000 7f3c08832700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f3bec06af10 0x7f3bec06d3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8000c00 tx=0x7f3bf8009e30 comp rx=0 tx=0).stop 2023-12-05T09:25:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fcbf0 msgr2=0x7f3c0410f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:25:59.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fcbf0 0x7f3c0410f6f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400eb70 tx=0x7f3bf400b040 comp rx=0 tx=0).stop 2023-12-05T09:25:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 shutdown_connections 2023-12-05T09:25:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f3bec06af10 0x7f3bec06d3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c040fcbf0 0x7f3c0410f6f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 --2- 172.21.15.67:0/3858261610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c040fde00 0x7f3c0410fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:25:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 >> 172.21.15.67:0/3858261610 conn(0x7f3c040f82d0 msgr2=0x7f3c040ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:25:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 shutdown_connections 2023-12-05T09:25:59.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:25:59.080+0000 7f3c08832700 1 -- 172.21.15.67:0/3858261610 wait complete. 2023-12-05T09:25:59.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:59.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:25:59.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:59.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3840617223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:25:59.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:25:59 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3840617223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:25:59.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:25:59 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:00.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:00 smithi067 ceph-mon[107174]: Reconfiguring node-exporter.smithi067 (dependencies changed)... 2023-12-05T09:26:00.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:00 smithi067 ceph-mon[107174]: Reconfiguring daemon node-exporter.smithi067 on smithi067 2023-12-05T09:26:00.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:00 smithi067 ceph-mon[107174]: pgmap v15: 65 pgs: 65 active+clean; 188 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 184 op/s 2023-12-05T09:26:00.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:00 smithi067 ceph-mon[107174]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:00.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:00 smithi134 ceph-mon[116304]: Reconfiguring node-exporter.smithi067 (dependencies changed)... 2023-12-05T09:26:00.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:00 smithi134 ceph-mon[116304]: Reconfiguring daemon node-exporter.smithi067 on smithi067 2023-12-05T09:26:00.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:00 smithi134 ceph-mon[116304]: pgmap v15: 65 pgs: 65 active+clean; 188 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 184 op/s 2023-12-05T09:26:00.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:00 smithi134 ceph-mon[116304]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:01.307 INFO:tasks.workunit.client.1.smithi134.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-05T09:26:01.320 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T09:26:01.321 INFO:tasks.workunit.client.1.smithi134.stderr:+ make 2023-12-05T09:26:01.810 INFO:tasks.workunit.client.1.smithi134.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-05T09:26:02.104 INFO:tasks.workunit.client.1.smithi134.stderr:++ readlink -f fsstress 2023-12-05T09:26:02.105 INFO:tasks.workunit.client.1.smithi134.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-05T09:26:02.105 INFO:tasks.workunit.client.1.smithi134.stderr:+ popd 2023-12-05T09:26:02.107 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-05T09:26:02.107 INFO:tasks.workunit.client.1.smithi134.stderr:+ popd 2023-12-05T09:26:02.107 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-05T09:26:02.108 INFO:tasks.workunit.client.1.smithi134.stderr:++ mktemp -d -p . 2023-12-05T09:26:02.113 INFO:tasks.workunit.client.1.smithi134.stderr:+ T=./tmp.qjQSx5tmBi 2023-12-05T09:26:02.113 INFO:tasks.workunit.client.1.smithi134.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.qjQSx5tmBi -l 1 -n 1000 -p 10 -v 2023-12-05T09:26:02.113 INFO:tasks.workunit.client.1.smithi134.stdout:seed = 1701784657 2023-12-05T09:26:02.116 INFO:tasks.workunit.client.1.smithi134.stdout:0/0: rmdir - no directory 2023-12-05T09:26:02.116 INFO:tasks.workunit.client.1.smithi134.stdout:0/1: rename - no filename 2023-12-05T09:26:02.117 INFO:tasks.workunit.client.1.smithi134.stdout:0/2: chown . 7965085 1 2023-12-05T09:26:02.118 INFO:tasks.workunit.client.1.smithi134.stdout:0/3: creat f0 x:0 0 0 2023-12-05T09:26:02.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/0: readlink - no filename 2023-12-05T09:26:02.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/1: fdatasync - no filename 2023-12-05T09:26:02.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/2: write - no filename 2023-12-05T09:26:02.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/3: fdatasync - no filename 2023-12-05T09:26:02.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/4: chown . 2150 1 2023-12-05T09:26:02.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/5: truncate - no filename 2023-12-05T09:26:02.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/6: dread - no filename 2023-12-05T09:26:02.119 INFO:tasks.workunit.client.1.smithi134.stdout:1/0: symlink l0 0 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/4: unlink f0 0 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/5: dread - no filename 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/6: readlink - no filename 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/7: readlink - no filename 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/8: dwrite - no filename 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/9: chown . 9 1 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/10: dread - no filename 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/11: dread - no filename 2023-12-05T09:26:02.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/12: truncate - no filename 2023-12-05T09:26:02.121 INFO:tasks.workunit.client.1.smithi134.stdout:0/13: truncate - no filename 2023-12-05T09:26:02.121 INFO:tasks.workunit.client.1.smithi134.stdout:0/14: write - no filename 2023-12-05T09:26:02.121 INFO:tasks.workunit.client.1.smithi134.stdout:0/15: fdatasync - no filename 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:3/0: fdatasync - no filename 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:3/1: dread - no filename 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:3/2: dread - no filename 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:1/1: link l0 l1 0 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:2/7: mknod c0 0 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:2/8: dread - no filename 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:2/9: dwrite - no filename 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:2/10: write - no filename 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:2/11: truncate - no filename 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:0/16: mknod c1 0 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:0/17: chown c1 879 1 2023-12-05T09:26:02.122 INFO:tasks.workunit.client.1.smithi134.stdout:0/18: write - no filename 2023-12-05T09:26:02.123 INFO:tasks.workunit.client.1.smithi134.stdout:4/0: rename - no filename 2023-12-05T09:26:02.123 INFO:tasks.workunit.client.1.smithi134.stdout:4/1: read - no filename 2023-12-05T09:26:02.123 INFO:tasks.workunit.client.1.smithi134.stdout:4/2: fdatasync - no filename 2023-12-05T09:26:02.123 INFO:tasks.workunit.client.1.smithi134.stdout:4/3: write - no filename 2023-12-05T09:26:02.123 INFO:tasks.workunit.client.1.smithi134.stdout:3/3: creat f0 x:0 0 0 2023-12-05T09:26:02.123 INFO:tasks.workunit.client.1.smithi134.stdout:3/4: chown f0 1714 1 2023-12-05T09:26:02.124 INFO:tasks.workunit.client.1.smithi134.stdout:3/5: write f0 [772090,112873] 0 2023-12-05T09:26:02.124 INFO:tasks.workunit.client.1.smithi134.stdout:3/6: creat f1 x:0 0 0 2023-12-05T09:26:02.124 INFO:tasks.workunit.client.1.smithi134.stdout:1/2: mkdir d2 0 2023-12-05T09:26:02.124 INFO:tasks.workunit.client.1.smithi134.stdout:2/12: creat f1 x:0 0 0 2023-12-05T09:26:02.124 INFO:tasks.workunit.client.1.smithi134.stdout:2/13: creat f2 x:0 0 0 2023-12-05T09:26:02.125 INFO:tasks.workunit.client.1.smithi134.stdout:2/14: stat f1 0 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:0/19: symlink l2 0 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:0/20: fdatasync - no filename 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:0/21: dwrite - no filename 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:4/4: creat f0 x:0 0 0 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:5/0: chown . 126594 1 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:5/1: truncate - no filename 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:5/2: truncate - no filename 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:5/3: rmdir - no directory 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:5/4: dread - no filename 2023-12-05T09:26:02.129 INFO:tasks.workunit.client.1.smithi134.stdout:4/5: creat f1 x:0 0 0 2023-12-05T09:26:02.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/3: mknod d2/c3 0 2023-12-05T09:26:02.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/4: dwrite - no filename 2023-12-05T09:26:02.133 INFO:tasks.workunit.client.1.smithi134.stdout:0/22: unlink l2 0 2023-12-05T09:26:02.133 INFO:tasks.workunit.client.1.smithi134.stdout:0/23: creat f3 x:0 0 0 2023-12-05T09:26:02.134 INFO:tasks.workunit.client.1.smithi134.stdout:0/24: chown f3 10260996 1 2023-12-05T09:26:02.134 INFO:tasks.workunit.client.1.smithi134.stdout:6/0: fsync - no filename 2023-12-05T09:26:02.134 INFO:tasks.workunit.client.1.smithi134.stdout:6/1: truncate - no filename 2023-12-05T09:26:02.134 INFO:tasks.workunit.client.1.smithi134.stdout:6/2: dread - no filename 2023-12-05T09:26:02.134 INFO:tasks.workunit.client.1.smithi134.stdout:6/3: stat - no entries 2023-12-05T09:26:02.134 INFO:tasks.workunit.client.1.smithi134.stdout:0/25: write f3 [513289,11032] 0 2023-12-05T09:26:02.134 INFO:tasks.workunit.client.1.smithi134.stdout:5/5: mkdir d0 0 2023-12-05T09:26:02.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/0: dread - no filename 2023-12-05T09:26:02.139 INFO:tasks.workunit.client.1.smithi134.stdout:6/4: creat f0 x:0 0 0 2023-12-05T09:26:02.139 INFO:tasks.workunit.client.1.smithi134.stdout:6/5: chown f0 4996 1 2023-12-05T09:26:02.141 INFO:tasks.workunit.client.1.smithi134.stdout:0/26: link c1 c4 0 2023-12-05T09:26:02.141 INFO:tasks.workunit.client.1.smithi134.stdout:0/27: chown f3 32473729 1 2023-12-05T09:26:02.142 INFO:tasks.workunit.client.1.smithi134.stdout:5/6: creat d0/f1 x:0 0 0 2023-12-05T09:26:02.142 INFO:tasks.workunit.client.1.smithi134.stdout:5/7: dread - d0/f1 zero size 2023-12-05T09:26:02.143 INFO:tasks.workunit.client.1.smithi134.stdout:5/8: dread - d0/f1 zero size 2023-12-05T09:26:02.143 INFO:tasks.workunit.client.1.smithi134.stdout:5/9: creat d0/f2 x:0 0 0 2023-12-05T09:26:02.145 INFO:tasks.workunit.client.1.smithi134.stdout:8/0: dwrite - no filename 2023-12-05T09:26:02.145 INFO:tasks.workunit.client.1.smithi134.stdout:8/1: write - no filename 2023-12-05T09:26:02.146 INFO:tasks.workunit.client.1.smithi134.stdout:7/1: symlink l0 0 2023-12-05T09:26:02.147 INFO:tasks.workunit.client.1.smithi134.stdout:7/2: dwrite - no filename 2023-12-05T09:26:02.148 INFO:tasks.workunit.client.1.smithi134.stdout:6/6: mknod c1 0 2023-12-05T09:26:02.149 INFO:tasks.workunit.client.1.smithi134.stdout:0/28: mknod c5 0 2023-12-05T09:26:02.153 INFO:tasks.workunit.client.1.smithi134.stdout:3/7: fsync f0 0 2023-12-05T09:26:02.153 INFO:tasks.workunit.client.1.smithi134.stdout:3/8: creat f2 x:0 0 0 2023-12-05T09:26:02.153 INFO:tasks.workunit.client.1.smithi134.stdout:3/9: creat f3 x:0 0 0 2023-12-05T09:26:02.153 INFO:tasks.workunit.client.1.smithi134.stdout:8/2: creat f0 x:0 0 0 2023-12-05T09:26:02.155 INFO:tasks.workunit.client.1.smithi134.stdout:7/3: creat f1 x:0 0 0 2023-12-05T09:26:02.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/7: mknod c2 0 2023-12-05T09:26:02.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/8: rmdir - no directory 2023-12-05T09:26:02.157 INFO:tasks.workunit.client.1.smithi134.stdout:9/0: creat f0 x:0 0 0 2023-12-05T09:26:02.166 INFO:tasks.workunit.client.1.smithi134.stdout:3/10: mkdir d4 0 2023-12-05T09:26:02.166 INFO:tasks.workunit.client.1.smithi134.stdout:3/11: chown f2 541716137 1 2023-12-05T09:26:02.167 INFO:tasks.workunit.client.1.smithi134.stdout:1/5: getdents d2 0 2023-12-05T09:26:02.167 INFO:tasks.workunit.client.1.smithi134.stdout:1/6: chown d2/c3 0 1 2023-12-05T09:26:02.168 INFO:tasks.workunit.client.1.smithi134.stdout:1/7: dread - no filename 2023-12-05T09:26:02.168 INFO:tasks.workunit.client.1.smithi134.stdout:6/9: mkdir d3 0 2023-12-05T09:26:02.168 INFO:tasks.workunit.client.1.smithi134.stdout:6/10: getdents d3 0 2023-12-05T09:26:02.168 INFO:tasks.workunit.client.1.smithi134.stdout:6/11: truncate f0 108918 0 2023-12-05T09:26:02.173 INFO:tasks.workunit.client.1.smithi134.stdout:9/1: rename f0 to f1 0 2023-12-05T09:26:02.173 INFO:tasks.workunit.client.1.smithi134.stdout:3/12: unlink f2 0 2023-12-05T09:26:02.173 INFO:tasks.workunit.client.1.smithi134.stdout:1/8: creat d2/f4 x:0 0 0 2023-12-05T09:26:02.173 INFO:tasks.workunit.client.1.smithi134.stdout:1/9: creat d2/f5 x:0 0 0 2023-12-05T09:26:02.174 INFO:tasks.workunit.client.1.smithi134.stdout:1/10: creat d2/f6 x:0 0 0 2023-12-05T09:26:02.204 INFO:tasks.workunit.client.1.smithi134.stdout:6/12: unlink c1 0 2023-12-05T09:26:02.204 INFO:tasks.workunit.client.1.smithi134.stdout:3/13: mkdir d4/d5 0 2023-12-05T09:26:02.204 INFO:tasks.workunit.client.1.smithi134.stdout:3/14: chown d4/d5 449 1 2023-12-05T09:26:02.204 INFO:tasks.workunit.client.1.smithi134.stdout:1/11: mknod d2/c7 0 2023-12-05T09:26:02.204 INFO:tasks.workunit.client.1.smithi134.stdout:1/12: fdatasync d2/f6 0 2023-12-05T09:26:02.217 INFO:tasks.workunit.client.1.smithi134.stdout:0/29: dread f3 [0,4194304] 0 2023-12-05T09:26:02.280 INFO:tasks.workunit.client.1.smithi134.stdout:0/30: rename c4 to c6 0 2023-12-05T09:26:02.280 INFO:tasks.workunit.client.1.smithi134.stdout:0/31: creat f7 x:0 0 0 2023-12-05T09:26:02.280 INFO:tasks.workunit.client.1.smithi134.stdout:0/32: creat f8 x:0 0 0 2023-12-05T09:26:02.350 INFO:tasks.workunit.client.1.smithi134.stdout:4/6: dwrite f1 [0,4194304] 0 2023-12-05T09:26:02.352 INFO:tasks.workunit.client.1.smithi134.stdout:2/15: dwrite f2 [0,4194304] 0 2023-12-05T09:26:02.352 INFO:tasks.workunit.client.1.smithi134.stdout:2/16: chown f1 112 1 2023-12-05T09:26:02.352 INFO:tasks.workunit.client.1.smithi134.stdout:2/17: creat f3 x:0 0 0 2023-12-05T09:26:02.353 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:02 smithi134 ceph-mon[116304]: pgmap v16: 65 pgs: 65 active+clean; 188 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 184 op/s 2023-12-05T09:26:02.353 INFO:tasks.workunit.client.1.smithi134.stdout:2/18: write f3 [989188,121653] 0 2023-12-05T09:26:02.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:02 smithi067 ceph-mon[107174]: pgmap v16: 65 pgs: 65 active+clean; 188 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s wr, 184 op/s 2023-12-05T09:26:02.451 INFO:tasks.workunit.client.1.smithi134.stdout:8/3: dwrite f0 [0,4194304] 0 2023-12-05T09:26:02.451 INFO:tasks.workunit.client.1.smithi134.stdout:8/4: creat f1 x:0 0 0 2023-12-05T09:26:02.451 INFO:tasks.workunit.client.1.smithi134.stdout:6/13: rmdir d3 0 2023-12-05T09:26:02.528 INFO:tasks.workunit.client.1.smithi134.stdout:9/2: dwrite f1 [0,4194304] 0 2023-12-05T09:26:02.528 INFO:tasks.workunit.client.1.smithi134.stdout:9/3: creat f2 x:0 0 0 2023-12-05T09:26:02.556 INFO:tasks.workunit.client.1.smithi134.stdout:4/7: rename f1 to f2 0 2023-12-05T09:26:02.562 INFO:tasks.workunit.client.1.smithi134.stdout:2/19: link f1 f4 0 2023-12-05T09:26:02.726 INFO:tasks.workunit.client.1.smithi134.stdout:0/33: read f3 [308110,129352] 0 2023-12-05T09:26:02.726 INFO:tasks.workunit.client.1.smithi134.stdout:0/34: creat f9 x:0 0 0 2023-12-05T09:26:02.726 INFO:tasks.workunit.client.1.smithi134.stdout:0/35: creat fa x:0 0 0 2023-12-05T09:26:03.076 INFO:tasks.workunit.client.1.smithi134.stdout:6/14: write f0 [42928,171] 0 2023-12-05T09:26:03.103 INFO:tasks.workunit.client.1.smithi134.stdout:2/20: link f2 f5 0 2023-12-05T09:26:03.221 INFO:tasks.workunit.client.1.smithi134.stdout:8/5: dwrite f1 [0,4194304] 0 2023-12-05T09:26:03.379 INFO:tasks.workunit.client.1.smithi134.stdout:4/8: write f2 [3593210,124085] 0 2023-12-05T09:26:03.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/9: dread f2 [0,4194304] 0 2023-12-05T09:26:03.431 INFO:tasks.workunit.client.1.smithi134.stdout:2/21: dwrite f2 [0,4194304] 0 2023-12-05T09:26:03.431 INFO:tasks.workunit.client.1.smithi134.stdout:2/22: write f4 [184529,63757] 0 2023-12-05T09:26:03.431 INFO:tasks.workunit.client.1.smithi134.stdout:2/23: chown f3 310 1 2023-12-05T09:26:03.431 INFO:tasks.workunit.client.1.smithi134.stdout:4/10: write f0 [4157,97366] 0 2023-12-05T09:26:03.431 INFO:tasks.workunit.client.1.smithi134.stdout:2/24: chown f1 7580 1 2023-12-05T09:26:03.530 INFO:tasks.workunit.client.1.smithi134.stdout:6/15: fsync f0 0 2023-12-05T09:26:03.543 INFO:tasks.workunit.client.1.smithi134.stdout:7/4: fsync f1 0 2023-12-05T09:26:03.557 INFO:tasks.workunit.client.1.smithi134.stdout:1/13: getdents d2 0 2023-12-05T09:26:03.715 INFO:tasks.workunit.client.1.smithi134.stdout:4/11: dwrite f0 [0,4194304] 0 2023-12-05T09:26:03.761 INFO:tasks.workunit.client.1.smithi134.stdout:0/36: mknod cb 0 2023-12-05T09:26:03.762 INFO:tasks.workunit.client.1.smithi134.stdout:0/37: chown fa 203 1 2023-12-05T09:26:04.247 INFO:tasks.workunit.client.1.smithi134.stdout:2/25: fsync f5 0 2023-12-05T09:26:04.247 INFO:tasks.workunit.client.1.smithi134.stdout:2/26: chown f1 22268 1 2023-12-05T09:26:04.283 INFO:tasks.workunit.client.1.smithi134.stdout:2/27: dwrite f3 [0,4194304] 0 2023-12-05T09:26:04.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:04 smithi067 ceph-mon[107174]: pgmap v17: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s rd, 17 MiB/s wr, 463 op/s 2023-12-05T09:26:04.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:04 smithi134 ceph-mon[116304]: pgmap v17: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s rd, 17 MiB/s wr, 463 op/s 2023-12-05T09:26:04.549 INFO:tasks.workunit.client.1.smithi134.stdout:9/4: rename f2 to f3 0 2023-12-05T09:26:04.561 INFO:tasks.workunit.client.1.smithi134.stdout:9/5: read f1 [2947235,129358] 0 2023-12-05T09:26:05.473 INFO:tasks.workunit.client.1.smithi134.stdout:6/16: mkdir d4 0 2023-12-05T09:26:05.473 INFO:tasks.workunit.client.1.smithi134.stdout:6/17: rename d4 to d4/d5 22 2023-12-05T09:26:05.473 INFO:tasks.workunit.client.1.smithi134.stdout:6/18: stat d4 0 2023-12-05T09:26:05.486 INFO:tasks.workunit.client.1.smithi134.stdout:7/5: mkdir d2 0 2023-12-05T09:26:05.487 INFO:tasks.workunit.client.1.smithi134.stdout:7/6: stat l0 0 2023-12-05T09:26:05.503 INFO:tasks.workunit.client.1.smithi134.stdout:1/14: rmdir d2 39 2023-12-05T09:26:05.556 INFO:tasks.workunit.client.1.smithi134.stdout:1/15: dwrite d2/f4 [0,4194304] 0 2023-12-05T09:26:05.574 INFO:tasks.workunit.client.1.smithi134.stdout:1/16: write d2/f4 [579043,59110] 0 2023-12-05T09:26:06.293 INFO:tasks.workunit.client.1.smithi134.stdout:4/12: mkdir d3 0 2023-12-05T09:26:06.294 INFO:tasks.workunit.client.1.smithi134.stdout:0/38: link f7 fc 0 2023-12-05T09:26:06.294 INFO:tasks.workunit.client.1.smithi134.stdout:0/39: write f3 [22750,42764] 0 2023-12-05T09:26:06.294 INFO:tasks.workunit.client.1.smithi134.stdout:0/40: chown f7 1 1 2023-12-05T09:26:06.294 INFO:tasks.workunit.client.1.smithi134.stdout:0/41: write fa [184058,113491] 0 2023-12-05T09:26:06.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/42: rmdir - no directory 2023-12-05T09:26:06.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/43: dread - fc zero size 2023-12-05T09:26:06.298 INFO:tasks.workunit.client.1.smithi134.stdout:2/28: rename f2 to f6 0 2023-12-05T09:26:06.300 INFO:tasks.workunit.client.1.smithi134.stdout:9/6: symlink l4 0 2023-12-05T09:26:06.300 INFO:tasks.workunit.client.1.smithi134.stdout:9/7: chown f3 682909304 1 2023-12-05T09:26:06.300 INFO:tasks.workunit.client.1.smithi134.stdout:9/8: write f1 [4909660,75885] 0 2023-12-05T09:26:06.300 INFO:tasks.workunit.client.1.smithi134.stdout:9/9: chown l4 1935 1 2023-12-05T09:26:06.300 INFO:tasks.workunit.client.1.smithi134.stdout:8/6: link f0 f2 0 2023-12-05T09:26:06.304 INFO:tasks.workunit.client.1.smithi134.stdout:6/19: link c2 d4/c6 0 2023-12-05T09:26:06.304 INFO:tasks.workunit.client.1.smithi134.stdout:7/7: creat d2/f3 x:0 0 0 2023-12-05T09:26:06.305 INFO:tasks.workunit.client.1.smithi134.stdout:7/8: chown d2 8566434 1 2023-12-05T09:26:06.305 INFO:tasks.workunit.client.1.smithi134.stdout:7/9: write d2/f3 [219495,74531] 0 2023-12-05T09:26:06.305 INFO:tasks.workunit.client.1.smithi134.stdout:1/17: rename d2/c7 to d2/c8 0 2023-12-05T09:26:06.305 INFO:tasks.workunit.client.1.smithi134.stdout:1/18: dread - d2/f6 zero size 2023-12-05T09:26:06.306 INFO:tasks.workunit.client.1.smithi134.stdout:4/13: rmdir d3 0 2023-12-05T09:26:06.311 INFO:tasks.workunit.client.1.smithi134.stdout:6/20: creat d4/f7 x:0 0 0 2023-12-05T09:26:06.311 INFO:tasks.workunit.client.1.smithi134.stdout:6/21: fdatasync d4/f7 0 2023-12-05T09:26:06.312 INFO:tasks.workunit.client.1.smithi134.stdout:7/10: rename d2/f3 to d2/f4 0 2023-12-05T09:26:06.313 INFO:tasks.workunit.client.1.smithi134.stdout:1/19: mkdir d2/d9 0 2023-12-05T09:26:06.317 INFO:tasks.workunit.client.1.smithi134.stdout:7/11: mkdir d2/d5 0 2023-12-05T09:26:06.317 INFO:tasks.workunit.client.1.smithi134.stdout:7/12: stat l0 0 2023-12-05T09:26:06.317 INFO:tasks.workunit.client.1.smithi134.stdout:7/13: fdatasync f1 0 2023-12-05T09:26:06.317 INFO:tasks.workunit.client.1.smithi134.stdout:7/14: write f1 [841439,103648] 0 2023-12-05T09:26:06.320 INFO:tasks.workunit.client.1.smithi134.stdout:1/20: fdatasync d2/f4 0 2023-12-05T09:26:06.324 INFO:tasks.workunit.client.1.smithi134.stdout:1/21: rename l1 to d2/d9/la 0 2023-12-05T09:26:06.329 INFO:tasks.workunit.client.1.smithi134.stdout:8/7: dread f0 [0,4194304] 0 2023-12-05T09:26:06.338 INFO:tasks.workunit.client.1.smithi134.stdout:4/14: dread f0 [0,4194304] 0 2023-12-05T09:26:06.340 INFO:tasks.workunit.client.1.smithi134.stdout:7/15: dread d2/f4 [0,4194304] 0 2023-12-05T09:26:06.340 INFO:tasks.workunit.client.1.smithi134.stdout:4/15: link f2 f4 0 2023-12-05T09:26:06.340 INFO:tasks.workunit.client.1.smithi134.stdout:4/16: chown f4 5 1 2023-12-05T09:26:06.355 INFO:tasks.workunit.client.1.smithi134.stdout:8/8: write f1 [3274511,112655] 0 2023-12-05T09:26:06.357 INFO:tasks.workunit.client.1.smithi134.stdout:2/29: dwrite f3 [0,4194304] 0 2023-12-05T09:26:06.357 INFO:tasks.workunit.client.1.smithi134.stdout:2/30: fdatasync f3 0 2023-12-05T09:26:06.360 INFO:tasks.workunit.client.1.smithi134.stdout:2/31: rename c0 to c7 0 2023-12-05T09:26:06.363 INFO:tasks.workunit.client.1.smithi134.stdout:4/17: write f0 [642464,2392] 0 2023-12-05T09:26:06.363 INFO:tasks.workunit.client.1.smithi134.stdout:4/18: chown f0 5701 1 2023-12-05T09:26:06.365 INFO:tasks.workunit.client.1.smithi134.stdout:4/19: rename f2 to f5 0 2023-12-05T09:26:06.365 INFO:tasks.workunit.client.1.smithi134.stdout:4/20: read f0 [1844818,106398] 0 2023-12-05T09:26:06.365 INFO:tasks.workunit.client.1.smithi134.stdout:4/21: readlink - no filename 2023-12-05T09:26:06.365 INFO:tasks.workunit.client.1.smithi134.stdout:4/22: write f5 [1152381,98888] 0 2023-12-05T09:26:06.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:06 smithi067 ceph-mon[107174]: pgmap v18: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s rd, 15 MiB/s wr, 381 op/s 2023-12-05T09:26:06.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:06 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:26:06.371 INFO:tasks.workunit.client.1.smithi134.stdout:6/22: dwrite f0 [0,4194304] 0 2023-12-05T09:26:06.373 INFO:tasks.workunit.client.1.smithi134.stdout:2/32: write f5 [2006460,123997] 0 2023-12-05T09:26:06.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:06 smithi134 ceph-mon[116304]: pgmap v18: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 5.9 MiB/s rd, 15 MiB/s wr, 381 op/s 2023-12-05T09:26:06.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:06 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:26:06.379 INFO:tasks.workunit.client.1.smithi134.stdout:8/9: dread f2 [0,4194304] 0 2023-12-05T09:26:06.382 INFO:tasks.workunit.client.1.smithi134.stdout:2/33: dread f1 [0,4194304] 0 2023-12-05T09:26:06.382 INFO:tasks.workunit.client.1.smithi134.stdout:2/34: write f6 [3554433,8257] 0 2023-12-05T09:26:06.382 INFO:tasks.workunit.client.1.smithi134.stdout:2/35: creat f8 x:0 0 0 2023-12-05T09:26:06.388 INFO:tasks.workunit.client.1.smithi134.stdout:4/23: dread f0 [0,4194304] 0 2023-12-05T09:26:06.388 INFO:tasks.workunit.client.1.smithi134.stdout:4/24: creat f6 x:0 0 0 2023-12-05T09:26:06.388 INFO:tasks.workunit.client.1.smithi134.stdout:4/25: write f4 [1806348,11765] 0 2023-12-05T09:26:06.389 INFO:tasks.workunit.client.1.smithi134.stdout:2/36: dread f1 [0,4194304] 0 2023-12-05T09:26:06.392 INFO:tasks.workunit.client.1.smithi134.stdout:4/26: symlink l7 0 2023-12-05T09:26:06.394 INFO:tasks.workunit.client.1.smithi134.stdout:8/10: read f0 [463634,81287] 0 2023-12-05T09:26:06.394 INFO:tasks.workunit.client.1.smithi134.stdout:8/11: creat f3 x:0 0 0 2023-12-05T09:26:06.397 INFO:tasks.workunit.client.1.smithi134.stdout:4/27: symlink l8 0 2023-12-05T09:26:06.399 INFO:tasks.workunit.client.1.smithi134.stdout:4/28: symlink l9 0 2023-12-05T09:26:06.399 INFO:tasks.workunit.client.1.smithi134.stdout:4/29: rmdir - no directory 2023-12-05T09:26:06.428 INFO:tasks.workunit.client.1.smithi134.stdout:8/12: dwrite f3 [0,4194304] 0 2023-12-05T09:26:06.428 INFO:tasks.workunit.client.1.smithi134.stdout:8/13: creat f4 x:0 0 0 2023-12-05T09:26:06.978 INFO:tasks.workunit.client.1.smithi134.stdout:0/44: getdents . 0 2023-12-05T09:26:06.982 INFO:tasks.workunit.client.1.smithi134.stdout:0/45: creat fd x:0 0 0 2023-12-05T09:26:06.982 INFO:tasks.workunit.client.1.smithi134.stdout:0/46: truncate f8 60225 0 2023-12-05T09:26:06.982 INFO:tasks.workunit.client.1.smithi134.stdout:0/47: rmdir - no directory 2023-12-05T09:26:06.987 INFO:tasks.workunit.client.1.smithi134.stdout:3/15: sync 2023-12-05T09:26:06.987 INFO:tasks.workunit.client.1.smithi134.stdout:5/10: sync 2023-12-05T09:26:06.987 INFO:tasks.workunit.client.1.smithi134.stdout:3/16: chown d4 12704867 1 2023-12-05T09:26:06.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/17: creat d4/d5/f6 x:0 0 0 2023-12-05T09:26:06.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/18: dread - f3 zero size 2023-12-05T09:26:06.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/19: stat f1 0 2023-12-05T09:26:06.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/20: rename d4/d5 to d4/d5/d7 22 2023-12-05T09:26:06.996 INFO:tasks.workunit.client.1.smithi134.stdout:9/10: truncate f1 991592 0 2023-12-05T09:26:06.996 INFO:tasks.workunit.client.1.smithi134.stdout:5/11: rmdir d0 39 2023-12-05T09:26:06.996 INFO:tasks.workunit.client.1.smithi134.stdout:5/12: fsync d0/f2 0 2023-12-05T09:26:06.996 INFO:tasks.workunit.client.1.smithi134.stdout:5/13: chown d0/f1 378 1 2023-12-05T09:26:07.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/11: symlink l5 0 2023-12-05T09:26:07.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/12: creat f6 x:0 0 0 2023-12-05T09:26:07.004 INFO:tasks.workunit.client.1.smithi134.stdout:5/14: mknod d0/c3 0 2023-12-05T09:26:07.008 INFO:tasks.workunit.client.1.smithi134.stdout:5/15: link d0/c3 d0/c4 0 2023-12-05T09:26:07.008 INFO:tasks.workunit.client.1.smithi134.stdout:5/16: chown d0 4759 1 2023-12-05T09:26:07.015 INFO:tasks.workunit.client.1.smithi134.stdout:4/30: link f5 fa 0 2023-12-05T09:26:07.015 INFO:tasks.workunit.client.1.smithi134.stdout:4/31: creat fb x:0 0 0 2023-12-05T09:26:07.015 INFO:tasks.workunit.client.1.smithi134.stdout:4/32: fdatasync f5 0 2023-12-05T09:26:07.015 INFO:tasks.workunit.client.1.smithi134.stdout:5/17: creat d0/f5 x:0 0 0 2023-12-05T09:26:07.020 INFO:tasks.workunit.client.1.smithi134.stdout:4/33: mknod cc 0 2023-12-05T09:26:07.024 INFO:tasks.workunit.client.1.smithi134.stdout:4/34: symlink ld 0 2023-12-05T09:26:07.027 INFO:tasks.workunit.client.1.smithi134.stdout:4/35: symlink le 0 2023-12-05T09:26:07.028 INFO:tasks.workunit.client.1.smithi134.stdout:8/14: fsync f4 0 2023-12-05T09:26:07.032 INFO:tasks.workunit.client.1.smithi134.stdout:0/48: dwrite f3 [0,4194304] 0 2023-12-05T09:26:07.032 INFO:tasks.workunit.client.1.smithi134.stdout:0/49: creat fe x:0 0 0 2023-12-05T09:26:07.033 INFO:tasks.workunit.client.1.smithi134.stdout:1/22: dwrite d2/f4 [4194304,4194304] 0 2023-12-05T09:26:07.059 INFO:tasks.workunit.client.1.smithi134.stdout:5/18: dwrite d0/f5 [0,4194304] 0 2023-12-05T09:26:07.071 INFO:tasks.workunit.client.1.smithi134.stdout:8/15: dwrite f3 [0,4194304] 0 2023-12-05T09:26:07.071 INFO:tasks.workunit.client.1.smithi134.stdout:8/16: chown f2 44699 1 2023-12-05T09:26:07.083 INFO:tasks.workunit.client.1.smithi134.stdout:0/50: dwrite fd [0,4194304] 0 2023-12-05T09:26:07.089 INFO:tasks.workunit.client.1.smithi134.stdout:1/23: mknod d2/d9/cb 0 2023-12-05T09:26:07.098 INFO:tasks.workunit.client.1.smithi134.stdout:5/19: mknod d0/c6 0 2023-12-05T09:26:07.098 INFO:tasks.workunit.client.1.smithi134.stdout:5/20: creat d0/f7 x:0 0 0 2023-12-05T09:26:07.098 INFO:tasks.workunit.client.1.smithi134.stdout:5/21: write d0/f1 [168732,1786] 0 2023-12-05T09:26:07.107 INFO:tasks.workunit.client.1.smithi134.stdout:1/24: dread d2/f4 [0,4194304] 0 2023-12-05T09:26:07.114 INFO:tasks.workunit.client.1.smithi134.stdout:5/22: symlink d0/l8 0 2023-12-05T09:26:07.114 INFO:tasks.workunit.client.1.smithi134.stdout:5/23: fdatasync d0/f5 0 2023-12-05T09:26:07.121 INFO:tasks.workunit.client.1.smithi134.stdout:5/24: mknod d0/c9 0 2023-12-05T09:26:07.121 INFO:tasks.workunit.client.1.smithi134.stdout:5/25: truncate d0/f2 552242 0 2023-12-05T09:26:07.123 INFO:tasks.workunit.client.1.smithi134.stdout:1/25: write d2/f4 [4712458,129049] 0 2023-12-05T09:26:07.126 INFO:tasks.workunit.client.1.smithi134.stdout:5/26: symlink d0/la 0 2023-12-05T09:26:07.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/26: symlink d2/d9/lc 0 2023-12-05T09:26:07.130 INFO:tasks.workunit.client.1.smithi134.stdout:5/27: mknod d0/cb 0 2023-12-05T09:26:07.132 INFO:tasks.workunit.client.1.smithi134.stdout:8/17: dwrite f4 [0,4194304] 0 2023-12-05T09:26:07.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/27: symlink d2/ld 0 2023-12-05T09:26:07.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/28: chown d2/f5 4377666 1 2023-12-05T09:26:07.134 INFO:tasks.workunit.client.1.smithi134.stdout:0/51: dwrite f7 [0,4194304] 0 2023-12-05T09:26:07.142 INFO:tasks.workunit.client.1.smithi134.stdout:8/18: unlink f4 0 2023-12-05T09:26:07.142 INFO:tasks.workunit.client.1.smithi134.stdout:8/19: readlink - no filename 2023-12-05T09:26:07.143 INFO:tasks.workunit.client.1.smithi134.stdout:8/20: chown f1 42095 1 2023-12-05T09:26:07.143 INFO:tasks.workunit.client.1.smithi134.stdout:8/21: fsync f2 0 2023-12-05T09:26:07.146 INFO:tasks.workunit.client.1.smithi134.stdout:1/29: creat d2/d9/fe x:0 0 0 2023-12-05T09:26:07.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/52: dread fc [0,4194304] 0 2023-12-05T09:26:07.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/53: write f8 [152217,90184] 0 2023-12-05T09:26:07.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/54: write fa [591991,90066] 0 2023-12-05T09:26:07.160 INFO:tasks.workunit.client.1.smithi134.stdout:0/55: dread f3 [0,4194304] 0 2023-12-05T09:26:07.160 INFO:tasks.workunit.client.1.smithi134.stdout:0/56: rmdir - no directory 2023-12-05T09:26:07.160 INFO:tasks.workunit.client.1.smithi134.stdout:8/22: mknod c5 0 2023-12-05T09:26:07.161 INFO:tasks.workunit.client.1.smithi134.stdout:8/23: write f2 [3184584,117314] 0 2023-12-05T09:26:07.161 INFO:tasks.workunit.client.1.smithi134.stdout:8/24: chown c5 81 1 2023-12-05T09:26:07.161 INFO:tasks.workunit.client.1.smithi134.stdout:8/25: creat f6 x:0 0 0 2023-12-05T09:26:07.161 INFO:tasks.workunit.client.1.smithi134.stdout:8/26: dread - f6 zero size 2023-12-05T09:26:07.163 INFO:tasks.workunit.client.1.smithi134.stdout:1/30: link d2/d9/cb d2/cf 0 2023-12-05T09:26:07.163 INFO:tasks.workunit.client.1.smithi134.stdout:1/31: chown d2/f6 1028257 1 2023-12-05T09:26:07.196 INFO:tasks.workunit.client.1.smithi134.stdout:8/27: dwrite f2 [0,4194304] 0 2023-12-05T09:26:07.208 INFO:tasks.workunit.client.1.smithi134.stdout:8/28: write f3 [2911924,6015] 0 2023-12-05T09:26:07.210 INFO:tasks.workunit.client.1.smithi134.stdout:8/29: rename f1 to f7 0 2023-12-05T09:26:07.210 INFO:tasks.workunit.client.1.smithi134.stdout:8/30: write f2 [4273945,43219] 0 2023-12-05T09:26:07.211 INFO:tasks.workunit.client.1.smithi134.stdout:8/31: unlink c5 0 2023-12-05T09:26:07.227 INFO:tasks.workunit.client.1.smithi134.stdout:8/32: dread f2 [0,4194304] 0 2023-12-05T09:26:07.227 INFO:tasks.workunit.client.1.smithi134.stdout:8/33: write f7 [3261685,106764] 0 2023-12-05T09:26:07.227 INFO:tasks.workunit.client.1.smithi134.stdout:8/34: creat f8 x:0 0 0 2023-12-05T09:26:07.230 INFO:tasks.workunit.client.1.smithi134.stdout:8/35: link f8 f9 0 2023-12-05T09:26:07.232 INFO:tasks.workunit.client.1.smithi134.stdout:8/36: unlink f6 0 2023-12-05T09:26:07.249 INFO:tasks.workunit.client.1.smithi134.stdout:4/36: fsync f5 0 2023-12-05T09:26:07.249 INFO:tasks.workunit.client.1.smithi134.stdout:4/37: creat ff x:0 0 0 2023-12-05T09:26:07.251 INFO:tasks.workunit.client.1.smithi134.stdout:6/23: sync 2023-12-05T09:26:07.251 INFO:tasks.workunit.client.1.smithi134.stdout:2/37: sync 2023-12-05T09:26:07.251 INFO:tasks.workunit.client.1.smithi134.stdout:2/38: readlink - no filename 2023-12-05T09:26:07.251 INFO:tasks.workunit.client.1.smithi134.stdout:7/16: sync 2023-12-05T09:26:07.251 INFO:tasks.workunit.client.1.smithi134.stdout:2/39: write f1 [547583,124672] 0 2023-12-05T09:26:07.251 INFO:tasks.workunit.client.1.smithi134.stdout:2/40: dread - f8 zero size 2023-12-05T09:26:07.251 INFO:tasks.workunit.client.1.smithi134.stdout:6/24: write f0 [4337783,112322] 0 2023-12-05T09:26:07.255 INFO:tasks.workunit.client.1.smithi134.stdout:7/17: symlink d2/l6 0 2023-12-05T09:26:07.257 INFO:tasks.workunit.client.1.smithi134.stdout:2/41: rename c7 to c9 0 2023-12-05T09:26:07.257 INFO:tasks.workunit.client.1.smithi134.stdout:2/42: readlink - no filename 2023-12-05T09:26:07.257 INFO:tasks.workunit.client.1.smithi134.stdout:2/43: creat fa x:0 0 0 2023-12-05T09:26:07.260 INFO:tasks.workunit.client.1.smithi134.stdout:6/25: mkdir d4/d8 0 2023-12-05T09:26:07.269 INFO:tasks.workunit.client.1.smithi134.stdout:2/44: write f3 [2740637,19721] 0 2023-12-05T09:26:07.275 INFO:tasks.workunit.client.1.smithi134.stdout:6/26: mkdir d4/d9 0 2023-12-05T09:26:07.275 INFO:tasks.workunit.client.1.smithi134.stdout:6/27: chown d4/c6 11873002 1 2023-12-05T09:26:07.277 INFO:tasks.workunit.client.1.smithi134.stdout:2/45: mknod cb 0 2023-12-05T09:26:07.277 INFO:tasks.workunit.client.1.smithi134.stdout:2/46: write f1 [822693,48727] 0 2023-12-05T09:26:07.277 INFO:tasks.workunit.client.1.smithi134.stdout:2/47: creat fc x:0 0 0 2023-12-05T09:26:07.277 INFO:tasks.workunit.client.1.smithi134.stdout:2/48: creat fd x:0 0 0 2023-12-05T09:26:07.291 INFO:tasks.workunit.client.1.smithi134.stdout:6/28: write f0 [975922,53149] 0 2023-12-05T09:26:07.295 INFO:tasks.workunit.client.1.smithi134.stdout:5/28: rmdir d0 39 2023-12-05T09:26:07.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/29: unlink d0/f1 0 2023-12-05T09:26:07.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/30: read - d0/f7 zero size 2023-12-05T09:26:07.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/31: dread - d0/f7 zero size 2023-12-05T09:26:07.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/32: fsync d0/f2 0 2023-12-05T09:26:07.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/33: write d0/f7 [352181,59995] 0 2023-12-05T09:26:07.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/34: truncate d0/f2 1147612 0 2023-12-05T09:26:07.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/35: stat d0/l8 0 2023-12-05T09:26:07.303 INFO:tasks.workunit.client.1.smithi134.stdout:4/38: dwrite ff [0,4194304] 0 2023-12-05T09:26:07.303 INFO:tasks.workunit.client.1.smithi134.stdout:4/39: fdatasync fa 0 2023-12-05T09:26:07.309 INFO:tasks.workunit.client.1.smithi134.stdout:4/40: link ld l10 0 2023-12-05T09:26:07.309 INFO:tasks.workunit.client.1.smithi134.stdout:4/41: creat f11 x:0 0 0 2023-12-05T09:26:07.312 INFO:tasks.workunit.client.1.smithi134.stdout:1/32: truncate d2/f4 5288857 0 2023-12-05T09:26:07.312 INFO:tasks.workunit.client.1.smithi134.stdout:4/42: mknod c12 0 2023-12-05T09:26:07.314 INFO:tasks.workunit.client.1.smithi134.stdout:9/13: sync 2023-12-05T09:26:07.314 INFO:tasks.workunit.client.1.smithi134.stdout:9/14: chown f1 3266660 1 2023-12-05T09:26:07.314 INFO:tasks.workunit.client.1.smithi134.stdout:3/21: sync 2023-12-05T09:26:07.314 INFO:tasks.workunit.client.1.smithi134.stdout:3/22: chown d4/d5 106027 1 2023-12-05T09:26:07.314 INFO:tasks.workunit.client.1.smithi134.stdout:9/15: fsync f6 0 2023-12-05T09:26:07.314 INFO:tasks.workunit.client.1.smithi134.stdout:3/23: fsync f1 0 2023-12-05T09:26:07.315 INFO:tasks.workunit.client.1.smithi134.stdout:9/16: mkdir d7 0 2023-12-05T09:26:07.315 INFO:tasks.workunit.client.1.smithi134.stdout:9/17: readlink l4 0 2023-12-05T09:26:07.319 INFO:tasks.workunit.client.1.smithi134.stdout:9/18: mkdir d7/d8 0 2023-12-05T09:26:07.324 INFO:tasks.workunit.client.1.smithi134.stdout:9/19: rmdir d7 39 2023-12-05T09:26:07.324 INFO:tasks.workunit.client.1.smithi134.stdout:9/20: fsync f3 0 2023-12-05T09:26:07.326 INFO:tasks.workunit.client.1.smithi134.stdout:2/49: dwrite fa [0,4194304] 0 2023-12-05T09:26:07.326 INFO:tasks.workunit.client.1.smithi134.stdout:2/50: write f4 [885277,10373] 0 2023-12-05T09:26:07.334 INFO:tasks.workunit.client.1.smithi134.stdout:7/18: dwrite d2/f4 [0,4194304] 0 2023-12-05T09:26:07.334 INFO:tasks.workunit.client.1.smithi134.stdout:7/19: chown l0 1661376 1 2023-12-05T09:26:07.347 INFO:tasks.workunit.client.1.smithi134.stdout:8/37: fsync f8 0 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:6/3: sync 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:9/119: sync 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:8/48: sync 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:7/77: sync 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:6/4: write - no filename 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:1/37: sync 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:6/5: dwrite - no filename 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:6/6: truncate - no filename 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:1/38: fdatasync f1 0 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:0/43: sync 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:3/18: sync 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:2/4: sync 2023-12-05T09:26:07.349 INFO:tasks.workunit.client.0.smithi067.stdout:5/32: sync 2023-12-05T09:26:07.350 INFO:tasks.workunit.client.0.smithi067.stdout:5/33: chown f7 1209225 1 2023-12-05T09:26:07.350 INFO:tasks.workunit.client.0.smithi067.stdout:4/5: sync 2023-12-05T09:26:07.350 INFO:tasks.workunit.client.1.smithi134.stdout:5/36: write d0/f5 [2385118,34082] 0 2023-12-05T09:26:07.351 INFO:tasks.workunit.client.1.smithi134.stdout:6/29: dwrite d4/f7 [0,4194304] 0 2023-12-05T09:26:07.351 INFO:tasks.workunit.client.1.smithi134.stdout:1/33: dwrite d2/f6 [0,4194304] 0 2023-12-05T09:26:07.352 INFO:tasks.workunit.client.0.smithi067.stdout:7/78: truncate d0/f6 359099 0 2023-12-05T09:26:07.352 INFO:tasks.workunit.client.0.smithi067.stdout:7/79: write d0/d9/f14 [1009585,61999] 0 2023-12-05T09:26:07.352 INFO:tasks.workunit.client.0.smithi067.stdout:6/7: mknod c0 0 2023-12-05T09:26:07.352 INFO:tasks.workunit.client.0.smithi067.stdout:6/8: dwrite - no filename 2023-12-05T09:26:07.352 INFO:tasks.workunit.client.0.smithi067.stdout:6/9: dread - no filename 2023-12-05T09:26:07.353 INFO:tasks.workunit.client.0.smithi067.stdout:6/10: dread - no filename 2023-12-05T09:26:07.353 INFO:tasks.workunit.client.0.smithi067.stdout:6/11: rmdir - no directory 2023-12-05T09:26:07.354 INFO:tasks.workunit.client.0.smithi067.stdout:9/120: mknod d1b/d25/c2b 0 2023-12-05T09:26:07.360 INFO:tasks.workunit.client.0.smithi067.stdout:8/49: mknod d5/ce 0 2023-12-05T09:26:07.360 INFO:tasks.workunit.client.0.smithi067.stdout:1/39: unlink d2/d5/lc 0 2023-12-05T09:26:07.363 INFO:tasks.workunit.client.1.smithi134.stdout:2/51: getdents . 0 2023-12-05T09:26:07.363 INFO:tasks.workunit.client.1.smithi134.stdout:2/52: chown fd 92851106 1 2023-12-05T09:26:07.366 INFO:tasks.workunit.client.0.smithi067.stdout:3/19: creat f7 x:0 0 0 2023-12-05T09:26:07.367 INFO:tasks.workunit.client.0.smithi067.stdout:4/6: creat d0/f1 x:0 0 0 2023-12-05T09:26:07.367 INFO:tasks.workunit.client.0.smithi067.stdout:4/7: chown d0/f1 2179593 1 2023-12-05T09:26:07.368 INFO:tasks.workunit.client.0.smithi067.stdout:4/8: dread - d0/f1 zero size 2023-12-05T09:26:07.368 INFO:tasks.workunit.client.0.smithi067.stdout:4/9: dread - d0/f1 zero size 2023-12-05T09:26:07.368 INFO:tasks.workunit.client.0.smithi067.stdout:4/10: stat d0 0 2023-12-05T09:26:07.371 INFO:tasks.workunit.client.0.smithi067.stdout:5/34: creat db/f13 x:0 0 0 2023-12-05T09:26:07.371 INFO:tasks.workunit.client.0.smithi067.stdout:5/35: creat db/f14 x:0 0 0 2023-12-05T09:26:07.371 INFO:tasks.workunit.client.0.smithi067.stdout:5/36: fdatasync db/f13 0 2023-12-05T09:26:07.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/12: link c0 c1 0 2023-12-05T09:26:07.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/13: write - no filename 2023-12-05T09:26:07.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/14: dwrite - no filename 2023-12-05T09:26:07.376 INFO:tasks.workunit.client.1.smithi134.stdout:0/57: sync 2023-12-05T09:26:07.377 INFO:tasks.workunit.client.0.smithi067.stdout:9/121: creat d1b/d25/f2c x:0 0 0 2023-12-05T09:26:07.377 INFO:tasks.workunit.client.0.smithi067.stdout:9/122: dread - d1b/d25/f2c zero size 2023-12-05T09:26:07.385 INFO:tasks.workunit.client.0.smithi067.stdout:8/50: write f2 [1461522,24854] 0 2023-12-05T09:26:07.387 INFO:tasks.workunit.client.0.smithi067.stdout:4/11: rename d0/f1 to d0/f2 0 2023-12-05T09:26:07.390 INFO:tasks.workunit.client.0.smithi067.stdout:6/15: creat f2 x:0 0 0 2023-12-05T09:26:07.391 INFO:tasks.workunit.client.1.smithi134.stdout:1/34: unlink d2/d9/fe 0 2023-12-05T09:26:07.391 INFO:tasks.workunit.client.1.smithi134.stdout:5/37: rmdir d0 39 2023-12-05T09:26:07.392 INFO:tasks.workunit.client.1.smithi134.stdout:0/58: dread f7 [0,4194304] 0 2023-12-05T09:26:07.393 INFO:tasks.workunit.client.1.smithi134.stdout:5/38: creat d0/fc x:0 0 0 2023-12-05T09:26:07.395 INFO:tasks.workunit.client.0.smithi067.stdout:0/44: dread d3/f6 [0,4194304] 0 2023-12-05T09:26:07.397 INFO:tasks.workunit.client.0.smithi067.stdout:8/51: symlink d5/da/lf 0 2023-12-05T09:26:07.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/39: mkdir d0/dd 0 2023-12-05T09:26:07.398 INFO:tasks.workunit.client.0.smithi067.stdout:0/45: rmdir d3 39 2023-12-05T09:26:07.398 INFO:tasks.workunit.client.1.smithi134.stdout:6/30: dread d4/f7 [0,4194304] 0 2023-12-05T09:26:07.402 INFO:tasks.workunit.client.1.smithi134.stdout:5/40: symlink d0/dd/le 0 2023-12-05T09:26:07.402 INFO:tasks.workunit.client.1.smithi134.stdout:5/41: fdatasync d0/f7 0 2023-12-05T09:26:07.404 INFO:tasks.workunit.client.1.smithi134.stdout:6/31: rename d4/d9 to d4/d8/da 0 2023-12-05T09:26:07.407 INFO:tasks.workunit.client.1.smithi134.stdout:5/42: symlink d0/dd/lf 0 2023-12-05T09:26:07.409 INFO:tasks.workunit.client.0.smithi067.stdout:8/52: creat d5/f10 x:0 0 0 2023-12-05T09:26:07.409 INFO:tasks.workunit.client.0.smithi067.stdout:8/53: fsync d5/fb 0 2023-12-05T09:26:07.409 INFO:tasks.workunit.client.0.smithi067.stdout:8/54: dread - d5/f10 zero size 2023-12-05T09:26:07.416 INFO:tasks.workunit.client.1.smithi134.stdout:5/43: link d0/f5 d0/dd/f10 0 2023-12-05T09:26:07.418 INFO:tasks.workunit.client.1.smithi134.stdout:5/44: mkdir d0/d11 0 2023-12-05T09:26:07.418 INFO:tasks.workunit.client.1.smithi134.stdout:5/45: chown d0/dd 25064845 1 2023-12-05T09:26:07.418 INFO:tasks.workunit.client.1.smithi134.stdout:5/46: chown d0/c4 0 1 2023-12-05T09:26:07.422 INFO:tasks.workunit.client.1.smithi134.stdout:5/47: symlink d0/l12 0 2023-12-05T09:26:07.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/55: rename d5/fb to d5/dc/f11 0 2023-12-05T09:26:07.429 INFO:tasks.workunit.client.0.smithi067.stdout:8/56: rename d5/c9 to d5/da/c12 0 2023-12-05T09:26:07.433 INFO:tasks.workunit.client.1.smithi134.stdout:8/38: dwrite f3 [0,4194304] 0 2023-12-05T09:26:07.438 INFO:tasks.workunit.client.0.smithi067.stdout:8/57: rename l4 to d5/dc/l13 0 2023-12-05T09:26:07.438 INFO:tasks.workunit.client.0.smithi067.stdout:8/58: dread - d5/f10 zero size 2023-12-05T09:26:07.439 INFO:tasks.workunit.client.1.smithi134.stdout:8/39: unlink f8 0 2023-12-05T09:26:07.440 INFO:tasks.workunit.client.1.smithi134.stdout:7/20: read d2/f4 [1428211,43437] 0 2023-12-05T09:26:07.441 INFO:tasks.workunit.client.0.smithi067.stdout:9/123: dread f9 [0,4194304] 0 2023-12-05T09:26:07.443 INFO:tasks.workunit.client.1.smithi134.stdout:8/40: mkdir da 0 2023-12-05T09:26:07.443 INFO:tasks.workunit.client.1.smithi134.stdout:8/41: stat f2 0 2023-12-05T09:26:07.443 INFO:tasks.workunit.client.1.smithi134.stdout:8/42: getdents da 0 2023-12-05T09:26:07.444 INFO:tasks.workunit.client.1.smithi134.stdout:8/43: chown f0 11886 1 2023-12-05T09:26:07.444 INFO:tasks.workunit.client.1.smithi134.stdout:8/44: stat f7 0 2023-12-05T09:26:07.444 INFO:tasks.workunit.client.1.smithi134.stdout:7/21: write d2/f4 [4371650,116968] 0 2023-12-05T09:26:07.445 INFO:tasks.workunit.client.0.smithi067.stdout:9/124: truncate f16 2155256 0 2023-12-05T09:26:07.452 INFO:tasks.workunit.client.1.smithi134.stdout:9/21: dwrite f3 [0,4194304] 0 2023-12-05T09:26:07.459 INFO:tasks.workunit.client.1.smithi134.stdout:4/43: dwrite fb [0,4194304] 0 2023-12-05T09:26:07.459 INFO:tasks.workunit.client.1.smithi134.stdout:1/35: dwrite d2/f5 [0,4194304] 0 2023-12-05T09:26:07.463 INFO:tasks.workunit.client.0.smithi067.stdout:6/16: dwrite f2 [0,4194304] 0 2023-12-05T09:26:07.467 INFO:tasks.workunit.client.1.smithi134.stdout:1/36: truncate d2/f4 1042615 0 2023-12-05T09:26:07.475 INFO:tasks.workunit.client.0.smithi067.stdout:2/5: dwrite d0/f1 [0,4194304] 0 2023-12-05T09:26:07.475 INFO:tasks.workunit.client.0.smithi067.stdout:4/12: rmdir d0 39 2023-12-05T09:26:07.476 INFO:tasks.workunit.client.0.smithi067.stdout:4/13: chown d0/f2 279448 1 2023-12-05T09:26:07.476 INFO:tasks.workunit.client.0.smithi067.stdout:7/80: truncate d0/d9/f14 648991 0 2023-12-05T09:26:07.481 INFO:tasks.workunit.client.1.smithi134.stdout:7/22: dread d2/f4 [4194304,4194304] 0 2023-12-05T09:26:07.485 INFO:tasks.workunit.client.1.smithi134.stdout:1/37: write d2/f5 [114618,62019] 0 2023-12-05T09:26:07.489 INFO:tasks.workunit.client.1.smithi134.stdout:2/53: dwrite f8 [0,4194304] 0 2023-12-05T09:26:07.490 INFO:tasks.workunit.client.0.smithi067.stdout:6/17: dread f2 [0,4194304] 0 2023-12-05T09:26:07.491 INFO:tasks.workunit.client.1.smithi134.stdout:7/23: dread f1 [0,4194304] 0 2023-12-05T09:26:07.491 INFO:tasks.workunit.client.1.smithi134.stdout:7/24: truncate f1 1794794 0 2023-12-05T09:26:07.495 INFO:tasks.workunit.client.1.smithi134.stdout:4/44: dread fa [0,4194304] 0 2023-12-05T09:26:07.495 INFO:tasks.workunit.client.1.smithi134.stdout:8/45: write f2 [3160393,40630] 0 2023-12-05T09:26:07.495 INFO:tasks.workunit.client.1.smithi134.stdout:8/46: chown f3 4 1 2023-12-05T09:26:07.495 INFO:tasks.workunit.client.1.smithi134.stdout:8/47: getdents da 0 2023-12-05T09:26:07.495 INFO:tasks.workunit.client.1.smithi134.stdout:2/54: creat fe x:0 0 0 2023-12-05T09:26:07.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/14: unlink d0/f2 0 2023-12-05T09:26:07.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/15: unlink - no file 2023-12-05T09:26:07.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/16: read - no filename 2023-12-05T09:26:07.498 INFO:tasks.workunit.client.1.smithi134.stdout:9/22: dwrite f1 [0,4194304] 0 2023-12-05T09:26:07.498 INFO:tasks.workunit.client.1.smithi134.stdout:9/23: dread - f6 zero size 2023-12-05T09:26:07.498 INFO:tasks.workunit.client.1.smithi134.stdout:7/25: rename d2/d5 to d2/d7 0 2023-12-05T09:26:07.498 INFO:tasks.workunit.client.1.smithi134.stdout:4/45: link f11 f13 0 2023-12-05T09:26:07.499 INFO:tasks.workunit.client.0.smithi067.stdout:1/40: dwrite f1 [0,4194304] 0 2023-12-05T09:26:07.499 INFO:tasks.workunit.client.0.smithi067.stdout:1/41: stat d2/d3/ld 0 2023-12-05T09:26:07.501 INFO:tasks.workunit.client.1.smithi134.stdout:6/32: dwrite d4/f7 [0,4194304] 0 2023-12-05T09:26:07.501 INFO:tasks.workunit.client.0.smithi067.stdout:2/6: dread d0/f1 [0,4194304] 0 2023-12-05T09:26:07.502 INFO:tasks.workunit.client.0.smithi067.stdout:4/17: mknod d0/c3 0 2023-12-05T09:26:07.506 INFO:tasks.workunit.client.1.smithi134.stdout:3/24: sync 2023-12-05T09:26:07.506 INFO:tasks.workunit.client.1.smithi134.stdout:3/25: read - f1 zero size 2023-12-05T09:26:07.506 INFO:tasks.workunit.client.1.smithi134.stdout:3/26: write f3 [335841,98402] 0 2023-12-05T09:26:07.506 INFO:tasks.workunit.client.1.smithi134.stdout:3/27: read - f1 zero size 2023-12-05T09:26:07.506 INFO:tasks.workunit.client.1.smithi134.stdout:5/48: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:26:07.507 INFO:tasks.workunit.client.1.smithi134.stdout:9/24: mknod d7/c9 0 2023-12-05T09:26:07.507 INFO:tasks.workunit.client.0.smithi067.stdout:5/37: write f9 [2389666,51971] 0 2023-12-05T09:26:07.508 INFO:tasks.workunit.client.1.smithi134.stdout:7/26: rename d2/f4 to d2/f8 0 2023-12-05T09:26:07.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/27: write f1 [436858,91636] 0 2023-12-05T09:26:07.511 INFO:tasks.workunit.client.1.smithi134.stdout:4/46: unlink le 0 2023-12-05T09:26:07.513 INFO:tasks.workunit.client.1.smithi134.stdout:1/38: read d2/f4 [934795,108956] 0 2023-12-05T09:26:07.514 INFO:tasks.workunit.client.0.smithi067.stdout:1/42: creat d2/f13 x:0 0 0 2023-12-05T09:26:07.514 INFO:tasks.workunit.client.0.smithi067.stdout:4/18: creat d0/f4 x:0 0 0 2023-12-05T09:26:07.514 INFO:tasks.workunit.client.0.smithi067.stdout:0/46: dwrite d3/fb [0,4194304] 0 2023-12-05T09:26:07.517 INFO:tasks.workunit.client.1.smithi134.stdout:6/33: mkdir d4/db 0 2023-12-05T09:26:07.517 INFO:tasks.workunit.client.1.smithi134.stdout:6/34: write f0 [4078664,14077] 0 2023-12-05T09:26:07.518 INFO:tasks.workunit.client.0.smithi067.stdout:6/18: write f2 [498435,69272] 0 2023-12-05T09:26:07.524 INFO:tasks.workunit.client.1.smithi134.stdout:3/28: mknod d4/c8 0 2023-12-05T09:26:07.524 INFO:tasks.workunit.client.1.smithi134.stdout:5/49: rename d0/dd/lf to d0/l13 0 2023-12-05T09:26:07.526 INFO:tasks.workunit.client.1.smithi134.stdout:9/25: link l5 d7/d8/la 0 2023-12-05T09:26:07.526 INFO:tasks.workunit.client.1.smithi134.stdout:9/26: write f1 [4678310,28528] 0 2023-12-05T09:26:07.535 INFO:tasks.workunit.client.1.smithi134.stdout:7/28: symlink d2/l9 0 2023-12-05T09:26:07.538 INFO:tasks.workunit.client.0.smithi067.stdout:1/43: mkdir d2/d5/d7/de/d10/d14 0 2023-12-05T09:26:07.540 INFO:tasks.workunit.client.0.smithi067.stdout:9/125: write d1b/f1f [832983,60092] 0 2023-12-05T09:26:07.541 INFO:tasks.workunit.client.0.smithi067.stdout:0/47: write d3/fb [428889,118021] 0 2023-12-05T09:26:07.544 INFO:tasks.workunit.client.1.smithi134.stdout:4/47: mknod c14 0 2023-12-05T09:26:07.544 INFO:tasks.workunit.client.1.smithi134.stdout:4/48: fsync f5 0 2023-12-05T09:26:07.546 INFO:tasks.workunit.client.1.smithi134.stdout:1/39: mkdir d2/d9/d10 0 2023-12-05T09:26:07.546 INFO:tasks.workunit.client.1.smithi134.stdout:6/35: symlink d4/d8/da/lc 0 2023-12-05T09:26:07.546 INFO:tasks.workunit.client.1.smithi134.stdout:3/29: mknod d4/d5/c9 0 2023-12-05T09:26:07.546 INFO:tasks.workunit.client.1.smithi134.stdout:3/30: fsync f3 0 2023-12-05T09:26:07.548 INFO:tasks.workunit.client.1.smithi134.stdout:9/27: rename f6 to d7/fb 0 2023-12-05T09:26:07.549 INFO:tasks.workunit.client.0.smithi067.stdout:6/19: fdatasync f2 0 2023-12-05T09:26:07.549 INFO:tasks.workunit.client.0.smithi067.stdout:1/44: mkdir d2/d5/d7/de/d10/d15 0 2023-12-05T09:26:07.549 INFO:tasks.workunit.client.0.smithi067.stdout:6/20: write f2 [4141768,19283] 0 2023-12-05T09:26:07.555 INFO:tasks.workunit.client.1.smithi134.stdout:3/31: mknod d4/d5/ca 0 2023-12-05T09:26:07.555 INFO:tasks.workunit.client.1.smithi134.stdout:3/32: write f3 [905977,95275] 0 2023-12-05T09:26:07.555 INFO:tasks.workunit.client.1.smithi134.stdout:3/33: chown f3 24152 1 2023-12-05T09:26:07.556 INFO:tasks.workunit.client.1.smithi134.stdout:6/36: unlink d4/f7 0 2023-12-05T09:26:07.557 INFO:tasks.workunit.client.1.smithi134.stdout:6/37: write f0 [1799613,42380] 0 2023-12-05T09:26:07.557 INFO:tasks.workunit.client.1.smithi134.stdout:7/29: write f1 [866507,117773] 0 2023-12-05T09:26:07.557 INFO:tasks.workunit.client.1.smithi134.stdout:7/30: fdatasync d2/f8 0 2023-12-05T09:26:07.558 INFO:tasks.workunit.client.1.smithi134.stdout:9/28: creat d7/d8/fc x:0 0 0 2023-12-05T09:26:07.559 INFO:tasks.workunit.client.0.smithi067.stdout:0/48: mkdir d3/dd 0 2023-12-05T09:26:07.560 INFO:tasks.workunit.client.1.smithi134.stdout:3/34: creat d4/fb x:0 0 0 2023-12-05T09:26:07.562 INFO:tasks.workunit.client.1.smithi134.stdout:7/31: symlink d2/d7/la 0 2023-12-05T09:26:07.562 INFO:tasks.workunit.client.1.smithi134.stdout:7/32: chown d2/l9 2008670 1 2023-12-05T09:26:07.563 INFO:tasks.workunit.client.0.smithi067.stdout:2/7: dwrite d0/f1 [0,4194304] 0 2023-12-05T09:26:07.563 INFO:tasks.workunit.client.0.smithi067.stdout:2/8: chown d0 7 1 2023-12-05T09:26:07.569 INFO:tasks.workunit.client.1.smithi134.stdout:3/35: symlink d4/lc 0 2023-12-05T09:26:07.569 INFO:tasks.workunit.client.1.smithi134.stdout:3/36: creat d4/d5/fd x:0 0 0 2023-12-05T09:26:07.570 INFO:tasks.workunit.client.1.smithi134.stdout:4/49: dread f5 [0,4194304] 0 2023-12-05T09:26:07.571 INFO:tasks.workunit.client.0.smithi067.stdout:8/59: dwrite f2 [4194304,4194304] 0 2023-12-05T09:26:07.571 INFO:tasks.workunit.client.0.smithi067.stdout:8/60: creat d5/f14 x:0 0 0 2023-12-05T09:26:07.572 INFO:tasks.workunit.client.1.smithi134.stdout:4/50: creat f15 x:0 0 0 2023-12-05T09:26:07.576 INFO:tasks.workunit.client.0.smithi067.stdout:1/45: rmdir d2/d3 39 2023-12-05T09:26:07.576 INFO:tasks.workunit.client.0.smithi067.stdout:1/46: fdatasync f1 0 2023-12-05T09:26:07.576 INFO:tasks.workunit.client.0.smithi067.stdout:7/81: link d0/d9/f14 d0/d9/d10/d1d/f1f 0 2023-12-05T09:26:07.576 INFO:tasks.workunit.client.0.smithi067.stdout:7/82: read - d0/d9/d1b/f1e zero size 2023-12-05T09:26:07.581 INFO:tasks.workunit.client.1.smithi134.stdout:8/48: truncate f2 2235892 0 2023-12-05T09:26:07.582 INFO:tasks.workunit.client.0.smithi067.stdout:8/61: dread d5/dc/f11 [0,4194304] 0 2023-12-05T09:26:07.586 INFO:tasks.workunit.client.0.smithi067.stdout:0/49: dread d3/f6 [0,4194304] 0 2023-12-05T09:26:07.586 INFO:tasks.workunit.client.0.smithi067.stdout:1/47: creat d2/d3/f16 x:0 0 0 2023-12-05T09:26:07.590 INFO:tasks.workunit.client.1.smithi134.stdout:7/33: mknod d2/d7/cb 0 2023-12-05T09:26:07.591 INFO:tasks.workunit.client.1.smithi134.stdout:7/34: readlink d2/d7/la 0 2023-12-05T09:26:07.591 INFO:tasks.workunit.client.0.smithi067.stdout:5/38: dwrite f6 [0,4194304] 0 2023-12-05T09:26:07.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/39: creat db/df/f15 x:0 0 0 2023-12-05T09:26:07.594 INFO:tasks.workunit.client.0.smithi067.stdout:7/83: rename d0/d9/d10/l19 to d0/l20 0 2023-12-05T09:26:07.597 INFO:tasks.workunit.client.1.smithi134.stdout:2/55: dwrite f1 [0,4194304] 0 2023-12-05T09:26:07.600 INFO:tasks.workunit.client.0.smithi067.stdout:2/9: dread d0/f1 [0,4194304] 0 2023-12-05T09:26:07.600 INFO:tasks.workunit.client.0.smithi067.stdout:1/48: mknod d2/d5/d7/de/c17 0 2023-12-05T09:26:07.600 INFO:tasks.workunit.client.0.smithi067.stdout:1/49: chown f1 22 1 2023-12-05T09:26:07.605 INFO:tasks.workunit.client.1.smithi134.stdout:7/35: dread f1 [0,4194304] 0 2023-12-05T09:26:07.609 INFO:tasks.workunit.client.0.smithi067.stdout:0/50: write d3/f6 [332901,23279] 0 2023-12-05T09:26:07.610 INFO:tasks.workunit.client.0.smithi067.stdout:2/10: rename d0/f1 to d0/f2 0 2023-12-05T09:26:07.611 INFO:tasks.workunit.client.1.smithi134.stdout:9/29: dwrite f1 [0,4194304] 0 2023-12-05T09:26:07.612 INFO:tasks.workunit.client.1.smithi134.stdout:9/30: rename d7 to d7/dd 22 2023-12-05T09:26:07.612 INFO:tasks.workunit.client.1.smithi134.stdout:2/56: mknod cf 0 2023-12-05T09:26:07.613 INFO:tasks.workunit.client.1.smithi134.stdout:2/57: chown fe 164 1 2023-12-05T09:26:07.613 INFO:tasks.workunit.client.1.smithi134.stdout:2/58: creat f10 x:0 0 0 2023-12-05T09:26:07.621 INFO:tasks.workunit.client.1.smithi134.stdout:1/40: dwrite d2/f4 [0,4194304] 0 2023-12-05T09:26:07.622 INFO:tasks.workunit.client.0.smithi067.stdout:0/51: unlink f1 0 2023-12-05T09:26:07.622 INFO:tasks.workunit.client.1.smithi134.stdout:7/36: mkdir d2/d7/dc 0 2023-12-05T09:26:07.622 INFO:tasks.workunit.client.1.smithi134.stdout:8/49: mkdir da/db 0 2023-12-05T09:26:07.622 INFO:tasks.workunit.client.1.smithi134.stdout:8/50: readlink - no filename 2023-12-05T09:26:07.622 INFO:tasks.workunit.client.1.smithi134.stdout:2/59: symlink l11 0 2023-12-05T09:26:07.622 INFO:tasks.workunit.client.1.smithi134.stdout:2/60: creat f12 x:0 0 0 2023-12-05T09:26:07.623 INFO:tasks.workunit.client.1.smithi134.stdout:6/38: truncate f0 704380 0 2023-12-05T09:26:07.623 INFO:tasks.workunit.client.1.smithi134.stdout:6/39: creat d4/fd x:0 0 0 2023-12-05T09:26:07.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/52: truncate d3/f4 486713 0 2023-12-05T09:26:07.632 INFO:tasks.workunit.client.0.smithi067.stdout:5/40: dread f9 [0,4194304] 0 2023-12-05T09:26:07.633 INFO:tasks.workunit.client.1.smithi134.stdout:1/41: symlink d2/l11 0 2023-12-05T09:26:07.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/37: mkdir d2/dd 0 2023-12-05T09:26:07.633 INFO:tasks.workunit.client.1.smithi134.stdout:2/61: unlink f3 0 2023-12-05T09:26:07.633 INFO:tasks.workunit.client.1.smithi134.stdout:2/62: truncate fc 870424 0 2023-12-05T09:26:07.639 INFO:tasks.workunit.client.0.smithi067.stdout:0/53: getdents d3 0 2023-12-05T09:26:07.643 INFO:tasks.workunit.client.1.smithi134.stdout:2/63: dread fc [0,4194304] 0 2023-12-05T09:26:07.643 INFO:tasks.workunit.client.1.smithi134.stdout:2/64: write fc [1447896,6326] 0 2023-12-05T09:26:07.643 INFO:tasks.workunit.client.1.smithi134.stdout:2/65: creat f13 x:0 0 0 2023-12-05T09:26:07.647 INFO:tasks.workunit.client.0.smithi067.stdout:6/21: truncate f2 653836 0 2023-12-05T09:26:07.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/31: dread f3 [0,4194304] 0 2023-12-05T09:26:07.652 INFO:tasks.workunit.client.1.smithi134.stdout:4/51: dwrite fa [0,4194304] 0 2023-12-05T09:26:07.652 INFO:tasks.workunit.client.1.smithi134.stdout:4/52: truncate f13 426325 0 2023-12-05T09:26:07.653 INFO:tasks.workunit.client.0.smithi067.stdout:2/11: read d0/f2 [1005059,73909] 0 2023-12-05T09:26:07.656 INFO:tasks.workunit.client.1.smithi134.stdout:6/40: creat d4/d8/fe x:0 0 0 2023-12-05T09:26:07.656 INFO:tasks.workunit.client.1.smithi134.stdout:6/41: dread - d4/fd zero size 2023-12-05T09:26:07.656 INFO:tasks.workunit.client.1.smithi134.stdout:1/42: rename d2/l11 to d2/d9/d10/l12 0 2023-12-05T09:26:07.656 INFO:tasks.workunit.client.1.smithi134.stdout:6/42: readlink d4/d8/da/lc 0 2023-12-05T09:26:07.656 INFO:tasks.workunit.client.1.smithi134.stdout:1/43: chown d2/f5 3 1 2023-12-05T09:26:07.658 INFO:tasks.workunit.client.0.smithi067.stdout:8/62: dwrite d5/f14 [0,4194304] 0 2023-12-05T09:26:07.658 INFO:tasks.workunit.client.1.smithi134.stdout:2/66: symlink l14 0 2023-12-05T09:26:07.658 INFO:tasks.workunit.client.1.smithi134.stdout:2/67: creat f15 x:0 0 0 2023-12-05T09:26:07.661 INFO:tasks.workunit.client.0.smithi067.stdout:5/41: truncate f6 1697102 0 2023-12-05T09:26:07.661 INFO:tasks.workunit.client.0.smithi067.stdout:5/42: creat db/df/f16 x:0 0 0 2023-12-05T09:26:07.663 INFO:tasks.workunit.client.1.smithi134.stdout:8/51: dread f2 [0,4194304] 0 2023-12-05T09:26:07.664 INFO:tasks.workunit.client.0.smithi067.stdout:7/84: dwrite d0/d9/d10/d1d/f1f [0,4194304] 0 2023-12-05T09:26:07.665 INFO:tasks.workunit.client.0.smithi067.stdout:2/12: unlink d0/f2 0 2023-12-05T09:26:07.666 INFO:tasks.workunit.client.0.smithi067.stdout:2/13: creat d0/f3 x:0 0 0 2023-12-05T09:26:07.666 INFO:tasks.workunit.client.0.smithi067.stdout:2/14: creat d0/f4 x:0 0 0 2023-12-05T09:26:07.666 INFO:tasks.workunit.client.0.smithi067.stdout:2/15: dread - d0/f3 zero size 2023-12-05T09:26:07.667 INFO:tasks.workunit.client.0.smithi067.stdout:8/63: truncate d5/dc/f11 73562 0 2023-12-05T09:26:07.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/44: creat d2/d9/d10/f13 x:0 0 0 2023-12-05T09:26:07.669 INFO:tasks.workunit.client.1.smithi134.stdout:6/43: link d4/fd d4/ff 0 2023-12-05T09:26:07.670 INFO:tasks.workunit.client.1.smithi134.stdout:1/45: fsync d2/f6 0 2023-12-05T09:26:07.670 INFO:tasks.workunit.client.1.smithi134.stdout:2/68: link fe f16 0 2023-12-05T09:26:07.670 INFO:tasks.workunit.client.1.smithi134.stdout:2/69: write f13 [962239,112119] 0 2023-12-05T09:26:07.671 INFO:tasks.workunit.client.1.smithi134.stdout:2/70: creat f17 x:0 0 0 2023-12-05T09:26:07.672 INFO:tasks.workunit.client.1.smithi134.stdout:2/71: creat f18 x:0 0 0 2023-12-05T09:26:07.672 INFO:tasks.workunit.client.1.smithi134.stdout:0/59: sync 2023-12-05T09:26:07.673 INFO:tasks.workunit.client.1.smithi134.stdout:8/52: creat da/db/fc x:0 0 0 2023-12-05T09:26:07.673 INFO:tasks.workunit.client.1.smithi134.stdout:6/44: mknod d4/d8/da/c10 0 2023-12-05T09:26:07.673 INFO:tasks.workunit.client.1.smithi134.stdout:6/45: read - d4/d8/fe zero size 2023-12-05T09:26:07.674 INFO:tasks.workunit.client.1.smithi134.stdout:1/46: rename d2/c3 to d2/c14 0 2023-12-05T09:26:07.674 INFO:tasks.workunit.client.1.smithi134.stdout:1/47: fdatasync d2/f6 0 2023-12-05T09:26:07.674 INFO:tasks.workunit.client.1.smithi134.stdout:1/48: chown d2 488914 1 2023-12-05T09:26:07.677 INFO:tasks.workunit.client.0.smithi067.stdout:6/22: write f2 [1282094,89061] 0 2023-12-05T09:26:07.677 INFO:tasks.workunit.client.0.smithi067.stdout:5/43: truncate f9 2905093 0 2023-12-05T09:26:07.681 INFO:tasks.workunit.client.1.smithi134.stdout:4/53: dread ff [0,4194304] 0 2023-12-05T09:26:07.682 INFO:tasks.workunit.client.1.smithi134.stdout:0/60: truncate f7 3148212 0 2023-12-05T09:26:07.682 INFO:tasks.workunit.client.1.smithi134.stdout:0/61: chown fd 103760702 1 2023-12-05T09:26:07.682 INFO:tasks.workunit.client.1.smithi134.stdout:8/53: stat f3 0 2023-12-05T09:26:07.683 INFO:tasks.workunit.client.1.smithi134.stdout:1/49: rmdir d2 39 2023-12-05T09:26:07.683 INFO:tasks.workunit.client.1.smithi134.stdout:4/54: mkdir d16 0 2023-12-05T09:26:07.684 INFO:tasks.workunit.client.1.smithi134.stdout:4/55: chown fa 162 1 2023-12-05T09:26:07.684 INFO:tasks.workunit.client.1.smithi134.stdout:8/54: creat da/fd x:0 0 0 2023-12-05T09:26:07.685 INFO:tasks.workunit.client.1.smithi134.stdout:4/56: mkdir d16/d17 0 2023-12-05T09:26:07.687 INFO:tasks.workunit.client.0.smithi067.stdout:7/85: unlink d0/c3 0 2023-12-05T09:26:07.687 INFO:tasks.workunit.client.0.smithi067.stdout:0/54: dread d3/d7/f8 [0,4194304] 0 2023-12-05T09:26:07.693 INFO:tasks.workunit.client.0.smithi067.stdout:2/16: mknod d0/c5 0 2023-12-05T09:26:07.693 INFO:tasks.workunit.client.0.smithi067.stdout:8/64: creat d5/dc/f15 x:0 0 0 2023-12-05T09:26:07.694 INFO:tasks.workunit.client.0.smithi067.stdout:2/17: mknod d0/c6 0 2023-12-05T09:26:07.702 INFO:tasks.workunit.client.0.smithi067.stdout:8/65: unlink f2 0 2023-12-05T09:26:07.703 INFO:tasks.workunit.client.0.smithi067.stdout:9/126: dwrite fa [0,4194304] 0 2023-12-05T09:26:07.705 INFO:tasks.workunit.client.0.smithi067.stdout:8/66: unlink d5/dc/f15 0 2023-12-05T09:26:07.713 INFO:tasks.workunit.client.1.smithi134.stdout:3/37: sync 2023-12-05T09:26:07.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/50: sync 2023-12-05T09:26:07.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/51: chown d0/f2 415 1 2023-12-05T09:26:07.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/52: write d0/f7 [374047,56553] 0 2023-12-05T09:26:07.716 INFO:tasks.workunit.client.1.smithi134.stdout:4/57: read f5 [3503866,81526] 0 2023-12-05T09:26:07.716 INFO:tasks.workunit.client.1.smithi134.stdout:3/38: link f1 d4/d5/fe 0 2023-12-05T09:26:07.717 INFO:tasks.workunit.client.1.smithi134.stdout:7/38: dwrite f1 [0,4194304] 0 2023-12-05T09:26:07.721 INFO:tasks.workunit.client.1.smithi134.stdout:4/58: rename d16/d17 to d16/d18 0 2023-12-05T09:26:07.723 INFO:tasks.workunit.client.1.smithi134.stdout:1/50: dread d2/f4 [0,4194304] 0 2023-12-05T09:26:07.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/55: dread d3/f6 [0,4194304] 0 2023-12-05T09:26:07.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/56: write d3/d7/fc [731467,77521] 0 2023-12-05T09:26:07.725 INFO:tasks.workunit.client.1.smithi134.stdout:2/72: dwrite f10 [0,4194304] 0 2023-12-05T09:26:07.725 INFO:tasks.workunit.client.1.smithi134.stdout:2/73: write f17 [487784,112592] 0 2023-12-05T09:26:07.726 INFO:tasks.workunit.client.0.smithi067.stdout:0/57: symlink d3/d7/le 0 2023-12-05T09:26:07.726 INFO:tasks.workunit.client.0.smithi067.stdout:0/58: fsync d3/fa 0 2023-12-05T09:26:07.726 INFO:tasks.workunit.client.1.smithi134.stdout:3/39: symlink d4/lf 0 2023-12-05T09:26:07.727 INFO:tasks.workunit.client.1.smithi134.stdout:3/40: creat d4/d5/f10 x:0 0 0 2023-12-05T09:26:07.727 INFO:tasks.workunit.client.1.smithi134.stdout:3/41: dread - d4/d5/fd zero size 2023-12-05T09:26:07.727 INFO:tasks.workunit.client.1.smithi134.stdout:3/42: creat d4/d5/f11 x:0 0 0 2023-12-05T09:26:07.727 INFO:tasks.workunit.client.1.smithi134.stdout:3/43: chown d4/lf 64802385 1 2023-12-05T09:26:07.728 INFO:tasks.workunit.client.0.smithi067.stdout:0/59: rename d3/dd to d3/df 0 2023-12-05T09:26:07.729 INFO:tasks.workunit.client.1.smithi134.stdout:7/39: link d2/d7/la d2/le 0 2023-12-05T09:26:07.729 INFO:tasks.workunit.client.1.smithi134.stdout:4/59: mknod d16/c19 0 2023-12-05T09:26:07.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/51: symlink d2/l15 0 2023-12-05T09:26:07.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/52: write d2/f5 [629074,57823] 0 2023-12-05T09:26:07.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/53: write d2/f5 [2675758,26912] 0 2023-12-05T09:26:07.731 INFO:tasks.workunit.client.1.smithi134.stdout:8/55: rename da/db to da/de 0 2023-12-05T09:26:07.731 INFO:tasks.workunit.client.1.smithi134.stdout:8/56: write da/de/fc [998075,123783] 0 2023-12-05T09:26:07.735 INFO:tasks.workunit.client.1.smithi134.stdout:3/44: dread f3 [0,4194304] 0 2023-12-05T09:26:07.735 INFO:tasks.workunit.client.1.smithi134.stdout:3/45: creat d4/f12 x:0 0 0 2023-12-05T09:26:07.735 INFO:tasks.workunit.client.1.smithi134.stdout:3/46: creat d4/f13 x:0 0 0 2023-12-05T09:26:07.745 INFO:tasks.workunit.client.0.smithi067.stdout:2/18: fsync d0/f3 0 2023-12-05T09:26:07.746 INFO:tasks.workunit.client.0.smithi067.stdout:1/50: dwrite f1 [0,4194304] 0 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:2/74: mkdir d19 0 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:7/40: getdents d2/d7 0 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/60: mkdir d16/d18/d1a 0 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/61: chown ld 2 1 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/62: write f15 [70398,16873] 0 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/63: write ff [5016328,99966] 0 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/64: fsync f11 0 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/65: chown d16/d18/d1a 10535 1 2023-12-05T09:26:07.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/66: fdatasync f11 0 2023-12-05T09:26:07.749 INFO:tasks.workunit.client.1.smithi134.stdout:4/67: fsync f4 0 2023-12-05T09:26:07.754 INFO:tasks.workunit.client.0.smithi067.stdout:8/67: rename d5/dc/f11 to d5/f16 0 2023-12-05T09:26:07.754 INFO:tasks.workunit.client.1.smithi134.stdout:1/54: symlink d2/d9/l16 0 2023-12-05T09:26:07.755 INFO:tasks.workunit.client.1.smithi134.stdout:8/57: symlink da/de/lf 0 2023-12-05T09:26:07.758 INFO:tasks.workunit.client.0.smithi067.stdout:9/127: truncate fa 4036562 0 2023-12-05T09:26:07.758 INFO:tasks.workunit.client.1.smithi134.stdout:6/46: dwrite d4/ff [0,4194304] 0 2023-12-05T09:26:07.758 INFO:tasks.workunit.client.1.smithi134.stdout:7/41: mkdir d2/df 0 2023-12-05T09:26:07.760 INFO:tasks.workunit.client.1.smithi134.stdout:8/58: chown f7 35140 1 2023-12-05T09:26:07.761 INFO:tasks.workunit.client.1.smithi134.stdout:0/62: dwrite fd [0,4194304] 0 2023-12-05T09:26:07.764 INFO:tasks.workunit.client.0.smithi067.stdout:1/51: unlink d2/d3/ld 0 2023-12-05T09:26:07.765 INFO:tasks.workunit.client.0.smithi067.stdout:1/52: write d2/f13 [36824,88085] 0 2023-12-05T09:26:07.767 INFO:tasks.workunit.client.1.smithi134.stdout:8/59: truncate f3 348005 0 2023-12-05T09:26:07.767 INFO:tasks.workunit.client.1.smithi134.stdout:8/60: truncate da/fd 543426 0 2023-12-05T09:26:07.767 INFO:tasks.workunit.client.1.smithi134.stdout:2/75: dread fa [0,4194304] 0 2023-12-05T09:26:07.770 INFO:tasks.workunit.client.1.smithi134.stdout:2/76: mknod d19/c1a 0 2023-12-05T09:26:07.774 INFO:tasks.workunit.client.1.smithi134.stdout:2/77: write f13 [997484,80204] 0 2023-12-05T09:26:07.774 INFO:tasks.workunit.client.0.smithi067.stdout:9/128: rename fb to d1b/d25/f2d 0 2023-12-05T09:26:07.774 INFO:tasks.workunit.client.0.smithi067.stdout:0/60: dread d3/f5 [0,4194304] 0 2023-12-05T09:26:07.774 INFO:tasks.workunit.client.0.smithi067.stdout:9/129: write f19 [387760,97434] 0 2023-12-05T09:26:07.777 INFO:tasks.workunit.client.1.smithi134.stdout:2/78: symlink d19/l1b 0 2023-12-05T09:26:07.781 INFO:tasks.workunit.client.0.smithi067.stdout:1/53: stat d2/d5/d7/l12 0 2023-12-05T09:26:07.784 INFO:tasks.workunit.client.0.smithi067.stdout:1/54: creat d2/d3/f18 x:0 0 0 2023-12-05T09:26:07.801 INFO:tasks.workunit.client.1.smithi134.stdout:1/55: dread d2/f6 [0,4194304] 0 2023-12-05T09:26:07.805 INFO:tasks.workunit.client.1.smithi134.stdout:1/56: creat d2/f17 x:0 0 0 2023-12-05T09:26:07.808 INFO:tasks.workunit.client.0.smithi067.stdout:7/86: dwrite d0/d9/ff [0,4194304] 0 2023-12-05T09:26:07.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/44: dwrite db/df/f15 [0,4194304] 0 2023-12-05T09:26:07.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/45: read - db/f13 zero size 2023-12-05T09:26:07.809 INFO:tasks.workunit.client.0.smithi067.stdout:5/46: dread - db/df/f12 zero size 2023-12-05T09:26:07.823 INFO:tasks.workunit.client.1.smithi134.stdout:1/57: unlink d2/c8 0 2023-12-05T09:26:07.829 INFO:tasks.workunit.client.0.smithi067.stdout:5/47: mknod db/c17 0 2023-12-05T09:26:07.831 INFO:tasks.workunit.client.1.smithi134.stdout:0/63: dread f8 [0,4194304] 0 2023-12-05T09:26:07.832 INFO:tasks.workunit.client.1.smithi134.stdout:1/58: rename d2/d9/cb to d2/d9/c18 0 2023-12-05T09:26:07.832 INFO:tasks.workunit.client.1.smithi134.stdout:1/59: creat d2/f19 x:0 0 0 2023-12-05T09:26:07.832 INFO:tasks.workunit.client.1.smithi134.stdout:1/60: write d2/f19 [844181,9953] 0 2023-12-05T09:26:07.832 INFO:tasks.workunit.client.0.smithi067.stdout:7/87: getdents d0/d9/d1b 0 2023-12-05T09:26:07.832 INFO:tasks.workunit.client.0.smithi067.stdout:7/88: truncate d0/d9/d10/f1a 852877 0 2023-12-05T09:26:07.833 INFO:tasks.workunit.client.1.smithi134.stdout:9/32: sync 2023-12-05T09:26:07.835 INFO:tasks.workunit.client.1.smithi134.stdout:5/53: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:26:07.835 INFO:tasks.workunit.client.0.smithi067.stdout:1/55: rmdir d2/d3 39 2023-12-05T09:26:07.838 INFO:tasks.workunit.client.0.smithi067.stdout:7/89: link d0/d9/f18 d0/f21 0 2023-12-05T09:26:07.840 INFO:tasks.workunit.client.0.smithi067.stdout:1/56: mkdir d2/d5/d7/de/d19 0 2023-12-05T09:26:07.841 INFO:tasks.workunit.client.1.smithi134.stdout:9/33: link f1 d7/d8/fe 0 2023-12-05T09:26:07.841 INFO:tasks.workunit.client.1.smithi134.stdout:1/61: mknod d2/c1a 0 2023-12-05T09:26:07.848 INFO:tasks.workunit.client.0.smithi067.stdout:1/57: unlink l0 0 2023-12-05T09:26:07.849 INFO:tasks.workunit.client.0.smithi067.stdout:8/68: dwrite d5/f10 [0,4194304] 0 2023-12-05T09:26:07.852 INFO:tasks.workunit.client.0.smithi067.stdout:1/58: mkdir d2/d5/d7/de/d1a 0 2023-12-05T09:26:07.852 INFO:tasks.workunit.client.0.smithi067.stdout:1/59: readlink d2/d5/d7/l12 0 2023-12-05T09:26:07.853 INFO:tasks.workunit.client.1.smithi134.stdout:2/79: read f10 [3195734,89585] 0 2023-12-05T09:26:07.854 INFO:tasks.workunit.client.0.smithi067.stdout:8/69: creat d5/da/f17 x:0 0 0 2023-12-05T09:26:07.857 INFO:tasks.workunit.client.1.smithi134.stdout:2/80: getdents d19 0 2023-12-05T09:26:07.858 INFO:tasks.workunit.client.0.smithi067.stdout:1/60: link f1 d2/d5/d7/de/d1a/f1b 0 2023-12-05T09:26:07.858 INFO:tasks.workunit.client.0.smithi067.stdout:1/61: chown d2/d5/d7/de/c17 131906076 1 2023-12-05T09:26:07.858 INFO:tasks.workunit.client.0.smithi067.stdout:1/62: read d2/f13 [65387,76617] 0 2023-12-05T09:26:07.869 INFO:tasks.workunit.client.1.smithi134.stdout:8/61: dwrite f3 [0,4194304] 0 2023-12-05T09:26:07.870 INFO:tasks.workunit.client.1.smithi134.stdout:5/54: dread d0/f7 [0,4194304] 0 2023-12-05T09:26:07.870 INFO:tasks.workunit.client.1.smithi134.stdout:5/55: chown d0/c9 198363848 1 2023-12-05T09:26:07.870 INFO:tasks.workunit.client.1.smithi134.stdout:5/56: chown d0/cb 63451928 1 2023-12-05T09:26:07.870 INFO:tasks.workunit.client.1.smithi134.stdout:4/68: dwrite fa [0,4194304] 0 2023-12-05T09:26:07.870 INFO:tasks.workunit.client.1.smithi134.stdout:4/69: dread - f6 zero size 2023-12-05T09:26:07.871 INFO:tasks.workunit.client.1.smithi134.stdout:9/34: write f3 [3957817,91369] 0 2023-12-05T09:26:07.871 INFO:tasks.workunit.client.1.smithi134.stdout:9/35: write d7/fb [25835,27403] 0 2023-12-05T09:26:07.872 INFO:tasks.workunit.client.1.smithi134.stdout:6/47: dwrite d4/d8/fe [0,4194304] 0 2023-12-05T09:26:07.872 INFO:tasks.workunit.client.1.smithi134.stdout:6/48: stat f0 0 2023-12-05T09:26:07.872 INFO:tasks.workunit.client.1.smithi134.stdout:7/42: dwrite f1 [0,4194304] 0 2023-12-05T09:26:07.873 INFO:tasks.workunit.client.1.smithi134.stdout:5/57: creat d0/dd/f14 x:0 0 0 2023-12-05T09:26:07.873 INFO:tasks.workunit.client.0.smithi067.stdout:0/61: write d3/d7/f8 [1175725,92231] 0 2023-12-05T09:26:07.873 INFO:tasks.workunit.client.0.smithi067.stdout:2/19: dwrite d0/f3 [0,4194304] 0 2023-12-05T09:26:07.876 INFO:tasks.workunit.client.1.smithi134.stdout:1/62: truncate d2/f19 678175 0 2023-12-05T09:26:07.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/70: write d5/f14 [3961143,1863] 0 2023-12-05T09:26:07.878 INFO:tasks.workunit.client.0.smithi067.stdout:8/71: creat d5/f18 x:0 0 0 2023-12-05T09:26:07.878 INFO:tasks.workunit.client.0.smithi067.stdout:8/72: truncate d5/da/f17 258554 0 2023-12-05T09:26:07.878 INFO:tasks.workunit.client.0.smithi067.stdout:8/73: creat d5/dc/f19 x:0 0 0 2023-12-05T09:26:07.878 INFO:tasks.workunit.client.1.smithi134.stdout:4/70: getdents d16 0 2023-12-05T09:26:07.879 INFO:tasks.workunit.client.1.smithi134.stdout:9/36: mknod d7/d8/cf 0 2023-12-05T09:26:07.880 INFO:tasks.workunit.client.0.smithi067.stdout:7/90: write d0/f21 [1093990,96629] 0 2023-12-05T09:26:07.880 INFO:tasks.workunit.client.1.smithi134.stdout:2/81: dread f10 [0,4194304] 0 2023-12-05T09:26:07.881 INFO:tasks.workunit.client.1.smithi134.stdout:2/82: chown d19 3497703 1 2023-12-05T09:26:07.881 INFO:tasks.workunit.client.1.smithi134.stdout:2/83: fsync f16 0 2023-12-05T09:26:07.884 INFO:tasks.workunit.client.1.smithi134.stdout:7/43: mkdir d2/d7/d10 0 2023-12-05T09:26:07.887 INFO:tasks.workunit.client.1.smithi134.stdout:5/58: link d0/dd/f10 d0/d11/f15 0 2023-12-05T09:26:07.888 INFO:tasks.workunit.client.1.smithi134.stdout:4/71: mkdir d16/d18/d1b 0 2023-12-05T09:26:07.888 INFO:tasks.workunit.client.1.smithi134.stdout:2/84: dread f17 [0,4194304] 0 2023-12-05T09:26:07.889 INFO:tasks.workunit.client.1.smithi134.stdout:9/37: mkdir d7/d10 0 2023-12-05T09:26:07.889 INFO:tasks.workunit.client.1.smithi134.stdout:9/38: stat d7/d8/fe 0 2023-12-05T09:26:07.891 INFO:tasks.workunit.client.1.smithi134.stdout:1/63: rmdir d2/d9 39 2023-12-05T09:26:07.892 INFO:tasks.workunit.client.1.smithi134.stdout:8/62: dread f3 [0,4194304] 0 2023-12-05T09:26:07.897 INFO:tasks.workunit.client.0.smithi067.stdout:2/20: getdents d0 0 2023-12-05T09:26:07.897 INFO:tasks.workunit.client.1.smithi134.stdout:8/63: creat da/de/f10 x:0 0 0 2023-12-05T09:26:07.899 INFO:tasks.workunit.client.0.smithi067.stdout:9/130: dwrite d1b/d25/f2c [0,4194304] 0 2023-12-05T09:26:07.899 INFO:tasks.workunit.client.0.smithi067.stdout:9/131: write f19 [792312,120451] 0 2023-12-05T09:26:07.899 INFO:tasks.workunit.client.0.smithi067.stdout:9/132: chown c12 1 1 2023-12-05T09:26:07.903 INFO:tasks.workunit.client.0.smithi067.stdout:7/91: mkdir d0/d9/d10/d22 0 2023-12-05T09:26:07.906 INFO:tasks.workunit.client.0.smithi067.stdout:2/21: link d0/c5 d0/c7 0 2023-12-05T09:26:07.906 INFO:tasks.workunit.client.0.smithi067.stdout:2/22: write d0/f4 [22951,66316] 0 2023-12-05T09:26:07.906 INFO:tasks.workunit.client.0.smithi067.stdout:2/23: chown d0/f3 5561494 1 2023-12-05T09:26:07.907 INFO:tasks.workunit.client.1.smithi134.stdout:6/49: read d4/ff [2832132,48364] 0 2023-12-05T09:26:07.907 INFO:tasks.workunit.client.1.smithi134.stdout:3/47: sync 2023-12-05T09:26:07.908 INFO:tasks.workunit.client.1.smithi134.stdout:7/44: write f1 [2534855,88253] 0 2023-12-05T09:26:07.909 INFO:tasks.workunit.client.1.smithi134.stdout:0/64: dwrite fe [0,4194304] 0 2023-12-05T09:26:07.910 INFO:tasks.workunit.client.1.smithi134.stdout:6/50: symlink d4/d8/l11 0 2023-12-05T09:26:07.910 INFO:tasks.workunit.client.1.smithi134.stdout:6/51: stat d4/d8/da 0 2023-12-05T09:26:07.913 INFO:tasks.workunit.client.0.smithi067.stdout:7/92: unlink d0/f21 0 2023-12-05T09:26:07.913 INFO:tasks.workunit.client.0.smithi067.stdout:7/93: write d0/f11 [2033682,103914] 0 2023-12-05T09:26:07.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/64: dread d2/f19 [0,4194304] 0 2023-12-05T09:26:07.915 INFO:tasks.workunit.client.0.smithi067.stdout:2/24: mknod d0/c8 0 2023-12-05T09:26:07.915 INFO:tasks.workunit.client.0.smithi067.stdout:2/25: chown d0/c5 510677471 1 2023-12-05T09:26:07.915 INFO:tasks.workunit.client.0.smithi067.stdout:2/26: truncate d0/f3 4224753 0 2023-12-05T09:26:07.916 INFO:tasks.workunit.client.1.smithi134.stdout:7/45: symlink d2/dd/l11 0 2023-12-05T09:26:07.918 INFO:tasks.workunit.client.0.smithi067.stdout:7/94: symlink d0/d9/l23 0 2023-12-05T09:26:07.920 INFO:tasks.workunit.client.1.smithi134.stdout:0/65: symlink lf 0 2023-12-05T09:26:07.923 INFO:tasks.workunit.client.1.smithi134.stdout:6/52: creat d4/db/f12 x:0 0 0 2023-12-05T09:26:07.923 INFO:tasks.workunit.client.1.smithi134.stdout:6/53: write d4/db/f12 [618312,73749] 0 2023-12-05T09:26:07.923 INFO:tasks.workunit.client.1.smithi134.stdout:6/54: stat d4/ff 0 2023-12-05T09:26:07.927 INFO:tasks.workunit.client.0.smithi067.stdout:2/27: creat d0/f9 x:0 0 0 2023-12-05T09:26:07.927 INFO:tasks.workunit.client.0.smithi067.stdout:2/28: stat d0/f3 0 2023-12-05T09:26:07.927 INFO:tasks.workunit.client.1.smithi134.stdout:1/65: getdents d2/d9/d10 0 2023-12-05T09:26:07.928 INFO:tasks.workunit.client.0.smithi067.stdout:7/95: symlink d0/d9/d10/d1d/l24 0 2023-12-05T09:26:07.932 INFO:tasks.workunit.client.1.smithi134.stdout:6/55: symlink d4/d8/da/l13 0 2023-12-05T09:26:07.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/48: rmdir d4/d5 39 2023-12-05T09:26:07.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/49: truncate d4/d5/fe 999754 0 2023-12-05T09:26:07.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/50: dread - d4/f12 zero size 2023-12-05T09:26:07.932 INFO:tasks.workunit.client.1.smithi134.stdout:0/66: dread f7 [0,4194304] 0 2023-12-05T09:26:07.934 INFO:tasks.workunit.client.0.smithi067.stdout:2/29: mknod d0/ca 0 2023-12-05T09:26:07.942 INFO:tasks.workunit.client.1.smithi134.stdout:0/67: mknod c10 0 2023-12-05T09:26:07.942 INFO:tasks.workunit.client.1.smithi134.stdout:0/68: stat f3 0 2023-12-05T09:26:07.942 INFO:tasks.workunit.client.1.smithi134.stdout:0/69: write f7 [3505452,70695] 0 2023-12-05T09:26:07.942 INFO:tasks.workunit.client.1.smithi134.stdout:0/70: chown lf 25719303 1 2023-12-05T09:26:07.943 INFO:tasks.workunit.client.1.smithi134.stdout:8/64: dread f7 [0,4194304] 0 2023-12-05T09:26:07.945 INFO:tasks.workunit.client.0.smithi067.stdout:7/96: rename d0/la to d0/d9/d10/d22/l25 0 2023-12-05T09:26:07.945 INFO:tasks.workunit.client.0.smithi067.stdout:0/62: dwrite d3/d7/fc [0,4194304] 0 2023-12-05T09:26:07.948 INFO:tasks.workunit.client.1.smithi134.stdout:0/71: mknod c11 0 2023-12-05T09:26:07.959 INFO:tasks.workunit.client.1.smithi134.stdout:8/65: unlink da/de/lf 0 2023-12-05T09:26:07.970 INFO:tasks.workunit.client.1.smithi134.stdout:8/66: mkdir da/de/d11 0 2023-12-05T09:26:07.975 INFO:tasks.workunit.client.1.smithi134.stdout:8/67: rename da/de/f10 to da/de/f12 0 2023-12-05T09:26:07.976 INFO:tasks.workunit.client.1.smithi134.stdout:8/68: symlink da/de/d11/l13 0 2023-12-05T09:26:07.980 INFO:tasks.workunit.client.1.smithi134.stdout:1/66: read d2/f4 [3069900,81484] 0 2023-12-05T09:26:07.980 INFO:tasks.workunit.client.1.smithi134.stdout:1/67: readlink d2/l15 0 2023-12-05T09:26:07.985 INFO:tasks.workunit.client.1.smithi134.stdout:9/39: dwrite d7/d8/fc [0,4194304] 0 2023-12-05T09:26:07.985 INFO:tasks.workunit.client.1.smithi134.stdout:9/40: chown f1 39175714 1 2023-12-05T09:26:07.989 INFO:tasks.workunit.client.0.smithi067.stdout:2/30: rmdir d0 39 2023-12-05T09:26:08.002 INFO:tasks.workunit.client.1.smithi134.stdout:5/59: dwrite d0/fc [0,4194304] 0 2023-12-05T09:26:08.002 INFO:tasks.workunit.client.1.smithi134.stdout:5/60: chown d0/dd 24713887 1 2023-12-05T09:26:08.008 INFO:tasks.workunit.client.1.smithi134.stdout:1/68: dread d2/f6 [0,4194304] 0 2023-12-05T09:26:08.012 INFO:tasks.workunit.client.0.smithi067.stdout:2/31: write d0/f3 [858526,4372] 0 2023-12-05T09:26:08.012 INFO:tasks.workunit.client.0.smithi067.stdout:2/32: write d0/f3 [4269678,33263] 0 2023-12-05T09:26:08.013 INFO:tasks.workunit.client.0.smithi067.stdout:2/33: write d0/f4 [683054,81939] 0 2023-12-05T09:26:08.015 INFO:tasks.workunit.client.1.smithi134.stdout:4/72: dwrite ff [0,4194304] 0 2023-12-05T09:26:08.018 INFO:tasks.workunit.client.0.smithi067.stdout:0/63: write d3/f4 [294752,51575] 0 2023-12-05T09:26:08.025 INFO:tasks.workunit.client.1.smithi134.stdout:2/85: dwrite f13 [0,4194304] 0 2023-12-05T09:26:08.027 INFO:tasks.workunit.client.1.smithi134.stdout:2/86: mknod d19/c1c 0 2023-12-05T09:26:08.029 INFO:tasks.workunit.client.1.smithi134.stdout:2/87: creat d19/f1d x:0 0 0 2023-12-05T09:26:08.031 INFO:tasks.workunit.client.1.smithi134.stdout:2/88: rename fe to d19/f1e 0 2023-12-05T09:26:08.035 INFO:tasks.workunit.client.1.smithi134.stdout:6/56: dwrite d4/d8/fe [0,4194304] 0 2023-12-05T09:26:08.036 INFO:tasks.workunit.client.0.smithi067.stdout:9/133: dwrite d1b/d25/f26 [0,4194304] 0 2023-12-05T09:26:08.038 INFO:tasks.workunit.client.0.smithi067.stdout:9/134: rename d1b/c27 to d1b/c2e 0 2023-12-05T09:26:08.039 INFO:tasks.workunit.client.0.smithi067.stdout:0/64: dread d3/fb [0,4194304] 0 2023-12-05T09:26:08.039 INFO:tasks.workunit.client.0.smithi067.stdout:0/65: fdatasync d3/d7/fc 0 2023-12-05T09:26:08.039 INFO:tasks.workunit.client.0.smithi067.stdout:0/66: fsync d3/d7/f8 0 2023-12-05T09:26:08.039 INFO:tasks.workunit.client.1.smithi134.stdout:7/46: dwrite f1 [0,4194304] 0 2023-12-05T09:26:08.040 INFO:tasks.workunit.client.1.smithi134.stdout:8/69: dwrite f0 [0,4194304] 0 2023-12-05T09:26:08.040 INFO:tasks.workunit.client.0.smithi067.stdout:9/135: stat d1b/d25/f2d 0 2023-12-05T09:26:08.040 INFO:tasks.workunit.client.0.smithi067.stdout:9/136: stat f10 0 2023-12-05T09:26:08.041 INFO:tasks.workunit.client.0.smithi067.stdout:8/74: dwrite d5/f16 [0,4194304] 0 2023-12-05T09:26:08.041 INFO:tasks.workunit.client.0.smithi067.stdout:0/67: mkdir d3/df/d10 0 2023-12-05T09:26:08.041 INFO:tasks.workunit.client.0.smithi067.stdout:0/68: chown d3 205427 1 2023-12-05T09:26:08.043 INFO:tasks.workunit.client.0.smithi067.stdout:9/137: mknod d1b/c2f 0 2023-12-05T09:26:08.047 INFO:tasks.workunit.client.0.smithi067.stdout:8/75: mkdir d5/dc/d1a 0 2023-12-05T09:26:08.047 INFO:tasks.workunit.client.0.smithi067.stdout:0/69: mknod d3/c11 0 2023-12-05T09:26:08.048 INFO:tasks.workunit.client.1.smithi134.stdout:6/57: link d4/d8/da/l13 d4/d8/da/l14 0 2023-12-05T09:26:08.048 INFO:tasks.workunit.client.1.smithi134.stdout:6/58: write d4/ff [511227,54538] 0 2023-12-05T09:26:08.048 INFO:tasks.workunit.client.1.smithi134.stdout:4/73: dread f0 [0,4194304] 0 2023-12-05T09:26:08.048 INFO:tasks.workunit.client.1.smithi134.stdout:3/51: dwrite f1 [0,4194304] 0 2023-12-05T09:26:08.048 INFO:tasks.workunit.client.1.smithi134.stdout:3/52: write d4/d5/f10 [282981,122843] 0 2023-12-05T09:26:08.048 INFO:tasks.workunit.client.1.smithi134.stdout:3/53: chown d4/d5/f11 196381 1 2023-12-05T09:26:08.048 INFO:tasks.workunit.client.1.smithi134.stdout:3/54: fsync d4/d5/f11 0 2023-12-05T09:26:08.058 INFO:tasks.workunit.client.0.smithi067.stdout:2/34: dread d0/f3 [0,4194304] 0 2023-12-05T09:26:08.059 INFO:tasks.workunit.client.0.smithi067.stdout:2/35: fdatasync d0/f3 0 2023-12-05T09:26:08.059 INFO:tasks.workunit.client.0.smithi067.stdout:8/76: dread d5/da/f17 [0,4194304] 0 2023-12-05T09:26:08.061 INFO:tasks.workunit.client.1.smithi134.stdout:9/41: truncate d7/d8/fc 3759775 0 2023-12-05T09:26:08.062 INFO:tasks.workunit.client.0.smithi067.stdout:2/36: symlink d0/lb 0 2023-12-05T09:26:08.062 INFO:tasks.workunit.client.0.smithi067.stdout:8/77: rename d5/dc/ld to d5/dc/l1b 0 2023-12-05T09:26:08.062 INFO:tasks.workunit.client.0.smithi067.stdout:8/78: chown c3 506783 1 2023-12-05T09:26:08.062 INFO:tasks.workunit.client.0.smithi067.stdout:8/79: readlink d5/dc/l1b 0 2023-12-05T09:26:08.062 INFO:tasks.workunit.client.0.smithi067.stdout:8/80: fdatasync d5/da/f17 0 2023-12-05T09:26:08.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/70: unlink f0 0 2023-12-05T09:26:08.065 INFO:tasks.workunit.client.1.smithi134.stdout:3/55: rename d4/d5/ca to d4/d5/c14 0 2023-12-05T09:26:08.066 INFO:tasks.workunit.client.1.smithi134.stdout:0/72: dwrite f8 [0,4194304] 0 2023-12-05T09:26:08.070 INFO:tasks.workunit.client.1.smithi134.stdout:9/42: mknod d7/d8/c11 0 2023-12-05T09:26:08.070 INFO:tasks.workunit.client.1.smithi134.stdout:9/43: write d7/fb [229716,21581] 0 2023-12-05T09:26:08.070 INFO:tasks.workunit.client.1.smithi134.stdout:8/71: mkdir da/de/d11/d14 0 2023-12-05T09:26:08.071 INFO:tasks.workunit.client.1.smithi134.stdout:3/56: mknod d4/c15 0 2023-12-05T09:26:08.071 INFO:tasks.workunit.client.1.smithi134.stdout:3/57: creat d4/f16 x:0 0 0 2023-12-05T09:26:08.071 INFO:tasks.workunit.client.1.smithi134.stdout:3/58: readlink d4/lf 0 2023-12-05T09:26:08.071 INFO:tasks.workunit.client.1.smithi134.stdout:3/59: creat d4/f17 x:0 0 0 2023-12-05T09:26:08.071 INFO:tasks.workunit.client.1.smithi134.stdout:3/60: creat d4/f18 x:0 0 0 2023-12-05T09:26:08.072 INFO:tasks.workunit.client.0.smithi067.stdout:2/37: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:08.073 INFO:tasks.workunit.client.1.smithi134.stdout:9/44: getdents d7 0 2023-12-05T09:26:08.075 INFO:tasks.workunit.client.0.smithi067.stdout:0/70: dread d3/d7/fc [0,4194304] 0 2023-12-05T09:26:08.076 INFO:tasks.workunit.client.0.smithi067.stdout:0/71: stat d3 0 2023-12-05T09:26:08.076 INFO:tasks.workunit.client.1.smithi134.stdout:2/89: dwrite f15 [0,4194304] 0 2023-12-05T09:26:08.077 INFO:tasks.workunit.client.1.smithi134.stdout:4/74: read f5 [2152447,38544] 0 2023-12-05T09:26:08.082 INFO:tasks.workunit.client.1.smithi134.stdout:9/45: symlink d7/d10/l12 0 2023-12-05T09:26:08.083 INFO:tasks.workunit.client.1.smithi134.stdout:3/61: rmdir d4/d5 39 2023-12-05T09:26:08.083 INFO:tasks.workunit.client.1.smithi134.stdout:5/61: dwrite d0/d11/f15 [4194304,4194304] 0 2023-12-05T09:26:08.083 INFO:tasks.workunit.client.1.smithi134.stdout:5/62: chown d0/f2 944124 1 2023-12-05T09:26:08.088 INFO:tasks.workunit.client.0.smithi067.stdout:9/138: dread d1b/d25/f2d [0,4194304] 0 2023-12-05T09:26:08.092 INFO:tasks.workunit.client.1.smithi134.stdout:0/73: dread fe [0,4194304] 0 2023-12-05T09:26:08.093 INFO:tasks.workunit.client.0.smithi067.stdout:0/72: unlink d3/f6 0 2023-12-05T09:26:08.093 INFO:tasks.workunit.client.1.smithi134.stdout:2/90: link d19/l1b d19/l1f 0 2023-12-05T09:26:08.094 INFO:tasks.workunit.client.1.smithi134.stdout:4/75: mkdir d16/d18/d1c 0 2023-12-05T09:26:08.094 INFO:tasks.workunit.client.1.smithi134.stdout:8/72: dread da/de/fc [0,4194304] 0 2023-12-05T09:26:08.101 INFO:tasks.workunit.client.1.smithi134.stdout:5/63: rename d0/c9 to d0/c16 0 2023-12-05T09:26:08.101 INFO:tasks.workunit.client.1.smithi134.stdout:5/64: readlink d0/l13 0 2023-12-05T09:26:08.111 INFO:tasks.workunit.client.1.smithi134.stdout:0/74: symlink l12 0 2023-12-05T09:26:08.112 INFO:tasks.workunit.client.1.smithi134.stdout:1/69: dwrite d2/f17 [0,4194304] 0 2023-12-05T09:26:08.112 INFO:tasks.workunit.client.1.smithi134.stdout:4/76: symlink d16/d18/d1a/l1d 0 2023-12-05T09:26:08.113 INFO:tasks.workunit.client.0.smithi067.stdout:9/139: read f10 [1453830,23601] 0 2023-12-05T09:26:08.119 INFO:tasks.workunit.client.1.smithi134.stdout:8/73: creat da/de/d11/f15 x:0 0 0 2023-12-05T09:26:08.119 INFO:tasks.workunit.client.1.smithi134.stdout:8/74: readlink da/de/d11/l13 0 2023-12-05T09:26:08.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:08 smithi067 ceph-mon[107174]: pgmap v19: 65 pgs: 65 active+clean; 364 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 8.7 MiB/s rd, 22 MiB/s wr, 830 op/s 2023-12-05T09:26:08.126 INFO:tasks.workunit.client.0.smithi067.stdout:0/73: dread d3/d7/f8 [0,4194304] 0 2023-12-05T09:26:08.126 INFO:tasks.workunit.client.0.smithi067.stdout:2/38: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:08.126 INFO:tasks.workunit.client.0.smithi067.stdout:2/39: write d0/f4 [884722,4337] 0 2023-12-05T09:26:08.129 INFO:tasks.workunit.client.0.smithi067.stdout:0/74: link d3/fa d3/d7/f12 0 2023-12-05T09:26:08.129 INFO:tasks.workunit.client.0.smithi067.stdout:0/75: creat d3/d7/f13 x:0 0 0 2023-12-05T09:26:08.131 INFO:tasks.workunit.client.0.smithi067.stdout:2/40: rmdir d0 39 2023-12-05T09:26:08.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/41: dread - d0/f9 zero size 2023-12-05T09:26:08.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/42: readlink d0/lb 0 2023-12-05T09:26:08.132 INFO:tasks.workunit.client.0.smithi067.stdout:2/43: truncate d0/f9 126232 0 2023-12-05T09:26:08.133 INFO:tasks.workunit.client.1.smithi134.stdout:7/47: truncate f1 1645150 0 2023-12-05T09:26:08.134 INFO:tasks.workunit.client.0.smithi067.stdout:2/44: symlink d0/lc 0 2023-12-05T09:26:08.134 INFO:tasks.workunit.client.1.smithi134.stdout:2/91: dread fa [0,4194304] 0 2023-12-05T09:26:08.134 INFO:tasks.workunit.client.1.smithi134.stdout:2/92: creat d19/f20 x:0 0 0 2023-12-05T09:26:08.134 INFO:tasks.workunit.client.1.smithi134.stdout:2/93: fdatasync f5 0 2023-12-05T09:26:08.135 INFO:tasks.workunit.client.1.smithi134.stdout:2/94: fsync f5 0 2023-12-05T09:26:08.139 INFO:tasks.workunit.client.1.smithi134.stdout:5/65: dwrite d0/dd/f14 [0,4194304] 0 2023-12-05T09:26:08.141 INFO:tasks.workunit.client.1.smithi134.stdout:5/66: creat d0/dd/f17 x:0 0 0 2023-12-05T09:26:08.142 INFO:tasks.workunit.client.1.smithi134.stdout:1/70: write d2/f17 [309860,31392] 0 2023-12-05T09:26:08.145 INFO:tasks.workunit.client.1.smithi134.stdout:0/75: mkdir d13 0 2023-12-05T09:26:08.151 INFO:tasks.workunit.client.0.smithi067.stdout:2/45: dread d0/f3 [0,4194304] 0 2023-12-05T09:26:08.151 INFO:tasks.workunit.client.0.smithi067.stdout:2/46: truncate d0/f4 911076 0 2023-12-05T09:26:08.151 INFO:tasks.workunit.client.0.smithi067.stdout:2/47: truncate d0/f3 4925037 0 2023-12-05T09:26:08.152 INFO:tasks.workunit.client.0.smithi067.stdout:2/48: write d0/f4 [871956,9317] 0 2023-12-05T09:26:08.155 INFO:tasks.workunit.client.0.smithi067.stdout:2/49: link d0/f4 d0/fd 0 2023-12-05T09:26:08.156 INFO:tasks.workunit.client.1.smithi134.stdout:4/77: truncate f5 2260181 0 2023-12-05T09:26:08.157 INFO:tasks.workunit.client.1.smithi134.stdout:3/62: dwrite d4/f16 [0,4194304] 0 2023-12-05T09:26:08.157 INFO:tasks.workunit.client.1.smithi134.stdout:3/63: creat d4/f19 x:0 0 0 2023-12-05T09:26:08.157 INFO:tasks.workunit.client.0.smithi067.stdout:2/50: creat d0/fe x:0 0 0 2023-12-05T09:26:08.159 INFO:tasks.workunit.client.0.smithi067.stdout:8/81: dwrite d5/f10 [4194304,4194304] 0 2023-12-05T09:26:08.159 INFO:tasks.workunit.client.0.smithi067.stdout:8/82: stat d5/l6 0 2023-12-05T09:26:08.159 INFO:tasks.workunit.client.0.smithi067.stdout:2/51: write d0/f4 [1422128,49522] 0 2023-12-05T09:26:08.163 INFO:tasks.workunit.client.0.smithi067.stdout:2/52: mkdir d0/df 0 2023-12-05T09:26:08.163 INFO:tasks.workunit.client.1.smithi134.stdout:4/78: dread f13 [0,4194304] 0 2023-12-05T09:26:08.163 INFO:tasks.workunit.client.1.smithi134.stdout:8/75: rename da/de/d11/d14 to da/de/d16 0 2023-12-05T09:26:08.166 INFO:tasks.workunit.client.1.smithi134.stdout:1/71: dread d2/f4 [0,4194304] 0 2023-12-05T09:26:08.168 INFO:tasks.workunit.client.0.smithi067.stdout:2/53: mkdir d0/d10 0 2023-12-05T09:26:08.169 INFO:tasks.workunit.client.1.smithi134.stdout:7/48: creat d2/dd/f12 x:0 0 0 2023-12-05T09:26:08.169 INFO:tasks.workunit.client.0.smithi067.stdout:2/54: link d0/lc d0/l11 0 2023-12-05T09:26:08.171 INFO:tasks.workunit.client.0.smithi067.stdout:2/55: write d0/f4 [2031533,89548] 0 2023-12-05T09:26:08.171 INFO:tasks.workunit.client.1.smithi134.stdout:9/46: dwrite d7/fb [0,4194304] 0 2023-12-05T09:26:08.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/72: dread d2/f5 [0,4194304] 0 2023-12-05T09:26:08.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/73: chown d2/ld 11 1 2023-12-05T09:26:08.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/74: dread - d2/d9/d10/f13 zero size 2023-12-05T09:26:08.177 INFO:tasks.workunit.client.1.smithi134.stdout:1/75: chown d2/d9/lc 0 1 2023-12-05T09:26:08.177 INFO:tasks.workunit.client.0.smithi067.stdout:0/76: dwrite d3/fa [0,4194304] 0 2023-12-05T09:26:08.177 INFO:tasks.workunit.client.0.smithi067.stdout:0/77: readlink d3/d7/le 0 2023-12-05T09:26:08.177 INFO:tasks.workunit.client.0.smithi067.stdout:0/78: mknod d3/df/d10/c14 0 2023-12-05T09:26:08.179 INFO:tasks.workunit.client.0.smithi067.stdout:0/79: mknod d3/df/d10/c15 0 2023-12-05T09:26:08.184 INFO:tasks.workunit.client.1.smithi134.stdout:5/67: mknod d0/c18 0 2023-12-05T09:26:08.184 INFO:tasks.workunit.client.1.smithi134.stdout:0/76: mkdir d13/d14 0 2023-12-05T09:26:08.186 INFO:tasks.workunit.client.0.smithi067.stdout:8/83: rmdir d5 39 2023-12-05T09:26:08.187 INFO:tasks.workunit.client.0.smithi067.stdout:8/84: chown d5/da 59 1 2023-12-05T09:26:08.193 INFO:tasks.workunit.client.1.smithi134.stdout:3/64: creat d4/d5/f1a x:0 0 0 2023-12-05T09:26:08.193 INFO:tasks.workunit.client.1.smithi134.stdout:3/65: stat d4/lf 0 2023-12-05T09:26:08.194 INFO:tasks.workunit.client.1.smithi134.stdout:0/77: write fe [148277,89810] 0 2023-12-05T09:26:08.194 INFO:tasks.workunit.client.1.smithi134.stdout:0/78: fsync fc 0 2023-12-05T09:26:08.194 INFO:tasks.workunit.client.1.smithi134.stdout:0/79: write fe [3728639,107657] 0 2023-12-05T09:26:08.199 INFO:tasks.workunit.client.1.smithi134.stdout:9/47: truncate f3 50824 0 2023-12-05T09:26:08.199 INFO:tasks.workunit.client.1.smithi134.stdout:9/48: fdatasync f3 0 2023-12-05T09:26:08.202 INFO:tasks.workunit.client.1.smithi134.stdout:5/68: rename d0/dd/f10 to d0/f19 0 2023-12-05T09:26:08.202 INFO:tasks.workunit.client.1.smithi134.stdout:1/76: dread d2/f6 [0,4194304] 0 2023-12-05T09:26:08.205 INFO:tasks.workunit.client.0.smithi067.stdout:0/80: dread d3/d7/f12 [0,4194304] 0 2023-12-05T09:26:08.208 INFO:tasks.workunit.client.0.smithi067.stdout:0/81: creat d3/df/f16 x:0 0 0 2023-12-05T09:26:08.209 INFO:tasks.workunit.client.1.smithi134.stdout:8/76: mknod da/de/c17 0 2023-12-05T09:26:08.209 INFO:tasks.workunit.client.1.smithi134.stdout:0/80: mkdir d13/d14/d15 0 2023-12-05T09:26:08.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/49: dread d2/f8 [0,4194304] 0 2023-12-05T09:26:08.210 INFO:tasks.workunit.client.1.smithi134.stdout:1/77: creat d2/d9/f1b x:0 0 0 2023-12-05T09:26:08.223 INFO:tasks.workunit.client.1.smithi134.stdout:4/79: unlink fa 0 2023-12-05T09:26:08.223 INFO:tasks.workunit.client.1.smithi134.stdout:8/77: truncate da/de/fc 911955 0 2023-12-05T09:26:08.225 INFO:tasks.workunit.client.1.smithi134.stdout:7/50: rmdir d2 39 2023-12-05T09:26:08.227 INFO:tasks.workunit.client.1.smithi134.stdout:4/80: link l9 d16/d18/d1c/l1e 0 2023-12-05T09:26:08.229 INFO:tasks.workunit.client.1.smithi134.stdout:8/78: mknod da/c18 0 2023-12-05T09:26:08.229 INFO:tasks.workunit.client.1.smithi134.stdout:8/79: chown da/de/c17 275599 1 2023-12-05T09:26:08.229 INFO:tasks.workunit.client.1.smithi134.stdout:8/80: readlink da/de/d11/l13 0 2023-12-05T09:26:08.229 INFO:tasks.workunit.client.1.smithi134.stdout:7/51: creat d2/d7/f13 x:0 0 0 2023-12-05T09:26:08.229 INFO:tasks.workunit.client.1.smithi134.stdout:7/52: readlink d2/dd/l11 0 2023-12-05T09:26:08.232 INFO:tasks.workunit.client.0.smithi067.stdout:0/82: fsync d3/df/f16 0 2023-12-05T09:26:08.233 INFO:tasks.workunit.client.0.smithi067.stdout:0/83: mknod d3/d7/c17 0 2023-12-05T09:26:08.233 INFO:tasks.workunit.client.0.smithi067.stdout:0/84: fsync d3/d7/f13 0 2023-12-05T09:26:08.233 INFO:tasks.workunit.client.0.smithi067.stdout:0/85: write d3/fb [5109556,26942] 0 2023-12-05T09:26:08.236 INFO:tasks.workunit.client.0.smithi067.stdout:0/86: creat d3/df/f18 x:0 0 0 2023-12-05T09:26:08.241 INFO:tasks.workunit.client.1.smithi134.stdout:8/81: link da/de/f12 da/de/d11/f19 0 2023-12-05T09:26:08.241 INFO:tasks.workunit.client.1.smithi134.stdout:8/82: write da/de/d11/f19 [679169,58121] 0 2023-12-05T09:26:08.242 INFO:tasks.workunit.client.0.smithi067.stdout:9/140: dwrite f19 [0,4194304] 0 2023-12-05T09:26:08.244 INFO:tasks.workunit.client.1.smithi134.stdout:7/53: creat d2/df/f14 x:0 0 0 2023-12-05T09:26:08.245 INFO:tasks.workunit.client.1.smithi134.stdout:7/54: creat d2/df/f15 x:0 0 0 2023-12-05T09:26:08.245 INFO:tasks.workunit.client.1.smithi134.stdout:7/55: dread - d2/d7/f13 zero size 2023-12-05T09:26:08.245 INFO:tasks.workunit.client.1.smithi134.stdout:7/56: chown d2/df 125 1 2023-12-05T09:26:08.247 INFO:tasks.workunit.client.1.smithi134.stdout:8/83: truncate f9 653364 0 2023-12-05T09:26:08.252 INFO:tasks.workunit.client.1.smithi134.stdout:3/66: rmdir d4 39 2023-12-05T09:26:08.252 INFO:tasks.workunit.client.1.smithi134.stdout:3/67: fdatasync d4/f16 0 2023-12-05T09:26:08.255 INFO:tasks.workunit.client.1.smithi134.stdout:8/84: stat f7 0 2023-12-05T09:26:08.255 INFO:tasks.workunit.client.1.smithi134.stdout:8/85: chown da/c18 55665 1 2023-12-05T09:26:08.255 INFO:tasks.workunit.client.1.smithi134.stdout:8/86: creat da/de/d11/f1a x:0 0 0 2023-12-05T09:26:08.256 INFO:tasks.workunit.client.1.smithi134.stdout:3/68: rmdir d4 39 2023-12-05T09:26:08.260 INFO:tasks.workunit.client.1.smithi134.stdout:3/69: creat d4/f1b x:0 0 0 2023-12-05T09:26:08.261 INFO:tasks.workunit.client.1.smithi134.stdout:7/57: dread f1 [0,4194304] 0 2023-12-05T09:26:08.261 INFO:tasks.workunit.client.1.smithi134.stdout:7/58: write f1 [1941578,93556] 0 2023-12-05T09:26:08.263 INFO:tasks.workunit.client.1.smithi134.stdout:7/59: mkdir d2/df/d16 0 2023-12-05T09:26:08.263 INFO:tasks.workunit.client.1.smithi134.stdout:7/60: fdatasync d2/dd/f12 0 2023-12-05T09:26:08.270 INFO:tasks.workunit.client.1.smithi134.stdout:7/61: mkdir d2/df/d17 0 2023-12-05T09:26:08.270 INFO:tasks.workunit.client.1.smithi134.stdout:7/62: fdatasync d2/d7/f13 0 2023-12-05T09:26:08.271 INFO:tasks.workunit.client.0.smithi067.stdout:9/141: write d1b/d25/f2c [1726989,23738] 0 2023-12-05T09:26:08.271 INFO:tasks.workunit.client.0.smithi067.stdout:9/142: readlink d1b/d25/l29 0 2023-12-05T09:26:08.271 INFO:tasks.workunit.client.0.smithi067.stdout:9/143: stat f7 0 2023-12-05T09:26:08.271 INFO:tasks.workunit.client.0.smithi067.stdout:9/144: creat d1b/f30 x:0 0 0 2023-12-05T09:26:08.271 INFO:tasks.workunit.client.0.smithi067.stdout:9/145: creat d1b/f31 x:0 0 0 2023-12-05T09:26:08.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/63: write f1 [436943,101781] 0 2023-12-05T09:26:08.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/64: chown d2/d7/d10 58824346 1 2023-12-05T09:26:08.271 INFO:tasks.workunit.client.1.smithi134.stdout:6/59: sync 2023-12-05T09:26:08.272 INFO:tasks.workunit.client.1.smithi134.stdout:2/95: sync 2023-12-05T09:26:08.272 INFO:tasks.workunit.client.1.smithi134.stdout:6/60: fdatasync d4/ff 0 2023-12-05T09:26:08.272 INFO:tasks.workunit.client.1.smithi134.stdout:6/61: unlink d4/c6 0 2023-12-05T09:26:08.272 INFO:tasks.workunit.client.1.smithi134.stdout:6/62: chown d4/d8 6 1 2023-12-05T09:26:08.273 INFO:tasks.workunit.client.1.smithi134.stdout:2/96: symlink d19/l21 0 2023-12-05T09:26:08.274 INFO:tasks.workunit.client.1.smithi134.stdout:1/78: dwrite d2/d9/f1b [0,4194304] 0 2023-12-05T09:26:08.274 INFO:tasks.workunit.client.1.smithi134.stdout:6/63: rmdir d4/d8/da 39 2023-12-05T09:26:08.274 INFO:tasks.workunit.client.1.smithi134.stdout:6/64: fsync f0 0 2023-12-05T09:26:08.275 INFO:tasks.workunit.client.1.smithi134.stdout:6/65: creat d4/d8/f15 x:0 0 0 2023-12-05T09:26:08.275 INFO:tasks.workunit.client.1.smithi134.stdout:3/70: read f1 [400284,64643] 0 2023-12-05T09:26:08.275 INFO:tasks.workunit.client.1.smithi134.stdout:3/71: chown d4/f17 3 1 2023-12-05T09:26:08.275 INFO:tasks.workunit.client.1.smithi134.stdout:5/69: dwrite d0/d11/f15 [4194304,4194304] 0 2023-12-05T09:26:08.277 INFO:tasks.workunit.client.1.smithi134.stdout:4/81: dwrite f13 [0,4194304] 0 2023-12-05T09:26:08.280 INFO:tasks.workunit.client.1.smithi134.stdout:1/79: mknod d2/d9/c1c 0 2023-12-05T09:26:08.280 INFO:tasks.workunit.client.1.smithi134.stdout:3/72: symlink d4/d5/l1c 0 2023-12-05T09:26:08.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/73: chown f0 0 1 2023-12-05T09:26:08.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/74: write d4/f13 [303389,123248] 0 2023-12-05T09:26:08.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/75: creat d4/f1d x:0 0 0 2023-12-05T09:26:08.286 INFO:tasks.workunit.client.1.smithi134.stdout:4/82: symlink d16/d18/d1c/l1f 0 2023-12-05T09:26:08.290 INFO:tasks.workunit.client.1.smithi134.stdout:3/76: rename f1 to d4/d5/f1e 0 2023-12-05T09:26:08.294 INFO:tasks.workunit.client.1.smithi134.stdout:3/77: mkdir d4/d1f 0 2023-12-05T09:26:08.294 INFO:tasks.workunit.client.1.smithi134.stdout:3/78: write d4/f1b [774557,28814] 0 2023-12-05T09:26:08.297 INFO:tasks.workunit.client.1.smithi134.stdout:8/87: truncate f9 398519 0 2023-12-05T09:26:08.303 INFO:tasks.workunit.client.0.smithi067.stdout:2/56: dwrite d0/f9 [0,4194304] 0 2023-12-05T09:26:08.304 INFO:tasks.workunit.client.1.smithi134.stdout:6/66: dread d4/fd [0,4194304] 0 2023-12-05T09:26:08.304 INFO:tasks.workunit.client.1.smithi134.stdout:6/67: chown f0 18975 1 2023-12-05T09:26:08.308 INFO:tasks.workunit.client.1.smithi134.stdout:8/88: mkdir da/d1b 0 2023-12-05T09:26:08.311 INFO:tasks.workunit.client.1.smithi134.stdout:8/89: unlink da/de/c17 0 2023-12-05T09:26:08.311 INFO:tasks.workunit.client.1.smithi134.stdout:8/90: chown da/de/d11/l13 323 1 2023-12-05T09:26:08.311 INFO:tasks.workunit.client.1.smithi134.stdout:8/91: stat da/d1b 0 2023-12-05T09:26:08.311 INFO:tasks.workunit.client.1.smithi134.stdout:8/92: creat da/de/f1c x:0 0 0 2023-12-05T09:26:08.311 INFO:tasks.workunit.client.1.smithi134.stdout:6/68: dread f0 [0,4194304] 0 2023-12-05T09:26:08.314 INFO:tasks.workunit.client.1.smithi134.stdout:8/93: mkdir da/de/d11/d1d 0 2023-12-05T09:26:08.314 INFO:tasks.workunit.client.1.smithi134.stdout:8/94: chown da/de/d11/f1a 3085 1 2023-12-05T09:26:08.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/69: link d4/d8/f15 d4/d8/f16 0 2023-12-05T09:26:08.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/70: truncate d4/db/f12 1547367 0 2023-12-05T09:26:08.319 INFO:tasks.workunit.client.1.smithi134.stdout:6/71: creat d4/f17 x:0 0 0 2023-12-05T09:26:08.320 INFO:tasks.workunit.client.1.smithi134.stdout:8/95: rename da/fd to da/d1b/f1e 0 2023-12-05T09:26:08.325 INFO:tasks.workunit.client.0.smithi067.stdout:2/57: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:08.328 INFO:tasks.workunit.client.0.smithi067.stdout:2/58: rmdir d0/df 0 2023-12-05T09:26:08.328 INFO:tasks.workunit.client.0.smithi067.stdout:2/59: readlink d0/lb 0 2023-12-05T09:26:08.328 INFO:tasks.workunit.client.0.smithi067.stdout:2/60: stat d0/c8 0 2023-12-05T09:26:08.328 INFO:tasks.workunit.client.0.smithi067.stdout:2/61: fdatasync d0/fe 0 2023-12-05T09:26:08.329 INFO:tasks.workunit.client.1.smithi134.stdout:6/72: rename d4/d8/f15 to d4/db/f18 0 2023-12-05T09:26:08.332 INFO:tasks.workunit.client.0.smithi067.stdout:2/62: mknod d0/d10/c12 0 2023-12-05T09:26:08.332 INFO:tasks.workunit.client.1.smithi134.stdout:1/80: dwrite d2/d9/f1b [0,4194304] 0 2023-12-05T09:26:08.333 INFO:tasks.workunit.client.0.smithi067.stdout:2/63: mknod d0/d10/c13 0 2023-12-05T09:26:08.335 INFO:tasks.workunit.client.0.smithi067.stdout:9/146: dread f19 [0,4194304] 0 2023-12-05T09:26:08.335 INFO:tasks.workunit.client.0.smithi067.stdout:2/64: rename d0/c7 to d0/c14 0 2023-12-05T09:26:08.339 INFO:tasks.workunit.client.0.smithi067.stdout:2/65: mkdir d0/d15 0 2023-12-05T09:26:08.339 INFO:tasks.workunit.client.0.smithi067.stdout:0/87: dwrite d3/df/f16 [0,4194304] 0 2023-12-05T09:26:08.342 INFO:tasks.workunit.client.1.smithi134.stdout:1/81: truncate d2/f17 180605 0 2023-12-05T09:26:08.343 INFO:tasks.workunit.client.1.smithi134.stdout:4/83: dread f5 [0,4194304] 0 2023-12-05T09:26:08.343 INFO:tasks.workunit.client.0.smithi067.stdout:2/66: creat d0/d10/f16 x:0 0 0 2023-12-05T09:26:08.344 INFO:tasks.workunit.client.1.smithi134.stdout:1/82: rmdir d2/d9/d10 39 2023-12-05T09:26:08.344 INFO:tasks.workunit.client.1.smithi134.stdout:1/83: chown d2/c1a 495862 1 2023-12-05T09:26:08.344 INFO:tasks.workunit.client.1.smithi134.stdout:1/84: chown d2/c14 122873 1 2023-12-05T09:26:08.345 INFO:tasks.workunit.client.1.smithi134.stdout:4/84: creat d16/d18/d1a/f20 x:0 0 0 2023-12-05T09:26:08.345 INFO:tasks.workunit.client.1.smithi134.stdout:4/85: fdatasync f13 0 2023-12-05T09:26:08.345 INFO:tasks.workunit.client.1.smithi134.stdout:4/86: stat d16/d18 0 2023-12-05T09:26:08.346 INFO:tasks.workunit.client.1.smithi134.stdout:4/87: mkdir d16/d21 0 2023-12-05T09:26:08.348 INFO:tasks.workunit.client.1.smithi134.stdout:2/97: dwrite fc [0,4194304] 0 2023-12-05T09:26:08.349 INFO:tasks.workunit.client.1.smithi134.stdout:7/65: dwrite d2/dd/f12 [0,4194304] 0 2023-12-05T09:26:08.352 INFO:tasks.workunit.client.1.smithi134.stdout:8/96: rmdir da/de 39 2023-12-05T09:26:08.353 INFO:tasks.workunit.client.0.smithi067.stdout:9/147: write f16 [2163239,89476] 0 2023-12-05T09:26:08.353 INFO:tasks.workunit.client.0.smithi067.stdout:9/148: chown f11 436 1 2023-12-05T09:26:08.355 INFO:tasks.workunit.client.0.smithi067.stdout:9/149: truncate fc 2006043 0 2023-12-05T09:26:08.355 INFO:tasks.workunit.client.0.smithi067.stdout:9/150: creat d1b/d25/f32 x:0 0 0 2023-12-05T09:26:08.355 INFO:tasks.workunit.client.0.smithi067.stdout:9/151: creat d1b/d25/f33 x:0 0 0 2023-12-05T09:26:08.355 INFO:tasks.workunit.client.0.smithi067.stdout:9/152: write d1b/d25/f33 [349255,739] 0 2023-12-05T09:26:08.356 INFO:tasks.workunit.client.0.smithi067.stdout:9/153: stat d1b/d25/f2c 0 2023-12-05T09:26:08.359 INFO:tasks.workunit.client.0.smithi067.stdout:9/154: symlink d1b/d25/l34 0 2023-12-05T09:26:08.363 INFO:tasks.workunit.client.1.smithi134.stdout:2/98: rename d19/c1c to d19/c22 0 2023-12-05T09:26:08.366 INFO:tasks.workunit.client.1.smithi134.stdout:7/66: rmdir d2/df/d16 0 2023-12-05T09:26:08.366 INFO:tasks.workunit.client.1.smithi134.stdout:7/67: truncate d2/df/f15 255698 0 2023-12-05T09:26:08.367 INFO:tasks.workunit.client.1.smithi134.stdout:5/70: dwrite d0/f19 [0,4194304] 0 2023-12-05T09:26:08.368 INFO:tasks.workunit.client.1.smithi134.stdout:6/73: unlink d4/db/f18 0 2023-12-05T09:26:08.368 INFO:tasks.workunit.client.1.smithi134.stdout:6/74: write d4/fd [105781,71758] 0 2023-12-05T09:26:08.368 INFO:tasks.workunit.client.1.smithi134.stdout:6/75: readlink d4/d8/da/l14 0 2023-12-05T09:26:08.371 INFO:tasks.workunit.client.1.smithi134.stdout:8/97: symlink da/de/d11/d1d/l1f 0 2023-12-05T09:26:08.374 INFO:tasks.workunit.client.1.smithi134.stdout:7/68: symlink d2/d7/l18 0 2023-12-05T09:26:08.374 INFO:tasks.workunit.client.1.smithi134.stdout:7/69: write d2/f8 [2054545,28046] 0 2023-12-05T09:26:08.374 INFO:tasks.workunit.client.1.smithi134.stdout:7/70: chown d2/d7/cb 12104141 1 2023-12-05T09:26:08.375 INFO:tasks.workunit.client.1.smithi134.stdout:6/76: dread d4/db/f12 [0,4194304] 0 2023-12-05T09:26:08.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:08 smithi134 ceph-mon[116304]: pgmap v19: 65 pgs: 65 active+clean; 364 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 8.7 MiB/s rd, 22 MiB/s wr, 830 op/s 2023-12-05T09:26:08.378 INFO:tasks.workunit.client.1.smithi134.stdout:5/71: mkdir d0/d1a 0 2023-12-05T09:26:08.378 INFO:tasks.workunit.client.1.smithi134.stdout:5/72: chown d0/dd/f17 4096651 1 2023-12-05T09:26:08.380 INFO:tasks.workunit.client.0.smithi067.stdout:3/20: sync 2023-12-05T09:26:08.380 INFO:tasks.workunit.client.0.smithi067.stdout:4/19: sync 2023-12-05T09:26:08.382 INFO:tasks.workunit.client.1.smithi134.stdout:4/88: dread ff [0,4194304] 0 2023-12-05T09:26:08.383 INFO:tasks.workunit.client.1.smithi134.stdout:4/89: truncate f15 91700 0 2023-12-05T09:26:08.383 INFO:tasks.workunit.client.1.smithi134.stdout:4/90: dread - f6 zero size 2023-12-05T09:26:08.383 INFO:tasks.workunit.client.1.smithi134.stdout:4/91: write d16/d18/d1a/f20 [987251,17670] 0 2023-12-05T09:26:08.383 INFO:tasks.workunit.client.1.smithi134.stdout:5/73: creat d0/d11/f1b x:0 0 0 2023-12-05T09:26:08.385 INFO:tasks.workunit.client.1.smithi134.stdout:2/99: getdents d19 0 2023-12-05T09:26:08.385 INFO:tasks.workunit.client.1.smithi134.stdout:4/92: symlink d16/d21/l22 0 2023-12-05T09:26:08.386 INFO:tasks.workunit.client.0.smithi067.stdout:4/20: rmdir d0 39 2023-12-05T09:26:08.388 INFO:tasks.workunit.client.1.smithi134.stdout:1/85: dwrite d2/d9/f1b [4194304,4194304] 0 2023-12-05T09:26:08.389 INFO:tasks.workunit.client.1.smithi134.stdout:6/77: fsync d4/fd 0 2023-12-05T09:26:08.390 INFO:tasks.workunit.client.0.smithi067.stdout:4/21: creat d0/f5 x:0 0 0 2023-12-05T09:26:08.391 INFO:tasks.workunit.client.0.smithi067.stdout:4/22: rename d0/f5 to d0/f6 0 2023-12-05T09:26:08.393 INFO:tasks.workunit.client.1.smithi134.stdout:2/100: symlink d19/l23 0 2023-12-05T09:26:08.393 INFO:tasks.workunit.client.1.smithi134.stdout:2/101: write d19/f20 [1047055,5859] 0 2023-12-05T09:26:08.394 INFO:tasks.workunit.client.1.smithi134.stdout:9/49: sync 2023-12-05T09:26:08.395 INFO:tasks.workunit.client.1.smithi134.stdout:0/81: sync 2023-12-05T09:26:08.395 INFO:tasks.workunit.client.1.smithi134.stdout:9/50: chown d7/fb 8 1 2023-12-05T09:26:08.397 INFO:tasks.workunit.client.1.smithi134.stdout:4/93: mknod d16/c23 0 2023-12-05T09:26:08.404 INFO:tasks.workunit.client.0.smithi067.stdout:9/155: dread d1b/f1f [0,4194304] 0 2023-12-05T09:26:08.404 INFO:tasks.workunit.client.0.smithi067.stdout:9/156: truncate d1b/d25/f2c 4420858 0 2023-12-05T09:26:08.408 INFO:tasks.workunit.client.0.smithi067.stdout:9/157: mkdir d1b/d25/d35 0 2023-12-05T09:26:08.409 INFO:tasks.workunit.client.0.smithi067.stdout:9/158: creat d1b/d25/f36 x:0 0 0 2023-12-05T09:26:08.409 INFO:tasks.workunit.client.1.smithi134.stdout:6/78: creat d4/d8/da/f19 x:0 0 0 2023-12-05T09:26:08.410 INFO:tasks.workunit.client.1.smithi134.stdout:1/86: creat d2/d9/d10/f1d x:0 0 0 2023-12-05T09:26:08.411 INFO:tasks.workunit.client.1.smithi134.stdout:2/102: creat d19/f24 x:0 0 0 2023-12-05T09:26:08.411 INFO:tasks.workunit.client.1.smithi134.stdout:5/74: dread d0/f5 [0,4194304] 0 2023-12-05T09:26:08.411 INFO:tasks.workunit.client.1.smithi134.stdout:2/103: write f15 [4905022,118941] 0 2023-12-05T09:26:08.411 INFO:tasks.workunit.client.1.smithi134.stdout:2/104: write d19/f24 [990564,99] 0 2023-12-05T09:26:08.412 INFO:tasks.workunit.client.1.smithi134.stdout:0/82: unlink c6 0 2023-12-05T09:26:08.420 INFO:tasks.workunit.client.1.smithi134.stdout:6/79: fdatasync d4/d8/fe 0 2023-12-05T09:26:08.420 INFO:tasks.workunit.client.1.smithi134.stdout:1/87: mknod d2/d9/c1e 0 2023-12-05T09:26:08.420 INFO:tasks.workunit.client.1.smithi134.stdout:1/88: write d2/f5 [2927654,31726] 0 2023-12-05T09:26:08.421 INFO:tasks.workunit.client.1.smithi134.stdout:8/98: dwrite da/de/f12 [0,4194304] 0 2023-12-05T09:26:08.423 INFO:tasks.workunit.client.0.smithi067.stdout:0/88: dwrite d3/fb [0,4194304] 0 2023-12-05T09:26:08.425 INFO:tasks.workunit.client.0.smithi067.stdout:9/159: rmdir d1b/d25 39 2023-12-05T09:26:08.429 INFO:tasks.workunit.client.1.smithi134.stdout:6/80: link d4/fd d4/f1a 0 2023-12-05T09:26:08.433 INFO:tasks.workunit.client.1.smithi134.stdout:5/75: read d0/f7 [4098525,16246] 0 2023-12-05T09:26:08.434 INFO:tasks.workunit.client.1.smithi134.stdout:5/76: truncate d0/fc 4705129 0 2023-12-05T09:26:08.440 INFO:tasks.workunit.client.1.smithi134.stdout:8/99: creat da/de/d16/f20 x:0 0 0 2023-12-05T09:26:08.442 INFO:tasks.workunit.client.1.smithi134.stdout:3/79: sync 2023-12-05T09:26:08.445 INFO:tasks.workunit.client.1.smithi134.stdout:9/51: dwrite f1 [0,4194304] 0 2023-12-05T09:26:08.445 INFO:tasks.workunit.client.1.smithi134.stdout:9/52: creat d7/d8/f13 x:0 0 0 2023-12-05T09:26:08.446 INFO:tasks.workunit.client.1.smithi134.stdout:6/81: mkdir d4/d8/da/d1b 0 2023-12-05T09:26:08.446 INFO:tasks.workunit.client.1.smithi134.stdout:6/82: read d4/fd [1782981,125414] 0 2023-12-05T09:26:08.446 INFO:tasks.workunit.client.1.smithi134.stdout:6/83: write d4/f1a [4885562,78903] 0 2023-12-05T09:26:08.447 INFO:tasks.workunit.client.1.smithi134.stdout:5/77: mkdir d0/d1a/d1c 0 2023-12-05T09:26:08.447 INFO:tasks.workunit.client.1.smithi134.stdout:5/78: chown d0/cb 118 1 2023-12-05T09:26:08.448 INFO:tasks.workunit.client.1.smithi134.stdout:5/79: truncate d0/dd/f14 5112507 0 2023-12-05T09:26:08.450 INFO:tasks.workunit.client.0.smithi067.stdout:0/89: write d3/d7/fc [3073251,73734] 0 2023-12-05T09:26:08.451 INFO:tasks.workunit.client.1.smithi134.stdout:9/53: rmdir d7/d10 39 2023-12-05T09:26:08.451 INFO:tasks.workunit.client.1.smithi134.stdout:1/89: rmdir d2/d9 39 2023-12-05T09:26:08.452 INFO:tasks.workunit.client.1.smithi134.stdout:1/90: rename d2/d9 to d2/d9/d1f 22 2023-12-05T09:26:08.452 INFO:tasks.workunit.client.1.smithi134.stdout:1/91: readlink d2/d9/l16 0 2023-12-05T09:26:08.452 INFO:tasks.workunit.client.1.smithi134.stdout:1/92: creat d2/f20 x:0 0 0 2023-12-05T09:26:08.452 INFO:tasks.workunit.client.0.smithi067.stdout:0/90: mknod d3/df/c19 0 2023-12-05T09:26:08.453 INFO:tasks.workunit.client.1.smithi134.stdout:6/84: truncate d4/d8/fe 1814949 0 2023-12-05T09:26:08.454 INFO:tasks.workunit.client.0.smithi067.stdout:4/23: dwrite d0/f6 [0,4194304] 0 2023-12-05T09:26:08.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/83: dwrite fa [0,4194304] 0 2023-12-05T09:26:08.455 INFO:tasks.workunit.client.1.smithi134.stdout:0/84: write f7 [4379745,127136] 0 2023-12-05T09:26:08.455 INFO:tasks.workunit.client.1.smithi134.stdout:0/85: chown fc 1296 1 2023-12-05T09:26:08.455 INFO:tasks.workunit.client.1.smithi134.stdout:0/86: write fe [4554012,103596] 0 2023-12-05T09:26:08.460 INFO:tasks.workunit.client.1.smithi134.stdout:9/54: mkdir d7/d8/d14 0 2023-12-05T09:26:08.460 INFO:tasks.workunit.client.1.smithi134.stdout:8/100: dread f9 [0,4194304] 0 2023-12-05T09:26:08.462 INFO:tasks.workunit.client.1.smithi134.stdout:1/93: symlink d2/l21 0 2023-12-05T09:26:08.464 INFO:tasks.workunit.client.1.smithi134.stdout:6/85: mknod d4/db/c1c 0 2023-12-05T09:26:08.465 INFO:tasks.workunit.client.0.smithi067.stdout:4/24: truncate d0/f6 3841256 0 2023-12-05T09:26:08.465 INFO:tasks.workunit.client.0.smithi067.stdout:4/25: read - d0/f4 zero size 2023-12-05T09:26:08.465 INFO:tasks.workunit.client.0.smithi067.stdout:4/26: read - d0/f4 zero size 2023-12-05T09:26:08.467 INFO:tasks.workunit.client.1.smithi134.stdout:0/87: symlink d13/d14/l16 0 2023-12-05T09:26:08.468 INFO:tasks.workunit.client.1.smithi134.stdout:0/88: write f9 [950237,59853] 0 2023-12-05T09:26:08.469 INFO:tasks.workunit.client.1.smithi134.stdout:5/80: rmdir d0 39 2023-12-05T09:26:08.470 INFO:tasks.workunit.client.1.smithi134.stdout:5/81: chown d0/c3 207005491 1 2023-12-05T09:26:08.470 INFO:tasks.workunit.client.1.smithi134.stdout:7/71: sync 2023-12-05T09:26:08.470 INFO:tasks.workunit.client.1.smithi134.stdout:7/72: chown d2/dd/f12 225 1 2023-12-05T09:26:08.473 INFO:tasks.workunit.client.1.smithi134.stdout:6/86: symlink d4/db/l1d 0 2023-12-05T09:26:08.476 INFO:tasks.workunit.client.1.smithi134.stdout:0/89: creat d13/f17 x:0 0 0 2023-12-05T09:26:08.476 INFO:tasks.workunit.client.1.smithi134.stdout:5/82: symlink d0/d11/l1d 0 2023-12-05T09:26:08.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/73: creat d2/dd/f19 x:0 0 0 2023-12-05T09:26:08.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/74: chown d2/d7/la 3 1 2023-12-05T09:26:08.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/75: truncate d2/df/f15 1285456 0 2023-12-05T09:26:08.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/76: chown d2 0 1 2023-12-05T09:26:08.480 INFO:tasks.workunit.client.1.smithi134.stdout:0/90: symlink d13/d14/l18 0 2023-12-05T09:26:08.482 INFO:tasks.workunit.client.1.smithi134.stdout:5/83: truncate d0/f5 1121069 0 2023-12-05T09:26:08.484 INFO:tasks.workunit.client.1.smithi134.stdout:7/77: mkdir d2/dd/d1a 0 2023-12-05T09:26:08.488 INFO:tasks.workunit.client.1.smithi134.stdout:0/91: mkdir d13/d14/d19 0 2023-12-05T09:26:08.488 INFO:tasks.workunit.client.1.smithi134.stdout:5/84: creat d0/d11/f1e x:0 0 0 2023-12-05T09:26:08.488 INFO:tasks.workunit.client.1.smithi134.stdout:5/85: chown d0/dd 13017571 1 2023-12-05T09:26:08.488 INFO:tasks.workunit.client.1.smithi134.stdout:1/94: dread d2/f6 [0,4194304] 0 2023-12-05T09:26:08.488 INFO:tasks.workunit.client.1.smithi134.stdout:5/86: creat d0/d11/f1f x:0 0 0 2023-12-05T09:26:08.491 INFO:tasks.workunit.client.1.smithi134.stdout:9/55: dread d7/d8/fe [0,4194304] 0 2023-12-05T09:26:08.493 INFO:tasks.workunit.client.1.smithi134.stdout:7/78: truncate d2/f8 4321771 0 2023-12-05T09:26:08.493 INFO:tasks.workunit.client.1.smithi134.stdout:7/79: write d2/d7/f13 [1024304,89634] 0 2023-12-05T09:26:08.493 INFO:tasks.workunit.client.1.smithi134.stdout:1/95: rmdir d2/d9/d10 39 2023-12-05T09:26:08.494 INFO:tasks.workunit.client.1.smithi134.stdout:9/56: creat d7/d10/f15 x:0 0 0 2023-12-05T09:26:08.495 INFO:tasks.workunit.client.0.smithi067.stdout:4/27: write d0/f6 [544406,28423] 0 2023-12-05T09:26:08.496 INFO:tasks.workunit.client.0.smithi067.stdout:4/28: link d0/f4 d0/f7 0 2023-12-05T09:26:08.496 INFO:tasks.workunit.client.0.smithi067.stdout:4/29: creat d0/f8 x:0 0 0 2023-12-05T09:26:08.496 INFO:tasks.workunit.client.1.smithi134.stdout:7/80: creat d2/df/d17/f1b x:0 0 0 2023-12-05T09:26:08.497 INFO:tasks.workunit.client.1.smithi134.stdout:1/96: symlink d2/d9/d10/l22 0 2023-12-05T09:26:08.498 INFO:tasks.workunit.client.1.smithi134.stdout:3/80: dwrite d4/d5/fd [0,4194304] 0 2023-12-05T09:26:08.499 INFO:tasks.workunit.client.0.smithi067.stdout:4/30: mkdir d0/d9 0 2023-12-05T09:26:08.499 INFO:tasks.workunit.client.0.smithi067.stdout:4/31: write d0/f8 [923914,99990] 0 2023-12-05T09:26:08.500 INFO:tasks.workunit.client.0.smithi067.stdout:4/32: link d0/f7 d0/fa 0 2023-12-05T09:26:08.500 INFO:tasks.workunit.client.1.smithi134.stdout:7/81: creat d2/d7/d10/f1c x:0 0 0 2023-12-05T09:26:08.501 INFO:tasks.workunit.client.1.smithi134.stdout:7/82: fsync d2/df/f14 0 2023-12-05T09:26:08.501 INFO:tasks.workunit.client.1.smithi134.stdout:1/97: unlink d2/d9/c1e 0 2023-12-05T09:26:08.502 INFO:tasks.workunit.client.1.smithi134.stdout:1/98: readlink d2/l15 0 2023-12-05T09:26:08.506 INFO:tasks.workunit.client.1.smithi134.stdout:3/81: creat d4/d1f/f20 x:0 0 0 2023-12-05T09:26:08.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/92: fsync f9 0 2023-12-05T09:26:08.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/93: stat fd 0 2023-12-05T09:26:08.513 INFO:tasks.workunit.client.1.smithi134.stdout:4/94: dwrite d16/d18/d1a/f20 [0,4194304] 0 2023-12-05T09:26:08.513 INFO:tasks.workunit.client.1.smithi134.stdout:4/95: readlink l7 0 2023-12-05T09:26:08.513 INFO:tasks.workunit.client.1.smithi134.stdout:1/99: mknod d2/d9/c23 0 2023-12-05T09:26:08.519 INFO:tasks.workunit.client.1.smithi134.stdout:5/87: dread d0/f2 [0,4194304] 0 2023-12-05T09:26:08.519 INFO:tasks.workunit.client.1.smithi134.stdout:5/88: fdatasync d0/d11/f1e 0 2023-12-05T09:26:08.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/57: dread f3 [0,4194304] 0 2023-12-05T09:26:08.519 INFO:tasks.workunit.client.1.smithi134.stdout:5/89: truncate d0/f19 2142711 0 2023-12-05T09:26:08.519 INFO:tasks.workunit.client.1.smithi134.stdout:1/100: creat d2/d9/f24 x:0 0 0 2023-12-05T09:26:08.519 INFO:tasks.workunit.client.1.smithi134.stdout:1/101: dread - d2/d9/d10/f13 zero size 2023-12-05T09:26:08.520 INFO:tasks.workunit.client.0.smithi067.stdout:0/91: dwrite d3/fa [0,4194304] 0 2023-12-05T09:26:08.521 INFO:tasks.workunit.client.1.smithi134.stdout:9/58: mkdir d7/d8/d16 0 2023-12-05T09:26:08.522 INFO:tasks.workunit.client.1.smithi134.stdout:1/102: link d2/ld d2/l25 0 2023-12-05T09:26:08.522 INFO:tasks.workunit.client.0.smithi067.stdout:0/92: link d3/fa d3/df/d10/f1a 0 2023-12-05T09:26:08.522 INFO:tasks.workunit.client.0.smithi067.stdout:0/93: stat d3/d7/f13 0 2023-12-05T09:26:08.523 INFO:tasks.workunit.client.1.smithi134.stdout:1/103: write d2/d9/d10/f1d [6216,121897] 0 2023-12-05T09:26:08.523 INFO:tasks.workunit.client.1.smithi134.stdout:1/104: chown d2/l21 217912532 1 2023-12-05T09:26:08.523 INFO:tasks.workunit.client.1.smithi134.stdout:1/105: creat d2/f26 x:0 0 0 2023-12-05T09:26:08.523 INFO:tasks.workunit.client.1.smithi134.stdout:9/59: chown f1 51530636 1 2023-12-05T09:26:08.523 INFO:tasks.workunit.client.1.smithi134.stdout:3/82: dread d4/d5/f1e [0,4194304] 0 2023-12-05T09:26:08.526 INFO:tasks.workunit.client.0.smithi067.stdout:9/160: dwrite f14 [0,4194304] 0 2023-12-05T09:26:08.533 INFO:tasks.workunit.client.1.smithi134.stdout:9/60: link d7/d8/c11 d7/c17 0 2023-12-05T09:26:08.533 INFO:tasks.workunit.client.0.smithi067.stdout:9/161: mknod d1b/d25/c37 0 2023-12-05T09:26:08.533 INFO:tasks.workunit.client.0.smithi067.stdout:9/162: stat d1b/d25 0 2023-12-05T09:26:08.533 INFO:tasks.workunit.client.0.smithi067.stdout:9/163: read f10 [3782126,11633] 0 2023-12-05T09:26:08.535 INFO:tasks.workunit.client.1.smithi134.stdout:1/106: mkdir d2/d27 0 2023-12-05T09:26:08.535 INFO:tasks.workunit.client.1.smithi134.stdout:1/107: write d2/f4 [921530,74049] 0 2023-12-05T09:26:08.536 INFO:tasks.workunit.client.0.smithi067.stdout:9/164: getdents d1b 0 2023-12-05T09:26:08.537 INFO:tasks.workunit.client.1.smithi134.stdout:9/61: mknod d7/d8/d16/c18 0 2023-12-05T09:26:08.537 INFO:tasks.workunit.client.1.smithi134.stdout:9/62: fsync d7/fb 0 2023-12-05T09:26:08.537 INFO:tasks.workunit.client.1.smithi134.stdout:8/101: dwrite f7 [0,4194304] 0 2023-12-05T09:26:08.537 INFO:tasks.workunit.client.1.smithi134.stdout:8/102: read - da/de/f1c zero size 2023-12-05T09:26:08.538 INFO:tasks.workunit.client.1.smithi134.stdout:2/105: sync 2023-12-05T09:26:08.538 INFO:tasks.workunit.client.0.smithi067.stdout:9/165: creat d1b/d25/d35/f38 x:0 0 0 2023-12-05T09:26:08.538 INFO:tasks.workunit.client.0.smithi067.stdout:9/166: chown d1b/l22 716 1 2023-12-05T09:26:08.538 INFO:tasks.workunit.client.0.smithi067.stdout:9/167: fsync d1b/f1f 0 2023-12-05T09:26:08.540 INFO:tasks.workunit.client.0.smithi067.stdout:4/33: fsync d0/f8 0 2023-12-05T09:26:08.541 INFO:tasks.workunit.client.1.smithi134.stdout:1/108: fsync d2/d9/f24 0 2023-12-05T09:26:08.541 INFO:tasks.workunit.client.1.smithi134.stdout:1/109: chown d2/d9/f1b 30 1 2023-12-05T09:26:08.541 INFO:tasks.workunit.client.1.smithi134.stdout:8/103: dread f9 [0,4194304] 0 2023-12-05T09:26:08.542 INFO:tasks.workunit.client.0.smithi067.stdout:0/94: dread d3/fa [0,4194304] 0 2023-12-05T09:26:08.548 INFO:tasks.workunit.client.0.smithi067.stdout:0/95: rmdir d3/d7 39 2023-12-05T09:26:08.551 INFO:tasks.workunit.client.1.smithi134.stdout:1/110: rename d2/f5 to d2/d9/f28 0 2023-12-05T09:26:08.552 INFO:tasks.workunit.client.1.smithi134.stdout:1/111: write d2/f26 [982164,8062] 0 2023-12-05T09:26:08.552 INFO:tasks.workunit.client.1.smithi134.stdout:2/106: link f6 d19/f25 0 2023-12-05T09:26:08.552 INFO:tasks.workunit.client.1.smithi134.stdout:2/107: readlink d19/l1f 0 2023-12-05T09:26:08.558 INFO:tasks.workunit.client.1.smithi134.stdout:8/104: unlink f7 0 2023-12-05T09:26:08.559 INFO:tasks.workunit.client.0.smithi067.stdout:9/168: write f19 [1297366,43975] 0 2023-12-05T09:26:08.560 INFO:tasks.workunit.client.1.smithi134.stdout:8/105: link da/de/d11/d1d/l1f da/de/l21 0 2023-12-05T09:26:08.562 INFO:tasks.workunit.client.0.smithi067.stdout:9/169: truncate d1b/d25/f2d 3994012 0 2023-12-05T09:26:08.563 INFO:tasks.workunit.client.1.smithi134.stdout:8/106: getdents da/d1b 0 2023-12-05T09:26:08.563 INFO:tasks.workunit.client.1.smithi134.stdout:8/107: rename da/de to da/de/d16/d22 22 2023-12-05T09:26:08.563 INFO:tasks.workunit.client.1.smithi134.stdout:6/87: dwrite d4/f17 [0,4194304] 0 2023-12-05T09:26:08.568 INFO:tasks.workunit.client.1.smithi134.stdout:8/108: creat da/de/d16/f23 x:0 0 0 2023-12-05T09:26:08.568 INFO:tasks.workunit.client.1.smithi134.stdout:8/109: chown da/de/d11/d1d 62202 1 2023-12-05T09:26:08.574 INFO:tasks.workunit.client.1.smithi134.stdout:6/88: truncate d4/ff 111639 0 2023-12-05T09:26:08.576 INFO:tasks.workunit.client.1.smithi134.stdout:5/90: write d0/f2 [605189,118043] 0 2023-12-05T09:26:08.576 INFO:tasks.workunit.client.1.smithi134.stdout:5/91: stat d0/l12 0 2023-12-05T09:26:08.576 INFO:tasks.workunit.client.1.smithi134.stdout:5/92: readlink d0/l12 0 2023-12-05T09:26:08.587 INFO:tasks.workunit.client.1.smithi134.stdout:1/112: dread d2/d9/f1b [0,4194304] 0 2023-12-05T09:26:08.589 INFO:tasks.workunit.client.1.smithi134.stdout:6/89: symlink d4/d8/l1e 0 2023-12-05T09:26:08.590 INFO:tasks.workunit.client.1.smithi134.stdout:4/96: dwrite f11 [0,4194304] 0 2023-12-05T09:26:08.593 INFO:tasks.workunit.client.1.smithi134.stdout:5/93: creat d0/dd/f20 x:0 0 0 2023-12-05T09:26:08.593 INFO:tasks.workunit.client.1.smithi134.stdout:5/94: dread - d0/d11/f1e zero size 2023-12-05T09:26:08.594 INFO:tasks.workunit.client.1.smithi134.stdout:9/63: dwrite f1 [0,4194304] 0 2023-12-05T09:26:08.594 INFO:tasks.workunit.client.1.smithi134.stdout:9/64: chown d7/fb 9 1 2023-12-05T09:26:08.594 INFO:tasks.workunit.client.1.smithi134.stdout:9/65: fdatasync d7/d8/fe 0 2023-12-05T09:26:08.594 INFO:tasks.workunit.client.1.smithi134.stdout:9/66: chown d7/d8 34597775 1 2023-12-05T09:26:08.595 INFO:tasks.workunit.client.1.smithi134.stdout:1/113: link d2/d9/c18 d2/d27/c29 0 2023-12-05T09:26:08.595 INFO:tasks.workunit.client.1.smithi134.stdout:1/114: readlink d2/d9/la 0 2023-12-05T09:26:08.595 INFO:tasks.workunit.client.1.smithi134.stdout:1/115: chown d2/f4 0 1 2023-12-05T09:26:08.595 INFO:tasks.workunit.client.1.smithi134.stdout:1/116: write d2/f20 [939697,24777] 0 2023-12-05T09:26:08.597 INFO:tasks.workunit.client.1.smithi134.stdout:1/117: write d2/f19 [1170977,7047] 0 2023-12-05T09:26:08.597 INFO:tasks.workunit.client.1.smithi134.stdout:1/118: truncate d2/f20 1765995 0 2023-12-05T09:26:08.597 INFO:tasks.workunit.client.1.smithi134.stdout:1/119: chown d2/l15 194 1 2023-12-05T09:26:08.598 INFO:tasks.workunit.client.1.smithi134.stdout:4/97: mkdir d16/d18/d1b/d24 0 2023-12-05T09:26:08.598 INFO:tasks.workunit.client.1.smithi134.stdout:9/67: rename d7/d8/d16/c18 to d7/c19 0 2023-12-05T09:26:08.602 INFO:tasks.workunit.client.1.smithi134.stdout:9/68: unlink d7/d8/fe 0 2023-12-05T09:26:08.603 INFO:tasks.workunit.client.1.smithi134.stdout:2/108: dwrite f15 [0,4194304] 0 2023-12-05T09:26:08.604 INFO:tasks.workunit.client.1.smithi134.stdout:9/69: rename d7/d10/f15 to d7/f1a 0 2023-12-05T09:26:08.604 INFO:tasks.workunit.client.1.smithi134.stdout:0/94: dwrite f7 [0,4194304] 0 2023-12-05T09:26:08.606 INFO:tasks.workunit.client.0.smithi067.stdout:1/63: sync 2023-12-05T09:26:08.606 INFO:tasks.workunit.client.0.smithi067.stdout:5/48: sync 2023-12-05T09:26:08.606 INFO:tasks.workunit.client.1.smithi134.stdout:2/109: mknod d19/c26 0 2023-12-05T09:26:08.607 INFO:tasks.workunit.client.0.smithi067.stdout:6/23: sync 2023-12-05T09:26:08.607 INFO:tasks.workunit.client.0.smithi067.stdout:7/97: sync 2023-12-05T09:26:08.607 INFO:tasks.workunit.client.1.smithi134.stdout:9/70: mkdir d7/d8/d1b 0 2023-12-05T09:26:08.607 INFO:tasks.workunit.client.1.smithi134.stdout:9/71: truncate f3 288070 0 2023-12-05T09:26:08.608 INFO:tasks.workunit.client.0.smithi067.stdout:6/24: write f2 [385708,65678] 0 2023-12-05T09:26:08.608 INFO:tasks.workunit.client.1.smithi134.stdout:2/110: mknod d19/c27 0 2023-12-05T09:26:08.608 INFO:tasks.workunit.client.1.smithi134.stdout:2/111: fsync d19/f20 0 2023-12-05T09:26:08.611 INFO:tasks.workunit.client.0.smithi067.stdout:1/64: creat d2/d5/d7/de/d10/d15/f1c x:0 0 0 2023-12-05T09:26:08.611 INFO:tasks.workunit.client.1.smithi134.stdout:5/95: dread d0/f19 [0,4194304] 0 2023-12-05T09:26:08.612 INFO:tasks.workunit.client.0.smithi067.stdout:7/98: truncate d0/f7 2497826 0 2023-12-05T09:26:08.614 INFO:tasks.workunit.client.0.smithi067.stdout:0/96: dwrite d3/fa [0,4194304] 0 2023-12-05T09:26:08.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/112: mkdir d19/d28 0 2023-12-05T09:26:08.619 INFO:tasks.workunit.client.0.smithi067.stdout:1/65: link d2/f13 d2/d3/f1d 0 2023-12-05T09:26:08.619 INFO:tasks.workunit.client.0.smithi067.stdout:9/170: dwrite d1b/f1c [0,4194304] 0 2023-12-05T09:26:08.619 INFO:tasks.workunit.client.0.smithi067.stdout:7/99: unlink d0/lb 0 2023-12-05T09:26:08.619 INFO:tasks.workunit.client.0.smithi067.stdout:7/100: chown d0/d9/l1c 10 1 2023-12-05T09:26:08.620 INFO:tasks.workunit.client.0.smithi067.stdout:0/97: truncate d3/fb 3795590 0 2023-12-05T09:26:08.623 INFO:tasks.workunit.client.0.smithi067.stdout:9/171: mknod d1b/d25/c39 0 2023-12-05T09:26:08.624 INFO:tasks.workunit.client.0.smithi067.stdout:7/101: truncate d0/d9/ff 2245740 0 2023-12-05T09:26:08.627 INFO:tasks.workunit.client.0.smithi067.stdout:0/98: symlink d3/d7/l1b 0 2023-12-05T09:26:08.627 INFO:tasks.workunit.client.0.smithi067.stdout:0/99: chown d3/df/c19 3101 1 2023-12-05T09:26:08.627 INFO:tasks.workunit.client.1.smithi134.stdout:1/120: dread d2/f4 [0,4194304] 0 2023-12-05T09:26:08.627 INFO:tasks.workunit.client.1.smithi134.stdout:1/121: write d2/d9/f24 [139570,75320] 0 2023-12-05T09:26:08.627 INFO:tasks.workunit.client.1.smithi134.stdout:1/122: stat d2/d9/d10/f13 0 2023-12-05T09:26:08.627 INFO:tasks.workunit.client.0.smithi067.stdout:9/172: mknod d1b/d25/c3a 0 2023-12-05T09:26:08.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/100: mknod d3/df/c1c 0 2023-12-05T09:26:08.630 INFO:tasks.workunit.client.0.smithi067.stdout:9/173: unlink c1a 0 2023-12-05T09:26:08.631 INFO:tasks.workunit.client.0.smithi067.stdout:0/101: link d3/d7/f8 d3/f1d 0 2023-12-05T09:26:08.631 INFO:tasks.workunit.client.0.smithi067.stdout:0/102: write d3/df/f18 [127473,32633] 0 2023-12-05T09:26:08.632 INFO:tasks.workunit.client.0.smithi067.stdout:9/174: truncate fa 2943166 0 2023-12-05T09:26:08.633 INFO:tasks.workunit.client.0.smithi067.stdout:9/175: dread - d1b/d25/f36 zero size 2023-12-05T09:26:08.633 INFO:tasks.workunit.client.0.smithi067.stdout:9/176: read - d1b/f31 zero size 2023-12-05T09:26:08.633 INFO:tasks.workunit.client.0.smithi067.stdout:9/177: chown l13 162823 1 2023-12-05T09:26:08.637 INFO:tasks.workunit.client.0.smithi067.stdout:0/103: rename d3/d7/f13 to d3/f1e 0 2023-12-05T09:26:08.640 INFO:tasks.workunit.client.1.smithi134.stdout:5/96: read d0/fc [1369482,24827] 0 2023-12-05T09:26:08.641 INFO:tasks.workunit.client.0.smithi067.stdout:9/178: rename d1b/f1f to d1b/f3b 0 2023-12-05T09:26:08.642 INFO:tasks.workunit.client.1.smithi134.stdout:2/113: dread f1 [0,4194304] 0 2023-12-05T09:26:08.642 INFO:tasks.workunit.client.1.smithi134.stdout:2/114: chown d19/c27 85 1 2023-12-05T09:26:08.647 INFO:tasks.workunit.client.1.smithi134.stdout:5/97: mknod d0/d11/c21 0 2023-12-05T09:26:08.647 INFO:tasks.workunit.client.1.smithi134.stdout:6/90: dwrite d4/d8/fe [0,4194304] 0 2023-12-05T09:26:08.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/72: getdents d7/d8 0 2023-12-05T09:26:08.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/73: chown f1 514034242 1 2023-12-05T09:26:08.649 INFO:tasks.workunit.client.1.smithi134.stdout:1/123: dread d2/d9/f1b [4194304,4194304] 0 2023-12-05T09:26:08.649 INFO:tasks.workunit.client.0.smithi067.stdout:9/179: rename d1b/f30 to d1b/d25/f3c 0 2023-12-05T09:26:08.649 INFO:tasks.workunit.client.0.smithi067.stdout:9/180: write d1b/f24 [965560,35719] 0 2023-12-05T09:26:08.649 INFO:tasks.workunit.client.0.smithi067.stdout:9/181: write f19 [512332,20544] 0 2023-12-05T09:26:08.650 INFO:tasks.workunit.client.1.smithi134.stdout:6/91: rmdir d4/db 39 2023-12-05T09:26:08.650 INFO:tasks.workunit.client.1.smithi134.stdout:6/92: write d4/fd [425841,66771] 0 2023-12-05T09:26:08.651 INFO:tasks.workunit.client.1.smithi134.stdout:0/95: dwrite f3 [0,4194304] 0 2023-12-05T09:26:08.652 INFO:tasks.workunit.client.1.smithi134.stdout:8/110: dwrite f9 [0,4194304] 0 2023-12-05T09:26:08.652 INFO:tasks.workunit.client.0.smithi067.stdout:5/49: write db/df/f15 [3276203,43275] 0 2023-12-05T09:26:08.654 INFO:tasks.workunit.client.1.smithi134.stdout:1/124: symlink d2/d9/l2a 0 2023-12-05T09:26:08.655 INFO:tasks.workunit.client.1.smithi134.stdout:1/125: creat d2/f2b x:0 0 0 2023-12-05T09:26:08.655 INFO:tasks.workunit.client.1.smithi134.stdout:1/126: creat d2/d9/f2c x:0 0 0 2023-12-05T09:26:08.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/50: rename ca to db/c18 0 2023-12-05T09:26:08.678 INFO:tasks.workunit.client.1.smithi134.stdout:0/96: rename cb to d13/d14/d15/c1a 0 2023-12-05T09:26:08.679 INFO:tasks.workunit.client.1.smithi134.stdout:2/115: dread f13 [0,4194304] 0 2023-12-05T09:26:08.679 INFO:tasks.workunit.client.1.smithi134.stdout:2/116: chown f1 12567 1 2023-12-05T09:26:08.679 INFO:tasks.workunit.client.1.smithi134.stdout:2/117: chown f18 258692382 1 2023-12-05T09:26:08.679 INFO:tasks.workunit.client.1.smithi134.stdout:0/97: symlink d13/d14/d15/l1b 0 2023-12-05T09:26:08.679 INFO:tasks.workunit.client.1.smithi134.stdout:2/118: mknod d19/d28/c29 0 2023-12-05T09:26:08.680 INFO:tasks.workunit.client.1.smithi134.stdout:5/98: dread d0/f19 [0,4194304] 0 2023-12-05T09:26:08.680 INFO:tasks.workunit.client.1.smithi134.stdout:5/99: chown d0/dd/f17 4081170 1 2023-12-05T09:26:08.680 INFO:tasks.workunit.client.1.smithi134.stdout:5/100: creat d0/d11/f22 x:0 0 0 2023-12-05T09:26:08.681 INFO:tasks.workunit.client.1.smithi134.stdout:9/74: write f1 [77672,2396] 0 2023-12-05T09:26:08.681 INFO:tasks.workunit.client.1.smithi134.stdout:0/98: mknod d13/c1c 0 2023-12-05T09:26:08.681 INFO:tasks.workunit.client.1.smithi134.stdout:9/75: getdents d7/d8 0 2023-12-05T09:26:08.681 INFO:tasks.workunit.client.1.smithi134.stdout:9/76: truncate d7/d8/fc 3913258 0 2023-12-05T09:26:08.682 INFO:tasks.workunit.client.1.smithi134.stdout:2/119: creat d19/d28/f2a x:0 0 0 2023-12-05T09:26:08.682 INFO:tasks.workunit.client.1.smithi134.stdout:2/120: chown d19/l23 13224600 1 2023-12-05T09:26:08.687 INFO:tasks.workunit.client.1.smithi134.stdout:8/111: dwrite da/de/d11/f15 [0,4194304] 0 2023-12-05T09:26:08.689 INFO:tasks.workunit.client.1.smithi134.stdout:5/101: creat d0/d1a/d1c/f23 x:0 0 0 2023-12-05T09:26:08.690 INFO:tasks.workunit.client.0.smithi067.stdout:1/66: dwrite d2/d3/f16 [0,4194304] 0 2023-12-05T09:26:08.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/51: dread db/fe [0,4194304] 0 2023-12-05T09:26:08.692 INFO:tasks.workunit.client.0.smithi067.stdout:5/52: stat f7 0 2023-12-05T09:26:08.692 INFO:tasks.workunit.client.0.smithi067.stdout:5/53: write db/f14 [779963,124330] 0 2023-12-05T09:26:08.693 INFO:tasks.workunit.client.1.smithi134.stdout:0/99: symlink d13/l1d 0 2023-12-05T09:26:08.693 INFO:tasks.workunit.client.1.smithi134.stdout:9/77: creat d7/f1c x:0 0 0 2023-12-05T09:26:08.693 INFO:tasks.workunit.client.1.smithi134.stdout:9/78: dread - d7/d8/f13 zero size 2023-12-05T09:26:08.694 INFO:tasks.workunit.client.1.smithi134.stdout:2/121: mkdir d19/d28/d2b 0 2023-12-05T09:26:08.695 INFO:tasks.workunit.client.1.smithi134.stdout:7/83: sync 2023-12-05T09:26:08.695 INFO:tasks.workunit.client.1.smithi134.stdout:3/83: sync 2023-12-05T09:26:08.695 INFO:tasks.workunit.client.1.smithi134.stdout:7/84: truncate d2/dd/f19 312180 0 2023-12-05T09:26:08.696 INFO:tasks.workunit.client.1.smithi134.stdout:7/85: dread - d2/d7/d10/f1c zero size 2023-12-05T09:26:08.701 INFO:tasks.workunit.client.0.smithi067.stdout:5/54: symlink db/df/l19 0 2023-12-05T09:26:08.701 INFO:tasks.workunit.client.0.smithi067.stdout:5/55: chown db/f14 78238529 1 2023-12-05T09:26:08.701 INFO:tasks.workunit.client.1.smithi134.stdout:8/112: rename da/de/d11/f15 to da/de/d16/f24 0 2023-12-05T09:26:08.702 INFO:tasks.workunit.client.1.smithi134.stdout:9/79: mknod d7/d8/d16/c1d 0 2023-12-05T09:26:08.702 INFO:tasks.workunit.client.1.smithi134.stdout:3/84: dread f3 [0,4194304] 0 2023-12-05T09:26:08.702 INFO:tasks.workunit.client.1.smithi134.stdout:3/85: chown d4/c8 155 1 2023-12-05T09:26:08.703 INFO:tasks.workunit.client.1.smithi134.stdout:2/122: unlink cb 0 2023-12-05T09:26:08.707 INFO:tasks.workunit.client.1.smithi134.stdout:5/102: rename d0/cb to d0/d1a/c24 0 2023-12-05T09:26:08.707 INFO:tasks.workunit.client.1.smithi134.stdout:3/86: truncate d4/d5/fd 3986768 0 2023-12-05T09:26:08.707 INFO:tasks.workunit.client.1.smithi134.stdout:5/103: write d0/d11/f1b [127789,109272] 0 2023-12-05T09:26:08.713 INFO:tasks.workunit.client.1.smithi134.stdout:3/87: rename d4/d5/l1c to d4/d5/l21 0 2023-12-05T09:26:08.715 INFO:tasks.workunit.client.1.smithi134.stdout:7/86: write d2/dd/f12 [2006117,94305] 0 2023-12-05T09:26:08.716 INFO:tasks.workunit.client.1.smithi134.stdout:8/113: dread f9 [0,4194304] 0 2023-12-05T09:26:08.716 INFO:tasks.workunit.client.1.smithi134.stdout:5/104: mkdir d0/d1a/d1c/d25 0 2023-12-05T09:26:08.716 INFO:tasks.workunit.client.1.smithi134.stdout:3/88: mknod d4/c22 0 2023-12-05T09:26:08.717 INFO:tasks.workunit.client.0.smithi067.stdout:7/102: dread d0/d9/ff [0,4194304] 0 2023-12-05T09:26:08.718 INFO:tasks.workunit.client.1.smithi134.stdout:7/87: rename d2/le to d2/d7/dc/l1d 0 2023-12-05T09:26:08.720 INFO:tasks.workunit.client.1.smithi134.stdout:8/114: creat da/de/d16/f25 x:0 0 0 2023-12-05T09:26:08.720 INFO:tasks.workunit.client.1.smithi134.stdout:8/115: dread - da/de/f1c zero size 2023-12-05T09:26:08.721 INFO:tasks.workunit.client.1.smithi134.stdout:9/80: dread f3 [0,4194304] 0 2023-12-05T09:26:08.730 INFO:tasks.workunit.client.1.smithi134.stdout:3/89: mkdir d4/d5/d23 0 2023-12-05T09:26:08.730 INFO:tasks.workunit.client.1.smithi134.stdout:3/90: dread - d4/f17 zero size 2023-12-05T09:26:08.730 INFO:tasks.workunit.client.1.smithi134.stdout:5/105: rename d0/c18 to d0/d11/c26 0 2023-12-05T09:26:08.730 INFO:tasks.workunit.client.1.smithi134.stdout:8/116: link da/de/d11/f1a da/de/d16/f26 0 2023-12-05T09:26:08.730 INFO:tasks.workunit.client.1.smithi134.stdout:8/117: readlink da/de/d11/l13 0 2023-12-05T09:26:08.730 INFO:tasks.workunit.client.1.smithi134.stdout:9/81: creat d7/d8/d14/f1e x:0 0 0 2023-12-05T09:26:08.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/100: rmdir d13 39 2023-12-05T09:26:08.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/101: stat d13/d14/l18 0 2023-12-05T09:26:08.731 INFO:tasks.workunit.client.1.smithi134.stdout:2/123: write f13 [2422265,2365] 0 2023-12-05T09:26:08.732 INFO:tasks.workunit.client.0.smithi067.stdout:0/104: dwrite d3/f5 [0,4194304] 0 2023-12-05T09:26:08.732 INFO:tasks.workunit.client.1.smithi134.stdout:7/88: dread d2/df/f15 [0,4194304] 0 2023-12-05T09:26:08.734 INFO:tasks.workunit.client.0.smithi067.stdout:0/105: link d3/f4 d3/df/d10/f1f 0 2023-12-05T09:26:08.734 INFO:tasks.workunit.client.1.smithi134.stdout:4/98: sync 2023-12-05T09:26:08.736 INFO:tasks.workunit.client.1.smithi134.stdout:3/91: truncate d4/d5/f1e 415731 0 2023-12-05T09:26:08.736 INFO:tasks.workunit.client.1.smithi134.stdout:3/92: dread - d4/f12 zero size 2023-12-05T09:26:08.736 INFO:tasks.workunit.client.1.smithi134.stdout:0/102: rename d13/d14/d15/l1b to d13/d14/d19/l1e 0 2023-12-05T09:26:08.736 INFO:tasks.workunit.client.1.smithi134.stdout:0/103: write fe [1578131,3030] 0 2023-12-05T09:26:08.739 INFO:tasks.workunit.client.0.smithi067.stdout:0/106: link d3/fb d3/df/d10/f20 0 2023-12-05T09:26:08.739 INFO:tasks.workunit.client.1.smithi134.stdout:0/104: write d13/f17 [962634,127927] 0 2023-12-05T09:26:08.742 INFO:tasks.workunit.client.1.smithi134.stdout:5/106: dread d0/fc [0,4194304] 0 2023-12-05T09:26:08.742 INFO:tasks.workunit.client.1.smithi134.stdout:5/107: truncate d0/dd/f17 407083 0 2023-12-05T09:26:08.742 INFO:tasks.workunit.client.1.smithi134.stdout:5/108: chown d0/d1a 44 1 2023-12-05T09:26:08.742 INFO:tasks.workunit.client.1.smithi134.stdout:5/109: chown d0/c6 2 1 2023-12-05T09:26:08.743 INFO:tasks.workunit.client.1.smithi134.stdout:4/99: creat d16/d18/d1b/d24/f25 x:0 0 0 2023-12-05T09:26:08.743 INFO:tasks.workunit.client.1.smithi134.stdout:4/100: write f6 [647032,85709] 0 2023-12-05T09:26:08.743 INFO:tasks.workunit.client.1.smithi134.stdout:4/101: stat f15 0 2023-12-05T09:26:08.743 INFO:tasks.workunit.client.1.smithi134.stdout:7/89: truncate f1 902014 0 2023-12-05T09:26:08.743 INFO:tasks.workunit.client.1.smithi134.stdout:2/124: rename f13 to d19/f2c 0 2023-12-05T09:26:08.743 INFO:tasks.workunit.client.0.smithi067.stdout:9/182: dwrite f11 [0,4194304] 0 2023-12-05T09:26:08.743 INFO:tasks.workunit.client.0.smithi067.stdout:9/183: truncate d1b/d25/f33 1328312 0 2023-12-05T09:26:08.746 INFO:tasks.workunit.client.0.smithi067.stdout:9/184: symlink d1b/d25/d35/l3d 0 2023-12-05T09:26:08.748 INFO:tasks.workunit.client.0.smithi067.stdout:9/185: mkdir d1b/d3e 0 2023-12-05T09:26:08.748 INFO:tasks.workunit.client.0.smithi067.stdout:9/186: readlink d1b/l1e 0 2023-12-05T09:26:08.748 INFO:tasks.workunit.client.0.smithi067.stdout:9/187: dread - d1b/f20 zero size 2023-12-05T09:26:08.749 INFO:tasks.workunit.client.0.smithi067.stdout:9/188: mknod d1b/c3f 0 2023-12-05T09:26:08.751 INFO:tasks.workunit.client.1.smithi134.stdout:5/110: creat d0/d1a/f27 x:0 0 0 2023-12-05T09:26:08.751 INFO:tasks.workunit.client.1.smithi134.stdout:7/90: symlink d2/df/l1e 0 2023-12-05T09:26:08.752 INFO:tasks.workunit.client.0.smithi067.stdout:9/189: link d1b/d25/f2d d1b/d25/f40 0 2023-12-05T09:26:08.752 INFO:tasks.workunit.client.1.smithi134.stdout:2/125: truncate f1 3487987 0 2023-12-05T09:26:08.752 INFO:tasks.workunit.client.1.smithi134.stdout:2/126: readlink d19/l23 0 2023-12-05T09:26:08.760 INFO:tasks.workunit.client.0.smithi067.stdout:9/190: link d1b/c28 d1b/c41 0 2023-12-05T09:26:08.765 INFO:tasks.workunit.client.0.smithi067.stdout:0/107: write d3/fb [3247690,8203] 0 2023-12-05T09:26:08.768 INFO:tasks.workunit.client.0.smithi067.stdout:0/108: creat d3/df/f21 x:0 0 0 2023-12-05T09:26:08.771 INFO:tasks.workunit.client.0.smithi067.stdout:0/109: link d3/df/c1c d3/c22 0 2023-12-05T09:26:08.776 INFO:tasks.workunit.client.1.smithi134.stdout:7/91: getdents d2/dd 0 2023-12-05T09:26:08.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/127: truncate f6 421792 0 2023-12-05T09:26:08.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/128: truncate f12 57782 0 2023-12-05T09:26:08.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/129: creat d19/f2d x:0 0 0 2023-12-05T09:26:08.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/130: truncate f18 926435 0 2023-12-05T09:26:08.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/131: fdatasync f15 0 2023-12-05T09:26:08.782 INFO:tasks.workunit.client.1.smithi134.stdout:7/92: mkdir d2/d7/d1f 0 2023-12-05T09:26:08.783 INFO:tasks.workunit.client.0.smithi067.stdout:0/110: dread d3/df/d10/f1f [0,4194304] 0 2023-12-05T09:26:08.783 INFO:tasks.workunit.client.0.smithi067.stdout:0/111: stat d3/f1e 0 2023-12-05T09:26:08.783 INFO:tasks.workunit.client.0.smithi067.stdout:0/112: fdatasync d3/f4 0 2023-12-05T09:26:08.785 INFO:tasks.workunit.client.0.smithi067.stdout:1/67: dwrite d2/d5/d7/de/d10/d15/f1c [0,4194304] 0 2023-12-05T09:26:08.785 INFO:tasks.workunit.client.0.smithi067.stdout:1/68: stat d2/d5/d7/cb 0 2023-12-05T09:26:08.785 INFO:tasks.workunit.client.0.smithi067.stdout:1/69: fsync f1 0 2023-12-05T09:26:08.785 INFO:tasks.workunit.client.0.smithi067.stdout:1/70: read d2/d3/f1d [116120,42001] 0 2023-12-05T09:26:08.785 INFO:tasks.workunit.client.0.smithi067.stdout:1/71: fsync d2/d5/d7/de/d1a/f1b 0 2023-12-05T09:26:08.789 INFO:tasks.workunit.client.1.smithi134.stdout:6/93: sync 2023-12-05T09:26:08.789 INFO:tasks.workunit.client.1.smithi134.stdout:1/127: sync 2023-12-05T09:26:08.789 INFO:tasks.workunit.client.1.smithi134.stdout:1/128: creat d2/d9/f2d x:0 0 0 2023-12-05T09:26:08.791 INFO:tasks.workunit.client.1.smithi134.stdout:0/105: dread fa [0,4194304] 0 2023-12-05T09:26:08.791 INFO:tasks.workunit.client.1.smithi134.stdout:0/106: fdatasync f8 0 2023-12-05T09:26:08.795 INFO:tasks.workunit.client.1.smithi134.stdout:9/82: dwrite f3 [0,4194304] 0 2023-12-05T09:26:08.795 INFO:tasks.workunit.client.1.smithi134.stdout:9/83: fdatasync d7/fb 0 2023-12-05T09:26:08.795 INFO:tasks.workunit.client.1.smithi134.stdout:9/84: truncate d7/f1a 563658 0 2023-12-05T09:26:08.800 INFO:tasks.workunit.client.1.smithi134.stdout:1/129: mknod d2/d9/c2e 0 2023-12-05T09:26:08.803 INFO:tasks.workunit.client.1.smithi134.stdout:0/107: unlink c5 0 2023-12-05T09:26:08.803 INFO:tasks.workunit.client.1.smithi134.stdout:0/108: readlink d13/d14/l18 0 2023-12-05T09:26:08.807 INFO:tasks.workunit.client.1.smithi134.stdout:9/85: unlink d7/d8/c11 0 2023-12-05T09:26:08.808 INFO:tasks.workunit.client.1.smithi134.stdout:6/94: getdents d4 0 2023-12-05T09:26:08.809 INFO:tasks.workunit.client.1.smithi134.stdout:1/130: mknod d2/d9/d10/c2f 0 2023-12-05T09:26:08.810 INFO:tasks.workunit.client.1.smithi134.stdout:0/109: mkdir d13/d1f 0 2023-12-05T09:26:08.812 INFO:tasks.workunit.client.1.smithi134.stdout:9/86: creat d7/d8/d16/f1f x:0 0 0 2023-12-05T09:26:08.812 INFO:tasks.workunit.client.1.smithi134.stdout:9/87: chown d7/d8/d16/c1d 61 1 2023-12-05T09:26:08.812 INFO:tasks.workunit.client.1.smithi134.stdout:9/88: fdatasync d7/fb 0 2023-12-05T09:26:08.812 INFO:tasks.workunit.client.1.smithi134.stdout:9/89: truncate d7/d8/f13 260281 0 2023-12-05T09:26:08.813 INFO:tasks.workunit.client.0.smithi067.stdout:1/72: write d2/d5/d7/de/d1a/f1b [6147555,70128] 0 2023-12-05T09:26:08.813 INFO:tasks.workunit.client.1.smithi134.stdout:6/95: fdatasync d4/d8/f16 0 2023-12-05T09:26:08.814 INFO:tasks.workunit.client.1.smithi134.stdout:1/131: mkdir d2/d9/d10/d30 0 2023-12-05T09:26:08.814 INFO:tasks.workunit.client.1.smithi134.stdout:1/132: write d2/d9/f2d [466703,67669] 0 2023-12-05T09:26:08.816 INFO:tasks.workunit.client.1.smithi134.stdout:0/110: creat d13/d14/d19/f20 x:0 0 0 2023-12-05T09:26:08.817 INFO:tasks.workunit.client.0.smithi067.stdout:1/73: unlink f1 0 2023-12-05T09:26:08.818 INFO:tasks.workunit.client.1.smithi134.stdout:9/90: rmdir d7/d8/d1b 0 2023-12-05T09:26:08.820 INFO:tasks.workunit.client.1.smithi134.stdout:6/96: creat d4/db/f1f x:0 0 0 2023-12-05T09:26:08.820 INFO:tasks.workunit.client.1.smithi134.stdout:6/97: truncate f0 1184056 0 2023-12-05T09:26:08.820 INFO:tasks.workunit.client.1.smithi134.stdout:6/98: fsync d4/d8/f16 0 2023-12-05T09:26:08.820 INFO:tasks.workunit.client.0.smithi067.stdout:0/113: fsync d3/f4 0 2023-12-05T09:26:08.820 INFO:tasks.workunit.client.0.smithi067.stdout:1/74: creat d2/d5/d7/de/d10/f1e x:0 0 0 2023-12-05T09:26:08.820 INFO:tasks.workunit.client.0.smithi067.stdout:1/75: dread - d2/d5/d7/de/d10/f1e zero size 2023-12-05T09:26:08.822 INFO:tasks.workunit.client.0.smithi067.stdout:1/76: getdents d2/d3 0 2023-12-05T09:26:08.826 INFO:tasks.workunit.client.0.smithi067.stdout:1/77: symlink d2/d3/l1f 0 2023-12-05T09:26:08.827 INFO:tasks.workunit.client.1.smithi134.stdout:1/133: mknod d2/c31 0 2023-12-05T09:26:08.827 INFO:tasks.workunit.client.1.smithi134.stdout:9/91: mknod d7/d8/d16/c20 0 2023-12-05T09:26:08.827 INFO:tasks.workunit.client.1.smithi134.stdout:9/92: dread - d7/d8/d16/f1f zero size 2023-12-05T09:26:08.827 INFO:tasks.workunit.client.1.smithi134.stdout:1/134: dread - d2/d9/d10/f13 zero size 2023-12-05T09:26:08.828 INFO:tasks.workunit.client.1.smithi134.stdout:6/99: rename d4/f1a to d4/db/f20 0 2023-12-05T09:26:08.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/56: dwrite db/df/f12 [0,4194304] 0 2023-12-05T09:26:08.834 INFO:tasks.workunit.client.1.smithi134.stdout:9/93: rename d7/c17 to d7/d8/d16/c21 0 2023-12-05T09:26:08.836 INFO:tasks.workunit.client.0.smithi067.stdout:7/103: dwrite d0/f11 [0,4194304] 0 2023-12-05T09:26:08.838 INFO:tasks.workunit.client.1.smithi134.stdout:0/111: dread fd [0,4194304] 0 2023-12-05T09:26:08.843 INFO:tasks.workunit.client.1.smithi134.stdout:0/112: unlink d13/d14/d19/f20 0 2023-12-05T09:26:08.847 INFO:tasks.workunit.client.0.smithi067.stdout:5/57: mkdir db/df/d1a 0 2023-12-05T09:26:08.851 INFO:tasks.workunit.client.0.smithi067.stdout:1/78: dread d2/d5/d7/de/d10/d15/f1c [0,4194304] 0 2023-12-05T09:26:08.852 INFO:tasks.workunit.client.1.smithi134.stdout:5/111: dwrite d0/d11/f15 [0,4194304] 0 2023-12-05T09:26:08.852 INFO:tasks.workunit.client.0.smithi067.stdout:1/79: truncate d2/f13 881860 0 2023-12-05T09:26:08.852 INFO:tasks.workunit.client.0.smithi067.stdout:1/80: truncate d2/f13 1522951 0 2023-12-05T09:26:08.855 INFO:tasks.workunit.client.0.smithi067.stdout:5/58: dread db/fe [0,4194304] 0 2023-12-05T09:26:08.855 INFO:tasks.workunit.client.0.smithi067.stdout:5/59: readlink db/df/l19 0 2023-12-05T09:26:08.855 INFO:tasks.workunit.client.0.smithi067.stdout:5/60: write db/df/f15 [2734826,52213] 0 2023-12-05T09:26:08.873 INFO:tasks.workunit.client.0.smithi067.stdout:1/81: mkdir d2/d5/d7/de/d10/d14/d20 0 2023-12-05T09:26:08.874 INFO:tasks.workunit.client.0.smithi067.stdout:5/61: mknod db/df/d1a/c1b 0 2023-12-05T09:26:08.875 INFO:tasks.workunit.client.1.smithi134.stdout:0/113: creat d13/d14/d15/f21 x:0 0 0 2023-12-05T09:26:08.876 INFO:tasks.workunit.client.1.smithi134.stdout:0/114: fdatasync f3 0 2023-12-05T09:26:08.876 INFO:tasks.workunit.client.1.smithi134.stdout:0/115: dread - d13/d14/d15/f21 zero size 2023-12-05T09:26:08.876 INFO:tasks.workunit.client.0.smithi067.stdout:7/104: creat d0/d9/d10/d1d/f26 x:0 0 0 2023-12-05T09:26:08.877 INFO:tasks.workunit.client.1.smithi134.stdout:3/93: dwrite d4/d5/fe [0,4194304] 0 2023-12-05T09:26:08.877 INFO:tasks.workunit.client.1.smithi134.stdout:3/94: fdatasync d4/f17 0 2023-12-05T09:26:08.880 INFO:tasks.workunit.client.0.smithi067.stdout:5/62: creat db/df/d1a/f1c x:0 0 0 2023-12-05T09:26:08.882 INFO:tasks.workunit.client.1.smithi134.stdout:5/112: rename d0/la to d0/dd/l28 0 2023-12-05T09:26:08.885 INFO:tasks.workunit.client.0.smithi067.stdout:7/105: truncate d0/f6 871441 0 2023-12-05T09:26:08.885 INFO:tasks.workunit.client.1.smithi134.stdout:0/116: write fd [3411137,45718] 0 2023-12-05T09:26:08.889 INFO:tasks.workunit.client.0.smithi067.stdout:9/191: dwrite f19 [0,4194304] 0 2023-12-05T09:26:08.889 INFO:tasks.workunit.client.1.smithi134.stdout:2/132: dwrite f10 [4194304,4194304] 0 2023-12-05T09:26:08.892 INFO:tasks.workunit.client.1.smithi134.stdout:5/113: creat d0/f29 x:0 0 0 2023-12-05T09:26:08.896 INFO:tasks.workunit.client.0.smithi067.stdout:1/82: dread d2/d3/f16 [0,4194304] 0 2023-12-05T09:26:08.897 INFO:tasks.workunit.client.1.smithi134.stdout:6/100: fsync d4/ff 0 2023-12-05T09:26:08.904 INFO:tasks.workunit.client.0.smithi067.stdout:5/63: dread f9 [0,4194304] 0 2023-12-05T09:26:08.906 INFO:tasks.workunit.client.1.smithi134.stdout:0/117: dread d13/f17 [0,4194304] 0 2023-12-05T09:26:08.906 INFO:tasks.workunit.client.0.smithi067.stdout:5/64: unlink f4 0 2023-12-05T09:26:08.907 INFO:tasks.workunit.client.1.smithi134.stdout:1/135: dwrite d2/d9/d10/f1d [0,4194304] 0 2023-12-05T09:26:08.909 INFO:tasks.workunit.client.0.smithi067.stdout:0/114: dwrite d3/df/f16 [0,4194304] 0 2023-12-05T09:26:08.909 INFO:tasks.workunit.client.1.smithi134.stdout:7/93: dwrite d2/df/f15 [0,4194304] 0 2023-12-05T09:26:08.913 INFO:tasks.workunit.client.0.smithi067.stdout:1/83: dread d2/d5/d7/de/d10/d15/f1c [0,4194304] 0 2023-12-05T09:26:08.916 INFO:tasks.workunit.client.0.smithi067.stdout:0/115: link d3/df/d10/c14 d3/df/d10/c23 0 2023-12-05T09:26:08.918 INFO:tasks.workunit.client.1.smithi134.stdout:7/94: unlink l0 0 2023-12-05T09:26:08.918 INFO:tasks.workunit.client.1.smithi134.stdout:7/95: chown d2/l6 20 1 2023-12-05T09:26:08.919 INFO:tasks.workunit.client.0.smithi067.stdout:1/84: creat d2/d3/f21 x:0 0 0 2023-12-05T09:26:08.919 INFO:tasks.workunit.client.0.smithi067.stdout:5/65: getdents db/df/d1a 0 2023-12-05T09:26:08.920 INFO:tasks.workunit.client.0.smithi067.stdout:0/116: creat d3/df/f24 x:0 0 0 2023-12-05T09:26:08.925 INFO:tasks.workunit.client.0.smithi067.stdout:5/66: mkdir db/df/d1a/d1d 0 2023-12-05T09:26:08.928 INFO:tasks.workunit.client.0.smithi067.stdout:1/85: dread d2/f13 [0,4194304] 0 2023-12-05T09:26:08.928 INFO:tasks.workunit.client.0.smithi067.stdout:7/106: write d0/d9/d10/f1a [179995,81731] 0 2023-12-05T09:26:08.934 INFO:tasks.workunit.client.0.smithi067.stdout:1/86: mknod d2/c22 0 2023-12-05T09:26:08.939 INFO:tasks.workunit.client.1.smithi134.stdout:0/118: write f3 [3866798,83804] 0 2023-12-05T09:26:08.939 INFO:tasks.workunit.client.0.smithi067.stdout:1/87: symlink d2/l23 0 2023-12-05T09:26:08.940 INFO:tasks.workunit.client.0.smithi067.stdout:7/107: rename d0/d9/f14 to d0/f27 0 2023-12-05T09:26:08.940 INFO:tasks.workunit.client.1.smithi134.stdout:0/119: rename d13/l1d to d13/d14/l22 0 2023-12-05T09:26:08.942 INFO:tasks.workunit.client.1.smithi134.stdout:0/120: truncate d13/f17 820650 0 2023-12-05T09:26:08.944 INFO:tasks.workunit.client.0.smithi067.stdout:1/88: getdents d2/d5 0 2023-12-05T09:26:08.944 INFO:tasks.workunit.client.0.smithi067.stdout:1/89: write d2/d5/d7/de/d10/f1e [560953,46591] 0 2023-12-05T09:26:08.944 INFO:tasks.workunit.client.0.smithi067.stdout:1/90: creat d2/f24 x:0 0 0 2023-12-05T09:26:08.944 INFO:tasks.workunit.client.1.smithi134.stdout:2/133: dwrite f18 [0,4194304] 0 2023-12-05T09:26:08.944 INFO:tasks.workunit.client.1.smithi134.stdout:2/134: write fd [430438,65824] 0 2023-12-05T09:26:08.947 INFO:tasks.workunit.client.1.smithi134.stdout:2/135: symlink d19/d28/d2b/l2e 0 2023-12-05T09:26:08.948 INFO:tasks.workunit.client.0.smithi067.stdout:1/91: getdents d2/d5/d7/de/d1a 0 2023-12-05T09:26:08.950 INFO:tasks.workunit.client.0.smithi067.stdout:9/192: dwrite fa [0,4194304] 0 2023-12-05T09:26:08.952 INFO:tasks.workunit.client.0.smithi067.stdout:5/67: write f6 [1239589,69196] 0 2023-12-05T09:26:08.956 INFO:tasks.workunit.client.1.smithi134.stdout:9/94: sync 2023-12-05T09:26:08.956 INFO:tasks.workunit.client.1.smithi134.stdout:8/118: sync 2023-12-05T09:26:08.956 INFO:tasks.workunit.client.1.smithi134.stdout:4/102: sync 2023-12-05T09:26:08.956 INFO:tasks.workunit.client.1.smithi134.stdout:4/103: dread - d16/d18/d1b/d24/f25 zero size 2023-12-05T09:26:08.956 INFO:tasks.workunit.client.1.smithi134.stdout:1/136: dwrite d2/f19 [0,4194304] 0 2023-12-05T09:26:08.956 INFO:tasks.workunit.client.1.smithi134.stdout:1/137: truncate d2/d9/d10/f13 103713 0 2023-12-05T09:26:08.958 INFO:tasks.workunit.client.1.smithi134.stdout:3/95: dwrite f3 [0,4194304] 0 2023-12-05T09:26:08.963 INFO:tasks.workunit.client.0.smithi067.stdout:0/117: getdents d3/df 0 2023-12-05T09:26:08.963 INFO:tasks.workunit.client.0.smithi067.stdout:0/118: write d3/f5 [4826434,48435] 0 2023-12-05T09:26:08.963 INFO:tasks.workunit.client.0.smithi067.stdout:0/119: write d3/f1d [1607677,77157] 0 2023-12-05T09:26:08.965 INFO:tasks.workunit.client.1.smithi134.stdout:8/119: getdents da/de/d11/d1d 0 2023-12-05T09:26:08.965 INFO:tasks.workunit.client.1.smithi134.stdout:4/104: symlink d16/l26 0 2023-12-05T09:26:08.968 INFO:tasks.workunit.client.0.smithi067.stdout:9/193: symlink d1b/l42 0 2023-12-05T09:26:08.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/108: dread d0/f7 [0,4194304] 0 2023-12-05T09:26:08.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/109: dread - d0/d9/d1b/f1e zero size 2023-12-05T09:26:08.968 INFO:tasks.workunit.client.0.smithi067.stdout:1/92: rename d2/l23 to d2/d3/l25 0 2023-12-05T09:26:08.969 INFO:tasks.workunit.client.0.smithi067.stdout:5/68: mknod db/df/c1e 0 2023-12-05T09:26:08.969 INFO:tasks.workunit.client.0.smithi067.stdout:5/69: chown db/df/d1a/d1d 128242 1 2023-12-05T09:26:08.970 INFO:tasks.workunit.client.1.smithi134.stdout:3/96: link d4/f17 d4/d1f/f24 0 2023-12-05T09:26:08.973 INFO:tasks.workunit.client.0.smithi067.stdout:9/194: write d1b/f24 [75293,114444] 0 2023-12-05T09:26:08.973 INFO:tasks.workunit.client.1.smithi134.stdout:8/120: rename da/de/fc to da/de/f27 0 2023-12-05T09:26:08.973 INFO:tasks.workunit.client.1.smithi134.stdout:8/121: chown da/de/d11/d1d/l1f 29453080 1 2023-12-05T09:26:08.973 INFO:tasks.workunit.client.1.smithi134.stdout:4/105: symlink d16/d18/d1b/l27 0 2023-12-05T09:26:08.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/195: truncate d1b/d25/f32 93782 0 2023-12-05T09:26:08.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/196: truncate f11 4362005 0 2023-12-05T09:26:08.977 INFO:tasks.workunit.client.0.smithi067.stdout:5/70: rename f7 to db/f1f 0 2023-12-05T09:26:08.977 INFO:tasks.workunit.client.0.smithi067.stdout:5/71: chown db/df/f15 57004 1 2023-12-05T09:26:08.977 INFO:tasks.workunit.client.1.smithi134.stdout:8/122: symlink da/de/d16/l28 0 2023-12-05T09:26:08.978 INFO:tasks.workunit.client.1.smithi134.stdout:8/123: creat da/f29 x:0 0 0 2023-12-05T09:26:08.978 INFO:tasks.workunit.client.1.smithi134.stdout:8/124: creat da/f2a x:0 0 0 2023-12-05T09:26:08.978 INFO:tasks.workunit.client.1.smithi134.stdout:8/125: dread - da/de/d16/f23 zero size 2023-12-05T09:26:08.981 INFO:tasks.workunit.client.1.smithi134.stdout:1/138: dread d2/f19 [0,4194304] 0 2023-12-05T09:26:08.982 INFO:tasks.workunit.client.0.smithi067.stdout:5/72: mkdir db/df/d1a/d1d/d20 0 2023-12-05T09:26:08.984 INFO:tasks.workunit.client.0.smithi067.stdout:5/73: creat db/df/d1a/f21 x:0 0 0 2023-12-05T09:26:08.989 INFO:tasks.workunit.client.1.smithi134.stdout:1/139: rename d2/d9/la to d2/d9/d10/d30/l32 0 2023-12-05T09:26:08.992 INFO:tasks.workunit.client.0.smithi067.stdout:2/67: sync 2023-12-05T09:26:08.992 INFO:tasks.workunit.client.0.smithi067.stdout:6/25: sync 2023-12-05T09:26:08.992 INFO:tasks.workunit.client.0.smithi067.stdout:8/85: sync 2023-12-05T09:26:08.992 INFO:tasks.workunit.client.0.smithi067.stdout:4/34: sync 2023-12-05T09:26:08.992 INFO:tasks.workunit.client.0.smithi067.stdout:8/86: dread - d5/dc/f19 zero size 2023-12-05T09:26:08.992 INFO:tasks.workunit.client.1.smithi134.stdout:5/114: dwrite d0/d11/f1e [0,4194304] 0 2023-12-05T09:26:08.993 INFO:tasks.workunit.client.0.smithi067.stdout:1/93: write d2/d5/d7/de/d1a/f1b [1877356,48222] 0 2023-12-05T09:26:08.993 INFO:tasks.workunit.client.0.smithi067.stdout:8/87: truncate d5/f18 190370 0 2023-12-05T09:26:08.995 INFO:tasks.workunit.client.0.smithi067.stdout:4/35: write d0/f4 [603748,122654] 0 2023-12-05T09:26:08.995 INFO:tasks.workunit.client.0.smithi067.stdout:4/36: fdatasync d0/f6 0 2023-12-05T09:26:08.995 INFO:tasks.workunit.client.0.smithi067.stdout:4/37: readlink - no filename 2023-12-05T09:26:08.996 INFO:tasks.workunit.client.1.smithi134.stdout:8/126: truncate f3 2345644 0 2023-12-05T09:26:08.996 INFO:tasks.workunit.client.0.smithi067.stdout:3/21: sync 2023-12-05T09:26:08.996 INFO:tasks.workunit.client.0.smithi067.stdout:3/22: creat f8 x:0 0 0 2023-12-05T09:26:08.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/121: write fc [1876285,127624] 0 2023-12-05T09:26:09.002 INFO:tasks.workunit.client.0.smithi067.stdout:9/197: dread f10 [0,4194304] 0 2023-12-05T09:26:09.002 INFO:tasks.workunit.client.0.smithi067.stdout:9/198: truncate d1b/d25/f3c 628399 0 2023-12-05T09:26:09.003 INFO:tasks.workunit.client.1.smithi134.stdout:4/106: dread f13 [0,4194304] 0 2023-12-05T09:26:09.003 INFO:tasks.workunit.client.1.smithi134.stdout:7/96: dwrite d2/f8 [0,4194304] 0 2023-12-05T09:26:09.004 INFO:tasks.workunit.client.1.smithi134.stdout:1/140: rename l0 to d2/d27/l33 0 2023-12-05T09:26:09.007 INFO:tasks.workunit.client.0.smithi067.stdout:7/110: write d0/f6 [1171466,59590] 0 2023-12-05T09:26:09.007 INFO:tasks.workunit.client.0.smithi067.stdout:7/111: chown d0/d9/d10/d1d 13704 1 2023-12-05T09:26:09.008 INFO:tasks.workunit.client.0.smithi067.stdout:7/112: readlink d0/d9/d10/d22/l25 0 2023-12-05T09:26:09.008 INFO:tasks.workunit.client.0.smithi067.stdout:7/113: fsync d0/f27 0 2023-12-05T09:26:09.010 INFO:tasks.workunit.client.0.smithi067.stdout:0/120: dread d3/f5 [0,4194304] 0 2023-12-05T09:26:09.011 INFO:tasks.workunit.client.0.smithi067.stdout:6/26: link f2 f3 0 2023-12-05T09:26:09.011 INFO:tasks.workunit.client.0.smithi067.stdout:6/27: creat f4 x:0 0 0 2023-12-05T09:26:09.013 INFO:tasks.workunit.client.1.smithi134.stdout:5/115: mknod d0/c2a 0 2023-12-05T09:26:09.015 INFO:tasks.workunit.client.0.smithi067.stdout:4/38: creat d0/d9/fb x:0 0 0 2023-12-05T09:26:09.015 INFO:tasks.workunit.client.0.smithi067.stdout:1/94: creat d2/d5/d7/de/d10/d14/d20/f26 x:0 0 0 2023-12-05T09:26:09.015 INFO:tasks.workunit.client.1.smithi134.stdout:7/97: truncate d2/d7/f13 454641 0 2023-12-05T09:26:09.015 INFO:tasks.workunit.client.1.smithi134.stdout:4/107: truncate f6 145394 0 2023-12-05T09:26:09.016 INFO:tasks.workunit.client.1.smithi134.stdout:7/98: creat d2/d7/d10/f20 x:0 0 0 2023-12-05T09:26:09.016 INFO:tasks.workunit.client.0.smithi067.stdout:9/199: write f16 [18028,113966] 0 2023-12-05T09:26:09.021 INFO:tasks.workunit.client.1.smithi134.stdout:4/108: rmdir d16/d18/d1c 39 2023-12-05T09:26:09.024 INFO:tasks.workunit.client.1.smithi134.stdout:7/99: creat d2/f21 x:0 0 0 2023-12-05T09:26:09.025 INFO:tasks.workunit.client.1.smithi134.stdout:4/109: getdents d16/d18 0 2023-12-05T09:26:09.026 INFO:tasks.workunit.client.1.smithi134.stdout:4/110: write f15 [389441,69674] 0 2023-12-05T09:26:09.030 INFO:tasks.workunit.client.0.smithi067.stdout:3/23: truncate f4 2311899 0 2023-12-05T09:26:09.032 INFO:tasks.workunit.client.0.smithi067.stdout:7/114: link d0/d9/d10/f1a d0/d9/d10/d22/f28 0 2023-12-05T09:26:09.035 INFO:tasks.workunit.client.0.smithi067.stdout:0/121: creat d3/df/f25 x:0 0 0 2023-12-05T09:26:09.035 INFO:tasks.workunit.client.0.smithi067.stdout:0/122: creat d3/df/f26 x:0 0 0 2023-12-05T09:26:09.039 INFO:tasks.workunit.client.0.smithi067.stdout:6/28: rename f3 to f5 0 2023-12-05T09:26:09.039 INFO:tasks.workunit.client.0.smithi067.stdout:6/29: readlink - no filename 2023-12-05T09:26:09.040 INFO:tasks.workunit.client.0.smithi067.stdout:6/30: fdatasync f4 0 2023-12-05T09:26:09.043 INFO:tasks.workunit.client.0.smithi067.stdout:3/24: mkdir d9 0 2023-12-05T09:26:09.043 INFO:tasks.workunit.client.0.smithi067.stdout:7/115: getdents d0/d9/d10 0 2023-12-05T09:26:09.051 INFO:tasks.workunit.client.0.smithi067.stdout:0/123: link d3/d7/l1b d3/l27 0 2023-12-05T09:26:09.051 INFO:tasks.workunit.client.0.smithi067.stdout:3/25: mkdir d9/da 0 2023-12-05T09:26:09.051 INFO:tasks.workunit.client.1.smithi134.stdout:2/136: dwrite d19/f25 [0,4194304] 0 2023-12-05T09:26:09.055 INFO:tasks.workunit.client.0.smithi067.stdout:5/74: write db/fe [309108,63693] 0 2023-12-05T09:26:09.055 INFO:tasks.workunit.client.0.smithi067.stdout:5/75: write db/df/f15 [3618055,19979] 0 2023-12-05T09:26:09.055 INFO:tasks.workunit.client.0.smithi067.stdout:6/31: mknod c6 0 2023-12-05T09:26:09.055 INFO:tasks.workunit.client.0.smithi067.stdout:6/32: stat c6 0 2023-12-05T09:26:09.065 INFO:tasks.workunit.client.0.smithi067.stdout:5/76: link f6 db/df/f22 0 2023-12-05T09:26:09.068 INFO:tasks.workunit.client.1.smithi134.stdout:4/111: fsync f15 0 2023-12-05T09:26:09.069 INFO:tasks.workunit.client.1.smithi134.stdout:6/101: dwrite d4/f17 [0,4194304] 0 2023-12-05T09:26:09.069 INFO:tasks.workunit.client.1.smithi134.stdout:4/112: creat d16/d18/d1b/d24/f28 x:0 0 0 2023-12-05T09:26:09.076 INFO:tasks.workunit.client.1.smithi134.stdout:6/102: write d4/ff [347326,42180] 0 2023-12-05T09:26:09.077 INFO:tasks.workunit.client.1.smithi134.stdout:9/95: dwrite d7/f1c [0,4194304] 0 2023-12-05T09:26:09.077 INFO:tasks.workunit.client.1.smithi134.stdout:9/96: fdatasync f1 0 2023-12-05T09:26:09.077 INFO:tasks.workunit.client.1.smithi134.stdout:9/97: fdatasync d7/fb 0 2023-12-05T09:26:09.077 INFO:tasks.workunit.client.1.smithi134.stdout:0/122: dread fc [0,4194304] 0 2023-12-05T09:26:09.078 INFO:tasks.workunit.client.1.smithi134.stdout:0/123: truncate fa 4421862 0 2023-12-05T09:26:09.078 INFO:tasks.workunit.client.1.smithi134.stdout:4/113: mkdir d16/d18/d1b/d24/d29 0 2023-12-05T09:26:09.083 INFO:tasks.workunit.client.0.smithi067.stdout:0/124: dread d3/d7/fc [0,4194304] 0 2023-12-05T09:26:09.085 INFO:tasks.workunit.client.0.smithi067.stdout:2/68: dwrite d0/f9 [0,4194304] 0 2023-12-05T09:26:09.085 INFO:tasks.workunit.client.0.smithi067.stdout:0/125: link d3/df/f24 d3/f28 0 2023-12-05T09:26:09.085 INFO:tasks.workunit.client.0.smithi067.stdout:0/126: chown d3/l27 950360 1 2023-12-05T09:26:09.085 INFO:tasks.workunit.client.0.smithi067.stdout:0/127: truncate d3/f5 5010978 0 2023-12-05T09:26:09.085 INFO:tasks.workunit.client.0.smithi067.stdout:0/128: chown d3/df/d10/f1f 204288330 1 2023-12-05T09:26:09.087 INFO:tasks.workunit.client.1.smithi134.stdout:6/103: stat d4/d8/da/l13 0 2023-12-05T09:26:09.087 INFO:tasks.workunit.client.1.smithi134.stdout:6/104: readlink d4/d8/da/l14 0 2023-12-05T09:26:09.087 INFO:tasks.workunit.client.1.smithi134.stdout:5/116: dwrite d0/dd/f14 [0,4194304] 0 2023-12-05T09:26:09.087 INFO:tasks.workunit.client.1.smithi134.stdout:5/117: chown d0/l13 2558 1 2023-12-05T09:26:09.088 INFO:tasks.workunit.client.1.smithi134.stdout:2/137: write f10 [6847293,49986] 0 2023-12-05T09:26:09.089 INFO:tasks.workunit.client.1.smithi134.stdout:8/127: dwrite da/de/d16/f26 [0,4194304] 0 2023-12-05T09:26:09.089 INFO:tasks.workunit.client.1.smithi134.stdout:9/98: symlink d7/d10/l22 0 2023-12-05T09:26:09.089 INFO:tasks.workunit.client.1.smithi134.stdout:5/118: symlink d0/d1a/d1c/d25/l2b 0 2023-12-05T09:26:09.090 INFO:tasks.workunit.client.0.smithi067.stdout:5/77: write db/df/f15 [2698624,71026] 0 2023-12-05T09:26:09.090 INFO:tasks.workunit.client.0.smithi067.stdout:5/78: chown db/df/d1a 1741806430 1 2023-12-05T09:26:09.091 INFO:tasks.workunit.client.0.smithi067.stdout:5/79: fdatasync db/fc 0 2023-12-05T09:26:09.091 INFO:tasks.workunit.client.0.smithi067.stdout:2/69: symlink d0/l17 0 2023-12-05T09:26:09.091 INFO:tasks.workunit.client.0.smithi067.stdout:0/129: creat d3/d7/f29 x:0 0 0 2023-12-05T09:26:09.094 INFO:tasks.workunit.client.0.smithi067.stdout:2/70: rename d0/c8 to d0/c18 0 2023-12-05T09:26:09.095 INFO:tasks.workunit.client.1.smithi134.stdout:2/138: creat d19/d28/d2b/f2f x:0 0 0 2023-12-05T09:26:09.096 INFO:tasks.workunit.client.0.smithi067.stdout:0/130: rename d3/df/c19 to d3/c2a 0 2023-12-05T09:26:09.096 INFO:tasks.workunit.client.0.smithi067.stdout:0/131: chown d3/df/f21 1222 1 2023-12-05T09:26:09.097 INFO:tasks.workunit.client.1.smithi134.stdout:9/99: mkdir d7/d10/d23 0 2023-12-05T09:26:09.099 INFO:tasks.workunit.client.1.smithi134.stdout:8/128: link da/de/d16/f23 da/de/f2b 0 2023-12-05T09:26:09.099 INFO:tasks.workunit.client.1.smithi134.stdout:8/129: chown da/de/d16/f26 104 1 2023-12-05T09:26:09.101 INFO:tasks.workunit.client.1.smithi134.stdout:5/119: truncate d0/d11/f15 2409532 0 2023-12-05T09:26:09.101 INFO:tasks.workunit.client.1.smithi134.stdout:9/100: mknod d7/d8/d14/c24 0 2023-12-05T09:26:09.103 INFO:tasks.workunit.client.1.smithi134.stdout:8/130: mknod da/de/d11/c2c 0 2023-12-05T09:26:09.103 INFO:tasks.workunit.client.0.smithi067.stdout:2/71: rename d0/f3 to d0/d10/f19 0 2023-12-05T09:26:09.103 INFO:tasks.workunit.client.0.smithi067.stdout:2/72: fdatasync d0/fe 0 2023-12-05T09:26:09.105 INFO:tasks.workunit.client.1.smithi134.stdout:5/120: link d0/f29 d0/dd/f2c 0 2023-12-05T09:26:09.107 INFO:tasks.workunit.client.1.smithi134.stdout:9/101: unlink d7/d8/fc 0 2023-12-05T09:26:09.107 INFO:tasks.workunit.client.1.smithi134.stdout:9/102: getdents d7/d10/d23 0 2023-12-05T09:26:09.107 INFO:tasks.workunit.client.0.smithi067.stdout:0/132: truncate d3/fa 295185 0 2023-12-05T09:26:09.108 INFO:tasks.workunit.client.1.smithi134.stdout:8/131: mkdir da/de/d16/d2d 0 2023-12-05T09:26:09.110 INFO:tasks.workunit.client.1.smithi134.stdout:5/121: creat d0/d1a/d1c/d25/f2d x:0 0 0 2023-12-05T09:26:09.111 INFO:tasks.workunit.client.0.smithi067.stdout:6/33: fsync f4 0 2023-12-05T09:26:09.112 INFO:tasks.workunit.client.1.smithi134.stdout:7/100: write d2/d7/f13 [326492,95327] 0 2023-12-05T09:26:09.113 INFO:tasks.workunit.client.1.smithi134.stdout:3/97: dwrite d4/d5/fe [0,4194304] 0 2023-12-05T09:26:09.113 INFO:tasks.workunit.client.1.smithi134.stdout:3/98: readlink d4/lf 0 2023-12-05T09:26:09.114 INFO:tasks.workunit.client.1.smithi134.stdout:3/99: creat d4/d1f/f25 x:0 0 0 2023-12-05T09:26:09.114 INFO:tasks.workunit.client.1.smithi134.stdout:3/100: chown d4/f12 406028 1 2023-12-05T09:26:09.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/122: symlink d0/l2e 0 2023-12-05T09:26:09.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/123: creat d0/d11/f2f x:0 0 0 2023-12-05T09:26:09.118 INFO:tasks.workunit.client.1.smithi134.stdout:9/103: rename d7/fb to d7/d8/d14/f25 0 2023-12-05T09:26:09.123 INFO:tasks.workunit.client.1.smithi134.stdout:7/101: rename d2/df/d17 to d2/d7/dc/d22 0 2023-12-05T09:26:09.124 INFO:tasks.workunit.client.1.smithi134.stdout:7/102: stat d2 0 2023-12-05T09:26:09.127 INFO:tasks.workunit.client.0.smithi067.stdout:9/200: dwrite d1b/f20 [0,4194304] 0 2023-12-05T09:26:09.128 INFO:tasks.workunit.client.1.smithi134.stdout:2/139: write f6 [1261284,44587] 0 2023-12-05T09:26:09.128 INFO:tasks.workunit.client.1.smithi134.stdout:2/140: creat d19/d28/f30 x:0 0 0 2023-12-05T09:26:09.128 INFO:tasks.workunit.client.1.smithi134.stdout:2/141: write d19/f2c [284214,102980] 0 2023-12-05T09:26:09.128 INFO:tasks.workunit.client.1.smithi134.stdout:2/142: chown d19/f2c 2499497 1 2023-12-05T09:26:09.130 INFO:tasks.workunit.client.1.smithi134.stdout:1/141: dwrite d2/f20 [0,4194304] 0 2023-12-05T09:26:09.131 INFO:tasks.workunit.client.1.smithi134.stdout:1/142: chown d2/d27/l33 42918 1 2023-12-05T09:26:09.131 INFO:tasks.workunit.client.1.smithi134.stdout:1/143: chown d2/l25 213 1 2023-12-05T09:26:09.135 INFO:tasks.workunit.client.0.smithi067.stdout:9/201: unlink f16 0 2023-12-05T09:26:09.135 INFO:tasks.workunit.client.0.smithi067.stdout:9/202: chown d1b/d25/c3a 448 1 2023-12-05T09:26:09.137 INFO:tasks.workunit.client.1.smithi134.stdout:9/104: rename d7/d10/d23 to d7/d8/d14/d26 0 2023-12-05T09:26:09.137 INFO:tasks.workunit.client.1.smithi134.stdout:7/103: creat d2/dd/d1a/f23 x:0 0 0 2023-12-05T09:26:09.138 INFO:tasks.workunit.client.0.smithi067.stdout:6/34: dread f2 [0,4194304] 0 2023-12-05T09:26:09.140 INFO:tasks.workunit.client.1.smithi134.stdout:8/132: write da/de/d11/f1a [4073837,43481] 0 2023-12-05T09:26:09.140 INFO:tasks.workunit.client.1.smithi134.stdout:8/133: dread - da/de/d16/f23 zero size 2023-12-05T09:26:09.140 INFO:tasks.workunit.client.1.smithi134.stdout:8/134: chown da/de/d16/l28 3 1 2023-12-05T09:26:09.142 INFO:tasks.workunit.client.1.smithi134.stdout:8/135: creat da/de/d11/d1d/f2e x:0 0 0 2023-12-05T09:26:09.143 INFO:tasks.workunit.client.0.smithi067.stdout:9/203: rename f9 to d1b/d25/d35/f43 0 2023-12-05T09:26:09.145 INFO:tasks.workunit.client.0.smithi067.stdout:9/204: rename d1b/l22 to d1b/d3e/l44 0 2023-12-05T09:26:09.147 INFO:tasks.workunit.client.0.smithi067.stdout:9/205: truncate fa 942827 0 2023-12-05T09:26:09.153 INFO:tasks.workunit.client.1.smithi134.stdout:8/136: creat da/d1b/f2f x:0 0 0 2023-12-05T09:26:09.155 INFO:tasks.workunit.client.0.smithi067.stdout:9/206: rmdir d1b/d25 39 2023-12-05T09:26:09.157 INFO:tasks.workunit.client.0.smithi067.stdout:0/133: write d3/df/d10/f1a [789524,4663] 0 2023-12-05T09:26:09.171 INFO:tasks.workunit.client.1.smithi134.stdout:3/101: rmdir d4/d1f 39 2023-12-05T09:26:09.177 INFO:tasks.workunit.client.1.smithi134.stdout:3/102: link d4/d1f/f20 d4/d1f/f26 0 2023-12-05T09:26:09.179 INFO:tasks.workunit.client.1.smithi134.stdout:4/114: dwrite d16/d18/d1a/f20 [0,4194304] 0 2023-12-05T09:26:09.180 INFO:tasks.workunit.client.1.smithi134.stdout:4/115: write d16/d18/d1b/d24/f25 [42048,4461] 0 2023-12-05T09:26:09.196 INFO:tasks.workunit.client.0.smithi067.stdout:5/80: dwrite f9 [0,4194304] 0 2023-12-05T09:26:09.196 INFO:tasks.workunit.client.0.smithi067.stdout:9/207: read d1b/d25/f40 [762007,83104] 0 2023-12-05T09:26:09.197 INFO:tasks.workunit.client.1.smithi134.stdout:3/103: dread f3 [0,4194304] 0 2023-12-05T09:26:09.198 INFO:tasks.workunit.client.1.smithi134.stdout:3/104: read - d4/fb zero size 2023-12-05T09:26:09.199 INFO:tasks.workunit.client.0.smithi067.stdout:5/81: creat db/df/d1a/d1d/f23 x:0 0 0 2023-12-05T09:26:09.200 INFO:tasks.workunit.client.0.smithi067.stdout:9/208: symlink d1b/d25/l45 0 2023-12-05T09:26:09.200 INFO:tasks.workunit.client.0.smithi067.stdout:9/209: chown d1b 9462 1 2023-12-05T09:26:09.206 INFO:tasks.workunit.client.0.smithi067.stdout:9/210: unlink d1b/d25/c39 0 2023-12-05T09:26:09.208 INFO:tasks.workunit.client.1.smithi134.stdout:4/116: dread d16/d18/d1b/d24/f25 [0,4194304] 0 2023-12-05T09:26:09.208 INFO:tasks.workunit.client.1.smithi134.stdout:4/117: creat d16/d18/d1b/d24/f2a x:0 0 0 2023-12-05T09:26:09.210 INFO:tasks.workunit.client.0.smithi067.stdout:6/35: dwrite f5 [0,4194304] 0 2023-12-05T09:26:09.212 INFO:tasks.workunit.client.0.smithi067.stdout:9/211: creat d1b/d25/f46 x:0 0 0 2023-12-05T09:26:09.213 INFO:tasks.workunit.client.1.smithi134.stdout:3/105: dread f0 [0,4194304] 0 2023-12-05T09:26:09.214 INFO:tasks.workunit.client.0.smithi067.stdout:6/36: link c0 c7 0 2023-12-05T09:26:09.215 INFO:tasks.workunit.client.1.smithi134.stdout:8/137: read da/de/f27 [739868,56517] 0 2023-12-05T09:26:09.215 INFO:tasks.workunit.client.1.smithi134.stdout:4/118: link c12 d16/d18/d1a/c2b 0 2023-12-05T09:26:09.216 INFO:tasks.workunit.client.1.smithi134.stdout:0/124: dwrite fc [0,4194304] 0 2023-12-05T09:26:09.220 INFO:tasks.workunit.client.0.smithi067.stdout:6/37: rename f5 to f8 0 2023-12-05T09:26:09.221 INFO:tasks.workunit.client.0.smithi067.stdout:6/38: mknod c9 0 2023-12-05T09:26:09.224 INFO:tasks.workunit.client.0.smithi067.stdout:5/82: rmdir db 39 2023-12-05T09:26:09.225 INFO:tasks.workunit.client.1.smithi134.stdout:1/144: dread d2/d9/f24 [0,4194304] 0 2023-12-05T09:26:09.226 INFO:tasks.workunit.client.1.smithi134.stdout:3/106: dread f3 [0,4194304] 0 2023-12-05T09:26:09.226 INFO:tasks.workunit.client.1.smithi134.stdout:3/107: rename d4 to d4/d5/d23/d27 22 2023-12-05T09:26:09.227 INFO:tasks.workunit.client.0.smithi067.stdout:6/39: mkdir da 0 2023-12-05T09:26:09.228 INFO:tasks.workunit.client.0.smithi067.stdout:5/83: creat db/df/d1a/d1d/f24 x:0 0 0 2023-12-05T09:26:09.228 INFO:tasks.workunit.client.0.smithi067.stdout:5/84: dread - db/df/d1a/d1d/f23 zero size 2023-12-05T09:26:09.229 INFO:tasks.workunit.client.1.smithi134.stdout:8/138: creat da/de/d11/f30 x:0 0 0 2023-12-05T09:26:09.229 INFO:tasks.workunit.client.1.smithi134.stdout:8/139: dread - da/de/f2b zero size 2023-12-05T09:26:09.229 INFO:tasks.workunit.client.1.smithi134.stdout:8/140: write da/de/d16/f25 [120439,66565] 0 2023-12-05T09:26:09.229 INFO:tasks.workunit.client.1.smithi134.stdout:8/141: truncate da/de/d16/f23 180233 0 2023-12-05T09:26:09.231 INFO:tasks.workunit.client.1.smithi134.stdout:4/119: creat d16/d18/d1c/f2c x:0 0 0 2023-12-05T09:26:09.231 INFO:tasks.workunit.client.1.smithi134.stdout:4/120: write f0 [3426941,7795] 0 2023-12-05T09:26:09.231 INFO:tasks.workunit.client.1.smithi134.stdout:4/121: truncate d16/d18/d1b/d24/f25 673535 0 2023-12-05T09:26:09.231 INFO:tasks.workunit.client.1.smithi134.stdout:4/122: truncate f4 2372364 0 2023-12-05T09:26:09.233 INFO:tasks.workunit.client.0.smithi067.stdout:1/95: dwrite d2/d5/d7/de/d1a/f1b [8388608,4194304] 0 2023-12-05T09:26:09.233 INFO:tasks.workunit.client.0.smithi067.stdout:1/96: chown d2/d5/lf 1538 1 2023-12-05T09:26:09.234 INFO:tasks.workunit.client.1.smithi134.stdout:6/105: dwrite d4/ff [0,4194304] 0 2023-12-05T09:26:09.234 INFO:tasks.workunit.client.0.smithi067.stdout:8/88: dwrite d5/f18 [0,4194304] 0 2023-12-05T09:26:09.236 INFO:tasks.workunit.client.0.smithi067.stdout:6/40: mkdir da/db 0 2023-12-05T09:26:09.236 INFO:tasks.workunit.client.0.smithi067.stdout:0/134: dwrite d3/f1e [0,4194304] 0 2023-12-05T09:26:09.237 INFO:tasks.workunit.client.0.smithi067.stdout:7/116: dwrite d0/f6 [0,4194304] 0 2023-12-05T09:26:09.243 INFO:tasks.workunit.client.1.smithi134.stdout:5/124: dwrite d0/f2 [0,4194304] 0 2023-12-05T09:26:09.243 INFO:tasks.workunit.client.1.smithi134.stdout:9/105: dwrite d7/d8/d14/f1e [0,4194304] 0 2023-12-05T09:26:09.247 INFO:tasks.workunit.client.0.smithi067.stdout:5/85: mknod db/df/d1a/d1d/c25 0 2023-12-05T09:26:09.247 INFO:tasks.workunit.client.0.smithi067.stdout:1/97: rename d2/d5/d7/l12 to d2/d5/l27 0 2023-12-05T09:26:09.247 INFO:tasks.workunit.client.0.smithi067.stdout:8/89: stat d5/dc/l13 0 2023-12-05T09:26:09.247 INFO:tasks.workunit.client.0.smithi067.stdout:8/90: fsync d5/f18 0 2023-12-05T09:26:09.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/125: mkdir d13/d1f/d23 0 2023-12-05T09:26:09.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/126: dread - d13/d14/d15/f21 zero size 2023-12-05T09:26:09.250 INFO:tasks.workunit.client.1.smithi134.stdout:4/123: rename d16/d18/d1a/c2b to d16/d18/d1b/d24/c2d 0 2023-12-05T09:26:09.250 INFO:tasks.workunit.client.1.smithi134.stdout:5/125: rename d0/d1a to d0/d1a/d1c/d30 22 2023-12-05T09:26:09.251 INFO:tasks.workunit.client.1.smithi134.stdout:2/143: dwrite d19/f25 [0,4194304] 0 2023-12-05T09:26:09.260 INFO:tasks.workunit.client.1.smithi134.stdout:6/106: unlink d4/d8/f16 0 2023-12-05T09:26:09.260 INFO:tasks.workunit.client.1.smithi134.stdout:9/106: creat d7/d8/d16/f27 x:0 0 0 2023-12-05T09:26:09.261 INFO:tasks.workunit.client.1.smithi134.stdout:2/144: mkdir d19/d28/d31 0 2023-12-05T09:26:09.265 INFO:tasks.workunit.client.1.smithi134.stdout:9/107: unlink d7/d8/d16/f27 0 2023-12-05T09:26:09.265 INFO:tasks.workunit.client.1.smithi134.stdout:2/145: mknod d19/c32 0 2023-12-05T09:26:09.266 INFO:tasks.workunit.client.1.smithi134.stdout:2/146: creat d19/d28/f33 x:0 0 0 2023-12-05T09:26:09.266 INFO:tasks.workunit.client.1.smithi134.stdout:2/147: creat d19/f34 x:0 0 0 2023-12-05T09:26:09.266 INFO:tasks.workunit.client.1.smithi134.stdout:2/148: creat d19/f35 x:0 0 0 2023-12-05T09:26:09.266 INFO:tasks.workunit.client.1.smithi134.stdout:2/149: truncate d19/f1e 359315 0 2023-12-05T09:26:09.266 INFO:tasks.workunit.client.1.smithi134.stdout:2/150: read f10 [3801258,124158] 0 2023-12-05T09:26:09.266 INFO:tasks.workunit.client.1.smithi134.stdout:2/151: chown d19/l1b 64 1 2023-12-05T09:26:09.267 INFO:tasks.workunit.client.1.smithi134.stdout:9/108: write d7/d8/d16/f1f [331604,49062] 0 2023-12-05T09:26:09.267 INFO:tasks.workunit.client.0.smithi067.stdout:5/86: dread f1 [0,4194304] 0 2023-12-05T09:26:09.268 INFO:tasks.workunit.client.0.smithi067.stdout:5/87: write db/fc [882925,5767] 0 2023-12-05T09:26:09.268 INFO:tasks.workunit.client.0.smithi067.stdout:6/41: rmdir da 39 2023-12-05T09:26:09.271 INFO:tasks.workunit.client.1.smithi134.stdout:9/109: rename d7/d8/cf to d7/d8/c28 0 2023-12-05T09:26:09.274 INFO:tasks.workunit.client.1.smithi134.stdout:8/142: dread da/de/d11/f1a [0,4194304] 0 2023-12-05T09:26:09.274 INFO:tasks.workunit.client.1.smithi134.stdout:9/110: unlink d7/d10/l12 0 2023-12-05T09:26:09.275 INFO:tasks.workunit.client.0.smithi067.stdout:8/91: truncate d5/f10 5503609 0 2023-12-05T09:26:09.275 INFO:tasks.workunit.client.0.smithi067.stdout:0/135: rename d3/f1e to d3/df/f2b 0 2023-12-05T09:26:09.282 INFO:tasks.workunit.client.1.smithi134.stdout:0/127: write fa [3878951,110037] 0 2023-12-05T09:26:09.284 INFO:tasks.workunit.client.1.smithi134.stdout:7/104: dwrite d2/d7/f13 [0,4194304] 0 2023-12-05T09:26:09.284 INFO:tasks.workunit.client.1.smithi134.stdout:7/105: readlink d2/dd/l11 0 2023-12-05T09:26:09.284 INFO:tasks.workunit.client.1.smithi134.stdout:7/106: chown d2/d7/dc 111953 1 2023-12-05T09:26:09.284 INFO:tasks.workunit.client.1.smithi134.stdout:7/107: chown d2/dd 367 1 2023-12-05T09:26:09.284 INFO:tasks.workunit.client.1.smithi134.stdout:2/152: dread f17 [0,4194304] 0 2023-12-05T09:26:09.285 INFO:tasks.workunit.client.1.smithi134.stdout:2/153: fdatasync d19/d28/f2a 0 2023-12-05T09:26:09.286 INFO:tasks.workunit.client.0.smithi067.stdout:6/42: mknod da/db/cc 0 2023-12-05T09:26:09.286 INFO:tasks.workunit.client.0.smithi067.stdout:6/43: truncate f4 962581 0 2023-12-05T09:26:09.286 INFO:tasks.workunit.client.0.smithi067.stdout:6/44: readlink - no filename 2023-12-05T09:26:09.287 INFO:tasks.workunit.client.0.smithi067.stdout:7/117: rename d0/d9/l23 to d0/d9/d1b/l29 0 2023-12-05T09:26:09.289 INFO:tasks.workunit.client.1.smithi134.stdout:0/128: unlink c1 0 2023-12-05T09:26:09.293 INFO:tasks.workunit.client.1.smithi134.stdout:7/108: link d2/d7/la d2/dd/l24 0 2023-12-05T09:26:09.293 INFO:tasks.workunit.client.1.smithi134.stdout:7/109: dread - d2/d7/d10/f20 zero size 2023-12-05T09:26:09.294 INFO:tasks.workunit.client.1.smithi134.stdout:7/110: fdatasync d2/d7/dc/d22/f1b 0 2023-12-05T09:26:09.294 INFO:tasks.workunit.client.1.smithi134.stdout:7/111: chown d2/df/f14 561382 1 2023-12-05T09:26:09.294 INFO:tasks.workunit.client.1.smithi134.stdout:7/112: readlink d2/l6 0 2023-12-05T09:26:09.298 INFO:tasks.workunit.client.0.smithi067.stdout:7/118: creat d0/d9/d10/d22/f2a x:0 0 0 2023-12-05T09:26:09.298 INFO:tasks.workunit.client.1.smithi134.stdout:0/129: mknod d13/d1f/c24 0 2023-12-05T09:26:09.298 INFO:tasks.workunit.client.1.smithi134.stdout:7/113: mkdir d2/d7/d25 0 2023-12-05T09:26:09.298 INFO:tasks.workunit.client.1.smithi134.stdout:7/114: chown d2/d7 9466812 1 2023-12-05T09:26:09.298 INFO:tasks.workunit.client.1.smithi134.stdout:7/115: chown d2/d7/cb 1617381 1 2023-12-05T09:26:09.301 INFO:tasks.workunit.client.1.smithi134.stdout:9/111: dread d7/d8/f13 [0,4194304] 0 2023-12-05T09:26:09.309 INFO:tasks.workunit.client.0.smithi067.stdout:5/88: rename db/df/d1a/d1d/c25 to db/df/d1a/d1d/d20/c26 0 2023-12-05T09:26:09.309 INFO:tasks.workunit.client.0.smithi067.stdout:5/89: readlink db/df/l19 0 2023-12-05T09:26:09.309 INFO:tasks.workunit.client.0.smithi067.stdout:3/26: dwrite f0 [0,4194304] 0 2023-12-05T09:26:09.310 INFO:tasks.workunit.client.0.smithi067.stdout:6/45: write f2 [1001332,25170] 0 2023-12-05T09:26:09.315 INFO:tasks.workunit.client.1.smithi134.stdout:6/107: dread d4/d8/fe [0,4194304] 0 2023-12-05T09:26:09.315 INFO:tasks.workunit.client.1.smithi134.stdout:0/130: mknod d13/d14/d19/c25 0 2023-12-05T09:26:09.316 INFO:tasks.workunit.client.1.smithi134.stdout:4/124: dwrite d16/d18/d1b/d24/f28 [0,4194304] 0 2023-12-05T09:26:09.322 INFO:tasks.workunit.client.0.smithi067.stdout:9/212: dwrite d1b/f20 [0,4194304] 0 2023-12-05T09:26:09.325 INFO:tasks.workunit.client.1.smithi134.stdout:6/108: creat d4/d8/da/d1b/f21 x:0 0 0 2023-12-05T09:26:09.327 INFO:tasks.workunit.client.0.smithi067.stdout:6/46: rename da/db/cc to da/db/cd 0 2023-12-05T09:26:09.327 INFO:tasks.workunit.client.0.smithi067.stdout:5/90: truncate db/df/d1a/f1c 956289 0 2023-12-05T09:26:09.330 INFO:tasks.workunit.client.1.smithi134.stdout:1/145: dwrite d2/f4 [4194304,4194304] 0 2023-12-05T09:26:09.335 INFO:tasks.workunit.client.0.smithi067.stdout:7/119: write d0/f6 [1673685,119169] 0 2023-12-05T09:26:09.335 INFO:tasks.workunit.client.1.smithi134.stdout:0/131: dread fd [0,4194304] 0 2023-12-05T09:26:09.344 INFO:tasks.workunit.client.1.smithi134.stdout:4/125: unlink c14 0 2023-12-05T09:26:09.344 INFO:tasks.workunit.client.1.smithi134.stdout:4/126: dread - d16/d18/d1c/f2c zero size 2023-12-05T09:26:09.344 INFO:tasks.workunit.client.1.smithi134.stdout:7/116: rename d2/d7/d10 to d2/d7/d25/d26 0 2023-12-05T09:26:09.344 INFO:tasks.workunit.client.1.smithi134.stdout:6/109: readlink d4/d8/l11 0 2023-12-05T09:26:09.344 INFO:tasks.workunit.client.1.smithi134.stdout:6/110: readlink d4/d8/da/lc 0 2023-12-05T09:26:09.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/117: stat d2/d7/la 0 2023-12-05T09:26:09.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/118: read - d2/d7/d25/d26/f20 zero size 2023-12-05T09:26:09.352 INFO:tasks.workunit.client.1.smithi134.stdout:1/146: getdents d2 0 2023-12-05T09:26:09.353 INFO:tasks.workunit.client.1.smithi134.stdout:7/119: creat d2/d7/dc/d22/f27 x:0 0 0 2023-12-05T09:26:09.358 INFO:tasks.workunit.client.1.smithi134.stdout:6/111: symlink d4/d8/l22 0 2023-12-05T09:26:09.358 INFO:tasks.workunit.client.1.smithi134.stdout:6/112: fsync d4/db/f20 0 2023-12-05T09:26:09.361 INFO:tasks.workunit.client.1.smithi134.stdout:7/120: mkdir d2/d7/dc/d28 0 2023-12-05T09:26:09.361 INFO:tasks.workunit.client.1.smithi134.stdout:7/121: chown d2/df/f14 3 1 2023-12-05T09:26:09.361 INFO:tasks.workunit.client.1.smithi134.stdout:7/122: dread - d2/d7/d25/d26/f1c zero size 2023-12-05T09:26:09.364 INFO:tasks.workunit.client.0.smithi067.stdout:6/47: creat da/fe x:0 0 0 2023-12-05T09:26:09.365 INFO:tasks.workunit.client.0.smithi067.stdout:6/48: chown f4 16202270 1 2023-12-05T09:26:09.365 INFO:tasks.workunit.client.0.smithi067.stdout:9/213: truncate d1b/d25/f2d 1406096 0 2023-12-05T09:26:09.365 INFO:tasks.workunit.client.0.smithi067.stdout:5/91: mknod db/df/d1a/d1d/c27 0 2023-12-05T09:26:09.368 INFO:tasks.workunit.client.0.smithi067.stdout:6/49: symlink da/db/lf 0 2023-12-05T09:26:09.370 INFO:tasks.workunit.client.0.smithi067.stdout:6/50: write f4 [816299,129901] 0 2023-12-05T09:26:09.370 INFO:tasks.workunit.client.1.smithi134.stdout:6/113: symlink d4/d8/da/l23 0 2023-12-05T09:26:09.372 INFO:tasks.workunit.client.0.smithi067.stdout:5/92: rename db/fd to db/df/d1a/f28 0 2023-12-05T09:26:09.373 INFO:tasks.workunit.client.1.smithi134.stdout:6/114: mknod d4/d8/da/c24 0 2023-12-05T09:26:09.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/51: mkdir da/d10 0 2023-12-05T09:26:09.376 INFO:tasks.workunit.client.0.smithi067.stdout:2/73: dwrite d0/fd [0,4194304] 0 2023-12-05T09:26:09.376 INFO:tasks.workunit.client.0.smithi067.stdout:2/74: creat d0/f1a x:0 0 0 2023-12-05T09:26:09.376 INFO:tasks.workunit.client.0.smithi067.stdout:2/75: truncate d0/f9 4238187 0 2023-12-05T09:26:09.377 INFO:tasks.workunit.client.0.smithi067.stdout:0/136: dwrite d3/df/f24 [0,4194304] 0 2023-12-05T09:26:09.379 INFO:tasks.workunit.client.0.smithi067.stdout:5/93: creat db/df/d1a/f29 x:0 0 0 2023-12-05T09:26:09.380 INFO:tasks.workunit.client.1.smithi134.stdout:4/127: write f6 [137780,116953] 0 2023-12-05T09:26:09.380 INFO:tasks.workunit.client.1.smithi134.stdout:4/128: creat d16/d18/d1c/f2e x:0 0 0 2023-12-05T09:26:09.380 INFO:tasks.workunit.client.1.smithi134.stdout:4/129: chown c12 194 1 2023-12-05T09:26:09.384 INFO:tasks.workunit.client.1.smithi134.stdout:4/130: symlink d16/d18/d1c/l2f 0 2023-12-05T09:26:09.384 INFO:tasks.workunit.client.1.smithi134.stdout:6/115: dread f0 [0,4194304] 0 2023-12-05T09:26:09.384 INFO:tasks.workunit.client.1.smithi134.stdout:6/116: truncate d4/db/f12 2561572 0 2023-12-05T09:26:09.385 INFO:tasks.workunit.client.0.smithi067.stdout:2/76: creat d0/d15/f1b x:0 0 0 2023-12-05T09:26:09.389 INFO:tasks.workunit.client.0.smithi067.stdout:5/94: rmdir db/df/d1a/d1d/d20 39 2023-12-05T09:26:09.389 INFO:tasks.workunit.client.1.smithi134.stdout:5/126: dwrite d0/dd/f2c [0,4194304] 0 2023-12-05T09:26:09.390 INFO:tasks.workunit.client.0.smithi067.stdout:1/98: dwrite d2/f13 [0,4194304] 0 2023-12-05T09:26:09.390 INFO:tasks.workunit.client.0.smithi067.stdout:2/77: symlink d0/d10/l1c 0 2023-12-05T09:26:09.390 INFO:tasks.workunit.client.0.smithi067.stdout:2/78: readlink d0/d10/l1c 0 2023-12-05T09:26:09.392 INFO:tasks.workunit.client.0.smithi067.stdout:1/99: write d2/d5/d7/de/d10/d14/d20/f26 [318995,125757] 0 2023-12-05T09:26:09.392 INFO:tasks.workunit.client.0.smithi067.stdout:9/214: dread f10 [0,4194304] 0 2023-12-05T09:26:09.392 INFO:tasks.workunit.client.0.smithi067.stdout:9/215: write d1b/d25/d35/f43 [1618859,24618] 0 2023-12-05T09:26:09.392 INFO:tasks.workunit.client.0.smithi067.stdout:5/95: rename db/fc to db/df/d1a/d1d/d20/f2a 0 2023-12-05T09:26:09.395 INFO:tasks.workunit.client.1.smithi134.stdout:7/123: dread d2/f8 [0,4194304] 0 2023-12-05T09:26:09.397 INFO:tasks.workunit.client.0.smithi067.stdout:3/27: dwrite f3 [0,4194304] 0 2023-12-05T09:26:09.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/216: unlink d1b/l1d 0 2023-12-05T09:26:09.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/217: chown f7 2 1 2023-12-05T09:26:09.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/218: readlink d1b/d25/l29 0 2023-12-05T09:26:09.399 INFO:tasks.workunit.client.1.smithi134.stdout:8/143: dwrite f3 [0,4194304] 0 2023-12-05T09:26:09.399 INFO:tasks.workunit.client.1.smithi134.stdout:8/144: write da/de/d11/f19 [4820587,73215] 0 2023-12-05T09:26:09.400 INFO:tasks.workunit.client.0.smithi067.stdout:5/96: unlink db/f1f 0 2023-12-05T09:26:09.400 INFO:tasks.workunit.client.0.smithi067.stdout:5/97: dread - db/df/f16 zero size 2023-12-05T09:26:09.402 INFO:tasks.workunit.client.1.smithi134.stdout:2/154: dwrite f4 [0,4194304] 0 2023-12-05T09:26:09.402 INFO:tasks.workunit.client.1.smithi134.stdout:2/155: stat d19/f24 0 2023-12-05T09:26:09.403 INFO:tasks.workunit.client.0.smithi067.stdout:2/79: rename d0/f1a to d0/d10/f1d 0 2023-12-05T09:26:09.406 INFO:tasks.workunit.client.1.smithi134.stdout:9/112: dwrite d7/f1a [0,4194304] 0 2023-12-05T09:26:09.407 INFO:tasks.workunit.client.0.smithi067.stdout:7/120: dwrite d0/d9/d10/d22/f2a [0,4194304] 0 2023-12-05T09:26:09.407 INFO:tasks.workunit.client.0.smithi067.stdout:7/121: rename d0 to d0/d9/d10/d22/d2b 22 2023-12-05T09:26:09.411 INFO:tasks.workunit.client.0.smithi067.stdout:3/28: creat d9/fb x:0 0 0 2023-12-05T09:26:09.411 INFO:tasks.workunit.client.0.smithi067.stdout:8/92: dwrite d5/f16 [0,4194304] 0 2023-12-05T09:26:09.413 INFO:tasks.workunit.client.0.smithi067.stdout:0/137: getdents d3 0 2023-12-05T09:26:09.413 INFO:tasks.workunit.client.0.smithi067.stdout:0/138: creat d3/d7/f2c x:0 0 0 2023-12-05T09:26:09.420 INFO:tasks.workunit.client.0.smithi067.stdout:9/219: fsync d1b/d25/d35/f43 0 2023-12-05T09:26:09.430 INFO:tasks.workunit.client.0.smithi067.stdout:2/80: mkdir d0/d10/d1e 0 2023-12-05T09:26:09.430 INFO:tasks.workunit.client.0.smithi067.stdout:2/81: getdents d0/d10/d1e 0 2023-12-05T09:26:09.430 INFO:tasks.workunit.client.0.smithi067.stdout:2/82: chown d0/c18 23 1 2023-12-05T09:26:09.431 INFO:tasks.workunit.client.0.smithi067.stdout:7/122: creat d0/d9/f2c x:0 0 0 2023-12-05T09:26:09.438 INFO:tasks.workunit.client.0.smithi067.stdout:8/93: dread d5/f16 [0,4194304] 0 2023-12-05T09:26:09.443 INFO:tasks.workunit.client.1.smithi134.stdout:4/131: dwrite f0 [0,4194304] 0 2023-12-05T09:26:09.444 INFO:tasks.workunit.client.1.smithi134.stdout:4/132: chown d16/d18/d1b/d24/f28 203762 1 2023-12-05T09:26:09.445 INFO:tasks.workunit.client.0.smithi067.stdout:6/52: dwrite f4 [0,4194304] 0 2023-12-05T09:26:09.447 INFO:tasks.workunit.client.1.smithi134.stdout:0/132: dwrite d13/d14/d15/f21 [0,4194304] 0 2023-12-05T09:26:09.451 INFO:tasks.workunit.client.1.smithi134.stdout:8/145: symlink da/de/d16/l31 0 2023-12-05T09:26:09.454 INFO:tasks.workunit.client.0.smithi067.stdout:9/220: dread fa [0,4194304] 0 2023-12-05T09:26:09.455 INFO:tasks.workunit.client.1.smithi134.stdout:5/127: dwrite d0/f19 [0,4194304] 0 2023-12-05T09:26:09.455 INFO:tasks.workunit.client.1.smithi134.stdout:5/128: creat d0/d1a/d1c/f31 x:0 0 0 2023-12-05T09:26:09.456 INFO:tasks.workunit.client.1.smithi134.stdout:5/129: chown d0/f7 868 1 2023-12-05T09:26:09.456 INFO:tasks.workunit.client.1.smithi134.stdout:5/130: stat d0/d11/c21 0 2023-12-05T09:26:09.458 INFO:tasks.workunit.client.1.smithi134.stdout:2/156: rename cf to d19/d28/c36 0 2023-12-05T09:26:09.458 INFO:tasks.workunit.client.1.smithi134.stdout:9/113: rename d7/d8 to d7/d8/d29 22 2023-12-05T09:26:09.461 INFO:tasks.workunit.client.1.smithi134.stdout:7/124: dwrite d2/d7/dc/d22/f1b [0,4194304] 0 2023-12-05T09:26:09.461 INFO:tasks.workunit.client.1.smithi134.stdout:7/125: dread - d2/dd/d1a/f23 zero size 2023-12-05T09:26:09.463 INFO:tasks.workunit.client.0.smithi067.stdout:5/98: symlink db/df/d1a/l2b 0 2023-12-05T09:26:09.465 INFO:tasks.workunit.client.0.smithi067.stdout:7/123: mknod d0/d9/d1b/c2d 0 2023-12-05T09:26:09.465 INFO:tasks.workunit.client.0.smithi067.stdout:7/124: getdents d0/d9/d10 0 2023-12-05T09:26:09.470 INFO:tasks.workunit.client.0.smithi067.stdout:6/53: rename f2 to da/d10/f11 0 2023-12-05T09:26:09.470 INFO:tasks.workunit.client.0.smithi067.stdout:0/139: truncate d3/fa 307005 0 2023-12-05T09:26:09.470 INFO:tasks.workunit.client.0.smithi067.stdout:0/140: fdatasync d3/d7/f8 0 2023-12-05T09:26:09.470 INFO:tasks.workunit.client.0.smithi067.stdout:0/141: readlink d3/d7/l1b 0 2023-12-05T09:26:09.471 INFO:tasks.workunit.client.0.smithi067.stdout:0/142: write d3/f1d [4957924,121534] 0 2023-12-05T09:26:09.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/100: dwrite d2/d5/d7/de/d10/d14/d20/f26 [0,4194304] 0 2023-12-05T09:26:09.472 INFO:tasks.workunit.client.1.smithi134.stdout:4/133: link d16/d18/d1c/f2c d16/d18/d1a/f30 0 2023-12-05T09:26:09.473 INFO:tasks.workunit.client.0.smithi067.stdout:9/221: write d1b/f20 [2425079,74114] 0 2023-12-05T09:26:09.473 INFO:tasks.workunit.client.0.smithi067.stdout:9/222: readlink l13 0 2023-12-05T09:26:09.476 INFO:tasks.workunit.client.0.smithi067.stdout:5/99: creat db/df/d1a/d1d/d20/f2c x:0 0 0 2023-12-05T09:26:09.476 INFO:tasks.workunit.client.0.smithi067.stdout:5/100: dread - db/df/f16 zero size 2023-12-05T09:26:09.476 INFO:tasks.workunit.client.0.smithi067.stdout:5/101: stat f1 0 2023-12-05T09:26:09.476 INFO:tasks.workunit.client.0.smithi067.stdout:5/102: creat db/df/d1a/d1d/d20/f2d x:0 0 0 2023-12-05T09:26:09.479 INFO:tasks.workunit.client.0.smithi067.stdout:7/125: symlink d0/d9/d10/l2e 0 2023-12-05T09:26:09.483 INFO:tasks.workunit.client.1.smithi134.stdout:0/133: mkdir d13/d26 0 2023-12-05T09:26:09.487 INFO:tasks.workunit.client.0.smithi067.stdout:0/143: link d3/df/d10/c23 d3/c2d 0 2023-12-05T09:26:09.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/223: getdents d1b/d3e 0 2023-12-05T09:26:09.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/224: stat d1b/d25/d35/l3d 0 2023-12-05T09:26:09.487 INFO:tasks.workunit.client.1.smithi134.stdout:8/146: mknod da/de/d16/d2d/c32 0 2023-12-05T09:26:09.487 INFO:tasks.workunit.client.1.smithi134.stdout:8/147: chown da/de/d16/d2d/c32 1 1 2023-12-05T09:26:09.491 INFO:tasks.workunit.client.1.smithi134.stdout:2/157: rename d19/l1f to d19/d28/l37 0 2023-12-05T09:26:09.491 INFO:tasks.workunit.client.1.smithi134.stdout:4/134: dread d16/d18/d1a/f20 [0,4194304] 0 2023-12-05T09:26:09.491 INFO:tasks.workunit.client.1.smithi134.stdout:4/135: chown d16/d18/d1b/l27 79 1 2023-12-05T09:26:09.492 INFO:tasks.workunit.client.0.smithi067.stdout:2/83: dread d0/fd [0,4194304] 0 2023-12-05T09:26:09.497 INFO:tasks.workunit.client.0.smithi067.stdout:7/126: creat d0/d9/d10/f2f x:0 0 0 2023-12-05T09:26:09.498 INFO:tasks.workunit.client.1.smithi134.stdout:9/114: creat d7/d8/d16/f2a x:0 0 0 2023-12-05T09:26:09.500 INFO:tasks.workunit.client.0.smithi067.stdout:1/101: symlink d2/d3/l28 0 2023-12-05T09:26:09.500 INFO:tasks.workunit.client.0.smithi067.stdout:1/102: stat d2/d5/d7/de/d1a/f1b 0 2023-12-05T09:26:09.500 INFO:tasks.workunit.client.0.smithi067.stdout:1/103: chown d2/c22 12409 1 2023-12-05T09:26:09.500 INFO:tasks.workunit.client.0.smithi067.stdout:1/104: write d2/f24 [647329,99652] 0 2023-12-05T09:26:09.501 INFO:tasks.workunit.client.0.smithi067.stdout:3/29: dwrite f4 [0,4194304] 0 2023-12-05T09:26:09.501 INFO:tasks.workunit.client.0.smithi067.stdout:3/30: stat l2 0 2023-12-05T09:26:09.503 INFO:tasks.workunit.client.1.smithi134.stdout:7/126: symlink d2/d7/dc/l29 0 2023-12-05T09:26:09.504 INFO:tasks.workunit.client.0.smithi067.stdout:5/103: mknod db/df/d1a/c2e 0 2023-12-05T09:26:09.504 INFO:tasks.workunit.client.0.smithi067.stdout:5/104: fdatasync db/f14 0 2023-12-05T09:26:09.506 INFO:tasks.workunit.client.0.smithi067.stdout:7/127: link d0/d9/d10/f1a d0/d9/f30 0 2023-12-05T09:26:09.507 INFO:tasks.workunit.client.1.smithi134.stdout:0/134: creat d13/d1f/d23/f27 x:0 0 0 2023-12-05T09:26:09.508 INFO:tasks.workunit.client.1.smithi134.stdout:0/135: chown f7 1118755 1 2023-12-05T09:26:09.508 INFO:tasks.workunit.client.1.smithi134.stdout:8/148: mkdir da/de/d16/d33 0 2023-12-05T09:26:09.509 INFO:tasks.workunit.client.1.smithi134.stdout:9/115: truncate d7/d8/d14/f25 3713587 0 2023-12-05T09:26:09.509 INFO:tasks.workunit.client.1.smithi134.stdout:4/136: creat d16/d18/d1b/f31 x:0 0 0 2023-12-05T09:26:09.513 INFO:tasks.workunit.client.0.smithi067.stdout:1/105: rename d2/f13 to d2/d5/d7/de/d10/d15/f29 0 2023-12-05T09:26:09.516 INFO:tasks.workunit.client.0.smithi067.stdout:5/105: getdents db/df 0 2023-12-05T09:26:09.516 INFO:tasks.workunit.client.0.smithi067.stdout:5/106: chown db/df/f22 3560 1 2023-12-05T09:26:09.516 INFO:tasks.workunit.client.1.smithi134.stdout:7/127: mkdir d2/df/d2a 0 2023-12-05T09:26:09.538 INFO:tasks.workunit.client.1.smithi134.stdout:9/116: mknod d7/d8/d16/c2b 0 2023-12-05T09:26:09.544 INFO:tasks.workunit.client.1.smithi134.stdout:9/117: symlink d7/d8/d14/l2c 0 2023-12-05T09:26:09.544 INFO:tasks.workunit.client.1.smithi134.stdout:9/118: truncate d7/d8/d16/f2a 936726 0 2023-12-05T09:26:09.544 INFO:tasks.workunit.client.1.smithi134.stdout:9/119: stat d7 0 2023-12-05T09:26:09.549 INFO:tasks.workunit.client.1.smithi134.stdout:8/149: dread da/de/d11/f1a [0,4194304] 0 2023-12-05T09:26:09.549 INFO:tasks.workunit.client.1.smithi134.stdout:8/150: write da/f2a [908679,97340] 0 2023-12-05T09:26:09.550 INFO:tasks.workunit.client.1.smithi134.stdout:3/108: sync 2023-12-05T09:26:09.550 INFO:tasks.workunit.client.1.smithi134.stdout:1/147: sync 2023-12-05T09:26:09.550 INFO:tasks.workunit.client.1.smithi134.stdout:8/151: creat da/de/d11/f34 x:0 0 0 2023-12-05T09:26:09.551 INFO:tasks.workunit.client.1.smithi134.stdout:8/152: fsync da/de/d11/f19 0 2023-12-05T09:26:09.551 INFO:tasks.workunit.client.1.smithi134.stdout:6/117: sync 2023-12-05T09:26:09.554 INFO:tasks.workunit.client.1.smithi134.stdout:7/128: rmdir d2/d7 39 2023-12-05T09:26:09.555 INFO:tasks.workunit.client.1.smithi134.stdout:1/148: unlink d2/f26 0 2023-12-05T09:26:09.559 INFO:tasks.workunit.client.1.smithi134.stdout:3/109: rename d4/f17 to d4/d1f/f28 0 2023-12-05T09:26:09.562 INFO:tasks.workunit.client.0.smithi067.stdout:4/39: sync 2023-12-05T09:26:09.563 INFO:tasks.workunit.client.0.smithi067.stdout:4/40: dread - d0/d9/fb zero size 2023-12-05T09:26:09.564 INFO:tasks.workunit.client.1.smithi134.stdout:8/153: symlink da/l35 0 2023-12-05T09:26:09.567 INFO:tasks.workunit.client.1.smithi134.stdout:7/129: rename d2/d7/d1f to d2/d7/d2b 0 2023-12-05T09:26:09.567 INFO:tasks.workunit.client.1.smithi134.stdout:7/130: fsync d2/df/f15 0 2023-12-05T09:26:09.567 INFO:tasks.workunit.client.1.smithi134.stdout:7/131: readlink d2/d7/dc/l29 0 2023-12-05T09:26:09.568 INFO:tasks.workunit.client.0.smithi067.stdout:1/106: read d2/d3/f16 [2781473,91424] 0 2023-12-05T09:26:09.571 INFO:tasks.workunit.client.1.smithi134.stdout:1/149: symlink d2/l34 0 2023-12-05T09:26:09.571 INFO:tasks.workunit.client.1.smithi134.stdout:3/110: link d4/d5/l21 d4/l29 0 2023-12-05T09:26:09.571 INFO:tasks.workunit.client.1.smithi134.stdout:1/150: write d2/d9/f1b [8862707,17459] 0 2023-12-05T09:26:09.571 INFO:tasks.workunit.client.1.smithi134.stdout:1/151: stat d2/f17 0 2023-12-05T09:26:09.571 INFO:tasks.workunit.client.1.smithi134.stdout:1/152: fsync d2/f17 0 2023-12-05T09:26:09.572 INFO:tasks.workunit.client.0.smithi067.stdout:4/41: getdents d0 0 2023-12-05T09:26:09.573 INFO:tasks.workunit.client.1.smithi134.stdout:8/154: unlink f3 0 2023-12-05T09:26:09.575 INFO:tasks.workunit.client.0.smithi067.stdout:4/42: rename d0/d9/fb to d0/fc 0 2023-12-05T09:26:09.576 INFO:tasks.workunit.client.0.smithi067.stdout:6/54: dwrite da/d10/f11 [0,4194304] 0 2023-12-05T09:26:09.577 INFO:tasks.workunit.client.0.smithi067.stdout:6/55: mkdir da/db/d12 0 2023-12-05T09:26:09.577 INFO:tasks.workunit.client.0.smithi067.stdout:6/56: truncate da/fe 113242 0 2023-12-05T09:26:09.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/132: rename d2/d7/dc/d22/f1b to d2/d7/dc/f2c 0 2023-12-05T09:26:09.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/133: read f1 [1327,65840] 0 2023-12-05T09:26:09.578 INFO:tasks.workunit.client.1.smithi134.stdout:5/131: dwrite d0/dd/f17 [0,4194304] 0 2023-12-05T09:26:09.579 INFO:tasks.workunit.client.1.smithi134.stdout:5/132: write d0/d1a/f27 [594344,118978] 0 2023-12-05T09:26:09.579 INFO:tasks.workunit.client.1.smithi134.stdout:5/133: readlink d0/l8 0 2023-12-05T09:26:09.579 INFO:tasks.workunit.client.1.smithi134.stdout:1/153: getdents d2/d9/d10 0 2023-12-05T09:26:09.579 INFO:tasks.workunit.client.1.smithi134.stdout:6/118: dread d4/fd [0,4194304] 0 2023-12-05T09:26:09.579 INFO:tasks.workunit.client.0.smithi067.stdout:8/94: dwrite d5/f10 [0,4194304] 0 2023-12-05T09:26:09.579 INFO:tasks.workunit.client.0.smithi067.stdout:0/144: dwrite d3/d7/f29 [0,4194304] 0 2023-12-05T09:26:09.581 INFO:tasks.workunit.client.0.smithi067.stdout:3/31: dwrite f3 [0,4194304] 0 2023-12-05T09:26:09.584 INFO:tasks.workunit.client.1.smithi134.stdout:3/111: rename d4/d5/fd to d4/d5/d23/f2a 0 2023-12-05T09:26:09.584 INFO:tasks.workunit.client.1.smithi134.stdout:3/112: truncate d4/d1f/f25 957582 0 2023-12-05T09:26:09.590 INFO:tasks.workunit.client.1.smithi134.stdout:1/154: mknod d2/d9/c35 0 2023-12-05T09:26:09.593 INFO:tasks.workunit.client.0.smithi067.stdout:9/225: dwrite d1b/d25/f40 [0,4194304] 0 2023-12-05T09:26:09.595 INFO:tasks.workunit.client.0.smithi067.stdout:9/226: symlink d1b/d25/l47 0 2023-12-05T09:26:09.597 INFO:tasks.workunit.client.1.smithi134.stdout:3/113: creat d4/d1f/f2b x:0 0 0 2023-12-05T09:26:09.597 INFO:tasks.workunit.client.1.smithi134.stdout:1/155: link d2/d27/c29 d2/d9/d10/c36 0 2023-12-05T09:26:09.599 INFO:tasks.workunit.client.1.smithi134.stdout:1/156: link d2/f17 d2/d9/d10/d30/f37 0 2023-12-05T09:26:09.606 INFO:tasks.workunit.client.0.smithi067.stdout:3/32: write f0 [3030603,104567] 0 2023-12-05T09:26:09.617 INFO:tasks.workunit.client.1.smithi134.stdout:8/155: fsync da/de/d11/f34 0 2023-12-05T09:26:09.617 INFO:tasks.workunit.client.1.smithi134.stdout:8/156: write da/de/f2b [1083231,76583] 0 2023-12-05T09:26:09.617 INFO:tasks.workunit.client.1.smithi134.stdout:8/157: chown da/de/d16 45705768 1 2023-12-05T09:26:09.621 INFO:tasks.workunit.client.0.smithi067.stdout:3/33: mkdir d9/dc 0 2023-12-05T09:26:09.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/157: fsync d2/d9/f1b 0 2023-12-05T09:26:09.622 INFO:tasks.workunit.client.0.smithi067.stdout:5/107: dwrite db/fe [0,4194304] 0 2023-12-05T09:26:09.623 INFO:tasks.workunit.client.0.smithi067.stdout:5/108: getdents db/df 0 2023-12-05T09:26:09.623 INFO:tasks.workunit.client.0.smithi067.stdout:5/109: chown db/df/f12 123989150 1 2023-12-05T09:26:09.628 INFO:tasks.workunit.client.0.smithi067.stdout:5/110: link db/df/d1a/c2e db/df/c2f 0 2023-12-05T09:26:09.629 INFO:tasks.workunit.client.0.smithi067.stdout:5/111: write db/f13 [781711,99283] 0 2023-12-05T09:26:09.629 INFO:tasks.workunit.client.0.smithi067.stdout:5/112: fdatasync db/df/f16 0 2023-12-05T09:26:09.629 INFO:tasks.workunit.client.1.smithi134.stdout:8/158: creat da/de/d16/d2d/f36 x:0 0 0 2023-12-05T09:26:09.630 INFO:tasks.workunit.client.1.smithi134.stdout:8/159: read - da/de/d11/d1d/f2e zero size 2023-12-05T09:26:09.630 INFO:tasks.workunit.client.1.smithi134.stdout:8/160: write da/de/d11/f34 [705803,125200] 0 2023-12-05T09:26:09.630 INFO:tasks.workunit.client.1.smithi134.stdout:1/158: getdents d2/d27 0 2023-12-05T09:26:09.630 INFO:tasks.workunit.client.1.smithi134.stdout:8/161: write f9 [4365463,25909] 0 2023-12-05T09:26:09.636 INFO:tasks.workunit.client.0.smithi067.stdout:2/84: dwrite d0/d10/f1d [0,4194304] 0 2023-12-05T09:26:09.645 INFO:tasks.workunit.client.0.smithi067.stdout:5/113: getdents db/df/d1a/d1d 0 2023-12-05T09:26:09.651 INFO:tasks.workunit.client.0.smithi067.stdout:6/57: truncate f4 1940521 0 2023-12-05T09:26:09.653 INFO:tasks.workunit.client.0.smithi067.stdout:2/85: mknod d0/c1f 0 2023-12-05T09:26:09.653 INFO:tasks.workunit.client.0.smithi067.stdout:2/86: dread - d0/fe zero size 2023-12-05T09:26:09.654 INFO:tasks.workunit.client.1.smithi134.stdout:9/120: dwrite d7/d8/d16/f2a [0,4194304] 0 2023-12-05T09:26:09.657 INFO:tasks.workunit.client.0.smithi067.stdout:5/114: mknod db/df/d1a/c30 0 2023-12-05T09:26:09.666 INFO:tasks.workunit.client.0.smithi067.stdout:5/115: rmdir db/df/d1a/d1d/d20 39 2023-12-05T09:26:09.671 INFO:tasks.workunit.client.0.smithi067.stdout:9/227: dwrite fa [0,4194304] 0 2023-12-05T09:26:09.677 INFO:tasks.workunit.client.0.smithi067.stdout:8/95: truncate d5/f10 1331611 0 2023-12-05T09:26:09.678 INFO:tasks.workunit.client.0.smithi067.stdout:9/228: unlink d1b/d25/f26 0 2023-12-05T09:26:09.679 INFO:tasks.workunit.client.0.smithi067.stdout:8/96: creat d5/f1c x:0 0 0 2023-12-05T09:26:09.681 INFO:tasks.workunit.client.0.smithi067.stdout:5/116: dread db/f14 [0,4194304] 0 2023-12-05T09:26:09.681 INFO:tasks.workunit.client.0.smithi067.stdout:5/117: truncate db/df/d1a/d1d/d20/f2c 891157 0 2023-12-05T09:26:09.685 INFO:tasks.workunit.client.0.smithi067.stdout:9/229: link d1b/d25/l47 d1b/d25/d35/l48 0 2023-12-05T09:26:09.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/230: creat d1b/d25/d35/f49 x:0 0 0 2023-12-05T09:26:09.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/231: creat d1b/d25/d35/f4a x:0 0 0 2023-12-05T09:26:09.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/232: creat d1b/d25/f4b x:0 0 0 2023-12-05T09:26:09.689 INFO:tasks.workunit.client.0.smithi067.stdout:4/43: dwrite d0/fc [0,4194304] 0 2023-12-05T09:26:09.689 INFO:tasks.workunit.client.0.smithi067.stdout:5/118: unlink db/df/f22 0 2023-12-05T09:26:09.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/134: dwrite d2/d7/d25/d26/f20 [0,4194304] 0 2023-12-05T09:26:09.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/135: readlink d2/d7/dc/l29 0 2023-12-05T09:26:09.694 INFO:tasks.workunit.client.0.smithi067.stdout:0/145: dwrite d3/df/f24 [0,4194304] 0 2023-12-05T09:26:09.695 INFO:tasks.workunit.client.0.smithi067.stdout:0/146: fdatasync d3/df/d10/f1a 0 2023-12-05T09:26:09.695 INFO:tasks.workunit.client.0.smithi067.stdout:0/147: readlink d3/d7/le 0 2023-12-05T09:26:09.695 INFO:tasks.workunit.client.0.smithi067.stdout:0/148: chown d3/f5 150446 1 2023-12-05T09:26:09.697 INFO:tasks.workunit.client.0.smithi067.stdout:1/107: dwrite d2/d3/f1d [0,4194304] 0 2023-12-05T09:26:09.701 INFO:tasks.workunit.client.0.smithi067.stdout:9/233: unlink d1b/d25/f36 0 2023-12-05T09:26:09.702 INFO:tasks.workunit.client.1.smithi134.stdout:6/119: dwrite d4/d8/da/d1b/f21 [0,4194304] 0 2023-12-05T09:26:09.702 INFO:tasks.workunit.client.1.smithi134.stdout:6/120: creat d4/d8/da/f25 x:0 0 0 2023-12-05T09:26:09.702 INFO:tasks.workunit.client.1.smithi134.stdout:6/121: dread - d4/d8/da/f19 zero size 2023-12-05T09:26:09.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/136: write d2/d7/d25/d26/f20 [3802449,62419] 0 2023-12-05T09:26:09.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/137: chown d2/d7/la 70767488 1 2023-12-05T09:26:09.711 INFO:tasks.workunit.client.0.smithi067.stdout:2/87: rmdir d0 39 2023-12-05T09:26:09.713 INFO:tasks.workunit.client.0.smithi067.stdout:8/97: write d5/f16 [3269047,44428] 0 2023-12-05T09:26:09.714 INFO:tasks.workunit.client.0.smithi067.stdout:8/98: chown d5/ce 7738809 1 2023-12-05T09:26:09.716 INFO:tasks.workunit.client.0.smithi067.stdout:3/34: dwrite f8 [0,4194304] 0 2023-12-05T09:26:09.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/108: dread d2/d5/d7/de/d1a/f1b [4194304,4194304] 0 2023-12-05T09:26:09.728 INFO:tasks.workunit.client.1.smithi134.stdout:7/138: dread d2/d7/d25/d26/f20 [0,4194304] 0 2023-12-05T09:26:09.729 INFO:tasks.workunit.client.1.smithi134.stdout:8/162: dwrite da/de/d16/f26 [0,4194304] 0 2023-12-05T09:26:09.730 INFO:tasks.workunit.client.0.smithi067.stdout:0/149: unlink d3/d7/c17 0 2023-12-05T09:26:09.731 INFO:tasks.workunit.client.1.smithi134.stdout:7/139: mkdir d2/d7/d2b/d2d 0 2023-12-05T09:26:09.731 INFO:tasks.workunit.client.1.smithi134.stdout:7/140: fsync f1 0 2023-12-05T09:26:09.732 INFO:tasks.workunit.client.1.smithi134.stdout:1/159: dwrite d2/d9/d10/d30/f37 [0,4194304] 0 2023-12-05T09:26:09.733 INFO:tasks.workunit.client.1.smithi134.stdout:1/160: dread - d2/d9/f2c zero size 2023-12-05T09:26:09.733 INFO:tasks.workunit.client.0.smithi067.stdout:4/44: mkdir d0/d9/dd 0 2023-12-05T09:26:09.734 INFO:tasks.workunit.client.1.smithi134.stdout:6/122: read d4/db/f20 [3688540,127187] 0 2023-12-05T09:26:09.734 INFO:tasks.workunit.client.1.smithi134.stdout:6/123: chown d4/d8/da 14 1 2023-12-05T09:26:09.734 INFO:tasks.workunit.client.1.smithi134.stdout:6/124: stat d4/db/c1c 0 2023-12-05T09:26:09.735 INFO:tasks.workunit.client.0.smithi067.stdout:3/35: creat d9/da/fd x:0 0 0 2023-12-05T09:26:09.735 INFO:tasks.workunit.client.0.smithi067.stdout:3/36: creat d9/fe x:0 0 0 2023-12-05T09:26:09.735 INFO:tasks.workunit.client.1.smithi134.stdout:8/163: dread da/d1b/f1e [0,4194304] 0 2023-12-05T09:26:09.735 INFO:tasks.workunit.client.1.smithi134.stdout:7/141: rename d2/d7/dc/d28 to d2/d7/dc/d2e 0 2023-12-05T09:26:09.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/161: creat d2/d9/d10/f38 x:0 0 0 2023-12-05T09:26:09.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/162: fdatasync d2/f4 0 2023-12-05T09:26:09.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/163: fdatasync d2/f19 0 2023-12-05T09:26:09.736 INFO:tasks.workunit.client.0.smithi067.stdout:0/150: mknod d3/c2e 0 2023-12-05T09:26:09.738 INFO:tasks.workunit.client.0.smithi067.stdout:1/109: getdents d2/d3 0 2023-12-05T09:26:09.738 INFO:tasks.workunit.client.1.smithi134.stdout:3/114: dwrite d4/d5/f1e [0,4194304] 0 2023-12-05T09:26:09.740 INFO:tasks.workunit.client.1.smithi134.stdout:9/121: dwrite d7/d8/d14/f25 [0,4194304] 0 2023-12-05T09:26:09.740 INFO:tasks.workunit.client.1.smithi134.stdout:6/125: creat d4/f26 x:0 0 0 2023-12-05T09:26:09.740 INFO:tasks.workunit.client.1.smithi134.stdout:6/126: read - d4/db/f1f zero size 2023-12-05T09:26:09.741 INFO:tasks.workunit.client.0.smithi067.stdout:3/37: rename f8 to d9/dc/ff 0 2023-12-05T09:26:09.743 INFO:tasks.workunit.client.0.smithi067.stdout:0/151: mknod d3/d7/c2f 0 2023-12-05T09:26:09.743 INFO:tasks.workunit.client.1.smithi134.stdout:2/158: sync 2023-12-05T09:26:09.743 INFO:tasks.workunit.client.1.smithi134.stdout:4/137: sync 2023-12-05T09:26:09.743 INFO:tasks.workunit.client.1.smithi134.stdout:0/136: sync 2023-12-05T09:26:09.744 INFO:tasks.workunit.client.1.smithi134.stdout:2/159: dread - d19/f35 zero size 2023-12-05T09:26:09.745 INFO:tasks.workunit.client.0.smithi067.stdout:6/58: dwrite f8 [0,4194304] 0 2023-12-05T09:26:09.745 INFO:tasks.workunit.client.0.smithi067.stdout:4/45: mknod d0/ce 0 2023-12-05T09:26:09.745 INFO:tasks.workunit.client.0.smithi067.stdout:6/59: fsync f8 0 2023-12-05T09:26:09.749 INFO:tasks.workunit.client.1.smithi134.stdout:7/142: mknod d2/d7/dc/c2f 0 2023-12-05T09:26:09.749 INFO:tasks.workunit.client.0.smithi067.stdout:1/110: rename d2/d3/f16 to d2/d3/f2a 0 2023-12-05T09:26:09.749 INFO:tasks.workunit.client.1.smithi134.stdout:1/164: rename d2/f4 to d2/d27/f39 0 2023-12-05T09:26:09.751 INFO:tasks.workunit.client.0.smithi067.stdout:0/152: mkdir d3/d7/d30 0 2023-12-05T09:26:09.753 INFO:tasks.workunit.client.0.smithi067.stdout:4/46: creat d0/ff x:0 0 0 2023-12-05T09:26:09.753 INFO:tasks.workunit.client.0.smithi067.stdout:4/47: getdents d0/d9/dd 0 2023-12-05T09:26:09.753 INFO:tasks.workunit.client.0.smithi067.stdout:4/48: chown d0/d9/dd 15582 1 2023-12-05T09:26:09.754 INFO:tasks.workunit.client.0.smithi067.stdout:6/60: symlink da/db/l13 0 2023-12-05T09:26:09.754 INFO:tasks.workunit.client.1.smithi134.stdout:6/127: mkdir d4/d27 0 2023-12-05T09:26:09.755 INFO:tasks.workunit.client.0.smithi067.stdout:1/111: mknod d2/c2b 0 2023-12-05T09:26:09.757 INFO:tasks.workunit.client.0.smithi067.stdout:5/119: dwrite db/df/d1a/f28 [0,4194304] 0 2023-12-05T09:26:09.758 INFO:tasks.workunit.client.0.smithi067.stdout:4/49: mknod d0/d9/c10 0 2023-12-05T09:26:09.759 INFO:tasks.workunit.client.1.smithi134.stdout:2/160: mkdir d19/d28/d31/d38 0 2023-12-05T09:26:09.763 INFO:tasks.workunit.client.1.smithi134.stdout:1/165: creat d2/d27/f3a x:0 0 0 2023-12-05T09:26:09.763 INFO:tasks.workunit.client.1.smithi134.stdout:4/138: rename f6 to d16/d18/d1a/f32 0 2023-12-05T09:26:09.763 INFO:tasks.workunit.client.1.smithi134.stdout:4/139: fsync fb 0 2023-12-05T09:26:09.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/120: creat db/df/f31 x:0 0 0 2023-12-05T09:26:09.766 INFO:tasks.workunit.client.1.smithi134.stdout:0/137: getdents d13/d14/d19 0 2023-12-05T09:26:09.766 INFO:tasks.workunit.client.1.smithi134.stdout:0/138: write fd [3481929,102505] 0 2023-12-05T09:26:09.766 INFO:tasks.workunit.client.1.smithi134.stdout:4/140: symlink d16/d21/l33 0 2023-12-05T09:26:09.770 INFO:tasks.workunit.client.0.smithi067.stdout:4/50: link d0/f8 d0/d9/f11 0 2023-12-05T09:26:09.773 INFO:tasks.workunit.client.1.smithi134.stdout:4/141: creat d16/d18/d1b/d24/d29/f34 x:0 0 0 2023-12-05T09:26:09.773 INFO:tasks.workunit.client.1.smithi134.stdout:0/139: read f9 [175211,103824] 0 2023-12-05T09:26:09.787 INFO:tasks.workunit.client.0.smithi067.stdout:4/51: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:09.788 INFO:tasks.workunit.client.0.smithi067.stdout:4/52: write d0/ff [840797,72703] 0 2023-12-05T09:26:09.790 INFO:tasks.workunit.client.1.smithi134.stdout:8/164: truncate da/de/d11/f1a 3901731 0 2023-12-05T09:26:09.791 INFO:tasks.workunit.client.0.smithi067.stdout:3/38: rmdir d9/da 39 2023-12-05T09:26:09.792 INFO:tasks.workunit.client.0.smithi067.stdout:1/112: write d2/d5/d7/de/d1a/f1b [11270302,48945] 0 2023-12-05T09:26:09.795 INFO:tasks.workunit.client.1.smithi134.stdout:8/165: mknod da/de/c37 0 2023-12-05T09:26:09.795 INFO:tasks.workunit.client.1.smithi134.stdout:8/166: write da/de/d16/f25 [815404,5343] 0 2023-12-05T09:26:09.796 INFO:tasks.workunit.client.0.smithi067.stdout:4/53: mkdir d0/d9/d12 0 2023-12-05T09:26:09.798 INFO:tasks.workunit.client.1.smithi134.stdout:8/167: creat da/de/d16/d33/f38 x:0 0 0 2023-12-05T09:26:09.798 INFO:tasks.workunit.client.1.smithi134.stdout:8/168: write da/de/d11/f30 [600929,86346] 0 2023-12-05T09:26:09.802 INFO:tasks.workunit.client.0.smithi067.stdout:3/39: symlink d9/dc/l10 0 2023-12-05T09:26:09.803 INFO:tasks.workunit.client.0.smithi067.stdout:1/113: dread - d2/d3/f18 zero size 2023-12-05T09:26:09.803 INFO:tasks.workunit.client.0.smithi067.stdout:1/114: chown d2/d5/d7/de/d10/d14/d20/f26 15 1 2023-12-05T09:26:09.803 INFO:tasks.workunit.client.1.smithi134.stdout:8/169: unlink da/de/l21 0 2023-12-05T09:26:09.803 INFO:tasks.workunit.client.1.smithi134.stdout:8/170: read - da/de/d16/f20 zero size 2023-12-05T09:26:09.803 INFO:tasks.workunit.client.1.smithi134.stdout:8/171: fsync da/de/d16/d2d/f36 0 2023-12-05T09:26:09.803 INFO:tasks.workunit.client.1.smithi134.stdout:8/172: chown da/de/d11/f34 10 1 2023-12-05T09:26:09.805 INFO:tasks.workunit.client.1.smithi134.stdout:2/161: write d19/f25 [1821346,75896] 0 2023-12-05T09:26:09.807 INFO:tasks.workunit.client.0.smithi067.stdout:2/88: dread d0/fd [0,4194304] 0 2023-12-05T09:26:09.808 INFO:tasks.workunit.client.1.smithi134.stdout:8/173: mkdir da/de/d16/d33/d39 0 2023-12-05T09:26:09.809 INFO:tasks.workunit.client.1.smithi134.stdout:8/174: stat da/d1b 0 2023-12-05T09:26:09.813 INFO:tasks.workunit.client.1.smithi134.stdout:8/175: link da/de/d11/f30 da/f3a 0 2023-12-05T09:26:09.813 INFO:tasks.workunit.client.1.smithi134.stdout:8/176: chown da/de 42881790 1 2023-12-05T09:26:09.816 INFO:tasks.workunit.client.0.smithi067.stdout:1/115: getdents d2/d5/d7/de 0 2023-12-05T09:26:09.817 INFO:tasks.workunit.client.1.smithi134.stdout:8/177: mkdir da/de/d16/d33/d39/d3b 0 2023-12-05T09:26:09.819 INFO:tasks.workunit.client.1.smithi134.stdout:8/178: symlink da/de/l3c 0 2023-12-05T09:26:09.819 INFO:tasks.workunit.client.1.smithi134.stdout:8/179: fdatasync da/de/d16/d33/f38 0 2023-12-05T09:26:09.819 INFO:tasks.workunit.client.1.smithi134.stdout:8/180: chown da 22215783 1 2023-12-05T09:26:09.819 INFO:tasks.workunit.client.1.smithi134.stdout:8/181: creat da/de/d16/d33/f3d x:0 0 0 2023-12-05T09:26:09.821 INFO:tasks.workunit.client.0.smithi067.stdout:1/116: mknod d2/d5/d7/de/d10/c2c 0 2023-12-05T09:26:09.822 INFO:tasks.workunit.client.0.smithi067.stdout:1/117: write d2/d5/d7/de/d10/d15/f29 [4644510,127355] 0 2023-12-05T09:26:09.826 INFO:tasks.workunit.client.0.smithi067.stdout:6/61: truncate f8 2958002 0 2023-12-05T09:26:09.826 INFO:tasks.workunit.client.0.smithi067.stdout:6/62: rename da to da/db/d12/d14 22 2023-12-05T09:26:09.827 INFO:tasks.workunit.client.1.smithi134.stdout:9/122: dwrite d7/f1c [0,4194304] 0 2023-12-05T09:26:09.832 INFO:tasks.workunit.client.0.smithi067.stdout:9/234: dwrite f11 [0,4194304] 0 2023-12-05T09:26:09.833 INFO:tasks.workunit.client.0.smithi067.stdout:3/40: dread f0 [0,4194304] 0 2023-12-05T09:26:09.834 INFO:tasks.workunit.client.0.smithi067.stdout:1/118: stat d2/d3/l1f 0 2023-12-05T09:26:09.834 INFO:tasks.workunit.client.0.smithi067.stdout:3/41: chown d9/fe 2011 1 2023-12-05T09:26:09.837 INFO:tasks.workunit.client.0.smithi067.stdout:1/119: symlink d2/d5/d7/l2d 0 2023-12-05T09:26:09.838 INFO:tasks.workunit.client.0.smithi067.stdout:1/120: stat d2/d5/d7 0 2023-12-05T09:26:09.838 INFO:tasks.workunit.client.0.smithi067.stdout:1/121: dread - d2/d3/f18 zero size 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/115: dwrite d4/f1b [0,4194304] 0 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/116: fsync d4/d5/f11 0 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/117: chown d4/c15 1040868 1 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/118: fdatasync d4/d5/f10 0 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:7/143: dwrite d2/d7/d25/d26/f20 [0,4194304] 0 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:7/144: fsync d2/d7/d25/d26/f20 0 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/119: write d4/fb [75952,68123] 0 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/120: dread - d4/d1f/f28 zero size 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/121: chown d4/d5/l21 9 1 2023-12-05T09:26:09.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/122: readlink d4/l29 0 2023-12-05T09:26:09.841 INFO:tasks.workunit.client.1.smithi134.stdout:3/123: dread - d4/d1f/f20 zero size 2023-12-05T09:26:09.841 INFO:tasks.workunit.client.1.smithi134.stdout:9/123: mknod d7/d8/d14/d26/c2d 0 2023-12-05T09:26:09.843 INFO:tasks.workunit.client.1.smithi134.stdout:1/166: dwrite d2/d9/f24 [0,4194304] 0 2023-12-05T09:26:09.843 INFO:tasks.workunit.client.1.smithi134.stdout:4/142: dwrite f15 [0,4194304] 0 2023-12-05T09:26:09.845 INFO:tasks.workunit.client.0.smithi067.stdout:1/122: mknod d2/d5/c2e 0 2023-12-05T09:26:09.846 INFO:tasks.workunit.client.1.smithi134.stdout:7/145: mknod d2/d7/dc/c30 0 2023-12-05T09:26:09.846 INFO:tasks.workunit.client.1.smithi134.stdout:7/146: dread - d2/df/f14 zero size 2023-12-05T09:26:09.847 INFO:tasks.workunit.client.0.smithi067.stdout:1/123: mknod d2/d5/d7/de/d10/c2f 0 2023-12-05T09:26:09.848 INFO:tasks.workunit.client.0.smithi067.stdout:5/121: dwrite db/df/d1a/d1d/d20/f2d [0,4194304] 0 2023-12-05T09:26:09.851 INFO:tasks.workunit.client.1.smithi134.stdout:5/134: sync 2023-12-05T09:26:09.853 INFO:tasks.workunit.client.0.smithi067.stdout:3/42: getdents d9/dc 0 2023-12-05T09:26:09.854 INFO:tasks.workunit.client.1.smithi134.stdout:1/167: symlink d2/d9/d10/d30/l3b 0 2023-12-05T09:26:09.854 INFO:tasks.workunit.client.1.smithi134.stdout:1/168: creat d2/d9/d10/f3c x:0 0 0 2023-12-05T09:26:09.854 INFO:tasks.workunit.client.1.smithi134.stdout:1/169: creat d2/d27/f3d x:0 0 0 2023-12-05T09:26:09.858 INFO:tasks.workunit.client.1.smithi134.stdout:3/124: dread d4/d5/f1e [0,4194304] 0 2023-12-05T09:26:09.858 INFO:tasks.workunit.client.1.smithi134.stdout:3/125: readlink d4/d5/l21 0 2023-12-05T09:26:09.858 INFO:tasks.workunit.client.1.smithi134.stdout:3/126: truncate d4/d1f/f25 1602217 0 2023-12-05T09:26:09.859 INFO:tasks.workunit.client.1.smithi134.stdout:4/143: mkdir d16/d21/d35 0 2023-12-05T09:26:09.860 INFO:tasks.workunit.client.1.smithi134.stdout:9/124: dread d7/f1a [0,4194304] 0 2023-12-05T09:26:09.862 INFO:tasks.workunit.client.1.smithi134.stdout:2/162: dwrite d19/d28/f30 [0,4194304] 0 2023-12-05T09:26:09.862 INFO:tasks.workunit.client.1.smithi134.stdout:2/163: creat d19/d28/f39 x:0 0 0 2023-12-05T09:26:09.862 INFO:tasks.workunit.client.1.smithi134.stdout:7/147: unlink d2/l9 0 2023-12-05T09:26:09.863 INFO:tasks.workunit.client.0.smithi067.stdout:9/235: write fa [1375404,92958] 0 2023-12-05T09:26:09.863 INFO:tasks.workunit.client.0.smithi067.stdout:9/236: write d1b/f31 [611048,29950] 0 2023-12-05T09:26:09.863 INFO:tasks.workunit.client.0.smithi067.stdout:9/237: dread - d1b/d25/d35/f4a zero size 2023-12-05T09:26:09.867 INFO:tasks.workunit.client.1.smithi134.stdout:4/144: dread d16/d18/d1a/f32 [0,4194304] 0 2023-12-05T09:26:09.869 INFO:tasks.workunit.client.1.smithi134.stdout:5/135: write d0/dd/f17 [2024887,110052] 0 2023-12-05T09:26:09.875 INFO:tasks.workunit.client.0.smithi067.stdout:5/122: unlink db/fe 0 2023-12-05T09:26:09.875 INFO:tasks.workunit.client.1.smithi134.stdout:1/170: rmdir d2/d9/d10/d30 39 2023-12-05T09:26:09.879 INFO:tasks.workunit.client.1.smithi134.stdout:3/127: symlink d4/d5/d23/l2c 0 2023-12-05T09:26:09.881 INFO:tasks.workunit.client.0.smithi067.stdout:9/238: symlink d1b/d25/d35/l4c 0 2023-12-05T09:26:09.889 INFO:tasks.workunit.client.1.smithi134.stdout:8/182: truncate da/f3a 91199 0 2023-12-05T09:26:09.889 INFO:tasks.workunit.client.1.smithi134.stdout:8/183: truncate da/d1b/f2f 211026 0 2023-12-05T09:26:09.892 INFO:tasks.workunit.client.0.smithi067.stdout:4/54: dwrite d0/fa [0,4194304] 0 2023-12-05T09:26:09.893 INFO:tasks.workunit.client.1.smithi134.stdout:2/164: mkdir d19/d3a 0 2023-12-05T09:26:09.893 INFO:tasks.workunit.client.1.smithi134.stdout:2/165: readlink d19/l23 0 2023-12-05T09:26:09.896 INFO:tasks.workunit.client.1.smithi134.stdout:1/171: write d2/f20 [1154901,4281] 0 2023-12-05T09:26:09.900 INFO:tasks.workunit.client.1.smithi134.stdout:7/148: truncate d2/d7/f13 2465152 0 2023-12-05T09:26:09.900 INFO:tasks.workunit.client.1.smithi134.stdout:4/145: creat d16/d18/f36 x:0 0 0 2023-12-05T09:26:09.900 INFO:tasks.workunit.client.1.smithi134.stdout:7/149: read d2/dd/f12 [1034261,96975] 0 2023-12-05T09:26:09.900 INFO:tasks.workunit.client.1.smithi134.stdout:4/146: fsync d16/d18/d1b/f31 0 2023-12-05T09:26:09.900 INFO:tasks.workunit.client.1.smithi134.stdout:7/150: chown d2/d7/d25/d26/f20 131938043 1 2023-12-05T09:26:09.900 INFO:tasks.workunit.client.0.smithi067.stdout:4/55: creat d0/d9/f13 x:0 0 0 2023-12-05T09:26:09.905 INFO:tasks.workunit.client.0.smithi067.stdout:9/239: dread f7 [0,4194304] 0 2023-12-05T09:26:09.906 INFO:tasks.workunit.client.0.smithi067.stdout:9/240: mknod d1b/c4d 0 2023-12-05T09:26:09.913 INFO:tasks.workunit.client.1.smithi134.stdout:8/184: rename da/de/d16/f25 to da/f3e 0 2023-12-05T09:26:09.913 INFO:tasks.workunit.client.1.smithi134.stdout:8/185: truncate da/de/d11/f1a 4469243 0 2023-12-05T09:26:09.913 INFO:tasks.workunit.client.1.smithi134.stdout:8/186: chown da/l35 211 1 2023-12-05T09:26:09.913 INFO:tasks.workunit.client.1.smithi134.stdout:8/187: creat da/d1b/f3f x:0 0 0 2023-12-05T09:26:09.913 INFO:tasks.workunit.client.1.smithi134.stdout:8/188: readlink da/de/d11/d1d/l1f 0 2023-12-05T09:26:09.915 INFO:tasks.workunit.client.0.smithi067.stdout:9/241: symlink d1b/d25/d35/l4e 0 2023-12-05T09:26:09.915 INFO:tasks.workunit.client.0.smithi067.stdout:6/63: dwrite f8 [0,4194304] 0 2023-12-05T09:26:09.919 INFO:tasks.workunit.client.1.smithi134.stdout:2/166: mknod d19/d28/d2b/c3b 0 2023-12-05T09:26:09.919 INFO:tasks.workunit.client.1.smithi134.stdout:2/167: fdatasync f16 0 2023-12-05T09:26:09.919 INFO:tasks.workunit.client.1.smithi134.stdout:2/168: write d19/f25 [1724104,26666] 0 2023-12-05T09:26:09.920 INFO:tasks.workunit.client.0.smithi067.stdout:6/64: rename c6 to da/db/c15 0 2023-12-05T09:26:09.920 INFO:tasks.workunit.client.0.smithi067.stdout:6/65: fdatasync da/d10/f11 0 2023-12-05T09:26:09.920 INFO:tasks.workunit.client.1.smithi134.stdout:2/169: fdatasync d19/d28/f33 0 2023-12-05T09:26:09.920 INFO:tasks.workunit.client.1.smithi134.stdout:4/147: unlink d16/d18/d1b/d24/f2a 0 2023-12-05T09:26:09.924 INFO:tasks.workunit.client.0.smithi067.stdout:4/56: dread d0/f8 [0,4194304] 0 2023-12-05T09:26:09.926 INFO:tasks.workunit.client.1.smithi134.stdout:8/189: rename da/de/f12 to da/de/f40 0 2023-12-05T09:26:09.927 INFO:tasks.workunit.client.1.smithi134.stdout:2/170: creat d19/d28/d31/f3c x:0 0 0 2023-12-05T09:26:09.929 INFO:tasks.workunit.client.1.smithi134.stdout:4/148: symlink d16/d18/d1c/l37 0 2023-12-05T09:26:09.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/125: dwrite d7/d8/d14/f1e [0,4194304] 0 2023-12-05T09:26:09.932 INFO:tasks.workunit.client.1.smithi134.stdout:8/190: rename da/de/d16/d33/f3d to da/de/f41 0 2023-12-05T09:26:09.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/126: read f1 [1715649,67303] 0 2023-12-05T09:26:09.938 INFO:tasks.workunit.client.1.smithi134.stdout:5/136: dwrite d0/f19 [4194304,4194304] 0 2023-12-05T09:26:09.938 INFO:tasks.workunit.client.1.smithi134.stdout:5/137: write d0/d1a/d1c/f23 [760994,17129] 0 2023-12-05T09:26:09.938 INFO:tasks.workunit.client.1.smithi134.stdout:5/138: fdatasync d0/d11/f1f 0 2023-12-05T09:26:09.946 INFO:tasks.workunit.client.1.smithi134.stdout:3/128: dread d4/fb [0,4194304] 0 2023-12-05T09:26:09.946 INFO:tasks.workunit.client.1.smithi134.stdout:8/191: mkdir da/d1b/d42 0 2023-12-05T09:26:09.950 INFO:tasks.workunit.client.1.smithi134.stdout:9/127: mkdir d7/d8/d2e 0 2023-12-05T09:26:09.956 INFO:tasks.workunit.client.1.smithi134.stdout:1/172: dwrite d2/d9/d10/f38 [0,4194304] 0 2023-12-05T09:26:09.957 INFO:tasks.workunit.client.1.smithi134.stdout:5/139: dread d0/d11/f15 [4194304,4194304] 0 2023-12-05T09:26:09.957 INFO:tasks.workunit.client.1.smithi134.stdout:5/140: creat d0/dd/f32 x:0 0 0 2023-12-05T09:26:09.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/123: dwrite db/df/d1a/d1d/d20/f2d [0,4194304] 0 2023-12-05T09:26:09.962 INFO:tasks.workunit.client.1.smithi134.stdout:3/129: symlink d4/d5/d23/l2d 0 2023-12-05T09:26:09.966 INFO:tasks.workunit.client.0.smithi067.stdout:5/124: truncate db/df/d1a/d1d/d20/f2a 282805 0 2023-12-05T09:26:09.967 INFO:tasks.workunit.client.1.smithi134.stdout:8/192: mkdir da/de/d43 0 2023-12-05T09:26:09.968 INFO:tasks.workunit.client.1.smithi134.stdout:9/128: mknod d7/d10/c2f 0 2023-12-05T09:26:09.971 INFO:tasks.workunit.client.1.smithi134.stdout:8/193: mknod da/de/d11/d1d/c44 0 2023-12-05T09:26:09.971 INFO:tasks.workunit.client.1.smithi134.stdout:7/151: dwrite d2/f8 [0,4194304] 0 2023-12-05T09:26:09.977 INFO:tasks.workunit.client.1.smithi134.stdout:9/129: rename d7/d8/d16/c1d to d7/d8/d14/d26/c30 0 2023-12-05T09:26:09.979 INFO:tasks.workunit.client.0.smithi067.stdout:6/66: dwrite da/fe [0,4194304] 0 2023-12-05T09:26:09.982 INFO:tasks.workunit.client.0.smithi067.stdout:3/43: dwrite d9/fe [0,4194304] 0 2023-12-05T09:26:09.982 INFO:tasks.workunit.client.0.smithi067.stdout:3/44: write d9/fb [401769,92186] 0 2023-12-05T09:26:09.983 INFO:tasks.workunit.client.0.smithi067.stdout:6/67: unlink da/db/cd 0 2023-12-05T09:26:09.986 INFO:tasks.workunit.client.1.smithi134.stdout:7/152: getdents d2/dd/d1a 0 2023-12-05T09:26:09.987 INFO:tasks.workunit.client.1.smithi134.stdout:8/194: rename da/de/d16/d33/d39 to da/de/d16/d45 0 2023-12-05T09:26:09.989 INFO:tasks.workunit.client.0.smithi067.stdout:3/45: rename d9/dc to d9/d11 0 2023-12-05T09:26:09.990 INFO:tasks.workunit.client.1.smithi134.stdout:8/195: stat da/de/d16/d45/d3b 0 2023-12-05T09:26:09.991 INFO:tasks.workunit.client.1.smithi134.stdout:7/153: creat d2/d7/dc/f31 x:0 0 0 2023-12-05T09:26:09.992 INFO:tasks.workunit.client.1.smithi134.stdout:4/149: getdents d16/d18/d1b/d24 0 2023-12-05T09:26:09.993 INFO:tasks.workunit.client.0.smithi067.stdout:6/68: mkdir da/db/d16 0 2023-12-05T09:26:09.996 INFO:tasks.workunit.client.0.smithi067.stdout:9/242: dread d1b/d25/f2c [0,4194304] 0 2023-12-05T09:26:09.996 INFO:tasks.workunit.client.0.smithi067.stdout:9/243: creat d1b/d25/d35/f4f x:0 0 0 2023-12-05T09:26:09.997 INFO:tasks.workunit.client.0.smithi067.stdout:9/244: fdatasync f7 0 2023-12-05T09:26:09.997 INFO:tasks.workunit.client.0.smithi067.stdout:9/245: write d1b/d25/f3c [1570974,69010] 0 2023-12-05T09:26:09.997 INFO:tasks.workunit.client.0.smithi067.stdout:9/246: creat d1b/d25/f50 x:0 0 0 2023-12-05T09:26:09.997 INFO:tasks.workunit.client.0.smithi067.stdout:9/247: chown c12 11269 1 2023-12-05T09:26:09.998 INFO:tasks.workunit.client.1.smithi134.stdout:3/130: dread d4/d5/fe [0,4194304] 0 2023-12-05T09:26:09.998 INFO:tasks.workunit.client.1.smithi134.stdout:9/130: dread d7/d8/d16/f1f [0,4194304] 0 2023-12-05T09:26:09.998 INFO:tasks.workunit.client.1.smithi134.stdout:7/154: symlink d2/d7/d2b/d2d/l32 0 2023-12-05T09:26:09.998 INFO:tasks.workunit.client.1.smithi134.stdout:7/155: chown d2/f8 7151687 1 2023-12-05T09:26:09.999 INFO:tasks.workunit.client.0.smithi067.stdout:6/69: mkdir da/db/d16/d17 0 2023-12-05T09:26:10.000 INFO:tasks.workunit.client.1.smithi134.stdout:2/171: fsync d19/d28/d31/f3c 0 2023-12-05T09:26:10.007 INFO:tasks.workunit.client.0.smithi067.stdout:1/124: dwrite d2/d3/f21 [0,4194304] 0 2023-12-05T09:26:10.010 INFO:tasks.workunit.client.0.smithi067.stdout:6/70: creat da/db/d16/d17/f18 x:0 0 0 2023-12-05T09:26:10.015 INFO:tasks.workunit.client.1.smithi134.stdout:3/131: dread f0 [0,4194304] 0 2023-12-05T09:26:10.015 INFO:tasks.workunit.client.1.smithi134.stdout:3/132: truncate d4/f16 4254016 0 2023-12-05T09:26:10.018 INFO:tasks.workunit.client.0.smithi067.stdout:6/71: mkdir da/db/d12/d19 0 2023-12-05T09:26:10.020 INFO:tasks.workunit.client.1.smithi134.stdout:3/133: creat d4/d5/d23/f2e x:0 0 0 2023-12-05T09:26:10.020 INFO:tasks.workunit.client.1.smithi134.stdout:3/134: readlink d4/l29 0 2023-12-05T09:26:10.020 INFO:tasks.workunit.client.0.smithi067.stdout:6/72: symlink da/db/d12/l1a 0 2023-12-05T09:26:10.020 INFO:tasks.workunit.client.0.smithi067.stdout:6/73: fsync da/fe 0 2023-12-05T09:26:10.021 INFO:tasks.workunit.client.0.smithi067.stdout:6/74: rmdir da/db/d12 39 2023-12-05T09:26:10.025 INFO:tasks.workunit.client.1.smithi134.stdout:8/196: dwrite da/d1b/f1e [0,4194304] 0 2023-12-05T09:26:10.025 INFO:tasks.workunit.client.1.smithi134.stdout:8/197: write da/de/d16/d33/f38 [743960,5777] 0 2023-12-05T09:26:10.026 INFO:tasks.workunit.client.0.smithi067.stdout:6/75: rename da/db/c15 to da/db/c1b 0 2023-12-05T09:26:10.027 INFO:tasks.workunit.client.0.smithi067.stdout:6/76: mknod da/d10/c1c 0 2023-12-05T09:26:10.027 INFO:tasks.workunit.client.0.smithi067.stdout:6/77: dread - da/db/d16/d17/f18 zero size 2023-12-05T09:26:10.040 INFO:tasks.workunit.client.0.smithi067.stdout:5/125: write db/df/d1a/d1d/d20/f2a [167270,27039] 0 2023-12-05T09:26:10.040 INFO:tasks.workunit.client.0.smithi067.stdout:5/126: creat db/df/f32 x:0 0 0 2023-12-05T09:26:10.042 INFO:tasks.workunit.client.1.smithi134.stdout:5/141: dwrite d0/f19 [0,4194304] 0 2023-12-05T09:26:10.042 INFO:tasks.workunit.client.1.smithi134.stdout:5/142: creat d0/f33 x:0 0 0 2023-12-05T09:26:10.042 INFO:tasks.workunit.client.1.smithi134.stdout:5/143: write d0/fc [3913115,31086] 0 2023-12-05T09:26:10.042 INFO:tasks.workunit.client.1.smithi134.stdout:5/144: chown d0/d11/c21 213831 1 2023-12-05T09:26:10.042 INFO:tasks.workunit.client.1.smithi134.stdout:9/131: read d7/d8/d14/f1e [2729113,89988] 0 2023-12-05T09:26:10.046 INFO:tasks.workunit.client.1.smithi134.stdout:1/173: dwrite d2/d9/f2d [0,4194304] 0 2023-12-05T09:26:10.051 INFO:tasks.workunit.client.1.smithi134.stdout:0/140: sync 2023-12-05T09:26:10.051 INFO:tasks.workunit.client.1.smithi134.stdout:6/128: sync 2023-12-05T09:26:10.051 INFO:tasks.workunit.client.1.smithi134.stdout:6/129: dread - d4/d8/da/f25 zero size 2023-12-05T09:26:10.051 INFO:tasks.workunit.client.1.smithi134.stdout:9/132: creat d7/d8/d2e/f31 x:0 0 0 2023-12-05T09:26:10.052 INFO:tasks.workunit.client.1.smithi134.stdout:8/198: write da/d1b/f1e [1230258,84712] 0 2023-12-05T09:26:10.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/78: dread f8 [0,4194304] 0 2023-12-05T09:26:10.054 INFO:tasks.workunit.client.0.smithi067.stdout:3/46: rename d9/d11 to d9/d12 0 2023-12-05T09:26:10.054 INFO:tasks.workunit.client.0.smithi067.stdout:3/47: chown f7 2 1 2023-12-05T09:26:10.055 INFO:tasks.workunit.client.0.smithi067.stdout:3/48: chown d9/da 2625 1 2023-12-05T09:26:10.055 INFO:tasks.workunit.client.0.smithi067.stdout:3/49: write d9/fb [1000577,8022] 0 2023-12-05T09:26:10.063 INFO:tasks.workunit.client.1.smithi134.stdout:1/174: symlink d2/l3e 0 2023-12-05T09:26:10.063 INFO:tasks.workunit.client.1.smithi134.stdout:6/130: creat d4/d8/f28 x:0 0 0 2023-12-05T09:26:10.063 INFO:tasks.workunit.client.1.smithi134.stdout:6/131: chown d4/d8/da/d1b/f21 1 1 2023-12-05T09:26:10.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/199: creat da/de/d43/f46 x:0 0 0 2023-12-05T09:26:10.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/200: dread - da/d1b/f3f zero size 2023-12-05T09:26:10.064 INFO:tasks.workunit.client.1.smithi134.stdout:8/201: readlink da/de/d11/l13 0 2023-12-05T09:26:10.064 INFO:tasks.workunit.client.1.smithi134.stdout:8/202: truncate da/de/d16/f23 1803281 0 2023-12-05T09:26:10.064 INFO:tasks.workunit.client.1.smithi134.stdout:8/203: readlink da/de/d16/l31 0 2023-12-05T09:26:10.065 INFO:tasks.workunit.client.0.smithi067.stdout:3/50: mknod d9/da/c13 0 2023-12-05T09:26:10.065 INFO:tasks.workunit.client.0.smithi067.stdout:3/51: creat d9/f14 x:0 0 0 2023-12-05T09:26:10.069 INFO:tasks.workunit.client.1.smithi134.stdout:0/141: write fc [1602844,129946] 0 2023-12-05T09:26:10.069 INFO:tasks.workunit.client.1.smithi134.stdout:4/150: dwrite f13 [0,4194304] 0 2023-12-05T09:26:10.069 INFO:tasks.workunit.client.1.smithi134.stdout:4/151: readlink l7 0 2023-12-05T09:26:10.069 INFO:tasks.workunit.client.1.smithi134.stdout:7/156: dread d2/f8 [0,4194304] 0 2023-12-05T09:26:10.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/175: dread d2/d9/d10/f13 [0,4194304] 0 2023-12-05T09:26:10.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/176: creat d2/d9/d10/f3f x:0 0 0 2023-12-05T09:26:10.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/177: truncate d2/d9/d10/f3f 607793 0 2023-12-05T09:26:10.070 INFO:tasks.workunit.client.1.smithi134.stdout:1/178: write d2/d9/f24 [4990651,98342] 0 2023-12-05T09:26:10.074 INFO:tasks.workunit.client.1.smithi134.stdout:9/133: getdents d7/d8/d16 0 2023-12-05T09:26:10.074 INFO:tasks.workunit.client.1.smithi134.stdout:9/134: truncate d7/d8/f13 428598 0 2023-12-05T09:26:10.080 INFO:tasks.workunit.client.1.smithi134.stdout:3/135: dwrite d4/d5/f6 [0,4194304] 0 2023-12-05T09:26:10.080 INFO:tasks.workunit.client.1.smithi134.stdout:3/136: read - d4/d1f/f20 zero size 2023-12-05T09:26:10.080 INFO:tasks.workunit.client.1.smithi134.stdout:3/137: creat d4/f2f x:0 0 0 2023-12-05T09:26:10.081 INFO:tasks.workunit.client.1.smithi134.stdout:3/138: stat d4/d5/f1e 0 2023-12-05T09:26:10.081 INFO:tasks.workunit.client.1.smithi134.stdout:3/139: chown d4/f19 1 1 2023-12-05T09:26:10.081 INFO:tasks.workunit.client.1.smithi134.stdout:3/140: creat d4/d5/d23/f30 x:0 0 0 2023-12-05T09:26:10.089 INFO:tasks.workunit.client.1.smithi134.stdout:3/141: dread f0 [0,4194304] 0 2023-12-05T09:26:10.089 INFO:tasks.workunit.client.1.smithi134.stdout:3/142: readlink d4/lc 0 2023-12-05T09:26:10.089 INFO:tasks.workunit.client.1.smithi134.stdout:3/143: creat d4/d1f/f31 x:0 0 0 2023-12-05T09:26:10.090 INFO:tasks.workunit.client.1.smithi134.stdout:6/132: rename d4/d8/f28 to d4/d8/da/d1b/f29 0 2023-12-05T09:26:10.100 INFO:tasks.workunit.client.1.smithi134.stdout:1/179: mkdir d2/d27/d40 0 2023-12-05T09:26:10.101 INFO:tasks.workunit.client.1.smithi134.stdout:6/133: dread d4/d8/fe [0,4194304] 0 2023-12-05T09:26:10.102 INFO:tasks.workunit.client.1.smithi134.stdout:6/134: write d4/d8/da/d1b/f29 [1005091,72662] 0 2023-12-05T09:26:10.102 INFO:tasks.workunit.client.1.smithi134.stdout:6/135: write d4/d8/da/f25 [571858,105509] 0 2023-12-05T09:26:10.115 INFO:tasks.workunit.client.0.smithi067.stdout:1/125: dwrite d2/d5/d7/de/d10/d15/f1c [0,4194304] 0 2023-12-05T09:26:10.118 INFO:tasks.workunit.client.1.smithi134.stdout:3/144: link d4/d5/f1e d4/d5/f32 0 2023-12-05T09:26:10.119 INFO:tasks.workunit.client.0.smithi067.stdout:1/126: truncate d2/d3/f1d 3753130 0 2023-12-05T09:26:10.119 INFO:tasks.workunit.client.1.smithi134.stdout:3/145: creat d4/d1f/f33 x:0 0 0 2023-12-05T09:26:10.119 INFO:tasks.workunit.client.1.smithi134.stdout:4/152: rmdir d16/d18/d1c 39 2023-12-05T09:26:10.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/180: symlink d2/d27/d40/l41 0 2023-12-05T09:26:10.127 INFO:tasks.workunit.client.1.smithi134.stdout:3/146: stat d4/d5/c14 0 2023-12-05T09:26:10.127 INFO:tasks.workunit.client.1.smithi134.stdout:4/153: symlink d16/d18/d1c/l38 0 2023-12-05T09:26:10.127 INFO:tasks.workunit.client.1.smithi134.stdout:4/154: getdents d16/d21/d35 0 2023-12-05T09:26:10.127 INFO:tasks.workunit.client.1.smithi134.stdout:4/155: fsync d16/d18/d1a/f20 0 2023-12-05T09:26:10.130 INFO:tasks.workunit.client.1.smithi134.stdout:4/156: rename d16/c23 to d16/c39 0 2023-12-05T09:26:10.131 INFO:tasks.workunit.client.1.smithi134.stdout:4/157: dread - d16/d18/d1b/f31 zero size 2023-12-05T09:26:10.131 INFO:tasks.workunit.client.1.smithi134.stdout:4/158: dread - d16/d18/d1b/f31 zero size 2023-12-05T09:26:10.134 INFO:tasks.workunit.client.1.smithi134.stdout:6/136: dread d4/db/f20 [0,4194304] 0 2023-12-05T09:26:10.134 INFO:tasks.workunit.client.1.smithi134.stdout:6/137: fdatasync d4/db/f12 0 2023-12-05T09:26:10.138 INFO:tasks.workunit.client.0.smithi067.stdout:7/128: sync 2023-12-05T09:26:10.138 INFO:tasks.workunit.client.1.smithi134.stdout:7/157: dwrite d2/d7/dc/d22/f27 [0,4194304] 0 2023-12-05T09:26:10.139 INFO:tasks.workunit.client.0.smithi067.stdout:6/79: dwrite da/d10/f11 [0,4194304] 0 2023-12-05T09:26:10.139 INFO:tasks.workunit.client.0.smithi067.stdout:6/80: dread - da/db/d16/d17/f18 zero size 2023-12-05T09:26:10.143 INFO:tasks.workunit.client.0.smithi067.stdout:9/248: dwrite d1b/d25/d35/f49 [0,4194304] 0 2023-12-05T09:26:10.143 INFO:tasks.workunit.client.0.smithi067.stdout:9/249: dread - d1b/d25/d35/f4f zero size 2023-12-05T09:26:10.145 INFO:tasks.workunit.client.1.smithi134.stdout:7/158: symlink d2/d7/dc/d22/l33 0 2023-12-05T09:26:10.145 INFO:tasks.workunit.client.1.smithi134.stdout:7/159: stat d2/df/l1e 0 2023-12-05T09:26:10.147 INFO:tasks.workunit.client.1.smithi134.stdout:7/160: rmdir d2/d7/d25 39 2023-12-05T09:26:10.147 INFO:tasks.workunit.client.1.smithi134.stdout:7/161: fsync d2/df/f14 0 2023-12-05T09:26:10.153 INFO:tasks.workunit.client.1.smithi134.stdout:5/145: dwrite d0/d1a/d1c/f23 [0,4194304] 0 2023-12-05T09:26:10.153 INFO:tasks.workunit.client.1.smithi134.stdout:5/146: truncate d0/d1a/d1c/d25/f2d 910536 0 2023-12-05T09:26:10.161 INFO:tasks.workunit.client.1.smithi134.stdout:5/147: mknod d0/d1a/d1c/c34 0 2023-12-05T09:26:10.161 INFO:tasks.workunit.client.1.smithi134.stdout:6/138: getdents d4/d8 0 2023-12-05T09:26:10.163 INFO:tasks.workunit.client.0.smithi067.stdout:6/81: link da/db/lf da/db/d16/l1d 0 2023-12-05T09:26:10.165 INFO:tasks.workunit.client.1.smithi134.stdout:6/139: unlink f0 0 2023-12-05T09:26:10.168 INFO:tasks.workunit.client.1.smithi134.stdout:6/140: mkdir d4/d2a 0 2023-12-05T09:26:10.168 INFO:tasks.workunit.client.1.smithi134.stdout:6/141: readlink d4/d8/l22 0 2023-12-05T09:26:10.174 INFO:tasks.workunit.client.1.smithi134.stdout:6/142: rename c2 to d4/c2b 0 2023-12-05T09:26:10.175 INFO:tasks.workunit.client.1.smithi134.stdout:6/143: stat d4/db/f12 0 2023-12-05T09:26:10.179 INFO:tasks.workunit.client.0.smithi067.stdout:3/52: dwrite f4 [0,4194304] 0 2023-12-05T09:26:10.179 INFO:tasks.workunit.client.0.smithi067.stdout:3/53: readlink d9/d12/l10 0 2023-12-05T09:26:10.179 INFO:tasks.workunit.client.0.smithi067.stdout:3/54: chown d9/d12 1817 1 2023-12-05T09:26:10.180 INFO:tasks.workunit.client.0.smithi067.stdout:7/129: rename d0/d9/d1b/l29 to d0/l31 0 2023-12-05T09:26:10.180 INFO:tasks.workunit.client.0.smithi067.stdout:7/130: write d0/d9/d10/d1d/f26 [688478,103626] 0 2023-12-05T09:26:10.180 INFO:tasks.workunit.client.1.smithi134.stdout:6/144: rmdir d4/d8/da/d1b 39 2023-12-05T09:26:10.180 INFO:tasks.workunit.client.1.smithi134.stdout:6/145: chown d4/d8/da/l13 2424 1 2023-12-05T09:26:10.181 INFO:tasks.workunit.client.1.smithi134.stdout:7/162: write d2/d7/d25/d26/f20 [3741425,31724] 0 2023-12-05T09:26:10.182 INFO:tasks.workunit.client.1.smithi134.stdout:7/163: chown d2/d7/dc/f31 3811970 1 2023-12-05T09:26:10.182 INFO:tasks.workunit.client.1.smithi134.stdout:7/164: fdatasync d2/d7/dc/f31 0 2023-12-05T09:26:10.188 INFO:tasks.workunit.client.1.smithi134.stdout:1/181: dread d2/d9/f1b [0,4194304] 0 2023-12-05T09:26:10.188 INFO:tasks.workunit.client.0.smithi067.stdout:7/131: getdents d0/d9/d10/d22 0 2023-12-05T09:26:10.189 INFO:tasks.workunit.client.0.smithi067.stdout:7/132: read d0/f7 [1144945,113250] 0 2023-12-05T09:26:10.189 INFO:tasks.workunit.client.0.smithi067.stdout:7/133: fsync d0/d9/d10/d1d/f1f 0 2023-12-05T09:26:10.191 INFO:tasks.workunit.client.0.smithi067.stdout:5/127: dwrite db/df/d1a/d1d/d20/f2a [0,4194304] 0 2023-12-05T09:26:10.195 INFO:tasks.workunit.client.0.smithi067.stdout:5/128: write db/df/f32 [477468,31387] 0 2023-12-05T09:26:10.195 INFO:tasks.workunit.client.0.smithi067.stdout:7/134: link d0/f7 d0/d9/d10/f32 0 2023-12-05T09:26:10.195 INFO:tasks.workunit.client.1.smithi134.stdout:1/182: symlink d2/d9/l42 0 2023-12-05T09:26:10.199 INFO:tasks.workunit.client.1.smithi134.stdout:8/204: dwrite da/de/d16/f26 [0,4194304] 0 2023-12-05T09:26:10.199 INFO:tasks.workunit.client.1.smithi134.stdout:3/147: dwrite f0 [0,4194304] 0 2023-12-05T09:26:10.199 INFO:tasks.workunit.client.1.smithi134.stdout:3/148: dread - d4/f19 zero size 2023-12-05T09:26:10.208 INFO:tasks.workunit.client.0.smithi067.stdout:3/55: write d9/d12/ff [3611565,25249] 0 2023-12-05T09:26:10.208 INFO:tasks.workunit.client.1.smithi134.stdout:9/135: dwrite f3 [0,4194304] 0 2023-12-05T09:26:10.208 INFO:tasks.workunit.client.1.smithi134.stdout:9/136: chown d7/d8/d2e/f31 47 1 2023-12-05T09:26:10.208 INFO:tasks.workunit.client.0.smithi067.stdout:1/127: dwrite d2/d5/d7/de/d10/d15/f1c [4194304,4194304] 0 2023-12-05T09:26:10.213 INFO:tasks.workunit.client.1.smithi134.stdout:1/183: write d2/f17 [2576482,92558] 0 2023-12-05T09:26:10.213 INFO:tasks.workunit.client.1.smithi134.stdout:1/184: chown d2/d9 684077083 1 2023-12-05T09:26:10.214 INFO:tasks.workunit.client.1.smithi134.stdout:8/205: link da/de/f27 da/de/d16/d45/d3b/f47 0 2023-12-05T09:26:10.214 INFO:tasks.workunit.client.1.smithi134.stdout:3/149: rename d4/f19 to d4/f34 0 2023-12-05T09:26:10.216 INFO:tasks.workunit.client.1.smithi134.stdout:0/142: dwrite d13/d1f/d23/f27 [0,4194304] 0 2023-12-05T09:26:10.219 INFO:tasks.workunit.client.1.smithi134.stdout:8/206: rename da/d1b/f2f to da/de/f48 0 2023-12-05T09:26:10.219 INFO:tasks.workunit.client.1.smithi134.stdout:8/207: dread - da/de/d16/f20 zero size 2023-12-05T09:26:10.220 INFO:tasks.workunit.client.1.smithi134.stdout:8/208: chown da/de/d16/d45 3659 1 2023-12-05T09:26:10.220 INFO:tasks.workunit.client.1.smithi134.stdout:8/209: write da/de/d11/f30 [927295,117459] 0 2023-12-05T09:26:10.220 INFO:tasks.workunit.client.1.smithi134.stdout:7/165: write d2/d7/dc/d22/f27 [503497,77355] 0 2023-12-05T09:26:10.220 INFO:tasks.workunit.client.1.smithi134.stdout:1/185: getdents d2/d27 0 2023-12-05T09:26:10.220 INFO:tasks.workunit.client.1.smithi134.stdout:1/186: write d2/f17 [1049373,82764] 0 2023-12-05T09:26:10.222 INFO:tasks.workunit.client.1.smithi134.stdout:0/143: mknod d13/d14/d15/c28 0 2023-12-05T09:26:10.223 INFO:tasks.workunit.client.1.smithi134.stdout:8/210: symlink da/de/d16/d45/l49 0 2023-12-05T09:26:10.223 INFO:tasks.workunit.client.1.smithi134.stdout:4/159: dwrite d16/d18/d1b/d24/f25 [0,4194304] 0 2023-12-05T09:26:10.224 INFO:tasks.workunit.client.0.smithi067.stdout:6/82: rename da/db/d16 to da/d10/d1e 0 2023-12-05T09:26:10.224 INFO:tasks.workunit.client.0.smithi067.stdout:6/83: fsync da/d10/d1e/d17/f18 0 2023-12-05T09:26:10.227 INFO:tasks.workunit.client.0.smithi067.stdout:9/250: dwrite f7 [0,4194304] 0 2023-12-05T09:26:10.227 INFO:tasks.workunit.client.1.smithi134.stdout:1/187: creat d2/f43 x:0 0 0 2023-12-05T09:26:10.227 INFO:tasks.workunit.client.1.smithi134.stdout:1/188: creat d2/d9/f44 x:0 0 0 2023-12-05T09:26:10.227 INFO:tasks.workunit.client.1.smithi134.stdout:1/189: stat d2/d9/l42 0 2023-12-05T09:26:10.228 INFO:tasks.workunit.client.1.smithi134.stdout:0/144: creat d13/d14/d19/f29 x:0 0 0 2023-12-05T09:26:10.229 INFO:tasks.workunit.client.0.smithi067.stdout:5/129: dread f9 [0,4194304] 0 2023-12-05T09:26:10.231 INFO:tasks.workunit.client.0.smithi067.stdout:6/84: getdents da/db/d12 0 2023-12-05T09:26:10.231 INFO:tasks.workunit.client.1.smithi134.stdout:5/148: dwrite d0/fc [4194304,4194304] 0 2023-12-05T09:26:10.237 INFO:tasks.workunit.client.0.smithi067.stdout:9/251: dread d1b/f3b [4194304,4194304] 0 2023-12-05T09:26:10.240 INFO:tasks.workunit.client.1.smithi134.stdout:1/190: link d2/l21 d2/d9/l45 0 2023-12-05T09:26:10.240 INFO:tasks.workunit.client.1.smithi134.stdout:5/149: link d0/dd/le d0/d1a/l35 0 2023-12-05T09:26:10.241 INFO:tasks.workunit.client.1.smithi134.stdout:3/150: write f0 [4695795,86396] 0 2023-12-05T09:26:10.242 INFO:tasks.workunit.client.0.smithi067.stdout:3/56: dread d9/fe [0,4194304] 0 2023-12-05T09:26:10.242 INFO:tasks.workunit.client.0.smithi067.stdout:3/57: readlink l2 0 2023-12-05T09:26:10.242 INFO:tasks.workunit.client.0.smithi067.stdout:3/58: fsync f6 0 2023-12-05T09:26:10.243 INFO:tasks.workunit.client.1.smithi134.stdout:5/150: rename d0/d11/c26 to d0/dd/c36 0 2023-12-05T09:26:10.244 INFO:tasks.workunit.client.1.smithi134.stdout:9/137: dread d7/d8/d14/f1e [0,4194304] 0 2023-12-05T09:26:10.249 INFO:tasks.workunit.client.1.smithi134.stdout:3/151: truncate d4/d5/f32 770818 0 2023-12-05T09:26:10.250 INFO:tasks.workunit.client.1.smithi134.stdout:9/138: rename l4 to d7/l32 0 2023-12-05T09:26:10.251 INFO:tasks.workunit.client.1.smithi134.stdout:9/139: truncate d7/d8/f13 1129593 0 2023-12-05T09:26:10.254 INFO:tasks.workunit.client.1.smithi134.stdout:0/145: dread f8 [0,4194304] 0 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:6/85: mkdir da/db/d1f 0 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:0/153: sync 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:0/154: fdatasync d3/df/f21 0 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:8/99: sync 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:0/155: creat d3/f31 x:0 0 0 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:0/156: read - d3/df/f25 zero size 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:2/89: sync 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:0/157: creat d3/f32 x:0 0 0 2023-12-05T09:26:10.255 INFO:tasks.workunit.client.0.smithi067.stdout:0/158: stat d3/d7/f8 0 2023-12-05T09:26:10.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/100: creat d5/da/f1d x:0 0 0 2023-12-05T09:26:10.256 INFO:tasks.workunit.client.0.smithi067.stdout:2/90: unlink d0/d10/f16 0 2023-12-05T09:26:10.256 INFO:tasks.workunit.client.0.smithi067.stdout:0/159: creat d3/df/d10/f33 x:0 0 0 2023-12-05T09:26:10.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/101: mknod d5/dc/c1e 0 2023-12-05T09:26:10.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/102: chown d5/dc/d1a 47 1 2023-12-05T09:26:10.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/103: stat d5 0 2023-12-05T09:26:10.264 INFO:tasks.workunit.client.0.smithi067.stdout:8/104: stat d5/da/c12 0 2023-12-05T09:26:10.269 INFO:tasks.workunit.client.1.smithi134.stdout:0/146: mkdir d13/d14/d15/d2a 0 2023-12-05T09:26:10.270 INFO:tasks.workunit.client.1.smithi134.stdout:2/172: sync 2023-12-05T09:26:10.272 INFO:tasks.workunit.client.1.smithi134.stdout:0/147: symlink d13/l2b 0 2023-12-05T09:26:10.272 INFO:tasks.workunit.client.1.smithi134.stdout:0/148: chown f9 11398007 1 2023-12-05T09:26:10.273 INFO:tasks.workunit.client.1.smithi134.stdout:2/173: mknod d19/c3d 0 2023-12-05T09:26:10.273 INFO:tasks.workunit.client.1.smithi134.stdout:2/174: fsync d19/d28/f30 0 2023-12-05T09:26:10.273 INFO:tasks.workunit.client.1.smithi134.stdout:2/175: stat f15 0 2023-12-05T09:26:10.278 INFO:tasks.workunit.client.1.smithi134.stdout:2/176: unlink d19/f1e 0 2023-12-05T09:26:10.278 INFO:tasks.workunit.client.1.smithi134.stdout:2/177: dread - d19/f35 zero size 2023-12-05T09:26:10.278 INFO:tasks.workunit.client.1.smithi134.stdout:2/178: creat d19/d28/d31/f3e x:0 0 0 2023-12-05T09:26:10.282 INFO:tasks.workunit.client.0.smithi067.stdout:6/86: dread da/d10/f11 [0,4194304] 0 2023-12-05T09:26:10.284 INFO:tasks.workunit.client.0.smithi067.stdout:6/87: getdents da/d10 0 2023-12-05T09:26:10.284 INFO:tasks.workunit.client.0.smithi067.stdout:6/88: fsync f8 0 2023-12-05T09:26:10.284 INFO:tasks.workunit.client.1.smithi134.stdout:2/179: mkdir d19/d3f 0 2023-12-05T09:26:10.287 INFO:tasks.workunit.client.0.smithi067.stdout:6/89: symlink da/db/l20 0 2023-12-05T09:26:10.288 INFO:tasks.workunit.client.0.smithi067.stdout:6/90: creat da/db/d12/d19/f21 x:0 0 0 2023-12-05T09:26:10.290 INFO:tasks.workunit.client.1.smithi134.stdout:9/140: dread f1 [0,4194304] 0 2023-12-05T09:26:10.295 INFO:tasks.workunit.client.1.smithi134.stdout:2/180: dread f12 [0,4194304] 0 2023-12-05T09:26:10.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/149: dread fe [0,4194304] 0 2023-12-05T09:26:10.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/150: getdents d13/d14/d15/d2a 0 2023-12-05T09:26:10.297 INFO:tasks.workunit.client.1.smithi134.stdout:0/151: mkdir d13/d14/d19/d2c 0 2023-12-05T09:26:10.297 INFO:tasks.workunit.client.1.smithi134.stdout:0/152: stat d13/d14/d19 0 2023-12-05T09:26:10.298 INFO:tasks.workunit.client.1.smithi134.stdout:0/153: mknod d13/d14/d19/c2d 0 2023-12-05T09:26:10.300 INFO:tasks.workunit.client.1.smithi134.stdout:0/154: mknod d13/d14/d19/c2e 0 2023-12-05T09:26:10.303 INFO:tasks.workunit.client.1.smithi134.stdout:1/191: write d2/d9/f2d [841192,11236] 0 2023-12-05T09:26:10.306 INFO:tasks.workunit.client.1.smithi134.stdout:1/192: creat d2/d27/d40/f46 x:0 0 0 2023-12-05T09:26:10.306 INFO:tasks.workunit.client.1.smithi134.stdout:1/193: creat d2/d9/d10/f47 x:0 0 0 2023-12-05T09:26:10.308 INFO:tasks.workunit.client.0.smithi067.stdout:6/91: dread f4 [0,4194304] 0 2023-12-05T09:26:10.309 INFO:tasks.workunit.client.0.smithi067.stdout:6/92: mknod da/d10/d1e/d17/c22 0 2023-12-05T09:26:10.312 INFO:tasks.workunit.client.0.smithi067.stdout:6/93: creat da/d10/d1e/d17/f23 x:0 0 0 2023-12-05T09:26:10.312 INFO:tasks.workunit.client.0.smithi067.stdout:6/94: stat da/d10 0 2023-12-05T09:26:10.317 INFO:tasks.workunit.client.1.smithi134.stdout:2/181: read f15 [1631798,75314] 0 2023-12-05T09:26:10.317 INFO:tasks.workunit.client.1.smithi134.stdout:2/182: readlink d19/l21 0 2023-12-05T09:26:10.317 INFO:tasks.workunit.client.1.smithi134.stdout:2/183: symlink d19/d3f/l40 0 2023-12-05T09:26:10.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/151: dwrite d0/f7 [4194304,4194304] 0 2023-12-05T09:26:10.323 INFO:tasks.workunit.client.1.smithi134.stdout:8/211: dwrite da/f29 [0,4194304] 0 2023-12-05T09:26:10.329 INFO:tasks.workunit.client.1.smithi134.stdout:8/212: symlink da/d1b/d42/l4a 0 2023-12-05T09:26:10.331 INFO:tasks.workunit.client.1.smithi134.stdout:5/152: write d0/f19 [6950608,107799] 0 2023-12-05T09:26:10.332 INFO:tasks.workunit.client.1.smithi134.stdout:4/160: dwrite d16/d18/d1a/f20 [0,4194304] 0 2023-12-05T09:26:10.332 INFO:tasks.workunit.client.1.smithi134.stdout:4/161: fsync d16/d18/d1b/d24/f28 0 2023-12-05T09:26:10.332 INFO:tasks.workunit.client.1.smithi134.stdout:4/162: fsync f15 0 2023-12-05T09:26:10.333 INFO:tasks.workunit.client.1.smithi134.stdout:4/163: chown d16/d18/d1c 41613 1 2023-12-05T09:26:10.333 INFO:tasks.workunit.client.1.smithi134.stdout:9/141: dwrite d7/d8/d14/f1e [0,4194304] 0 2023-12-05T09:26:10.337 INFO:tasks.workunit.client.1.smithi134.stdout:5/153: mkdir d0/dd/d37 0 2023-12-05T09:26:10.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/154: mknod d0/d1a/c38 0 2023-12-05T09:26:10.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/155: fsync d0/f33 0 2023-12-05T09:26:10.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/156: creat d0/d1a/f39 x:0 0 0 2023-12-05T09:26:10.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/157: dread - d0/f33 zero size 2023-12-05T09:26:10.344 INFO:tasks.workunit.client.1.smithi134.stdout:8/213: read da/de/f40 [3024935,42401] 0 2023-12-05T09:26:10.344 INFO:tasks.workunit.client.1.smithi134.stdout:8/214: dread - da/de/f1c zero size 2023-12-05T09:26:10.344 INFO:tasks.workunit.client.1.smithi134.stdout:8/215: dread - da/de/d11/d1d/f2e zero size 2023-12-05T09:26:10.346 INFO:tasks.workunit.client.1.smithi134.stdout:8/216: rmdir da/de/d11/d1d 39 2023-12-05T09:26:10.356 INFO:tasks.workunit.client.1.smithi134.stdout:9/142: dread f1 [0,4194304] 0 2023-12-05T09:26:10.356 INFO:tasks.workunit.client.1.smithi134.stdout:9/143: fdatasync d7/f1a 0 2023-12-05T09:26:10.356 INFO:tasks.workunit.client.1.smithi134.stdout:2/184: dwrite d19/d28/f33 [0,4194304] 0 2023-12-05T09:26:10.356 INFO:tasks.workunit.client.1.smithi134.stdout:2/185: truncate d19/d28/d2b/f2f 203517 0 2023-12-05T09:26:10.357 INFO:tasks.workunit.client.1.smithi134.stdout:9/144: write d7/d8/f13 [452057,75486] 0 2023-12-05T09:26:10.358 INFO:tasks.workunit.client.1.smithi134.stdout:2/186: truncate f8 1314264 0 2023-12-05T09:26:10.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:10 smithi067 ceph-mon[107174]: pgmap v20: 65 pgs: 65 active+clean; 364 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 8.7 MiB/s rd, 20 MiB/s wr, 728 op/s 2023-12-05T09:26:10.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:10 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:10.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:10 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:10.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:10 smithi134 ceph-mon[116304]: pgmap v20: 65 pgs: 65 active+clean; 364 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 8.7 MiB/s rd, 20 MiB/s wr, 728 op/s 2023-12-05T09:26:10.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:10 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:10.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:10 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:10.379 INFO:tasks.workunit.client.1.smithi134.stdout:7/166: dwrite f1 [0,4194304] 0 2023-12-05T09:26:10.380 INFO:tasks.workunit.client.1.smithi134.stdout:7/167: fdatasync d2/d7/dc/f31 0 2023-12-05T09:26:10.380 INFO:tasks.workunit.client.1.smithi134.stdout:7/168: creat d2/d7/dc/f34 x:0 0 0 2023-12-05T09:26:10.380 INFO:tasks.workunit.client.1.smithi134.stdout:7/169: stat d2/d7/d25/d26/f1c 0 2023-12-05T09:26:10.384 INFO:tasks.workunit.client.0.smithi067.stdout:2/91: dread d0/f9 [0,4194304] 0 2023-12-05T09:26:10.387 INFO:tasks.workunit.client.1.smithi134.stdout:7/170: creat d2/d7/d25/d26/f35 x:0 0 0 2023-12-05T09:26:10.387 INFO:tasks.workunit.client.0.smithi067.stdout:2/92: truncate d0/fd 3004382 0 2023-12-05T09:26:10.387 INFO:tasks.workunit.client.0.smithi067.stdout:2/93: chown d0/f4 7311916 1 2023-12-05T09:26:10.387 INFO:tasks.workunit.client.0.smithi067.stdout:2/94: write d0/d10/f19 [2598662,9314] 0 2023-12-05T09:26:10.388 INFO:tasks.workunit.client.0.smithi067.stdout:2/95: getdents d0/d15 0 2023-12-05T09:26:10.396 INFO:tasks.workunit.client.0.smithi067.stdout:8/105: dwrite d5/f1c [0,4194304] 0 2023-12-05T09:26:10.396 INFO:tasks.workunit.client.0.smithi067.stdout:8/106: fsync d5/f10 0 2023-12-05T09:26:10.396 INFO:tasks.workunit.client.0.smithi067.stdout:8/107: stat d5/f14 0 2023-12-05T09:26:10.396 INFO:tasks.workunit.client.0.smithi067.stdout:2/96: mknod d0/d10/d1e/c20 0 2023-12-05T09:26:10.397 INFO:tasks.workunit.client.1.smithi134.stdout:5/158: dwrite d0/d11/f22 [0,4194304] 0 2023-12-05T09:26:10.399 INFO:tasks.workunit.client.1.smithi134.stdout:7/171: mkdir d2/df/d2a/d36 0 2023-12-05T09:26:10.403 INFO:tasks.workunit.client.0.smithi067.stdout:0/160: dread d3/df/f16 [0,4194304] 0 2023-12-05T09:26:10.404 INFO:tasks.workunit.client.1.smithi134.stdout:5/159: mkdir d0/d1a/d3a 0 2023-12-05T09:26:10.407 INFO:tasks.workunit.client.1.smithi134.stdout:1/194: getdents d2/d27/d40 0 2023-12-05T09:26:10.409 INFO:tasks.workunit.client.0.smithi067.stdout:8/108: write d5/f10 [1287798,126298] 0 2023-12-05T09:26:10.409 INFO:tasks.workunit.client.0.smithi067.stdout:7/135: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:26:10.410 INFO:tasks.workunit.client.1.smithi134.stdout:3/152: dwrite d4/d1f/f26 [0,4194304] 0 2023-12-05T09:26:10.410 INFO:tasks.workunit.client.1.smithi134.stdout:3/153: readlink d4/d5/l21 0 2023-12-05T09:26:10.410 INFO:tasks.workunit.client.1.smithi134.stdout:3/154: creat d4/d1f/f35 x:0 0 0 2023-12-05T09:26:10.411 INFO:tasks.workunit.client.1.smithi134.stdout:5/160: creat d0/d1a/d3a/f3b x:0 0 0 2023-12-05T09:26:10.411 INFO:tasks.workunit.client.1.smithi134.stdout:5/161: write d0/f19 [8339882,30365] 0 2023-12-05T09:26:10.412 INFO:tasks.workunit.client.1.smithi134.stdout:2/187: rmdir d19 39 2023-12-05T09:26:10.414 INFO:tasks.workunit.client.0.smithi067.stdout:7/136: symlink d0/d9/d10/d22/l33 0 2023-12-05T09:26:10.422 INFO:tasks.workunit.client.1.smithi134.stdout:3/155: unlink d4/d5/fe 0 2023-12-05T09:26:10.424 INFO:tasks.workunit.client.0.smithi067.stdout:0/161: dread d3/f1d [0,4194304] 0 2023-12-05T09:26:10.426 INFO:tasks.workunit.client.1.smithi134.stdout:2/188: stat d19/d3a 0 2023-12-05T09:26:10.426 INFO:tasks.workunit.client.1.smithi134.stdout:3/156: symlink d4/d1f/l36 0 2023-12-05T09:26:10.426 INFO:tasks.workunit.client.1.smithi134.stdout:2/189: dread - d19/f1d zero size 2023-12-05T09:26:10.426 INFO:tasks.workunit.client.1.smithi134.stdout:2/190: dread - d19/d28/d31/f3e zero size 2023-12-05T09:26:10.426 INFO:tasks.workunit.client.1.smithi134.stdout:3/157: creat d4/d5/d23/f37 x:0 0 0 2023-12-05T09:26:10.426 INFO:tasks.workunit.client.1.smithi134.stdout:3/158: dread - d4/f1d zero size 2023-12-05T09:26:10.426 INFO:tasks.workunit.client.1.smithi134.stdout:3/159: stat d4/d5/d23 0 2023-12-05T09:26:10.426 INFO:tasks.workunit.client.1.smithi134.stdout:3/160: creat d4/f38 x:0 0 0 2023-12-05T09:26:10.430 INFO:tasks.workunit.client.0.smithi067.stdout:8/109: read d5/f18 [2846568,9511] 0 2023-12-05T09:26:10.430 INFO:tasks.workunit.client.0.smithi067.stdout:8/110: creat d5/da/f1f x:0 0 0 2023-12-05T09:26:10.430 INFO:tasks.workunit.client.0.smithi067.stdout:8/111: getdents d5/dc/d1a 0 2023-12-05T09:26:10.432 INFO:tasks.workunit.client.1.smithi134.stdout:2/191: creat d19/d28/f41 x:0 0 0 2023-12-05T09:26:10.435 INFO:tasks.workunit.client.1.smithi134.stdout:9/145: dwrite d7/f1c [0,4194304] 0 2023-12-05T09:26:10.436 INFO:tasks.workunit.client.1.smithi134.stdout:3/161: mknod d4/d5/d23/c39 0 2023-12-05T09:26:10.436 INFO:tasks.workunit.client.1.smithi134.stdout:3/162: creat d4/d1f/f3a x:0 0 0 2023-12-05T09:26:10.439 INFO:tasks.workunit.client.0.smithi067.stdout:0/162: getdents d3/d7 0 2023-12-05T09:26:10.442 INFO:tasks.workunit.client.0.smithi067.stdout:6/95: dwrite da/d10/d1e/d17/f18 [0,4194304] 0 2023-12-05T09:26:10.442 INFO:tasks.workunit.client.0.smithi067.stdout:0/163: mknod d3/c34 0 2023-12-05T09:26:10.442 INFO:tasks.workunit.client.0.smithi067.stdout:0/164: creat d3/f35 x:0 0 0 2023-12-05T09:26:10.443 INFO:tasks.workunit.client.1.smithi134.stdout:9/146: rename d7/d8/f13 to d7/d8/d16/f33 0 2023-12-05T09:26:10.443 INFO:tasks.workunit.client.1.smithi134.stdout:5/162: fsync d0/f19 0 2023-12-05T09:26:10.445 INFO:tasks.workunit.client.1.smithi134.stdout:8/217: dwrite da/de/d16/f20 [0,4194304] 0 2023-12-05T09:26:10.446 INFO:tasks.workunit.client.1.smithi134.stdout:7/172: dread d2/df/f15 [0,4194304] 0 2023-12-05T09:26:10.446 INFO:tasks.workunit.client.1.smithi134.stdout:2/192: dread d19/f20 [0,4194304] 0 2023-12-05T09:26:10.447 INFO:tasks.workunit.client.0.smithi067.stdout:0/165: rename d3/f5 to d3/df/f36 0 2023-12-05T09:26:10.447 INFO:tasks.workunit.client.0.smithi067.stdout:0/166: chown d3/df/f21 5 1 2023-12-05T09:26:10.447 INFO:tasks.workunit.client.0.smithi067.stdout:0/167: getdents d3/d7/d30 0 2023-12-05T09:26:10.453 INFO:tasks.workunit.client.0.smithi067.stdout:0/168: rename d3/df/f24 to d3/df/d10/f37 0 2023-12-05T09:26:10.454 INFO:tasks.workunit.client.1.smithi134.stdout:4/164: dwrite d16/d18/d1b/f31 [0,4194304] 0 2023-12-05T09:26:10.454 INFO:tasks.workunit.client.0.smithi067.stdout:6/96: dread f4 [0,4194304] 0 2023-12-05T09:26:10.456 INFO:tasks.workunit.client.1.smithi134.stdout:6/146: sync 2023-12-05T09:26:10.458 INFO:tasks.workunit.client.0.smithi067.stdout:0/169: mkdir d3/d38 0 2023-12-05T09:26:10.458 INFO:tasks.workunit.client.0.smithi067.stdout:0/170: creat d3/f39 x:0 0 0 2023-12-05T09:26:10.459 INFO:tasks.workunit.client.1.smithi134.stdout:6/147: read d4/d8/da/d1b/f29 [306668,37636] 0 2023-12-05T09:26:10.460 INFO:tasks.workunit.client.1.smithi134.stdout:8/218: mknod da/de/d11/d1d/c4b 0 2023-12-05T09:26:10.461 INFO:tasks.workunit.client.0.smithi067.stdout:6/97: unlink f8 0 2023-12-05T09:26:10.461 INFO:tasks.workunit.client.1.smithi134.stdout:7/173: link d2/d7/dc/f31 d2/d7/f37 0 2023-12-05T09:26:10.462 INFO:tasks.workunit.client.1.smithi134.stdout:2/193: truncate fc 4943833 0 2023-12-05T09:26:10.462 INFO:tasks.workunit.client.1.smithi134.stdout:2/194: chown d19/f20 0 1 2023-12-05T09:26:10.465 INFO:tasks.workunit.client.0.smithi067.stdout:0/171: rename d3/df/d10/c15 to d3/d7/c3a 0 2023-12-05T09:26:10.471 INFO:tasks.workunit.client.0.smithi067.stdout:6/98: rename da/d10/d1e/d17/c22 to da/db/d1f/c24 0 2023-12-05T09:26:10.474 INFO:tasks.workunit.client.0.smithi067.stdout:7/137: dwrite d0/f11 [0,4194304] 0 2023-12-05T09:26:10.475 INFO:tasks.workunit.client.0.smithi067.stdout:6/99: link da/d10/d1e/d17/f23 da/db/d1f/f25 0 2023-12-05T09:26:10.475 INFO:tasks.workunit.client.1.smithi134.stdout:9/147: dread f3 [0,4194304] 0 2023-12-05T09:26:10.477 INFO:tasks.workunit.client.1.smithi134.stdout:8/219: creat da/de/f4c x:0 0 0 2023-12-05T09:26:10.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/174: mknod d2/d7/c38 0 2023-12-05T09:26:10.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/175: write d2/d7/dc/f34 [1040881,52173] 0 2023-12-05T09:26:10.479 INFO:tasks.workunit.client.0.smithi067.stdout:7/138: mkdir d0/d9/d1b/d34 0 2023-12-05T09:26:10.479 INFO:tasks.workunit.client.0.smithi067.stdout:6/100: mknod da/c26 0 2023-12-05T09:26:10.480 INFO:tasks.workunit.client.1.smithi134.stdout:1/195: dwrite d2/d9/d10/d30/f37 [0,4194304] 0 2023-12-05T09:26:10.481 INFO:tasks.workunit.client.1.smithi134.stdout:1/196: chown d2/d27 309199537 1 2023-12-05T09:26:10.481 INFO:tasks.workunit.client.1.smithi134.stdout:2/195: dread d19/f2c [0,4194304] 0 2023-12-05T09:26:10.481 INFO:tasks.workunit.client.1.smithi134.stdout:2/196: chown d19/c3d 317 1 2023-12-05T09:26:10.486 INFO:tasks.workunit.client.1.smithi134.stdout:9/148: symlink d7/d8/l34 0 2023-12-05T09:26:10.492 INFO:tasks.workunit.client.1.smithi134.stdout:7/176: symlink d2/df/l39 0 2023-12-05T09:26:10.492 INFO:tasks.workunit.client.1.smithi134.stdout:3/163: getdents d4 0 2023-12-05T09:26:10.492 INFO:tasks.workunit.client.1.smithi134.stdout:3/164: chown d4 196759 1 2023-12-05T09:26:10.492 INFO:tasks.workunit.client.1.smithi134.stdout:2/197: fsync f15 0 2023-12-05T09:26:10.505 INFO:tasks.workunit.client.1.smithi134.stdout:9/149: rename d7/d8/d16/c2b to d7/d8/d14/c35 0 2023-12-05T09:26:10.505 INFO:tasks.workunit.client.1.smithi134.stdout:9/150: write d7/d8/d2e/f31 [1034004,95324] 0 2023-12-05T09:26:10.507 INFO:tasks.workunit.client.0.smithi067.stdout:8/112: dread d5/f10 [0,4194304] 0 2023-12-05T09:26:10.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/139: write d0/f7 [4077565,24134] 0 2023-12-05T09:26:10.517 INFO:tasks.workunit.client.0.smithi067.stdout:8/113: mkdir d5/dc/d1a/d20 0 2023-12-05T09:26:10.517 INFO:tasks.workunit.client.0.smithi067.stdout:8/114: dread - d5/dc/f19 zero size 2023-12-05T09:26:10.517 INFO:tasks.workunit.client.1.smithi134.stdout:7/177: mkdir d2/d7/dc/d2e/d3a 0 2023-12-05T09:26:10.517 INFO:tasks.workunit.client.1.smithi134.stdout:3/165: creat d4/f3b x:0 0 0 2023-12-05T09:26:10.520 INFO:tasks.workunit.client.1.smithi134.stdout:4/165: dwrite f13 [0,4194304] 0 2023-12-05T09:26:10.524 INFO:tasks.workunit.client.1.smithi134.stdout:6/148: dwrite d4/fd [0,4194304] 0 2023-12-05T09:26:10.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/140: rename d0/d9/ff to d0/d9/d10/f35 0 2023-12-05T09:26:10.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/141: write d0/d9/d10/f1a [1737940,76455] 0 2023-12-05T09:26:10.527 INFO:tasks.workunit.client.0.smithi067.stdout:7/142: getdents d0 0 2023-12-05T09:26:10.527 INFO:tasks.workunit.client.1.smithi134.stdout:2/198: link d19/d28/d2b/l2e d19/d3a/l42 0 2023-12-05T09:26:10.529 INFO:tasks.workunit.client.0.smithi067.stdout:7/143: creat d0/d9/d1b/d34/f36 x:0 0 0 2023-12-05T09:26:10.529 INFO:tasks.workunit.client.0.smithi067.stdout:7/144: write d0/f7 [3607332,110294] 0 2023-12-05T09:26:10.530 INFO:tasks.workunit.client.1.smithi134.stdout:7/178: creat d2/d7/dc/d2e/d3a/f3b x:0 0 0 2023-12-05T09:26:10.530 INFO:tasks.workunit.client.1.smithi134.stdout:7/179: chown d2/d7/d25/d26/f20 3491 1 2023-12-05T09:26:10.533 INFO:tasks.workunit.client.1.smithi134.stdout:0/155: sync 2023-12-05T09:26:10.533 INFO:tasks.workunit.client.1.smithi134.stdout:0/156: chown d13/d1f/d23/f27 4 1 2023-12-05T09:26:10.533 INFO:tasks.workunit.client.1.smithi134.stdout:0/157: truncate f9 1949525 0 2023-12-05T09:26:10.534 INFO:tasks.workunit.client.1.smithi134.stdout:3/166: mknod d4/d5/c3c 0 2023-12-05T09:26:10.534 INFO:tasks.workunit.client.1.smithi134.stdout:6/149: getdents d4/d8/da/d1b 0 2023-12-05T09:26:10.534 INFO:tasks.workunit.client.1.smithi134.stdout:6/150: write d4/d8/da/f19 [922795,66184] 0 2023-12-05T09:26:10.534 INFO:tasks.workunit.client.1.smithi134.stdout:6/151: write d4/db/f1f [80496,79208] 0 2023-12-05T09:26:10.534 INFO:tasks.workunit.client.1.smithi134.stdout:6/152: fsync d4/f26 0 2023-12-05T09:26:10.535 INFO:tasks.workunit.client.1.smithi134.stdout:1/197: dwrite d2/f19 [0,4194304] 0 2023-12-05T09:26:10.535 INFO:tasks.workunit.client.1.smithi134.stdout:1/198: dread - d2/d27/d40/f46 zero size 2023-12-05T09:26:10.535 INFO:tasks.workunit.client.1.smithi134.stdout:1/199: dread - d2/f2b zero size 2023-12-05T09:26:10.535 INFO:tasks.workunit.client.1.smithi134.stdout:1/200: fsync d2/d9/d10/d30/f37 0 2023-12-05T09:26:10.536 INFO:tasks.workunit.client.1.smithi134.stdout:6/153: rename d4/db/c1c to d4/d2a/c2c 0 2023-12-05T09:26:10.541 INFO:tasks.workunit.client.1.smithi134.stdout:6/154: symlink d4/l2d 0 2023-12-05T09:26:10.541 INFO:tasks.workunit.client.1.smithi134.stdout:6/155: stat d4/d8/da 0 2023-12-05T09:26:10.542 INFO:tasks.workunit.client.1.smithi134.stdout:6/156: readlink d4/d8/da/l13 0 2023-12-05T09:26:10.545 INFO:tasks.workunit.client.1.smithi134.stdout:1/201: rename d2/d9/d10/f38 to d2/d9/f48 0 2023-12-05T09:26:10.550 INFO:tasks.workunit.client.1.smithi134.stdout:0/158: dread d13/f17 [0,4194304] 0 2023-12-05T09:26:10.552 INFO:tasks.workunit.client.1.smithi134.stdout:9/151: rmdir d7/d8 39 2023-12-05T09:26:10.554 INFO:tasks.workunit.client.0.smithi067.stdout:6/101: dwrite da/d10/d1e/d17/f18 [0,4194304] 0 2023-12-05T09:26:10.554 INFO:tasks.workunit.client.0.smithi067.stdout:7/145: dread d0/f6 [0,4194304] 0 2023-12-05T09:26:10.555 INFO:tasks.workunit.client.1.smithi134.stdout:3/167: dread d4/d5/f6 [0,4194304] 0 2023-12-05T09:26:10.558 INFO:tasks.workunit.client.1.smithi134.stdout:9/152: mkdir d7/d8/d2e/d36 0 2023-12-05T09:26:10.563 INFO:tasks.workunit.client.1.smithi134.stdout:3/168: mknod d4/d5/c3d 0 2023-12-05T09:26:10.564 INFO:tasks.workunit.client.1.smithi134.stdout:3/169: chown d4/d1f/f20 2177549 1 2023-12-05T09:26:10.564 INFO:tasks.workunit.client.1.smithi134.stdout:3/170: dread - d4/f2f zero size 2023-12-05T09:26:10.567 INFO:tasks.workunit.client.1.smithi134.stdout:3/171: getdents d4/d5/d23 0 2023-12-05T09:26:10.567 INFO:tasks.workunit.client.1.smithi134.stdout:3/172: write d4/d5/d23/f2e [799593,12816] 0 2023-12-05T09:26:10.569 INFO:tasks.workunit.client.0.smithi067.stdout:0/172: dwrite d3/df/d10/f33 [0,4194304] 0 2023-12-05T09:26:10.569 INFO:tasks.workunit.client.0.smithi067.stdout:0/173: chown d3/df/f18 474 1 2023-12-05T09:26:10.570 INFO:tasks.workunit.client.1.smithi134.stdout:6/157: write d4/db/f20 [3440760,25374] 0 2023-12-05T09:26:10.570 INFO:tasks.workunit.client.1.smithi134.stdout:6/158: chown d4/d8/da/c10 2075026 1 2023-12-05T09:26:10.570 INFO:tasks.workunit.client.1.smithi134.stdout:6/159: fsync d4/d8/da/d1b/f21 0 2023-12-05T09:26:10.570 INFO:tasks.workunit.client.1.smithi134.stdout:6/160: chown d4 268 1 2023-12-05T09:26:10.573 INFO:tasks.workunit.client.1.smithi134.stdout:8/220: dwrite da/de/f27 [0,4194304] 0 2023-12-05T09:26:10.573 INFO:tasks.workunit.client.1.smithi134.stdout:8/221: fsync da/f3e 0 2023-12-05T09:26:10.573 INFO:tasks.workunit.client.1.smithi134.stdout:8/222: truncate da/de/f48 211345 0 2023-12-05T09:26:10.581 INFO:tasks.workunit.client.1.smithi134.stdout:9/153: dread d7/f1a [0,4194304] 0 2023-12-05T09:26:10.581 INFO:tasks.workunit.client.1.smithi134.stdout:9/154: fsync d7/d8/d14/f1e 0 2023-12-05T09:26:10.582 INFO:tasks.workunit.client.0.smithi067.stdout:6/102: write da/fe [2969450,37233] 0 2023-12-05T09:26:10.587 INFO:tasks.workunit.client.1.smithi134.stdout:8/223: mkdir da/de/d4d 0 2023-12-05T09:26:10.588 INFO:tasks.workunit.client.1.smithi134.stdout:0/159: write d13/d14/d15/f21 [3072446,88829] 0 2023-12-05T09:26:10.589 INFO:tasks.workunit.client.1.smithi134.stdout:9/155: rmdir d7/d10 39 2023-12-05T09:26:10.591 INFO:tasks.workunit.client.0.smithi067.stdout:6/103: mkdir da/db/d1f/d27 0 2023-12-05T09:26:10.592 INFO:tasks.workunit.client.1.smithi134.stdout:6/161: read d4/d8/da/f25 [185893,62577] 0 2023-12-05T09:26:10.595 INFO:tasks.workunit.client.0.smithi067.stdout:8/115: dwrite d5/f16 [4194304,4194304] 0 2023-12-05T09:26:10.595 INFO:tasks.workunit.client.0.smithi067.stdout:8/116: chown d5/da/lf 1042936 1 2023-12-05T09:26:10.596 INFO:tasks.workunit.client.0.smithi067.stdout:8/117: fdatasync d5/f18 0 2023-12-05T09:26:10.596 INFO:tasks.workunit.client.0.smithi067.stdout:8/118: fdatasync d5/f10 0 2023-12-05T09:26:10.600 INFO:tasks.workunit.client.1.smithi134.stdout:8/224: mknod da/de/d16/d45/c4e 0 2023-12-05T09:26:10.601 INFO:tasks.workunit.client.1.smithi134.stdout:7/180: dwrite d2/d7/dc/f31 [0,4194304] 0 2023-12-05T09:26:10.602 INFO:tasks.workunit.client.1.smithi134.stdout:7/181: write d2/d7/dc/d2e/d3a/f3b [117996,48825] 0 2023-12-05T09:26:10.602 INFO:tasks.workunit.client.1.smithi134.stdout:0/160: rmdir d13/d26 0 2023-12-05T09:26:10.605 INFO:tasks.workunit.client.1.smithi134.stdout:4/166: dwrite d16/d18/d1b/d24/f28 [4194304,4194304] 0 2023-12-05T09:26:10.605 INFO:tasks.workunit.client.1.smithi134.stdout:4/167: write f5 [1955591,4684] 0 2023-12-05T09:26:10.611 INFO:tasks.workunit.client.0.smithi067.stdout:0/174: rmdir d3/df 39 2023-12-05T09:26:10.611 INFO:tasks.workunit.client.0.smithi067.stdout:0/175: readlink d3/l27 0 2023-12-05T09:26:10.619 INFO:tasks.workunit.client.0.smithi067.stdout:0/176: rename d3/d7/f12 to d3/f3b 0 2023-12-05T09:26:10.621 INFO:tasks.workunit.client.0.smithi067.stdout:7/146: getdents d0/d9 0 2023-12-05T09:26:10.624 INFO:tasks.workunit.client.1.smithi134.stdout:1/202: dwrite d2/d9/d10/f1d [0,4194304] 0 2023-12-05T09:26:10.625 INFO:tasks.workunit.client.0.smithi067.stdout:0/177: mkdir d3/d7/d3c 0 2023-12-05T09:26:10.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/199: dwrite f5 [4194304,4194304] 0 2023-12-05T09:26:10.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/200: write d19/f2d [208547,35554] 0 2023-12-05T09:26:10.626 INFO:tasks.workunit.client.1.smithi134.stdout:7/182: mknod d2/d7/d2b/c3c 0 2023-12-05T09:26:10.627 INFO:tasks.workunit.client.1.smithi134.stdout:7/183: read - d2/f21 zero size 2023-12-05T09:26:10.627 INFO:tasks.workunit.client.1.smithi134.stdout:4/168: creat d16/d18/d1c/f3a x:0 0 0 2023-12-05T09:26:10.627 INFO:tasks.workunit.client.1.smithi134.stdout:4/169: write d16/d18/d1c/f2e [51259,87945] 0 2023-12-05T09:26:10.628 INFO:tasks.workunit.client.0.smithi067.stdout:0/178: rename d3/df/f25 to d3/f3d 0 2023-12-05T09:26:10.628 INFO:tasks.workunit.client.0.smithi067.stdout:8/119: dread d5/f16 [4194304,4194304] 0 2023-12-05T09:26:10.629 INFO:tasks.workunit.client.0.smithi067.stdout:8/120: write d5/dc/f19 [268276,68535] 0 2023-12-05T09:26:10.631 INFO:tasks.workunit.client.1.smithi134.stdout:2/201: rmdir d19/d28/d2b 39 2023-12-05T09:26:10.632 INFO:tasks.workunit.client.1.smithi134.stdout:4/170: mkdir d16/d18/d1a/d3b 0 2023-12-05T09:26:10.632 INFO:tasks.workunit.client.1.smithi134.stdout:4/171: stat l7 0 2023-12-05T09:26:10.633 INFO:tasks.workunit.client.1.smithi134.stdout:4/172: write fb [5076073,125389] 0 2023-12-05T09:26:10.634 INFO:tasks.workunit.client.1.smithi134.stdout:8/225: dread da/d1b/f1e [0,4194304] 0 2023-12-05T09:26:10.637 INFO:tasks.workunit.client.1.smithi134.stdout:4/173: link d16/d18/d1c/l37 d16/d18/d1b/d24/l3c 0 2023-12-05T09:26:10.641 INFO:tasks.workunit.client.1.smithi134.stdout:3/173: dwrite d4/d1f/f35 [0,4194304] 0 2023-12-05T09:26:10.645 INFO:tasks.workunit.client.0.smithi067.stdout:8/121: read d5/f16 [7147208,119137] 0 2023-12-05T09:26:10.646 INFO:tasks.workunit.client.1.smithi134.stdout:6/162: fsync d4/db/f1f 0 2023-12-05T09:26:10.648 INFO:tasks.workunit.client.1.smithi134.stdout:1/203: dread d2/d9/f48 [0,4194304] 0 2023-12-05T09:26:10.651 INFO:tasks.workunit.client.1.smithi134.stdout:9/156: dwrite d7/d8/d16/f1f [0,4194304] 0 2023-12-05T09:26:10.657 INFO:tasks.workunit.client.1.smithi134.stdout:0/161: dwrite f9 [0,4194304] 0 2023-12-05T09:26:10.658 INFO:tasks.workunit.client.1.smithi134.stdout:1/204: symlink d2/d27/l49 0 2023-12-05T09:26:10.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/163: sync 2023-12-05T09:26:10.660 INFO:tasks.workunit.client.0.smithi067.stdout:7/147: write d0/d9/d10/d1d/f1f [2720264,61963] 0 2023-12-05T09:26:10.661 INFO:tasks.workunit.client.0.smithi067.stdout:7/148: write d0/d9/d10/f35 [3089883,66113] 0 2023-12-05T09:26:10.661 INFO:tasks.workunit.client.0.smithi067.stdout:6/104: dwrite f4 [0,4194304] 0 2023-12-05T09:26:10.662 INFO:tasks.workunit.client.1.smithi134.stdout:7/184: write d2/d7/dc/f2c [2346484,96410] 0 2023-12-05T09:26:10.664 INFO:tasks.workunit.client.1.smithi134.stdout:7/185: write d2/d7/dc/d2e/d3a/f3b [620235,102824] 0 2023-12-05T09:26:10.664 INFO:tasks.workunit.client.1.smithi134.stdout:6/163: dread d4/d8/fe [0,4194304] 0 2023-12-05T09:26:10.670 INFO:tasks.workunit.client.1.smithi134.stdout:8/226: dread da/de/d11/f1a [0,4194304] 0 2023-12-05T09:26:10.671 INFO:tasks.workunit.client.1.smithi134.stdout:2/202: read f1 [2038770,17805] 0 2023-12-05T09:26:10.672 INFO:tasks.workunit.client.0.smithi067.stdout:7/149: rename d0/d9/d10/d22 to d0/d9/d10/d37 0 2023-12-05T09:26:10.672 INFO:tasks.workunit.client.0.smithi067.stdout:7/150: chown d0/f27 4059229 1 2023-12-05T09:26:10.672 INFO:tasks.workunit.client.0.smithi067.stdout:7/151: chown d0/d9/d10/d1d/f1f 438978 1 2023-12-05T09:26:10.672 INFO:tasks.workunit.client.0.smithi067.stdout:7/152: chown d0/l20 135784 1 2023-12-05T09:26:10.672 INFO:tasks.workunit.client.0.smithi067.stdout:7/153: chown d0/d9/f2c 43461 1 2023-12-05T09:26:10.672 INFO:tasks.workunit.client.0.smithi067.stdout:7/154: chown d0/d9/d10/d37/l25 432575735 1 2023-12-05T09:26:10.673 INFO:tasks.workunit.client.1.smithi134.stdout:9/157: rename d7/d8/d14/f1e to d7/d10/f37 0 2023-12-05T09:26:10.686 INFO:tasks.workunit.client.1.smithi134.stdout:7/186: write d2/d7/f13 [974377,35975] 0 2023-12-05T09:26:10.686 INFO:tasks.workunit.client.1.smithi134.stdout:5/164: mknod d0/c3c 0 2023-12-05T09:26:10.700 INFO:tasks.workunit.client.1.smithi134.stdout:9/158: read f3 [3544715,23162] 0 2023-12-05T09:26:10.701 INFO:tasks.workunit.client.1.smithi134.stdout:6/164: creat d4/d2a/f2e x:0 0 0 2023-12-05T09:26:10.701 INFO:tasks.workunit.client.1.smithi134.stdout:6/165: chown d4/fd 6992791 1 2023-12-05T09:26:10.701 INFO:tasks.workunit.client.1.smithi134.stdout:0/162: rename f9 to d13/d14/d19/f2f 0 2023-12-05T09:26:10.701 INFO:tasks.workunit.client.1.smithi134.stdout:0/163: stat d13 0 2023-12-05T09:26:10.701 INFO:tasks.workunit.client.1.smithi134.stdout:0/164: chown d13/d14/d15/c28 332041704 1 2023-12-05T09:26:10.701 INFO:tasks.workunit.client.1.smithi134.stdout:6/166: creat d4/f2f x:0 0 0 2023-12-05T09:26:10.701 INFO:tasks.workunit.client.1.smithi134.stdout:5/165: dread d0/dd/f14 [0,4194304] 0 2023-12-05T09:26:10.701 INFO:tasks.workunit.client.1.smithi134.stdout:5/166: chown d0/f19 123713 1 2023-12-05T09:26:10.704 INFO:tasks.workunit.client.0.smithi067.stdout:7/155: dread d0/d9/d10/f1a [0,4194304] 0 2023-12-05T09:26:10.717 INFO:tasks.workunit.client.0.smithi067.stdout:7/156: dread d0/d9/d10/f1a [0,4194304] 0 2023-12-05T09:26:10.721 INFO:tasks.workunit.client.0.smithi067.stdout:0/179: dwrite d3/df/d10/f37 [4194304,4194304] 0 2023-12-05T09:26:10.721 INFO:tasks.workunit.client.1.smithi134.stdout:4/174: dwrite d16/d18/d1b/d24/f25 [0,4194304] 0 2023-12-05T09:26:10.721 INFO:tasks.workunit.client.1.smithi134.stdout:7/187: creat d2/d7/dc/d22/f3d x:0 0 0 2023-12-05T09:26:10.721 INFO:tasks.workunit.client.1.smithi134.stdout:9/159: getdents d7/d8 0 2023-12-05T09:26:10.721 INFO:tasks.workunit.client.1.smithi134.stdout:6/167: creat d4/d8/da/d1b/f30 x:0 0 0 2023-12-05T09:26:10.721 INFO:tasks.workunit.client.1.smithi134.stdout:6/168: write d4/d2a/f2e [883554,104332] 0 2023-12-05T09:26:10.725 INFO:tasks.workunit.client.1.smithi134.stdout:3/174: dwrite d4/f16 [0,4194304] 0 2023-12-05T09:26:10.725 INFO:tasks.workunit.client.1.smithi134.stdout:4/175: unlink d16/d18/d1b/d24/f28 0 2023-12-05T09:26:10.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/188: write d2/d7/dc/d2e/d3a/f3b [615627,80480] 0 2023-12-05T09:26:10.726 INFO:tasks.workunit.client.0.smithi067.stdout:8/122: dwrite d5/da/f1f [0,4194304] 0 2023-12-05T09:26:10.727 INFO:tasks.workunit.client.0.smithi067.stdout:7/157: rmdir d0/d9/d10/d1d 39 2023-12-05T09:26:10.727 INFO:tasks.workunit.client.0.smithi067.stdout:0/180: creat d3/df/f3e x:0 0 0 2023-12-05T09:26:10.728 INFO:tasks.workunit.client.0.smithi067.stdout:0/181: creat d3/df/f3f x:0 0 0 2023-12-05T09:26:10.728 INFO:tasks.workunit.client.0.smithi067.stdout:0/182: write d3/f4 [1515108,58949] 0 2023-12-05T09:26:10.728 INFO:tasks.workunit.client.0.smithi067.stdout:0/183: creat d3/df/f40 x:0 0 0 2023-12-05T09:26:10.730 INFO:tasks.workunit.client.1.smithi134.stdout:6/169: dread d4/db/f12 [0,4194304] 0 2023-12-05T09:26:10.732 INFO:tasks.workunit.client.0.smithi067.stdout:8/123: getdents d5/dc 0 2023-12-05T09:26:10.735 INFO:tasks.workunit.client.1.smithi134.stdout:9/160: mknod d7/d8/d2e/d36/c38 0 2023-12-05T09:26:10.735 INFO:tasks.workunit.client.1.smithi134.stdout:3/175: symlink d4/d1f/l3e 0 2023-12-05T09:26:10.735 INFO:tasks.workunit.client.1.smithi134.stdout:9/161: chown d7/d8/d14/d26 226 1 2023-12-05T09:26:10.736 INFO:tasks.workunit.client.1.smithi134.stdout:8/227: write f2 [2583411,28521] 0 2023-12-05T09:26:10.736 INFO:tasks.workunit.client.1.smithi134.stdout:8/228: chown da/de/d11/f30 7545621 1 2023-12-05T09:26:10.736 INFO:tasks.workunit.client.1.smithi134.stdout:8/229: truncate da/de/f4c 860368 0 2023-12-05T09:26:10.736 INFO:tasks.workunit.client.0.smithi067.stdout:7/158: truncate d0/d9/d10/f32 7232 0 2023-12-05T09:26:10.736 INFO:tasks.workunit.client.1.smithi134.stdout:5/167: dwrite d0/f19 [0,4194304] 0 2023-12-05T09:26:10.738 INFO:tasks.workunit.client.1.smithi134.stdout:6/170: rename d4/db/f20 to d4/db/f31 0 2023-12-05T09:26:10.742 INFO:tasks.workunit.client.1.smithi134.stdout:3/176: mkdir d4/d3f 0 2023-12-05T09:26:10.743 INFO:tasks.workunit.client.1.smithi134.stdout:5/168: unlink d0/dd/c36 0 2023-12-05T09:26:10.745 INFO:tasks.workunit.client.1.smithi134.stdout:4/176: rename d16/d18/d1b/d24/d29 to d16/d18/d1b/d3d 0 2023-12-05T09:26:10.746 INFO:tasks.workunit.client.1.smithi134.stdout:5/169: mknod d0/dd/c3d 0 2023-12-05T09:26:10.746 INFO:tasks.workunit.client.1.smithi134.stdout:5/170: readlink d0/l2e 0 2023-12-05T09:26:10.747 INFO:tasks.workunit.client.0.smithi067.stdout:8/124: dread d5/f16 [4194304,4194304] 0 2023-12-05T09:26:10.747 INFO:tasks.workunit.client.0.smithi067.stdout:8/125: read d5/f18 [569117,84355] 0 2023-12-05T09:26:10.747 INFO:tasks.workunit.client.0.smithi067.stdout:8/126: chown d5/f16 12846761 1 2023-12-05T09:26:10.748 INFO:tasks.workunit.client.0.smithi067.stdout:4/57: sync 2023-12-05T09:26:10.748 INFO:tasks.workunit.client.0.smithi067.stdout:4/58: dread - d0/d9/f13 zero size 2023-12-05T09:26:10.750 INFO:tasks.workunit.client.1.smithi134.stdout:7/189: rename d2/dd/f12 to d2/d7/dc/d2e/f3e 0 2023-12-05T09:26:10.752 INFO:tasks.workunit.client.1.smithi134.stdout:4/177: rename d16/d18/d1a/f30 to d16/d18/d1a/f3e 0 2023-12-05T09:26:10.754 INFO:tasks.workunit.client.1.smithi134.stdout:5/171: symlink d0/l3e 0 2023-12-05T09:26:10.754 INFO:tasks.workunit.client.1.smithi134.stdout:5/172: readlink d0/d1a/l35 0 2023-12-05T09:26:10.755 INFO:tasks.workunit.client.0.smithi067.stdout:8/127: rename d5/f16 to d5/dc/d1a/f21 0 2023-12-05T09:26:10.757 INFO:tasks.workunit.client.1.smithi134.stdout:3/177: write d4/d1f/f20 [2529990,99018] 0 2023-12-05T09:26:10.759 INFO:tasks.workunit.client.0.smithi067.stdout:4/59: write d0/f6 [4150620,34592] 0 2023-12-05T09:26:10.760 INFO:tasks.workunit.client.0.smithi067.stdout:7/159: write d0/d9/d10/f32 [743335,58692] 0 2023-12-05T09:26:10.763 INFO:tasks.workunit.client.0.smithi067.stdout:7/160: mkdir d0/d9/d10/d37/d38 0 2023-12-05T09:26:10.770 INFO:tasks.workunit.client.1.smithi134.stdout:5/173: mkdir d0/d1a/d1c/d3f 0 2023-12-05T09:26:10.772 INFO:tasks.workunit.client.0.smithi067.stdout:7/161: mkdir d0/d9/d10/d37/d39 0 2023-12-05T09:26:10.772 INFO:tasks.workunit.client.0.smithi067.stdout:7/162: chown d0/f6 35 1 2023-12-05T09:26:10.772 INFO:tasks.workunit.client.0.smithi067.stdout:7/163: read - d0/d9/f2c zero size 2023-12-05T09:26:10.774 INFO:tasks.workunit.client.0.smithi067.stdout:7/164: symlink d0/d9/l3a 0 2023-12-05T09:26:10.781 INFO:tasks.workunit.client.1.smithi134.stdout:0/165: rename d13/d14/d19 to d13/d14/d30 0 2023-12-05T09:26:10.782 INFO:tasks.workunit.client.1.smithi134.stdout:2/203: dwrite fd [0,4194304] 0 2023-12-05T09:26:10.782 INFO:tasks.workunit.client.1.smithi134.stdout:3/178: dread d4/d5/f32 [0,4194304] 0 2023-12-05T09:26:10.782 INFO:tasks.workunit.client.1.smithi134.stdout:3/179: fdatasync d4/d1f/f2b 0 2023-12-05T09:26:10.783 INFO:tasks.workunit.client.0.smithi067.stdout:7/165: rename d0/l15 to d0/d9/d10/d1d/l3b 0 2023-12-05T09:26:10.784 INFO:tasks.workunit.client.0.smithi067.stdout:7/166: write d0/d9/d10/d1d/f1f [892326,118475] 0 2023-12-05T09:26:10.789 INFO:tasks.workunit.client.0.smithi067.stdout:4/60: dread d0/fc [0,4194304] 0 2023-12-05T09:26:10.797 INFO:tasks.workunit.client.1.smithi134.stdout:2/204: rename f4 to d19/d28/d31/f43 0 2023-12-05T09:26:10.798 INFO:tasks.workunit.client.0.smithi067.stdout:7/167: rmdir d0/d9/d10/d37/d39 0 2023-12-05T09:26:10.799 INFO:tasks.workunit.client.1.smithi134.stdout:5/174: write d0/d11/f1e [3668140,75061] 0 2023-12-05T09:26:10.799 INFO:tasks.workunit.client.1.smithi134.stdout:5/175: fdatasync d0/d1a/d1c/d25/f2d 0 2023-12-05T09:26:10.800 INFO:tasks.workunit.client.0.smithi067.stdout:7/168: symlink d0/d9/l3c 0 2023-12-05T09:26:10.800 INFO:tasks.workunit.client.0.smithi067.stdout:7/169: stat d0/d9/d10 0 2023-12-05T09:26:10.802 INFO:tasks.workunit.client.1.smithi134.stdout:2/205: creat d19/d3a/f44 x:0 0 0 2023-12-05T09:26:10.802 INFO:tasks.workunit.client.1.smithi134.stdout:2/206: creat d19/d3a/f45 x:0 0 0 2023-12-05T09:26:10.802 INFO:tasks.workunit.client.1.smithi134.stdout:2/207: readlink d19/d28/d2b/l2e 0 2023-12-05T09:26:10.803 INFO:tasks.workunit.client.0.smithi067.stdout:0/184: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:26:10.803 INFO:tasks.workunit.client.1.smithi134.stdout:2/208: write d19/d28/f2a [505395,118811] 0 2023-12-05T09:26:10.803 INFO:tasks.workunit.client.1.smithi134.stdout:2/209: readlink d19/l1b 0 2023-12-05T09:26:10.803 INFO:tasks.workunit.client.1.smithi134.stdout:6/171: getdents d4/db 0 2023-12-05T09:26:10.804 INFO:tasks.workunit.client.1.smithi134.stdout:5/176: mknod d0/c40 0 2023-12-05T09:26:10.805 INFO:tasks.workunit.client.0.smithi067.stdout:7/170: link d0/d9/d10/d37/l33 d0/l3d 0 2023-12-05T09:26:10.805 INFO:tasks.workunit.client.0.smithi067.stdout:7/171: write d0/d9/d10/f1a [203767,49309] 0 2023-12-05T09:26:10.806 INFO:tasks.workunit.client.1.smithi134.stdout:2/210: mknod d19/d3f/c46 0 2023-12-05T09:26:10.807 INFO:tasks.workunit.client.1.smithi134.stdout:2/211: creat d19/d28/f47 x:0 0 0 2023-12-05T09:26:10.808 INFO:tasks.workunit.client.0.smithi067.stdout:7/172: symlink d0/d9/l3e 0 2023-12-05T09:26:10.808 INFO:tasks.workunit.client.0.smithi067.stdout:7/173: chown d0/l31 1 1 2023-12-05T09:26:10.808 INFO:tasks.workunit.client.0.smithi067.stdout:7/174: write d0/d9/f30 [58781,61490] 0 2023-12-05T09:26:10.811 INFO:tasks.workunit.client.1.smithi134.stdout:6/172: rmdir d4/d27 0 2023-12-05T09:26:10.811 INFO:tasks.workunit.client.1.smithi134.stdout:6/173: chown d4/d8/da/f19 9754 1 2023-12-05T09:26:10.813 INFO:tasks.workunit.client.1.smithi134.stdout:5/177: creat d0/d1a/d1c/d3f/f41 x:0 0 0 2023-12-05T09:26:10.817 INFO:tasks.workunit.client.0.smithi067.stdout:0/185: dread d3/fa [0,4194304] 0 2023-12-05T09:26:10.818 INFO:tasks.workunit.client.0.smithi067.stdout:0/186: creat d3/d38/f41 x:0 0 0 2023-12-05T09:26:10.819 INFO:tasks.workunit.client.0.smithi067.stdout:0/187: readlink d3/l27 0 2023-12-05T09:26:10.819 INFO:tasks.workunit.client.0.smithi067.stdout:0/188: write d3/f32 [699771,20597] 0 2023-12-05T09:26:10.819 INFO:tasks.workunit.client.0.smithi067.stdout:0/189: truncate d3/f32 1756196 0 2023-12-05T09:26:10.819 INFO:tasks.workunit.client.0.smithi067.stdout:0/190: mknod d3/df/d10/c42 0 2023-12-05T09:26:10.822 INFO:tasks.workunit.client.0.smithi067.stdout:4/61: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:10.822 INFO:tasks.workunit.client.0.smithi067.stdout:4/62: getdents d0/d9/d12 0 2023-12-05T09:26:10.823 INFO:tasks.workunit.client.0.smithi067.stdout:4/63: creat d0/d9/d12/f14 x:0 0 0 2023-12-05T09:26:10.824 INFO:tasks.workunit.client.0.smithi067.stdout:4/64: truncate d0/ff 39382 0 2023-12-05T09:26:10.825 INFO:tasks.workunit.client.0.smithi067.stdout:4/65: mkdir d0/d9/d12/d15 0 2023-12-05T09:26:10.827 INFO:tasks.workunit.client.0.smithi067.stdout:4/66: creat d0/d9/dd/f16 x:0 0 0 2023-12-05T09:26:10.831 INFO:tasks.workunit.client.1.smithi134.stdout:2/212: dread d19/d28/f33 [0,4194304] 0 2023-12-05T09:26:10.831 INFO:tasks.workunit.client.1.smithi134.stdout:2/213: dread - d19/f35 zero size 2023-12-05T09:26:10.834 INFO:tasks.workunit.client.1.smithi134.stdout:4/178: dwrite d16/d18/d1b/d3d/f34 [0,4194304] 0 2023-12-05T09:26:10.834 INFO:tasks.workunit.client.1.smithi134.stdout:4/179: read d16/d18/d1a/f32 [22738,82452] 0 2023-12-05T09:26:10.834 INFO:tasks.workunit.client.1.smithi134.stdout:4/180: dread - d16/d18/d1c/f3a zero size 2023-12-05T09:26:10.838 INFO:tasks.workunit.client.1.smithi134.stdout:4/181: creat d16/d21/f3f x:0 0 0 2023-12-05T09:26:10.838 INFO:tasks.workunit.client.1.smithi134.stdout:4/182: write f4 [3179726,118321] 0 2023-12-05T09:26:10.838 INFO:tasks.workunit.client.0.smithi067.stdout:8/128: dwrite d5/dc/f19 [0,4194304] 0 2023-12-05T09:26:10.839 INFO:tasks.workunit.client.1.smithi134.stdout:9/162: dwrite d7/d8/d16/f1f [0,4194304] 0 2023-12-05T09:26:10.840 INFO:tasks.workunit.client.1.smithi134.stdout:7/190: dwrite d2/dd/d1a/f23 [0,4194304] 0 2023-12-05T09:26:10.841 INFO:tasks.workunit.client.1.smithi134.stdout:4/183: creat d16/d18/d1b/d24/f40 x:0 0 0 2023-12-05T09:26:10.841 INFO:tasks.workunit.client.1.smithi134.stdout:4/184: chown d16/d18/d1b/d3d/f34 171 1 2023-12-05T09:26:10.842 INFO:tasks.workunit.client.1.smithi134.stdout:3/180: dwrite d4/d5/f10 [0,4194304] 0 2023-12-05T09:26:10.842 INFO:tasks.workunit.client.1.smithi134.stdout:0/166: dwrite f3 [0,4194304] 0 2023-12-05T09:26:10.843 INFO:tasks.workunit.client.1.smithi134.stdout:8/230: dwrite da/d1b/f3f [0,4194304] 0 2023-12-05T09:26:10.846 INFO:tasks.workunit.client.0.smithi067.stdout:0/191: dread d3/f28 [0,4194304] 0 2023-12-05T09:26:10.848 INFO:tasks.workunit.client.0.smithi067.stdout:0/192: symlink d3/d7/d3c/l43 0 2023-12-05T09:26:10.850 INFO:tasks.workunit.client.1.smithi134.stdout:9/163: mknod d7/c39 0 2023-12-05T09:26:10.856 INFO:tasks.workunit.client.0.smithi067.stdout:7/175: truncate d0/d9/f30 1170472 0 2023-12-05T09:26:10.857 INFO:tasks.workunit.client.1.smithi134.stdout:7/191: symlink d2/d7/dc/d2e/d3a/l3f 0 2023-12-05T09:26:10.857 INFO:tasks.workunit.client.1.smithi134.stdout:4/185: dread f15 [0,4194304] 0 2023-12-05T09:26:10.864 INFO:tasks.workunit.client.0.smithi067.stdout:8/129: write d5/dc/f19 [4361408,122574] 0 2023-12-05T09:26:10.864 INFO:tasks.workunit.client.0.smithi067.stdout:8/130: chown d5/da/f1d 2070994 1 2023-12-05T09:26:10.864 INFO:tasks.workunit.client.1.smithi134.stdout:3/181: unlink d4/d5/f6 0 2023-12-05T09:26:10.868 INFO:tasks.workunit.client.1.smithi134.stdout:0/167: rename d13/d14/d30/c25 to d13/d14/c31 0 2023-12-05T09:26:10.869 INFO:tasks.workunit.client.1.smithi134.stdout:2/214: dread f8 [0,4194304] 0 2023-12-05T09:26:10.875 INFO:tasks.workunit.client.1.smithi134.stdout:6/174: dwrite d4/fd [0,4194304] 0 2023-12-05T09:26:10.875 INFO:tasks.workunit.client.1.smithi134.stdout:6/175: chown d4/d8/da/d1b/f29 1754480350 1 2023-12-05T09:26:10.875 INFO:tasks.workunit.client.1.smithi134.stdout:8/231: unlink da/de/d11/l13 0 2023-12-05T09:26:10.876 INFO:tasks.workunit.client.0.smithi067.stdout:4/67: dwrite d0/f4 [0,4194304] 0 2023-12-05T09:26:10.880 INFO:tasks.workunit.client.1.smithi134.stdout:3/182: rename d4/d1f/f24 to d4/d1f/f40 0 2023-12-05T09:26:10.880 INFO:tasks.workunit.client.1.smithi134.stdout:3/183: truncate d4/f13 1106676 0 2023-12-05T09:26:10.881 INFO:tasks.workunit.client.0.smithi067.stdout:7/176: dread d0/f6 [0,4194304] 0 2023-12-05T09:26:10.882 INFO:tasks.workunit.client.0.smithi067.stdout:4/68: rename d0/d9/f11 to d0/f17 0 2023-12-05T09:26:10.884 INFO:tasks.workunit.client.0.smithi067.stdout:4/69: mknod d0/d9/dd/c18 0 2023-12-05T09:26:10.884 INFO:tasks.workunit.client.1.smithi134.stdout:2/215: dread d19/f24 [0,4194304] 0 2023-12-05T09:26:10.885 INFO:tasks.workunit.client.0.smithi067.stdout:7/177: mkdir d0/d9/d3f 0 2023-12-05T09:26:10.886 INFO:tasks.workunit.client.1.smithi134.stdout:0/168: creat d13/d14/d30/f32 x:0 0 0 2023-12-05T09:26:10.891 INFO:tasks.workunit.client.1.smithi134.stdout:3/184: truncate f0 1025774 0 2023-12-05T09:26:10.893 INFO:tasks.workunit.client.0.smithi067.stdout:8/131: dread d5/dc/f19 [0,4194304] 0 2023-12-05T09:26:10.894 INFO:tasks.workunit.client.1.smithi134.stdout:0/169: rename d13/d14/l16 to d13/d1f/l33 0 2023-12-05T09:26:10.894 INFO:tasks.workunit.client.1.smithi134.stdout:5/178: rmdir d0/d1a 39 2023-12-05T09:26:10.895 INFO:tasks.workunit.client.1.smithi134.stdout:5/179: chown d0/l12 10872 1 2023-12-05T09:26:10.896 INFO:tasks.workunit.client.1.smithi134.stdout:5/180: creat d0/d1a/d1c/f42 x:0 0 0 2023-12-05T09:26:10.898 INFO:tasks.workunit.client.1.smithi134.stdout:1/205: sync 2023-12-05T09:26:10.911 INFO:tasks.workunit.client.1.smithi134.stdout:3/185: rmdir d4/d1f 39 2023-12-05T09:26:10.911 INFO:tasks.workunit.client.1.smithi134.stdout:3/186: truncate d4/d1f/f28 709926 0 2023-12-05T09:26:10.911 INFO:tasks.workunit.client.1.smithi134.stdout:3/187: chown d4/lf 143 1 2023-12-05T09:26:10.911 INFO:tasks.workunit.client.1.smithi134.stdout:3/188: truncate d4/f34 75640 0 2023-12-05T09:26:10.912 INFO:tasks.workunit.client.0.smithi067.stdout:8/132: dread d5/f18 [0,4194304] 0 2023-12-05T09:26:10.913 INFO:tasks.workunit.client.0.smithi067.stdout:8/133: chown d5/dc 1206 1 2023-12-05T09:26:10.913 INFO:tasks.workunit.client.1.smithi134.stdout:3/189: rmdir d4/d1f 39 2023-12-05T09:26:10.920 INFO:tasks.workunit.client.1.smithi134.stdout:1/206: mkdir d2/d9/d10/d30/d4a 0 2023-12-05T09:26:10.920 INFO:tasks.workunit.client.1.smithi134.stdout:4/186: dread d16/d18/d1b/d24/f25 [0,4194304] 0 2023-12-05T09:26:10.920 INFO:tasks.workunit.client.1.smithi134.stdout:4/187: dread - d16/d18/f36 zero size 2023-12-05T09:26:10.920 INFO:tasks.workunit.client.1.smithi134.stdout:4/188: fsync d16/d18/d1c/f2e 0 2023-12-05T09:26:10.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/207: rename d2/d9/l45 to d2/d9/l4b 0 2023-12-05T09:26:10.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/208: rmdir d2/d27 39 2023-12-05T09:26:10.924 INFO:tasks.workunit.client.1.smithi134.stdout:1/209: symlink d2/d9/d10/l4c 0 2023-12-05T09:26:10.924 INFO:tasks.workunit.client.0.smithi067.stdout:4/70: dread d0/ff [0,4194304] 0 2023-12-05T09:26:10.925 INFO:tasks.workunit.client.0.smithi067.stdout:4/71: chown d0/ce 3154 1 2023-12-05T09:26:10.925 INFO:tasks.workunit.client.0.smithi067.stdout:4/72: symlink d0/d9/dd/l19 0 2023-12-05T09:26:10.927 INFO:tasks.workunit.client.1.smithi134.stdout:1/210: link d2/d9/d10/d30/f37 d2/f4d 0 2023-12-05T09:26:10.927 INFO:tasks.workunit.client.1.smithi134.stdout:1/211: creat d2/d9/d10/f4e x:0 0 0 2023-12-05T09:26:10.928 INFO:tasks.workunit.client.0.smithi067.stdout:8/134: write d5/da/f1f [3230465,34071] 0 2023-12-05T09:26:10.928 INFO:tasks.workunit.client.0.smithi067.stdout:8/135: stat d5/l6 0 2023-12-05T09:26:10.930 INFO:tasks.workunit.client.1.smithi134.stdout:1/212: mknod d2/c4f 0 2023-12-05T09:26:10.934 INFO:tasks.workunit.client.0.smithi067.stdout:8/136: rename d5/f10 to d5/dc/d1a/d20/f22 0 2023-12-05T09:26:10.952 INFO:tasks.workunit.client.0.smithi067.stdout:0/193: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:26:10.952 INFO:tasks.workunit.client.1.smithi134.stdout:4/189: dread d16/d18/d1a/f20 [0,4194304] 0 2023-12-05T09:26:10.952 INFO:tasks.workunit.client.1.smithi134.stdout:6/176: dwrite d4/db/f12 [0,4194304] 0 2023-12-05T09:26:10.953 INFO:tasks.workunit.client.0.smithi067.stdout:0/194: mknod d3/c44 0 2023-12-05T09:26:10.953 INFO:tasks.workunit.client.1.smithi134.stdout:9/164: dwrite f1 [0,4194304] 0 2023-12-05T09:26:10.956 INFO:tasks.workunit.client.0.smithi067.stdout:0/195: symlink d3/d7/d30/l45 0 2023-12-05T09:26:10.957 INFO:tasks.workunit.client.0.smithi067.stdout:0/196: creat d3/d38/f46 x:0 0 0 2023-12-05T09:26:10.957 INFO:tasks.workunit.client.0.smithi067.stdout:0/197: fsync d3/df/d10/f1f 0 2023-12-05T09:26:10.958 INFO:tasks.workunit.client.1.smithi134.stdout:0/170: dread fa [0,4194304] 0 2023-12-05T09:26:10.958 INFO:tasks.workunit.client.1.smithi134.stdout:4/190: rename f11 to d16/f41 0 2023-12-05T09:26:10.958 INFO:tasks.workunit.client.1.smithi134.stdout:4/191: creat d16/d18/d1c/f42 x:0 0 0 2023-12-05T09:26:10.959 INFO:tasks.workunit.client.1.smithi134.stdout:4/192: stat d16/c19 0 2023-12-05T09:26:10.960 INFO:tasks.workunit.client.1.smithi134.stdout:2/216: dwrite f17 [0,4194304] 0 2023-12-05T09:26:10.961 INFO:tasks.workunit.client.0.smithi067.stdout:7/178: dwrite d0/d9/d1b/d34/f36 [0,4194304] 0 2023-12-05T09:26:10.962 INFO:tasks.workunit.client.0.smithi067.stdout:7/179: getdents d0/d9/d3f 0 2023-12-05T09:26:10.962 INFO:tasks.workunit.client.0.smithi067.stdout:7/180: dread - d0/d9/d1b/f1e zero size 2023-12-05T09:26:10.962 INFO:tasks.workunit.client.1.smithi134.stdout:8/232: dwrite da/de/d43/f46 [0,4194304] 0 2023-12-05T09:26:10.962 INFO:tasks.workunit.client.1.smithi134.stdout:6/177: mkdir d4/d32 0 2023-12-05T09:26:10.970 INFO:tasks.workunit.client.0.smithi067.stdout:0/198: rename d3/d38/f46 to d3/d7/d3c/f47 0 2023-12-05T09:26:10.974 INFO:tasks.workunit.client.1.smithi134.stdout:4/193: truncate fb 211143 0 2023-12-05T09:26:10.974 INFO:tasks.workunit.client.1.smithi134.stdout:4/194: dread - d16/d18/d1c/f2c zero size 2023-12-05T09:26:10.974 INFO:tasks.workunit.client.1.smithi134.stdout:4/195: write d16/d18/d1a/f32 [753182,26627] 0 2023-12-05T09:26:10.976 INFO:tasks.workunit.client.1.smithi134.stdout:2/217: link d19/d28/f41 d19/d28/d31/d38/f48 0 2023-12-05T09:26:10.976 INFO:tasks.workunit.client.1.smithi134.stdout:2/218: truncate fd 4498569 0 2023-12-05T09:26:10.982 INFO:tasks.workunit.client.0.smithi067.stdout:4/73: dwrite d0/f17 [0,4194304] 0 2023-12-05T09:26:10.982 INFO:tasks.workunit.client.0.smithi067.stdout:4/74: dread - d0/d9/f13 zero size 2023-12-05T09:26:10.984 INFO:tasks.workunit.client.1.smithi134.stdout:8/233: symlink da/de/d11/l4f 0 2023-12-05T09:26:10.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/75: link d0/d9/dd/c18 d0/d9/d12/c1a 0 2023-12-05T09:26:10.988 INFO:tasks.workunit.client.0.smithi067.stdout:4/76: symlink d0/d9/dd/l1b 0 2023-12-05T09:26:10.988 INFO:tasks.workunit.client.0.smithi067.stdout:1/128: sync 2023-12-05T09:26:10.989 INFO:tasks.workunit.client.0.smithi067.stdout:0/199: dread d3/f28 [0,4194304] 0 2023-12-05T09:26:10.989 INFO:tasks.workunit.client.0.smithi067.stdout:0/200: read - d3/f3d zero size 2023-12-05T09:26:10.991 INFO:tasks.workunit.client.1.smithi134.stdout:6/178: rename d4/f2f to d4/d8/da/f33 0 2023-12-05T09:26:10.991 INFO:tasks.workunit.client.1.smithi134.stdout:6/179: chown d4/f26 4001418 1 2023-12-05T09:26:10.991 INFO:tasks.workunit.client.0.smithi067.stdout:1/129: mknod d2/d5/d7/c30 0 2023-12-05T09:26:10.993 INFO:tasks.workunit.client.0.smithi067.stdout:0/201: link d3/f35 d3/d7/d3c/f48 0 2023-12-05T09:26:10.997 INFO:tasks.workunit.client.0.smithi067.stdout:1/130: rename d2/d5/d7/de/d10/c2f to d2/d5/d7/de/d10/d14/c31 0 2023-12-05T09:26:11.000 INFO:tasks.workunit.client.1.smithi134.stdout:0/171: rmdir d13/d1f/d23 39 2023-12-05T09:26:11.000 INFO:tasks.workunit.client.1.smithi134.stdout:1/213: dwrite d2/f6 [0,4194304] 0 2023-12-05T09:26:11.003 INFO:tasks.workunit.client.1.smithi134.stdout:8/234: rmdir da/d1b/d42 39 2023-12-05T09:26:11.011 INFO:tasks.workunit.client.0.smithi067.stdout:4/77: write d0/fa [3795227,125698] 0 2023-12-05T09:26:11.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/137: dwrite d5/da/f17 [0,4194304] 0 2023-12-05T09:26:11.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/138: write d5/da/f1f [985675,67928] 0 2023-12-05T09:26:11.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/139: write d5/dc/d1a/f21 [1630393,84648] 0 2023-12-05T09:26:11.020 INFO:tasks.workunit.client.0.smithi067.stdout:8/140: truncate d5/dc/d1a/d20/f22 2344133 0 2023-12-05T09:26:11.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/214: write d2/f4d [1865260,28606] 0 2023-12-05T09:26:11.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/215: write d2/d9/f28 [332306,29033] 0 2023-12-05T09:26:11.034 INFO:tasks.workunit.client.1.smithi134.stdout:3/190: dwrite d4/f16 [0,4194304] 0 2023-12-05T09:26:11.034 INFO:tasks.workunit.client.1.smithi134.stdout:6/180: rename d4/d8/da/f33 to d4/db/f34 0 2023-12-05T09:26:11.034 INFO:tasks.workunit.client.1.smithi134.stdout:8/235: dread da/f29 [0,4194304] 0 2023-12-05T09:26:11.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/236: fsync da/de/d11/f1a 0 2023-12-05T09:26:11.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/237: chown da/d1b/d42 507034344 1 2023-12-05T09:26:11.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/238: rename da/de to da/de/d16/d50 22 2023-12-05T09:26:11.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/239: chown da/d1b/d42/l4a 10741344 1 2023-12-05T09:26:11.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/240: dread - da/de/d16/d2d/f36 zero size 2023-12-05T09:26:11.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/241: write da/d1b/f1e [448604,2912] 0 2023-12-05T09:26:11.036 INFO:tasks.workunit.client.1.smithi134.stdout:6/181: creat d4/d32/f35 x:0 0 0 2023-12-05T09:26:11.036 INFO:tasks.workunit.client.1.smithi134.stdout:6/182: truncate d4/d8/da/d1b/f30 989885 0 2023-12-05T09:26:11.046 INFO:tasks.workunit.client.1.smithi134.stdout:2/219: dwrite d19/f1d [0,4194304] 0 2023-12-05T09:26:11.049 INFO:tasks.workunit.client.1.smithi134.stdout:2/220: mkdir d19/d49 0 2023-12-05T09:26:11.052 INFO:tasks.workunit.client.0.smithi067.stdout:1/131: dwrite d2/d5/d7/de/d10/f1e [0,4194304] 0 2023-12-05T09:26:11.052 INFO:tasks.workunit.client.0.smithi067.stdout:1/132: creat d2/d5/d7/f32 x:0 0 0 2023-12-05T09:26:11.053 INFO:tasks.workunit.client.0.smithi067.stdout:1/133: mknod d2/d5/d7/de/c33 0 2023-12-05T09:26:11.053 INFO:tasks.workunit.client.0.smithi067.stdout:1/134: dread - d2/d3/f18 zero size 2023-12-05T09:26:11.055 INFO:tasks.workunit.client.0.smithi067.stdout:1/135: creat d2/d5/f34 x:0 0 0 2023-12-05T09:26:11.057 INFO:tasks.workunit.client.1.smithi134.stdout:2/221: stat d19/c22 0 2023-12-05T09:26:11.058 INFO:tasks.workunit.client.0.smithi067.stdout:1/136: mkdir d2/d5/d7/de/d10/d35 0 2023-12-05T09:26:11.064 INFO:tasks.workunit.client.0.smithi067.stdout:1/137: symlink d2/d5/d7/de/l36 0 2023-12-05T09:26:11.064 INFO:tasks.workunit.client.1.smithi134.stdout:2/222: mknod d19/d49/c4a 0 2023-12-05T09:26:11.064 INFO:tasks.workunit.client.1.smithi134.stdout:0/172: dwrite fd [0,4194304] 0 2023-12-05T09:26:11.067 INFO:tasks.workunit.client.0.smithi067.stdout:7/181: dwrite d0/f27 [0,4194304] 0 2023-12-05T09:26:11.067 INFO:tasks.workunit.client.0.smithi067.stdout:7/182: write d0/d9/d1b/f1e [659241,119599] 0 2023-12-05T09:26:11.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/216: dread d2/d9/f28 [0,4194304] 0 2023-12-05T09:26:11.075 INFO:tasks.workunit.client.1.smithi134.stdout:9/165: dwrite d7/f1a [4194304,4194304] 0 2023-12-05T09:26:11.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/223: dread f8 [0,4194304] 0 2023-12-05T09:26:11.078 INFO:tasks.workunit.client.1.smithi134.stdout:0/173: creat d13/d14/d30/d2c/f34 x:0 0 0 2023-12-05T09:26:11.078 INFO:tasks.workunit.client.1.smithi134.stdout:0/174: dread - d13/d14/d30/d2c/f34 zero size 2023-12-05T09:26:11.085 INFO:tasks.workunit.client.1.smithi134.stdout:9/166: rename l5 to d7/d8/l3a 0 2023-12-05T09:26:11.087 INFO:tasks.workunit.client.1.smithi134.stdout:2/224: chown c9 253790 1 2023-12-05T09:26:11.089 INFO:tasks.workunit.client.1.smithi134.stdout:9/167: link d7/d8/c28 d7/d10/c3b 0 2023-12-05T09:26:11.090 INFO:tasks.workunit.client.1.smithi134.stdout:9/168: write d7/d8/d16/f1f [4866899,78221] 0 2023-12-05T09:26:11.094 INFO:tasks.workunit.client.1.smithi134.stdout:4/196: dwrite f5 [0,4194304] 0 2023-12-05T09:26:11.094 INFO:tasks.workunit.client.1.smithi134.stdout:4/197: creat d16/d18/d1a/f43 x:0 0 0 2023-12-05T09:26:11.094 INFO:tasks.workunit.client.0.smithi067.stdout:1/138: dread d2/d5/d7/de/d10/f1e [0,4194304] 0 2023-12-05T09:26:11.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/225: truncate f10 4649639 0 2023-12-05T09:26:11.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/226: fdatasync d19/d28/f41 0 2023-12-05T09:26:11.100 INFO:tasks.workunit.client.0.smithi067.stdout:0/202: dwrite d3/df/f26 [0,4194304] 0 2023-12-05T09:26:11.106 INFO:tasks.workunit.client.1.smithi134.stdout:4/198: symlink d16/d21/l44 0 2023-12-05T09:26:11.106 INFO:tasks.workunit.client.1.smithi134.stdout:4/199: dread - d16/d21/f3f zero size 2023-12-05T09:26:11.108 INFO:tasks.workunit.client.1.smithi134.stdout:2/227: creat d19/d28/d2b/f4b x:0 0 0 2023-12-05T09:26:11.108 INFO:tasks.workunit.client.0.smithi067.stdout:7/183: truncate d0/d9/d10/d1d/f1f 2513458 0 2023-12-05T09:26:11.108 INFO:tasks.workunit.client.0.smithi067.stdout:0/203: mkdir d3/d7/d3c/d49 0 2023-12-05T09:26:11.109 INFO:tasks.workunit.client.0.smithi067.stdout:5/130: sync 2023-12-05T09:26:11.109 INFO:tasks.workunit.client.0.smithi067.stdout:9/252: sync 2023-12-05T09:26:11.109 INFO:tasks.workunit.client.0.smithi067.stdout:5/131: write db/df/d1a/f21 [439984,12799] 0 2023-12-05T09:26:11.109 INFO:tasks.workunit.client.0.smithi067.stdout:9/253: read fa [1948483,85516] 0 2023-12-05T09:26:11.109 INFO:tasks.workunit.client.1.smithi134.stdout:4/200: mkdir d16/d18/d1b/d45 0 2023-12-05T09:26:11.109 INFO:tasks.workunit.client.1.smithi134.stdout:4/201: chown d16/f41 56350888 1 2023-12-05T09:26:11.109 INFO:tasks.workunit.client.1.smithi134.stdout:3/191: dwrite d4/d1f/f20 [0,4194304] 0 2023-12-05T09:26:11.110 INFO:tasks.workunit.client.1.smithi134.stdout:2/228: symlink d19/d3f/l4c 0 2023-12-05T09:26:11.110 INFO:tasks.workunit.client.0.smithi067.stdout:4/78: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:11.110 INFO:tasks.workunit.client.0.smithi067.stdout:0/204: truncate d3/df/d10/f20 2347043 0 2023-12-05T09:26:11.110 INFO:tasks.workunit.client.0.smithi067.stdout:9/254: creat d1b/f51 x:0 0 0 2023-12-05T09:26:11.112 INFO:tasks.workunit.client.1.smithi134.stdout:3/192: symlink d4/d5/l41 0 2023-12-05T09:26:11.113 INFO:tasks.workunit.client.1.smithi134.stdout:2/229: symlink d19/d3a/l4d 0 2023-12-05T09:26:11.113 INFO:tasks.workunit.client.1.smithi134.stdout:2/230: dread - d19/d28/f47 zero size 2023-12-05T09:26:11.113 INFO:tasks.workunit.client.1.smithi134.stdout:2/231: creat d19/d28/f4e x:0 0 0 2023-12-05T09:26:11.114 INFO:tasks.workunit.client.0.smithi067.stdout:0/205: link d3/f1d d3/d7/d30/f4a 0 2023-12-05T09:26:11.114 INFO:tasks.workunit.client.0.smithi067.stdout:5/132: mknod db/df/d1a/d1d/c33 0 2023-12-05T09:26:11.115 INFO:tasks.workunit.client.1.smithi134.stdout:3/193: rename d4/d5/d23 to d4/d3f/d42 0 2023-12-05T09:26:11.124 INFO:tasks.workunit.client.0.smithi067.stdout:9/255: truncate fa 4117250 0 2023-12-05T09:26:11.124 INFO:tasks.workunit.client.0.smithi067.stdout:9/256: chown d1b/d25/d35/f38 1857004 1 2023-12-05T09:26:11.124 INFO:tasks.workunit.client.0.smithi067.stdout:0/206: mknod d3/df/d10/c4b 0 2023-12-05T09:26:11.124 INFO:tasks.workunit.client.0.smithi067.stdout:0/207: readlink d3/d7/d3c/l43 0 2023-12-05T09:26:11.124 INFO:tasks.workunit.client.1.smithi134.stdout:3/194: dread d4/f13 [0,4194304] 0 2023-12-05T09:26:11.124 INFO:tasks.workunit.client.1.smithi134.stdout:6/183: dwrite d4/d2a/f2e [0,4194304] 0 2023-12-05T09:26:11.124 INFO:tasks.workunit.client.1.smithi134.stdout:3/195: dread - d4/d1f/f33 zero size 2023-12-05T09:26:11.124 INFO:tasks.workunit.client.1.smithi134.stdout:6/184: fsync d4/f26 0 2023-12-05T09:26:11.125 INFO:tasks.workunit.client.1.smithi134.stdout:6/185: fdatasync d4/f26 0 2023-12-05T09:26:11.125 INFO:tasks.workunit.client.1.smithi134.stdout:3/196: write d4/d3f/d42/f37 [368411,79999] 0 2023-12-05T09:26:11.126 INFO:tasks.workunit.client.1.smithi134.stdout:3/197: symlink d4/d1f/l43 0 2023-12-05T09:26:11.126 INFO:tasks.workunit.client.1.smithi134.stdout:3/198: chown d4/d1f/f2b 18900 1 2023-12-05T09:26:11.133 INFO:tasks.workunit.client.1.smithi134.stdout:9/169: dread f3 [0,4194304] 0 2023-12-05T09:26:11.135 INFO:tasks.workunit.client.0.smithi067.stdout:0/208: symlink d3/d7/d30/l4c 0 2023-12-05T09:26:11.135 INFO:tasks.workunit.client.0.smithi067.stdout:0/209: chown d3/f3d 58540 1 2023-12-05T09:26:11.135 INFO:tasks.workunit.client.0.smithi067.stdout:0/210: chown d3/f35 22274636 1 2023-12-05T09:26:11.136 INFO:tasks.workunit.client.0.smithi067.stdout:5/133: dread db/df/d1a/d1d/d20/f2d [0,4194304] 0 2023-12-05T09:26:11.137 INFO:tasks.workunit.client.0.smithi067.stdout:7/184: dread d0/d9/f30 [0,4194304] 0 2023-12-05T09:26:11.137 INFO:tasks.workunit.client.0.smithi067.stdout:9/257: dread d1b/d25/d35/f43 [0,4194304] 0 2023-12-05T09:26:11.138 INFO:tasks.workunit.client.0.smithi067.stdout:9/258: write f14 [4569388,29809] 0 2023-12-05T09:26:11.138 INFO:tasks.workunit.client.0.smithi067.stdout:9/259: creat d1b/d25/d35/f52 x:0 0 0 2023-12-05T09:26:11.138 INFO:tasks.workunit.client.0.smithi067.stdout:9/260: readlink d1b/l1e 0 2023-12-05T09:26:11.138 INFO:tasks.workunit.client.0.smithi067.stdout:9/261: fsync d1b/d25/d35/f43 0 2023-12-05T09:26:11.138 INFO:tasks.workunit.client.0.smithi067.stdout:9/262: chown d1b/f31 3140 1 2023-12-05T09:26:11.139 INFO:tasks.workunit.client.1.smithi134.stdout:8/242: write da/de/f27 [1964075,82282] 0 2023-12-05T09:26:11.139 INFO:tasks.workunit.client.1.smithi134.stdout:8/243: readlink da/de/d16/l31 0 2023-12-05T09:26:11.139 INFO:tasks.workunit.client.0.smithi067.stdout:8/141: dwrite d5/f18 [0,4194304] 0 2023-12-05T09:26:11.139 INFO:tasks.workunit.client.0.smithi067.stdout:8/142: readlink d5/l6 0 2023-12-05T09:26:11.140 INFO:tasks.workunit.client.1.smithi134.stdout:2/232: dread fa [0,4194304] 0 2023-12-05T09:26:11.141 INFO:tasks.workunit.client.1.smithi134.stdout:2/233: write d19/d28/d31/f43 [2116189,43430] 0 2023-12-05T09:26:11.141 INFO:tasks.workunit.client.1.smithi134.stdout:2/234: write d19/d3a/f45 [200596,3346] 0 2023-12-05T09:26:11.144 INFO:tasks.workunit.client.0.smithi067.stdout:0/211: link d3/f35 d3/f4d 0 2023-12-05T09:26:11.144 INFO:tasks.workunit.client.0.smithi067.stdout:0/212: write d3/f28 [9406323,52807] 0 2023-12-05T09:26:11.144 INFO:tasks.workunit.client.0.smithi067.stdout:1/139: dwrite d2/d5/d7/de/d10/f1e [0,4194304] 0 2023-12-05T09:26:11.148 INFO:tasks.workunit.client.0.smithi067.stdout:6/105: sync 2023-12-05T09:26:11.148 INFO:tasks.workunit.client.0.smithi067.stdout:3/59: sync 2023-12-05T09:26:11.148 INFO:tasks.workunit.client.0.smithi067.stdout:3/60: chown f0 30854280 1 2023-12-05T09:26:11.148 INFO:tasks.workunit.client.0.smithi067.stdout:3/61: chown d9/da 25005 1 2023-12-05T09:26:11.148 INFO:tasks.workunit.client.0.smithi067.stdout:3/62: write f6 [873880,7965] 0 2023-12-05T09:26:11.148 INFO:tasks.workunit.client.0.smithi067.stdout:3/63: chown d9/fb 0 1 2023-12-05T09:26:11.152 INFO:tasks.workunit.client.0.smithi067.stdout:2/97: sync 2023-12-05T09:26:11.152 INFO:tasks.workunit.client.0.smithi067.stdout:2/98: dread - d0/d15/f1b zero size 2023-12-05T09:26:11.152 INFO:tasks.workunit.client.0.smithi067.stdout:5/134: mknod db/df/d1a/d1d/c34 0 2023-12-05T09:26:11.152 INFO:tasks.workunit.client.1.smithi134.stdout:9/170: rename d7/d8/d2e/d36 to d7/d8/d16/d3c 0 2023-12-05T09:26:11.155 INFO:tasks.workunit.client.0.smithi067.stdout:7/185: rmdir d0/d9/d10/d1d 39 2023-12-05T09:26:11.156 INFO:tasks.workunit.client.1.smithi134.stdout:1/217: dwrite d2/d27/f3a [0,4194304] 0 2023-12-05T09:26:11.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/186: write d4/db/f31 [430772,87551] 0 2023-12-05T09:26:11.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/187: chown d4/db/f31 6663943 1 2023-12-05T09:26:11.157 INFO:tasks.workunit.client.1.smithi134.stdout:6/188: readlink d4/d8/da/l14 0 2023-12-05T09:26:11.161 INFO:tasks.workunit.client.1.smithi134.stdout:7/192: sync 2023-12-05T09:26:11.161 INFO:tasks.workunit.client.1.smithi134.stdout:5/181: sync 2023-12-05T09:26:11.161 INFO:tasks.workunit.client.1.smithi134.stdout:5/182: chown d0/d11/f1b 263915947 1 2023-12-05T09:26:11.161 INFO:tasks.workunit.client.1.smithi134.stdout:3/199: dread d4/d1f/f35 [0,4194304] 0 2023-12-05T09:26:11.161 INFO:tasks.workunit.client.1.smithi134.stdout:3/200: chown d4/f2f 1009526 1 2023-12-05T09:26:11.168 INFO:tasks.workunit.client.0.smithi067.stdout:1/140: write d2/d3/f1d [2457884,74567] 0 2023-12-05T09:26:11.170 INFO:tasks.workunit.client.0.smithi067.stdout:9/263: unlink d1b/c4d 0 2023-12-05T09:26:11.170 INFO:tasks.workunit.client.0.smithi067.stdout:9/264: write d1b/d25/d35/f52 [223025,114666] 0 2023-12-05T09:26:11.172 INFO:tasks.workunit.client.1.smithi134.stdout:1/218: symlink d2/d9/d10/d30/l50 0 2023-12-05T09:26:11.172 INFO:tasks.workunit.client.1.smithi134.stdout:1/219: dread - d2/f2b zero size 2023-12-05T09:26:11.172 INFO:tasks.workunit.client.1.smithi134.stdout:2/235: truncate f18 3361059 0 2023-12-05T09:26:11.175 INFO:tasks.workunit.client.1.smithi134.stdout:3/201: unlink d4/d1f/f31 0 2023-12-05T09:26:11.178 INFO:tasks.workunit.client.1.smithi134.stdout:1/220: rename d2/d27/f39 to d2/d27/d40/f51 0 2023-12-05T09:26:11.179 INFO:tasks.workunit.client.0.smithi067.stdout:8/143: creat d5/dc/f23 x:0 0 0 2023-12-05T09:26:11.180 INFO:tasks.workunit.client.1.smithi134.stdout:6/189: read d4/f17 [2551714,109747] 0 2023-12-05T09:26:11.180 INFO:tasks.workunit.client.1.smithi134.stdout:2/236: mknod d19/c4f 0 2023-12-05T09:26:11.181 INFO:tasks.workunit.client.1.smithi134.stdout:2/237: write d19/f24 [1555800,109312] 0 2023-12-05T09:26:11.181 INFO:tasks.workunit.client.1.smithi134.stdout:5/183: getdents d0/d1a/d1c 0 2023-12-05T09:26:11.181 INFO:tasks.workunit.client.1.smithi134.stdout:5/184: creat d0/f43 x:0 0 0 2023-12-05T09:26:11.183 INFO:tasks.workunit.client.1.smithi134.stdout:1/221: symlink d2/l52 0 2023-12-05T09:26:11.183 INFO:tasks.workunit.client.1.smithi134.stdout:6/190: creat d4/d8/f36 x:0 0 0 2023-12-05T09:26:11.184 INFO:tasks.workunit.client.1.smithi134.stdout:6/191: write d4/db/f1f [571283,111919] 0 2023-12-05T09:26:11.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/213: unlink d3/c44 0 2023-12-05T09:26:11.186 INFO:tasks.workunit.client.1.smithi134.stdout:3/202: getdents d4 0 2023-12-05T09:26:11.190 INFO:tasks.workunit.client.1.smithi134.stdout:4/202: dwrite f0 [0,4194304] 0 2023-12-05T09:26:11.192 INFO:tasks.workunit.client.0.smithi067.stdout:2/99: mknod d0/c21 0 2023-12-05T09:26:11.193 INFO:tasks.workunit.client.1.smithi134.stdout:8/244: dwrite da/de/f40 [0,4194304] 0 2023-12-05T09:26:11.197 INFO:tasks.workunit.client.0.smithi067.stdout:4/79: dwrite d0/ff [0,4194304] 0 2023-12-05T09:26:11.197 INFO:tasks.workunit.client.0.smithi067.stdout:4/80: fdatasync d0/f8 0 2023-12-05T09:26:11.200 INFO:tasks.workunit.client.0.smithi067.stdout:7/186: truncate d0/f27 933807 0 2023-12-05T09:26:11.206 INFO:tasks.workunit.client.1.smithi134.stdout:9/171: dread d7/d8/d16/f1f [0,4194304] 0 2023-12-05T09:26:11.209 INFO:tasks.workunit.client.0.smithi067.stdout:1/141: rename d2/d5/d7/f32 to d2/d5/d7/de/f37 0 2023-12-05T09:26:11.209 INFO:tasks.workunit.client.0.smithi067.stdout:9/265: creat d1b/d3e/f53 x:0 0 0 2023-12-05T09:26:11.210 INFO:tasks.workunit.client.0.smithi067.stdout:6/106: getdents da 0 2023-12-05T09:26:11.210 INFO:tasks.workunit.client.0.smithi067.stdout:8/144: symlink d5/l24 0 2023-12-05T09:26:11.210 INFO:tasks.workunit.client.0.smithi067.stdout:8/145: chown d5/da/lf 374 1 2023-12-05T09:26:11.210 INFO:tasks.workunit.client.0.smithi067.stdout:8/146: chown d5/da/f17 718355378 1 2023-12-05T09:26:11.210 INFO:tasks.workunit.client.1.smithi134.stdout:5/185: dread d0/fc [0,4194304] 0 2023-12-05T09:26:11.211 INFO:tasks.workunit.client.0.smithi067.stdout:0/214: mkdir d3/d38/d4e 0 2023-12-05T09:26:11.211 INFO:tasks.workunit.client.0.smithi067.stdout:2/100: mknod d0/d15/c22 0 2023-12-05T09:26:11.212 INFO:tasks.workunit.client.1.smithi134.stdout:3/203: symlink d4/d1f/l44 0 2023-12-05T09:26:11.212 INFO:tasks.workunit.client.1.smithi134.stdout:3/204: readlink d4/d5/l21 0 2023-12-05T09:26:11.213 INFO:tasks.workunit.client.0.smithi067.stdout:7/187: mkdir d0/d9/d40 0 2023-12-05T09:26:11.213 INFO:tasks.workunit.client.0.smithi067.stdout:7/188: fdatasync d0/f7 0 2023-12-05T09:26:11.213 INFO:tasks.workunit.client.1.smithi134.stdout:7/193: dwrite d2/d7/dc/f34 [0,4194304] 0 2023-12-05T09:26:11.216 INFO:tasks.workunit.client.1.smithi134.stdout:5/186: symlink d0/d1a/d1c/d25/l44 0 2023-12-05T09:26:11.220 INFO:tasks.workunit.client.1.smithi134.stdout:6/192: write d4/d2a/f2e [147815,101172] 0 2023-12-05T09:26:11.220 INFO:tasks.workunit.client.0.smithi067.stdout:0/215: symlink d3/d38/l4f 0 2023-12-05T09:26:11.220 INFO:tasks.workunit.client.0.smithi067.stdout:4/81: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:11.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/101: rename d0/c6 to d0/d10/c23 0 2023-12-05T09:26:11.222 INFO:tasks.workunit.client.0.smithi067.stdout:2/102: mknod d0/d10/d1e/c24 0 2023-12-05T09:26:11.222 INFO:tasks.workunit.client.0.smithi067.stdout:2/103: dread - d0/d15/f1b zero size 2023-12-05T09:26:11.222 INFO:tasks.workunit.client.0.smithi067.stdout:2/104: chown d0/d10/d1e/c24 1500 1 2023-12-05T09:26:11.224 INFO:tasks.workunit.client.0.smithi067.stdout:2/105: mkdir d0/d25 0 2023-12-05T09:26:11.225 INFO:tasks.workunit.client.1.smithi134.stdout:4/203: write d16/d18/d1b/f31 [1406239,32792] 0 2023-12-05T09:26:11.226 INFO:tasks.workunit.client.1.smithi134.stdout:6/193: creat d4/db/f37 x:0 0 0 2023-12-05T09:26:11.229 INFO:tasks.workunit.client.1.smithi134.stdout:6/194: mknod d4/d8/da/c38 0 2023-12-05T09:26:11.229 INFO:tasks.workunit.client.1.smithi134.stdout:6/195: write d4/db/f37 [310682,27654] 0 2023-12-05T09:26:11.243 INFO:tasks.workunit.client.0.smithi067.stdout:9/266: getdents d1b/d25/d35 0 2023-12-05T09:26:11.244 INFO:tasks.workunit.client.0.smithi067.stdout:0/216: write d3/df/d10/f33 [1490451,25843] 0 2023-12-05T09:26:11.246 INFO:tasks.workunit.client.0.smithi067.stdout:9/267: mkdir d1b/d25/d54 0 2023-12-05T09:26:11.251 INFO:tasks.workunit.client.1.smithi134.stdout:1/222: dwrite d2/f19 [0,4194304] 0 2023-12-05T09:26:11.252 INFO:tasks.workunit.client.0.smithi067.stdout:0/217: creat d3/d7/d3c/f50 x:0 0 0 2023-12-05T09:26:11.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/223: rmdir d2/d27/d40 39 2023-12-05T09:26:11.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/224: readlink d2/d9/l2a 0 2023-12-05T09:26:11.255 INFO:tasks.workunit.client.1.smithi134.stdout:1/225: fsync d2/d9/f28 0 2023-12-05T09:26:11.255 INFO:tasks.workunit.client.1.smithi134.stdout:1/226: chown d2/f43 0 1 2023-12-05T09:26:11.255 INFO:tasks.workunit.client.1.smithi134.stdout:1/227: creat d2/d9/d10/f53 x:0 0 0 2023-12-05T09:26:11.255 INFO:tasks.workunit.client.1.smithi134.stdout:1/228: readlink d2/d9/d10/l4c 0 2023-12-05T09:26:11.255 INFO:tasks.workunit.client.0.smithi067.stdout:5/135: dwrite db/df/d1a/f1c [0,4194304] 0 2023-12-05T09:26:11.257 INFO:tasks.workunit.client.0.smithi067.stdout:9/268: rename d1b/c28 to d1b/d25/d54/c55 0 2023-12-05T09:26:11.257 INFO:tasks.workunit.client.0.smithi067.stdout:9/269: readlink d1b/d25/l29 0 2023-12-05T09:26:11.260 INFO:tasks.workunit.client.0.smithi067.stdout:0/218: truncate d3/df/d10/f1f 3408434 0 2023-12-05T09:26:11.260 INFO:tasks.workunit.client.0.smithi067.stdout:0/219: write d3/df/f3e [844169,96215] 0 2023-12-05T09:26:11.260 INFO:tasks.workunit.client.0.smithi067.stdout:0/220: write d3/df/f40 [734451,39318] 0 2023-12-05T09:26:11.261 INFO:tasks.workunit.client.1.smithi134.stdout:1/229: creat d2/d27/f54 x:0 0 0 2023-12-05T09:26:11.261 INFO:tasks.workunit.client.1.smithi134.stdout:8/245: dwrite da/de/d16/f23 [0,4194304] 0 2023-12-05T09:26:11.262 INFO:tasks.workunit.client.1.smithi134.stdout:4/204: dread d16/f41 [0,4194304] 0 2023-12-05T09:26:11.262 INFO:tasks.workunit.client.1.smithi134.stdout:4/205: dread - d16/d18/d1c/f3a zero size 2023-12-05T09:26:11.264 INFO:tasks.workunit.client.0.smithi067.stdout:1/142: link d2/d5/d7/de/f37 d2/d5/d7/de/d19/f38 0 2023-12-05T09:26:11.264 INFO:tasks.workunit.client.0.smithi067.stdout:1/143: truncate d2/d5/f34 696583 0 2023-12-05T09:26:11.264 INFO:tasks.workunit.client.0.smithi067.stdout:8/147: dread d5/dc/d1a/f21 [4194304,4194304] 0 2023-12-05T09:26:11.265 INFO:tasks.workunit.client.0.smithi067.stdout:1/144: creat d2/f39 x:0 0 0 2023-12-05T09:26:11.265 INFO:tasks.workunit.client.1.smithi134.stdout:0/175: sync 2023-12-05T09:26:11.266 INFO:tasks.workunit.client.1.smithi134.stdout:0/176: write fa [4901713,112964] 0 2023-12-05T09:26:11.266 INFO:tasks.workunit.client.1.smithi134.stdout:0/177: write d13/d14/d30/d2c/f34 [203631,574] 0 2023-12-05T09:26:11.266 INFO:tasks.workunit.client.1.smithi134.stdout:0/178: read - d13/d14/d30/f32 zero size 2023-12-05T09:26:11.267 INFO:tasks.workunit.client.0.smithi067.stdout:9/270: mkdir d1b/d25/d35/d56 0 2023-12-05T09:26:11.267 INFO:tasks.workunit.client.0.smithi067.stdout:9/271: fsync d1b/d25/f50 0 2023-12-05T09:26:11.268 INFO:tasks.workunit.client.0.smithi067.stdout:0/221: getdents d3/d7/d30 0 2023-12-05T09:26:11.269 INFO:tasks.workunit.client.0.smithi067.stdout:0/222: chown d3/fb 15789 1 2023-12-05T09:26:11.271 INFO:tasks.workunit.client.0.smithi067.stdout:0/223: chown d3/df/f3f 6504101 1 2023-12-05T09:26:11.271 INFO:tasks.workunit.client.0.smithi067.stdout:3/64: dwrite f7 [0,4194304] 0 2023-12-05T09:26:11.271 INFO:tasks.workunit.client.0.smithi067.stdout:3/65: readlink l2 0 2023-12-05T09:26:11.272 INFO:tasks.workunit.client.1.smithi134.stdout:1/230: rename d2/d9/f28 to d2/d9/d10/d30/d4a/f55 0 2023-12-05T09:26:11.272 INFO:tasks.workunit.client.1.smithi134.stdout:1/231: write d2/f17 [1739604,118183] 0 2023-12-05T09:26:11.277 INFO:tasks.workunit.client.1.smithi134.stdout:8/246: symlink da/de/d16/d45/l51 0 2023-12-05T09:26:11.278 INFO:tasks.workunit.client.0.smithi067.stdout:7/189: getdents d0/d9 0 2023-12-05T09:26:11.278 INFO:tasks.workunit.client.0.smithi067.stdout:7/190: chown d0/d9/d10 77 1 2023-12-05T09:26:11.288 INFO:tasks.workunit.client.0.smithi067.stdout:8/148: creat d5/dc/d1a/d20/f25 x:0 0 0 2023-12-05T09:26:11.288 INFO:tasks.workunit.client.1.smithi134.stdout:4/206: symlink d16/d18/l46 0 2023-12-05T09:26:11.294 INFO:tasks.workunit.client.1.smithi134.stdout:7/194: dwrite d2/d7/d25/d26/f1c [0,4194304] 0 2023-12-05T09:26:11.294 INFO:tasks.workunit.client.0.smithi067.stdout:1/145: creat d2/d5/d7/de/f3a x:0 0 0 2023-12-05T09:26:11.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/136: getdents db/df 0 2023-12-05T09:26:11.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/137: readlink db/df/d1a/l2b 0 2023-12-05T09:26:11.294 INFO:tasks.workunit.client.0.smithi067.stdout:1/146: chown d2/d5/d7/c30 1385 1 2023-12-05T09:26:11.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/138: write db/df/f15 [822272,5479] 0 2023-12-05T09:26:11.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/139: chown db/df/d1a/f21 42948 1 2023-12-05T09:26:11.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/140: readlink db/df/d1a/l2b 0 2023-12-05T09:26:11.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/179: creat d13/f35 x:0 0 0 2023-12-05T09:26:11.298 INFO:tasks.workunit.client.1.smithi134.stdout:3/205: write d4/f16 [1849122,69690] 0 2023-12-05T09:26:11.298 INFO:tasks.workunit.client.1.smithi134.stdout:3/206: write d4/d3f/d42/f37 [708657,35986] 0 2023-12-05T09:26:11.298 INFO:tasks.workunit.client.1.smithi134.stdout:1/232: mkdir d2/d56 0 2023-12-05T09:26:11.299 INFO:tasks.workunit.client.1.smithi134.stdout:8/247: mknod da/de/d43/c52 0 2023-12-05T09:26:11.299 INFO:tasks.workunit.client.1.smithi134.stdout:8/248: chown da/de/d16/d2d 0 1 2023-12-05T09:26:11.299 INFO:tasks.workunit.client.1.smithi134.stdout:4/207: mkdir d16/d21/d47 0 2023-12-05T09:26:11.305 INFO:tasks.workunit.client.1.smithi134.stdout:7/195: creat d2/df/d2a/f40 x:0 0 0 2023-12-05T09:26:11.309 INFO:tasks.workunit.client.0.smithi067.stdout:3/66: mkdir d9/da/d15 0 2023-12-05T09:26:11.309 INFO:tasks.workunit.client.0.smithi067.stdout:9/272: symlink d1b/d25/d35/l57 0 2023-12-05T09:26:11.309 INFO:tasks.workunit.client.0.smithi067.stdout:9/273: dread - d1b/d25/d35/f4f zero size 2023-12-05T09:26:11.313 INFO:tasks.workunit.client.1.smithi134.stdout:3/207: mkdir d4/d5/d45 0 2023-12-05T09:26:11.313 INFO:tasks.workunit.client.1.smithi134.stdout:3/208: write d4/d1f/f35 [4343721,37862] 0 2023-12-05T09:26:11.313 INFO:tasks.workunit.client.1.smithi134.stdout:3/209: write d4/d5/f11 [477402,28923] 0 2023-12-05T09:26:11.314 INFO:tasks.workunit.client.0.smithi067.stdout:5/141: mkdir db/df/d35 0 2023-12-05T09:26:11.320 INFO:tasks.workunit.client.1.smithi134.stdout:4/208: unlink d16/d18/d1c/l37 0 2023-12-05T09:26:11.321 INFO:tasks.workunit.client.1.smithi134.stdout:4/209: fsync d16/d18/d1c/f2e 0 2023-12-05T09:26:11.321 INFO:tasks.workunit.client.1.smithi134.stdout:4/210: dread - d16/d18/d1a/f43 zero size 2023-12-05T09:26:11.322 INFO:tasks.workunit.client.1.smithi134.stdout:6/196: dwrite d4/d32/f35 [0,4194304] 0 2023-12-05T09:26:11.323 INFO:tasks.workunit.client.0.smithi067.stdout:9/274: truncate d1b/d25/f2c 2363781 0 2023-12-05T09:26:11.328 INFO:tasks.workunit.client.1.smithi134.stdout:1/233: dread d2/d9/f1b [4194304,4194304] 0 2023-12-05T09:26:11.328 INFO:tasks.workunit.client.1.smithi134.stdout:1/234: creat d2/d9/f57 x:0 0 0 2023-12-05T09:26:11.328 INFO:tasks.workunit.client.1.smithi134.stdout:1/235: chown d2/d9/d10/f13 210722 1 2023-12-05T09:26:11.328 INFO:tasks.workunit.client.1.smithi134.stdout:1/236: write d2/d9/f57 [384294,30176] 0 2023-12-05T09:26:11.329 INFO:tasks.workunit.client.1.smithi134.stdout:1/237: fdatasync d2/d9/f1b 0 2023-12-05T09:26:11.329 INFO:tasks.workunit.client.0.smithi067.stdout:1/147: getdents d2/d5/d7/de/d10/d15 0 2023-12-05T09:26:11.329 INFO:tasks.workunit.client.0.smithi067.stdout:1/148: chown d2/d3/l1f 89019409 1 2023-12-05T09:26:11.329 INFO:tasks.workunit.client.0.smithi067.stdout:1/149: fsync d2/d3/f2a 0 2023-12-05T09:26:11.329 INFO:tasks.workunit.client.0.smithi067.stdout:1/150: write d2/f24 [1465942,1668] 0 2023-12-05T09:26:11.329 INFO:tasks.workunit.client.0.smithi067.stdout:1/151: chown d2/f24 19750131 1 2023-12-05T09:26:11.329 INFO:tasks.workunit.client.0.smithi067.stdout:2/106: write d0/f9 [1883084,21617] 0 2023-12-05T09:26:11.335 INFO:tasks.workunit.client.1.smithi134.stdout:3/210: dread d4/d5/f32 [0,4194304] 0 2023-12-05T09:26:11.335 INFO:tasks.workunit.client.1.smithi134.stdout:3/211: getdents d4/d5/d45 0 2023-12-05T09:26:11.338 INFO:tasks.workunit.client.0.smithi067.stdout:9/275: rename d1b/d25/d35/l57 to d1b/l58 0 2023-12-05T09:26:11.339 INFO:tasks.workunit.client.0.smithi067.stdout:6/107: dwrite da/fe [0,4194304] 0 2023-12-05T09:26:11.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/67: getdents d9 0 2023-12-05T09:26:11.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/68: fsync f7 0 2023-12-05T09:26:11.342 INFO:tasks.workunit.client.0.smithi067.stdout:3/69: write d9/fb [385158,21901] 0 2023-12-05T09:26:11.343 INFO:tasks.workunit.client.0.smithi067.stdout:3/70: chown d9/fb 969717561 1 2023-12-05T09:26:11.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/191: dread d0/d9/d10/d37/f2a [0,4194304] 0 2023-12-05T09:26:11.344 INFO:tasks.workunit.client.0.smithi067.stdout:7/192: write d0/f7 [1577627,12253] 0 2023-12-05T09:26:11.344 INFO:tasks.workunit.client.0.smithi067.stdout:7/193: stat d0/d9/d1b/d34 0 2023-12-05T09:26:11.345 INFO:tasks.workunit.client.1.smithi134.stdout:7/196: dread d2/df/f15 [0,4194304] 0 2023-12-05T09:26:11.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/172: dwrite d7/d8/d2e/f31 [0,4194304] 0 2023-12-05T09:26:11.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/173: fsync d7/d8/d16/f2a 0 2023-12-05T09:26:11.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/174: fdatasync d7/d8/d2e/f31 0 2023-12-05T09:26:11.346 INFO:tasks.workunit.client.0.smithi067.stdout:9/276: creat d1b/d25/d54/f59 x:0 0 0 2023-12-05T09:26:11.347 INFO:tasks.workunit.client.1.smithi134.stdout:4/211: rename d16/d18/d1b/d3d to d16/d21/d48 0 2023-12-05T09:26:11.347 INFO:tasks.workunit.client.0.smithi067.stdout:9/277: write d1b/d25/f46 [679347,128272] 0 2023-12-05T09:26:11.349 INFO:tasks.workunit.client.0.smithi067.stdout:6/108: mknod da/db/c28 0 2023-12-05T09:26:11.349 INFO:tasks.workunit.client.0.smithi067.stdout:6/109: creat da/d10/d1e/d17/f29 x:0 0 0 2023-12-05T09:26:11.349 INFO:tasks.workunit.client.0.smithi067.stdout:6/110: stat da/db/d1f/d27 0 2023-12-05T09:26:11.354 INFO:tasks.workunit.client.0.smithi067.stdout:3/71: creat d9/d12/f16 x:0 0 0 2023-12-05T09:26:11.354 INFO:tasks.workunit.client.0.smithi067.stdout:7/194: unlink d0/d9/f18 0 2023-12-05T09:26:11.363 INFO:tasks.workunit.client.0.smithi067.stdout:9/278: creat d1b/d25/d35/d56/f5a x:0 0 0 2023-12-05T09:26:11.363 INFO:tasks.workunit.client.0.smithi067.stdout:9/279: write d1b/f20 [3064902,76944] 0 2023-12-05T09:26:11.370 INFO:tasks.workunit.client.0.smithi067.stdout:9/280: mkdir d1b/d25/d5b 0 2023-12-05T09:26:11.372 INFO:tasks.workunit.client.0.smithi067.stdout:9/281: stat d1b/d25/l47 0 2023-12-05T09:26:11.376 INFO:tasks.workunit.client.0.smithi067.stdout:9/282: mkdir d1b/d25/d54/d5c 0 2023-12-05T09:26:11.377 INFO:tasks.workunit.client.1.smithi134.stdout:0/180: rmdir d13 39 2023-12-05T09:26:11.377 INFO:tasks.workunit.client.1.smithi134.stdout:1/238: truncate d2/d9/d10/f1d 786932 0 2023-12-05T09:26:11.377 INFO:tasks.workunit.client.1.smithi134.stdout:3/212: truncate d4/f13 229864 0 2023-12-05T09:26:11.378 INFO:tasks.workunit.client.1.smithi134.stdout:1/239: write d2/d9/d10/d30/f37 [3118507,91233] 0 2023-12-05T09:26:11.378 INFO:tasks.workunit.client.1.smithi134.stdout:3/213: chown d4/d1f/l36 1 1 2023-12-05T09:26:11.379 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:11 smithi067 ceph-mon[107174]: Reconfiguring alertmanager.smithi067 (dependencies changed)... 2023-12-05T09:26:11.379 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:11 smithi067 ceph-mon[107174]: Reconfiguring daemon alertmanager.smithi067 on smithi067 2023-12-05T09:26:11.386 INFO:tasks.workunit.client.0.smithi067.stdout:4/82: dwrite d0/f4 [0,4194304] 0 2023-12-05T09:26:11.388 INFO:tasks.workunit.client.1.smithi134.stdout:7/197: truncate d2/df/f15 584740 0 2023-12-05T09:26:11.388 INFO:tasks.workunit.client.0.smithi067.stdout:4/83: link d0/d9/dd/l19 d0/d9/d12/l1c 0 2023-12-05T09:26:11.388 INFO:tasks.workunit.client.0.smithi067.stdout:4/84: fsync d0/f4 0 2023-12-05T09:26:11.390 INFO:tasks.workunit.client.1.smithi134.stdout:8/249: dwrite f9 [0,4194304] 0 2023-12-05T09:26:11.398 INFO:tasks.workunit.client.1.smithi134.stdout:4/212: rename cc to d16/d21/d47/c49 0 2023-12-05T09:26:11.401 INFO:tasks.workunit.client.0.smithi067.stdout:8/149: dwrite d5/da/f17 [0,4194304] 0 2023-12-05T09:26:11.402 INFO:tasks.workunit.client.1.smithi134.stdout:0/181: creat d13/d14/d15/d2a/f36 x:0 0 0 2023-12-05T09:26:11.414 INFO:tasks.workunit.client.0.smithi067.stdout:3/72: rename d9/d12 to d9/da/d15/d17 0 2023-12-05T09:26:11.414 INFO:tasks.workunit.client.0.smithi067.stdout:3/73: fdatasync f0 0 2023-12-05T09:26:11.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/85: rmdir d0/d9/dd 39 2023-12-05T09:26:11.415 INFO:tasks.workunit.client.1.smithi134.stdout:9/175: dwrite d7/d8/d2e/f31 [0,4194304] 0 2023-12-05T09:26:11.420 INFO:tasks.workunit.client.1.smithi134.stdout:0/182: dread d13/d14/d15/f21 [0,4194304] 0 2023-12-05T09:26:11.423 INFO:tasks.workunit.client.0.smithi067.stdout:8/150: mknod d5/dc/c26 0 2023-12-05T09:26:11.423 INFO:tasks.workunit.client.0.smithi067.stdout:9/283: rename fc to d1b/f5d 0 2023-12-05T09:26:11.426 INFO:tasks.workunit.client.0.smithi067.stdout:4/86: truncate d0/fc 2445313 0 2023-12-05T09:26:11.430 INFO:tasks.workunit.client.1.smithi134.stdout:0/183: dread fc [0,4194304] 0 2023-12-05T09:26:11.430 INFO:tasks.workunit.client.0.smithi067.stdout:8/151: symlink d5/dc/d1a/l27 0 2023-12-05T09:26:11.431 INFO:tasks.workunit.client.0.smithi067.stdout:8/152: creat d5/f28 x:0 0 0 2023-12-05T09:26:11.432 INFO:tasks.workunit.client.0.smithi067.stdout:9/284: creat d1b/d25/d35/f5e x:0 0 0 2023-12-05T09:26:11.432 INFO:tasks.workunit.client.0.smithi067.stdout:9/285: dread - d1b/d3e/f53 zero size 2023-12-05T09:26:11.432 INFO:tasks.workunit.client.0.smithi067.stdout:9/286: chown d1b/d25/c3a 165 1 2023-12-05T09:26:11.438 INFO:tasks.workunit.client.0.smithi067.stdout:8/153: rename d5/da/f1d to d5/dc/f29 0 2023-12-05T09:26:11.438 INFO:tasks.workunit.client.0.smithi067.stdout:8/154: fdatasync d5/dc/d1a/f21 0 2023-12-05T09:26:11.438 INFO:tasks.workunit.client.0.smithi067.stdout:5/142: dwrite f9 [0,4194304] 0 2023-12-05T09:26:11.440 INFO:tasks.workunit.client.0.smithi067.stdout:4/87: mkdir d0/d1d 0 2023-12-05T09:26:11.440 INFO:tasks.workunit.client.0.smithi067.stdout:4/88: write d0/f6 [5119682,131018] 0 2023-12-05T09:26:11.441 INFO:tasks.workunit.client.1.smithi134.stdout:3/214: creat d4/d5/d45/f46 x:0 0 0 2023-12-05T09:26:11.441 INFO:tasks.workunit.client.1.smithi134.stdout:3/215: stat d4/fb 0 2023-12-05T09:26:11.441 INFO:tasks.workunit.client.1.smithi134.stdout:3/216: fsync d4/fb 0 2023-12-05T09:26:11.447 INFO:tasks.workunit.client.1.smithi134.stdout:8/250: rename da/de/d16/d2d/c32 to da/de/d11/c53 0 2023-12-05T09:26:11.447 INFO:tasks.workunit.client.1.smithi134.stdout:8/251: stat da/de/c37 0 2023-12-05T09:26:11.447 INFO:tasks.workunit.client.1.smithi134.stdout:4/213: creat d16/d21/d47/f4a x:0 0 0 2023-12-05T09:26:11.451 INFO:tasks.workunit.client.1.smithi134.stdout:6/197: rename d4/db to d4/d39 0 2023-12-05T09:26:11.453 INFO:tasks.workunit.client.0.smithi067.stdout:9/287: rename d1b/d25/f3c to d1b/f5f 0 2023-12-05T09:26:11.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/184: creat d13/d14/d15/f37 x:0 0 0 2023-12-05T09:26:11.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/185: write fe [2696238,24947] 0 2023-12-05T09:26:11.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/186: fsync fd 0 2023-12-05T09:26:11.455 INFO:tasks.workunit.client.0.smithi067.stdout:2/107: dwrite d0/f4 [0,4194304] 0 2023-12-05T09:26:11.456 INFO:tasks.workunit.client.1.smithi134.stdout:1/240: rmdir d2/d9 39 2023-12-05T09:26:11.459 INFO:tasks.workunit.client.0.smithi067.stdout:4/89: unlink d0/ff 0 2023-12-05T09:26:11.459 INFO:tasks.workunit.client.0.smithi067.stdout:4/90: chown d0/f8 62 1 2023-12-05T09:26:11.459 INFO:tasks.workunit.client.0.smithi067.stdout:4/91: readlink d0/d9/dd/l1b 0 2023-12-05T09:26:11.459 INFO:tasks.workunit.client.1.smithi134.stdout:8/252: rename da/de/d16/f20 to da/de/f54 0 2023-12-05T09:26:11.460 INFO:tasks.workunit.client.1.smithi134.stdout:3/217: symlink d4/d5/d45/l47 0 2023-12-05T09:26:11.460 INFO:tasks.workunit.client.1.smithi134.stdout:3/218: dread - d4/d5/f1a zero size 2023-12-05T09:26:11.460 INFO:tasks.workunit.client.1.smithi134.stdout:8/253: creat da/de/f55 x:0 0 0 2023-12-05T09:26:11.460 INFO:tasks.workunit.client.1.smithi134.stdout:4/214: mkdir d16/d21/d47/d4b 0 2023-12-05T09:26:11.463 INFO:tasks.workunit.client.1.smithi134.stdout:9/176: getdents d7 0 2023-12-05T09:26:11.463 INFO:tasks.workunit.client.0.smithi067.stdout:9/288: creat d1b/d25/d54/d5c/f60 x:0 0 0 2023-12-05T09:26:11.464 INFO:tasks.workunit.client.1.smithi134.stdout:0/187: creat d13/f38 x:0 0 0 2023-12-05T09:26:11.465 INFO:tasks.workunit.client.1.smithi134.stdout:1/241: mknod d2/d9/c58 0 2023-12-05T09:26:11.466 INFO:tasks.workunit.client.1.smithi134.stdout:1/242: write d2/f20 [3078474,129704] 0 2023-12-05T09:26:11.466 INFO:tasks.workunit.client.1.smithi134.stdout:1/243: creat d2/d27/f59 x:0 0 0 2023-12-05T09:26:11.466 INFO:tasks.workunit.client.1.smithi134.stdout:6/198: dread d4/d8/da/d1b/f30 [0,4194304] 0 2023-12-05T09:26:11.468 INFO:tasks.workunit.client.0.smithi067.stdout:4/92: rename d0/ce to d0/d9/c1e 0 2023-12-05T09:26:11.468 INFO:tasks.workunit.client.0.smithi067.stdout:4/93: getdents d0/d1d 0 2023-12-05T09:26:11.468 INFO:tasks.workunit.client.0.smithi067.stdout:9/289: readlink d1b/d25/l29 0 2023-12-05T09:26:11.470 INFO:tasks.workunit.client.0.smithi067.stdout:6/111: dwrite da/db/d1f/f25 [0,4194304] 0 2023-12-05T09:26:11.472 INFO:tasks.workunit.client.0.smithi067.stdout:3/74: write f4 [3952609,45943] 0 2023-12-05T09:26:11.472 INFO:tasks.workunit.client.0.smithi067.stdout:3/75: chown d9/da/d15/d17/l10 33871213 1 2023-12-05T09:26:11.473 INFO:tasks.workunit.client.1.smithi134.stdout:1/244: fdatasync d2/f4d 0 2023-12-05T09:26:11.473 INFO:tasks.workunit.client.1.smithi134.stdout:1/245: chown d2/d9/c18 1946 1 2023-12-05T09:26:11.473 INFO:tasks.workunit.client.1.smithi134.stdout:1/246: read - d2/d27/d40/f46 zero size 2023-12-05T09:26:11.477 INFO:tasks.workunit.client.0.smithi067.stdout:3/76: mknod d9/da/c18 0 2023-12-05T09:26:11.477 INFO:tasks.workunit.client.0.smithi067.stdout:3/77: chown d9/fb 0 1 2023-12-05T09:26:11.479 INFO:tasks.workunit.client.1.smithi134.stdout:8/254: dread da/de/d16/f24 [0,4194304] 0 2023-12-05T09:26:11.479 INFO:tasks.workunit.client.1.smithi134.stdout:8/255: creat da/de/d16/d33/f56 x:0 0 0 2023-12-05T09:26:11.480 INFO:tasks.workunit.client.1.smithi134.stdout:8/256: write da/de/d16/d45/d3b/f47 [4227125,57598] 0 2023-12-05T09:26:11.482 INFO:tasks.workunit.client.0.smithi067.stdout:3/78: creat d9/da/f19 x:0 0 0 2023-12-05T09:26:11.502 INFO:tasks.workunit.client.0.smithi067.stdout:5/143: dread db/df/d1a/d1d/d20/f2a [0,4194304] 0 2023-12-05T09:26:11.504 INFO:tasks.workunit.client.1.smithi134.stdout:3/219: creat d4/d3f/f48 x:0 0 0 2023-12-05T09:26:11.506 INFO:tasks.workunit.client.0.smithi067.stdout:5/144: mkdir db/df/d36 0 2023-12-05T09:26:11.507 INFO:tasks.workunit.client.1.smithi134.stdout:4/215: rename d16/d18/d1c/f2e to d16/d21/d48/f4c 0 2023-12-05T09:26:11.508 INFO:tasks.workunit.client.0.smithi067.stdout:5/145: rmdir db/df/d1a/d1d/d20 39 2023-12-05T09:26:11.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/188: unlink fc 0 2023-12-05T09:26:11.517 INFO:tasks.workunit.client.1.smithi134.stdout:9/177: rename d7/d8/d16/f2a to d7/d8/d14/f3d 0 2023-12-05T09:26:11.519 INFO:tasks.workunit.client.0.smithi067.stdout:6/112: read da/fe [2138129,44713] 0 2023-12-05T09:26:11.519 INFO:tasks.workunit.client.1.smithi134.stdout:4/216: mknod d16/d21/d35/c4d 0 2023-12-05T09:26:11.522 INFO:tasks.workunit.client.0.smithi067.stdout:7/195: dwrite d0/f6 [0,4194304] 0 2023-12-05T09:26:11.522 INFO:tasks.workunit.client.1.smithi134.stdout:5/187: sync 2023-12-05T09:26:11.522 INFO:tasks.workunit.client.1.smithi134.stdout:2/238: sync 2023-12-05T09:26:11.524 INFO:tasks.workunit.client.1.smithi134.stdout:9/178: creat d7/d8/d14/d26/f3e x:0 0 0 2023-12-05T09:26:11.526 INFO:tasks.workunit.client.1.smithi134.stdout:7/198: dwrite d2/df/f15 [0,4194304] 0 2023-12-05T09:26:11.526 INFO:tasks.workunit.client.1.smithi134.stdout:7/199: creat d2/f41 x:0 0 0 2023-12-05T09:26:11.528 INFO:tasks.workunit.client.1.smithi134.stdout:2/239: mknod d19/d28/c50 0 2023-12-05T09:26:11.529 INFO:tasks.workunit.client.0.smithi067.stdout:9/290: dwrite d1b/d25/d35/d56/f5a [0,4194304] 0 2023-12-05T09:26:11.529 INFO:tasks.workunit.client.1.smithi134.stdout:9/179: mknod d7/d8/d14/d26/c3f 0 2023-12-05T09:26:11.532 INFO:tasks.workunit.client.1.smithi134.stdout:6/199: rename d4/d8 to d4/d2a/d3a 0 2023-12-05T09:26:11.533 INFO:tasks.workunit.client.0.smithi067.stdout:3/79: write d9/fe [641572,104732] 0 2023-12-05T09:26:11.535 INFO:tasks.workunit.client.0.smithi067.stdout:6/113: link c9 da/db/d12/d19/c2a 0 2023-12-05T09:26:11.536 INFO:tasks.workunit.client.1.smithi134.stdout:7/200: symlink d2/d7/dc/d2e/d3a/l42 0 2023-12-05T09:26:11.537 INFO:tasks.workunit.client.1.smithi134.stdout:2/240: mknod d19/d49/c51 0 2023-12-05T09:26:11.537 INFO:tasks.workunit.client.1.smithi134.stdout:9/180: creat d7/f40 x:0 0 0 2023-12-05T09:26:11.541 INFO:tasks.workunit.client.0.smithi067.stdout:9/291: link d1b/f24 d1b/d25/d54/d5c/f61 0 2023-12-05T09:26:11.546 INFO:tasks.workunit.client.1.smithi134.stdout:1/247: rename d2/f2b to d2/d9/d10/f5a 0 2023-12-05T09:26:11.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/189: write d13/d1f/d23/f27 [3765596,60717] 0 2023-12-05T09:26:11.546 INFO:tasks.workunit.client.1.smithi134.stdout:7/201: creat d2/d7/dc/d2e/f43 x:0 0 0 2023-12-05T09:26:11.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/190: dread - d13/d14/d30/f32 zero size 2023-12-05T09:26:11.548 INFO:tasks.workunit.client.1.smithi134.stdout:9/181: mknod d7/d8/d16/c41 0 2023-12-05T09:26:11.549 INFO:tasks.workunit.client.0.smithi067.stdout:6/114: unlink da/c26 0 2023-12-05T09:26:11.549 INFO:tasks.workunit.client.1.smithi134.stdout:1/248: mkdir d2/d9/d10/d5b 0 2023-12-05T09:26:11.551 INFO:tasks.workunit.client.1.smithi134.stdout:7/202: truncate d2/d7/f37 1301938 0 2023-12-05T09:26:11.552 INFO:tasks.workunit.client.1.smithi134.stdout:7/203: chown d2/dd/f19 145 1 2023-12-05T09:26:11.555 INFO:tasks.workunit.client.1.smithi134.stdout:7/204: mknod d2/df/c44 0 2023-12-05T09:26:11.555 INFO:tasks.workunit.client.1.smithi134.stdout:7/205: fsync d2/df/f15 0 2023-12-05T09:26:11.563 INFO:tasks.workunit.client.1.smithi134.stdout:0/191: dread f7 [0,4194304] 0 2023-12-05T09:26:11.564 INFO:tasks.workunit.client.1.smithi134.stdout:0/192: mknod d13/d14/d30/d2c/c39 0 2023-12-05T09:26:11.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:11 smithi134 ceph-mon[116304]: Reconfiguring alertmanager.smithi067 (dependencies changed)... 2023-12-05T09:26:11.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:11 smithi134 ceph-mon[116304]: Reconfiguring daemon alertmanager.smithi067 on smithi067 2023-12-05T09:26:11.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/217: dread d16/d18/d1b/f31 [0,4194304] 0 2023-12-05T09:26:11.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/218: fsync d16/f41 0 2023-12-05T09:26:11.638 INFO:tasks.workunit.client.0.smithi067.stdout:3/80: dread f4 [0,4194304] 0 2023-12-05T09:26:11.638 INFO:tasks.workunit.client.0.smithi067.stdout:4/94: dwrite d0/d9/f13 [0,4194304] 0 2023-12-05T09:26:11.639 INFO:tasks.workunit.client.0.smithi067.stdout:9/292: dwrite d1b/d25/d54/f59 [0,4194304] 0 2023-12-05T09:26:11.640 INFO:tasks.workunit.client.0.smithi067.stdout:9/293: chown d1b/d25/f40 85 1 2023-12-05T09:26:11.643 INFO:tasks.workunit.client.1.smithi134.stdout:8/257: dwrite da/f3e [0,4194304] 0 2023-12-05T09:26:11.643 INFO:tasks.workunit.client.1.smithi134.stdout:8/258: chown da/de/f48 1746 1 2023-12-05T09:26:11.651 INFO:tasks.workunit.client.0.smithi067.stdout:4/95: rename d0/d9/f13 to d0/d1d/f1f 0 2023-12-05T09:26:11.655 INFO:tasks.workunit.client.1.smithi134.stdout:0/193: dwrite f8 [0,4194304] 0 2023-12-05T09:26:11.657 INFO:tasks.workunit.client.0.smithi067.stdout:9/294: mkdir d1b/d25/d5b/d62 0 2023-12-05T09:26:11.657 INFO:tasks.workunit.client.0.smithi067.stdout:3/81: dread f0 [0,4194304] 0 2023-12-05T09:26:11.657 INFO:tasks.workunit.client.0.smithi067.stdout:3/82: dread - d9/da/fd zero size 2023-12-05T09:26:11.657 INFO:tasks.workunit.client.0.smithi067.stdout:4/96: creat d0/d9/d12/d15/f20 x:0 0 0 2023-12-05T09:26:11.658 INFO:tasks.workunit.client.0.smithi067.stdout:3/83: mkdir d9/da/d15/d17/d1a 0 2023-12-05T09:26:11.658 INFO:tasks.workunit.client.0.smithi067.stdout:3/84: read - d9/f14 zero size 2023-12-05T09:26:11.659 INFO:tasks.workunit.client.1.smithi134.stdout:7/206: dwrite d2/d7/dc/d22/f3d [0,4194304] 0 2023-12-05T09:26:11.662 INFO:tasks.workunit.client.0.smithi067.stdout:4/97: creat d0/d1d/f21 x:0 0 0 2023-12-05T09:26:11.662 INFO:tasks.workunit.client.0.smithi067.stdout:4/98: truncate d0/fc 3331249 0 2023-12-05T09:26:11.665 INFO:tasks.workunit.client.1.smithi134.stdout:5/188: read d0/f2 [1944974,97605] 0 2023-12-05T09:26:11.667 INFO:tasks.workunit.client.1.smithi134.stdout:8/259: dread da/de/d11/f30 [0,4194304] 0 2023-12-05T09:26:11.667 INFO:tasks.workunit.client.0.smithi067.stdout:4/99: rename d0/c3 to d0/d9/c22 0 2023-12-05T09:26:11.667 INFO:tasks.workunit.client.0.smithi067.stdout:4/100: fsync d0/f8 0 2023-12-05T09:26:11.674 INFO:tasks.workunit.client.0.smithi067.stdout:5/146: dwrite db/df/f15 [4194304,4194304] 0 2023-12-05T09:26:11.674 INFO:tasks.workunit.client.0.smithi067.stdout:5/147: chown c2 17589012 1 2023-12-05T09:26:11.674 INFO:tasks.workunit.client.0.smithi067.stdout:5/148: dread - db/df/d1a/f29 zero size 2023-12-05T09:26:11.674 INFO:tasks.workunit.client.0.smithi067.stdout:5/149: write db/df/d1a/d1d/f24 [1019783,69501] 0 2023-12-05T09:26:11.678 INFO:tasks.workunit.client.0.smithi067.stdout:9/295: write f14 [2971086,18560] 0 2023-12-05T09:26:11.681 INFO:tasks.workunit.client.0.smithi067.stdout:6/115: dwrite da/d10/d1e/d17/f29 [0,4194304] 0 2023-12-05T09:26:11.681 INFO:tasks.workunit.client.0.smithi067.stdout:5/150: link db/df/d1a/d1d/d20/f2d db/df/d1a/d1d/d20/f37 0 2023-12-05T09:26:11.681 INFO:tasks.workunit.client.0.smithi067.stdout:5/151: chown db/df/d1a/d1d 12 1 2023-12-05T09:26:11.683 INFO:tasks.workunit.client.1.smithi134.stdout:8/260: dread da/de/d11/f30 [0,4194304] 0 2023-12-05T09:26:11.684 INFO:tasks.workunit.client.1.smithi134.stdout:9/182: dwrite d7/f40 [0,4194304] 0 2023-12-05T09:26:11.684 INFO:tasks.workunit.client.1.smithi134.stdout:3/220: dwrite d4/d5/f1a [0,4194304] 0 2023-12-05T09:26:11.691 INFO:tasks.workunit.client.1.smithi134.stdout:4/219: symlink d16/l4e 0 2023-12-05T09:26:11.692 INFO:tasks.workunit.client.0.smithi067.stdout:5/152: chown db/df/f12 134107984 1 2023-12-05T09:26:11.696 INFO:tasks.workunit.client.1.smithi134.stdout:1/249: dwrite d2/d9/d10/f1d [0,4194304] 0 2023-12-05T09:26:11.696 INFO:tasks.workunit.client.1.smithi134.stdout:1/250: write d2/d9/d10/f3c [659238,111469] 0 2023-12-05T09:26:11.710 INFO:tasks.workunit.client.0.smithi067.stdout:4/101: dread d0/d1d/f1f [0,4194304] 0 2023-12-05T09:26:11.712 INFO:tasks.workunit.client.0.smithi067.stdout:6/116: read da/d10/d1e/d17/f18 [411345,100693] 0 2023-12-05T09:26:11.712 INFO:tasks.workunit.client.0.smithi067.stdout:6/117: getdents da/db/d12 0 2023-12-05T09:26:11.712 INFO:tasks.workunit.client.0.smithi067.stdout:6/118: readlink da/db/lf 0 2023-12-05T09:26:11.714 INFO:tasks.workunit.client.0.smithi067.stdout:6/119: creat da/db/f2b x:0 0 0 2023-12-05T09:26:11.724 INFO:tasks.workunit.client.1.smithi134.stdout:8/261: dread f2 [0,4194304] 0 2023-12-05T09:26:11.725 INFO:tasks.workunit.client.1.smithi134.stdout:8/262: rename da/de/d16/d2d to da/de/d16/d2d/d57 22 2023-12-05T09:26:11.725 INFO:tasks.workunit.client.1.smithi134.stdout:8/263: chown da/de/d43 18 1 2023-12-05T09:26:11.726 INFO:tasks.workunit.client.1.smithi134.stdout:5/189: truncate d0/dd/f14 1070107 0 2023-12-05T09:26:11.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/207: creat d2/dd/d1a/f45 x:0 0 0 2023-12-05T09:26:11.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/208: truncate d2/df/f14 126064 0 2023-12-05T09:26:11.726 INFO:tasks.workunit.client.0.smithi067.stdout:9/296: write d1b/d25/d35/f43 [180091,24349] 0 2023-12-05T09:26:11.726 INFO:tasks.workunit.client.0.smithi067.stdout:3/85: dread f3 [0,4194304] 0 2023-12-05T09:26:11.732 INFO:tasks.workunit.client.0.smithi067.stdout:4/102: dread d0/f8 [0,4194304] 0 2023-12-05T09:26:11.733 INFO:tasks.workunit.client.0.smithi067.stdout:4/103: stat d0/f4 0 2023-12-05T09:26:11.743 INFO:tasks.workunit.client.0.smithi067.stdout:9/297: creat d1b/d25/d5b/d62/f63 x:0 0 0 2023-12-05T09:26:11.744 INFO:tasks.workunit.client.1.smithi134.stdout:5/190: dread d0/dd/f2c [0,4194304] 0 2023-12-05T09:26:11.749 INFO:tasks.workunit.client.0.smithi067.stdout:3/86: rmdir d9 39 2023-12-05T09:26:11.757 INFO:tasks.workunit.client.1.smithi134.stdout:9/183: stat d7/d8/c28 0 2023-12-05T09:26:11.760 INFO:tasks.workunit.client.0.smithi067.stdout:9/298: mknod d1b/d25/d35/c64 0 2023-12-05T09:26:11.760 INFO:tasks.workunit.client.0.smithi067.stdout:9/299: chown l13 1256989402 1 2023-12-05T09:26:11.760 INFO:tasks.workunit.client.0.smithi067.stdout:9/300: readlink d1b/d25/d35/l48 0 2023-12-05T09:26:11.762 INFO:tasks.workunit.client.1.smithi134.stdout:3/221: symlink d4/d3f/l49 0 2023-12-05T09:26:11.762 INFO:tasks.workunit.client.1.smithi134.stdout:3/222: write d4/f38 [754745,11538] 0 2023-12-05T09:26:11.762 INFO:tasks.workunit.client.1.smithi134.stdout:3/223: getdents d4 0 2023-12-05T09:26:11.763 INFO:tasks.workunit.client.1.smithi134.stdout:5/191: getdents d0/d1a/d1c/d3f 0 2023-12-05T09:26:11.763 INFO:tasks.workunit.client.1.smithi134.stdout:5/192: chown d0/d1a/l35 65532772 1 2023-12-05T09:26:11.763 INFO:tasks.workunit.client.1.smithi134.stdout:5/193: write d0/dd/f32 [1014531,42876] 0 2023-12-05T09:26:11.763 INFO:tasks.workunit.client.1.smithi134.stdout:5/194: chown d0/d1a/l35 6747615 1 2023-12-05T09:26:11.764 INFO:tasks.workunit.client.1.smithi134.stdout:3/224: mknod d4/d3f/c4a 0 2023-12-05T09:26:11.765 INFO:tasks.workunit.client.0.smithi067.stdout:3/87: rename d9/da/d15/d17/ff to d9/da/d15/f1b 0 2023-12-05T09:26:11.766 INFO:tasks.workunit.client.1.smithi134.stdout:5/195: mkdir d0/d45 0 2023-12-05T09:26:11.766 INFO:tasks.workunit.client.1.smithi134.stdout:5/196: write d0/d1a/d1c/f31 [272088,67683] 0 2023-12-05T09:26:11.766 INFO:tasks.workunit.client.1.smithi134.stdout:5/197: dread - d0/f43 zero size 2023-12-05T09:26:11.767 INFO:tasks.workunit.client.0.smithi067.stdout:9/301: mknod d1b/d25/c65 0 2023-12-05T09:26:11.774 INFO:tasks.workunit.client.0.smithi067.stdout:3/88: rename d9/da/d15/d17/l10 to d9/l1c 0 2023-12-05T09:26:11.774 INFO:tasks.workunit.client.0.smithi067.stdout:3/89: fdatasync f3 0 2023-12-05T09:26:11.774 INFO:tasks.workunit.client.0.smithi067.stdout:5/153: dwrite db/df/d1a/f1c [0,4194304] 0 2023-12-05T09:26:11.774 INFO:tasks.workunit.client.0.smithi067.stdout:5/154: stat db/f13 0 2023-12-05T09:26:11.775 INFO:tasks.workunit.client.0.smithi067.stdout:5/155: chown f1 11 1 2023-12-05T09:26:11.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/302: unlink d1b/d25/d54/d5c/f60 0 2023-12-05T09:26:11.775 INFO:tasks.workunit.client.0.smithi067.stdout:9/303: unlink d1b/d25/f40 0 2023-12-05T09:26:11.777 INFO:tasks.workunit.client.1.smithi134.stdout:5/198: truncate d0/d11/f22 3058842 0 2023-12-05T09:26:11.783 INFO:tasks.workunit.client.1.smithi134.stdout:4/220: dwrite fb [0,4194304] 0 2023-12-05T09:26:11.787 INFO:tasks.workunit.client.0.smithi067.stdout:4/104: write d0/f7 [1400430,96933] 0 2023-12-05T09:26:11.787 INFO:tasks.workunit.client.0.smithi067.stdout:4/105: readlink d0/d9/dd/l19 0 2023-12-05T09:26:11.787 INFO:tasks.workunit.client.0.smithi067.stdout:4/106: read d0/fa [1756410,62811] 0 2023-12-05T09:26:11.788 INFO:tasks.workunit.client.0.smithi067.stdout:4/107: creat d0/d1d/f23 x:0 0 0 2023-12-05T09:26:11.788 INFO:tasks.workunit.client.0.smithi067.stdout:4/108: read d0/f4 [2889940,105909] 0 2023-12-05T09:26:11.798 INFO:tasks.workunit.client.0.smithi067.stdout:9/304: getdents d1b/d25/d54/d5c 0 2023-12-05T09:26:11.799 INFO:tasks.workunit.client.0.smithi067.stdout:9/305: chown d1b/d25/d35/c64 123951 1 2023-12-05T09:26:11.799 INFO:tasks.workunit.client.1.smithi134.stdout:4/221: unlink d16/d18/d1b/d24/f40 0 2023-12-05T09:26:11.799 INFO:tasks.workunit.client.1.smithi134.stdout:4/222: chown d16/d21/l22 2338 1 2023-12-05T09:26:11.813 INFO:tasks.workunit.client.0.smithi067.stdout:6/120: dwrite da/db/d1f/f25 [4194304,4194304] 0 2023-12-05T09:26:11.816 INFO:tasks.workunit.client.1.smithi134.stdout:0/194: truncate d13/d1f/d23/f27 4110982 0 2023-12-05T09:26:11.824 INFO:tasks.workunit.client.1.smithi134.stdout:0/195: creat d13/d14/d30/f3a x:0 0 0 2023-12-05T09:26:11.826 INFO:tasks.workunit.client.1.smithi134.stdout:0/196: rename d13/d14/d30/f29 to d13/d14/d30/f3b 0 2023-12-05T09:26:11.838 INFO:tasks.workunit.client.1.smithi134.stdout:1/251: dwrite d2/d9/d10/f53 [0,4194304] 0 2023-12-05T09:26:11.838 INFO:tasks.workunit.client.1.smithi134.stdout:1/252: chown d2/d9/d10/f1d 3 1 2023-12-05T09:26:11.838 INFO:tasks.workunit.client.1.smithi134.stdout:1/253: truncate d2/d9/f2c 22070 0 2023-12-05T09:26:11.838 INFO:tasks.workunit.client.1.smithi134.stdout:1/254: fsync d2/d9/f1b 0 2023-12-05T09:26:11.840 INFO:tasks.workunit.client.0.smithi067.stdout:9/306: dread d1b/d25/f2d [0,4194304] 0 2023-12-05T09:26:11.850 INFO:tasks.workunit.client.1.smithi134.stdout:8/264: dwrite da/de/f54 [0,4194304] 0 2023-12-05T09:26:11.850 INFO:tasks.workunit.client.1.smithi134.stdout:8/265: readlink da/de/d16/d45/l51 0 2023-12-05T09:26:11.855 INFO:tasks.workunit.client.1.smithi134.stdout:1/255: truncate d2/d27/d40/f51 7863488 0 2023-12-05T09:26:11.859 INFO:tasks.workunit.client.1.smithi134.stdout:8/266: creat da/de/d16/f58 x:0 0 0 2023-12-05T09:26:11.859 INFO:tasks.workunit.client.1.smithi134.stdout:8/267: dread - da/de/f1c zero size 2023-12-05T09:26:11.859 INFO:tasks.workunit.client.1.smithi134.stdout:8/268: readlink da/de/d11/l4f 0 2023-12-05T09:26:11.859 INFO:tasks.workunit.client.1.smithi134.stdout:8/269: write da/de/d11/d1d/f2e [302126,71340] 0 2023-12-05T09:26:11.861 INFO:tasks.workunit.client.1.smithi134.stdout:9/184: dwrite d7/f1a [4194304,4194304] 0 2023-12-05T09:26:11.861 INFO:tasks.workunit.client.1.smithi134.stdout:9/185: truncate d7/d8/d16/f33 1363666 0 2023-12-05T09:26:11.865 INFO:tasks.workunit.client.1.smithi134.stdout:5/199: dwrite d0/d1a/f27 [0,4194304] 0 2023-12-05T09:26:11.865 INFO:tasks.workunit.client.1.smithi134.stdout:5/200: creat d0/f46 x:0 0 0 2023-12-05T09:26:11.865 INFO:tasks.workunit.client.1.smithi134.stdout:5/201: stat d0/d1a/d1c/d3f 0 2023-12-05T09:26:11.865 INFO:tasks.workunit.client.1.smithi134.stdout:5/202: chown d0/f7 2 1 2023-12-05T09:26:11.868 INFO:tasks.workunit.client.0.smithi067.stdout:2/108: sync 2023-12-05T09:26:11.870 INFO:tasks.workunit.client.0.smithi067.stdout:7/196: sync 2023-12-05T09:26:11.874 INFO:tasks.workunit.client.0.smithi067.stdout:0/224: sync 2023-12-05T09:26:11.876 INFO:tasks.workunit.client.0.smithi067.stdout:8/155: sync 2023-12-05T09:26:11.876 INFO:tasks.workunit.client.0.smithi067.stdout:1/152: sync 2023-12-05T09:26:11.876 INFO:tasks.workunit.client.0.smithi067.stdout:1/153: chown d2/d3/f18 36 1 2023-12-05T09:26:11.877 INFO:tasks.workunit.client.0.smithi067.stdout:1/154: dread - d2/d3/f18 zero size 2023-12-05T09:26:11.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/156: creat d5/da/f2a x:0 0 0 2023-12-05T09:26:11.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/157: fsync d5/dc/d1a/d20/f22 0 2023-12-05T09:26:11.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/158: dread - d5/da/f2a zero size 2023-12-05T09:26:11.878 INFO:tasks.workunit.client.1.smithi134.stdout:8/270: mknod da/de/d16/d33/c59 0 2023-12-05T09:26:11.879 INFO:tasks.workunit.client.0.smithi067.stdout:0/225: write d3/d7/f8 [4236673,80300] 0 2023-12-05T09:26:11.880 INFO:tasks.workunit.client.0.smithi067.stdout:0/226: chown d3/df/f21 20043285 1 2023-12-05T09:26:11.884 INFO:tasks.workunit.client.0.smithi067.stdout:5/156: dwrite f9 [0,4194304] 0 2023-12-05T09:26:11.887 INFO:tasks.workunit.client.0.smithi067.stdout:8/159: getdents d5 0 2023-12-05T09:26:11.891 INFO:tasks.workunit.client.0.smithi067.stdout:3/90: dwrite d9/fb [0,4194304] 0 2023-12-05T09:26:11.891 INFO:tasks.workunit.client.0.smithi067.stdout:3/91: fsync d9/fb 0 2023-12-05T09:26:11.893 INFO:tasks.workunit.client.0.smithi067.stdout:5/157: mkdir db/df/d38 0 2023-12-05T09:26:11.896 INFO:tasks.workunit.client.1.smithi134.stdout:4/223: dwrite d16/d21/f3f [0,4194304] 0 2023-12-05T09:26:11.896 INFO:tasks.workunit.client.1.smithi134.stdout:4/224: chown d16/l4e 61 1 2023-12-05T09:26:11.899 INFO:tasks.workunit.client.1.smithi134.stdout:9/186: read d7/d8/d2e/f31 [393994,54] 0 2023-12-05T09:26:11.900 INFO:tasks.workunit.client.1.smithi134.stdout:9/187: fdatasync d7/f1a 0 2023-12-05T09:26:11.900 INFO:tasks.workunit.client.1.smithi134.stdout:9/188: fsync d7/d8/d16/f33 0 2023-12-05T09:26:11.900 INFO:tasks.workunit.client.1.smithi134.stdout:6/200: sync 2023-12-05T09:26:11.900 INFO:tasks.workunit.client.1.smithi134.stdout:2/241: sync 2023-12-05T09:26:11.900 INFO:tasks.workunit.client.1.smithi134.stdout:3/225: dwrite d4/f3b [0,4194304] 0 2023-12-05T09:26:11.901 INFO:tasks.workunit.client.1.smithi134.stdout:0/197: rmdir d13 39 2023-12-05T09:26:11.901 INFO:tasks.workunit.client.1.smithi134.stdout:0/198: chown lf 303 1 2023-12-05T09:26:11.903 INFO:tasks.workunit.client.1.smithi134.stdout:4/225: mknod d16/d21/d47/d4b/c4f 0 2023-12-05T09:26:11.903 INFO:tasks.workunit.client.1.smithi134.stdout:4/226: chown d16/d18/d1a/f20 99110137 1 2023-12-05T09:26:11.903 INFO:tasks.workunit.client.1.smithi134.stdout:4/227: fdatasync d16/f41 0 2023-12-05T09:26:11.909 INFO:tasks.workunit.client.1.smithi134.stdout:9/189: creat d7/d8/d2e/f42 x:0 0 0 2023-12-05T09:26:11.912 INFO:tasks.workunit.client.1.smithi134.stdout:4/228: truncate d16/d18/d1a/f32 162146 0 2023-12-05T09:26:11.912 INFO:tasks.workunit.client.1.smithi134.stdout:4/229: write d16/d18/d1a/f43 [395515,60816] 0 2023-12-05T09:26:11.915 INFO:tasks.workunit.client.1.smithi134.stdout:9/190: rename d7/d8/d14/c24 to d7/d8/d16/d3c/c43 0 2023-12-05T09:26:11.920 INFO:tasks.workunit.client.1.smithi134.stdout:3/226: rmdir d4/d5 39 2023-12-05T09:26:11.920 INFO:tasks.workunit.client.1.smithi134.stdout:3/227: chown d4/f3b 14497993 1 2023-12-05T09:26:11.920 INFO:tasks.workunit.client.1.smithi134.stdout:3/228: dread - d4/d3f/f48 zero size 2023-12-05T09:26:11.920 INFO:tasks.workunit.client.1.smithi134.stdout:3/229: chown f0 439 1 2023-12-05T09:26:11.923 INFO:tasks.workunit.client.1.smithi134.stdout:6/201: write d4/d39/f12 [549531,56238] 0 2023-12-05T09:26:11.924 INFO:tasks.workunit.client.1.smithi134.stdout:4/230: mkdir d16/d21/d50 0 2023-12-05T09:26:11.926 INFO:tasks.workunit.client.0.smithi067.stdout:2/109: dread d0/f9 [0,4194304] 0 2023-12-05T09:26:11.927 INFO:tasks.workunit.client.1.smithi134.stdout:3/230: truncate d4/d1f/f40 112918 0 2023-12-05T09:26:11.933 INFO:tasks.workunit.client.1.smithi134.stdout:6/202: unlink d4/d2a/d3a/da/f25 0 2023-12-05T09:26:11.933 INFO:tasks.workunit.client.1.smithi134.stdout:6/203: write d4/ff [2640317,41775] 0 2023-12-05T09:26:11.933 INFO:tasks.workunit.client.1.smithi134.stdout:9/191: rmdir d7/d8/d14/d26 39 2023-12-05T09:26:11.933 INFO:tasks.workunit.client.1.smithi134.stdout:9/192: truncate d7/d8/d14/d26/f3e 76656 0 2023-12-05T09:26:11.933 INFO:tasks.workunit.client.0.smithi067.stdout:2/110: truncate d0/d10/f19 1809855 0 2023-12-05T09:26:11.938 INFO:tasks.workunit.client.0.smithi067.stdout:2/111: rename d0/ca to d0/d25/c26 0 2023-12-05T09:26:11.941 INFO:tasks.workunit.client.0.smithi067.stdout:2/112: creat d0/d15/f27 x:0 0 0 2023-12-05T09:26:11.944 INFO:tasks.workunit.client.0.smithi067.stdout:2/113: mknod d0/d25/c28 0 2023-12-05T09:26:11.945 INFO:tasks.workunit.client.0.smithi067.stdout:2/114: write d0/d10/f1d [4993806,72947] 0 2023-12-05T09:26:11.945 INFO:tasks.workunit.client.0.smithi067.stdout:2/115: write d0/f9 [671386,40806] 0 2023-12-05T09:26:11.954 INFO:tasks.workunit.client.0.smithi067.stdout:6/121: dwrite da/d10/d1e/d17/f29 [0,4194304] 0 2023-12-05T09:26:11.954 INFO:tasks.workunit.client.0.smithi067.stdout:0/227: write d3/df/f16 [1427037,27530] 0 2023-12-05T09:26:11.954 INFO:tasks.workunit.client.0.smithi067.stdout:0/228: symlink d3/d7/d3c/l51 0 2023-12-05T09:26:11.954 INFO:tasks.workunit.client.0.smithi067.stdout:4/109: dwrite d0/f6 [0,4194304] 0 2023-12-05T09:26:11.954 INFO:tasks.workunit.client.1.smithi134.stdout:1/256: dwrite d2/d9/d10/f5a [0,4194304] 0 2023-12-05T09:26:11.959 INFO:tasks.workunit.client.1.smithi134.stdout:1/257: rmdir d2/d9/d10/d30/d4a 39 2023-12-05T09:26:11.961 INFO:tasks.workunit.client.0.smithi067.stdout:4/110: truncate d0/f4 1343177 0 2023-12-05T09:26:11.968 INFO:tasks.workunit.client.0.smithi067.stdout:8/160: dwrite d5/f1c [4194304,4194304] 0 2023-12-05T09:26:11.970 INFO:tasks.workunit.client.1.smithi134.stdout:1/258: rename d2/f20 to d2/d9/d10/d5b/f5c 0 2023-12-05T09:26:11.970 INFO:tasks.workunit.client.1.smithi134.stdout:1/259: fsync d2/d9/d10/f5a 0 2023-12-05T09:26:11.972 INFO:tasks.workunit.client.1.smithi134.stdout:1/260: creat d2/d27/d40/f5d x:0 0 0 2023-12-05T09:26:11.972 INFO:tasks.workunit.client.0.smithi067.stdout:7/197: dwrite d0/d9/f2c [0,4194304] 0 2023-12-05T09:26:11.974 INFO:tasks.workunit.client.1.smithi134.stdout:1/261: getdents d2/d9/d10/d30 0 2023-12-05T09:26:11.974 INFO:tasks.workunit.client.1.smithi134.stdout:1/262: dread - d2/d27/f3d zero size 2023-12-05T09:26:11.974 INFO:tasks.workunit.client.1.smithi134.stdout:1/263: chown d2/d9/d10/f4e 21 1 2023-12-05T09:26:11.977 INFO:tasks.workunit.client.0.smithi067.stdout:8/161: truncate d5/da/f1f 74283 0 2023-12-05T09:26:11.980 INFO:tasks.workunit.client.1.smithi134.stdout:2/242: dread f6 [0,4194304] 0 2023-12-05T09:26:11.980 INFO:tasks.workunit.client.1.smithi134.stdout:2/243: readlink d19/d3a/l42 0 2023-12-05T09:26:11.980 INFO:tasks.workunit.client.1.smithi134.stdout:5/203: dwrite d0/d1a/d3a/f3b [0,4194304] 0 2023-12-05T09:26:11.982 INFO:tasks.workunit.client.0.smithi067.stdout:2/116: rmdir d0/d15 39 2023-12-05T09:26:11.982 INFO:tasks.workunit.client.0.smithi067.stdout:2/117: fsync d0/fe 0 2023-12-05T09:26:11.982 INFO:tasks.workunit.client.0.smithi067.stdout:2/118: chown d0/d10/c12 866 1 2023-12-05T09:26:11.982 INFO:tasks.workunit.client.0.smithi067.stdout:4/111: write d0/fc [2043849,55911] 0 2023-12-05T09:26:11.982 INFO:tasks.workunit.client.0.smithi067.stdout:2/119: fsync d0/d10/f1d 0 2023-12-05T09:26:11.982 INFO:tasks.workunit.client.0.smithi067.stdout:2/120: dread - d0/d15/f1b zero size 2023-12-05T09:26:11.982 INFO:tasks.workunit.client.0.smithi067.stdout:4/112: write d0/d1d/f21 [678055,119923] 0 2023-12-05T09:26:11.983 INFO:tasks.workunit.client.0.smithi067.stdout:9/307: dwrite d1b/f24 [0,4194304] 0 2023-12-05T09:26:11.983 INFO:tasks.workunit.client.0.smithi067.stdout:9/308: chown d1b/d25/d35/l4e 65597400 1 2023-12-05T09:26:11.983 INFO:tasks.workunit.client.0.smithi067.stdout:9/309: dread - d1b/d25/d35/f5e zero size 2023-12-05T09:26:11.983 INFO:tasks.workunit.client.0.smithi067.stdout:9/310: read - d1b/d3e/f53 zero size 2023-12-05T09:26:11.983 INFO:tasks.workunit.client.0.smithi067.stdout:9/311: creat d1b/d3e/f66 x:0 0 0 2023-12-05T09:26:11.983 INFO:tasks.workunit.client.0.smithi067.stdout:9/312: creat d1b/d3e/f67 x:0 0 0 2023-12-05T09:26:11.984 INFO:tasks.workunit.client.0.smithi067.stdout:9/313: chown d1b/d25/c37 690971955 1 2023-12-05T09:26:11.984 INFO:tasks.workunit.client.0.smithi067.stdout:9/314: creat d1b/d25/d35/d56/f68 x:0 0 0 2023-12-05T09:26:11.984 INFO:tasks.workunit.client.0.smithi067.stdout:7/198: mknod d0/d9/d10/c41 0 2023-12-05T09:26:11.986 INFO:tasks.workunit.client.1.smithi134.stdout:8/271: dwrite da/f3e [0,4194304] 0 2023-12-05T09:26:11.986 INFO:tasks.workunit.client.1.smithi134.stdout:8/272: fdatasync da/de/f4c 0 2023-12-05T09:26:11.987 INFO:tasks.workunit.client.1.smithi134.stdout:8/273: truncate da/f29 2742598 0 2023-12-05T09:26:11.993 INFO:tasks.workunit.client.0.smithi067.stdout:8/162: rename d5/c8 to d5/c2b 0 2023-12-05T09:26:11.993 INFO:tasks.workunit.client.0.smithi067.stdout:5/158: dwrite db/df/d1a/d1d/d20/f2d [0,4194304] 0 2023-12-05T09:26:11.994 INFO:tasks.workunit.client.1.smithi134.stdout:1/264: dread d2/d9/f57 [0,4194304] 0 2023-12-05T09:26:11.996 INFO:tasks.workunit.client.1.smithi134.stdout:3/231: rmdir d4/d1f 39 2023-12-05T09:26:11.997 INFO:tasks.workunit.client.1.smithi134.stdout:9/193: dwrite d7/d8/d2e/f42 [0,4194304] 0 2023-12-05T09:26:12.006 INFO:tasks.workunit.client.0.smithi067.stdout:2/121: dread d0/d10/f19 [0,4194304] 0 2023-12-05T09:26:12.006 INFO:tasks.workunit.client.0.smithi067.stdout:2/122: chown d0/c5 1013 1 2023-12-05T09:26:12.007 INFO:tasks.workunit.client.0.smithi067.stdout:2/123: fsync d0/d10/f19 0 2023-12-05T09:26:12.007 INFO:tasks.workunit.client.1.smithi134.stdout:8/274: rename da/c18 to da/de/d16/d33/c5a 0 2023-12-05T09:26:12.010 INFO:tasks.workunit.client.0.smithi067.stdout:9/315: creat d1b/d25/d54/d5c/f69 x:0 0 0 2023-12-05T09:26:12.010 INFO:tasks.workunit.client.0.smithi067.stdout:7/199: creat d0/f42 x:0 0 0 2023-12-05T09:26:12.010 INFO:tasks.workunit.client.0.smithi067.stdout:9/316: fdatasync f19 0 2023-12-05T09:26:12.015 INFO:tasks.workunit.client.0.smithi067.stdout:9/317: mkdir d1b/d25/d54/d5c/d6a 0 2023-12-05T09:26:12.017 INFO:tasks.workunit.client.1.smithi134.stdout:3/232: mknod d4/d3f/d42/c4b 0 2023-12-05T09:26:12.029 INFO:tasks.workunit.client.1.smithi134.stdout:5/204: dread d0/f19 [4194304,4194304] 0 2023-12-05T09:26:12.030 INFO:tasks.workunit.client.1.smithi134.stdout:3/233: dread d4/d5/f1e [0,4194304] 0 2023-12-05T09:26:12.035 INFO:tasks.workunit.client.0.smithi067.stdout:3/92: dwrite f0 [0,4194304] 0 2023-12-05T09:26:12.041 INFO:tasks.workunit.client.0.smithi067.stdout:0/229: dwrite d3/df/f36 [0,4194304] 0 2023-12-05T09:26:12.041 INFO:tasks.workunit.client.0.smithi067.stdout:0/230: creat d3/df/f52 x:0 0 0 2023-12-05T09:26:12.042 INFO:tasks.workunit.client.1.smithi134.stdout:7/209: sync 2023-12-05T09:26:12.042 INFO:tasks.workunit.client.1.smithi134.stdout:6/204: dwrite d4/d2a/d3a/f36 [0,4194304] 0 2023-12-05T09:26:12.043 INFO:tasks.workunit.client.1.smithi134.stdout:5/205: creat d0/d1a/d3a/f47 x:0 0 0 2023-12-05T09:26:12.044 INFO:tasks.workunit.client.1.smithi134.stdout:5/206: write d0/f7 [2297142,88267] 0 2023-12-05T09:26:12.044 INFO:tasks.workunit.client.1.smithi134.stdout:5/207: chown d0/c40 958229 1 2023-12-05T09:26:12.044 INFO:tasks.workunit.client.1.smithi134.stdout:3/234: mknod d4/d5/d45/c4c 0 2023-12-05T09:26:12.045 INFO:tasks.workunit.client.1.smithi134.stdout:3/235: chown d4/d3f 1473622 1 2023-12-05T09:26:12.052 INFO:tasks.workunit.client.0.smithi067.stdout:0/231: read d3/f3b [41304,34369] 0 2023-12-05T09:26:12.053 INFO:tasks.workunit.client.1.smithi134.stdout:1/265: write d2/d9/d10/f5a [1737203,11058] 0 2023-12-05T09:26:12.053 INFO:tasks.workunit.client.1.smithi134.stdout:1/266: chown d2/d9/d10/c2f 534520 1 2023-12-05T09:26:12.053 INFO:tasks.workunit.client.1.smithi134.stdout:1/267: chown d2/l52 51435 1 2023-12-05T09:26:12.055 INFO:tasks.workunit.client.1.smithi134.stdout:2/244: dwrite fd [0,4194304] 0 2023-12-05T09:26:12.056 INFO:tasks.workunit.client.1.smithi134.stdout:2/245: creat d19/d3a/f52 x:0 0 0 2023-12-05T09:26:12.059 INFO:tasks.workunit.client.0.smithi067.stdout:8/163: dwrite d5/f28 [0,4194304] 0 2023-12-05T09:26:12.060 INFO:tasks.workunit.client.0.smithi067.stdout:9/318: getdents d1b/d3e 0 2023-12-05T09:26:12.065 INFO:tasks.workunit.client.0.smithi067.stdout:8/164: mknod d5/dc/d1a/c2c 0 2023-12-05T09:26:12.065 INFO:tasks.workunit.client.0.smithi067.stdout:8/165: dread - d5/dc/f29 zero size 2023-12-05T09:26:12.068 INFO:tasks.workunit.client.1.smithi134.stdout:7/210: rename d2/d7/d25/d26/f20 to d2/d7/dc/d2e/d3a/f46 0 2023-12-05T09:26:12.068 INFO:tasks.workunit.client.1.smithi134.stdout:5/208: symlink d0/d1a/d1c/l48 0 2023-12-05T09:26:12.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/268: mkdir d2/d9/d10/d5b/d5e 0 2023-12-05T09:26:12.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/269: creat d2/d27/f5f x:0 0 0 2023-12-05T09:26:12.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/319: truncate d1b/f3b 2384539 0 2023-12-05T09:26:12.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/320: chown d1b/d3e/f66 7 1 2023-12-05T09:26:12.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/321: write d1b/d3e/f66 [315373,108754] 0 2023-12-05T09:26:12.071 INFO:tasks.workunit.client.0.smithi067.stdout:9/322: dread - d1b/d25/d5b/d62/f63 zero size 2023-12-05T09:26:12.074 INFO:tasks.workunit.client.1.smithi134.stdout:9/194: dwrite d7/d8/d16/f33 [0,4194304] 0 2023-12-05T09:26:12.074 INFO:tasks.workunit.client.1.smithi134.stdout:9/195: fdatasync d7/d8/d14/d26/f3e 0 2023-12-05T09:26:12.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/246: link d19/l21 d19/d28/l53 0 2023-12-05T09:26:12.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/247: fdatasync fd 0 2023-12-05T09:26:12.080 INFO:tasks.workunit.client.1.smithi134.stdout:6/205: rename d4/d39/l1d to d4/d2a/d3a/da/d1b/l3b 0 2023-12-05T09:26:12.081 INFO:tasks.workunit.client.0.smithi067.stdout:9/323: symlink d1b/d25/d5b/l6b 0 2023-12-05T09:26:12.081 INFO:tasks.workunit.client.0.smithi067.stdout:9/324: fsync d1b/f5f 0 2023-12-05T09:26:12.084 INFO:tasks.workunit.client.0.smithi067.stdout:4/113: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:26:12.087 INFO:tasks.workunit.client.0.smithi067.stdout:2/124: dwrite d0/d15/f1b [0,4194304] 0 2023-12-05T09:26:12.089 INFO:tasks.workunit.client.0.smithi067.stdout:9/325: mkdir d1b/d25/d54/d5c/d6a/d6c 0 2023-12-05T09:26:12.089 INFO:tasks.workunit.client.0.smithi067.stdout:5/159: dwrite db/df/d1a/d1d/d20/f2c [0,4194304] 0 2023-12-05T09:26:12.091 INFO:tasks.workunit.client.1.smithi134.stdout:8/275: dwrite da/de/f48 [0,4194304] 0 2023-12-05T09:26:12.091 INFO:tasks.workunit.client.1.smithi134.stdout:8/276: write da/de/f1c [433813,38268] 0 2023-12-05T09:26:12.092 INFO:tasks.workunit.client.1.smithi134.stdout:8/277: chown da/de/l3c 994365 1 2023-12-05T09:26:12.092 INFO:tasks.workunit.client.1.smithi134.stdout:5/209: unlink d0/f2 0 2023-12-05T09:26:12.092 INFO:tasks.workunit.client.1.smithi134.stdout:5/210: creat d0/d1a/d3a/f49 x:0 0 0 2023-12-05T09:26:12.092 INFO:tasks.workunit.client.1.smithi134.stdout:6/206: creat d4/d2a/d3a/f3c x:0 0 0 2023-12-05T09:26:12.092 INFO:tasks.workunit.client.1.smithi134.stdout:6/207: fdatasync d4/d39/f1f 0 2023-12-05T09:26:12.092 INFO:tasks.workunit.client.1.smithi134.stdout:2/248: mknod d19/d28/d31/d38/c54 0 2023-12-05T09:26:12.092 INFO:tasks.workunit.client.1.smithi134.stdout:2/249: chown f1 5359 1 2023-12-05T09:26:12.092 INFO:tasks.workunit.client.1.smithi134.stdout:6/208: write d4/d2a/d3a/da/d1b/f29 [1768149,122548] 0 2023-12-05T09:26:12.093 INFO:tasks.workunit.client.1.smithi134.stdout:7/211: dread d2/d7/dc/d2e/d3a/f46 [0,4194304] 0 2023-12-05T09:26:12.094 INFO:tasks.workunit.client.1.smithi134.stdout:8/278: creat da/d1b/d42/f5b x:0 0 0 2023-12-05T09:26:12.095 INFO:tasks.workunit.client.0.smithi067.stdout:4/114: mkdir d0/d1d/d24 0 2023-12-05T09:26:12.097 INFO:tasks.workunit.client.1.smithi134.stdout:5/211: symlink d0/d1a/d1c/d3f/l4a 0 2023-12-05T09:26:12.098 INFO:tasks.workunit.client.1.smithi134.stdout:5/212: chown d0/dd/f2c 10673 1 2023-12-05T09:26:12.098 INFO:tasks.workunit.client.0.smithi067.stdout:8/166: write d5/f1c [52948,11678] 0 2023-12-05T09:26:12.101 INFO:tasks.workunit.client.0.smithi067.stdout:8/167: chown d5/dc/f19 9108 1 2023-12-05T09:26:12.101 INFO:tasks.workunit.client.0.smithi067.stdout:8/168: chown d5/dc/d1a/c2c 6135816 1 2023-12-05T09:26:12.101 INFO:tasks.workunit.client.0.smithi067.stdout:2/125: mkdir d0/d10/d1e/d29 0 2023-12-05T09:26:12.101 INFO:tasks.workunit.client.0.smithi067.stdout:2/126: chown d0/fd 1012 1 2023-12-05T09:26:12.101 INFO:tasks.workunit.client.1.smithi134.stdout:2/250: truncate d19/d28/f30 555333 0 2023-12-05T09:26:12.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/209: rename d4/d39/f1f to d4/d2a/d3a/f3d 0 2023-12-05T09:26:12.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/210: readlink d4/d2a/d3a/l1e 0 2023-12-05T09:26:12.103 INFO:tasks.workunit.client.0.smithi067.stdout:4/115: mkdir d0/d1d/d25 0 2023-12-05T09:26:12.104 INFO:tasks.workunit.client.0.smithi067.stdout:2/127: creat d0/d15/f2a x:0 0 0 2023-12-05T09:26:12.105 INFO:tasks.workunit.client.1.smithi134.stdout:7/212: creat d2/dd/f47 x:0 0 0 2023-12-05T09:26:12.106 INFO:tasks.workunit.client.0.smithi067.stdout:4/116: mknod d0/d9/d12/d15/c26 0 2023-12-05T09:26:12.106 INFO:tasks.workunit.client.1.smithi134.stdout:8/279: mknod da/de/d16/d2d/c5c 0 2023-12-05T09:26:12.106 INFO:tasks.workunit.client.1.smithi134.stdout:8/280: fsync da/de/d16/f26 0 2023-12-05T09:26:12.106 INFO:tasks.workunit.client.1.smithi134.stdout:8/281: creat da/de/d43/f5d x:0 0 0 2023-12-05T09:26:12.107 INFO:tasks.workunit.client.1.smithi134.stdout:2/251: mknod d19/c55 0 2023-12-05T09:26:12.109 INFO:tasks.workunit.client.1.smithi134.stdout:5/213: rename d0/dd/c3d to d0/d1a/d1c/d3f/c4b 0 2023-12-05T09:26:12.109 INFO:tasks.workunit.client.1.smithi134.stdout:6/211: rmdir d4/d39 39 2023-12-05T09:26:12.110 INFO:tasks.workunit.client.1.smithi134.stdout:5/214: read d0/d11/f1b [3219,66423] 0 2023-12-05T09:26:12.111 INFO:tasks.workunit.client.0.smithi067.stdout:2/128: mknod d0/d25/c2b 0 2023-12-05T09:26:12.111 INFO:tasks.workunit.client.0.smithi067.stdout:5/160: write f6 [2405011,102630] 0 2023-12-05T09:26:12.112 INFO:tasks.workunit.client.0.smithi067.stdout:4/117: link d0/d9/d12/c1a d0/d1d/d24/c27 0 2023-12-05T09:26:12.112 INFO:tasks.workunit.client.0.smithi067.stdout:4/118: chown d0/d9/dd/f16 1 1 2023-12-05T09:26:12.112 INFO:tasks.workunit.client.0.smithi067.stdout:5/161: readlink db/df/l19 0 2023-12-05T09:26:12.113 INFO:tasks.workunit.client.1.smithi134.stdout:6/212: unlink d4/fd 0 2023-12-05T09:26:12.113 INFO:tasks.workunit.client.1.smithi134.stdout:6/213: readlink d4/d2a/d3a/l1e 0 2023-12-05T09:26:12.114 INFO:tasks.workunit.client.0.smithi067.stdout:4/119: symlink d0/d9/dd/l28 0 2023-12-05T09:26:12.115 INFO:tasks.workunit.client.1.smithi134.stdout:5/215: rename d0/d1a/l35 to d0/dd/l4c 0 2023-12-05T09:26:12.118 INFO:tasks.workunit.client.1.smithi134.stdout:6/214: creat d4/d39/f3e x:0 0 0 2023-12-05T09:26:12.118 INFO:tasks.workunit.client.1.smithi134.stdout:6/215: rename d4/d2a/d3a to d4/d2a/d3a/da/d1b/d3f 22 2023-12-05T09:26:12.123 INFO:tasks.workunit.client.0.smithi067.stdout:0/232: dwrite d3/df/d10/f1f [0,4194304] 0 2023-12-05T09:26:12.124 INFO:tasks.workunit.client.0.smithi067.stdout:0/233: creat d3/d38/f53 x:0 0 0 2023-12-05T09:26:12.125 INFO:tasks.workunit.client.1.smithi134.stdout:0/199: sync 2023-12-05T09:26:12.125 INFO:tasks.workunit.client.1.smithi134.stdout:4/231: sync 2023-12-05T09:26:12.125 INFO:tasks.workunit.client.1.smithi134.stdout:4/232: chown ff 389533282 1 2023-12-05T09:26:12.125 INFO:tasks.workunit.client.1.smithi134.stdout:0/200: chown d13/d14/d15 87458 1 2023-12-05T09:26:12.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:12 smithi067 ceph-mon[107174]: pgmap v21: 65 pgs: 65 active+clean; 364 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 8.7 MiB/s rd, 20 MiB/s wr, 728 op/s 2023-12-05T09:26:12.129 INFO:tasks.workunit.client.0.smithi067.stdout:9/326: write d1b/d25/d35/f43 [1131243,119457] 0 2023-12-05T09:26:12.129 INFO:tasks.workunit.client.0.smithi067.stdout:9/327: fdatasync d1b/f51 0 2023-12-05T09:26:12.129 INFO:tasks.workunit.client.0.smithi067.stdout:9/328: creat d1b/d25/f6d x:0 0 0 2023-12-05T09:26:12.131 INFO:tasks.workunit.client.1.smithi134.stdout:4/233: rename d16/d18/d1b/d24/f25 to d16/d21/d50/f51 0 2023-12-05T09:26:12.131 INFO:tasks.workunit.client.1.smithi134.stdout:4/234: chown ff 17 1 2023-12-05T09:26:12.134 INFO:tasks.workunit.client.1.smithi134.stdout:4/235: mknod d16/d21/d47/d4b/c52 0 2023-12-05T09:26:12.136 INFO:tasks.workunit.client.1.smithi134.stdout:4/236: mknod d16/d21/d50/c53 0 2023-12-05T09:26:12.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/270: dread d2/d27/f3a [0,4194304] 0 2023-12-05T09:26:12.144 INFO:tasks.workunit.client.1.smithi134.stdout:4/237: rename c12 to d16/d18/d1c/c54 0 2023-12-05T09:26:12.144 INFO:tasks.workunit.client.1.smithi134.stdout:4/238: dread - d16/d18/d1a/f3e zero size 2023-12-05T09:26:12.144 INFO:tasks.workunit.client.1.smithi134.stdout:1/271: mknod d2/c60 0 2023-12-05T09:26:12.144 INFO:tasks.workunit.client.1.smithi134.stdout:1/272: dread - d2/d27/f5f zero size 2023-12-05T09:26:12.147 INFO:tasks.workunit.client.1.smithi134.stdout:4/239: truncate d16/d21/d50/f51 993923 0 2023-12-05T09:26:12.147 INFO:tasks.workunit.client.1.smithi134.stdout:4/240: readlink d16/d21/l33 0 2023-12-05T09:26:12.147 INFO:tasks.workunit.client.1.smithi134.stdout:4/241: rename d16 to d16/d18/d1a/d3b/d55 22 2023-12-05T09:26:12.149 INFO:tasks.workunit.client.1.smithi134.stdout:4/242: link l10 d16/d18/d1a/d3b/l56 0 2023-12-05T09:26:12.159 INFO:tasks.workunit.client.0.smithi067.stdout:0/234: rename d3/df/d10/c4b to d3/d7/c54 0 2023-12-05T09:26:12.159 INFO:tasks.workunit.client.1.smithi134.stdout:3/236: dwrite d4/d5/f10 [0,4194304] 0 2023-12-05T09:26:12.160 INFO:tasks.workunit.client.1.smithi134.stdout:3/237: dread - d4/f12 zero size 2023-12-05T09:26:12.160 INFO:tasks.workunit.client.0.smithi067.stdout:4/120: getdents d0/d9/dd 0 2023-12-05T09:26:12.162 INFO:tasks.workunit.client.0.smithi067.stdout:0/235: creat d3/d7/d30/f55 x:0 0 0 2023-12-05T09:26:12.163 INFO:tasks.workunit.client.0.smithi067.stdout:0/236: fdatasync d3/df/f3f 0 2023-12-05T09:26:12.163 INFO:tasks.workunit.client.0.smithi067.stdout:4/121: creat d0/d1d/d25/f29 x:0 0 0 2023-12-05T09:26:12.167 INFO:tasks.workunit.client.0.smithi067.stdout:7/200: dwrite d0/d9/f2c [4194304,4194304] 0 2023-12-05T09:26:12.167 INFO:tasks.workunit.client.0.smithi067.stdout:7/201: chown d0/d9/d10/d37/f28 66930413 1 2023-12-05T09:26:12.169 INFO:tasks.workunit.client.1.smithi134.stdout:1/273: dread d2/f6 [0,4194304] 0 2023-12-05T09:26:12.169 INFO:tasks.workunit.client.1.smithi134.stdout:1/274: getdents d2/d9/d10/d5b/d5e 0 2023-12-05T09:26:12.171 INFO:tasks.workunit.client.0.smithi067.stdout:0/237: mknod d3/df/d10/c56 0 2023-12-05T09:26:12.185 INFO:tasks.workunit.client.1.smithi134.stdout:3/238: creat d4/d5/d45/f4d x:0 0 0 2023-12-05T09:26:12.185 INFO:tasks.workunit.client.1.smithi134.stdout:3/239: chown d4/d1f/f35 19 1 2023-12-05T09:26:12.187 INFO:tasks.workunit.client.1.smithi134.stdout:1/275: link d2/d27/l33 d2/d9/d10/l61 0 2023-12-05T09:26:12.190 INFO:tasks.workunit.client.0.smithi067.stdout:0/238: mkdir d3/d7/d3c/d57 0 2023-12-05T09:26:12.191 INFO:tasks.workunit.client.0.smithi067.stdout:3/93: dwrite d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:12.191 INFO:tasks.workunit.client.0.smithi067.stdout:3/94: chown d9/da/d15 158600 1 2023-12-05T09:26:12.191 INFO:tasks.workunit.client.0.smithi067.stdout:3/95: stat d9/da/f19 0 2023-12-05T09:26:12.192 INFO:tasks.workunit.client.0.smithi067.stdout:3/96: fdatasync f4 0 2023-12-05T09:26:12.192 INFO:tasks.workunit.client.0.smithi067.stdout:3/97: truncate d9/f14 545038 0 2023-12-05T09:26:12.196 INFO:tasks.workunit.client.0.smithi067.stdout:0/239: link d3/d7/f29 d3/f58 0 2023-12-05T09:26:12.196 INFO:tasks.workunit.client.0.smithi067.stdout:0/240: dread - d3/f3d zero size 2023-12-05T09:26:12.196 INFO:tasks.workunit.client.0.smithi067.stdout:3/98: creat d9/da/d15/d17/d1a/f1d x:0 0 0 2023-12-05T09:26:12.197 INFO:tasks.workunit.client.1.smithi134.stdout:3/240: mkdir d4/d1f/d4e 0 2023-12-05T09:26:12.199 INFO:tasks.workunit.client.1.smithi134.stdout:0/201: dread fd [0,4194304] 0 2023-12-05T09:26:12.201 INFO:tasks.workunit.client.1.smithi134.stdout:1/276: dread d2/d9/f2c [0,4194304] 0 2023-12-05T09:26:12.204 INFO:tasks.workunit.client.1.smithi134.stdout:7/213: dwrite d2/dd/d1a/f45 [0,4194304] 0 2023-12-05T09:26:12.205 INFO:tasks.workunit.client.0.smithi067.stdout:0/241: rename d3/d38 to d3/d7/d3c/d49/d59 0 2023-12-05T09:26:12.205 INFO:tasks.workunit.client.0.smithi067.stdout:0/242: dread - d3/f4d zero size 2023-12-05T09:26:12.205 INFO:tasks.workunit.client.0.smithi067.stdout:0/243: chown d3/d7/d30/l45 371043 1 2023-12-05T09:26:12.207 INFO:tasks.workunit.client.1.smithi134.stdout:3/241: unlink d4/d3f/d42/f2e 0 2023-12-05T09:26:12.207 INFO:tasks.workunit.client.1.smithi134.stdout:1/277: truncate d2/d9/d10/f1d 2675284 0 2023-12-05T09:26:12.210 INFO:tasks.workunit.client.0.smithi067.stdout:7/202: dread d0/d9/f30 [0,4194304] 0 2023-12-05T09:26:12.212 INFO:tasks.workunit.client.1.smithi134.stdout:2/252: dwrite fa [0,4194304] 0 2023-12-05T09:26:12.213 INFO:tasks.workunit.client.1.smithi134.stdout:3/242: write d4/f38 [412392,26273] 0 2023-12-05T09:26:12.214 INFO:tasks.workunit.client.1.smithi134.stdout:3/243: fdatasync d4/f12 0 2023-12-05T09:26:12.214 INFO:tasks.workunit.client.1.smithi134.stdout:2/253: creat d19/d49/f56 x:0 0 0 2023-12-05T09:26:12.214 INFO:tasks.workunit.client.1.smithi134.stdout:2/254: write d19/d28/d31/d38/f48 [496760,10264] 0 2023-12-05T09:26:12.215 INFO:tasks.workunit.client.1.smithi134.stdout:2/255: write d19/f25 [3956876,52528] 0 2023-12-05T09:26:12.230 INFO:tasks.workunit.client.1.smithi134.stdout:7/214: write f1 [1225132,24139] 0 2023-12-05T09:26:12.230 INFO:tasks.workunit.client.1.smithi134.stdout:7/215: rmdir d2/d7/d2b/d2d 39 2023-12-05T09:26:12.234 INFO:tasks.workunit.client.0.smithi067.stdout:8/169: dwrite d5/dc/d1a/d20/f22 [0,4194304] 0 2023-12-05T09:26:12.235 INFO:tasks.workunit.client.0.smithi067.stdout:0/244: write d3/df/d10/f1f [845243,99630] 0 2023-12-05T09:26:12.235 INFO:tasks.workunit.client.0.smithi067.stdout:5/162: dwrite db/df/d1a/d1d/d20/f2a [0,4194304] 0 2023-12-05T09:26:12.235 INFO:tasks.workunit.client.1.smithi134.stdout:7/216: link d2/df/l1e d2/d7/d25/d26/l48 0 2023-12-05T09:26:12.235 INFO:tasks.workunit.client.1.smithi134.stdout:0/202: dread d13/d1f/d23/f27 [0,4194304] 0 2023-12-05T09:26:12.236 INFO:tasks.workunit.client.1.smithi134.stdout:5/216: dwrite d0/d1a/d1c/f23 [0,4194304] 0 2023-12-05T09:26:12.236 INFO:tasks.workunit.client.0.smithi067.stdout:5/163: truncate db/df/d1a/d1d/d20/f2c 260195 0 2023-12-05T09:26:12.238 INFO:tasks.workunit.client.0.smithi067.stdout:5/164: mknod db/df/d1a/d1d/d20/c39 0 2023-12-05T09:26:12.239 INFO:tasks.workunit.client.1.smithi134.stdout:8/282: dwrite da/de/d43/f46 [4194304,4194304] 0 2023-12-05T09:26:12.242 INFO:tasks.workunit.client.1.smithi134.stdout:0/203: getdents d13/d14/d15 0 2023-12-05T09:26:12.243 INFO:tasks.workunit.client.1.smithi134.stdout:0/204: dread - d13/d14/d30/f32 zero size 2023-12-05T09:26:12.243 INFO:tasks.workunit.client.0.smithi067.stdout:4/122: truncate d0/fc 3183103 0 2023-12-05T09:26:12.244 INFO:tasks.workunit.client.0.smithi067.stdout:2/129: dwrite d0/fd [0,4194304] 0 2023-12-05T09:26:12.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/130: rmdir d0/d10/d1e/d29 0 2023-12-05T09:26:12.252 INFO:tasks.workunit.client.0.smithi067.stdout:9/329: dwrite d1b/d25/d35/f4f [0,4194304] 0 2023-12-05T09:26:12.252 INFO:tasks.workunit.client.0.smithi067.stdout:9/330: chown f19 7705347 1 2023-12-05T09:26:12.256 INFO:tasks.workunit.client.1.smithi134.stdout:5/217: mkdir d0/d1a/d1c/d25/d4d 0 2023-12-05T09:26:12.270 INFO:tasks.workunit.client.0.smithi067.stdout:5/165: dread db/df/f12 [0,4194304] 0 2023-12-05T09:26:12.270 INFO:tasks.workunit.client.1.smithi134.stdout:4/243: dwrite f5 [0,4194304] 0 2023-12-05T09:26:12.270 INFO:tasks.workunit.client.1.smithi134.stdout:4/244: write d16/d18/d1a/f3e [865070,70594] 0 2023-12-05T09:26:12.287 INFO:tasks.workunit.client.1.smithi134.stdout:8/283: getdents da/de/d16 0 2023-12-05T09:26:12.287 INFO:tasks.workunit.client.1.smithi134.stdout:8/284: dread - da/de/d43/f5d zero size 2023-12-05T09:26:12.288 INFO:tasks.workunit.client.1.smithi134.stdout:8/285: creat da/de/d16/d2d/f5e x:0 0 0 2023-12-05T09:26:12.294 INFO:tasks.workunit.client.0.smithi067.stdout:3/99: dwrite d9/da/d15/d17/d1a/f1d [0,4194304] 0 2023-12-05T09:26:12.333 INFO:tasks.workunit.client.0.smithi067.stdout:8/170: dwrite d5/da/f17 [0,4194304] 0 2023-12-05T09:26:12.338 INFO:tasks.workunit.client.1.smithi134.stdout:3/244: dwrite d4/d3f/d42/f30 [0,4194304] 0 2023-12-05T09:26:12.339 INFO:tasks.workunit.client.0.smithi067.stdout:7/203: dwrite d0/f6 [0,4194304] 0 2023-12-05T09:26:12.342 INFO:tasks.workunit.client.1.smithi134.stdout:2/256: dread f6 [4194304,4194304] 0 2023-12-05T09:26:12.342 INFO:tasks.workunit.client.1.smithi134.stdout:2/257: chown d19/d3a/f45 406926 1 2023-12-05T09:26:12.345 INFO:tasks.workunit.client.1.smithi134.stdout:0/205: mknod d13/d1f/c3c 0 2023-12-05T09:26:12.345 INFO:tasks.workunit.client.1.smithi134.stdout:0/206: chown c11 20873948 1 2023-12-05T09:26:12.345 INFO:tasks.workunit.client.1.smithi134.stdout:0/207: chown fa 823 1 2023-12-05T09:26:12.345 INFO:tasks.workunit.client.1.smithi134.stdout:0/208: dread - d13/d14/d30/f32 zero size 2023-12-05T09:26:12.345 INFO:tasks.workunit.client.1.smithi134.stdout:0/209: fdatasync d13/f38 0 2023-12-05T09:26:12.346 INFO:tasks.workunit.client.0.smithi067.stdout:0/245: dwrite d3/fb [0,4194304] 0 2023-12-05T09:26:12.353 INFO:tasks.workunit.client.1.smithi134.stdout:8/286: mkdir da/de/d11/d1d/d5f 0 2023-12-05T09:26:12.354 INFO:tasks.workunit.client.1.smithi134.stdout:7/217: dwrite d2/d7/dc/f31 [0,4194304] 0 2023-12-05T09:26:12.354 INFO:tasks.workunit.client.1.smithi134.stdout:7/218: dread - d2/d7/d25/d26/f35 zero size 2023-12-05T09:26:12.354 INFO:tasks.workunit.client.1.smithi134.stdout:8/287: write da/de/d11/d1d/f2e [1323685,44487] 0 2023-12-05T09:26:12.354 INFO:tasks.workunit.client.1.smithi134.stdout:7/219: chown d2/d7/dc/d22/f3d 10853414 1 2023-12-05T09:26:12.359 INFO:tasks.workunit.client.1.smithi134.stdout:3/245: rmdir d4/d5 39 2023-12-05T09:26:12.361 INFO:tasks.workunit.client.1.smithi134.stdout:2/258: getdents d19/d28/d31 0 2023-12-05T09:26:12.361 INFO:tasks.workunit.client.1.smithi134.stdout:2/259: readlink d19/d3f/l4c 0 2023-12-05T09:26:12.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/260: creat d19/d28/d2b/f57 x:0 0 0 2023-12-05T09:26:12.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/261: write d19/d28/f4e [925301,48920] 0 2023-12-05T09:26:12.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/262: chown d19/d28/d2b/f57 52 1 2023-12-05T09:26:12.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/263: chown d19/d49 8268659 1 2023-12-05T09:26:12.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/264: chown d19/d28/f2a 10726215 1 2023-12-05T09:26:12.363 INFO:tasks.workunit.client.1.smithi134.stdout:4/245: dwrite ff [0,4194304] 0 2023-12-05T09:26:12.363 INFO:tasks.workunit.client.1.smithi134.stdout:4/246: creat d16/d21/f57 x:0 0 0 2023-12-05T09:26:12.364 INFO:tasks.workunit.client.1.smithi134.stdout:0/210: link d13/d14/d15/f37 d13/d14/f3d 0 2023-12-05T09:26:12.365 INFO:tasks.workunit.client.1.smithi134.stdout:0/211: fdatasync d13/d14/d30/d2c/f34 0 2023-12-05T09:26:12.367 INFO:tasks.workunit.client.1.smithi134.stdout:8/288: symlink da/d1b/d42/l60 0 2023-12-05T09:26:12.368 INFO:tasks.workunit.client.1.smithi134.stdout:7/220: write d2/d7/dc/d22/f3d [1883088,52130] 0 2023-12-05T09:26:12.368 INFO:tasks.workunit.client.0.smithi067.stdout:4/123: dwrite d0/fa [0,4194304] 0 2023-12-05T09:26:12.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/216: sync 2023-12-05T09:26:12.372 INFO:tasks.workunit.client.1.smithi134.stdout:9/196: sync 2023-12-05T09:26:12.377 INFO:tasks.workunit.client.1.smithi134.stdout:4/247: creat d16/d21/d48/f58 x:0 0 0 2023-12-05T09:26:12.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:12 smithi134 ceph-mon[116304]: pgmap v21: 65 pgs: 65 active+clean; 364 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 8.7 MiB/s rd, 20 MiB/s wr, 728 op/s 2023-12-05T09:26:12.379 INFO:tasks.workunit.client.1.smithi134.stdout:0/212: creat d13/d14/d15/d2a/f3e x:0 0 0 2023-12-05T09:26:12.381 INFO:tasks.workunit.client.1.smithi134.stdout:8/289: link f9 da/de/d16/d45/f61 0 2023-12-05T09:26:12.381 INFO:tasks.workunit.client.1.smithi134.stdout:1/278: sync 2023-12-05T09:26:12.382 INFO:tasks.workunit.client.1.smithi134.stdout:1/279: fsync d2/d9/f2d 0 2023-12-05T09:26:12.386 INFO:tasks.workunit.client.1.smithi134.stdout:7/221: rename d2/df/f14 to d2/d7/dc/d2e/d3a/f49 0 2023-12-05T09:26:12.386 INFO:tasks.workunit.client.1.smithi134.stdout:0/213: rename d13/d14/d15 to d13/d14/d15/d2a/d3f 22 2023-12-05T09:26:12.386 INFO:tasks.workunit.client.1.smithi134.stdout:0/214: dread - d13/d14/d30/f3b zero size 2023-12-05T09:26:12.386 INFO:tasks.workunit.client.1.smithi134.stdout:0/215: readlink d13/d1f/l33 0 2023-12-05T09:26:12.386 INFO:tasks.workunit.client.1.smithi134.stdout:0/216: fdatasync f3 0 2023-12-05T09:26:12.386 INFO:tasks.workunit.client.1.smithi134.stdout:7/222: creat d2/d7/dc/d22/f4a x:0 0 0 2023-12-05T09:26:12.386 INFO:tasks.workunit.client.1.smithi134.stdout:9/197: mknod d7/d10/c44 0 2023-12-05T09:26:12.389 INFO:tasks.workunit.client.1.smithi134.stdout:6/217: unlink d4/d2a/d3a/da/c10 0 2023-12-05T09:26:12.392 INFO:tasks.workunit.client.1.smithi134.stdout:8/290: link da/de/d11/d1d/l1f da/d1b/d42/l62 0 2023-12-05T09:26:12.395 INFO:tasks.workunit.client.1.smithi134.stdout:4/248: dread f13 [0,4194304] 0 2023-12-05T09:26:12.395 INFO:tasks.workunit.client.1.smithi134.stdout:4/249: readlink d16/d18/d1c/l1f 0 2023-12-05T09:26:12.397 INFO:tasks.workunit.client.1.smithi134.stdout:5/218: sync 2023-12-05T09:26:12.397 INFO:tasks.workunit.client.1.smithi134.stdout:0/217: creat d13/d14/d15/f40 x:0 0 0 2023-12-05T09:26:12.400 INFO:tasks.workunit.client.1.smithi134.stdout:7/223: symlink d2/dd/d1a/l4b 0 2023-12-05T09:26:12.400 INFO:tasks.workunit.client.1.smithi134.stdout:7/224: stat d2/d7/dc/d2e/f3e 0 2023-12-05T09:26:12.400 INFO:tasks.workunit.client.1.smithi134.stdout:9/198: symlink d7/d10/l45 0 2023-12-05T09:26:12.400 INFO:tasks.workunit.client.1.smithi134.stdout:6/218: chown d4/d39/f12 583841 1 2023-12-05T09:26:12.405 INFO:tasks.workunit.client.1.smithi134.stdout:8/291: unlink da/de/d11/c53 0 2023-12-05T09:26:12.406 INFO:tasks.workunit.client.1.smithi134.stdout:4/250: dread d16/d18/d1c/f2c [0,4194304] 0 2023-12-05T09:26:12.406 INFO:tasks.workunit.client.1.smithi134.stdout:4/251: readlink d16/d18/d1a/d3b/l56 0 2023-12-05T09:26:12.407 INFO:tasks.workunit.client.1.smithi134.stdout:5/219: rename d0/f19 to d0/d1a/d3a/f4e 0 2023-12-05T09:26:12.411 INFO:tasks.workunit.client.1.smithi134.stdout:0/218: creat d13/d1f/f41 x:0 0 0 2023-12-05T09:26:12.411 INFO:tasks.workunit.client.1.smithi134.stdout:8/292: link da/de/d11/d1d/f2e da/d1b/d42/f63 0 2023-12-05T09:26:12.411 INFO:tasks.workunit.client.1.smithi134.stdout:0/219: fsync d13/d14/d15/f21 0 2023-12-05T09:26:12.411 INFO:tasks.workunit.client.1.smithi134.stdout:8/293: dread - da/de/d43/f5d zero size 2023-12-05T09:26:12.411 INFO:tasks.workunit.client.1.smithi134.stdout:8/294: readlink da/de/d11/l4f 0 2023-12-05T09:26:12.411 INFO:tasks.workunit.client.1.smithi134.stdout:8/295: chown da/f3a 98 1 2023-12-05T09:26:12.411 INFO:tasks.workunit.client.1.smithi134.stdout:8/296: truncate da/de/d16/d33/f56 786708 0 2023-12-05T09:26:12.413 INFO:tasks.workunit.client.1.smithi134.stdout:7/225: rename d2/d7/dc/d2e/d3a/f46 to d2/d7/dc/d2e/f4c 0 2023-12-05T09:26:12.413 INFO:tasks.workunit.client.1.smithi134.stdout:7/226: creat d2/df/f4d x:0 0 0 2023-12-05T09:26:12.417 INFO:tasks.workunit.client.1.smithi134.stdout:4/252: link d16/d18/d1c/c54 d16/d18/d1b/d24/c59 0 2023-12-05T09:26:12.418 INFO:tasks.workunit.client.1.smithi134.stdout:4/253: creat d16/d18/d1a/d3b/f5a x:0 0 0 2023-12-05T09:26:12.430 INFO:tasks.workunit.client.1.smithi134.stdout:6/219: dread d4/d39/f12 [0,4194304] 0 2023-12-05T09:26:12.430 INFO:tasks.workunit.client.1.smithi134.stdout:6/220: fdatasync d4/d39/f12 0 2023-12-05T09:26:12.431 INFO:tasks.workunit.client.0.smithi067.stdout:2/131: creat d0/d25/f2c x:0 0 0 2023-12-05T09:26:12.431 INFO:tasks.workunit.client.0.smithi067.stdout:2/132: write d0/d25/f2c [965055,109028] 0 2023-12-05T09:26:12.432 INFO:tasks.workunit.client.1.smithi134.stdout:2/265: dwrite d19/f1d [0,4194304] 0 2023-12-05T09:26:12.432 INFO:tasks.workunit.client.1.smithi134.stdout:2/266: write f18 [4277339,17509] 0 2023-12-05T09:26:12.438 INFO:tasks.workunit.client.1.smithi134.stdout:6/221: rename d4/d2a/d3a/da/c38 to d4/d2a/d3a/da/d1b/c40 0 2023-12-05T09:26:12.440 INFO:tasks.workunit.client.1.smithi134.stdout:2/267: creat d19/d3f/f58 x:0 0 0 2023-12-05T09:26:12.440 INFO:tasks.workunit.client.1.smithi134.stdout:4/254: dread d16/d21/d48/f4c [0,4194304] 0 2023-12-05T09:26:12.442 INFO:tasks.workunit.client.1.smithi134.stdout:2/268: link d19/d28/f30 d19/d28/d31/d38/f59 0 2023-12-05T09:26:12.443 INFO:tasks.workunit.client.1.smithi134.stdout:4/255: mkdir d16/d18/d5b 0 2023-12-05T09:26:12.444 INFO:tasks.workunit.client.0.smithi067.stdout:4/124: dwrite d0/f8 [0,4194304] 0 2023-12-05T09:26:12.444 INFO:tasks.workunit.client.0.smithi067.stdout:9/331: rename d1b/d25/f2c to d1b/d3e/f6e 0 2023-12-05T09:26:12.449 INFO:tasks.workunit.client.1.smithi134.stdout:1/280: dwrite d2/f17 [0,4194304] 0 2023-12-05T09:26:12.452 INFO:tasks.workunit.client.1.smithi134.stdout:8/297: dread da/de/d16/f24 [0,4194304] 0 2023-12-05T09:26:12.453 INFO:tasks.workunit.client.1.smithi134.stdout:8/298: chown da/de/f41 649519530 1 2023-12-05T09:26:12.453 INFO:tasks.workunit.client.1.smithi134.stdout:1/281: mknod d2/d9/d10/d5b/c62 0 2023-12-05T09:26:12.453 INFO:tasks.workunit.client.1.smithi134.stdout:1/282: stat d2/l34 0 2023-12-05T09:26:12.453 INFO:tasks.workunit.client.0.smithi067.stdout:5/166: mknod db/df/d38/c3a 0 2023-12-05T09:26:12.455 INFO:tasks.workunit.client.1.smithi134.stdout:4/256: dread d16/d21/d48/f4c [0,4194304] 0 2023-12-05T09:26:12.459 INFO:tasks.workunit.client.1.smithi134.stdout:1/283: creat d2/f63 x:0 0 0 2023-12-05T09:26:12.462 INFO:tasks.workunit.client.1.smithi134.stdout:1/284: creat d2/d9/d10/d30/f64 x:0 0 0 2023-12-05T09:26:12.463 INFO:tasks.workunit.client.1.smithi134.stdout:1/285: creat d2/f65 x:0 0 0 2023-12-05T09:26:12.463 INFO:tasks.workunit.client.1.smithi134.stdout:1/286: chown d2/d9/d10/f3c 5974 1 2023-12-05T09:26:12.463 INFO:tasks.workunit.client.1.smithi134.stdout:5/220: dwrite d0/f33 [0,4194304] 0 2023-12-05T09:26:12.463 INFO:tasks.workunit.client.1.smithi134.stdout:5/221: stat d0/dd/f2c 0 2023-12-05T09:26:12.463 INFO:tasks.workunit.client.1.smithi134.stdout:5/222: fdatasync d0/d1a/d3a/f49 0 2023-12-05T09:26:12.464 INFO:tasks.workunit.client.1.smithi134.stdout:5/223: rename d0/d1a/d1c/d25 to d0/d1a/d1c/d25/d4d/d4f 22 2023-12-05T09:26:12.464 INFO:tasks.workunit.client.1.smithi134.stdout:5/224: fdatasync d0/f43 0 2023-12-05T09:26:12.464 INFO:tasks.workunit.client.1.smithi134.stdout:5/225: truncate d0/dd/f17 4797769 0 2023-12-05T09:26:12.471 INFO:tasks.workunit.client.1.smithi134.stdout:9/199: dwrite d7/d8/d14/f25 [0,4194304] 0 2023-12-05T09:26:12.471 INFO:tasks.workunit.client.1.smithi134.stdout:9/200: fsync d7/d8/d2e/f42 0 2023-12-05T09:26:12.476 INFO:tasks.workunit.client.1.smithi134.stdout:1/287: mkdir d2/d9/d10/d30/d66 0 2023-12-05T09:26:12.477 INFO:tasks.workunit.client.1.smithi134.stdout:5/226: unlink d0/c3 0 2023-12-05T09:26:12.477 INFO:tasks.workunit.client.1.smithi134.stdout:5/227: chown d0/d1a/d3a/f3b 99154 1 2023-12-05T09:26:12.477 INFO:tasks.workunit.client.1.smithi134.stdout:5/228: chown d0/dd/f32 114418 1 2023-12-05T09:26:12.477 INFO:tasks.workunit.client.1.smithi134.stdout:5/229: getdents d0/d45 0 2023-12-05T09:26:12.480 INFO:tasks.workunit.client.1.smithi134.stdout:1/288: creat d2/d9/d10/f67 x:0 0 0 2023-12-05T09:26:12.481 INFO:tasks.workunit.client.1.smithi134.stdout:9/201: dread d7/d8/d14/d26/f3e [0,4194304] 0 2023-12-05T09:26:12.484 INFO:tasks.workunit.client.1.smithi134.stdout:1/289: symlink d2/d9/d10/d5b/d5e/l68 0 2023-12-05T09:26:12.484 INFO:tasks.workunit.client.1.smithi134.stdout:1/290: truncate d2/d27/d40/f5d 128101 0 2023-12-05T09:26:12.485 INFO:tasks.workunit.client.1.smithi134.stdout:1/291: dread - d2/d9/d10/f47 zero size 2023-12-05T09:26:12.489 INFO:tasks.workunit.client.1.smithi134.stdout:1/292: rename d2/d9/c58 to d2/d27/d40/c69 0 2023-12-05T09:26:12.489 INFO:tasks.workunit.client.1.smithi134.stdout:1/293: write d2/d9/d10/d5b/f5c [85040,121704] 0 2023-12-05T09:26:12.515 INFO:tasks.workunit.client.1.smithi134.stdout:0/220: dwrite d13/d14/f3d [0,4194304] 0 2023-12-05T09:26:12.516 INFO:tasks.workunit.client.1.smithi134.stdout:0/221: dread - d13/d1f/f41 zero size 2023-12-05T09:26:12.516 INFO:tasks.workunit.client.0.smithi067.stdout:9/332: dwrite d1b/d3e/f66 [0,4194304] 0 2023-12-05T09:26:12.516 INFO:tasks.workunit.client.0.smithi067.stdout:2/133: dwrite d0/d10/f1d [4194304,4194304] 0 2023-12-05T09:26:12.517 INFO:tasks.workunit.client.0.smithi067.stdout:2/134: dread - d0/d15/f2a zero size 2023-12-05T09:26:12.517 INFO:tasks.workunit.client.1.smithi134.stdout:6/222: dwrite d4/d2a/d3a/da/d1b/f30 [0,4194304] 0 2023-12-05T09:26:12.524 INFO:tasks.workunit.client.0.smithi067.stdout:8/171: mkdir d5/dc/d1a/d20/d2d 0 2023-12-05T09:26:12.529 INFO:tasks.workunit.client.0.smithi067.stdout:7/204: symlink d0/d9/d1b/d34/l43 0 2023-12-05T09:26:12.529 INFO:tasks.workunit.client.0.smithi067.stdout:7/205: chown d0/d9/d10/d37/l25 347 1 2023-12-05T09:26:12.533 INFO:tasks.workunit.client.0.smithi067.stdout:0/246: mkdir d3/df/d10/d5a 0 2023-12-05T09:26:12.536 INFO:tasks.workunit.client.0.smithi067.stdout:4/125: dwrite d0/d9/d12/d15/f20 [0,4194304] 0 2023-12-05T09:26:12.547 INFO:tasks.workunit.client.1.smithi134.stdout:4/257: write f4 [773752,35295] 0 2023-12-05T09:26:12.547 INFO:tasks.workunit.client.1.smithi134.stdout:4/258: truncate d16/d21/f57 341851 0 2023-12-05T09:26:12.547 INFO:tasks.workunit.client.1.smithi134.stdout:4/259: creat d16/d18/d1a/d3b/f5c x:0 0 0 2023-12-05T09:26:12.547 INFO:tasks.workunit.client.1.smithi134.stdout:2/269: dwrite d19/f25 [4194304,4194304] 0 2023-12-05T09:26:12.547 INFO:tasks.workunit.client.1.smithi134.stdout:4/260: creat d16/d18/d1a/d3b/f5d x:0 0 0 2023-12-05T09:26:12.547 INFO:tasks.workunit.client.1.smithi134.stdout:4/261: dread - d16/d18/d1c/f3a zero size 2023-12-05T09:26:12.547 INFO:tasks.workunit.client.1.smithi134.stdout:4/262: fdatasync d16/d18/f36 0 2023-12-05T09:26:12.547 INFO:tasks.workunit.client.1.smithi134.stdout:8/299: dwrite da/de/d16/d2d/f5e [0,4194304] 0 2023-12-05T09:26:12.559 INFO:tasks.workunit.client.0.smithi067.stdout:7/206: read d0/f11 [3928880,85812] 0 2023-12-05T09:26:12.559 INFO:tasks.workunit.client.0.smithi067.stdout:7/207: creat d0/d9/d10/f44 x:0 0 0 2023-12-05T09:26:12.560 INFO:tasks.workunit.client.0.smithi067.stdout:7/208: write d0/d9/d10/f32 [1887238,14701] 0 2023-12-05T09:26:12.567 INFO:tasks.workunit.client.1.smithi134.stdout:9/202: dwrite d7/d8/d14/d26/f3e [0,4194304] 0 2023-12-05T09:26:12.608 INFO:tasks.workunit.client.0.smithi067.stdout:3/100: rename c5 to d9/c1e 0 2023-12-05T09:26:12.608 INFO:tasks.workunit.client.0.smithi067.stdout:5/167: symlink db/df/d38/l3b 0 2023-12-05T09:26:12.609 INFO:tasks.workunit.client.0.smithi067.stdout:8/172: creat d5/dc/d1a/f2e x:0 0 0 2023-12-05T09:26:12.611 INFO:tasks.workunit.client.0.smithi067.stdout:0/247: truncate d3/d7/fc 1612511 0 2023-12-05T09:26:12.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/222: dwrite d13/d14/d15/f40 [0,4194304] 0 2023-12-05T09:26:12.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/223: creat d13/d1f/f42 x:0 0 0 2023-12-05T09:26:12.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/224: fdatasync d13/d1f/f42 0 2023-12-05T09:26:12.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/225: creat d13/d14/d15/f43 x:0 0 0 2023-12-05T09:26:12.615 INFO:tasks.workunit.client.1.smithi134.stdout:0/226: fsync d13/d14/d15/f40 0 2023-12-05T09:26:12.621 INFO:tasks.workunit.client.0.smithi067.stdout:4/126: mkdir d0/d1d/d2a 0 2023-12-05T09:26:12.621 INFO:tasks.workunit.client.0.smithi067.stdout:4/127: chown d0/d9/d12/f14 143 1 2023-12-05T09:26:12.625 INFO:tasks.workunit.client.0.smithi067.stdout:2/135: dwrite d0/d15/f1b [0,4194304] 0 2023-12-05T09:26:12.625 INFO:tasks.workunit.client.0.smithi067.stdout:7/209: mkdir d0/d45 0 2023-12-05T09:26:12.625 INFO:tasks.workunit.client.0.smithi067.stdout:7/210: fsync d0/d9/d10/f1a 0 2023-12-05T09:26:12.625 INFO:tasks.workunit.client.0.smithi067.stdout:7/211: truncate d0/f42 571598 0 2023-12-05T09:26:12.630 INFO:tasks.workunit.client.0.smithi067.stdout:5/168: mknod db/df/d1a/d1d/c3c 0 2023-12-05T09:26:12.634 INFO:tasks.workunit.client.0.smithi067.stdout:0/248: rename d3/df/d10/f33 to d3/d7/d3c/d49/f5b 0 2023-12-05T09:26:12.634 INFO:tasks.workunit.client.0.smithi067.stdout:0/249: write d3/df/f16 [3008434,111502] 0 2023-12-05T09:26:12.635 INFO:tasks.workunit.client.0.smithi067.stdout:4/128: mkdir d0/d1d/d2b 0 2023-12-05T09:26:12.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/263: dwrite d16/d18/d1a/f3e [0,4194304] 0 2023-12-05T09:26:12.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/264: write f5 [141441,47561] 0 2023-12-05T09:26:12.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/265: stat l7 0 2023-12-05T09:26:12.637 INFO:tasks.workunit.client.0.smithi067.stdout:9/333: dwrite d1b/d25/d35/f4a [0,4194304] 0 2023-12-05T09:26:12.638 INFO:tasks.workunit.client.0.smithi067.stdout:9/334: creat d1b/d25/d35/f6f x:0 0 0 2023-12-05T09:26:12.638 INFO:tasks.workunit.client.0.smithi067.stdout:9/335: chown fa 7638449 1 2023-12-05T09:26:12.638 INFO:tasks.workunit.client.0.smithi067.stdout:9/336: creat d1b/d25/f70 x:0 0 0 2023-12-05T09:26:12.638 INFO:tasks.workunit.client.0.smithi067.stdout:9/337: dread - d1b/d25/f70 zero size 2023-12-05T09:26:12.639 INFO:tasks.workunit.client.1.smithi134.stdout:2/270: getdents d19/d28/d31/d38 0 2023-12-05T09:26:12.639 INFO:tasks.workunit.client.1.smithi134.stdout:2/271: write d19/d28/f41 [1219687,6975] 0 2023-12-05T09:26:12.661 INFO:tasks.workunit.client.1.smithi134.stdout:4/266: write f0 [603590,29905] 0 2023-12-05T09:26:12.661 INFO:tasks.workunit.client.1.smithi134.stdout:4/267: stat d16/d21/d35/c4d 0 2023-12-05T09:26:12.661 INFO:tasks.workunit.client.0.smithi067.stdout:2/136: dread d0/d10/f1d [4194304,4194304] 0 2023-12-05T09:26:12.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/169: creat db/df/f3d x:0 0 0 2023-12-05T09:26:12.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/170: fsync db/df/f15 0 2023-12-05T09:26:12.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/171: fsync db/df/f15 0 2023-12-05T09:26:12.675 INFO:tasks.workunit.client.1.smithi134.stdout:8/300: mknod da/de/d16/d45/d3b/c64 0 2023-12-05T09:26:12.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/250: mkdir d3/d7/d3c/d49/d59/d5c 0 2023-12-05T09:26:12.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/251: truncate d3/f32 2322343 0 2023-12-05T09:26:12.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/252: readlink d3/d7/d3c/d49/d59/l4f 0 2023-12-05T09:26:12.679 INFO:tasks.workunit.client.0.smithi067.stdout:1/155: sync 2023-12-05T09:26:12.680 INFO:tasks.workunit.client.1.smithi134.stdout:4/268: write f15 [464880,48304] 0 2023-12-05T09:26:12.680 INFO:tasks.workunit.client.1.smithi134.stdout:4/269: stat d16/d21/d48 0 2023-12-05T09:26:12.682 INFO:tasks.workunit.client.1.smithi134.stdout:8/301: write da/de/d11/f30 [1118,105864] 0 2023-12-05T09:26:12.682 INFO:tasks.workunit.client.0.smithi067.stdout:6/122: sync 2023-12-05T09:26:12.683 INFO:tasks.workunit.client.1.smithi134.stdout:2/272: dwrite d19/f2d [0,4194304] 0 2023-12-05T09:26:12.683 INFO:tasks.workunit.client.1.smithi134.stdout:2/273: fdatasync d19/f34 0 2023-12-05T09:26:12.683 INFO:tasks.workunit.client.1.smithi134.stdout:2/274: creat d19/d3f/f5a x:0 0 0 2023-12-05T09:26:12.698 INFO:tasks.workunit.client.0.smithi067.stdout:3/101: dwrite f7 [0,4194304] 0 2023-12-05T09:26:12.711 INFO:tasks.workunit.client.0.smithi067.stdout:1/156: write d2/d5/d7/de/d10/d15/f1c [267892,101327] 0 2023-12-05T09:26:12.711 INFO:tasks.workunit.client.0.smithi067.stdout:1/157: chown d2/d5/f34 237 1 2023-12-05T09:26:12.717 INFO:tasks.workunit.client.0.smithi067.stdout:7/212: dwrite d0/d9/f30 [0,4194304] 0 2023-12-05T09:26:12.717 INFO:tasks.workunit.client.0.smithi067.stdout:7/213: creat d0/d9/d1b/d34/f46 x:0 0 0 2023-12-05T09:26:12.722 INFO:tasks.workunit.client.0.smithi067.stdout:4/129: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:26:12.741 INFO:tasks.workunit.client.0.smithi067.stdout:7/214: dread d0/f11 [0,4194304] 0 2023-12-05T09:26:12.746 INFO:tasks.workunit.client.0.smithi067.stdout:6/123: dwrite da/db/d1f/f25 [0,4194304] 0 2023-12-05T09:26:12.761 INFO:tasks.workunit.client.0.smithi067.stdout:4/130: dwrite d0/f4 [0,4194304] 0 2023-12-05T09:26:12.762 INFO:tasks.workunit.client.0.smithi067.stdout:4/131: chown d0/d1d/f21 90201 1 2023-12-05T09:26:12.996 INFO:tasks.workunit.client.0.smithi067.stdout:9/338: mknod d1b/d25/c71 0 2023-12-05T09:26:13.001 INFO:tasks.workunit.client.0.smithi067.stdout:2/137: link d0/d10/f19 d0/d10/d1e/f2d 0 2023-12-05T09:26:13.001 INFO:tasks.workunit.client.0.smithi067.stdout:2/138: stat d0/d10/c12 0 2023-12-05T09:26:13.001 INFO:tasks.workunit.client.0.smithi067.stdout:5/172: mknod db/df/d1a/d1d/c3e 0 2023-12-05T09:26:13.002 INFO:tasks.workunit.client.0.smithi067.stdout:0/253: creat d3/d7/d3c/d49/d59/d4e/f5d x:0 0 0 2023-12-05T09:26:13.002 INFO:tasks.workunit.client.0.smithi067.stdout:0/254: fsync d3/df/f18 0 2023-12-05T09:26:13.004 INFO:tasks.workunit.client.0.smithi067.stdout:3/102: truncate f0 1655276 0 2023-12-05T09:26:13.009 INFO:tasks.workunit.client.0.smithi067.stdout:7/215: creat d0/d9/d3f/f47 x:0 0 0 2023-12-05T09:26:13.010 INFO:tasks.workunit.client.0.smithi067.stdout:7/216: stat d0/d45 0 2023-12-05T09:26:13.010 INFO:tasks.workunit.client.0.smithi067.stdout:7/217: dread - d0/d9/d10/f44 zero size 2023-12-05T09:26:13.012 INFO:tasks.workunit.client.0.smithi067.stdout:6/124: mkdir da/db/d2c 0 2023-12-05T09:26:13.012 INFO:tasks.workunit.client.0.smithi067.stdout:6/125: chown c1 1147103 1 2023-12-05T09:26:13.013 INFO:tasks.workunit.client.0.smithi067.stdout:4/132: mkdir d0/d1d/d25/d2c 0 2023-12-05T09:26:13.029 INFO:tasks.workunit.client.1.smithi134.stdout:7/227: sync 2023-12-05T09:26:13.029 INFO:tasks.workunit.client.1.smithi134.stdout:7/228: write d2/d7/dc/d2e/d3a/f49 [210066,46299] 0 2023-12-05T09:26:13.035 INFO:tasks.workunit.client.1.smithi134.stdout:0/227: creat d13/d14/d30/d2c/f44 x:0 0 0 2023-12-05T09:26:13.035 INFO:tasks.workunit.client.1.smithi134.stdout:3/246: sync 2023-12-05T09:26:13.035 INFO:tasks.workunit.client.1.smithi134.stdout:3/247: readlink d4/d5/l21 0 2023-12-05T09:26:13.035 INFO:tasks.workunit.client.1.smithi134.stdout:3/248: fdatasync d4/f3b 0 2023-12-05T09:26:13.043 INFO:tasks.workunit.client.1.smithi134.stdout:7/229: dread d2/d7/dc/d22/f3d [0,4194304] 0 2023-12-05T09:26:13.055 INFO:tasks.workunit.client.1.smithi134.stdout:4/270: rmdir d16/d18/d1b/d45 0 2023-12-05T09:26:13.057 INFO:tasks.workunit.client.1.smithi134.stdout:8/302: truncate da/de/d11/f34 605534 0 2023-12-05T09:26:13.065 INFO:tasks.workunit.client.1.smithi134.stdout:2/275: truncate d19/d28/f33 1678423 0 2023-12-05T09:26:13.065 INFO:tasks.workunit.client.1.smithi134.stdout:2/276: write d19/d28/d31/f3e [188735,44898] 0 2023-12-05T09:26:13.071 INFO:tasks.workunit.client.0.smithi067.stdout:0/255: dwrite d3/d7/f8 [0,4194304] 0 2023-12-05T09:26:13.076 INFO:tasks.workunit.client.1.smithi134.stdout:5/230: sync 2023-12-05T09:26:13.082 INFO:tasks.workunit.client.0.smithi067.stdout:0/256: dread d3/df/f18 [0,4194304] 0 2023-12-05T09:26:13.087 INFO:tasks.workunit.client.1.smithi134.stdout:4/271: write ff [2337595,53667] 0 2023-12-05T09:26:13.093 INFO:tasks.workunit.client.0.smithi067.stdout:5/173: dwrite db/df/f3d [0,4194304] 0 2023-12-05T09:26:13.094 INFO:tasks.workunit.client.1.smithi134.stdout:8/303: dread f2 [0,4194304] 0 2023-12-05T09:26:13.100 INFO:tasks.workunit.client.1.smithi134.stdout:6/223: sync 2023-12-05T09:26:13.100 INFO:tasks.workunit.client.1.smithi134.stdout:1/294: sync 2023-12-05T09:26:13.100 INFO:tasks.workunit.client.1.smithi134.stdout:1/295: chown d2/d9/f2c 10078 1 2023-12-05T09:26:13.102 INFO:tasks.workunit.client.0.smithi067.stdout:7/218: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:26:13.102 INFO:tasks.workunit.client.0.smithi067.stdout:7/219: chown d0/d9/d10/d1d/l3b 757 1 2023-12-05T09:26:13.104 INFO:tasks.workunit.client.0.smithi067.stdout:9/339: rename d1b/f3b to d1b/d25/d54/d5c/f72 0 2023-12-05T09:26:13.105 INFO:tasks.workunit.client.0.smithi067.stdout:0/257: write d3/fb [994345,86993] 0 2023-12-05T09:26:13.106 INFO:tasks.workunit.client.1.smithi134.stdout:9/203: sync 2023-12-05T09:26:13.111 INFO:tasks.workunit.client.0.smithi067.stdout:3/103: symlink d9/l1f 0 2023-12-05T09:26:13.124 INFO:tasks.workunit.client.0.smithi067.stdout:1/158: rmdir d2/d5 39 2023-12-05T09:26:13.124 INFO:tasks.workunit.client.0.smithi067.stdout:1/159: stat d2/f24 0 2023-12-05T09:26:13.125 INFO:tasks.workunit.client.0.smithi067.stdout:9/340: dread f10 [0,4194304] 0 2023-12-05T09:26:13.125 INFO:tasks.workunit.client.0.smithi067.stdout:9/341: fsync d1b/d25/f46 0 2023-12-05T09:26:13.125 INFO:tasks.workunit.client.0.smithi067.stdout:8/173: sync 2023-12-05T09:26:13.126 INFO:tasks.workunit.client.0.smithi067.stdout:6/126: symlink da/db/d12/d19/l2d 0 2023-12-05T09:26:13.127 INFO:tasks.workunit.client.0.smithi067.stdout:6/127: write da/d10/d1e/d17/f29 [4777923,38601] 0 2023-12-05T09:26:13.129 INFO:tasks.workunit.client.0.smithi067.stdout:4/133: truncate d0/d1d/f21 155018 0 2023-12-05T09:26:13.133 INFO:tasks.workunit.client.0.smithi067.stdout:7/220: mkdir d0/d9/d40/d48 0 2023-12-05T09:26:13.133 INFO:tasks.workunit.client.0.smithi067.stdout:7/221: chown d0/d9/d10/d37/l33 1985354 1 2023-12-05T09:26:13.137 INFO:tasks.workunit.client.0.smithi067.stdout:0/258: rmdir d3/df/d10/d5a 0 2023-12-05T09:26:13.139 INFO:tasks.workunit.client.0.smithi067.stdout:2/139: truncate d0/d10/f1d 8275252 0 2023-12-05T09:26:13.141 INFO:tasks.workunit.client.0.smithi067.stdout:9/342: truncate d1b/d25/d35/f4a 3350971 0 2023-12-05T09:26:13.141 INFO:tasks.workunit.client.0.smithi067.stdout:9/343: write d1b/d3e/f6e [224226,107168] 0 2023-12-05T09:26:13.142 INFO:tasks.workunit.client.0.smithi067.stdout:3/104: mkdir d9/d20 0 2023-12-05T09:26:13.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/174: rename d5/dc/f29 to d5/dc/d1a/f2f 0 2023-12-05T09:26:13.148 INFO:tasks.workunit.client.0.smithi067.stdout:5/174: mkdir db/df/d3f 0 2023-12-05T09:26:13.152 INFO:tasks.workunit.client.0.smithi067.stdout:9/344: symlink d1b/l73 0 2023-12-05T09:26:13.167 INFO:tasks.workunit.client.0.smithi067.stdout:3/105: truncate d9/da/d15/d17/f16 3868086 0 2023-12-05T09:26:13.168 INFO:tasks.workunit.client.0.smithi067.stdout:3/106: fdatasync f6 0 2023-12-05T09:26:13.168 INFO:tasks.workunit.client.0.smithi067.stdout:7/222: write d0/f7 [1681731,28236] 0 2023-12-05T09:26:13.168 INFO:tasks.workunit.client.0.smithi067.stdout:0/259: dread d3/f58 [0,4194304] 0 2023-12-05T09:26:13.170 INFO:tasks.workunit.client.1.smithi134.stdout:9/204: dwrite d7/f1a [4194304,4194304] 0 2023-12-05T09:26:13.170 INFO:tasks.workunit.client.1.smithi134.stdout:9/205: readlink d7/l32 0 2023-12-05T09:26:13.170 INFO:tasks.workunit.client.1.smithi134.stdout:9/206: chown d7/d8/d14/d26/c2d 2800 1 2023-12-05T09:26:13.173 INFO:tasks.workunit.client.0.smithi067.stdout:8/175: mkdir d5/da/d30 0 2023-12-05T09:26:13.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/134: rename d0/d9/dd/l28 to d0/d1d/d25/d2c/l2d 0 2023-12-05T09:26:13.184 INFO:tasks.workunit.client.1.smithi134.stdout:9/207: dread d7/d8/d14/f3d [0,4194304] 0 2023-12-05T09:26:13.187 INFO:tasks.workunit.client.0.smithi067.stdout:2/140: dread d0/d15/f1b [0,4194304] 0 2023-12-05T09:26:13.192 INFO:tasks.workunit.client.0.smithi067.stdout:1/160: dwrite d2/d3/f21 [0,4194304] 0 2023-12-05T09:26:13.192 INFO:tasks.workunit.client.0.smithi067.stdout:1/161: chown d2/d5/d7/cb 110 1 2023-12-05T09:26:13.212 INFO:tasks.workunit.client.0.smithi067.stdout:6/128: dwrite da/d10/d1e/d17/f18 [0,4194304] 0 2023-12-05T09:26:13.221 INFO:tasks.workunit.client.0.smithi067.stdout:1/162: dread d2/d5/d7/de/d10/f1e [0,4194304] 0 2023-12-05T09:26:13.221 INFO:tasks.workunit.client.0.smithi067.stdout:1/163: read - d2/d5/d7/de/f3a zero size 2023-12-05T09:26:13.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/223: creat d0/d45/f49 x:0 0 0 2023-12-05T09:26:13.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/224: readlink d0/l31 0 2023-12-05T09:26:13.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/225: write d0/d9/d10/d37/f28 [4627366,58651] 0 2023-12-05T09:26:13.223 INFO:tasks.workunit.client.0.smithi067.stdout:7/226: chown d0/d9/d10/l2e 6978899 1 2023-12-05T09:26:13.228 INFO:tasks.workunit.client.0.smithi067.stdout:0/260: mknod d3/d7/d3c/d57/c5e 0 2023-12-05T09:26:13.228 INFO:tasks.workunit.client.0.smithi067.stdout:0/261: dread - d3/f39 zero size 2023-12-05T09:26:13.233 INFO:tasks.workunit.client.0.smithi067.stdout:8/176: dwrite d5/f14 [0,4194304] 0 2023-12-05T09:26:13.234 INFO:tasks.workunit.client.1.smithi134.stdout:9/208: dwrite f3 [4194304,4194304] 0 2023-12-05T09:26:13.236 INFO:tasks.workunit.client.0.smithi067.stdout:7/227: write d0/d9/d10/f35 [303641,120627] 0 2023-12-05T09:26:13.236 INFO:tasks.workunit.client.0.smithi067.stdout:7/228: creat d0/f4a x:0 0 0 2023-12-05T09:26:13.236 INFO:tasks.workunit.client.0.smithi067.stdout:4/135: unlink d0/d9/c1e 0 2023-12-05T09:26:13.237 INFO:tasks.workunit.client.0.smithi067.stdout:7/229: dread - d0/d9/d10/f44 zero size 2023-12-05T09:26:13.237 INFO:tasks.workunit.client.0.smithi067.stdout:7/230: truncate d0/d9/d10/f44 447856 0 2023-12-05T09:26:13.240 INFO:tasks.workunit.client.0.smithi067.stdout:5/175: rename db/df/d38/l3b to db/df/d1a/d1d/l40 0 2023-12-05T09:26:13.240 INFO:tasks.workunit.client.0.smithi067.stdout:5/176: truncate db/df/d1a/d1d/d20/f2c 1012379 0 2023-12-05T09:26:13.240 INFO:tasks.workunit.client.0.smithi067.stdout:5/177: chown db/df/d1a/d1d/f23 11 1 2023-12-05T09:26:13.242 INFO:tasks.workunit.client.0.smithi067.stdout:2/141: creat d0/d10/d1e/f2e x:0 0 0 2023-12-05T09:26:13.242 INFO:tasks.workunit.client.0.smithi067.stdout:2/142: truncate d0/fe 834244 0 2023-12-05T09:26:13.244 INFO:tasks.workunit.client.0.smithi067.stdout:6/129: mknod da/d10/d1e/d17/c2e 0 2023-12-05T09:26:13.244 INFO:tasks.workunit.client.0.smithi067.stdout:6/130: stat da/d10/d1e/d17/f18 0 2023-12-05T09:26:13.245 INFO:tasks.workunit.client.1.smithi134.stdout:9/209: read d7/d8/d14/f25 [2703283,120140] 0 2023-12-05T09:26:13.248 INFO:tasks.workunit.client.0.smithi067.stdout:8/177: truncate d5/dc/f19 1989519 0 2023-12-05T09:26:13.249 INFO:tasks.workunit.client.0.smithi067.stdout:8/178: creat d5/dc/d1a/d20/f31 x:0 0 0 2023-12-05T09:26:13.251 INFO:tasks.workunit.client.0.smithi067.stdout:7/231: rmdir d0/d9/d40 39 2023-12-05T09:26:13.257 INFO:tasks.workunit.client.0.smithi067.stdout:3/107: rename d9/l1c to d9/da/d15/l21 0 2023-12-05T09:26:13.259 INFO:tasks.workunit.client.0.smithi067.stdout:2/143: mkdir d0/d2f 0 2023-12-05T09:26:13.259 INFO:tasks.workunit.client.0.smithi067.stdout:2/144: chown d0/d10/c13 3017817 1 2023-12-05T09:26:13.270 INFO:tasks.workunit.client.0.smithi067.stdout:8/179: symlink d5/dc/d1a/l32 0 2023-12-05T09:26:13.270 INFO:tasks.workunit.client.0.smithi067.stdout:8/180: creat d5/da/f33 x:0 0 0 2023-12-05T09:26:13.272 INFO:tasks.workunit.client.0.smithi067.stdout:7/232: creat d0/d9/d40/f4b x:0 0 0 2023-12-05T09:26:13.276 INFO:tasks.workunit.client.0.smithi067.stdout:5/178: symlink db/df/d1a/l41 0 2023-12-05T09:26:13.276 INFO:tasks.workunit.client.0.smithi067.stdout:5/179: chown db/df/d1a 138143 1 2023-12-05T09:26:13.276 INFO:tasks.workunit.client.0.smithi067.stdout:5/180: chown f6 41235 1 2023-12-05T09:26:13.276 INFO:tasks.workunit.client.0.smithi067.stdout:5/181: stat db/df/d1a/d1d/f23 0 2023-12-05T09:26:13.278 INFO:tasks.workunit.client.0.smithi067.stdout:9/345: dwrite d1b/d25/d35/f4f [0,4194304] 0 2023-12-05T09:26:13.289 INFO:tasks.workunit.client.0.smithi067.stdout:0/262: read d3/f58 [2518409,92041] 0 2023-12-05T09:26:13.293 INFO:tasks.workunit.client.0.smithi067.stdout:7/233: dread d0/d9/d10/f44 [0,4194304] 0 2023-12-05T09:26:13.306 INFO:tasks.workunit.client.0.smithi067.stdout:1/164: dwrite d2/d5/f34 [0,4194304] 0 2023-12-05T09:26:13.320 INFO:tasks.workunit.client.0.smithi067.stdout:0/263: dwrite d3/f1d [0,4194304] 0 2023-12-05T09:26:13.342 INFO:tasks.workunit.client.0.smithi067.stdout:4/136: rename d0/d1d/f1f to d0/d1d/d2b/f2e 0 2023-12-05T09:26:13.342 INFO:tasks.workunit.client.0.smithi067.stdout:4/137: dread - d0/d9/d12/f14 zero size 2023-12-05T09:26:13.342 INFO:tasks.workunit.client.0.smithi067.stdout:4/138: chown d0 378777422 1 2023-12-05T09:26:13.342 INFO:tasks.workunit.client.0.smithi067.stdout:4/139: dread - d0/d1d/f23 zero size 2023-12-05T09:26:13.342 INFO:tasks.workunit.client.0.smithi067.stdout:2/145: link d0/c18 d0/d15/c30 0 2023-12-05T09:26:13.350 INFO:tasks.workunit.client.0.smithi067.stdout:5/182: creat db/df/d1a/d1d/d20/f42 x:0 0 0 2023-12-05T09:26:13.352 INFO:tasks.workunit.client.0.smithi067.stdout:9/346: truncate d1b/f1c 2453865 0 2023-12-05T09:26:13.352 INFO:tasks.workunit.client.0.smithi067.stdout:9/347: fsync d1b/f51 0 2023-12-05T09:26:13.355 INFO:tasks.workunit.client.0.smithi067.stdout:7/234: unlink d0/d9/d1b/d34/l43 0 2023-12-05T09:26:13.365 INFO:tasks.workunit.client.0.smithi067.stdout:5/183: dread db/df/d1a/d1d/d20/f37 [0,4194304] 0 2023-12-05T09:26:13.368 INFO:tasks.workunit.client.0.smithi067.stdout:1/165: chown d2/d3/l28 50690786 1 2023-12-05T09:26:13.368 INFO:tasks.workunit.client.0.smithi067.stdout:1/166: truncate d2/d5/d7/de/d10/d14/d20/f26 4379634 0 2023-12-05T09:26:13.371 INFO:tasks.workunit.client.0.smithi067.stdout:0/264: symlink d3/df/l5f 0 2023-12-05T09:26:13.377 INFO:tasks.workunit.client.0.smithi067.stdout:3/108: rmdir d9/da 39 2023-12-05T09:26:13.379 INFO:tasks.workunit.client.0.smithi067.stdout:7/235: getdents d0/d9/d10/d1d 0 2023-12-05T09:26:13.385 INFO:tasks.workunit.client.0.smithi067.stdout:1/167: mknod d2/d3/c3b 0 2023-12-05T09:26:13.385 INFO:tasks.workunit.client.0.smithi067.stdout:3/109: creat d9/da/f22 x:0 0 0 2023-12-05T09:26:13.390 INFO:tasks.workunit.client.0.smithi067.stdout:0/265: rmdir d3/d7/d3c 39 2023-12-05T09:26:13.392 INFO:tasks.workunit.client.0.smithi067.stdout:6/131: rename da/db to da/d10/d1e/d17/d2f 0 2023-12-05T09:26:13.392 INFO:tasks.workunit.client.0.smithi067.stdout:3/110: symlink d9/da/d15/d17/l23 0 2023-12-05T09:26:13.392 INFO:tasks.workunit.client.0.smithi067.stdout:4/140: dwrite d0/d1d/f23 [0,4194304] 0 2023-12-05T09:26:13.392 INFO:tasks.workunit.client.0.smithi067.stdout:4/141: write d0/d1d/d2b/f2e [5196174,5887] 0 2023-12-05T09:26:13.393 INFO:tasks.workunit.client.0.smithi067.stdout:4/142: stat d0/fc 0 2023-12-05T09:26:13.393 INFO:tasks.workunit.client.0.smithi067.stdout:4/143: creat d0/d9/f2f x:0 0 0 2023-12-05T09:26:13.397 INFO:tasks.workunit.client.0.smithi067.stdout:1/168: creat d2/d5/d7/de/d10/d14/f3c x:0 0 0 2023-12-05T09:26:13.400 INFO:tasks.workunit.client.0.smithi067.stdout:3/111: getdents d9 0 2023-12-05T09:26:13.400 INFO:tasks.workunit.client.1.smithi134.stdout:1/296: symlink d2/d9/d10/l6a 0 2023-12-05T09:26:13.414 INFO:tasks.workunit.client.0.smithi067.stdout:8/181: rename d5/dc/d1a/l32 to d5/dc/d1a/d20/l34 0 2023-12-05T09:26:13.422 INFO:tasks.workunit.client.0.smithi067.stdout:6/132: write da/d10/d1e/d17/f18 [805303,60625] 0 2023-12-05T09:26:13.427 INFO:tasks.workunit.client.0.smithi067.stdout:9/348: dwrite d1b/d3e/f66 [0,4194304] 0 2023-12-05T09:26:13.430 INFO:tasks.workunit.client.1.smithi134.stdout:9/210: link d7/d8/d14/d26/f3e d7/d8/d14/f46 0 2023-12-05T09:26:13.430 INFO:tasks.workunit.client.1.smithi134.stdout:7/230: unlink d2/d7/d25/d26/l48 0 2023-12-05T09:26:13.430 INFO:tasks.workunit.client.1.smithi134.stdout:8/304: creat da/de/d16/d45/d3b/f65 x:0 0 0 2023-12-05T09:26:13.430 INFO:tasks.workunit.client.1.smithi134.stdout:3/249: mknod d4/c4f 0 2023-12-05T09:26:13.431 INFO:tasks.workunit.client.1.smithi134.stdout:9/211: write d7/d8/d14/f25 [5145652,15326] 0 2023-12-05T09:26:13.431 INFO:tasks.workunit.client.1.smithi134.stdout:0/228: symlink d13/l45 0 2023-12-05T09:26:13.431 INFO:tasks.workunit.client.1.smithi134.stdout:3/250: truncate f3 5197703 0 2023-12-05T09:26:13.431 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:13 smithi067 ceph-mon[107174]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:26:13.431 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:13 smithi067 ceph-mon[107174]: pgmap v22: 65 pgs: 65 active+clean; 1.0 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 94 MiB/s rd, 122 MiB/s wr, 865 op/s 2023-12-05T09:26:13.432 INFO:tasks.workunit.client.0.smithi067.stdout:4/144: unlink d0/f17 0 2023-12-05T09:26:13.432 INFO:tasks.workunit.client.0.smithi067.stdout:8/182: truncate d5/f28 2159601 0 2023-12-05T09:26:13.432 INFO:tasks.workunit.client.0.smithi067.stdout:1/169: creat d2/d3/f3d x:0 0 0 2023-12-05T09:26:13.432 INFO:tasks.workunit.client.0.smithi067.stdout:1/170: dread - d2/f39 zero size 2023-12-05T09:26:13.432 INFO:tasks.workunit.client.1.smithi134.stdout:4/272: creat d16/d18/d5b/f5e x:0 0 0 2023-12-05T09:26:13.432 INFO:tasks.workunit.client.1.smithi134.stdout:4/273: readlink l8 0 2023-12-05T09:26:13.434 INFO:tasks.workunit.client.0.smithi067.stdout:2/146: rename d0/c18 to d0/d10/d1e/c31 0 2023-12-05T09:26:13.435 INFO:tasks.workunit.client.0.smithi067.stdout:6/133: stat da/d10/d1e/l1d 0 2023-12-05T09:26:13.437 INFO:tasks.workunit.client.1.smithi134.stdout:1/297: symlink d2/d9/d10/d5b/d5e/l6b 0 2023-12-05T09:26:13.441 INFO:tasks.workunit.client.1.smithi134.stdout:2/277: link fc d19/d28/d2b/f5b 0 2023-12-05T09:26:13.442 INFO:tasks.workunit.client.0.smithi067.stdout:4/145: stat d0/d9/d12/c1a 0 2023-12-05T09:26:13.444 INFO:tasks.workunit.client.1.smithi134.stdout:8/305: unlink da/de/f55 0 2023-12-05T09:26:13.445 INFO:tasks.workunit.client.0.smithi067.stdout:8/183: symlink d5/l35 0 2023-12-05T09:26:13.445 INFO:tasks.workunit.client.0.smithi067.stdout:8/184: fsync d5/dc/d1a/d20/f22 0 2023-12-05T09:26:13.446 INFO:tasks.workunit.client.0.smithi067.stdout:8/185: dread - d5/da/f2a zero size 2023-12-05T09:26:13.446 INFO:tasks.workunit.client.0.smithi067.stdout:8/186: dread - d5/dc/d1a/f2f zero size 2023-12-05T09:26:13.446 INFO:tasks.workunit.client.1.smithi134.stdout:7/231: truncate d2/d7/dc/f34 1710634 0 2023-12-05T09:26:13.449 INFO:tasks.workunit.client.0.smithi067.stdout:1/171: creat d2/d5/d7/de/d10/f3e x:0 0 0 2023-12-05T09:26:13.449 INFO:tasks.workunit.client.0.smithi067.stdout:1/172: fsync d2/d5/d7/de/d1a/f1b 0 2023-12-05T09:26:13.449 INFO:tasks.workunit.client.0.smithi067.stdout:1/173: write d2/d5/d7/de/d10/d15/f29 [2075197,19101] 0 2023-12-05T09:26:13.449 INFO:tasks.workunit.client.1.smithi134.stdout:3/251: mkdir d4/d1f/d50 0 2023-12-05T09:26:13.449 INFO:tasks.workunit.client.1.smithi134.stdout:3/252: chown d4/d5/d45/f4d 96771526 1 2023-12-05T09:26:13.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/147: mknod d0/d15/c32 0 2023-12-05T09:26:13.451 INFO:tasks.workunit.client.1.smithi134.stdout:9/212: creat d7/f47 x:0 0 0 2023-12-05T09:26:13.451 INFO:tasks.workunit.client.1.smithi134.stdout:9/213: chown d7/c39 158626001 1 2023-12-05T09:26:13.452 INFO:tasks.workunit.client.0.smithi067.stdout:2/148: write d0/fe [534235,110317] 0 2023-12-05T09:26:13.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/134: mknod da/d10/c30 0 2023-12-05T09:26:13.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/135: truncate da/d10/d1e/d17/d2f/f2b 717261 0 2023-12-05T09:26:13.453 INFO:tasks.workunit.client.1.smithi134.stdout:0/229: mknod d13/d14/d15/c46 0 2023-12-05T09:26:13.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/230: fsync fa 0 2023-12-05T09:26:13.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/231: read - d13/d1f/f41 zero size 2023-12-05T09:26:13.458 INFO:tasks.workunit.client.1.smithi134.stdout:3/253: dread d4/fb [0,4194304] 0 2023-12-05T09:26:13.458 INFO:tasks.workunit.client.1.smithi134.stdout:5/231: mkdir d0/d50 0 2023-12-05T09:26:13.462 INFO:tasks.workunit.client.0.smithi067.stdout:5/184: rename db/df/d1a/d1d/c3e to db/c43 0 2023-12-05T09:26:13.462 INFO:tasks.workunit.client.0.smithi067.stdout:8/187: creat d5/f36 x:0 0 0 2023-12-05T09:26:13.464 INFO:tasks.workunit.client.1.smithi134.stdout:1/298: mknod d2/d9/d10/d5b/d5e/c6c 0 2023-12-05T09:26:13.466 INFO:tasks.workunit.client.0.smithi067.stdout:9/349: dread d1b/d25/d35/f52 [0,4194304] 0 2023-12-05T09:26:13.468 INFO:tasks.workunit.client.0.smithi067.stdout:7/236: dread d0/d9/f30 [0,4194304] 0 2023-12-05T09:26:13.468 INFO:tasks.workunit.client.0.smithi067.stdout:7/237: creat d0/f4c x:0 0 0 2023-12-05T09:26:13.471 INFO:tasks.workunit.client.1.smithi134.stdout:2/278: creat d19/d28/f5c x:0 0 0 2023-12-05T09:26:13.472 INFO:tasks.workunit.client.1.smithi134.stdout:2/279: write d19/d28/f30 [933214,121551] 0 2023-12-05T09:26:13.472 INFO:tasks.workunit.client.1.smithi134.stdout:2/280: fdatasync d19/d49/f56 0 2023-12-05T09:26:13.473 INFO:tasks.workunit.client.0.smithi067.stdout:1/174: mknod d2/d5/d7/de/d19/c3f 0 2023-12-05T09:26:13.473 INFO:tasks.workunit.client.0.smithi067.stdout:1/175: dread - d2/d5/d7/de/f3a zero size 2023-12-05T09:26:13.476 INFO:tasks.workunit.client.1.smithi134.stdout:4/274: read d16/d18/d1a/f3e [3709516,51132] 0 2023-12-05T09:26:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:6/136: link da/d10/d1e/d17/d2f/d12/l1a da/d10/d1e/d17/d2f/d1f/l31 0 2023-12-05T09:26:13.486 INFO:tasks.workunit.client.0.smithi067.stdout:5/185: dread db/df/d1a/f28 [0,4194304] 0 2023-12-05T09:26:13.486 INFO:tasks.workunit.client.0.smithi067.stdout:4/146: rename d0/d9/c10 to d0/d1d/d25/c30 0 2023-12-05T09:26:13.487 INFO:tasks.workunit.client.0.smithi067.stdout:4/147: fdatasync d0/f7 0 2023-12-05T09:26:13.487 INFO:tasks.workunit.client.0.smithi067.stdout:4/148: chown d0/d1d/d25/c30 2 1 2023-12-05T09:26:13.487 INFO:tasks.workunit.client.0.smithi067.stdout:0/266: dwrite d3/f39 [0,4194304] 0 2023-12-05T09:26:13.489 INFO:tasks.workunit.client.1.smithi134.stdout:8/306: dread da/de/f40 [0,4194304] 0 2023-12-05T09:26:13.490 INFO:tasks.workunit.client.0.smithi067.stdout:5/186: write db/df/d1a/f21 [78281,70018] 0 2023-12-05T09:26:13.490 INFO:tasks.workunit.client.0.smithi067.stdout:5/187: stat db/df/f3d 0 2023-12-05T09:26:13.496 INFO:tasks.workunit.client.1.smithi134.stdout:7/232: creat d2/d7/dc/d2e/d3a/f4e x:0 0 0 2023-12-05T09:26:13.496 INFO:tasks.workunit.client.1.smithi134.stdout:7/233: fdatasync d2/d7/f37 0 2023-12-05T09:26:13.501 INFO:tasks.workunit.client.0.smithi067.stdout:9/350: link c4 d1b/d25/d54/d5c/d6a/d6c/c74 0 2023-12-05T09:26:13.501 INFO:tasks.workunit.client.0.smithi067.stdout:9/351: chown d1b/f5d 3 1 2023-12-05T09:26:13.503 INFO:tasks.workunit.client.1.smithi134.stdout:8/307: write da/de/f48 [4025041,91757] 0 2023-12-05T09:26:13.503 INFO:tasks.workunit.client.1.smithi134.stdout:8/308: write da/de/d16/d45/d3b/f65 [112637,54828] 0 2023-12-05T09:26:13.509 INFO:tasks.workunit.client.1.smithi134.stdout:7/234: dread d2/dd/d1a/f23 [0,4194304] 0 2023-12-05T09:26:13.510 INFO:tasks.workunit.client.1.smithi134.stdout:9/214: creat d7/d8/d14/d26/f48 x:0 0 0 2023-12-05T09:26:13.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/235: read - d2/d7/dc/d2e/d3a/f4e zero size 2023-12-05T09:26:13.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/236: readlink d2/d7/dc/d2e/d3a/l3f 0 2023-12-05T09:26:13.511 INFO:tasks.workunit.client.0.smithi067.stdout:6/137: dread da/d10/d1e/d17/f23 [4194304,4194304] 0 2023-12-05T09:26:13.512 INFO:tasks.workunit.client.0.smithi067.stdout:3/112: dwrite d9/da/d15/f1b [0,4194304] 0 2023-12-05T09:26:13.513 INFO:tasks.workunit.client.1.smithi134.stdout:6/224: symlink d4/d39/l41 0 2023-12-05T09:26:13.513 INFO:tasks.workunit.client.1.smithi134.stdout:6/225: fdatasync d4/d2a/f2e 0 2023-12-05T09:26:13.523 INFO:tasks.workunit.client.1.smithi134.stdout:0/232: link d13/f35 d13/d14/d30/d2c/f47 0 2023-12-05T09:26:13.523 INFO:tasks.workunit.client.1.smithi134.stdout:0/233: readlink d13/d14/l18 0 2023-12-05T09:26:13.527 INFO:tasks.workunit.client.0.smithi067.stdout:7/238: symlink d0/d9/d3f/l4d 0 2023-12-05T09:26:13.527 INFO:tasks.workunit.client.0.smithi067.stdout:7/239: readlink d0/l3d 0 2023-12-05T09:26:13.528 INFO:tasks.workunit.client.1.smithi134.stdout:3/254: link d4/d1f/l44 d4/d1f/l51 0 2023-12-05T09:26:13.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/149: mknod d0/d1d/c31 0 2023-12-05T09:26:13.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/150: write d0/d1d/f23 [4985561,123065] 0 2023-12-05T09:26:13.540 INFO:tasks.workunit.client.1.smithi134.stdout:2/281: truncate d19/d28/f4e 382675 0 2023-12-05T09:26:13.541 INFO:tasks.workunit.client.0.smithi067.stdout:0/267: getdents d3/d7 0 2023-12-05T09:26:13.547 INFO:tasks.workunit.client.0.smithi067.stdout:2/149: dwrite d0/d25/f2c [0,4194304] 0 2023-12-05T09:26:13.549 INFO:tasks.workunit.client.1.smithi134.stdout:3/255: write d4/d1f/f20 [3629297,93134] 0 2023-12-05T09:26:13.550 INFO:tasks.workunit.client.0.smithi067.stdout:9/352: rename d1b/d25/d35/f38 to d1b/f75 0 2023-12-05T09:26:13.550 INFO:tasks.workunit.client.0.smithi067.stdout:9/353: chown f10 3050950 1 2023-12-05T09:26:13.552 INFO:tasks.workunit.client.0.smithi067.stdout:8/188: write d5/f28 [1866738,67150] 0 2023-12-05T09:26:13.553 INFO:tasks.workunit.client.0.smithi067.stdout:8/189: read - d5/da/f2a zero size 2023-12-05T09:26:13.558 INFO:tasks.workunit.client.1.smithi134.stdout:4/275: rmdir d16/d18 39 2023-12-05T09:26:13.558 INFO:tasks.workunit.client.1.smithi134.stdout:9/215: dwrite d7/d8/d14/d26/f3e [0,4194304] 0 2023-12-05T09:26:13.560 INFO:tasks.workunit.client.1.smithi134.stdout:8/309: truncate da/f2a 679382 0 2023-12-05T09:26:13.561 INFO:tasks.workunit.client.0.smithi067.stdout:6/138: mknod da/d10/d1e/c32 0 2023-12-05T09:26:13.561 INFO:tasks.workunit.client.0.smithi067.stdout:6/139: stat da/d10/d1e/d17/d2f/c28 0 2023-12-05T09:26:13.568 INFO:tasks.workunit.client.0.smithi067.stdout:7/240: mkdir d0/d9/d3f/d4e 0 2023-12-05T09:26:13.573 INFO:tasks.workunit.client.0.smithi067.stdout:3/113: dwrite d9/f14 [0,4194304] 0 2023-12-05T09:26:13.573 INFO:tasks.workunit.client.0.smithi067.stdout:3/114: stat d9/da/d15/d17 0 2023-12-05T09:26:13.573 INFO:tasks.workunit.client.0.smithi067.stdout:3/115: getdents d9/d20 0 2023-12-05T09:26:13.576 INFO:tasks.workunit.client.0.smithi067.stdout:7/241: dread d0/f42 [0,4194304] 0 2023-12-05T09:26:13.580 INFO:tasks.workunit.client.0.smithi067.stdout:0/268: symlink d3/df/l60 0 2023-12-05T09:26:13.580 INFO:tasks.workunit.client.0.smithi067.stdout:0/269: dread - d3/df/f3f zero size 2023-12-05T09:26:13.582 INFO:tasks.workunit.client.1.smithi134.stdout:0/234: unlink d13/d14/d30/f3b 0 2023-12-05T09:26:13.587 INFO:tasks.workunit.client.1.smithi134.stdout:5/232: creat d0/dd/f51 x:0 0 0 2023-12-05T09:26:13.590 INFO:tasks.workunit.client.1.smithi134.stdout:2/282: creat d19/f5d x:0 0 0 2023-12-05T09:26:13.593 INFO:tasks.workunit.client.1.smithi134.stdout:3/256: getdents d4/d3f/d42 0 2023-12-05T09:26:13.593 INFO:tasks.workunit.client.1.smithi134.stdout:3/257: write d4/d3f/f48 [962669,78258] 0 2023-12-05T09:26:13.594 INFO:tasks.workunit.client.0.smithi067.stdout:3/116: dread d9/da/d15/d17/d1a/f1d [0,4194304] 0 2023-12-05T09:26:13.598 INFO:tasks.workunit.client.1.smithi134.stdout:4/276: mknod d16/c5f 0 2023-12-05T09:26:13.598 INFO:tasks.workunit.client.1.smithi134.stdout:4/277: dread - d16/d18/d1c/f42 zero size 2023-12-05T09:26:13.600 INFO:tasks.workunit.client.0.smithi067.stdout:9/354: mkdir d1b/d25/d54/d5c/d6a/d6c/d76 0 2023-12-05T09:26:13.601 INFO:tasks.workunit.client.0.smithi067.stdout:9/355: chown d1b/d25/c37 1358197 1 2023-12-05T09:26:13.604 INFO:tasks.workunit.client.1.smithi134.stdout:9/216: mknod d7/d10/c49 0 2023-12-05T09:26:13.608 INFO:tasks.workunit.client.0.smithi067.stdout:4/151: rename d0/d9/dd to d0/d1d/d25/d32 0 2023-12-05T09:26:13.608 INFO:tasks.workunit.client.0.smithi067.stdout:4/152: truncate d0/d1d/d25/d32/f16 699116 0 2023-12-05T09:26:13.612 INFO:tasks.workunit.client.1.smithi134.stdout:8/310: rename da/d1b/f3f to da/de/f66 0 2023-12-05T09:26:13.614 INFO:tasks.workunit.client.0.smithi067.stdout:8/190: symlink d5/dc/d1a/d20/d2d/l37 0 2023-12-05T09:26:13.614 INFO:tasks.workunit.client.0.smithi067.stdout:8/191: readlink d5/dc/l1b 0 2023-12-05T09:26:13.614 INFO:tasks.workunit.client.1.smithi134.stdout:9/217: write d7/d8/d14/f3d [3646129,61000] 0 2023-12-05T09:26:13.615 INFO:tasks.workunit.client.1.smithi134.stdout:9/218: creat d7/d8/d14/d26/f4a x:0 0 0 2023-12-05T09:26:13.615 INFO:tasks.workunit.client.1.smithi134.stdout:9/219: write d7/d8/d14/d26/f3e [4351637,15006] 0 2023-12-05T09:26:13.623 INFO:tasks.workunit.client.1.smithi134.stdout:6/226: mkdir d4/d39/d42 0 2023-12-05T09:26:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:13 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:26:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:13 smithi134 ceph-mon[116304]: pgmap v22: 65 pgs: 65 active+clean; 1.0 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 94 MiB/s rd, 122 MiB/s wr, 865 op/s 2023-12-05T09:26:13.630 INFO:tasks.workunit.client.0.smithi067.stdout:4/153: dread d0/f7 [0,4194304] 0 2023-12-05T09:26:13.632 INFO:tasks.workunit.client.1.smithi134.stdout:2/283: dwrite d19/d28/f41 [0,4194304] 0 2023-12-05T09:26:13.635 INFO:tasks.workunit.client.1.smithi134.stdout:9/220: dread d7/f1c [0,4194304] 0 2023-12-05T09:26:13.636 INFO:tasks.workunit.client.1.smithi134.stdout:9/221: fdatasync d7/d8/d16/f1f 0 2023-12-05T09:26:13.636 INFO:tasks.workunit.client.0.smithi067.stdout:7/242: link d0/d9/f2c d0/d9/f4f 0 2023-12-05T09:26:13.640 INFO:tasks.workunit.client.0.smithi067.stdout:9/356: mkdir d1b/d25/d35/d77 0 2023-12-05T09:26:13.644 INFO:tasks.workunit.client.0.smithi067.stdout:2/150: rename d0/d25/c2b to d0/d15/c33 0 2023-12-05T09:26:13.644 INFO:tasks.workunit.client.1.smithi134.stdout:0/235: rmdir d13/d14/d15 39 2023-12-05T09:26:13.648 INFO:tasks.workunit.client.0.smithi067.stdout:3/117: dwrite d9/da/f19 [0,4194304] 0 2023-12-05T09:26:13.648 INFO:tasks.workunit.client.0.smithi067.stdout:3/118: fsync f6 0 2023-12-05T09:26:13.650 INFO:tasks.workunit.client.1.smithi134.stdout:8/311: truncate da/de/f66 298572 0 2023-12-05T09:26:13.650 INFO:tasks.workunit.client.1.smithi134.stdout:8/312: fsync da/de/d16/f58 0 2023-12-05T09:26:13.650 INFO:tasks.workunit.client.1.smithi134.stdout:8/313: stat da/de/d11/f1a 0 2023-12-05T09:26:13.653 INFO:tasks.workunit.client.0.smithi067.stdout:9/357: mkdir d1b/d25/d54/d5c/d6a/d6c/d78 0 2023-12-05T09:26:13.654 INFO:tasks.workunit.client.1.smithi134.stdout:4/278: rmdir d16/d21/d48 39 2023-12-05T09:26:13.654 INFO:tasks.workunit.client.1.smithi134.stdout:8/314: dread da/de/d16/d33/f56 [0,4194304] 0 2023-12-05T09:26:13.657 INFO:tasks.workunit.client.0.smithi067.stdout:7/243: rename d0/d9/f4f to d0/d9/d40/d48/f50 0 2023-12-05T09:26:13.659 INFO:tasks.workunit.client.1.smithi134.stdout:6/227: creat d4/d2a/f43 x:0 0 0 2023-12-05T09:26:13.659 INFO:tasks.workunit.client.1.smithi134.stdout:6/228: chown d4/d2a/f43 0 1 2023-12-05T09:26:13.661 INFO:tasks.workunit.client.0.smithi067.stdout:2/151: mkdir d0/d25/d34 0 2023-12-05T09:26:13.668 INFO:tasks.workunit.client.1.smithi134.stdout:1/299: sync 2023-12-05T09:26:13.668 INFO:tasks.workunit.client.1.smithi134.stdout:1/300: dread - d2/d27/f59 zero size 2023-12-05T09:26:13.670 INFO:tasks.workunit.client.1.smithi134.stdout:8/315: dread da/f29 [0,4194304] 0 2023-12-05T09:26:13.671 INFO:tasks.workunit.client.1.smithi134.stdout:2/284: symlink d19/d49/l5e 0 2023-12-05T09:26:13.671 INFO:tasks.workunit.client.1.smithi134.stdout:2/285: fsync f8 0 2023-12-05T09:26:13.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/237: sync 2023-12-05T09:26:13.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/238: stat d2/d7/dc/f2c 0 2023-12-05T09:26:13.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/239: write d2/d7/dc/d2e/d3a/f49 [1109302,29901] 0 2023-12-05T09:26:13.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/119: dread d9/da/d15/f1b [0,4194304] 0 2023-12-05T09:26:13.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/120: readlink d9/da/d15/l21 0 2023-12-05T09:26:13.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/121: chown d9/fe 27 1 2023-12-05T09:26:13.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/122: chown d9/da/f19 787 1 2023-12-05T09:26:13.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/123: stat f0 0 2023-12-05T09:26:13.673 INFO:tasks.workunit.client.0.smithi067.stdout:0/270: dwrite d3/f58 [0,4194304] 0 2023-12-05T09:26:13.673 INFO:tasks.workunit.client.0.smithi067.stdout:0/271: fdatasync d3/d7/f29 0 2023-12-05T09:26:13.673 INFO:tasks.workunit.client.0.smithi067.stdout:0/272: truncate d3/f31 254623 0 2023-12-05T09:26:13.674 INFO:tasks.workunit.client.0.smithi067.stdout:8/192: getdents d5/dc 0 2023-12-05T09:26:13.674 INFO:tasks.workunit.client.0.smithi067.stdout:8/193: chown d5/dc/d1a/d20/d2d 1446955 1 2023-12-05T09:26:13.674 INFO:tasks.workunit.client.1.smithi134.stdout:5/233: unlink d0/l8 0 2023-12-05T09:26:13.674 INFO:tasks.workunit.client.1.smithi134.stdout:5/234: read - d0/dd/f20 zero size 2023-12-05T09:26:13.676 INFO:tasks.workunit.client.1.smithi134.stdout:9/222: mkdir d7/d10/d4b 0 2023-12-05T09:26:13.676 INFO:tasks.workunit.client.1.smithi134.stdout:6/229: read d4/d2a/d3a/da/d1b/f21 [1820680,1406] 0 2023-12-05T09:26:13.677 INFO:tasks.workunit.client.0.smithi067.stdout:7/244: creat d0/d9/d10/d37/d38/f51 x:0 0 0 2023-12-05T09:26:13.679 INFO:tasks.workunit.client.1.smithi134.stdout:0/236: mkdir d13/d14/d30/d2c/d48 0 2023-12-05T09:26:13.681 INFO:tasks.workunit.client.0.smithi067.stdout:2/152: rename d0/f4 to d0/d10/d1e/f35 0 2023-12-05T09:26:13.682 INFO:tasks.workunit.client.0.smithi067.stdout:2/153: write d0/d15/f2a [70914,60486] 0 2023-12-05T09:26:13.682 INFO:tasks.workunit.client.0.smithi067.stdout:2/154: write d0/d15/f1b [4499272,10888] 0 2023-12-05T09:26:13.684 INFO:tasks.workunit.client.0.smithi067.stdout:3/124: mkdir d9/d24 0 2023-12-05T09:26:13.686 INFO:tasks.workunit.client.1.smithi134.stdout:4/279: unlink d16/d18/f36 0 2023-12-05T09:26:13.690 INFO:tasks.workunit.client.1.smithi134.stdout:1/301: creat d2/d9/d10/d5b/d5e/f6d x:0 0 0 2023-12-05T09:26:13.690 INFO:tasks.workunit.client.1.smithi134.stdout:1/302: chown d2/d9/lc 4980970 1 2023-12-05T09:26:13.693 INFO:tasks.workunit.client.1.smithi134.stdout:8/316: mknod da/de/d16/d2d/c67 0 2023-12-05T09:26:13.693 INFO:tasks.workunit.client.1.smithi134.stdout:4/280: dread d16/d21/d50/f51 [0,4194304] 0 2023-12-05T09:26:13.698 INFO:tasks.workunit.client.0.smithi067.stdout:8/194: symlink d5/da/d30/l38 0 2023-12-05T09:26:13.699 INFO:tasks.workunit.client.0.smithi067.stdout:7/245: unlink d0/l20 0 2023-12-05T09:26:13.699 INFO:tasks.workunit.client.1.smithi134.stdout:2/286: mkdir d19/d5f 0 2023-12-05T09:26:13.699 INFO:tasks.workunit.client.1.smithi134.stdout:2/287: dread - d19/d3a/f52 zero size 2023-12-05T09:26:13.699 INFO:tasks.workunit.client.1.smithi134.stdout:2/288: stat d19/d28/d31 0 2023-12-05T09:26:13.700 INFO:tasks.workunit.client.0.smithi067.stdout:3/125: symlink d9/da/d15/d17/d1a/l25 0 2023-12-05T09:26:13.701 INFO:tasks.workunit.client.1.smithi134.stdout:7/240: link d2/df/c44 d2/d7/dc/c4f 0 2023-12-05T09:26:13.701 INFO:tasks.workunit.client.1.smithi134.stdout:7/241: chown d2/d7/dc/d2e/d3a/l42 80459 1 2023-12-05T09:26:13.707 INFO:tasks.workunit.client.1.smithi134.stdout:8/317: dread da/de/d11/f34 [0,4194304] 0 2023-12-05T09:26:13.710 INFO:tasks.workunit.client.1.smithi134.stdout:9/223: creat d7/d8/f4c x:0 0 0 2023-12-05T09:26:13.710 INFO:tasks.workunit.client.1.smithi134.stdout:5/235: write d0/d1a/d3a/f49 [66520,58435] 0 2023-12-05T09:26:13.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/230: write d4/d39/f37 [1329479,110606] 0 2023-12-05T09:26:13.712 INFO:tasks.workunit.client.0.smithi067.stdout:3/126: creat d9/d24/f26 x:0 0 0 2023-12-05T09:26:13.716 INFO:tasks.workunit.client.1.smithi134.stdout:0/237: creat d13/d14/d15/d2a/f49 x:0 0 0 2023-12-05T09:26:13.716 INFO:tasks.workunit.client.1.smithi134.stdout:0/238: creat d13/d14/d15/d2a/f4a x:0 0 0 2023-12-05T09:26:13.716 INFO:tasks.workunit.client.1.smithi134.stdout:0/239: stat d13/d14/d30/l1e 0 2023-12-05T09:26:13.716 INFO:tasks.workunit.client.1.smithi134.stdout:0/240: write d13/f35 [989100,36559] 0 2023-12-05T09:26:13.716 INFO:tasks.workunit.client.1.smithi134.stdout:2/289: truncate fc 2250067 0 2023-12-05T09:26:13.717 INFO:tasks.workunit.client.1.smithi134.stdout:4/281: creat d16/d21/d35/f60 x:0 0 0 2023-12-05T09:26:13.730 INFO:tasks.workunit.client.1.smithi134.stdout:8/318: dread da/de/d43/f46 [0,4194304] 0 2023-12-05T09:26:13.730 INFO:tasks.workunit.client.1.smithi134.stdout:8/319: write da/f2a [1349918,93584] 0 2023-12-05T09:26:13.730 INFO:tasks.workunit.client.1.smithi134.stdout:8/320: chown da/de/f41 484 1 2023-12-05T09:26:13.732 INFO:tasks.workunit.client.1.smithi134.stdout:8/321: mkdir da/de/d4d/d68 0 2023-12-05T09:26:13.734 INFO:tasks.workunit.client.0.smithi067.stdout:0/273: dwrite d3/df/f16 [0,4194304] 0 2023-12-05T09:26:13.738 INFO:tasks.workunit.client.1.smithi134.stdout:8/322: symlink da/de/d16/d45/l69 0 2023-12-05T09:26:13.750 INFO:tasks.workunit.client.0.smithi067.stdout:8/195: write d5/da/f17 [2021362,20502] 0 2023-12-05T09:26:13.766 INFO:tasks.workunit.client.1.smithi134.stdout:7/242: dwrite d2/f41 [0,4194304] 0 2023-12-05T09:26:13.768 INFO:tasks.workunit.client.1.smithi134.stdout:2/290: write fa [1841486,114091] 0 2023-12-05T09:26:13.769 INFO:tasks.workunit.client.0.smithi067.stdout:0/274: dread d3/d7/d30/f4a [0,4194304] 0 2023-12-05T09:26:13.769 INFO:tasks.workunit.client.0.smithi067.stdout:0/275: chown d3/d7/d3c 380 1 2023-12-05T09:26:13.769 INFO:tasks.workunit.client.0.smithi067.stdout:2/155: dwrite d0/d15/f27 [0,4194304] 0 2023-12-05T09:26:13.772 INFO:tasks.workunit.client.1.smithi134.stdout:5/236: dread d0/d1a/d3a/f49 [0,4194304] 0 2023-12-05T09:26:13.773 INFO:tasks.workunit.client.1.smithi134.stdout:1/303: dwrite d2/f17 [0,4194304] 0 2023-12-05T09:26:13.774 INFO:tasks.workunit.client.0.smithi067.stdout:8/196: dread d5/f14 [0,4194304] 0 2023-12-05T09:26:13.775 INFO:tasks.workunit.client.1.smithi134.stdout:6/231: dwrite d4/d2a/d3a/da/d1b/f21 [4194304,4194304] 0 2023-12-05T09:26:13.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/246: dwrite d0/d9/d40/d48/f50 [0,4194304] 0 2023-12-05T09:26:13.775 INFO:tasks.workunit.client.0.smithi067.stdout:7/247: write d0/f4c [633919,27683] 0 2023-12-05T09:26:13.776 INFO:tasks.workunit.client.1.smithi134.stdout:4/282: dwrite d16/d18/d1c/f3a [0,4194304] 0 2023-12-05T09:26:13.780 INFO:tasks.workunit.client.0.smithi067.stdout:7/248: dread d0/d9/d10/f44 [0,4194304] 0 2023-12-05T09:26:13.787 INFO:tasks.workunit.client.1.smithi134.stdout:2/291: dread f1 [0,4194304] 0 2023-12-05T09:26:13.896 INFO:tasks.workunit.client.1.smithi134.stdout:7/243: mknod d2/df/c50 0 2023-12-05T09:26:13.896 INFO:tasks.workunit.client.1.smithi134.stdout:7/244: readlink d2/d7/dc/l29 0 2023-12-05T09:26:13.896 INFO:tasks.workunit.client.1.smithi134.stdout:7/245: write d2/d7/dc/d2e/d3a/f4e [219146,58325] 0 2023-12-05T09:26:13.897 INFO:tasks.workunit.client.1.smithi134.stdout:3/258: rename d4/d3f to d4/d1f/d50/d52 0 2023-12-05T09:26:13.897 INFO:tasks.workunit.client.1.smithi134.stdout:3/259: fdatasync d4/d5/f1e 0 2023-12-05T09:26:13.897 INFO:tasks.workunit.client.1.smithi134.stdout:3/260: write d4/f1b [4681728,62294] 0 2023-12-05T09:26:13.897 INFO:tasks.workunit.client.0.smithi067.stdout:0/276: mknod d3/d7/d3c/d57/c61 0 2023-12-05T09:26:13.897 INFO:tasks.workunit.client.1.smithi134.stdout:1/304: symlink d2/d9/d10/l6e 0 2023-12-05T09:26:13.898 INFO:tasks.workunit.client.0.smithi067.stdout:2/156: truncate d0/fd 2349479 0 2023-12-05T09:26:13.900 INFO:tasks.workunit.client.1.smithi134.stdout:6/232: symlink d4/d2a/d3a/da/d1b/l44 0 2023-12-05T09:26:13.905 INFO:tasks.workunit.client.0.smithi067.stdout:8/197: unlink d5/l6 0 2023-12-05T09:26:13.906 INFO:tasks.workunit.client.0.smithi067.stdout:7/249: truncate d0/d9/d10/f32 1577306 0 2023-12-05T09:26:13.907 INFO:tasks.workunit.client.1.smithi134.stdout:4/283: creat d16/d18/d1b/d24/f61 x:0 0 0 2023-12-05T09:26:13.908 INFO:tasks.workunit.client.0.smithi067.stdout:2/157: mknod d0/d10/c36 0 2023-12-05T09:26:13.908 INFO:tasks.workunit.client.0.smithi067.stdout:2/158: write d0/f9 [2221903,25709] 0 2023-12-05T09:26:13.910 INFO:tasks.workunit.client.1.smithi134.stdout:2/292: truncate d19/f25 2488934 0 2023-12-05T09:26:13.910 INFO:tasks.workunit.client.1.smithi134.stdout:9/224: rename d7/c19 to d7/d8/d14/c4d 0 2023-12-05T09:26:13.911 INFO:tasks.workunit.client.0.smithi067.stdout:2/159: creat d0/d2f/f37 x:0 0 0 2023-12-05T09:26:13.913 INFO:tasks.workunit.client.0.smithi067.stdout:2/160: truncate d0/d10/f19 1234459 0 2023-12-05T09:26:13.915 INFO:tasks.workunit.client.1.smithi134.stdout:3/261: mknod d4/d5/c53 0 2023-12-05T09:26:13.915 INFO:tasks.workunit.client.1.smithi134.stdout:3/262: fsync d4/d1f/f3a 0 2023-12-05T09:26:13.915 INFO:tasks.workunit.client.1.smithi134.stdout:6/233: mkdir d4/d2a/d45 0 2023-12-05T09:26:13.916 INFO:tasks.workunit.client.1.smithi134.stdout:4/284: unlink d16/d18/d1c/f42 0 2023-12-05T09:26:13.916 INFO:tasks.workunit.client.1.smithi134.stdout:4/285: readlink d16/d18/d1a/d3b/l56 0 2023-12-05T09:26:13.916 INFO:tasks.workunit.client.1.smithi134.stdout:4/286: write f15 [4883478,40916] 0 2023-12-05T09:26:13.917 INFO:tasks.workunit.client.1.smithi134.stdout:4/287: stat d16/d18/d1a/f43 0 2023-12-05T09:26:13.919 INFO:tasks.workunit.client.1.smithi134.stdout:3/263: mknod d4/d1f/d50/d52/c54 0 2023-12-05T09:26:13.920 INFO:tasks.workunit.client.1.smithi134.stdout:5/237: dread d0/fc [0,4194304] 0 2023-12-05T09:26:13.920 INFO:tasks.workunit.client.1.smithi134.stdout:7/246: write d2/dd/d1a/f23 [3237110,73855] 0 2023-12-05T09:26:13.920 INFO:tasks.workunit.client.1.smithi134.stdout:7/247: fdatasync d2/d7/dc/f34 0 2023-12-05T09:26:13.920 INFO:tasks.workunit.client.1.smithi134.stdout:6/234: creat d4/f46 x:0 0 0 2023-12-05T09:26:13.920 INFO:tasks.workunit.client.1.smithi134.stdout:6/235: write d4/d39/f37 [1752732,20836] 0 2023-12-05T09:26:13.924 INFO:tasks.workunit.client.1.smithi134.stdout:2/293: rmdir d19/d3a 39 2023-12-05T09:26:13.924 INFO:tasks.workunit.client.1.smithi134.stdout:3/264: mknod d4/d1f/d4e/c55 0 2023-12-05T09:26:13.924 INFO:tasks.workunit.client.1.smithi134.stdout:3/265: dread - d4/d5/d45/f46 zero size 2023-12-05T09:26:13.925 INFO:tasks.workunit.client.0.smithi067.stdout:0/277: dread d3/d7/d30/f4a [0,4194304] 0 2023-12-05T09:26:13.927 INFO:tasks.workunit.client.1.smithi134.stdout:7/248: symlink d2/d7/dc/d2e/d3a/l51 0 2023-12-05T09:26:13.928 INFO:tasks.workunit.client.1.smithi134.stdout:7/249: dread - d2/f21 zero size 2023-12-05T09:26:13.928 INFO:tasks.workunit.client.1.smithi134.stdout:7/250: dread - d2/f21 zero size 2023-12-05T09:26:13.929 INFO:tasks.workunit.client.0.smithi067.stdout:0/278: rmdir d3/d7/d3c 39 2023-12-05T09:26:13.935 INFO:tasks.workunit.client.1.smithi134.stdout:0/241: rename d13/d1f to d13/d14/d30/d4b 0 2023-12-05T09:26:13.935 INFO:tasks.workunit.client.1.smithi134.stdout:0/242: write d13/d14/d30/f32 [208088,21183] 0 2023-12-05T09:26:13.935 INFO:tasks.workunit.client.1.smithi134.stdout:0/243: chown d13/d14/d30/c2e 7 1 2023-12-05T09:26:13.935 INFO:tasks.workunit.client.1.smithi134.stdout:0/244: creat d13/d14/d15/d2a/f4c x:0 0 0 2023-12-05T09:26:13.936 INFO:tasks.workunit.client.0.smithi067.stdout:8/198: dwrite d5/dc/d1a/d20/f25 [0,4194304] 0 2023-12-05T09:26:13.947 INFO:tasks.workunit.client.0.smithi067.stdout:0/279: write d3/d7/f29 [3181726,94228] 0 2023-12-05T09:26:13.954 INFO:tasks.workunit.client.1.smithi134.stdout:9/225: write d7/d8/d14/f46 [1970160,124886] 0 2023-12-05T09:26:13.968 INFO:tasks.workunit.client.1.smithi134.stdout:2/294: mkdir d19/d3a/d60 0 2023-12-05T09:26:13.969 INFO:tasks.workunit.client.1.smithi134.stdout:2/295: chown d19/d28/f33 83261 1 2023-12-05T09:26:13.969 INFO:tasks.workunit.client.0.smithi067.stdout:8/199: rmdir d5/da/d30 39 2023-12-05T09:26:13.970 INFO:tasks.workunit.client.1.smithi134.stdout:9/226: dread f1 [0,4194304] 0 2023-12-05T09:26:13.970 INFO:tasks.workunit.client.1.smithi134.stdout:3/266: creat d4/d1f/d50/d52/d42/f56 x:0 0 0 2023-12-05T09:26:13.971 INFO:tasks.workunit.client.1.smithi134.stdout:6/236: dwrite d4/d2a/d3a/f36 [0,4194304] 0 2023-12-05T09:26:13.971 INFO:tasks.workunit.client.1.smithi134.stdout:6/237: chown d4/d2a/d3a/da/d1b/l3b 78673763 1 2023-12-05T09:26:13.971 INFO:tasks.workunit.client.1.smithi134.stdout:6/238: write d4/f17 [1103358,40139] 0 2023-12-05T09:26:13.987 INFO:tasks.workunit.client.0.smithi067.stdout:8/200: write d5/dc/d1a/d20/f22 [1668897,77794] 0 2023-12-05T09:26:14.016 INFO:tasks.workunit.client.1.smithi134.stdout:6/239: dwrite d4/f46 [0,4194304] 0 2023-12-05T09:26:14.026 INFO:tasks.workunit.client.1.smithi134.stdout:6/240: read d4/d2a/d3a/f36 [3776416,121662] 0 2023-12-05T09:26:14.407 INFO:tasks.workunit.client.0.smithi067.stdout:0/280: link d3/c2e d3/d7/d3c/d49/d59/c62 0 2023-12-05T09:26:14.409 INFO:tasks.workunit.client.1.smithi134.stdout:8/323: rename da/de/d16/d45/d3b/f47 to da/de/d11/f6a 0 2023-12-05T09:26:14.410 INFO:tasks.workunit.client.0.smithi067.stdout:2/161: truncate d0/d10/d1e/f35 2842666 0 2023-12-05T09:26:14.423 INFO:tasks.workunit.client.0.smithi067.stdout:2/162: dread d0/d10/f1d [4194304,4194304] 0 2023-12-05T09:26:14.464 INFO:tasks.workunit.client.0.smithi067.stdout:8/201: mknod d5/da/c39 0 2023-12-05T09:26:14.464 INFO:tasks.workunit.client.1.smithi134.stdout:0/245: mknod d13/d14/d15/c4d 0 2023-12-05T09:26:14.465 INFO:tasks.workunit.client.0.smithi067.stdout:7/250: write d0/d9/d10/f32 [582924,52590] 0 2023-12-05T09:26:14.471 INFO:tasks.workunit.client.1.smithi134.stdout:9/227: mknod d7/d8/d2e/c4e 0 2023-12-05T09:26:14.471 INFO:tasks.workunit.client.1.smithi134.stdout:9/228: write d7/f1c [4650237,33658] 0 2023-12-05T09:26:14.481 INFO:tasks.workunit.client.1.smithi134.stdout:6/241: mknod d4/d2a/d45/c47 0 2023-12-05T09:26:14.481 INFO:tasks.workunit.client.1.smithi134.stdout:6/242: write d4/d2a/d3a/da/f19 [2025097,40219] 0 2023-12-05T09:26:14.482 INFO:tasks.workunit.client.1.smithi134.stdout:4/288: rename d16/d21/d48/f4c to d16/d21/f62 0 2023-12-05T09:26:14.482 INFO:tasks.workunit.client.1.smithi134.stdout:4/289: dread - d16/d21/d35/f60 zero size 2023-12-05T09:26:14.485 INFO:tasks.workunit.client.1.smithi134.stdout:8/324: symlink da/de/d16/d45/d3b/l6b 0 2023-12-05T09:26:14.486 INFO:tasks.workunit.client.0.smithi067.stdout:8/202: unlink d5/dc/d1a/l27 0 2023-12-05T09:26:14.489 INFO:tasks.workunit.client.1.smithi134.stdout:2/296: getdents d19 0 2023-12-05T09:26:14.490 INFO:tasks.workunit.client.0.smithi067.stdout:7/251: truncate d0/d9/d1b/d34/f36 2365259 0 2023-12-05T09:26:14.495 INFO:tasks.workunit.client.1.smithi134.stdout:9/229: symlink d7/d8/l4f 0 2023-12-05T09:26:14.495 INFO:tasks.workunit.client.1.smithi134.stdout:9/230: fsync d7/f47 0 2023-12-05T09:26:14.497 INFO:tasks.workunit.client.1.smithi134.stdout:6/243: write d4/ff [941221,85399] 0 2023-12-05T09:26:14.498 INFO:tasks.workunit.client.1.smithi134.stdout:6/244: readlink d4/d2a/d3a/da/d1b/l44 0 2023-12-05T09:26:14.502 INFO:tasks.workunit.client.0.smithi067.stdout:8/203: mkdir d5/d3a 0 2023-12-05T09:26:14.515 INFO:tasks.workunit.client.1.smithi134.stdout:4/290: mkdir d16/d18/d1c/d63 0 2023-12-05T09:26:14.515 INFO:tasks.workunit.client.1.smithi134.stdout:5/238: rename d0/c3c to d0/dd/c52 0 2023-12-05T09:26:14.516 INFO:tasks.workunit.client.1.smithi134.stdout:5/239: write d0/f7 [1614103,66175] 0 2023-12-05T09:26:14.516 INFO:tasks.workunit.client.1.smithi134.stdout:8/325: unlink da/de/f40 0 2023-12-05T09:26:14.517 INFO:tasks.workunit.client.1.smithi134.stdout:9/231: dread f3 [0,4194304] 0 2023-12-05T09:26:14.517 INFO:tasks.workunit.client.1.smithi134.stdout:9/232: write d7/d8/d2e/f31 [2795130,39719] 0 2023-12-05T09:26:14.519 INFO:tasks.workunit.client.1.smithi134.stdout:8/326: creat da/de/d4d/f6c x:0 0 0 2023-12-05T09:26:14.520 INFO:tasks.workunit.client.0.smithi067.stdout:0/281: truncate d3/df/f16 3554019 0 2023-12-05T09:26:14.522 INFO:tasks.workunit.client.1.smithi134.stdout:1/305: sync 2023-12-05T09:26:14.524 INFO:tasks.workunit.client.1.smithi134.stdout:1/306: rmdir d2/d9/d10/d5b/d5e 39 2023-12-05T09:26:14.528 INFO:tasks.workunit.client.1.smithi134.stdout:7/251: rename d2/dd/l11 to d2/l52 0 2023-12-05T09:26:14.529 INFO:tasks.workunit.client.1.smithi134.stdout:7/252: write f1 [3617302,104290] 0 2023-12-05T09:26:14.535 INFO:tasks.workunit.client.1.smithi134.stdout:3/267: rename d4/d1f/d50/d52/d42/l2c to d4/d1f/l57 0 2023-12-05T09:26:14.535 INFO:tasks.workunit.client.1.smithi134.stdout:3/268: chown d4/f16 5 1 2023-12-05T09:26:14.541 INFO:tasks.workunit.client.1.smithi134.stdout:3/269: creat d4/d1f/d50/d52/f58 x:0 0 0 2023-12-05T09:26:14.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/246: rename d13/d14/d30/f2f to d13/d14/d30/d4b/f4e 0 2023-12-05T09:26:14.546 INFO:tasks.workunit.client.1.smithi134.stdout:3/270: creat d4/d1f/d4e/f59 x:0 0 0 2023-12-05T09:26:14.549 INFO:tasks.workunit.client.1.smithi134.stdout:3/271: chown d4/d5/f11 32199 1 2023-12-05T09:26:14.549 INFO:tasks.workunit.client.1.smithi134.stdout:3/272: truncate d4/f34 83300 0 2023-12-05T09:26:14.558 INFO:tasks.workunit.client.1.smithi134.stdout:1/307: symlink d2/l6f 0 2023-12-05T09:26:14.558 INFO:tasks.workunit.client.1.smithi134.stdout:2/297: rename d19/d28/d31/d38/c54 to d19/d3a/c61 0 2023-12-05T09:26:14.559 INFO:tasks.workunit.client.1.smithi134.stdout:1/308: read d2/d27/d40/f5d [5854,43167] 0 2023-12-05T09:26:14.559 INFO:tasks.workunit.client.1.smithi134.stdout:1/309: chown d2/d9/d10/c36 0 1 2023-12-05T09:26:14.559 INFO:tasks.workunit.client.1.smithi134.stdout:1/310: dread - d2/d9/d10/f67 zero size 2023-12-05T09:26:14.561 INFO:tasks.workunit.client.0.smithi067.stdout:2/163: dwrite d0/fd [0,4194304] 0 2023-12-05T09:26:14.564 INFO:tasks.workunit.client.1.smithi134.stdout:2/298: mkdir d19/d3a/d62 0 2023-12-05T09:26:14.566 INFO:tasks.workunit.client.1.smithi134.stdout:8/327: rename da/de/d11/d1d/l1f to da/d1b/l6d 0 2023-12-05T09:26:14.568 INFO:tasks.workunit.client.0.smithi067.stdout:2/164: rename d0/d25/f2c to d0/d25/d34/f38 0 2023-12-05T09:26:14.570 INFO:tasks.workunit.client.1.smithi134.stdout:7/253: unlink d2/d7/dc/l1d 0 2023-12-05T09:26:14.571 INFO:tasks.workunit.client.1.smithi134.stdout:7/254: write d2/dd/f19 [344156,83054] 0 2023-12-05T09:26:14.571 INFO:tasks.workunit.client.1.smithi134.stdout:1/311: creat d2/d9/d10/d30/d4a/f70 x:0 0 0 2023-12-05T09:26:14.573 INFO:tasks.workunit.client.1.smithi134.stdout:6/245: dwrite d4/d2a/d3a/da/d1b/f21 [4194304,4194304] 0 2023-12-05T09:26:14.575 INFO:tasks.workunit.client.0.smithi067.stdout:2/165: mkdir d0/d2f/d39 0 2023-12-05T09:26:14.578 INFO:tasks.workunit.client.1.smithi134.stdout:2/299: dread d19/d28/f2a [0,4194304] 0 2023-12-05T09:26:14.578 INFO:tasks.workunit.client.1.smithi134.stdout:2/300: readlink d19/d28/l37 0 2023-12-05T09:26:14.578 INFO:tasks.workunit.client.1.smithi134.stdout:2/301: fdatasync fc 0 2023-12-05T09:26:14.578 INFO:tasks.workunit.client.1.smithi134.stdout:2/302: readlink d19/d28/l53 0 2023-12-05T09:26:14.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/255: mknod d2/df/c53 0 2023-12-05T09:26:14.578 INFO:tasks.workunit.client.1.smithi134.stdout:1/312: mkdir d2/d27/d71 0 2023-12-05T09:26:14.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/256: write f1 [3016114,96666] 0 2023-12-05T09:26:14.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/257: chown d2/dd/d1a/l4b 176720081 1 2023-12-05T09:26:14.582 INFO:tasks.workunit.client.1.smithi134.stdout:3/273: write f3 [4026744,114869] 0 2023-12-05T09:26:14.582 INFO:tasks.workunit.client.1.smithi134.stdout:3/274: write d4/d1f/d50/d52/d42/f56 [427590,98443] 0 2023-12-05T09:26:14.582 INFO:tasks.workunit.client.1.smithi134.stdout:6/246: dread - d4/d39/f3e zero size 2023-12-05T09:26:14.582 INFO:tasks.workunit.client.1.smithi134.stdout:1/313: rename d2/d9/d10/d5b/d5e/l6b to d2/d9/d10/l72 0 2023-12-05T09:26:14.583 INFO:tasks.workunit.client.1.smithi134.stdout:1/314: symlink d2/l73 0 2023-12-05T09:26:14.584 INFO:tasks.workunit.client.1.smithi134.stdout:1/315: mkdir d2/d56/d74 0 2023-12-05T09:26:14.584 INFO:tasks.workunit.client.1.smithi134.stdout:6/247: write d4/d2a/d3a/da/f19 [1447319,117270] 0 2023-12-05T09:26:14.585 INFO:tasks.workunit.client.1.smithi134.stdout:6/248: creat d4/d2a/f48 x:0 0 0 2023-12-05T09:26:14.585 INFO:tasks.workunit.client.1.smithi134.stdout:1/316: write d2/d9/d10/f13 [442963,103577] 0 2023-12-05T09:26:14.587 INFO:tasks.workunit.client.1.smithi134.stdout:1/317: mkdir d2/d27/d75 0 2023-12-05T09:26:14.589 INFO:tasks.workunit.client.1.smithi134.stdout:6/249: rmdir d4/d39 39 2023-12-05T09:26:14.589 INFO:tasks.workunit.client.1.smithi134.stdout:1/318: link d2/d9/d10/d30/l3b d2/d9/d10/d30/d66/l76 0 2023-12-05T09:26:14.591 INFO:tasks.workunit.client.1.smithi134.stdout:4/291: dwrite d16/d18/d1a/d3b/f5a [0,4194304] 0 2023-12-05T09:26:14.593 INFO:tasks.workunit.client.1.smithi134.stdout:6/250: getdents d4/d2a/d3a/da/d1b 0 2023-12-05T09:26:14.593 INFO:tasks.workunit.client.1.smithi134.stdout:6/251: fsync d4/d39/f12 0 2023-12-05T09:26:14.594 INFO:tasks.workunit.client.1.smithi134.stdout:4/292: write d16/d21/f57 [343649,99887] 0 2023-12-05T09:26:14.595 INFO:tasks.workunit.client.0.smithi067.stdout:7/252: dwrite d0/f7 [0,4194304] 0 2023-12-05T09:26:14.595 INFO:tasks.workunit.client.0.smithi067.stdout:7/253: chown d0/d9/d10/f35 5 1 2023-12-05T09:26:14.595 INFO:tasks.workunit.client.0.smithi067.stdout:0/282: dwrite d3/d7/d3c/d49/d59/f41 [0,4194304] 0 2023-12-05T09:26:14.601 INFO:tasks.workunit.client.1.smithi134.stdout:4/293: symlink d16/d18/d5b/l64 0 2023-12-05T09:26:14.607 INFO:tasks.workunit.client.1.smithi134.stdout:9/233: dwrite d7/d8/d14/f3d [4194304,4194304] 0 2023-12-05T09:26:14.607 INFO:tasks.workunit.client.1.smithi134.stdout:9/234: creat d7/d8/f50 x:0 0 0 2023-12-05T09:26:14.607 INFO:tasks.workunit.client.1.smithi134.stdout:9/235: dread - d7/d8/f4c zero size 2023-12-05T09:26:14.607 INFO:tasks.workunit.client.1.smithi134.stdout:0/247: dwrite d13/d14/d15/f43 [0,4194304] 0 2023-12-05T09:26:14.607 INFO:tasks.workunit.client.1.smithi134.stdout:0/248: dread - d13/d14/d15/d2a/f3e zero size 2023-12-05T09:26:14.608 INFO:tasks.workunit.client.0.smithi067.stdout:2/166: dread d0/fd [0,4194304] 0 2023-12-05T09:26:14.610 INFO:tasks.workunit.client.1.smithi134.stdout:4/294: readlink d16/d18/d1b/d24/l3c 0 2023-12-05T09:26:14.613 INFO:tasks.workunit.client.0.smithi067.stdout:2/167: truncate d0/d10/f1d 4356086 0 2023-12-05T09:26:14.614 INFO:tasks.workunit.client.1.smithi134.stdout:6/252: dread d4/d2a/d3a/da/f19 [0,4194304] 0 2023-12-05T09:26:14.616 INFO:tasks.workunit.client.1.smithi134.stdout:7/258: dread d2/d7/dc/f31 [0,4194304] 0 2023-12-05T09:26:14.616 INFO:tasks.workunit.client.0.smithi067.stdout:2/168: mkdir d0/d25/d3a 0 2023-12-05T09:26:14.621 INFO:tasks.workunit.client.0.smithi067.stdout:2/169: unlink d0/d25/c26 0 2023-12-05T09:26:14.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/170: symlink d0/d25/d34/l3b 0 2023-12-05T09:26:14.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/171: write d0/d15/f27 [4459089,100404] 0 2023-12-05T09:26:14.625 INFO:tasks.workunit.client.0.smithi067.stdout:2/172: readlink d0/d10/l1c 0 2023-12-05T09:26:14.625 INFO:tasks.workunit.client.1.smithi134.stdout:9/236: symlink d7/d8/d14/d26/l51 0 2023-12-05T09:26:14.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/249: creat d13/d14/f4f x:0 0 0 2023-12-05T09:26:14.625 INFO:tasks.workunit.client.0.smithi067.stdout:2/173: rmdir d0 39 2023-12-05T09:26:14.626 INFO:tasks.workunit.client.1.smithi134.stdout:8/328: dwrite da/de/d11/d1d/f2e [0,4194304] 0 2023-12-05T09:26:14.630 INFO:tasks.workunit.client.1.smithi134.stdout:7/259: mknod d2/d7/dc/d2e/d3a/c54 0 2023-12-05T09:26:14.632 INFO:tasks.workunit.client.1.smithi134.stdout:9/237: rename d7/d8/d16/d3c to d7/d8/d16/d52 0 2023-12-05T09:26:14.632 INFO:tasks.workunit.client.1.smithi134.stdout:9/238: chown d7/d8/d14/d26/c30 68 1 2023-12-05T09:26:14.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/295: dread d16/d18/d1a/d3b/f5a [0,4194304] 0 2023-12-05T09:26:14.639 INFO:tasks.workunit.client.1.smithi134.stdout:8/329: rename da/f3a to da/d1b/f6e 0 2023-12-05T09:26:14.641 INFO:tasks.workunit.client.1.smithi134.stdout:9/239: mkdir d7/d10/d4b/d53 0 2023-12-05T09:26:14.646 INFO:tasks.workunit.client.1.smithi134.stdout:6/253: rmdir d4/d2a 39 2023-12-05T09:26:14.648 INFO:tasks.workunit.client.1.smithi134.stdout:7/260: dread d2/d7/dc/d2e/f3e [0,4194304] 0 2023-12-05T09:26:14.648 INFO:tasks.workunit.client.1.smithi134.stdout:4/296: truncate d16/d21/f57 366992 0 2023-12-05T09:26:14.651 INFO:tasks.workunit.client.1.smithi134.stdout:6/254: unlink d4/d2a/d3a/da/l13 0 2023-12-05T09:26:14.651 INFO:tasks.workunit.client.1.smithi134.stdout:6/255: truncate d4/d2a/d3a/da/d1b/f29 2271554 0 2023-12-05T09:26:14.653 INFO:tasks.workunit.client.1.smithi134.stdout:4/297: mkdir d16/d18/d5b/d65 0 2023-12-05T09:26:14.654 INFO:tasks.workunit.client.1.smithi134.stdout:4/298: mkdir d16/d21/d48/d66 0 2023-12-05T09:26:14.655 INFO:tasks.workunit.client.1.smithi134.stdout:4/299: creat d16/d21/d47/f67 x:0 0 0 2023-12-05T09:26:14.656 INFO:tasks.workunit.client.1.smithi134.stdout:4/300: mknod d16/d18/d1a/c68 0 2023-12-05T09:26:14.656 INFO:tasks.workunit.client.1.smithi134.stdout:4/301: fsync f13 0 2023-12-05T09:26:14.657 INFO:tasks.workunit.client.1.smithi134.stdout:0/250: dread fa [0,4194304] 0 2023-12-05T09:26:14.657 INFO:tasks.workunit.client.1.smithi134.stdout:0/251: fdatasync d13/d14/d30/d4b/d23/f27 0 2023-12-05T09:26:14.658 INFO:tasks.workunit.client.1.smithi134.stdout:0/252: rename d13/d14/d30/d2c/d48 to d13/d14/d15/d50 0 2023-12-05T09:26:14.660 INFO:tasks.workunit.client.0.smithi067.stdout:7/254: dwrite d0/d9/d1b/d34/f36 [0,4194304] 0 2023-12-05T09:26:14.662 INFO:tasks.workunit.client.1.smithi134.stdout:8/330: dread da/de/d16/d45/f61 [0,4194304] 0 2023-12-05T09:26:14.662 INFO:tasks.workunit.client.1.smithi134.stdout:6/256: dread d4/d2a/d3a/f3d [0,4194304] 0 2023-12-05T09:26:14.664 INFO:tasks.workunit.client.1.smithi134.stdout:3/275: dwrite d4/d1f/f2b [0,4194304] 0 2023-12-05T09:26:14.667 INFO:tasks.workunit.client.1.smithi134.stdout:8/331: link da/de/d16/d45/d3b/l6b da/d1b/d42/l6f 0 2023-12-05T09:26:14.667 INFO:tasks.workunit.client.1.smithi134.stdout:8/332: fdatasync da/de/f27 0 2023-12-05T09:26:14.667 INFO:tasks.workunit.client.1.smithi134.stdout:7/261: getdents d2/d7/dc/d2e/d3a 0 2023-12-05T09:26:14.668 INFO:tasks.workunit.client.1.smithi134.stdout:9/240: write d7/d10/f37 [2598201,27018] 0 2023-12-05T09:26:14.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/319: dwrite d2/d9/f1b [0,4194304] 0 2023-12-05T09:26:14.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/320: write d2/d27/f5f [564634,84359] 0 2023-12-05T09:26:14.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/321: write d2/f43 [760893,1150] 0 2023-12-05T09:26:14.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/262: creat d2/d7/d2b/f55 x:0 0 0 2023-12-05T09:26:14.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/263: chown d2/df/l39 13377 1 2023-12-05T09:26:14.675 INFO:tasks.workunit.client.1.smithi134.stdout:9/241: creat d7/d8/d14/f54 x:0 0 0 2023-12-05T09:26:14.679 INFO:tasks.workunit.client.1.smithi134.stdout:9/242: mknod d7/d8/d16/c55 0 2023-12-05T09:26:14.681 INFO:tasks.workunit.client.1.smithi134.stdout:9/243: mkdir d7/d10/d56 0 2023-12-05T09:26:14.683 INFO:tasks.workunit.client.1.smithi134.stdout:9/244: creat d7/d10/d4b/f57 x:0 0 0 2023-12-05T09:26:14.684 INFO:tasks.workunit.client.1.smithi134.stdout:6/257: write d4/d32/f35 [1331573,64376] 0 2023-12-05T09:26:14.686 INFO:tasks.workunit.client.1.smithi134.stdout:9/245: rename d7/d10/c2f to d7/d8/d14/c58 0 2023-12-05T09:26:14.686 INFO:tasks.workunit.client.1.smithi134.stdout:9/246: write d7/d8/d14/f54 [525146,16931] 0 2023-12-05T09:26:14.686 INFO:tasks.workunit.client.1.smithi134.stdout:9/247: chown d7/d8/d14/d26/c3f 330185 1 2023-12-05T09:26:14.686 INFO:tasks.workunit.client.1.smithi134.stdout:9/248: creat d7/d8/d14/f59 x:0 0 0 2023-12-05T09:26:14.688 INFO:tasks.workunit.client.1.smithi134.stdout:6/258: getdents d4/d32 0 2023-12-05T09:26:14.688 INFO:tasks.workunit.client.1.smithi134.stdout:3/276: write d4/d1f/f35 [3541315,102812] 0 2023-12-05T09:26:14.688 INFO:tasks.workunit.client.1.smithi134.stdout:8/333: dread da/f3e [0,4194304] 0 2023-12-05T09:26:14.696 INFO:tasks.workunit.client.1.smithi134.stdout:1/322: write d2/d27/f3a [3355519,865] 0 2023-12-05T09:26:14.697 INFO:tasks.workunit.client.1.smithi134.stdout:0/253: getdents d13/d14/d15 0 2023-12-05T09:26:14.698 INFO:tasks.workunit.client.1.smithi134.stdout:0/254: fsync d13/d14/d15/d2a/f4a 0 2023-12-05T09:26:14.701 INFO:tasks.workunit.client.1.smithi134.stdout:7/264: write d2/f8 [4045059,20466] 0 2023-12-05T09:26:14.702 INFO:tasks.workunit.client.1.smithi134.stdout:6/259: symlink d4/d2a/l49 0 2023-12-05T09:26:14.702 INFO:tasks.workunit.client.1.smithi134.stdout:3/277: mkdir d4/d1f/d50/d5a 0 2023-12-05T09:26:14.704 INFO:tasks.workunit.client.1.smithi134.stdout:5/240: sync 2023-12-05T09:26:14.706 INFO:tasks.workunit.client.1.smithi134.stdout:8/334: rmdir da/de/d16/d33 39 2023-12-05T09:26:14.707 INFO:tasks.workunit.client.1.smithi134.stdout:1/323: truncate d2/d9/f57 268412 0 2023-12-05T09:26:14.707 INFO:tasks.workunit.client.1.smithi134.stdout:7/265: getdents d2/d7/d25/d26 0 2023-12-05T09:26:14.707 INFO:tasks.workunit.client.1.smithi134.stdout:1/324: dread - d2/d9/d10/f67 zero size 2023-12-05T09:26:14.708 INFO:tasks.workunit.client.1.smithi134.stdout:6/260: symlink d4/d2a/d3a/da/d1b/l4a 0 2023-12-05T09:26:14.708 INFO:tasks.workunit.client.1.smithi134.stdout:9/249: dread d7/d8/d16/f33 [0,4194304] 0 2023-12-05T09:26:14.708 INFO:tasks.workunit.client.1.smithi134.stdout:6/261: write d4/f26 [113513,21486] 0 2023-12-05T09:26:14.708 INFO:tasks.workunit.client.1.smithi134.stdout:3/278: creat d4/d5/d45/f5b x:0 0 0 2023-12-05T09:26:14.708 INFO:tasks.workunit.client.1.smithi134.stdout:3/279: fsync d4/f12 0 2023-12-05T09:26:14.708 INFO:tasks.workunit.client.1.smithi134.stdout:2/303: sync 2023-12-05T09:26:14.708 INFO:tasks.workunit.client.1.smithi134.stdout:5/241: write d0/f46 [644085,52567] 0 2023-12-05T09:26:14.709 INFO:tasks.workunit.client.1.smithi134.stdout:7/266: truncate d2/d7/dc/d22/f3d 3437495 0 2023-12-05T09:26:14.710 INFO:tasks.workunit.client.1.smithi134.stdout:9/250: mkdir d7/d8/d14/d26/d5a 0 2023-12-05T09:26:14.710 INFO:tasks.workunit.client.1.smithi134.stdout:1/325: creat d2/d56/d74/f77 x:0 0 0 2023-12-05T09:26:14.710 INFO:tasks.workunit.client.1.smithi134.stdout:9/251: truncate d7/d10/d4b/f57 24 0 2023-12-05T09:26:14.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/262: creat d4/d2a/d3a/f4b x:0 0 0 2023-12-05T09:26:14.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/263: stat d4/d2a/d45 0 2023-12-05T09:26:14.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/264: readlink d4/d2a/d3a/da/d1b/l3b 0 2023-12-05T09:26:14.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/265: stat d4/d2a/d3a/da/c24 0 2023-12-05T09:26:14.712 INFO:tasks.workunit.client.1.smithi134.stdout:3/280: unlink d4/f18 0 2023-12-05T09:26:14.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/242: creat d0/dd/d37/f53 x:0 0 0 2023-12-05T09:26:14.713 INFO:tasks.workunit.client.0.smithi067.stdout:7/255: dwrite d0/d9/d10/f1a [0,4194304] 0 2023-12-05T09:26:14.716 INFO:tasks.workunit.client.1.smithi134.stdout:7/267: link d2/df/c53 d2/dd/c56 0 2023-12-05T09:26:14.716 INFO:tasks.workunit.client.1.smithi134.stdout:1/326: symlink d2/d56/l78 0 2023-12-05T09:26:14.717 INFO:tasks.workunit.client.1.smithi134.stdout:2/304: dread d19/d28/f30 [0,4194304] 0 2023-12-05T09:26:14.718 INFO:tasks.workunit.client.1.smithi134.stdout:2/305: stat d19/l23 0 2023-12-05T09:26:14.718 INFO:tasks.workunit.client.1.smithi134.stdout:2/306: chown fc 1208 1 2023-12-05T09:26:14.718 INFO:tasks.workunit.client.0.smithi067.stdout:7/256: rename d0/d9/d10/l2e to d0/d9/d1b/d34/l52 0 2023-12-05T09:26:14.719 INFO:tasks.workunit.client.1.smithi134.stdout:4/302: dwrite d16/d18/d1a/d3b/f5d [0,4194304] 0 2023-12-05T09:26:14.720 INFO:tasks.workunit.client.1.smithi134.stdout:9/252: mkdir d7/d5b 0 2023-12-05T09:26:14.722 INFO:tasks.workunit.client.1.smithi134.stdout:6/266: unlink d4/d2a/d3a/f4b 0 2023-12-05T09:26:14.722 INFO:tasks.workunit.client.1.smithi134.stdout:6/267: truncate d4/d2a/f48 478487 0 2023-12-05T09:26:14.723 INFO:tasks.workunit.client.1.smithi134.stdout:0/255: dread fa [0,4194304] 0 2023-12-05T09:26:14.723 INFO:tasks.workunit.client.0.smithi067.stdout:7/257: mknod d0/d9/d40/c53 0 2023-12-05T09:26:14.724 INFO:tasks.workunit.client.1.smithi134.stdout:5/243: chown d0/f5 25218 1 2023-12-05T09:26:14.726 INFO:tasks.workunit.client.1.smithi134.stdout:8/335: dread f9 [0,4194304] 0 2023-12-05T09:26:14.727 INFO:tasks.workunit.client.1.smithi134.stdout:7/268: unlink d2/d7/c38 0 2023-12-05T09:26:14.727 INFO:tasks.workunit.client.1.smithi134.stdout:7/269: chown d2/f8 0 1 2023-12-05T09:26:14.728 INFO:tasks.workunit.client.1.smithi134.stdout:2/307: mkdir d19/d28/d63 0 2023-12-05T09:26:14.731 INFO:tasks.workunit.client.1.smithi134.stdout:4/303: mkdir d16/d21/d69 0 2023-12-05T09:26:14.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/256: dread d13/d14/d30/d2c/f47 [0,4194304] 0 2023-12-05T09:26:14.732 INFO:tasks.workunit.client.1.smithi134.stdout:6/268: symlink d4/d32/l4c 0 2023-12-05T09:26:14.733 INFO:tasks.workunit.client.1.smithi134.stdout:5/244: symlink d0/d1a/l54 0 2023-12-05T09:26:14.735 INFO:tasks.workunit.client.1.smithi134.stdout:8/336: mkdir da/de/d11/d1d/d70 0 2023-12-05T09:26:14.738 INFO:tasks.workunit.client.1.smithi134.stdout:3/281: dread d4/d1f/d50/d52/d42/f30 [0,4194304] 0 2023-12-05T09:26:14.739 INFO:tasks.workunit.client.1.smithi134.stdout:3/282: write d4/d1f/d50/d52/d42/f30 [5016063,61611] 0 2023-12-05T09:26:14.739 INFO:tasks.workunit.client.1.smithi134.stdout:3/283: dread - d4/f12 zero size 2023-12-05T09:26:14.739 INFO:tasks.workunit.client.1.smithi134.stdout:2/308: rmdir d19/d3a/d62 0 2023-12-05T09:26:14.743 INFO:tasks.workunit.client.1.smithi134.stdout:9/253: dread d7/d8/d16/f1f [0,4194304] 0 2023-12-05T09:26:14.744 INFO:tasks.workunit.client.1.smithi134.stdout:0/257: symlink d13/d14/d15/d50/l51 0 2023-12-05T09:26:14.744 INFO:tasks.workunit.client.1.smithi134.stdout:4/304: rename d16/l4e to d16/l6a 0 2023-12-05T09:26:14.751 INFO:tasks.workunit.client.1.smithi134.stdout:6/269: unlink d4/d39/f12 0 2023-12-05T09:26:14.752 INFO:tasks.workunit.client.1.smithi134.stdout:5/245: creat d0/f55 x:0 0 0 2023-12-05T09:26:14.752 INFO:tasks.workunit.client.1.smithi134.stdout:5/246: chown d0/dd/f17 0 1 2023-12-05T09:26:14.752 INFO:tasks.workunit.client.1.smithi134.stdout:8/337: creat da/de/d11/d1d/f71 x:0 0 0 2023-12-05T09:26:14.752 INFO:tasks.workunit.client.1.smithi134.stdout:3/284: mknod d4/c5c 0 2023-12-05T09:26:14.755 INFO:tasks.workunit.client.1.smithi134.stdout:9/254: symlink d7/d8/d14/l5c 0 2023-12-05T09:26:14.761 INFO:tasks.workunit.client.1.smithi134.stdout:0/258: rmdir d13/d14/d30/d4b 39 2023-12-05T09:26:14.761 INFO:tasks.workunit.client.1.smithi134.stdout:0/259: stat d13/d14 0 2023-12-05T09:26:14.762 INFO:tasks.workunit.client.0.smithi067.stdout:7/258: dwrite d0/d9/d3f/f47 [0,4194304] 0 2023-12-05T09:26:14.763 INFO:tasks.workunit.client.1.smithi134.stdout:6/270: getdents d4/d2a 0 2023-12-05T09:26:14.765 INFO:tasks.workunit.client.1.smithi134.stdout:5/247: rename d0/d1a/d1c/f42 to d0/d1a/d1c/d25/f56 0 2023-12-05T09:26:14.766 INFO:tasks.workunit.client.1.smithi134.stdout:8/338: mkdir da/de/d16/d45/d72 0 2023-12-05T09:26:14.766 INFO:tasks.workunit.client.1.smithi134.stdout:8/339: truncate da/de/d11/d1d/f71 147316 0 2023-12-05T09:26:14.772 INFO:tasks.workunit.client.1.smithi134.stdout:0/260: symlink d13/d14/d15/l52 0 2023-12-05T09:26:14.773 INFO:tasks.workunit.client.1.smithi134.stdout:0/261: chown d13/l2b 225 1 2023-12-05T09:26:14.774 INFO:tasks.workunit.client.1.smithi134.stdout:3/285: rmdir d4/d1f/d50 39 2023-12-05T09:26:14.775 INFO:tasks.workunit.client.1.smithi134.stdout:8/340: link da/l35 da/de/d11/d1d/l73 0 2023-12-05T09:26:14.777 INFO:tasks.workunit.client.1.smithi134.stdout:0/262: creat d13/f53 x:0 0 0 2023-12-05T09:26:14.777 INFO:tasks.workunit.client.1.smithi134.stdout:0/263: write f7 [693880,56759] 0 2023-12-05T09:26:14.779 INFO:tasks.workunit.client.1.smithi134.stdout:1/327: truncate d2/f43 82404 0 2023-12-05T09:26:14.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/248: rename d0/f5 to d0/d45/f57 0 2023-12-05T09:26:14.783 INFO:tasks.workunit.client.1.smithi134.stdout:8/341: mknod da/de/d16/d2d/c74 0 2023-12-05T09:26:14.783 INFO:tasks.workunit.client.1.smithi134.stdout:8/342: chown da/de/d16/d45/d72 52533218 1 2023-12-05T09:26:14.783 INFO:tasks.workunit.client.1.smithi134.stdout:0/264: mknod d13/d14/d30/d4b/c54 0 2023-12-05T09:26:14.789 INFO:tasks.workunit.client.1.smithi134.stdout:8/343: creat da/de/f75 x:0 0 0 2023-12-05T09:26:14.789 INFO:tasks.workunit.client.1.smithi134.stdout:8/344: getdents da/de/d4d/d68 0 2023-12-05T09:26:14.789 INFO:tasks.workunit.client.1.smithi134.stdout:8/345: creat da/de/d11/d1d/f76 x:0 0 0 2023-12-05T09:26:14.789 INFO:tasks.workunit.client.1.smithi134.stdout:8/346: truncate da/f29 3481547 0 2023-12-05T09:26:14.789 INFO:tasks.workunit.client.1.smithi134.stdout:8/347: chown da/d1b 1683857021 1 2023-12-05T09:26:14.789 INFO:tasks.workunit.client.1.smithi134.stdout:1/328: creat d2/d27/d71/f79 x:0 0 0 2023-12-05T09:26:14.790 INFO:tasks.workunit.client.1.smithi134.stdout:1/329: symlink d2/d9/d10/d5b/d5e/l7a 0 2023-12-05T09:26:14.791 INFO:tasks.workunit.client.1.smithi134.stdout:1/330: stat d2/d27/d40/c69 0 2023-12-05T09:26:14.794 INFO:tasks.workunit.client.1.smithi134.stdout:1/331: link d2/d9/d10/f3f d2/d56/d74/f7b 0 2023-12-05T09:26:14.808 INFO:tasks.workunit.client.1.smithi134.stdout:0/265: dread f3 [0,4194304] 0 2023-12-05T09:26:14.809 INFO:tasks.workunit.client.1.smithi134.stdout:0/266: mknod d13/d14/d15/d2a/c55 0 2023-12-05T09:26:14.812 INFO:tasks.workunit.client.1.smithi134.stdout:5/249: dread d0/f33 [0,4194304] 0 2023-12-05T09:26:14.812 INFO:tasks.workunit.client.1.smithi134.stdout:0/267: mkdir d13/d14/d30/d2c/d56 0 2023-12-05T09:26:14.812 INFO:tasks.workunit.client.1.smithi134.stdout:0/268: readlink d13/d14/l22 0 2023-12-05T09:26:14.812 INFO:tasks.workunit.client.1.smithi134.stdout:0/269: stat d13/d14/d15/f21 0 2023-12-05T09:26:14.813 INFO:tasks.workunit.client.1.smithi134.stdout:7/270: dwrite d2/dd/f19 [0,4194304] 0 2023-12-05T09:26:14.813 INFO:tasks.workunit.client.1.smithi134.stdout:6/271: dread d4/f46 [0,4194304] 0 2023-12-05T09:26:14.815 INFO:tasks.workunit.client.1.smithi134.stdout:9/255: dwrite d7/d8/d14/f3d [0,4194304] 0 2023-12-05T09:26:14.815 INFO:tasks.workunit.client.1.smithi134.stdout:9/256: readlink d7/d10/l22 0 2023-12-05T09:26:14.816 INFO:tasks.workunit.client.1.smithi134.stdout:4/305: dwrite d16/d21/f62 [0,4194304] 0 2023-12-05T09:26:14.816 INFO:tasks.workunit.client.1.smithi134.stdout:4/306: fdatasync d16/d18/d5b/f5e 0 2023-12-05T09:26:14.816 INFO:tasks.workunit.client.1.smithi134.stdout:4/307: fsync f4 0 2023-12-05T09:26:14.816 INFO:tasks.workunit.client.1.smithi134.stdout:4/308: stat f0 0 2023-12-05T09:26:14.821 INFO:tasks.workunit.client.1.smithi134.stdout:0/270: unlink fe 0 2023-12-05T09:26:14.822 INFO:tasks.workunit.client.1.smithi134.stdout:7/271: mknod d2/df/d2a/d36/c57 0 2023-12-05T09:26:14.823 INFO:tasks.workunit.client.1.smithi134.stdout:6/272: truncate d4/d2a/d3a/f36 4176648 0 2023-12-05T09:26:14.825 INFO:tasks.workunit.client.1.smithi134.stdout:5/250: link d0/f43 d0/d1a/d3a/f58 0 2023-12-05T09:26:14.825 INFO:tasks.workunit.client.1.smithi134.stdout:5/251: stat d0/d45/f57 0 2023-12-05T09:26:14.826 INFO:tasks.workunit.client.1.smithi134.stdout:5/252: truncate d0/dd/f32 1152944 0 2023-12-05T09:26:14.826 INFO:tasks.workunit.client.1.smithi134.stdout:5/253: fsync d0/d45/f57 0 2023-12-05T09:26:14.829 INFO:tasks.workunit.client.1.smithi134.stdout:9/257: getdents d7/d10 0 2023-12-05T09:26:14.829 INFO:tasks.workunit.client.1.smithi134.stdout:9/258: read d7/d10/d4b/f57 [12,12064] 0 2023-12-05T09:26:14.829 INFO:tasks.workunit.client.1.smithi134.stdout:9/259: readlink d7/l32 0 2023-12-05T09:26:14.831 INFO:tasks.workunit.client.1.smithi134.stdout:6/273: creat d4/d39/d42/f4d x:0 0 0 2023-12-05T09:26:14.832 INFO:tasks.workunit.client.1.smithi134.stdout:5/254: mknod d0/d1a/d3a/c59 0 2023-12-05T09:26:14.834 INFO:tasks.workunit.client.1.smithi134.stdout:4/309: symlink d16/d18/d1b/d24/l6b 0 2023-12-05T09:26:14.836 INFO:tasks.workunit.client.1.smithi134.stdout:0/271: dread f8 [0,4194304] 0 2023-12-05T09:26:14.836 INFO:tasks.workunit.client.1.smithi134.stdout:6/274: mknod d4/d32/c4e 0 2023-12-05T09:26:14.837 INFO:tasks.workunit.client.1.smithi134.stdout:6/275: write d4/d2a/f48 [1507643,63529] 0 2023-12-05T09:26:14.838 INFO:tasks.workunit.client.1.smithi134.stdout:5/255: readlink d0/d11/l1d 0 2023-12-05T09:26:14.838 INFO:tasks.workunit.client.1.smithi134.stdout:5/256: truncate d0/d11/f1b 1053226 0 2023-12-05T09:26:14.841 INFO:tasks.workunit.client.1.smithi134.stdout:0/272: unlink lf 0 2023-12-05T09:26:14.841 INFO:tasks.workunit.client.1.smithi134.stdout:0/273: truncate d13/d14/d30/d4b/f41 683507 0 2023-12-05T09:26:14.842 INFO:tasks.workunit.client.1.smithi134.stdout:0/274: truncate d13/d14/d15/f37 5112010 0 2023-12-05T09:26:14.842 INFO:tasks.workunit.client.1.smithi134.stdout:0/275: fdatasync d13/d14/d30/f3a 0 2023-12-05T09:26:14.845 INFO:tasks.workunit.client.1.smithi134.stdout:0/276: creat d13/d14/d30/f57 x:0 0 0 2023-12-05T09:26:14.845 INFO:tasks.workunit.client.1.smithi134.stdout:0/277: chown d13/d14/d15/f40 21184876 1 2023-12-05T09:26:14.847 INFO:tasks.workunit.client.1.smithi134.stdout:9/260: dread d7/d8/d14/d26/f3e [0,4194304] 0 2023-12-05T09:26:14.849 INFO:tasks.workunit.client.1.smithi134.stdout:0/278: rename d13/d14/d15/d2a/f36 to d13/d14/d15/d2a/f58 0 2023-12-05T09:26:14.851 INFO:tasks.workunit.client.1.smithi134.stdout:0/279: mkdir d13/d14/d59 0 2023-12-05T09:26:14.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/280: mknod d13/d14/d59/c5a 0 2023-12-05T09:26:14.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/281: chown d13/d14/c31 2 1 2023-12-05T09:26:14.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/282: readlink d13/l45 0 2023-12-05T09:26:14.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/283: truncate d13/f35 1695118 0 2023-12-05T09:26:14.853 INFO:tasks.workunit.client.1.smithi134.stdout:0/284: write d13/d14/d30/d4b/f42 [696673,119541] 0 2023-12-05T09:26:14.853 INFO:tasks.workunit.client.1.smithi134.stdout:0/285: dread - d13/d14/d15/d2a/f49 zero size 2023-12-05T09:26:14.859 INFO:tasks.workunit.client.1.smithi134.stdout:5/257: read d0/dd/f2c [1570180,106288] 0 2023-12-05T09:26:14.863 INFO:tasks.workunit.client.1.smithi134.stdout:9/261: dread d7/d8/d14/f54 [0,4194304] 0 2023-12-05T09:26:14.863 INFO:tasks.workunit.client.1.smithi134.stdout:5/258: creat d0/d45/f5a x:0 0 0 2023-12-05T09:26:14.865 INFO:tasks.workunit.client.1.smithi134.stdout:5/259: mkdir d0/d1a/d1c/d3f/d5b 0 2023-12-05T09:26:14.869 INFO:tasks.workunit.client.1.smithi134.stdout:4/310: dread d16/d18/d1a/d3b/f5a [0,4194304] 0 2023-12-05T09:26:14.875 INFO:tasks.workunit.client.1.smithi134.stdout:3/286: dwrite d4/d5/d45/f5b [0,4194304] 0 2023-12-05T09:26:14.875 INFO:tasks.workunit.client.1.smithi134.stdout:1/332: dwrite d2/d9/d10/f47 [0,4194304] 0 2023-12-05T09:26:14.879 INFO:tasks.workunit.client.1.smithi134.stdout:7/272: dwrite f1 [0,4194304] 0 2023-12-05T09:26:14.880 INFO:tasks.workunit.client.1.smithi134.stdout:3/287: creat d4/d1f/f5d x:0 0 0 2023-12-05T09:26:14.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/288: write d4/d5/d45/f46 [540472,25589] 0 2023-12-05T09:26:14.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/289: write d4/f13 [312591,70203] 0 2023-12-05T09:26:14.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/290: fdatasync d4/f2f 0 2023-12-05T09:26:14.883 INFO:tasks.workunit.client.1.smithi134.stdout:0/286: getdents d13/d14/d30 0 2023-12-05T09:26:14.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/291: stat d4/d1f/d50/d52/d42/c39 0 2023-12-05T09:26:14.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/292: write d4/d1f/f28 [763242,116057] 0 2023-12-05T09:26:14.884 INFO:tasks.workunit.client.1.smithi134.stdout:7/273: creat d2/d7/d25/d26/f58 x:0 0 0 2023-12-05T09:26:14.885 INFO:tasks.workunit.client.1.smithi134.stdout:0/287: mknod d13/d14/d30/d4b/d23/c5b 0 2023-12-05T09:26:14.885 INFO:tasks.workunit.client.1.smithi134.stdout:0/288: dread - d13/d14/d15/d2a/f4c zero size 2023-12-05T09:26:14.885 INFO:tasks.workunit.client.1.smithi134.stdout:0/289: readlink d13/d14/l18 0 2023-12-05T09:26:14.888 INFO:tasks.workunit.client.1.smithi134.stdout:7/274: unlink d2/dd/c56 0 2023-12-05T09:26:14.889 INFO:tasks.workunit.client.1.smithi134.stdout:3/293: creat d4/d1f/d50/d5a/f5e x:0 0 0 2023-12-05T09:26:14.891 INFO:tasks.workunit.client.1.smithi134.stdout:7/275: rename d2/d7/dc/d2e/d3a/c54 to d2/d7/dc/d2e/c59 0 2023-12-05T09:26:14.892 INFO:tasks.workunit.client.1.smithi134.stdout:7/276: write d2/df/d2a/f40 [391698,97226] 0 2023-12-05T09:26:14.892 INFO:tasks.workunit.client.1.smithi134.stdout:7/277: dread - d2/dd/f47 zero size 2023-12-05T09:26:14.897 INFO:tasks.workunit.client.1.smithi134.stdout:7/278: rename d2/d7/la to d2/d7/d25/d26/l5a 0 2023-12-05T09:26:14.900 INFO:tasks.workunit.client.1.smithi134.stdout:2/309: sync 2023-12-05T09:26:14.900 INFO:tasks.workunit.client.1.smithi134.stdout:8/348: sync 2023-12-05T09:26:14.901 INFO:tasks.workunit.client.1.smithi134.stdout:2/310: creat d19/d28/d2b/f64 x:0 0 0 2023-12-05T09:26:14.901 INFO:tasks.workunit.client.1.smithi134.stdout:2/311: chown d19/f24 940827 1 2023-12-05T09:26:14.902 INFO:tasks.workunit.client.1.smithi134.stdout:2/312: creat d19/d3a/f65 x:0 0 0 2023-12-05T09:26:14.903 INFO:tasks.workunit.client.1.smithi134.stdout:2/313: mknod d19/d3a/d60/c66 0 2023-12-05T09:26:14.904 INFO:tasks.workunit.client.1.smithi134.stdout:2/314: stat d19/d3a/c61 0 2023-12-05T09:26:14.905 INFO:tasks.workunit.client.1.smithi134.stdout:2/315: fsync f8 0 2023-12-05T09:26:14.905 INFO:tasks.workunit.client.0.smithi067.stdout:1/176: sync 2023-12-05T09:26:14.907 INFO:tasks.workunit.client.1.smithi134.stdout:2/316: truncate d19/d28/f30 773303 0 2023-12-05T09:26:14.908 INFO:tasks.workunit.client.1.smithi134.stdout:9/262: dwrite d7/d8/d16/f1f [4194304,4194304] 0 2023-12-05T09:26:14.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/177: symlink d2/d5/d7/l40 0 2023-12-05T09:26:14.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/178: dread - d2/d5/d7/de/f37 zero size 2023-12-05T09:26:14.916 INFO:tasks.workunit.client.0.smithi067.stdout:1/179: rename d2/d5/lf to d2/d3/l41 0 2023-12-05T09:26:14.916 INFO:tasks.workunit.client.0.smithi067.stdout:1/180: write d2/d5/d7/de/d10/d15/f29 [169588,27115] 0 2023-12-05T09:26:14.916 INFO:tasks.workunit.client.0.smithi067.stdout:1/181: chown d2 0 1 2023-12-05T09:26:14.917 INFO:tasks.workunit.client.0.smithi067.stdout:1/182: creat d2/d5/d7/de/d10/d14/f42 x:0 0 0 2023-12-05T09:26:14.917 INFO:tasks.workunit.client.0.smithi067.stdout:1/183: dread - d2/d5/d7/de/f3a zero size 2023-12-05T09:26:14.921 INFO:tasks.workunit.client.1.smithi134.stdout:9/263: symlink d7/d8/d16/d52/l5d 0 2023-12-05T09:26:14.921 INFO:tasks.workunit.client.1.smithi134.stdout:9/264: stat d7/d8/d14/d26/f48 0 2023-12-05T09:26:14.924 INFO:tasks.workunit.client.1.smithi134.stdout:7/279: getdents d2/d7/dc/d2e/d3a 0 2023-12-05T09:26:14.924 INFO:tasks.workunit.client.1.smithi134.stdout:7/280: fdatasync d2/df/f4d 0 2023-12-05T09:26:14.924 INFO:tasks.workunit.client.1.smithi134.stdout:7/281: stat d2/d7/d2b/c3c 0 2023-12-05T09:26:14.926 INFO:tasks.workunit.client.0.smithi067.stdout:1/184: rmdir d2/d5/d7/de/d10/d35 0 2023-12-05T09:26:14.926 INFO:tasks.workunit.client.0.smithi067.stdout:1/185: write d2/d5/d7/de/f3a [866665,10360] 0 2023-12-05T09:26:14.936 INFO:tasks.workunit.client.1.smithi134.stdout:9/265: mkdir d7/d5b/d5e 0 2023-12-05T09:26:14.943 INFO:tasks.workunit.client.1.smithi134.stdout:9/266: mknod d7/d10/d56/c5f 0 2023-12-05T09:26:14.943 INFO:tasks.workunit.client.1.smithi134.stdout:9/267: write d7/d8/d14/f46 [1073549,65501] 0 2023-12-05T09:26:14.944 INFO:tasks.workunit.client.1.smithi134.stdout:8/349: dread da/f29 [0,4194304] 0 2023-12-05T09:26:14.946 INFO:tasks.workunit.client.1.smithi134.stdout:6/276: sync 2023-12-05T09:26:14.949 INFO:tasks.workunit.client.1.smithi134.stdout:9/268: symlink d7/d8/d14/d26/d5a/l60 0 2023-12-05T09:26:14.949 INFO:tasks.workunit.client.1.smithi134.stdout:9/269: write d7/d8/d14/d26/f4a [592957,53249] 0 2023-12-05T09:26:14.950 INFO:tasks.workunit.client.1.smithi134.stdout:3/294: dwrite f0 [0,4194304] 0 2023-12-05T09:26:14.950 INFO:tasks.workunit.client.1.smithi134.stdout:3/295: fsync d4/f12 0 2023-12-05T09:26:14.955 INFO:tasks.workunit.client.1.smithi134.stdout:3/296: dread d4/f34 [0,4194304] 0 2023-12-05T09:26:14.957 INFO:tasks.workunit.client.1.smithi134.stdout:8/350: truncate da/de/d16/d33/f56 454499 0 2023-12-05T09:26:14.957 INFO:tasks.workunit.client.1.smithi134.stdout:8/351: chown da/d1b/f1e 0 1 2023-12-05T09:26:14.958 INFO:tasks.workunit.client.1.smithi134.stdout:6/277: mkdir d4/d39/d42/d4f 0 2023-12-05T09:26:14.959 INFO:tasks.workunit.client.1.smithi134.stdout:9/270: rename d7/d8/d14/d26/c2d to d7/d10/d4b/c61 0 2023-12-05T09:26:14.959 INFO:tasks.workunit.client.1.smithi134.stdout:9/271: readlink d7/d8/l34 0 2023-12-05T09:26:14.962 INFO:tasks.workunit.client.1.smithi134.stdout:6/278: mknod d4/c50 0 2023-12-05T09:26:14.962 INFO:tasks.workunit.client.1.smithi134.stdout:8/352: rename da/de/d11/c2c to da/de/d16/d45/c77 0 2023-12-05T09:26:14.963 INFO:tasks.workunit.client.1.smithi134.stdout:7/282: creat d2/d7/d25/f5b x:0 0 0 2023-12-05T09:26:14.967 INFO:tasks.workunit.client.1.smithi134.stdout:2/317: dwrite f5 [0,4194304] 0 2023-12-05T09:26:14.967 INFO:tasks.workunit.client.1.smithi134.stdout:2/318: fdatasync d19/d3f/f58 0 2023-12-05T09:26:14.970 INFO:tasks.workunit.client.1.smithi134.stdout:5/260: dwrite d0/d1a/d1c/f23 [0,4194304] 0 2023-12-05T09:26:14.973 INFO:tasks.workunit.client.1.smithi134.stdout:8/353: symlink da/de/d43/l78 0 2023-12-05T09:26:14.976 INFO:tasks.workunit.client.1.smithi134.stdout:7/283: unlink d2/df/f4d 0 2023-12-05T09:26:14.979 INFO:tasks.workunit.client.1.smithi134.stdout:2/319: creat d19/d28/d63/f67 x:0 0 0 2023-12-05T09:26:14.982 INFO:tasks.workunit.client.1.smithi134.stdout:8/354: unlink da/de/d43/l78 0 2023-12-05T09:26:14.984 INFO:tasks.workunit.client.1.smithi134.stdout:7/284: rename d2/df/f15 to d2/df/d2a/d36/f5c 0 2023-12-05T09:26:14.985 INFO:tasks.workunit.client.1.smithi134.stdout:9/272: dread d7/d8/d14/d26/f3e [0,4194304] 0 2023-12-05T09:26:14.985 INFO:tasks.workunit.client.1.smithi134.stdout:9/273: fsync d7/f1a 0 2023-12-05T09:26:14.988 INFO:tasks.workunit.client.1.smithi134.stdout:2/320: mknod d19/d3a/d60/c68 0 2023-12-05T09:26:14.988 INFO:tasks.workunit.client.1.smithi134.stdout:5/261: write d0/dd/f32 [360869,60609] 0 2023-12-05T09:26:14.989 INFO:tasks.workunit.client.0.smithi067.stdout:1/186: dread d2/d5/d7/de/f3a [0,4194304] 0 2023-12-05T09:26:14.995 INFO:tasks.workunit.client.0.smithi067.stdout:1/187: rmdir d2/d5/d7/de/d10 39 2023-12-05T09:26:14.996 INFO:tasks.workunit.client.0.smithi067.stdout:1/188: rmdir d2/d3 39 2023-12-05T09:26:15.002 INFO:tasks.workunit.client.1.smithi134.stdout:3/297: dwrite d4/d1f/d50/d52/f58 [0,4194304] 0 2023-12-05T09:26:15.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/355: write da/de/d11/f1a [988628,35270] 0 2023-12-05T09:26:15.002 INFO:tasks.workunit.client.1.smithi134.stdout:1/333: dwrite d2/f65 [0,4194304] 0 2023-12-05T09:26:15.003 INFO:tasks.workunit.client.1.smithi134.stdout:7/285: dread d2/d7/dc/d22/f3d [0,4194304] 0 2023-12-05T09:26:15.003 INFO:tasks.workunit.client.1.smithi134.stdout:2/321: link d19/d28/d63/f67 d19/f69 0 2023-12-05T09:26:15.006 INFO:tasks.workunit.client.1.smithi134.stdout:1/334: symlink d2/d27/d71/l7c 0 2023-12-05T09:26:15.009 INFO:tasks.workunit.client.1.smithi134.stdout:0/290: dwrite d13/d14/f3d [4194304,4194304] 0 2023-12-05T09:26:15.009 INFO:tasks.workunit.client.1.smithi134.stdout:2/322: creat d19/d28/d31/d38/f6a x:0 0 0 2023-12-05T09:26:15.009 INFO:tasks.workunit.client.1.smithi134.stdout:1/335: symlink d2/d9/d10/d30/l7d 0 2023-12-05T09:26:15.010 INFO:tasks.workunit.client.1.smithi134.stdout:1/336: truncate d2/d9/d10/f3c 599652 0 2023-12-05T09:26:15.013 INFO:tasks.workunit.client.1.smithi134.stdout:1/337: rename d2/d27/d75 to d2/d7e 0 2023-12-05T09:26:15.014 INFO:tasks.workunit.client.1.smithi134.stdout:1/338: fdatasync d2/f17 0 2023-12-05T09:26:15.017 INFO:tasks.workunit.client.1.smithi134.stdout:1/339: creat d2/d56/f7f x:0 0 0 2023-12-05T09:26:15.018 INFO:tasks.workunit.client.1.smithi134.stdout:1/340: mkdir d2/d27/d71/d80 0 2023-12-05T09:26:15.019 INFO:tasks.workunit.client.1.smithi134.stdout:1/341: mkdir d2/d9/d10/d30/d4a/d81 0 2023-12-05T09:26:15.020 INFO:tasks.workunit.client.1.smithi134.stdout:5/262: dread d0/d11/f1e [0,4194304] 0 2023-12-05T09:26:15.020 INFO:tasks.workunit.client.1.smithi134.stdout:5/263: dread - d0/dd/f20 zero size 2023-12-05T09:26:15.024 INFO:tasks.workunit.client.0.smithi067.stdout:1/189: write d2/d5/d7/de/d10/d14/d20/f26 [2319601,82653] 0 2023-12-05T09:26:15.025 INFO:tasks.workunit.client.1.smithi134.stdout:1/342: rename d2/d9/d10/d5b/d5e/l68 to d2/d9/d10/d30/d4a/l82 0 2023-12-05T09:26:15.030 INFO:tasks.workunit.client.1.smithi134.stdout:5/264: mkdir d0/d11/d5c 0 2023-12-05T09:26:15.030 INFO:tasks.workunit.client.1.smithi134.stdout:1/343: creat d2/d27/d71/d80/f83 x:0 0 0 2023-12-05T09:26:15.032 INFO:tasks.workunit.client.0.smithi067.stdout:5/188: sync 2023-12-05T09:26:15.033 INFO:tasks.workunit.client.0.smithi067.stdout:5/189: truncate db/df/d1a/d1d/d20/f2a 1287335 0 2023-12-05T09:26:15.036 INFO:tasks.workunit.client.1.smithi134.stdout:6/279: dwrite d4/d2a/d3a/f3c [0,4194304] 0 2023-12-05T09:26:15.036 INFO:tasks.workunit.client.1.smithi134.stdout:4/311: dwrite d16/f41 [0,4194304] 0 2023-12-05T09:26:15.037 INFO:tasks.workunit.client.1.smithi134.stdout:7/286: write f1 [528741,70724] 0 2023-12-05T09:26:15.040 INFO:tasks.workunit.client.1.smithi134.stdout:0/291: dread d13/d14/d30/d4b/f41 [0,4194304] 0 2023-12-05T09:26:15.040 INFO:tasks.workunit.client.1.smithi134.stdout:0/292: dread - d13/d14/d30/f57 zero size 2023-12-05T09:26:15.041 INFO:tasks.workunit.client.1.smithi134.stdout:0/293: fdatasync d13/d14/d30/d2c/f34 0 2023-12-05T09:26:15.045 INFO:tasks.workunit.client.1.smithi134.stdout:2/323: dread f15 [0,4194304] 0 2023-12-05T09:26:15.048 INFO:tasks.workunit.client.1.smithi134.stdout:2/324: dread - d19/d28/f39 zero size 2023-12-05T09:26:15.061 INFO:tasks.workunit.client.1.smithi134.stdout:0/294: link d13/d14/d30/d4b/f42 d13/d14/f5c 0 2023-12-05T09:26:15.061 INFO:tasks.workunit.client.1.smithi134.stdout:7/287: getdents d2/d7/d2b 0 2023-12-05T09:26:15.061 INFO:tasks.workunit.client.1.smithi134.stdout:7/288: read f1 [127094,102724] 0 2023-12-05T09:26:15.061 INFO:tasks.workunit.client.1.smithi134.stdout:7/289: fsync d2/d7/dc/d2e/f43 0 2023-12-05T09:26:15.061 INFO:tasks.workunit.client.1.smithi134.stdout:6/280: rename d4/d2a/f2e to d4/d39/f51 0 2023-12-05T09:26:15.061 INFO:tasks.workunit.client.1.smithi134.stdout:7/290: write d2/d7/d2b/f55 [691257,88186] 0 2023-12-05T09:26:15.062 INFO:tasks.workunit.client.1.smithi134.stdout:3/298: dwrite d4/d1f/f26 [0,4194304] 0 2023-12-05T09:26:15.062 INFO:tasks.workunit.client.1.smithi134.stdout:3/299: truncate d4/d1f/d50/d52/d42/f56 667294 0 2023-12-05T09:26:15.071 INFO:tasks.workunit.client.1.smithi134.stdout:8/356: dwrite da/de/d16/f23 [0,4194304] 0 2023-12-05T09:26:15.072 INFO:tasks.workunit.client.1.smithi134.stdout:2/325: read d19/f1d [3607951,123566] 0 2023-12-05T09:26:15.072 INFO:tasks.workunit.client.1.smithi134.stdout:9/274: dwrite d7/d10/f37 [4194304,4194304] 0 2023-12-05T09:26:15.073 INFO:tasks.workunit.client.1.smithi134.stdout:9/275: write d7/f1c [4932342,29870] 0 2023-12-05T09:26:15.080 INFO:tasks.workunit.client.1.smithi134.stdout:7/291: creat d2/df/d2a/d36/f5d x:0 0 0 2023-12-05T09:26:15.081 INFO:tasks.workunit.client.1.smithi134.stdout:8/357: creat da/de/d4d/f79 x:0 0 0 2023-12-05T09:26:15.081 INFO:tasks.workunit.client.1.smithi134.stdout:9/276: symlink d7/d5b/d5e/l62 0 2023-12-05T09:26:15.083 INFO:tasks.workunit.client.1.smithi134.stdout:1/344: dwrite d2/f19 [0,4194304] 0 2023-12-05T09:26:15.083 INFO:tasks.workunit.client.0.smithi067.stdout:1/190: dwrite d2/d5/d7/de/f37 [0,4194304] 0 2023-12-05T09:26:15.085 INFO:tasks.workunit.client.1.smithi134.stdout:0/295: rmdir d13/d14 39 2023-12-05T09:26:15.085 INFO:tasks.workunit.client.1.smithi134.stdout:6/281: rmdir d4/d39/d42 39 2023-12-05T09:26:15.085 INFO:tasks.workunit.client.1.smithi134.stdout:3/300: getdents d4/d1f/d50/d5a 0 2023-12-05T09:26:15.091 INFO:tasks.workunit.client.1.smithi134.stdout:8/358: link da/de/d11/d1d/f71 da/de/f7a 0 2023-12-05T09:26:15.091 INFO:tasks.workunit.client.1.smithi134.stdout:8/359: chown da/de/d16/d33/c59 1175098 1 2023-12-05T09:26:15.094 INFO:tasks.workunit.client.1.smithi134.stdout:1/345: stat d2/d9/d10/c36 0 2023-12-05T09:26:15.095 INFO:tasks.workunit.client.1.smithi134.stdout:0/296: mknod d13/d14/d59/c5d 0 2023-12-05T09:26:15.098 INFO:tasks.workunit.client.1.smithi134.stdout:6/282: link d4/d32/l4c d4/d2a/d3a/l52 0 2023-12-05T09:26:15.099 INFO:tasks.workunit.client.1.smithi134.stdout:6/283: stat d4/d2a/d3a/da/d1b 0 2023-12-05T09:26:15.099 INFO:tasks.workunit.client.1.smithi134.stdout:6/284: truncate d4/d2a/d3a/da/d1b/f21 8859258 0 2023-12-05T09:26:15.099 INFO:tasks.workunit.client.1.smithi134.stdout:9/277: getdents d7/d10/d4b 0 2023-12-05T09:26:15.102 INFO:tasks.workunit.client.0.smithi067.stdout:5/190: dwrite db/df/f32 [0,4194304] 0 2023-12-05T09:26:15.104 INFO:tasks.workunit.client.1.smithi134.stdout:0/297: mknod d13/d14/d15/c5e 0 2023-12-05T09:26:15.104 INFO:tasks.workunit.client.1.smithi134.stdout:3/301: symlink d4/d5/d45/l5f 0 2023-12-05T09:26:15.104 INFO:tasks.workunit.client.1.smithi134.stdout:3/302: chown d4/d5/d45/f4d 7172 1 2023-12-05T09:26:15.104 INFO:tasks.workunit.client.1.smithi134.stdout:4/312: dwrite fb [0,4194304] 0 2023-12-05T09:26:15.104 INFO:tasks.workunit.client.1.smithi134.stdout:4/313: creat d16/d18/d5b/f6c x:0 0 0 2023-12-05T09:26:15.105 INFO:tasks.workunit.client.1.smithi134.stdout:6/285: creat d4/d39/f53 x:0 0 0 2023-12-05T09:26:15.105 INFO:tasks.workunit.client.1.smithi134.stdout:6/286: write d4/d2a/f48 [2075660,10634] 0 2023-12-05T09:26:15.105 INFO:tasks.workunit.client.1.smithi134.stdout:0/298: symlink d13/d14/d15/d50/l5f 0 2023-12-05T09:26:15.106 INFO:tasks.workunit.client.1.smithi134.stdout:8/360: dread da/de/d16/d45/f61 [0,4194304] 0 2023-12-05T09:26:15.106 INFO:tasks.workunit.client.1.smithi134.stdout:8/361: chown da/de/d16/l28 15 1 2023-12-05T09:26:15.107 INFO:tasks.workunit.client.0.smithi067.stdout:1/191: dread d2/d3/f1d [0,4194304] 0 2023-12-05T09:26:15.109 INFO:tasks.workunit.client.1.smithi134.stdout:4/314: rename fb to d16/d18/f6d 0 2023-12-05T09:26:15.110 INFO:tasks.workunit.client.0.smithi067.stdout:5/191: dread - db/df/f31 zero size 2023-12-05T09:26:15.110 INFO:tasks.workunit.client.0.smithi067.stdout:5/192: stat db/df/f12 0 2023-12-05T09:26:15.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/192: mknod d2/d5/d7/de/d1a/c43 0 2023-12-05T09:26:15.114 INFO:tasks.workunit.client.0.smithi067.stdout:1/193: creat d2/d5/d7/de/d1a/f44 x:0 0 0 2023-12-05T09:26:15.116 INFO:tasks.workunit.client.1.smithi134.stdout:0/299: rename fa to d13/d14/d30/d4b/d23/f60 0 2023-12-05T09:26:15.116 INFO:tasks.workunit.client.1.smithi134.stdout:4/315: truncate d16/d21/d48/f34 2914777 0 2023-12-05T09:26:15.116 INFO:tasks.workunit.client.1.smithi134.stdout:4/316: mkdir d16/d21/d69/d6e 0 2023-12-05T09:26:15.116 INFO:tasks.workunit.client.0.smithi067.stdout:1/194: rename d2/d5/d7/de/l36 to d2/l45 0 2023-12-05T09:26:15.119 INFO:tasks.workunit.client.1.smithi134.stdout:4/317: mkdir d16/d21/d50/d6f 0 2023-12-05T09:26:15.143 INFO:tasks.workunit.client.1.smithi134.stdout:6/287: dread d4/d2a/d3a/fe [0,4194304] 0 2023-12-05T09:26:15.143 INFO:tasks.workunit.client.1.smithi134.stdout:6/288: creat d4/d2a/d3a/f54 x:0 0 0 2023-12-05T09:26:15.143 INFO:tasks.workunit.client.1.smithi134.stdout:0/300: dread d13/d14/f3d [0,4194304] 0 2023-12-05T09:26:15.143 INFO:tasks.workunit.client.1.smithi134.stdout:0/301: chown d13/d14/d15/c1a 0 1 2023-12-05T09:26:15.144 INFO:tasks.workunit.client.1.smithi134.stdout:6/289: unlink d4/l2d 0 2023-12-05T09:26:15.148 INFO:tasks.workunit.client.1.smithi134.stdout:4/318: dread d16/d18/d1c/f2c [0,4194304] 0 2023-12-05T09:26:15.148 INFO:tasks.workunit.client.1.smithi134.stdout:4/319: write d16/d21/f57 [1407151,82049] 0 2023-12-05T09:26:15.151 INFO:tasks.workunit.client.1.smithi134.stdout:0/302: mknod d13/d14/d15/d2a/c61 0 2023-12-05T09:26:15.152 INFO:tasks.workunit.client.1.smithi134.stdout:6/290: getdents d4/d2a/d3a/da 0 2023-12-05T09:26:15.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/195: read d2/d5/d7/de/f37 [1759231,81721] 0 2023-12-05T09:26:15.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/196: truncate d2/d3/f18 406197 0 2023-12-05T09:26:15.155 INFO:tasks.workunit.client.0.smithi067.stdout:1/197: mkdir d2/d5/d7/d46 0 2023-12-05T09:26:15.156 INFO:tasks.workunit.client.1.smithi134.stdout:4/320: symlink d16/d21/l70 0 2023-12-05T09:26:15.156 INFO:tasks.workunit.client.1.smithi134.stdout:4/321: truncate f15 4981121 0 2023-12-05T09:26:15.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/291: write d4/d39/f53 [1045379,43211] 0 2023-12-05T09:26:15.156 INFO:tasks.workunit.client.1.smithi134.stdout:4/322: write d16/d18/d1c/f2c [3333706,12552] 0 2023-12-05T09:26:15.156 INFO:tasks.workunit.client.1.smithi134.stdout:4/323: fdatasync d16/d18/d1b/f31 0 2023-12-05T09:26:15.156 INFO:tasks.workunit.client.1.smithi134.stdout:0/303: truncate f7 1851088 0 2023-12-05T09:26:15.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/292: unlink d4/d2a/d3a/da/d1b/l3b 0 2023-12-05T09:26:15.156 INFO:tasks.workunit.client.0.smithi067.stdout:1/198: write d2/d5/d7/de/d10/d14/f42 [289170,93476] 0 2023-12-05T09:26:15.157 INFO:tasks.workunit.client.0.smithi067.stdout:1/199: truncate d2/d5/d7/de/d10/d15/f29 4109275 0 2023-12-05T09:26:15.158 INFO:tasks.workunit.client.1.smithi134.stdout:2/326: dwrite d19/f24 [0,4194304] 0 2023-12-05T09:26:15.159 INFO:tasks.workunit.client.1.smithi134.stdout:6/293: read d4/d39/f53 [670228,115094] 0 2023-12-05T09:26:15.167 INFO:tasks.workunit.client.1.smithi134.stdout:3/303: dwrite d4/d5/f1a [4194304,4194304] 0 2023-12-05T09:26:15.170 INFO:tasks.workunit.client.0.smithi067.stdout:1/200: write d2/d5/d7/de/d10/f1e [4101974,111374] 0 2023-12-05T09:26:15.176 INFO:tasks.workunit.client.0.smithi067.stdout:5/193: dwrite db/f13 [0,4194304] 0 2023-12-05T09:26:15.177 INFO:tasks.workunit.client.1.smithi134.stdout:7/292: dwrite d2/d7/dc/f31 [0,4194304] 0 2023-12-05T09:26:15.177 INFO:tasks.workunit.client.1.smithi134.stdout:7/293: chown d2/d7/dc/d2e/f4c 27632282 1 2023-12-05T09:26:15.178 INFO:tasks.workunit.client.0.smithi067.stdout:5/194: write db/df/d1a/d1d/d20/f2c [602769,106082] 0 2023-12-05T09:26:15.179 INFO:tasks.workunit.client.0.smithi067.stdout:5/195: fdatasync db/df/f31 0 2023-12-05T09:26:15.179 INFO:tasks.workunit.client.0.smithi067.stdout:5/196: write f6 [19467,53271] 0 2023-12-05T09:26:15.180 INFO:tasks.workunit.client.1.smithi134.stdout:1/346: dwrite d2/f17 [0,4194304] 0 2023-12-05T09:26:15.183 INFO:tasks.workunit.client.1.smithi134.stdout:8/362: dwrite da/de/d11/f19 [0,4194304] 0 2023-12-05T09:26:15.186 INFO:tasks.workunit.client.1.smithi134.stdout:8/363: write da/de/d11/f34 [276477,32578] 0 2023-12-05T09:26:15.187 INFO:tasks.workunit.client.1.smithi134.stdout:3/304: dread d4/d5/f10 [0,4194304] 0 2023-12-05T09:26:15.210 INFO:tasks.workunit.client.1.smithi134.stdout:0/304: dwrite d13/f38 [0,4194304] 0 2023-12-05T09:26:15.210 INFO:tasks.workunit.client.1.smithi134.stdout:0/305: write d13/d14/d30/d2c/f47 [1740502,106253] 0 2023-12-05T09:26:15.211 INFO:tasks.workunit.client.1.smithi134.stdout:0/306: chown fd 394037488 1 2023-12-05T09:26:15.215 INFO:tasks.workunit.client.1.smithi134.stdout:0/307: fdatasync d13/f35 0 2023-12-05T09:26:15.218 INFO:tasks.workunit.client.1.smithi134.stdout:8/364: read da/f3e [2408524,106336] 0 2023-12-05T09:26:15.238 INFO:tasks.workunit.client.1.smithi134.stdout:2/327: rmdir d19/d49 39 2023-12-05T09:26:15.239 INFO:tasks.workunit.client.1.smithi134.stdout:4/324: dwrite d16/d18/d1a/f3e [4194304,4194304] 0 2023-12-05T09:26:15.239 INFO:tasks.workunit.client.1.smithi134.stdout:6/294: symlink d4/d2a/d3a/l55 0 2023-12-05T09:26:15.239 INFO:tasks.workunit.client.1.smithi134.stdout:6/295: stat d4/d32 0 2023-12-05T09:26:15.241 INFO:tasks.workunit.client.1.smithi134.stdout:6/296: write d4/d39/f37 [267086,18230] 0 2023-12-05T09:26:15.241 INFO:tasks.workunit.client.1.smithi134.stdout:6/297: fsync d4/d2a/d3a/f36 0 2023-12-05T09:26:15.241 INFO:tasks.workunit.client.0.smithi067.stdout:1/201: rename d2/d5/d7/de/d10/d15/f1c to d2/d5/d7/de/d10/d14/f47 0 2023-12-05T09:26:15.241 INFO:tasks.workunit.client.0.smithi067.stdout:1/202: chown d2/f39 43768167 1 2023-12-05T09:26:15.245 INFO:tasks.workunit.client.1.smithi134.stdout:7/294: creat d2/d7/dc/d2e/d3a/f5e x:0 0 0 2023-12-05T09:26:15.248 INFO:tasks.workunit.client.1.smithi134.stdout:2/328: write fd [1672509,45902] 0 2023-12-05T09:26:15.257 INFO:tasks.workunit.client.0.smithi067.stdout:5/197: symlink db/df/d1a/d1d/l44 0 2023-12-05T09:26:15.257 INFO:tasks.workunit.client.1.smithi134.stdout:2/329: write f8 [44298,86696] 0 2023-12-05T09:26:15.260 INFO:tasks.workunit.client.0.smithi067.stdout:6/140: sync 2023-12-05T09:26:15.261 INFO:tasks.workunit.client.0.smithi067.stdout:6/141: truncate da/d10/d1e/d17/d2f/f2b 1723262 0 2023-12-05T09:26:15.261 INFO:tasks.workunit.client.0.smithi067.stdout:6/142: fsync f4 0 2023-12-05T09:26:15.262 INFO:tasks.workunit.client.0.smithi067.stdout:1/203: rmdir d2/d5/d7/d46 0 2023-12-05T09:26:15.262 INFO:tasks.workunit.client.0.smithi067.stdout:1/204: fdatasync d2/d5/d7/de/d19/f38 0 2023-12-05T09:26:15.264 INFO:tasks.workunit.client.0.smithi067.stdout:5/198: rename db/df/d1a/d1d/c33 to db/df/d1a/d1d/c45 0 2023-12-05T09:26:15.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/205: mkdir d2/d5/d7/de/d10/d14/d48 0 2023-12-05T09:26:15.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/206: readlink d2/d3/l1f 0 2023-12-05T09:26:15.269 INFO:tasks.workunit.client.0.smithi067.stdout:1/207: mkdir d2/d5/d7/de/d19/d49 0 2023-12-05T09:26:15.270 INFO:tasks.workunit.client.0.smithi067.stdout:1/208: fsync d2/d5/d7/de/d10/d15/f29 0 2023-12-05T09:26:15.271 INFO:tasks.workunit.client.1.smithi134.stdout:1/347: creat d2/d27/d40/f84 x:0 0 0 2023-12-05T09:26:15.275 INFO:tasks.workunit.client.1.smithi134.stdout:3/305: mkdir d4/d5/d45/d60 0 2023-12-05T09:26:15.280 INFO:tasks.workunit.client.1.smithi134.stdout:0/308: rmdir d13/d14/d30/d2c/d56 0 2023-12-05T09:26:15.282 INFO:tasks.workunit.client.1.smithi134.stdout:8/365: creat da/de/d16/d2d/f7b x:0 0 0 2023-12-05T09:26:15.284 INFO:tasks.workunit.client.1.smithi134.stdout:5/265: sync 2023-12-05T09:26:15.284 INFO:tasks.workunit.client.1.smithi134.stdout:5/266: read - d0/d45/f5a zero size 2023-12-05T09:26:15.287 INFO:tasks.workunit.client.1.smithi134.stdout:4/325: creat d16/d21/d48/d66/f71 x:0 0 0 2023-12-05T09:26:15.288 INFO:tasks.workunit.client.1.smithi134.stdout:7/295: symlink d2/d7/d25/l5f 0 2023-12-05T09:26:15.288 INFO:tasks.workunit.client.1.smithi134.stdout:7/296: truncate d2/d7/dc/d2e/d3a/f4e 1109160 0 2023-12-05T09:26:15.290 INFO:tasks.workunit.client.1.smithi134.stdout:2/330: mknod d19/d28/d2b/c6b 0 2023-12-05T09:26:15.291 INFO:tasks.workunit.client.1.smithi134.stdout:1/348: mkdir d2/d9/d10/d30/d4a/d85 0 2023-12-05T09:26:15.292 INFO:tasks.workunit.client.1.smithi134.stdout:1/349: chown d2/d56 4463 1 2023-12-05T09:26:15.292 INFO:tasks.workunit.client.1.smithi134.stdout:7/297: write d2/d7/d2b/f55 [505168,59355] 0 2023-12-05T09:26:15.292 INFO:tasks.workunit.client.1.smithi134.stdout:3/306: creat d4/d1f/d4e/f61 x:0 0 0 2023-12-05T09:26:15.293 INFO:tasks.workunit.client.1.smithi134.stdout:0/309: creat d13/d14/d15/f62 x:0 0 0 2023-12-05T09:26:15.296 INFO:tasks.workunit.client.1.smithi134.stdout:5/267: mkdir d0/d1a/d1c/d3f/d5b/d5d 0 2023-12-05T09:26:15.300 INFO:tasks.workunit.client.1.smithi134.stdout:6/298: rename d4/d2a/d3a/l55 to d4/d2a/d3a/da/l56 0 2023-12-05T09:26:15.301 INFO:tasks.workunit.client.1.smithi134.stdout:6/299: dread - d4/d2a/d3a/f54 zero size 2023-12-05T09:26:15.305 INFO:tasks.workunit.client.1.smithi134.stdout:9/278: sync 2023-12-05T09:26:15.305 INFO:tasks.workunit.client.1.smithi134.stdout:4/326: write d16/d18/f6d [3962803,109838] 0 2023-12-05T09:26:15.305 INFO:tasks.workunit.client.1.smithi134.stdout:2/331: write f16 [785786,92209] 0 2023-12-05T09:26:15.305 INFO:tasks.workunit.client.1.smithi134.stdout:2/332: chown d19/d28/f30 355255 1 2023-12-05T09:26:15.305 INFO:tasks.workunit.client.1.smithi134.stdout:7/298: mknod d2/dd/d1a/c60 0 2023-12-05T09:26:15.305 INFO:tasks.workunit.client.1.smithi134.stdout:7/299: chown d2/d7/dc/c4f 468265425 1 2023-12-05T09:26:15.305 INFO:tasks.workunit.client.1.smithi134.stdout:1/350: unlink d2/d9/d10/f4e 0 2023-12-05T09:26:15.305 INFO:tasks.workunit.client.1.smithi134.stdout:1/351: fsync d2/d9/d10/f67 0 2023-12-05T09:26:15.306 INFO:tasks.workunit.client.1.smithi134.stdout:8/366: rename da/de/d16/d33/c59 to da/de/d16/c7c 0 2023-12-05T09:26:15.308 INFO:tasks.workunit.client.1.smithi134.stdout:4/327: truncate d16/f41 2458758 0 2023-12-05T09:26:15.311 INFO:tasks.workunit.client.1.smithi134.stdout:2/333: mknod d19/d3f/c6c 0 2023-12-05T09:26:15.311 INFO:tasks.workunit.client.1.smithi134.stdout:2/334: stat d19/d49/c51 0 2023-12-05T09:26:15.311 INFO:tasks.workunit.client.1.smithi134.stdout:7/300: mknod d2/df/d2a/d36/c61 0 2023-12-05T09:26:15.311 INFO:tasks.workunit.client.1.smithi134.stdout:2/335: write f15 [3730426,37397] 0 2023-12-05T09:26:15.312 INFO:tasks.workunit.client.1.smithi134.stdout:1/352: truncate d2/d9/d10/d30/f37 2460127 0 2023-12-05T09:26:15.312 INFO:tasks.workunit.client.1.smithi134.stdout:1/353: fdatasync d2/d27/f3a 0 2023-12-05T09:26:15.312 INFO:tasks.workunit.client.1.smithi134.stdout:1/354: fsync d2/d27/f54 0 2023-12-05T09:26:15.312 INFO:tasks.workunit.client.1.smithi134.stdout:1/355: write d2/d27/d71/d80/f83 [837132,58896] 0 2023-12-05T09:26:15.312 INFO:tasks.workunit.client.1.smithi134.stdout:8/367: creat da/de/d16/f7d x:0 0 0 2023-12-05T09:26:15.314 INFO:tasks.workunit.client.1.smithi134.stdout:4/328: creat d16/d18/d5b/d65/f72 x:0 0 0 2023-12-05T09:26:15.316 INFO:tasks.workunit.client.1.smithi134.stdout:2/336: mkdir d19/d6d 0 2023-12-05T09:26:15.317 INFO:tasks.workunit.client.1.smithi134.stdout:7/301: link d2/l6 d2/df/l62 0 2023-12-05T09:26:15.318 INFO:tasks.workunit.client.1.smithi134.stdout:1/356: creat d2/d9/f86 x:0 0 0 2023-12-05T09:26:15.318 INFO:tasks.workunit.client.0.smithi067.stdout:5/199: dwrite f6 [0,4194304] 0 2023-12-05T09:26:15.318 INFO:tasks.workunit.client.0.smithi067.stdout:5/200: fdatasync f1 0 2023-12-05T09:26:15.319 INFO:tasks.workunit.client.1.smithi134.stdout:4/329: creat d16/d18/d1c/d63/f73 x:0 0 0 2023-12-05T09:26:15.319 INFO:tasks.workunit.client.1.smithi134.stdout:4/330: read - d16/d21/d35/f60 zero size 2023-12-05T09:26:15.319 INFO:tasks.workunit.client.1.smithi134.stdout:4/331: truncate d16/d18/d1a/d3b/f5c 826908 0 2023-12-05T09:26:15.320 INFO:tasks.workunit.client.1.smithi134.stdout:2/337: mknod d19/d28/d31/c6e 0 2023-12-05T09:26:15.321 INFO:tasks.workunit.client.0.smithi067.stdout:5/201: mkdir db/df/d1a/d1d/d20/d46 0 2023-12-05T09:26:15.321 INFO:tasks.workunit.client.0.smithi067.stdout:5/202: readlink db/df/d1a/d1d/l44 0 2023-12-05T09:26:15.321 INFO:tasks.workunit.client.0.smithi067.stdout:1/209: dread d2/d5/d7/de/d19/f38 [0,4194304] 0 2023-12-05T09:26:15.324 INFO:tasks.workunit.client.1.smithi134.stdout:7/302: mkdir d2/df/d2a/d63 0 2023-12-05T09:26:15.325 INFO:tasks.workunit.client.1.smithi134.stdout:7/303: write d2/d7/dc/d2e/f3e [1115180,89991] 0 2023-12-05T09:26:15.325 INFO:tasks.workunit.client.0.smithi067.stdout:5/203: mkdir db/df/d1a/d1d/d20/d47 0 2023-12-05T09:26:15.326 INFO:tasks.workunit.client.1.smithi134.stdout:6/300: dread d4/f17 [0,4194304] 0 2023-12-05T09:26:15.330 INFO:tasks.workunit.client.0.smithi067.stdout:6/143: dwrite da/d10/f11 [0,4194304] 0 2023-12-05T09:26:15.331 INFO:tasks.workunit.client.1.smithi134.stdout:4/332: creat d16/d21/d47/d4b/f74 x:0 0 0 2023-12-05T09:26:15.331 INFO:tasks.workunit.client.1.smithi134.stdout:7/304: rename d2/dd/d1a/f45 to d2/df/d2a/d36/f64 0 2023-12-05T09:26:15.331 INFO:tasks.workunit.client.1.smithi134.stdout:2/338: write f12 [265050,107002] 0 2023-12-05T09:26:15.331 INFO:tasks.workunit.client.1.smithi134.stdout:2/339: stat d19/f2d 0 2023-12-05T09:26:15.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/301: mkdir d4/d32/d57 0 2023-12-05T09:26:15.334 INFO:tasks.workunit.client.0.smithi067.stdout:5/204: rename db/df/c1e to db/df/d3f/c48 0 2023-12-05T09:26:15.334 INFO:tasks.workunit.client.0.smithi067.stdout:5/205: fsync db/df/d1a/d1d/f24 0 2023-12-05T09:26:15.336 INFO:tasks.workunit.client.1.smithi134.stdout:7/305: mkdir d2/d7/d65 0 2023-12-05T09:26:15.338 INFO:tasks.workunit.client.1.smithi134.stdout:9/279: dwrite d7/f40 [4194304,4194304] 0 2023-12-05T09:26:15.340 INFO:tasks.workunit.client.0.smithi067.stdout:5/206: symlink db/df/d3f/l49 0 2023-12-05T09:26:15.341 INFO:tasks.workunit.client.1.smithi134.stdout:4/333: dread d16/d18/d1a/d3b/f5c [0,4194304] 0 2023-12-05T09:26:15.341 INFO:tasks.workunit.client.1.smithi134.stdout:6/302: truncate d4/d2a/f48 1092465 0 2023-12-05T09:26:15.341 INFO:tasks.workunit.client.1.smithi134.stdout:7/306: creat d2/d7/d2b/d2d/f66 x:0 0 0 2023-12-05T09:26:15.344 INFO:tasks.workunit.client.0.smithi067.stdout:5/207: chown db/df/c10 1734590402 1 2023-12-05T09:26:15.346 INFO:tasks.workunit.client.1.smithi134.stdout:6/303: symlink d4/d32/d57/l58 0 2023-12-05T09:26:15.347 INFO:tasks.workunit.client.1.smithi134.stdout:1/357: read d2/d9/d10/f3f [54645,59043] 0 2023-12-05T09:26:15.347 INFO:tasks.workunit.client.1.smithi134.stdout:1/358: creat d2/d27/d40/f87 x:0 0 0 2023-12-05T09:26:15.348 INFO:tasks.workunit.client.1.smithi134.stdout:9/280: read d7/d8/d14/f54 [116924,105260] 0 2023-12-05T09:26:15.351 INFO:tasks.workunit.client.0.smithi067.stdout:5/208: rename f6 to db/df/d3f/f4a 0 2023-12-05T09:26:15.352 INFO:tasks.workunit.client.1.smithi134.stdout:7/307: stat d2/l52 0 2023-12-05T09:26:15.354 INFO:tasks.workunit.client.1.smithi134.stdout:4/334: write d16/d21/d48/f34 [2213801,107772] 0 2023-12-05T09:26:15.356 INFO:tasks.workunit.client.1.smithi134.stdout:2/340: dread f6 [0,4194304] 0 2023-12-05T09:26:15.358 INFO:tasks.workunit.client.1.smithi134.stdout:5/268: dwrite d0/dd/f17 [0,4194304] 0 2023-12-05T09:26:15.358 INFO:tasks.workunit.client.1.smithi134.stdout:5/269: write d0/dd/d37/f53 [207785,107991] 0 2023-12-05T09:26:15.359 INFO:tasks.workunit.client.1.smithi134.stdout:5/270: fsync d0/f33 0 2023-12-05T09:26:15.361 INFO:tasks.workunit.client.1.smithi134.stdout:3/307: dwrite d4/f12 [0,4194304] 0 2023-12-05T09:26:15.365 INFO:tasks.workunit.client.1.smithi134.stdout:1/359: rename d2/d9/d10/d30/l32 to d2/d56/d74/l88 0 2023-12-05T09:26:15.365 INFO:tasks.workunit.client.1.smithi134.stdout:7/308: mkdir d2/d7/d2b/d2d/d67 0 2023-12-05T09:26:15.371 INFO:tasks.workunit.client.0.smithi067.stdout:6/144: read da/d10/d1e/d17/f23 [7845356,79408] 0 2023-12-05T09:26:15.372 INFO:tasks.workunit.client.1.smithi134.stdout:2/341: mkdir d19/d28/d31/d6f 0 2023-12-05T09:26:15.372 INFO:tasks.workunit.client.1.smithi134.stdout:2/342: write d19/f5d [912255,102788] 0 2023-12-05T09:26:15.373 INFO:tasks.workunit.client.1.smithi134.stdout:5/271: getdents d0/d1a 0 2023-12-05T09:26:15.373 INFO:tasks.workunit.client.1.smithi134.stdout:5/272: dread - d0/dd/f20 zero size 2023-12-05T09:26:15.373 INFO:tasks.workunit.client.1.smithi134.stdout:3/308: symlink d4/d1f/d50/d5a/l62 0 2023-12-05T09:26:15.373 INFO:tasks.workunit.client.1.smithi134.stdout:6/304: mkdir d4/d2a/d3a/da/d1b/d59 0 2023-12-05T09:26:15.373 INFO:tasks.workunit.client.1.smithi134.stdout:6/305: truncate d4/f26 966253 0 2023-12-05T09:26:15.374 INFO:tasks.workunit.client.0.smithi067.stdout:6/145: stat c1 0 2023-12-05T09:26:15.379 INFO:tasks.workunit.client.1.smithi134.stdout:5/273: symlink d0/d11/d5c/l5e 0 2023-12-05T09:26:15.381 INFO:tasks.workunit.client.1.smithi134.stdout:7/309: getdents d2/d7/d25/d26 0 2023-12-05T09:26:15.383 INFO:tasks.workunit.client.1.smithi134.stdout:5/274: mknod d0/d1a/d3a/c5f 0 2023-12-05T09:26:15.387 INFO:tasks.workunit.client.1.smithi134.stdout:7/310: creat d2/df/f68 x:0 0 0 2023-12-05T09:26:15.391 INFO:tasks.workunit.client.1.smithi134.stdout:7/311: rmdir d2/d7/dc 39 2023-12-05T09:26:15.393 INFO:tasks.workunit.client.1.smithi134.stdout:7/312: mknod d2/df/d2a/c69 0 2023-12-05T09:26:15.395 INFO:tasks.workunit.client.1.smithi134.stdout:3/309: dread d4/f1b [0,4194304] 0 2023-12-05T09:26:15.398 INFO:tasks.workunit.client.1.smithi134.stdout:1/360: dread d2/f19 [0,4194304] 0 2023-12-05T09:26:15.398 INFO:tasks.workunit.client.1.smithi134.stdout:1/361: stat d2/d9/f2c 0 2023-12-05T09:26:15.398 INFO:tasks.workunit.client.1.smithi134.stdout:1/362: dread - d2/d27/f3d zero size 2023-12-05T09:26:15.398 INFO:tasks.workunit.client.1.smithi134.stdout:1/363: truncate d2/d9/f44 256262 0 2023-12-05T09:26:15.398 INFO:tasks.workunit.client.1.smithi134.stdout:1/364: creat d2/d27/d40/f89 x:0 0 0 2023-12-05T09:26:15.398 INFO:tasks.workunit.client.1.smithi134.stdout:1/365: readlink d2/d9/d10/d30/d66/l76 0 2023-12-05T09:26:15.398 INFO:tasks.workunit.client.1.smithi134.stdout:3/310: rename d4/d5/c3c to d4/d1f/c63 0 2023-12-05T09:26:15.400 INFO:tasks.workunit.client.0.smithi067.stdout:1/210: dwrite d2/d5/d7/de/d10/f1e [0,4194304] 0 2023-12-05T09:26:15.400 INFO:tasks.workunit.client.0.smithi067.stdout:1/211: dread - d2/d3/f3d zero size 2023-12-05T09:26:15.400 INFO:tasks.workunit.client.0.smithi067.stdout:1/212: chown d2/d3/f18 8583 1 2023-12-05T09:26:15.401 INFO:tasks.workunit.client.1.smithi134.stdout:1/366: creat d2/d27/f8a x:0 0 0 2023-12-05T09:26:15.404 INFO:tasks.workunit.client.0.smithi067.stdout:1/213: symlink d2/d3/l4a 0 2023-12-05T09:26:15.404 INFO:tasks.workunit.client.0.smithi067.stdout:4/154: sync 2023-12-05T09:26:15.405 INFO:tasks.workunit.client.1.smithi134.stdout:2/343: dread d19/f2d [0,4194304] 0 2023-12-05T09:26:15.406 INFO:tasks.workunit.client.0.smithi067.stdout:1/214: link d2/d5/d7/de/d1a/f44 d2/d5/d7/de/d1a/f4b 0 2023-12-05T09:26:15.408 INFO:tasks.workunit.client.0.smithi067.stdout:5/209: dwrite db/f14 [0,4194304] 0 2023-12-05T09:26:15.409 INFO:tasks.workunit.client.0.smithi067.stdout:4/155: link d0/d1d/f21 d0/d9/d12/d15/f33 0 2023-12-05T09:26:15.409 INFO:tasks.workunit.client.0.smithi067.stdout:4/156: chown d0/d9/d12/c1a 396123398 1 2023-12-05T09:26:15.414 INFO:tasks.workunit.client.0.smithi067.stdout:5/210: symlink db/df/d36/l4b 0 2023-12-05T09:26:15.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/157: unlink d0/fa 0 2023-12-05T09:26:15.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/335: dwrite ff [4194304,4194304] 0 2023-12-05T09:26:15.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/336: chown d16/d21/d47/f4a 2 1 2023-12-05T09:26:15.415 INFO:tasks.workunit.client.1.smithi134.stdout:5/275: dread d0/f33 [0,4194304] 0 2023-12-05T09:26:15.416 INFO:tasks.workunit.client.1.smithi134.stdout:2/344: rmdir d19/d28/d31/d38 39 2023-12-05T09:26:15.417 INFO:tasks.workunit.client.0.smithi067.stdout:5/211: creat db/df/d1a/f4c x:0 0 0 2023-12-05T09:26:15.418 INFO:tasks.workunit.client.1.smithi134.stdout:5/276: mkdir d0/d1a/d1c/d25/d4d/d60 0 2023-12-05T09:26:15.418 INFO:tasks.workunit.client.1.smithi134.stdout:5/277: chown d0/d1a/d1c/f31 1427361 1 2023-12-05T09:26:15.419 INFO:tasks.workunit.client.0.smithi067.stdout:4/158: rmdir d0/d1d/d2b 39 2023-12-05T09:26:15.419 INFO:tasks.workunit.client.1.smithi134.stdout:2/345: mkdir d19/d28/d63/d70 0 2023-12-05T09:26:15.419 INFO:tasks.workunit.client.1.smithi134.stdout:2/346: write d19/f1d [3410502,96525] 0 2023-12-05T09:26:15.420 INFO:tasks.workunit.client.1.smithi134.stdout:2/347: truncate d19/f69 29505 0 2023-12-05T09:26:15.420 INFO:tasks.workunit.client.1.smithi134.stdout:5/278: mkdir d0/d11/d61 0 2023-12-05T09:26:15.421 INFO:tasks.workunit.client.1.smithi134.stdout:7/313: write d2/df/d2a/d36/f64 [3833832,87139] 0 2023-12-05T09:26:15.421 INFO:tasks.workunit.client.1.smithi134.stdout:7/314: truncate d2/d7/dc/d2e/f3e 4552585 0 2023-12-05T09:26:15.421 INFO:tasks.workunit.client.0.smithi067.stdout:4/159: mkdir d0/d1d/d25/d2c/d34 0 2023-12-05T09:26:15.430 INFO:tasks.workunit.client.0.smithi067.stdout:5/212: link db/df/d1a/d1d/d20/c26 db/df/c4d 0 2023-12-05T09:26:15.430 INFO:tasks.workunit.client.0.smithi067.stdout:4/160: mknod d0/d1d/d24/c35 0 2023-12-05T09:26:15.430 INFO:tasks.workunit.client.0.smithi067.stdout:6/146: dwrite da/d10/d1e/d17/d2f/f2b [0,4194304] 0 2023-12-05T09:26:15.430 INFO:tasks.workunit.client.0.smithi067.stdout:6/147: fsync da/d10/f11 0 2023-12-05T09:26:15.433 INFO:tasks.workunit.client.1.smithi134.stdout:2/348: symlink d19/d6d/l71 0 2023-12-05T09:26:15.435 INFO:tasks.workunit.client.1.smithi134.stdout:7/315: creat d2/d7/dc/f6a x:0 0 0 2023-12-05T09:26:15.435 INFO:tasks.workunit.client.1.smithi134.stdout:7/316: chown d2/d7/dc/d2e/f4c 206037383 1 2023-12-05T09:26:15.435 INFO:tasks.workunit.client.1.smithi134.stdout:7/317: chown d2/d7/d25/d26/l5a 3 1 2023-12-05T09:26:15.443 INFO:tasks.workunit.client.1.smithi134.stdout:7/318: creat d2/dd/f6b x:0 0 0 2023-12-05T09:26:15.443 INFO:tasks.workunit.client.1.smithi134.stdout:7/319: stat d2/df 0 2023-12-05T09:26:15.443 INFO:tasks.workunit.client.0.smithi067.stdout:1/215: dread d2/d5/d7/de/d10/d15/f29 [0,4194304] 0 2023-12-05T09:26:15.443 INFO:tasks.workunit.client.0.smithi067.stdout:1/216: chown d2/d5/d7/de/d10/d14/f47 2650623 1 2023-12-05T09:26:15.444 INFO:tasks.workunit.client.0.smithi067.stdout:4/161: symlink d0/d1d/d25/d32/l36 0 2023-12-05T09:26:15.445 INFO:tasks.workunit.client.0.smithi067.stdout:6/148: truncate f4 2480046 0 2023-12-05T09:26:15.446 INFO:tasks.workunit.client.0.smithi067.stdout:1/217: mkdir d2/d5/d7/de/d10/d14/d20/d4c 0 2023-12-05T09:26:15.451 INFO:tasks.workunit.client.1.smithi134.stdout:6/306: dwrite d4/ff [0,4194304] 0 2023-12-05T09:26:15.451 INFO:tasks.workunit.client.1.smithi134.stdout:6/307: chown d4/d2a/d3a/f36 58411 1 2023-12-05T09:26:15.451 INFO:tasks.workunit.client.1.smithi134.stdout:3/311: write d4/f3b [2846298,26967] 0 2023-12-05T09:26:15.451 INFO:tasks.workunit.client.1.smithi134.stdout:3/312: readlink d4/d1f/d50/d52/d42/l2d 0 2023-12-05T09:26:15.451 INFO:tasks.workunit.client.1.smithi134.stdout:9/281: dwrite d7/d8/d2e/f42 [4194304,4194304] 0 2023-12-05T09:26:15.451 INFO:tasks.workunit.client.1.smithi134.stdout:9/282: chown d7/d8/d14 108225 1 2023-12-05T09:26:15.453 INFO:tasks.workunit.client.0.smithi067.stdout:5/213: dread f9 [0,4194304] 0 2023-12-05T09:26:15.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/149: getdents da/d10/d1e/d17 0 2023-12-05T09:26:15.454 INFO:tasks.workunit.client.1.smithi134.stdout:4/337: dwrite d16/d18/d1c/f3a [4194304,4194304] 0 2023-12-05T09:26:15.454 INFO:tasks.workunit.client.1.smithi134.stdout:4/338: dread - d16/d21/d48/d66/f71 zero size 2023-12-05T09:26:15.456 INFO:tasks.workunit.client.0.smithi067.stdout:6/150: mknod da/d10/c33 0 2023-12-05T09:26:15.459 INFO:tasks.workunit.client.1.smithi134.stdout:3/313: creat d4/d1f/d50/f64 x:0 0 0 2023-12-05T09:26:15.463 INFO:tasks.workunit.client.0.smithi067.stdout:6/151: mkdir da/d10/d1e/d17/d2f/d2c/d34 0 2023-12-05T09:26:15.463 INFO:tasks.workunit.client.0.smithi067.stdout:6/152: chown da/d10/d1e/d17/d2f/d1f 884 1 2023-12-05T09:26:15.466 INFO:tasks.workunit.client.1.smithi134.stdout:4/339: link d16/d18/d5b/l64 d16/d18/d5b/l75 0 2023-12-05T09:26:15.467 INFO:tasks.workunit.client.0.smithi067.stdout:3/127: sync 2023-12-05T09:26:15.467 INFO:tasks.workunit.client.0.smithi067.stdout:7/259: sync 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:2/174: sync 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:9/358: sync 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:3/128: readlink d9/l1f 0 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:2/175: getdents d0/d2f/d39 0 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:9/359: write d1b/d25/d35/f5e [402134,6174] 0 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:8/204: sync 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:0/283: sync 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:7/260: write d0/f4a [51718,103393] 0 2023-12-05T09:26:15.468 INFO:tasks.workunit.client.0.smithi067.stdout:0/284: creat d3/df/f63 x:0 0 0 2023-12-05T09:26:15.469 INFO:tasks.workunit.client.0.smithi067.stdout:8/205: write d5/da/f1f [415353,51888] 0 2023-12-05T09:26:15.469 INFO:tasks.workunit.client.0.smithi067.stdout:8/206: fsync d5/dc/d1a/f21 0 2023-12-05T09:26:15.469 INFO:tasks.workunit.client.0.smithi067.stdout:8/207: chown d5/da/f2a 241734329 1 2023-12-05T09:26:15.469 INFO:tasks.workunit.client.0.smithi067.stdout:8/208: readlink d5/l24 0 2023-12-05T09:26:15.469 INFO:tasks.workunit.client.0.smithi067.stdout:6/153: symlink da/d10/d1e/d17/l35 0 2023-12-05T09:26:15.470 INFO:tasks.workunit.client.1.smithi134.stdout:6/308: rename d4/d2a/d3a/da/c24 to d4/d2a/d3a/da/d1b/d59/c5a 0 2023-12-05T09:26:15.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/314: creat d4/d1f/d4e/f65 x:0 0 0 2023-12-05T09:26:15.474 INFO:tasks.workunit.client.0.smithi067.stdout:4/162: dwrite d0/d1d/d2b/f2e [4194304,4194304] 0 2023-12-05T09:26:15.474 INFO:tasks.workunit.client.0.smithi067.stdout:3/129: creat d9/f27 x:0 0 0 2023-12-05T09:26:15.478 INFO:tasks.workunit.client.0.smithi067.stdout:2/176: mknod d0/c3c 0 2023-12-05T09:26:15.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/315: creat d4/d5/d45/d60/f66 x:0 0 0 2023-12-05T09:26:15.483 INFO:tasks.workunit.client.1.smithi134.stdout:6/309: write d4/f46 [146289,48048] 0 2023-12-05T09:26:15.484 INFO:tasks.workunit.client.1.smithi134.stdout:3/316: rename d4/lc to d4/l67 0 2023-12-05T09:26:15.484 INFO:tasks.workunit.client.1.smithi134.stdout:3/317: write d4/fb [532257,119160] 0 2023-12-05T09:26:15.484 INFO:tasks.workunit.client.1.smithi134.stdout:3/318: chown d4/d5/d45/f4d 203 1 2023-12-05T09:26:15.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/360: link d1b/f5f d1b/d25/d35/f79 0 2023-12-05T09:26:15.485 INFO:tasks.workunit.client.0.smithi067.stdout:9/361: dread - d1b/d25/d54/d5c/f69 zero size 2023-12-05T09:26:15.493 INFO:tasks.workunit.client.0.smithi067.stdout:7/261: mkdir d0/d9/d1b/d54 0 2023-12-05T09:26:15.493 INFO:tasks.workunit.client.0.smithi067.stdout:0/285: symlink d3/d7/d3c/d49/d59/l64 0 2023-12-05T09:26:15.493 INFO:tasks.workunit.client.0.smithi067.stdout:0/286: chown d3/d7/d3c/d57/c5e 1622752 1 2023-12-05T09:26:15.494 INFO:tasks.workunit.client.0.smithi067.stdout:0/287: fdatasync d3/f3b 0 2023-12-05T09:26:15.494 INFO:tasks.workunit.client.0.smithi067.stdout:0/288: dread - d3/f35 zero size 2023-12-05T09:26:15.494 INFO:tasks.workunit.client.0.smithi067.stdout:0/289: chown d3/df/f36 1 1 2023-12-05T09:26:15.494 INFO:tasks.workunit.client.0.smithi067.stdout:0/290: read d3/d7/d3c/d49/f5b [4000452,30239] 0 2023-12-05T09:26:15.494 INFO:tasks.workunit.client.1.smithi134.stdout:3/319: creat d4/d1f/d50/d5a/f68 x:0 0 0 2023-12-05T09:26:15.494 INFO:tasks.workunit.client.1.smithi134.stdout:3/320: creat d4/d1f/d50/f69 x:0 0 0 2023-12-05T09:26:15.495 INFO:tasks.workunit.client.1.smithi134.stdout:3/321: chown d4/d1f/d50/d5a 435990755 1 2023-12-05T09:26:15.495 INFO:tasks.workunit.client.0.smithi067.stdout:8/209: unlink d5/da/f17 0 2023-12-05T09:26:15.497 INFO:tasks.workunit.client.0.smithi067.stdout:0/291: write d3/df/f3e [29726,51611] 0 2023-12-05T09:26:15.497 INFO:tasks.workunit.client.1.smithi134.stdout:1/367: dread d2/d9/f48 [0,4194304] 0 2023-12-05T09:26:15.497 INFO:tasks.workunit.client.1.smithi134.stdout:1/368: stat d2/d9/d10/d30/d4a/f70 0 2023-12-05T09:26:15.500 INFO:tasks.workunit.client.0.smithi067.stdout:4/163: rename d0/d1d/d25/d32/l36 to d0/d1d/l37 0 2023-12-05T09:26:15.500 INFO:tasks.workunit.client.0.smithi067.stdout:4/164: chown d0 182386519 1 2023-12-05T09:26:15.503 INFO:tasks.workunit.client.0.smithi067.stdout:3/130: unlink d9/da/d15/d17/d1a/l25 0 2023-12-05T09:26:15.506 INFO:tasks.workunit.client.0.smithi067.stdout:9/362: rmdir d1b/d25/d35/d77 0 2023-12-05T09:26:15.507 INFO:tasks.workunit.client.1.smithi134.stdout:6/310: read d4/d2a/d3a/da/d1b/f30 [4069133,102835] 0 2023-12-05T09:26:15.509 INFO:tasks.workunit.client.0.smithi067.stdout:1/218: dread d2/d3/f1d [0,4194304] 0 2023-12-05T09:26:15.509 INFO:tasks.workunit.client.0.smithi067.stdout:1/219: stat d2/d5/d7/cb 0 2023-12-05T09:26:15.509 INFO:tasks.workunit.client.0.smithi067.stdout:1/220: truncate d2/d3/f2a 4486644 0 2023-12-05T09:26:15.512 INFO:tasks.workunit.client.1.smithi134.stdout:3/322: write d4/d1f/d50/d52/f58 [218715,117668] 0 2023-12-05T09:26:15.513 INFO:tasks.workunit.client.0.smithi067.stdout:8/210: rename d5/d3a to d5/d3b 0 2023-12-05T09:26:15.513 INFO:tasks.workunit.client.0.smithi067.stdout:8/211: read - d5/da/f33 zero size 2023-12-05T09:26:15.514 INFO:tasks.workunit.client.0.smithi067.stdout:8/212: truncate d5/dc/d1a/d20/f31 340366 0 2023-12-05T09:26:15.514 INFO:tasks.workunit.client.0.smithi067.stdout:8/213: fdatasync d5/da/f2a 0 2023-12-05T09:26:15.515 INFO:tasks.workunit.client.0.smithi067.stdout:0/292: truncate d3/df/f40 458716 0 2023-12-05T09:26:15.521 INFO:tasks.workunit.client.0.smithi067.stdout:1/221: getdents d2/d5/d7/de/d10/d15 0 2023-12-05T09:26:15.521 INFO:tasks.workunit.client.0.smithi067.stdout:1/222: fsync d2/d5/d7/de/d10/f3e 0 2023-12-05T09:26:15.530 INFO:tasks.workunit.client.0.smithi067.stdout:8/214: symlink d5/dc/d1a/d20/d2d/l3c 0 2023-12-05T09:26:15.542 INFO:tasks.workunit.client.0.smithi067.stdout:6/154: dwrite f4 [0,4194304] 0 2023-12-05T09:26:15.542 INFO:tasks.workunit.client.0.smithi067.stdout:6/155: chown da/d10 452541899 1 2023-12-05T09:26:15.542 INFO:tasks.workunit.client.0.smithi067.stdout:6/156: read da/fe [3837816,127078] 0 2023-12-05T09:26:15.542 INFO:tasks.workunit.client.0.smithi067.stdout:6/157: readlink da/d10/d1e/d17/d2f/d12/l1a 0 2023-12-05T09:26:15.545 INFO:tasks.workunit.client.1.smithi134.stdout:7/320: dread d2/d7/dc/d22/f27 [0,4194304] 0 2023-12-05T09:26:15.560 INFO:tasks.workunit.client.1.smithi134.stdout:1/369: rename d2/d27/d71/l7c to d2/d9/d10/d5b/d5e/l8b 0 2023-12-05T09:26:15.569 INFO:tasks.workunit.client.1.smithi134.stdout:3/323: dwrite d4/d1f/f2b [0,4194304] 0 2023-12-05T09:26:15.570 INFO:tasks.workunit.client.0.smithi067.stdout:6/158: rename da/d10/d1e/d17/f18 to da/d10/d1e/f36 0 2023-12-05T09:26:15.574 INFO:tasks.workunit.client.1.smithi134.stdout:6/311: readlink d4/d2a/d3a/da/lc 0 2023-12-05T09:26:15.574 INFO:tasks.workunit.client.1.smithi134.stdout:6/312: truncate d4/d2a/f43 219599 0 2023-12-05T09:26:15.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/321: creat d2/f6c x:0 0 0 2023-12-05T09:26:15.578 INFO:tasks.workunit.client.1.smithi134.stdout:7/322: fsync d2/dd/d1a/f23 0 2023-12-05T09:26:15.581 INFO:tasks.workunit.client.1.smithi134.stdout:1/370: mknod d2/d9/d10/d30/d4a/d81/c8c 0 2023-12-05T09:26:15.582 INFO:tasks.workunit.client.1.smithi134.stdout:1/371: write d2/d9/d10/f5a [3169822,56146] 0 2023-12-05T09:26:15.582 INFO:tasks.workunit.client.1.smithi134.stdout:1/372: write d2/d9/d10/d30/f64 [946802,72723] 0 2023-12-05T09:26:15.582 INFO:tasks.workunit.client.0.smithi067.stdout:5/214: dwrite f9 [0,4194304] 0 2023-12-05T09:26:15.582 INFO:tasks.workunit.client.0.smithi067.stdout:5/215: chown db/df/d1a/d1d/c27 0 1 2023-12-05T09:26:15.582 INFO:tasks.workunit.client.0.smithi067.stdout:5/216: chown db/df/d1a/d1d/c3c 212992258 1 2023-12-05T09:26:15.588 INFO:tasks.workunit.client.0.smithi067.stdout:6/159: symlink da/l37 0 2023-12-05T09:26:15.588 INFO:tasks.workunit.client.1.smithi134.stdout:3/324: rmdir d4/d5 39 2023-12-05T09:26:15.588 INFO:tasks.workunit.client.1.smithi134.stdout:3/325: chown d4/d1f/d50/d52/c4a 1421 1 2023-12-05T09:26:15.588 INFO:tasks.workunit.client.1.smithi134.stdout:3/326: chown d4/d1f/d50/d52/d42/f30 40 1 2023-12-05T09:26:15.590 INFO:tasks.workunit.client.1.smithi134.stdout:5/279: dwrite d0/d1a/f27 [0,4194304] 0 2023-12-05T09:26:15.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/217: symlink db/df/d1a/d1d/d20/d46/l4e 0 2023-12-05T09:26:15.599 INFO:tasks.workunit.client.1.smithi134.stdout:7/323: mkdir d2/d7/dc/d2e/d3a/d6d 0 2023-12-05T09:26:15.600 INFO:tasks.workunit.client.1.smithi134.stdout:7/324: dread - d2/d7/d25/d26/f58 zero size 2023-12-05T09:26:15.605 INFO:tasks.workunit.client.0.smithi067.stdout:5/218: getdents db/df/d3f 0 2023-12-05T09:26:15.605 INFO:tasks.workunit.client.0.smithi067.stdout:5/219: write db/df/d1a/d1d/d20/f2c [51460,2568] 0 2023-12-05T09:26:15.605 INFO:tasks.workunit.client.0.smithi067.stdout:5/220: dread - db/df/d1a/f29 zero size 2023-12-05T09:26:15.605 INFO:tasks.workunit.client.0.smithi067.stdout:5/221: chown db/df/d1a/d1d/d20/f2a 35 1 2023-12-05T09:26:15.609 INFO:tasks.workunit.client.1.smithi134.stdout:1/373: unlink d2/f19 0 2023-12-05T09:26:15.610 INFO:tasks.workunit.client.0.smithi067.stdout:1/223: dwrite d2/d3/f18 [0,4194304] 0 2023-12-05T09:26:15.614 INFO:tasks.workunit.client.1.smithi134.stdout:9/283: dwrite d7/d8/d14/f54 [0,4194304] 0 2023-12-05T09:26:15.614 INFO:tasks.workunit.client.1.smithi134.stdout:9/284: read - d7/d8/f50 zero size 2023-12-05T09:26:15.616 INFO:tasks.workunit.client.0.smithi067.stdout:6/160: dread da/d10/d1e/f36 [0,4194304] 0 2023-12-05T09:26:15.616 INFO:tasks.workunit.client.0.smithi067.stdout:6/161: fsync da/d10/d1e/d17/f23 0 2023-12-05T09:26:15.616 INFO:tasks.workunit.client.0.smithi067.stdout:4/165: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:15.622 INFO:tasks.workunit.client.0.smithi067.stdout:5/222: rename db/df/f12 to db/df/d36/f4f 0 2023-12-05T09:26:15.622 INFO:tasks.workunit.client.0.smithi067.stdout:5/223: fsync db/df/d1a/d1d/d20/f2a 0 2023-12-05T09:26:15.623 INFO:tasks.workunit.client.1.smithi134.stdout:5/280: link d0/d1a/f27 d0/d11/f62 0 2023-12-05T09:26:15.623 INFO:tasks.workunit.client.1.smithi134.stdout:5/281: dread - d0/d11/f1f zero size 2023-12-05T09:26:15.623 INFO:tasks.workunit.client.0.smithi067.stdout:8/215: dwrite d5/f14 [0,4194304] 0 2023-12-05T09:26:15.625 INFO:tasks.workunit.client.1.smithi134.stdout:8/368: sync 2023-12-05T09:26:15.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/310: sync 2023-12-05T09:26:15.626 INFO:tasks.workunit.client.1.smithi134.stdout:6/313: symlink d4/d39/l5b 0 2023-12-05T09:26:15.626 INFO:tasks.workunit.client.0.smithi067.stdout:3/131: dwrite d9/f14 [4194304,4194304] 0 2023-12-05T09:26:15.630 INFO:tasks.workunit.client.1.smithi134.stdout:1/374: mkdir d2/d9/d8d 0 2023-12-05T09:26:15.630 INFO:tasks.workunit.client.0.smithi067.stdout:9/363: dwrite d1b/f20 [0,4194304] 0 2023-12-05T09:26:15.630 INFO:tasks.workunit.client.1.smithi134.stdout:2/349: dwrite d19/f24 [0,4194304] 0 2023-12-05T09:26:15.631 INFO:tasks.workunit.client.1.smithi134.stdout:2/350: truncate fa 4754134 0 2023-12-05T09:26:15.633 INFO:tasks.workunit.client.0.smithi067.stdout:1/224: creat d2/d5/d7/de/d10/d14/d48/f4d x:0 0 0 2023-12-05T09:26:15.633 INFO:tasks.workunit.client.0.smithi067.stdout:1/225: truncate d2/d5/d7/de/d1a/f44 318064 0 2023-12-05T09:26:15.633 INFO:tasks.workunit.client.0.smithi067.stdout:1/226: write d2/f39 [545009,91131] 0 2023-12-05T09:26:15.633 INFO:tasks.workunit.client.0.smithi067.stdout:1/227: chown d2/d5/d7/de/d10/f1e 21136993 1 2023-12-05T09:26:15.633 INFO:tasks.workunit.client.0.smithi067.stdout:1/228: chown d2/d5/d7/de/d19/c3f 1 1 2023-12-05T09:26:15.633 INFO:tasks.workunit.client.0.smithi067.stdout:2/177: dwrite d0/d10/d1e/f35 [0,4194304] 0 2023-12-05T09:26:15.634 INFO:tasks.workunit.client.1.smithi134.stdout:4/340: dwrite d16/d18/d1a/f3e [0,4194304] 0 2023-12-05T09:26:15.634 INFO:tasks.workunit.client.0.smithi067.stdout:4/166: mkdir d0/d1d/d25/d38 0 2023-12-05T09:26:15.634 INFO:tasks.workunit.client.0.smithi067.stdout:4/167: write d0/d1d/f21 [1097269,130243] 0 2023-12-05T09:26:15.634 INFO:tasks.workunit.client.0.smithi067.stdout:4/168: fsync d0/d9/f2f 0 2023-12-05T09:26:15.636 INFO:tasks.workunit.client.0.smithi067.stdout:9/364: write d1b/d25/f33 [62810,20526] 0 2023-12-05T09:26:15.640 INFO:tasks.workunit.client.0.smithi067.stdout:5/224: creat db/df/f50 x:0 0 0 2023-12-05T09:26:15.642 INFO:tasks.workunit.client.0.smithi067.stdout:5/225: creat db/df/d1a/d1d/d20/f51 x:0 0 0 2023-12-05T09:26:15.647 INFO:tasks.workunit.client.1.smithi134.stdout:7/325: dwrite d2/d7/f13 [0,4194304] 0 2023-12-05T09:26:15.647 INFO:tasks.workunit.client.1.smithi134.stdout:7/326: readlink d2/d7/d25/l5f 0 2023-12-05T09:26:15.650 INFO:tasks.workunit.client.0.smithi067.stdout:7/262: dwrite d0/d9/d40/d48/f50 [0,4194304] 0 2023-12-05T09:26:15.650 INFO:tasks.workunit.client.0.smithi067.stdout:7/263: dread - d0/d9/d40/f4b zero size 2023-12-05T09:26:15.651 INFO:tasks.workunit.client.1.smithi134.stdout:8/369: unlink da/de/d16/f7d 0 2023-12-05T09:26:15.651 INFO:tasks.workunit.client.1.smithi134.stdout:8/370: fsync da/de/f2b 0 2023-12-05T09:26:15.654 INFO:tasks.workunit.client.0.smithi067.stdout:9/365: dread f11 [0,4194304] 0 2023-12-05T09:26:15.654 INFO:tasks.workunit.client.0.smithi067.stdout:9/366: creat d1b/f7a x:0 0 0 2023-12-05T09:26:15.657 INFO:tasks.workunit.client.0.smithi067.stdout:8/216: creat d5/d3b/f3d x:0 0 0 2023-12-05T09:26:15.657 INFO:tasks.workunit.client.0.smithi067.stdout:8/217: chown d5/dc/d1a/f21 7078 1 2023-12-05T09:26:15.660 INFO:tasks.workunit.client.1.smithi134.stdout:6/314: truncate d4/d2a/d3a/f3d 289977 0 2023-12-05T09:26:15.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/132: mkdir d9/da/d15/d28 0 2023-12-05T09:26:15.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/133: write d9/da/f22 [868084,99951] 0 2023-12-05T09:26:15.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/134: chown d9/c1e 2 1 2023-12-05T09:26:15.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/375: unlink d2/d9/d10/d30/d4a/f55 0 2023-12-05T09:26:15.675 INFO:tasks.workunit.client.1.smithi134.stdout:2/351: symlink d19/d28/d2b/l72 0 2023-12-05T09:26:15.675 INFO:tasks.workunit.client.1.smithi134.stdout:2/352: stat d19/d3a/d60/c68 0 2023-12-05T09:26:15.677 INFO:tasks.workunit.client.0.smithi067.stdout:1/229: link d2/d5/d7/de/f37 d2/d5/f4e 0 2023-12-05T09:26:15.678 INFO:tasks.workunit.client.0.smithi067.stdout:1/230: write d2/d3/f1d [665505,36946] 0 2023-12-05T09:26:15.678 INFO:tasks.workunit.client.0.smithi067.stdout:1/231: readlink d2/l45 0 2023-12-05T09:26:15.678 INFO:tasks.workunit.client.0.smithi067.stdout:1/232: write d2/d5/d7/de/d19/f38 [1547543,51284] 0 2023-12-05T09:26:15.678 INFO:tasks.workunit.client.1.smithi134.stdout:0/311: dwrite d13/f53 [0,4194304] 0 2023-12-05T09:26:15.682 INFO:tasks.workunit.client.0.smithi067.stdout:7/264: dread d0/f7 [0,4194304] 0 2023-12-05T09:26:15.685 INFO:tasks.workunit.client.0.smithi067.stdout:2/178: rename d0/d15/f27 to d0/d25/d34/f3d 0 2023-12-05T09:26:15.685 INFO:tasks.workunit.client.0.smithi067.stdout:2/179: creat d0/d10/d1e/f3e x:0 0 0 2023-12-05T09:26:15.686 INFO:tasks.workunit.client.1.smithi134.stdout:2/353: read fc [458529,41598] 0 2023-12-05T09:26:15.686 INFO:tasks.workunit.client.1.smithi134.stdout:2/354: write d19/d28/d2b/f4b [381586,68459] 0 2023-12-05T09:26:15.686 INFO:tasks.workunit.client.1.smithi134.stdout:2/355: fsync d19/d28/d31/d38/f6a 0 2023-12-05T09:26:15.686 INFO:tasks.workunit.client.1.smithi134.stdout:4/341: rmdir d16/d21/d69 39 2023-12-05T09:26:15.687 INFO:tasks.workunit.client.0.smithi067.stdout:4/169: creat d0/d1d/d25/d38/f39 x:0 0 0 2023-12-05T09:26:15.688 INFO:tasks.workunit.client.1.smithi134.stdout:9/285: getdents d7/d8/d14/d26 0 2023-12-05T09:26:15.688 INFO:tasks.workunit.client.1.smithi134.stdout:9/286: stat d7/d8/d16/c55 0 2023-12-05T09:26:15.690 INFO:tasks.workunit.client.1.smithi134.stdout:5/282: dwrite d0/dd/f2c [0,4194304] 0 2023-12-05T09:26:15.690 INFO:tasks.workunit.client.1.smithi134.stdout:5/283: read d0/dd/d37/f53 [227506,58147] 0 2023-12-05T09:26:15.692 INFO:tasks.workunit.client.0.smithi067.stdout:1/233: fdatasync d2/d5/d7/de/d10/d15/f29 0 2023-12-05T09:26:15.693 INFO:tasks.workunit.client.1.smithi134.stdout:7/327: truncate d2/d7/f37 1221604 0 2023-12-05T09:26:15.696 INFO:tasks.workunit.client.0.smithi067.stdout:2/180: dread d0/d10/d1e/f2d [0,4194304] 0 2023-12-05T09:26:15.697 INFO:tasks.workunit.client.0.smithi067.stdout:3/135: write d9/fb [4081086,121627] 0 2023-12-05T09:26:15.698 INFO:tasks.workunit.client.0.smithi067.stdout:8/218: mkdir d5/dc/d1a/d20/d3e 0 2023-12-05T09:26:15.699 INFO:tasks.workunit.client.0.smithi067.stdout:6/162: dwrite da/d10/d1e/d17/d2f/d1f/f25 [4194304,4194304] 0 2023-12-05T09:26:15.700 INFO:tasks.workunit.client.1.smithi134.stdout:8/371: rename da/de/d43/c52 to da/de/d11/d1d/d70/c7e 0 2023-12-05T09:26:15.700 INFO:tasks.workunit.client.1.smithi134.stdout:8/372: write da/de/d11/f6a [1933599,128413] 0 2023-12-05T09:26:15.702 INFO:tasks.workunit.client.0.smithi067.stdout:7/265: unlink d0/d9/d1b/f1e 0 2023-12-05T09:26:15.708 INFO:tasks.workunit.client.0.smithi067.stdout:9/367: rename d1b/d25/f32 to d1b/d25/d54/d5c/d6a/d6c/d76/f7b 0 2023-12-05T09:26:15.712 INFO:tasks.workunit.client.0.smithi067.stdout:4/170: creat d0/d1d/d25/d2c/f3a x:0 0 0 2023-12-05T09:26:15.712 INFO:tasks.workunit.client.0.smithi067.stdout:4/171: readlink d0/d1d/d25/d32/l1b 0 2023-12-05T09:26:15.712 INFO:tasks.workunit.client.0.smithi067.stdout:4/172: truncate d0/d9/d12/f14 1039664 0 2023-12-05T09:26:15.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/293: dwrite d3/d7/d3c/d49/d59/d4e/f5d [0,4194304] 0 2023-12-05T09:26:15.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/294: chown d3/d7/d3c/d49/d59/c62 4 1 2023-12-05T09:26:15.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/295: readlink d3/df/l60 0 2023-12-05T09:26:15.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/296: dread - d3/f35 zero size 2023-12-05T09:26:15.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/297: fsync d3/df/f63 0 2023-12-05T09:26:15.718 INFO:tasks.workunit.client.0.smithi067.stdout:2/181: mkdir d0/d25/d3f 0 2023-12-05T09:26:15.725 INFO:tasks.workunit.client.0.smithi067.stdout:3/136: unlink d9/da/d15/d17/d1a/f1d 0 2023-12-05T09:26:15.728 INFO:tasks.workunit.client.0.smithi067.stdout:8/219: rename d5/dc/f23 to d5/dc/f3f 0 2023-12-05T09:26:15.729 INFO:tasks.workunit.client.1.smithi134.stdout:1/376: creat d2/d9/d10/d30/d4a/d81/f8e x:0 0 0 2023-12-05T09:26:15.732 INFO:tasks.workunit.client.0.smithi067.stdout:8/220: read d5/dc/d1a/f21 [7052990,108326] 0 2023-12-05T09:26:15.732 INFO:tasks.workunit.client.0.smithi067.stdout:8/221: dread - d5/dc/d1a/f2f zero size 2023-12-05T09:26:15.733 INFO:tasks.workunit.client.1.smithi134.stdout:0/312: creat d13/d14/d15/d50/f63 x:0 0 0 2023-12-05T09:26:15.733 INFO:tasks.workunit.client.0.smithi067.stdout:6/163: mknod da/d10/d1e/d17/d2f/c38 0 2023-12-05T09:26:15.737 INFO:tasks.workunit.client.1.smithi134.stdout:2/356: symlink d19/d28/d31/d38/l73 0 2023-12-05T09:26:15.737 INFO:tasks.workunit.client.1.smithi134.stdout:2/357: write d19/d28/d31/d38/f59 [1352667,78756] 0 2023-12-05T09:26:15.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/368: mknod d1b/d25/d54/d5c/d6a/d6c/d78/c7c 0 2023-12-05T09:26:15.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/369: fsync f14 0 2023-12-05T09:26:15.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/370: creat d1b/d25/d35/d56/f7d x:0 0 0 2023-12-05T09:26:15.749 INFO:tasks.workunit.client.0.smithi067.stdout:5/226: dwrite db/df/d1a/f4c [0,4194304] 0 2023-12-05T09:26:15.749 INFO:tasks.workunit.client.0.smithi067.stdout:4/173: symlink d0/d9/d12/d15/l3b 0 2023-12-05T09:26:15.750 INFO:tasks.workunit.client.1.smithi134.stdout:8/373: dwrite da/de/d11/f30 [0,4194304] 0 2023-12-05T09:26:15.753 INFO:tasks.workunit.client.1.smithi134.stdout:5/284: link d0/f43 d0/d1a/d1c/d3f/d5b/f63 0 2023-12-05T09:26:15.756 INFO:tasks.workunit.client.0.smithi067.stdout:0/298: unlink d3/d7/f8 0 2023-12-05T09:26:15.758 INFO:tasks.workunit.client.0.smithi067.stdout:3/137: mkdir d9/da/d15/d28/d29 0 2023-12-05T09:26:15.760 INFO:tasks.workunit.client.1.smithi134.stdout:7/328: rename d2/f21 to d2/d7/d2b/d2d/d67/f6e 0 2023-12-05T09:26:15.761 INFO:tasks.workunit.client.0.smithi067.stdout:6/164: stat da/d10/d1e/d17/d2f/d12/d19/c2a 0 2023-12-05T09:26:15.763 INFO:tasks.workunit.client.1.smithi134.stdout:9/287: dwrite d7/f1a [0,4194304] 0 2023-12-05T09:26:15.763 INFO:tasks.workunit.client.1.smithi134.stdout:9/288: fdatasync d7/d8/d2e/f31 0 2023-12-05T09:26:15.763 INFO:tasks.workunit.client.1.smithi134.stdout:6/315: mkdir d4/d39/d5c 0 2023-12-05T09:26:15.766 INFO:tasks.workunit.client.1.smithi134.stdout:1/377: mknod d2/d9/d10/d30/c8f 0 2023-12-05T09:26:15.768 INFO:tasks.workunit.client.0.smithi067.stdout:9/371: symlink d1b/d25/d35/l7e 0 2023-12-05T09:26:15.768 INFO:tasks.workunit.client.0.smithi067.stdout:7/266: dwrite d0/d9/d10/f44 [0,4194304] 0 2023-12-05T09:26:15.769 INFO:tasks.workunit.client.1.smithi134.stdout:0/313: creat d13/d14/d15/d2a/f64 x:0 0 0 2023-12-05T09:26:15.772 INFO:tasks.workunit.client.0.smithi067.stdout:1/234: rename d2/d5/d7/de/d10 to d2/d4f 0 2023-12-05T09:26:15.785 INFO:tasks.workunit.client.1.smithi134.stdout:2/358: creat d19/d28/d63/d70/f74 x:0 0 0 2023-12-05T09:26:15.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/342: mknod d16/d18/d1b/d24/c76 0 2023-12-05T09:26:15.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/343: truncate d16/d18/d1a/f20 4278084 0 2023-12-05T09:26:15.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/344: chown d16/d18/d1a/l1d 3135518 1 2023-12-05T09:26:15.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/345: creat d16/d21/d47/d4b/f77 x:0 0 0 2023-12-05T09:26:15.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/346: truncate d16/d18/d5b/d65/f72 279354 0 2023-12-05T09:26:15.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/347: chown d16/d18/d1c/d63 225912960 1 2023-12-05T09:26:15.787 INFO:tasks.workunit.client.0.smithi067.stdout:4/174: mkdir d0/d1d/d3c 0 2023-12-05T09:26:15.788 INFO:tasks.workunit.client.0.smithi067.stdout:4/175: readlink d0/d9/d12/l1c 0 2023-12-05T09:26:15.788 INFO:tasks.workunit.client.0.smithi067.stdout:4/176: getdents d0/d1d/d2a 0 2023-12-05T09:26:15.794 INFO:tasks.workunit.client.0.smithi067.stdout:8/222: dwrite d5/d3b/f3d [0,4194304] 0 2023-12-05T09:26:15.795 INFO:tasks.workunit.client.0.smithi067.stdout:8/223: creat d5/f40 x:0 0 0 2023-12-05T09:26:15.800 INFO:tasks.workunit.client.0.smithi067.stdout:3/138: symlink d9/da/d15/d17/d1a/l2a 0 2023-12-05T09:26:15.802 INFO:tasks.workunit.client.1.smithi134.stdout:8/374: symlink da/l7f 0 2023-12-05T09:26:15.802 INFO:tasks.workunit.client.1.smithi134.stdout:8/375: write da/de/f48 [4905400,51618] 0 2023-12-05T09:26:15.802 INFO:tasks.workunit.client.1.smithi134.stdout:8/376: readlink da/de/d16/l28 0 2023-12-05T09:26:15.802 INFO:tasks.workunit.client.1.smithi134.stdout:8/377: fdatasync da/de/d16/d33/f56 0 2023-12-05T09:26:15.803 INFO:tasks.workunit.client.0.smithi067.stdout:4/177: write d0/f7 [2073419,3158] 0 2023-12-05T09:26:15.806 INFO:tasks.workunit.client.1.smithi134.stdout:5/285: rename d0/d1a/f27 to d0/d45/f64 0 2023-12-05T09:26:15.806 INFO:tasks.workunit.client.1.smithi134.stdout:5/286: fdatasync d0/d1a/d3a/f47 0 2023-12-05T09:26:15.808 INFO:tasks.workunit.client.1.smithi134.stdout:7/329: mkdir d2/d7/d6f 0 2023-12-05T09:26:15.810 INFO:tasks.workunit.client.1.smithi134.stdout:6/316: dwrite d4/f46 [4194304,4194304] 0 2023-12-05T09:26:15.811 INFO:tasks.workunit.client.1.smithi134.stdout:9/289: creat d7/d10/d4b/d53/f63 x:0 0 0 2023-12-05T09:26:15.813 INFO:tasks.workunit.client.0.smithi067.stdout:9/372: mkdir d1b/d3e/d7f 0 2023-12-05T09:26:15.816 INFO:tasks.workunit.client.1.smithi134.stdout:3/327: sync 2023-12-05T09:26:15.818 INFO:tasks.workunit.client.0.smithi067.stdout:3/139: dread d9/f14 [4194304,4194304] 0 2023-12-05T09:26:15.820 INFO:tasks.workunit.client.1.smithi134.stdout:1/378: link d2/d56/d74/l88 d2/d9/d10/d5b/l90 0 2023-12-05T09:26:15.820 INFO:tasks.workunit.client.1.smithi134.stdout:1/379: chown d2/d9/c1c 669847338 1 2023-12-05T09:26:15.820 INFO:tasks.workunit.client.1.smithi134.stdout:1/380: fdatasync d2/d9/f86 0 2023-12-05T09:26:15.820 INFO:tasks.workunit.client.1.smithi134.stdout:1/381: write d2/d27/d40/f51 [3453485,99893] 0 2023-12-05T09:26:15.821 INFO:tasks.workunit.client.1.smithi134.stdout:1/382: write d2/d9/d10/f5a [3856257,40001] 0 2023-12-05T09:26:15.823 INFO:tasks.workunit.client.0.smithi067.stdout:7/267: link d0/d9/d10/f2f d0/d9/d1b/f55 0 2023-12-05T09:26:15.823 INFO:tasks.workunit.client.0.smithi067.stdout:7/268: write d0/d9/d10/f2f [655889,23986] 0 2023-12-05T09:26:15.823 INFO:tasks.workunit.client.0.smithi067.stdout:7/269: chown d0/l3d 9208 1 2023-12-05T09:26:15.824 INFO:tasks.workunit.client.1.smithi134.stdout:2/359: mknod d19/d28/c75 0 2023-12-05T09:26:15.824 INFO:tasks.workunit.client.1.smithi134.stdout:2/360: fsync d19/f2c 0 2023-12-05T09:26:15.826 INFO:tasks.workunit.client.0.smithi067.stdout:0/299: rename d3/d7/d3c/d49/d59/f53 to d3/d7/d3c/d49/d59/d5c/f65 0 2023-12-05T09:26:15.827 INFO:tasks.workunit.client.1.smithi134.stdout:5/287: dread d0/f33 [0,4194304] 0 2023-12-05T09:26:15.828 INFO:tasks.workunit.client.0.smithi067.stdout:1/235: mkdir d2/d5/d50 0 2023-12-05T09:26:15.828 INFO:tasks.workunit.client.0.smithi067.stdout:1/236: write d2/d5/d7/de/d19/f38 [3638426,50957] 0 2023-12-05T09:26:15.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/348: dwrite d16/d18/d5b/f5e [0,4194304] 0 2023-12-05T09:26:15.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/349: fdatasync d16/d18/d1a/d3b/f5a 0 2023-12-05T09:26:15.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/350: getdents d16/d21/d50/d6f 0 2023-12-05T09:26:15.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/351: write d16/d21/d47/f4a [565090,41781] 0 2023-12-05T09:26:15.832 INFO:tasks.workunit.client.1.smithi134.stdout:0/314: rename d13/d14/f3d to d13/d14/d30/d4b/d23/f65 0 2023-12-05T09:26:15.835 INFO:tasks.workunit.client.0.smithi067.stdout:5/227: mkdir db/df/d52 0 2023-12-05T09:26:15.837 INFO:tasks.workunit.client.1.smithi134.stdout:7/330: mkdir d2/d70 0 2023-12-05T09:26:15.837 INFO:tasks.workunit.client.1.smithi134.stdout:7/331: stat d2/d7/dc/d2e/d3a/l42 0 2023-12-05T09:26:15.839 INFO:tasks.workunit.client.1.smithi134.stdout:6/317: creat d4/d32/d57/f5d x:0 0 0 2023-12-05T09:26:15.842 INFO:tasks.workunit.client.1.smithi134.stdout:1/383: mknod d2/d27/d71/c91 0 2023-12-05T09:26:15.851 INFO:tasks.workunit.client.1.smithi134.stdout:2/361: mkdir d19/d76 0 2023-12-05T09:26:15.851 INFO:tasks.workunit.client.1.smithi134.stdout:5/288: link d0/d1a/d3a/f58 d0/d1a/d1c/f65 0 2023-12-05T09:26:15.851 INFO:tasks.workunit.client.1.smithi134.stdout:2/362: write d19/d28/f2a [1450641,114657] 0 2023-12-05T09:26:15.851 INFO:tasks.workunit.client.1.smithi134.stdout:2/363: readlink d19/d28/d2b/l72 0 2023-12-05T09:26:15.851 INFO:tasks.workunit.client.1.smithi134.stdout:9/290: dwrite d7/d8/d14/f59 [0,4194304] 0 2023-12-05T09:26:15.851 INFO:tasks.workunit.client.1.smithi134.stdout:9/291: fsync d7/d8/d14/d26/f4a 0 2023-12-05T09:26:15.852 INFO:tasks.workunit.client.1.smithi134.stdout:3/328: dread d4/f1b [0,4194304] 0 2023-12-05T09:26:15.853 INFO:tasks.workunit.client.1.smithi134.stdout:5/289: write d0/dd/f17 [4736100,98995] 0 2023-12-05T09:26:15.864 INFO:tasks.workunit.client.1.smithi134.stdout:2/364: dread d19/d28/f2a [0,4194304] 0 2023-12-05T09:26:15.866 INFO:tasks.workunit.client.1.smithi134.stdout:0/315: mkdir d13/d14/d30/d4b/d66 0 2023-12-05T09:26:15.870 INFO:tasks.workunit.client.1.smithi134.stdout:7/332: mkdir d2/dd/d71 0 2023-12-05T09:26:15.873 INFO:tasks.workunit.client.1.smithi134.stdout:6/318: mknod d4/d2a/d3a/c5e 0 2023-12-05T09:26:15.874 INFO:tasks.workunit.client.0.smithi067.stdout:4/178: symlink d0/d9/d12/d15/l3d 0 2023-12-05T09:26:15.876 INFO:tasks.workunit.client.0.smithi067.stdout:4/179: getdents d0/d1d/d25/d2c/d34 0 2023-12-05T09:26:15.879 INFO:tasks.workunit.client.0.smithi067.stdout:4/180: write d0/d9/d12/d15/f33 [617009,59779] 0 2023-12-05T09:26:15.879 INFO:tasks.workunit.client.0.smithi067.stdout:4/181: chown d0/d1d/d25/d32 125746 1 2023-12-05T09:26:15.879 INFO:tasks.workunit.client.0.smithi067.stdout:9/373: creat d1b/d25/d54/d5c/d6a/f80 x:0 0 0 2023-12-05T09:26:15.880 INFO:tasks.workunit.client.1.smithi134.stdout:1/384: creat d2/d9/d10/f92 x:0 0 0 2023-12-05T09:26:15.882 INFO:tasks.workunit.client.0.smithi067.stdout:8/224: dwrite d5/dc/d1a/d20/f22 [4194304,4194304] 0 2023-12-05T09:26:15.883 INFO:tasks.workunit.client.1.smithi134.stdout:2/365: dread d19/d28/d2b/f5b [0,4194304] 0 2023-12-05T09:26:15.884 INFO:tasks.workunit.client.1.smithi134.stdout:4/352: dwrite d16/d21/d48/f34 [0,4194304] 0 2023-12-05T09:26:15.884 INFO:tasks.workunit.client.1.smithi134.stdout:4/353: fsync d16/d21/f3f 0 2023-12-05T09:26:15.884 INFO:tasks.workunit.client.1.smithi134.stdout:4/354: fdatasync d16/d21/d47/d4b/f77 0 2023-12-05T09:26:15.884 INFO:tasks.workunit.client.0.smithi067.stdout:3/140: mkdir d9/da/d15/d17/d2b 0 2023-12-05T09:26:15.884 INFO:tasks.workunit.client.0.smithi067.stdout:3/141: chown d9/da/c13 15547 1 2023-12-05T09:26:15.885 INFO:tasks.workunit.client.1.smithi134.stdout:8/378: dwrite da/de/d16/d2d/f5e [0,4194304] 0 2023-12-05T09:26:15.888 INFO:tasks.workunit.client.1.smithi134.stdout:2/366: dread d19/d28/d2b/f2f [0,4194304] 0 2023-12-05T09:26:15.888 INFO:tasks.workunit.client.1.smithi134.stdout:2/367: chown d19/d28/d2b/c6b 20692 1 2023-12-05T09:26:15.888 INFO:tasks.workunit.client.1.smithi134.stdout:2/368: chown d19/d6d 0 1 2023-12-05T09:26:15.890 INFO:tasks.workunit.client.1.smithi134.stdout:7/333: dread d2/d7/dc/f31 [0,4194304] 0 2023-12-05T09:26:15.890 INFO:tasks.workunit.client.1.smithi134.stdout:7/334: chown d2/d7/dc/d2e/d3a/f5e 26827324 1 2023-12-05T09:26:15.891 INFO:tasks.workunit.client.1.smithi134.stdout:7/335: fsync d2/d7/f37 0 2023-12-05T09:26:15.891 INFO:tasks.workunit.client.1.smithi134.stdout:9/292: creat d7/d5b/d5e/f64 x:0 0 0 2023-12-05T09:26:15.891 INFO:tasks.workunit.client.1.smithi134.stdout:9/293: stat d7/d8/d14/d26/f48 0 2023-12-05T09:26:15.898 INFO:tasks.workunit.client.1.smithi134.stdout:3/329: mkdir d4/d1f/d4e/d6a 0 2023-12-05T09:26:15.899 INFO:tasks.workunit.client.1.smithi134.stdout:4/355: dread f15 [0,4194304] 0 2023-12-05T09:26:15.901 INFO:tasks.workunit.client.0.smithi067.stdout:7/270: mkdir d0/d9/d56 0 2023-12-05T09:26:15.905 INFO:tasks.workunit.client.1.smithi134.stdout:5/290: chown d0/c16 148 1 2023-12-05T09:26:15.908 INFO:tasks.workunit.client.0.smithi067.stdout:0/300: truncate d3/fa 355783 0 2023-12-05T09:26:15.909 INFO:tasks.workunit.client.1.smithi134.stdout:0/316: rename d13/d14/d15/d50 to d13/d14/d15/d67 0 2023-12-05T09:26:15.916 INFO:tasks.workunit.client.0.smithi067.stdout:6/165: rename da/d10/d1e/d17/d2f/d1f/c24 to da/d10/d1e/d17/d2f/d2c/c39 0 2023-12-05T09:26:15.919 INFO:tasks.workunit.client.1.smithi134.stdout:3/330: write d4/d1f/f26 [180628,9969] 0 2023-12-05T09:26:15.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/385: creat d2/d9/d10/d5b/d5e/f93 x:0 0 0 2023-12-05T09:26:15.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/386: fsync d2/d9/f44 0 2023-12-05T09:26:15.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/387: write d2/d27/d40/f87 [411808,88390] 0 2023-12-05T09:26:15.921 INFO:tasks.workunit.client.0.smithi067.stdout:1/237: mknod d2/d5/c51 0 2023-12-05T09:26:15.926 INFO:tasks.workunit.client.0.smithi067.stdout:9/374: write d1b/d3e/f66 [1432007,48145] 0 2023-12-05T09:26:15.927 INFO:tasks.workunit.client.0.smithi067.stdout:7/271: dread d0/d9/d10/f44 [0,4194304] 0 2023-12-05T09:26:15.928 INFO:tasks.workunit.client.0.smithi067.stdout:3/142: mknod d9/da/d15/c2c 0 2023-12-05T09:26:15.929 INFO:tasks.workunit.client.0.smithi067.stdout:8/225: dwrite d5/dc/d1a/d20/f25 [4194304,4194304] 0 2023-12-05T09:26:15.933 INFO:tasks.workunit.client.1.smithi134.stdout:2/369: mknod d19/d3a/d60/c77 0 2023-12-05T09:26:15.933 INFO:tasks.workunit.client.1.smithi134.stdout:2/370: write d19/d28/d31/d38/f59 [1695697,115117] 0 2023-12-05T09:26:15.933 INFO:tasks.workunit.client.1.smithi134.stdout:2/371: write d19/d28/d31/d38/f6a [738741,14688] 0 2023-12-05T09:26:15.935 INFO:tasks.workunit.client.0.smithi067.stdout:6/166: creat da/d10/d1e/d17/f3a x:0 0 0 2023-12-05T09:26:15.935 INFO:tasks.workunit.client.0.smithi067.stdout:6/167: chown da/d10/d1e/d17/d2f/d12/d19/c2a 122054 1 2023-12-05T09:26:15.936 INFO:tasks.workunit.client.0.smithi067.stdout:6/168: chown da/d10/d1e/d17/d2f/d1f/l31 22341 1 2023-12-05T09:26:15.936 INFO:tasks.workunit.client.1.smithi134.stdout:1/388: dread d2/f4d [0,4194304] 0 2023-12-05T09:26:15.937 INFO:tasks.workunit.client.0.smithi067.stdout:4/182: dwrite d0/d9/d12/f14 [0,4194304] 0 2023-12-05T09:26:15.938 INFO:tasks.workunit.client.0.smithi067.stdout:4/183: dread - d0/d1d/d25/f29 zero size 2023-12-05T09:26:15.938 INFO:tasks.workunit.client.0.smithi067.stdout:4/184: getdents d0/d1d/d2a 0 2023-12-05T09:26:15.938 INFO:tasks.workunit.client.0.smithi067.stdout:4/185: readlink d0/d1d/l37 0 2023-12-05T09:26:15.938 INFO:tasks.workunit.client.0.smithi067.stdout:4/186: fsync d0/d1d/d25/f29 0 2023-12-05T09:26:15.938 INFO:tasks.workunit.client.0.smithi067.stdout:4/187: fdatasync d0/d1d/d2b/f2e 0 2023-12-05T09:26:15.938 INFO:tasks.workunit.client.0.smithi067.stdout:1/238: symlink d2/d4f/d15/l52 0 2023-12-05T09:26:15.944 INFO:tasks.workunit.client.0.smithi067.stdout:9/375: mkdir d1b/d25/d54/d5c/d81 0 2023-12-05T09:26:15.944 INFO:tasks.workunit.client.0.smithi067.stdout:9/376: write d1b/d25/d35/f43 [251942,13126] 0 2023-12-05T09:26:15.947 INFO:tasks.workunit.client.0.smithi067.stdout:7/272: dread d0/d9/d1b/d34/f36 [0,4194304] 0 2023-12-05T09:26:15.949 INFO:tasks.workunit.client.0.smithi067.stdout:0/301: mkdir d3/d7/d3c/d66 0 2023-12-05T09:26:15.951 INFO:tasks.workunit.client.0.smithi067.stdout:8/226: mkdir d5/dc/d1a/d20/d2d/d41 0 2023-12-05T09:26:15.952 INFO:tasks.workunit.client.1.smithi134.stdout:2/372: write d19/f24 [4192988,68401] 0 2023-12-05T09:26:15.954 INFO:tasks.workunit.client.1.smithi134.stdout:7/336: rename d2/l6 to d2/d7/dc/d2e/l72 0 2023-12-05T09:26:15.956 INFO:tasks.workunit.client.0.smithi067.stdout:1/239: write d2/d3/f21 [873023,105251] 0 2023-12-05T09:26:15.956 INFO:tasks.workunit.client.0.smithi067.stdout:1/240: write d2/d4f/d14/d48/f4d [350180,121661] 0 2023-12-05T09:26:15.956 INFO:tasks.workunit.client.0.smithi067.stdout:1/241: truncate d2/d4f/d14/d48/f4d 1311088 0 2023-12-05T09:26:15.957 INFO:tasks.workunit.client.0.smithi067.stdout:5/228: rename f1 to db/df/f53 0 2023-12-05T09:26:15.958 INFO:tasks.workunit.client.1.smithi134.stdout:9/294: mkdir d7/d8/d16/d52/d65 0 2023-12-05T09:26:15.960 INFO:tasks.workunit.client.1.smithi134.stdout:7/337: dread d2/d7/d2b/f55 [0,4194304] 0 2023-12-05T09:26:15.963 INFO:tasks.workunit.client.1.smithi134.stdout:4/356: symlink d16/d18/d1b/l78 0 2023-12-05T09:26:15.964 INFO:tasks.workunit.client.1.smithi134.stdout:0/317: creat d13/d14/d30/d2c/f68 x:0 0 0 2023-12-05T09:26:15.964 INFO:tasks.workunit.client.1.smithi134.stdout:0/318: creat d13/d14/d15/f69 x:0 0 0 2023-12-05T09:26:15.967 INFO:tasks.workunit.client.0.smithi067.stdout:6/169: rmdir da/d10 39 2023-12-05T09:26:15.967 INFO:tasks.workunit.client.0.smithi067.stdout:6/170: chown da/d10/d1e/c32 0 1 2023-12-05T09:26:15.967 INFO:tasks.workunit.client.0.smithi067.stdout:6/171: chown da/d10/d1e/d17/d2f/d12/d19/c2a 9204365 1 2023-12-05T09:26:15.967 INFO:tasks.workunit.client.0.smithi067.stdout:6/172: write da/d10/d1e/f36 [3878176,804] 0 2023-12-05T09:26:15.969 INFO:tasks.workunit.client.1.smithi134.stdout:3/331: unlink d4/d1f/d50/d5a/l62 0 2023-12-05T09:26:15.974 INFO:tasks.workunit.client.1.smithi134.stdout:8/379: rmdir da/de/d43 39 2023-12-05T09:26:15.974 INFO:tasks.workunit.client.1.smithi134.stdout:8/380: creat da/de/d16/d2d/f80 x:0 0 0 2023-12-05T09:26:15.975 INFO:tasks.workunit.client.0.smithi067.stdout:4/188: symlink d0/d9/d12/d15/l3e 0 2023-12-05T09:26:15.976 INFO:tasks.workunit.client.0.smithi067.stdout:4/189: write d0/d1d/f21 [1391692,91090] 0 2023-12-05T09:26:15.982 INFO:tasks.workunit.client.1.smithi134.stdout:1/389: mkdir d2/d9/d10/d94 0 2023-12-05T09:26:15.986 INFO:tasks.workunit.client.0.smithi067.stdout:9/377: mkdir d1b/d25/d54/d5c/d6a/d82 0 2023-12-05T09:26:15.986 INFO:tasks.workunit.client.0.smithi067.stdout:9/378: creat d1b/d25/d35/f83 x:0 0 0 2023-12-05T09:26:15.996 INFO:tasks.workunit.client.1.smithi134.stdout:2/373: rmdir d19/d28/d31/d38 39 2023-12-05T09:26:16.000 INFO:tasks.workunit.client.1.smithi134.stdout:7/338: dwrite d2/d7/f13 [0,4194304] 0 2023-12-05T09:26:16.015 INFO:tasks.workunit.client.1.smithi134.stdout:8/381: dwrite da/de/d16/d2d/f36 [0,4194304] 0 2023-12-05T09:26:16.015 INFO:tasks.workunit.client.1.smithi134.stdout:8/382: chown da/de/f54 41 1 2023-12-05T09:26:16.027 INFO:tasks.workunit.client.0.smithi067.stdout:1/242: dwrite d2/d4f/d14/d48/f4d [0,4194304] 0 2023-12-05T09:26:16.051 INFO:tasks.workunit.client.0.smithi067.stdout:8/227: dwrite d5/dc/d1a/f2e [0,4194304] 0 2023-12-05T09:26:16.064 INFO:tasks.workunit.client.0.smithi067.stdout:4/190: dwrite d0/d1d/d25/d38/f39 [0,4194304] 0 2023-12-05T09:26:16.088 INFO:tasks.workunit.client.1.smithi134.stdout:9/295: creat d7/d8/d16/d52/d65/f66 x:0 0 0 2023-12-05T09:26:16.089 INFO:tasks.workunit.client.1.smithi134.stdout:4/357: creat d16/d18/d1a/f79 x:0 0 0 2023-12-05T09:26:16.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/319: rename d13/d14/d15/l52 to d13/d14/d15/l6a 0 2023-12-05T09:26:16.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/320: read - d13/d14/d15/d2a/f64 zero size 2023-12-05T09:26:16.104 INFO:tasks.workunit.client.1.smithi134.stdout:3/332: truncate d4/d1f/f2b 3687839 0 2023-12-05T09:26:16.104 INFO:tasks.workunit.client.1.smithi134.stdout:3/333: truncate d4/d1f/d50/d5a/f68 635055 0 2023-12-05T09:26:16.104 INFO:tasks.workunit.client.1.smithi134.stdout:6/319: sync 2023-12-05T09:26:16.104 INFO:tasks.workunit.client.1.smithi134.stdout:1/390: symlink d2/d9/d10/d30/l95 0 2023-12-05T09:26:16.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/391: dread - d2/d9/d10/d5b/d5e/f6d zero size 2023-12-05T09:26:16.105 INFO:tasks.workunit.client.1.smithi134.stdout:2/374: creat d19/d3f/f78 x:0 0 0 2023-12-05T09:26:16.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/392: fsync d2/d27/d40/f89 0 2023-12-05T09:26:16.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/393: write d2/d9/d10/f1d [3018075,112990] 0 2023-12-05T09:26:16.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/394: write d2/d27/d40/f84 [451689,99253] 0 2023-12-05T09:26:16.105 INFO:tasks.workunit.client.0.smithi067.stdout:7/273: symlink d0/d9/d40/d48/l57 0 2023-12-05T09:26:16.111 INFO:tasks.workunit.client.1.smithi134.stdout:8/383: creat da/de/d16/d33/f81 x:0 0 0 2023-12-05T09:26:16.114 INFO:tasks.workunit.client.0.smithi067.stdout:3/143: rmdir d9 39 2023-12-05T09:26:16.117 INFO:tasks.workunit.client.0.smithi067.stdout:0/302: rename d3/d7/d3c/d49 to d3/d7/d3c/d67 0 2023-12-05T09:26:16.117 INFO:tasks.workunit.client.0.smithi067.stdout:0/303: write d3/d7/d3c/f47 [702410,1494] 0 2023-12-05T09:26:16.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/375: dread f12 [0,4194304] 0 2023-12-05T09:26:16.119 INFO:tasks.workunit.client.1.smithi134.stdout:6/320: link d4/d39/f37 d4/d2a/d45/f5f 0 2023-12-05T09:26:16.119 INFO:tasks.workunit.client.1.smithi134.stdout:6/321: read - d4/d2a/d3a/f54 zero size 2023-12-05T09:26:16.120 INFO:tasks.workunit.client.0.smithi067.stdout:7/274: write d0/d9/d10/f1a [9039,58469] 0 2023-12-05T09:26:16.122 INFO:tasks.workunit.client.0.smithi067.stdout:6/173: mkdir da/d10/d1e/d17/d2f/d2c/d34/d3b 0 2023-12-05T09:26:16.122 INFO:tasks.workunit.client.0.smithi067.stdout:6/174: chown da/d10/d1e 0 1 2023-12-05T09:26:16.126 INFO:tasks.workunit.client.1.smithi134.stdout:3/334: dread d4/d1f/d50/d5a/f68 [0,4194304] 0 2023-12-05T09:26:16.126 INFO:tasks.workunit.client.1.smithi134.stdout:3/335: chown d4/d1f/l51 40278822 1 2023-12-05T09:26:16.127 INFO:tasks.workunit.client.1.smithi134.stdout:6/322: truncate d4/d39/f31 631551 0 2023-12-05T09:26:16.127 INFO:tasks.workunit.client.1.smithi134.stdout:6/323: write d4/d2a/d3a/f36 [3348944,88987] 0 2023-12-05T09:26:16.137 INFO:tasks.workunit.client.0.smithi067.stdout:9/379: mknod d1b/d25/d5b/c84 0 2023-12-05T09:26:16.139 INFO:tasks.workunit.client.1.smithi134.stdout:3/336: dread d4/d1f/d50/d5a/f68 [0,4194304] 0 2023-12-05T09:26:16.141 INFO:tasks.workunit.client.0.smithi067.stdout:1/243: mkdir d2/d5/d7/de/d19/d53 0 2023-12-05T09:26:16.141 INFO:tasks.workunit.client.1.smithi134.stdout:1/395: dread d2/d56/d74/f7b [0,4194304] 0 2023-12-05T09:26:16.145 INFO:tasks.workunit.client.1.smithi134.stdout:3/337: creat d4/f6b x:0 0 0 2023-12-05T09:26:16.150 INFO:tasks.workunit.client.0.smithi067.stdout:8/228: creat d5/dc/d1a/d20/d3e/f42 x:0 0 0 2023-12-05T09:26:16.150 INFO:tasks.workunit.client.1.smithi134.stdout:1/396: mknod d2/d56/c96 0 2023-12-05T09:26:16.150 INFO:tasks.workunit.client.1.smithi134.stdout:1/397: creat d2/d9/d10/d30/d4a/d81/f97 x:0 0 0 2023-12-05T09:26:16.162 INFO:tasks.workunit.client.1.smithi134.stdout:3/338: symlink d4/d5/l6c 0 2023-12-05T09:26:16.162 INFO:tasks.workunit.client.1.smithi134.stdout:3/339: dread - d4/d1f/d50/f64 zero size 2023-12-05T09:26:16.165 INFO:tasks.workunit.client.0.smithi067.stdout:4/191: creat d0/d1d/d25/d32/f3f x:0 0 0 2023-12-05T09:26:16.179 INFO:tasks.workunit.client.1.smithi134.stdout:9/296: dwrite d7/d8/d14/f25 [0,4194304] 0 2023-12-05T09:26:16.191 INFO:tasks.workunit.client.1.smithi134.stdout:5/291: sync 2023-12-05T09:26:16.195 INFO:tasks.workunit.client.1.smithi134.stdout:1/398: symlink d2/d56/d74/l98 0 2023-12-05T09:26:16.203 INFO:tasks.workunit.client.1.smithi134.stdout:7/339: sync 2023-12-05T09:26:16.209 INFO:tasks.workunit.client.1.smithi134.stdout:0/321: dwrite d13/d14/d30/d4b/d23/f60 [0,4194304] 0 2023-12-05T09:26:16.210 INFO:tasks.workunit.client.1.smithi134.stdout:0/322: fdatasync d13/f53 0 2023-12-05T09:26:16.210 INFO:tasks.workunit.client.1.smithi134.stdout:0/323: readlink d13/l45 0 2023-12-05T09:26:16.212 INFO:tasks.workunit.client.1.smithi134.stdout:1/399: dread d2/d9/f57 [0,4194304] 0 2023-12-05T09:26:16.213 INFO:tasks.workunit.client.0.smithi067.stdout:6/175: dwrite da/d10/d1e/d17/d2f/d12/d19/f21 [0,4194304] 0 2023-12-05T09:26:16.214 INFO:tasks.workunit.client.1.smithi134.stdout:1/400: fsync d2/d9/d10/d5b/f5c 0 2023-12-05T09:26:16.215 INFO:tasks.workunit.client.1.smithi134.stdout:6/324: rmdir d4 39 2023-12-05T09:26:16.217 INFO:tasks.workunit.client.1.smithi134.stdout:0/324: symlink d13/d14/d30/d4b/l6b 0 2023-12-05T09:26:16.218 INFO:tasks.workunit.client.1.smithi134.stdout:5/292: dread d0/d11/f15 [0,4194304] 0 2023-12-05T09:26:16.218 INFO:tasks.workunit.client.0.smithi067.stdout:3/144: dwrite d9/f27 [0,4194304] 0 2023-12-05T09:26:16.219 INFO:tasks.workunit.client.1.smithi134.stdout:3/340: dwrite d4/f3b [0,4194304] 0 2023-12-05T09:26:16.219 INFO:tasks.workunit.client.1.smithi134.stdout:3/341: write d4/d1f/d50/f64 [412481,78577] 0 2023-12-05T09:26:16.219 INFO:tasks.workunit.client.1.smithi134.stdout:3/342: fdatasync d4/d1f/d50/d5a/f5e 0 2023-12-05T09:26:16.219 INFO:tasks.workunit.client.1.smithi134.stdout:6/325: dread - d4/d39/f34 zero size 2023-12-05T09:26:16.222 INFO:tasks.workunit.client.0.smithi067.stdout:8/229: dwrite d5/d3b/f3d [0,4194304] 0 2023-12-05T09:26:16.222 INFO:tasks.workunit.client.0.smithi067.stdout:8/230: stat d5/dc/f19 0 2023-12-05T09:26:16.223 INFO:tasks.workunit.client.1.smithi134.stdout:4/358: dwrite d16/d18/d1a/f79 [0,4194304] 0 2023-12-05T09:26:16.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/343: symlink d4/d5/d45/d60/l6d 0 2023-12-05T09:26:16.231 INFO:tasks.workunit.client.1.smithi134.stdout:6/326: creat d4/d2a/f60 x:0 0 0 2023-12-05T09:26:16.231 INFO:tasks.workunit.client.1.smithi134.stdout:6/327: readlink d4/d32/l4c 0 2023-12-05T09:26:16.234 INFO:tasks.workunit.client.1.smithi134.stdout:9/297: dwrite d7/d8/d16/f33 [0,4194304] 0 2023-12-05T09:26:16.234 INFO:tasks.workunit.client.1.smithi134.stdout:9/298: truncate d7/d8/f4c 1840 0 2023-12-05T09:26:16.243 INFO:tasks.workunit.client.0.smithi067.stdout:3/145: dread d9/fb [0,4194304] 0 2023-12-05T09:26:16.243 INFO:tasks.workunit.client.0.smithi067.stdout:3/146: stat d9/da/f22 0 2023-12-05T09:26:16.244 INFO:tasks.workunit.client.0.smithi067.stdout:6/176: read da/d10/d1e/d17/d2f/f2b [2606109,45820] 0 2023-12-05T09:26:16.245 INFO:tasks.workunit.client.1.smithi134.stdout:4/359: creat d16/f7a x:0 0 0 2023-12-05T09:26:16.249 INFO:tasks.workunit.client.1.smithi134.stdout:3/344: symlink d4/d1f/d50/d52/d42/l6e 0 2023-12-05T09:26:16.251 INFO:tasks.workunit.client.1.smithi134.stdout:8/384: dwrite da/de/f27 [0,4194304] 0 2023-12-05T09:26:16.251 INFO:tasks.workunit.client.1.smithi134.stdout:8/385: write da/de/d16/f24 [4292321,63640] 0 2023-12-05T09:26:16.251 INFO:tasks.workunit.client.1.smithi134.stdout:8/386: truncate da/de/d4d/f79 298516 0 2023-12-05T09:26:16.254 INFO:tasks.workunit.client.1.smithi134.stdout:6/328: creat d4/d32/d57/f61 x:0 0 0 2023-12-05T09:26:16.262 INFO:tasks.workunit.client.0.smithi067.stdout:3/147: dread d9/f14 [4194304,4194304] 0 2023-12-05T09:26:16.262 INFO:tasks.workunit.client.1.smithi134.stdout:9/299: symlink d7/d8/l67 0 2023-12-05T09:26:16.262 INFO:tasks.workunit.client.1.smithi134.stdout:9/300: chown d7/d10 13 1 2023-12-05T09:26:16.264 INFO:tasks.workunit.client.1.smithi134.stdout:4/360: rename d16/d21/d50 to d16/d7b 0 2023-12-05T09:26:16.264 INFO:tasks.workunit.client.1.smithi134.stdout:4/361: write f13 [2952229,113307] 0 2023-12-05T09:26:16.264 INFO:tasks.workunit.client.0.smithi067.stdout:6/177: dread da/fe [0,4194304] 0 2023-12-05T09:26:16.266 INFO:tasks.workunit.client.1.smithi134.stdout:1/401: dwrite d2/d9/f1b [8388608,4194304] 0 2023-12-05T09:26:16.267 INFO:tasks.workunit.client.0.smithi067.stdout:1/244: mkdir d2/d4f/d54 0 2023-12-05T09:26:16.273 INFO:tasks.workunit.client.1.smithi134.stdout:7/340: dwrite d2/f41 [4194304,4194304] 0 2023-12-05T09:26:16.279 INFO:tasks.workunit.client.1.smithi134.stdout:9/301: read d7/f40 [7524336,83252] 0 2023-12-05T09:26:16.279 INFO:tasks.workunit.client.1.smithi134.stdout:8/387: creat da/de/d11/d1d/d70/f82 x:0 0 0 2023-12-05T09:26:16.289 INFO:tasks.workunit.client.0.smithi067.stdout:8/231: mknod d5/da/c43 0 2023-12-05T09:26:16.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/402: write d2/d9/f24 [4154927,23631] 0 2023-12-05T09:26:16.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/403: dread - d2/d9/d10/d30/d4a/f70 zero size 2023-12-05T09:26:16.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/404: fsync d2/d9/f48 0 2023-12-05T09:26:16.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/405: chown d2/d27/f8a 4 1 2023-12-05T09:26:16.292 INFO:tasks.workunit.client.0.smithi067.stdout:6/178: rmdir da/d10/d1e/d17/d2f/d1f 39 2023-12-05T09:26:16.292 INFO:tasks.workunit.client.0.smithi067.stdout:6/179: fsync da/d10/d1e/d17/f3a 0 2023-12-05T09:26:16.295 INFO:tasks.workunit.client.0.smithi067.stdout:9/380: getdents d1b/d25/d54/d5c 0 2023-12-05T09:26:16.295 INFO:tasks.workunit.client.0.smithi067.stdout:9/381: dread - d1b/d25/d35/f83 zero size 2023-12-05T09:26:16.295 INFO:tasks.workunit.client.0.smithi067.stdout:9/382: fsync d1b/f75 0 2023-12-05T09:26:16.295 INFO:tasks.workunit.client.1.smithi134.stdout:7/341: dread d2/d7/f37 [0,4194304] 0 2023-12-05T09:26:16.295 INFO:tasks.workunit.client.1.smithi134.stdout:7/342: write d2/d7/d2b/d2d/f66 [665928,41467] 0 2023-12-05T09:26:16.295 INFO:tasks.workunit.client.1.smithi134.stdout:7/343: readlink d2/df/l1e 0 2023-12-05T09:26:16.296 INFO:tasks.workunit.client.1.smithi134.stdout:7/344: chown d2/d7/dc/f6a 295033 1 2023-12-05T09:26:16.299 INFO:tasks.workunit.client.0.smithi067.stdout:6/180: mknod da/d10/d1e/d17/d2f/d12/c3c 0 2023-12-05T09:26:16.300 INFO:tasks.workunit.client.0.smithi067.stdout:6/181: write da/d10/d1e/d17/f3a [298921,71653] 0 2023-12-05T09:26:16.303 INFO:tasks.workunit.client.1.smithi134.stdout:1/406: dread d2/f4d [0,4194304] 0 2023-12-05T09:26:16.304 INFO:tasks.workunit.client.0.smithi067.stdout:9/383: link d1b/d25/d35/d56/f7d d1b/d25/d35/f85 0 2023-12-05T09:26:16.304 INFO:tasks.workunit.client.0.smithi067.stdout:9/384: write d1b/d25/d35/f83 [879403,88900] 0 2023-12-05T09:26:16.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/325: truncate d13/d14/d30/d4b/d23/f60 517398 0 2023-12-05T09:26:16.306 INFO:tasks.workunit.client.1.smithi134.stdout:9/302: dread d7/f40 [0,4194304] 0 2023-12-05T09:26:16.307 INFO:tasks.workunit.client.0.smithi067.stdout:8/232: mknod d5/dc/d1a/c44 0 2023-12-05T09:26:16.309 INFO:tasks.workunit.client.1.smithi134.stdout:8/388: unlink da/de/d11/d1d/d70/c7e 0 2023-12-05T09:26:16.309 INFO:tasks.workunit.client.1.smithi134.stdout:4/362: getdents d16/d18/d5b/d65 0 2023-12-05T09:26:16.314 INFO:tasks.workunit.client.1.smithi134.stdout:7/345: getdents d2/d7/dc/d2e 0 2023-12-05T09:26:16.315 INFO:tasks.workunit.client.1.smithi134.stdout:1/407: mkdir d2/d56/d74/d99 0 2023-12-05T09:26:16.315 INFO:tasks.workunit.client.0.smithi067.stdout:0/304: dwrite d3/f1d [0,4194304] 0 2023-12-05T09:26:16.318 INFO:tasks.workunit.client.0.smithi067.stdout:6/182: dread da/d10/f11 [0,4194304] 0 2023-12-05T09:26:16.318 INFO:tasks.workunit.client.0.smithi067.stdout:3/148: dwrite d9/f14 [0,4194304] 0 2023-12-05T09:26:16.318 INFO:tasks.workunit.client.1.smithi134.stdout:0/326: creat d13/d14/f6c x:0 0 0 2023-12-05T09:26:16.319 INFO:tasks.workunit.client.1.smithi134.stdout:9/303: creat d7/d8/d2e/f68 x:0 0 0 2023-12-05T09:26:16.320 INFO:tasks.workunit.client.0.smithi067.stdout:0/305: mkdir d3/d7/d3c/d67/d59/d5c/d68 0 2023-12-05T09:26:16.320 INFO:tasks.workunit.client.0.smithi067.stdout:9/385: write d1b/f1c [1500646,2247] 0 2023-12-05T09:26:16.320 INFO:tasks.workunit.client.0.smithi067.stdout:9/386: truncate d1b/d25/f33 1726133 0 2023-12-05T09:26:16.321 INFO:tasks.workunit.client.1.smithi134.stdout:8/389: symlink da/de/d16/d45/d72/l83 0 2023-12-05T09:26:16.321 INFO:tasks.workunit.client.0.smithi067.stdout:6/183: mknod da/d10/d1e/d17/c3d 0 2023-12-05T09:26:16.321 INFO:tasks.workunit.client.0.smithi067.stdout:3/149: creat d9/f2d x:0 0 0 2023-12-05T09:26:16.322 INFO:tasks.workunit.client.1.smithi134.stdout:3/345: rename d4/d1f/d50/d5a to d4/d5/d6f 0 2023-12-05T09:26:16.323 INFO:tasks.workunit.client.1.smithi134.stdout:3/346: write d4/d1f/d4e/f61 [917606,107718] 0 2023-12-05T09:26:16.323 INFO:tasks.workunit.client.1.smithi134.stdout:3/347: chown d4/d5/l21 286813601 1 2023-12-05T09:26:16.323 INFO:tasks.workunit.client.1.smithi134.stdout:3/348: dread - d4/d1f/d50/f69 zero size 2023-12-05T09:26:16.325 INFO:tasks.workunit.client.1.smithi134.stdout:7/346: unlink d2/d7/dc/f6a 0 2023-12-05T09:26:16.325 INFO:tasks.workunit.client.1.smithi134.stdout:7/347: dread - d2/df/f68 zero size 2023-12-05T09:26:16.326 INFO:tasks.workunit.client.0.smithi067.stdout:9/387: link d1b/d25/d54/d5c/d6a/d6c/d78/c7c d1b/d3e/c86 0 2023-12-05T09:26:16.327 INFO:tasks.workunit.client.0.smithi067.stdout:8/233: creat d5/f45 x:0 0 0 2023-12-05T09:26:16.327 INFO:tasks.workunit.client.0.smithi067.stdout:8/234: fsync d5/f40 0 2023-12-05T09:26:16.328 INFO:tasks.workunit.client.1.smithi134.stdout:8/390: creat da/de/d4d/d68/f84 x:0 0 0 2023-12-05T09:26:16.328 INFO:tasks.workunit.client.1.smithi134.stdout:8/391: creat da/de/d16/d2d/f85 x:0 0 0 2023-12-05T09:26:16.328 INFO:tasks.workunit.client.0.smithi067.stdout:6/184: creat da/d10/d1e/d17/d2f/d2c/d34/f3e x:0 0 0 2023-12-05T09:26:16.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/363: truncate d16/d18/d1a/f79 3546969 0 2023-12-05T09:26:16.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/364: chown d16/d18/d1a/f79 43016093 1 2023-12-05T09:26:16.331 INFO:tasks.workunit.client.0.smithi067.stdout:0/306: symlink d3/df/d10/l69 0 2023-12-05T09:26:16.331 INFO:tasks.workunit.client.0.smithi067.stdout:0/307: creat d3/d7/d30/f6a x:0 0 0 2023-12-05T09:26:16.331 INFO:tasks.workunit.client.0.smithi067.stdout:0/308: truncate d3/df/f21 993735 0 2023-12-05T09:26:16.332 INFO:tasks.workunit.client.1.smithi134.stdout:6/329: rename d4/d2a/c2c to d4/d39/d42/d4f/c62 0 2023-12-05T09:26:16.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/330: write d4/d2a/d45/f5f [2249201,123450] 0 2023-12-05T09:26:16.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/331: chown d4/d2a/l49 27787 1 2023-12-05T09:26:16.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/332: write d4/d32/f35 [2233658,114930] 0 2023-12-05T09:26:16.333 INFO:tasks.workunit.client.1.smithi134.stdout:3/349: dread d4/f38 [0,4194304] 0 2023-12-05T09:26:16.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/388: symlink d1b/d25/d54/d5c/d81/l87 0 2023-12-05T09:26:16.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/389: chown l13 69690367 1 2023-12-05T09:26:16.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/390: fdatasync d1b/f5d 0 2023-12-05T09:26:16.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/391: stat d1b/d25/d35/d56 0 2023-12-05T09:26:16.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/392: readlink d1b/d25/d35/l4e 0 2023-12-05T09:26:16.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/393: fsync d1b/d25/d35/f79 0 2023-12-05T09:26:16.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/394: write d1b/d25/f50 [918846,109785] 0 2023-12-05T09:26:16.338 INFO:tasks.workunit.client.1.smithi134.stdout:8/392: mknod da/de/d16/d2d/c86 0 2023-12-05T09:26:16.342 INFO:tasks.workunit.client.0.smithi067.stdout:8/235: dread d5/f14 [0,4194304] 0 2023-12-05T09:26:16.342 INFO:tasks.workunit.client.0.smithi067.stdout:9/395: mknod d1b/d25/d54/d5c/d6a/c88 0 2023-12-05T09:26:16.343 INFO:tasks.workunit.client.0.smithi067.stdout:6/185: dread da/d10/d1e/d17/f29 [4194304,4194304] 0 2023-12-05T09:26:16.343 INFO:tasks.workunit.client.0.smithi067.stdout:6/186: chown c0 45480080 1 2023-12-05T09:26:16.347 INFO:tasks.workunit.client.1.smithi134.stdout:6/333: mknod d4/d39/d42/d4f/c63 0 2023-12-05T09:26:16.347 INFO:tasks.workunit.client.1.smithi134.stdout:6/334: chown d4/d2a/d3a/da/d1b/l44 5836 1 2023-12-05T09:26:16.348 INFO:tasks.workunit.client.0.smithi067.stdout:0/309: mkdir d3/d6b 0 2023-12-05T09:26:16.349 INFO:tasks.workunit.client.0.smithi067.stdout:0/310: stat d3/df/f16 0 2023-12-05T09:26:16.350 INFO:tasks.workunit.client.1.smithi134.stdout:3/350: creat d4/d1f/d50/d52/d42/f70 x:0 0 0 2023-12-05T09:26:16.353 INFO:tasks.workunit.client.0.smithi067.stdout:5/229: rename db/df/c4d to db/df/d52/c54 0 2023-12-05T09:26:16.356 INFO:tasks.workunit.client.0.smithi067.stdout:9/396: creat d1b/d25/d54/d5c/d6a/d6c/d76/f89 x:0 0 0 2023-12-05T09:26:16.356 INFO:tasks.workunit.client.0.smithi067.stdout:9/397: chown d1b/d25/d54/d5c/f72 350210 1 2023-12-05T09:26:16.357 INFO:tasks.workunit.client.1.smithi134.stdout:0/327: dread d13/d14/d30/f32 [0,4194304] 0 2023-12-05T09:26:16.366 INFO:tasks.workunit.client.1.smithi134.stdout:9/304: write d7/d8/d14/f25 [2897912,31031] 0 2023-12-05T09:26:16.366 INFO:tasks.workunit.client.1.smithi134.stdout:1/408: dwrite d2/d9/d10/f3f [0,4194304] 0 2023-12-05T09:26:16.366 INFO:tasks.workunit.client.1.smithi134.stdout:1/409: readlink d2/d9/d10/d30/l95 0 2023-12-05T09:26:16.367 INFO:tasks.workunit.client.1.smithi134.stdout:1/410: getdents d2/d56/d74/d99 0 2023-12-05T09:26:16.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:16 smithi067 ceph-mon[107174]: pgmap v23: 65 pgs: 65 active+clean; 1.0 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 108 MiB/s wr, 586 op/s 2023-12-05T09:26:16.372 INFO:tasks.workunit.client.1.smithi134.stdout:0/328: dread f7 [0,4194304] 0 2023-12-05T09:26:16.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:16 smithi134 ceph-mon[116304]: pgmap v23: 65 pgs: 65 active+clean; 1.0 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 108 MiB/s wr, 586 op/s 2023-12-05T09:26:16.388 INFO:tasks.workunit.client.1.smithi134.stdout:1/411: write d2/d9/f1b [3934212,108662] 0 2023-12-05T09:26:16.454 INFO:tasks.workunit.client.1.smithi134.stdout:3/351: creat d4/d5/d6f/f71 x:0 0 0 2023-12-05T09:26:16.461 INFO:tasks.workunit.client.1.smithi134.stdout:7/348: rename d2/d7/d25 to d2/d7/d2b/d2d/d67/d73 0 2023-12-05T09:26:16.463 INFO:tasks.workunit.client.0.smithi067.stdout:0/311: mkdir d3/d7/d3c/d6c 0 2023-12-05T09:26:16.467 INFO:tasks.workunit.client.0.smithi067.stdout:0/312: fsync d3/df/f2b 0 2023-12-05T09:26:16.471 INFO:tasks.workunit.client.0.smithi067.stdout:4/192: rename d0/d9/d12/l1c to d0/d1d/d2a/l40 0 2023-12-05T09:26:16.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/245: rename d2/d5 to d2/d5/d7/de/d19/d55 22 2023-12-05T09:26:16.472 INFO:tasks.workunit.client.0.smithi067.stdout:1/246: write d2/d5/d7/de/d1a/f4b [518143,113019] 0 2023-12-05T09:26:16.478 INFO:tasks.workunit.client.1.smithi134.stdout:9/305: mkdir d7/d8/d14/d26/d5a/d69 0 2023-12-05T09:26:16.478 INFO:tasks.workunit.client.1.smithi134.stdout:0/329: symlink d13/d14/d15/d2a/l6d 0 2023-12-05T09:26:16.478 INFO:tasks.workunit.client.1.smithi134.stdout:4/365: rename d16/d21/d47/d4b/f74 to d16/d21/f7c 0 2023-12-05T09:26:16.478 INFO:tasks.workunit.client.1.smithi134.stdout:9/306: creat d7/d8/f6a x:0 0 0 2023-12-05T09:26:16.478 INFO:tasks.workunit.client.1.smithi134.stdout:4/366: write d16/d21/f57 [1788464,62511] 0 2023-12-05T09:26:16.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/352: truncate d4/d1f/f26 2286373 0 2023-12-05T09:26:16.482 INFO:tasks.workunit.client.1.smithi134.stdout:8/393: dwrite da/de/d11/d1d/d70/f82 [0,4194304] 0 2023-12-05T09:26:16.484 INFO:tasks.workunit.client.1.smithi134.stdout:0/330: symlink d13/d14/d30/l6e 0 2023-12-05T09:26:16.484 INFO:tasks.workunit.client.1.smithi134.stdout:1/412: dwrite d2/d9/d10/f67 [0,4194304] 0 2023-12-05T09:26:16.486 INFO:tasks.workunit.client.0.smithi067.stdout:1/247: dread d2/f24 [0,4194304] 0 2023-12-05T09:26:16.486 INFO:tasks.workunit.client.0.smithi067.stdout:3/150: dwrite d9/fe [0,4194304] 0 2023-12-05T09:26:16.486 INFO:tasks.workunit.client.0.smithi067.stdout:6/187: dwrite da/d10/d1e/f36 [0,4194304] 0 2023-12-05T09:26:16.486 INFO:tasks.workunit.client.1.smithi134.stdout:6/335: dwrite d4/d32/f35 [4194304,4194304] 0 2023-12-05T09:26:16.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/398: truncate d1b/d25/d54/d5c/f61 3437585 0 2023-12-05T09:26:16.487 INFO:tasks.workunit.client.0.smithi067.stdout:9/399: creat d1b/d25/d54/d5c/d6a/d6c/d76/f8a x:0 0 0 2023-12-05T09:26:16.490 INFO:tasks.workunit.client.1.smithi134.stdout:3/353: rmdir d4/d5 39 2023-12-05T09:26:16.494 INFO:tasks.workunit.client.0.smithi067.stdout:5/230: rename db/df/d1a/d1d/l44 to db/df/d36/l55 0 2023-12-05T09:26:16.495 INFO:tasks.workunit.client.1.smithi134.stdout:3/354: write d4/d1f/d50/d52/f48 [768443,114199] 0 2023-12-05T09:26:16.498 INFO:tasks.workunit.client.0.smithi067.stdout:4/193: creat d0/f41 x:0 0 0 2023-12-05T09:26:16.499 INFO:tasks.workunit.client.1.smithi134.stdout:2/376: sync 2023-12-05T09:26:16.499 INFO:tasks.workunit.client.1.smithi134.stdout:5/293: sync 2023-12-05T09:26:16.499 INFO:tasks.workunit.client.1.smithi134.stdout:5/294: write d0/dd/f20 [973525,54769] 0 2023-12-05T09:26:16.500 INFO:tasks.workunit.client.0.smithi067.stdout:4/194: write d0/d1d/d25/d32/f16 [392163,108127] 0 2023-12-05T09:26:16.501 INFO:tasks.workunit.client.0.smithi067.stdout:4/195: write d0/d1d/d25/d32/f3f [1018147,116843] 0 2023-12-05T09:26:16.501 INFO:tasks.workunit.client.1.smithi134.stdout:4/367: dread f5 [0,4194304] 0 2023-12-05T09:26:16.501 INFO:tasks.workunit.client.1.smithi134.stdout:8/394: unlink da/de/d16/f58 0 2023-12-05T09:26:16.505 INFO:tasks.workunit.client.0.smithi067.stdout:6/188: dread da/d10/d1e/d17/f23 [0,4194304] 0 2023-12-05T09:26:16.505 INFO:tasks.workunit.client.0.smithi067.stdout:6/189: read da/fe [2308265,110044] 0 2023-12-05T09:26:16.509 INFO:tasks.workunit.client.1.smithi134.stdout:6/336: write d4/d32/f35 [4560732,45122] 0 2023-12-05T09:26:16.509 INFO:tasks.workunit.client.1.smithi134.stdout:6/337: fsync d4/d2a/d3a/f3c 0 2023-12-05T09:26:16.509 INFO:tasks.workunit.client.1.smithi134.stdout:7/349: dwrite d2/d7/dc/d2e/f43 [0,4194304] 0 2023-12-05T09:26:16.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/350: write f1 [4313296,15082] 0 2023-12-05T09:26:16.512 INFO:tasks.workunit.client.0.smithi067.stdout:1/248: creat d2/d5/d7/de/d19/d49/f56 x:0 0 0 2023-12-05T09:26:16.512 INFO:tasks.workunit.client.0.smithi067.stdout:1/249: stat d2/d5/d7/de/f37 0 2023-12-05T09:26:16.512 INFO:tasks.workunit.client.0.smithi067.stdout:1/250: readlink d2/d5/l9 0 2023-12-05T09:26:16.514 INFO:tasks.workunit.client.1.smithi134.stdout:0/331: mknod d13/d14/d30/d4b/d23/c6f 0 2023-12-05T09:26:16.515 INFO:tasks.workunit.client.1.smithi134.stdout:6/338: write d4/d2a/f48 [884490,34724] 0 2023-12-05T09:26:16.515 INFO:tasks.workunit.client.1.smithi134.stdout:6/339: readlink d4/d2a/d3a/da/d1b/l44 0 2023-12-05T09:26:16.515 INFO:tasks.workunit.client.1.smithi134.stdout:6/340: creat d4/d32/d57/f64 x:0 0 0 2023-12-05T09:26:16.515 INFO:tasks.workunit.client.1.smithi134.stdout:6/341: stat d4/d2a/f60 0 2023-12-05T09:26:16.516 INFO:tasks.workunit.client.0.smithi067.stdout:3/151: mkdir d9/d2e 0 2023-12-05T09:26:16.518 INFO:tasks.workunit.client.1.smithi134.stdout:1/413: link d2/d56/d74/f77 d2/d9/d10/d30/d4a/f9a 0 2023-12-05T09:26:16.519 INFO:tasks.workunit.client.1.smithi134.stdout:1/414: dread - d2/d27/f59 zero size 2023-12-05T09:26:16.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/377: mknod d19/d28/d63/d70/c79 0 2023-12-05T09:26:16.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/378: fsync d19/d3a/f44 0 2023-12-05T09:26:16.526 INFO:tasks.workunit.client.0.smithi067.stdout:5/231: mknod db/df/d52/c56 0 2023-12-05T09:26:16.527 INFO:tasks.workunit.client.1.smithi134.stdout:5/295: getdents d0/d1a/d1c/d25 0 2023-12-05T09:26:16.527 INFO:tasks.workunit.client.1.smithi134.stdout:5/296: chown d0/f55 0 1 2023-12-05T09:26:16.537 INFO:tasks.workunit.client.0.smithi067.stdout:6/190: mkdir da/d10/d1e/d17/d2f/d3f 0 2023-12-05T09:26:16.540 INFO:tasks.workunit.client.1.smithi134.stdout:9/307: dwrite d7/f1c [4194304,4194304] 0 2023-12-05T09:26:16.540 INFO:tasks.workunit.client.1.smithi134.stdout:9/308: readlink d7/d8/la 0 2023-12-05T09:26:16.541 INFO:tasks.workunit.client.0.smithi067.stdout:0/313: dwrite d3/d7/fc [0,4194304] 0 2023-12-05T09:26:16.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/152: mknod d9/da/d15/d28/d29/c2f 0 2023-12-05T09:26:16.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/153: chown d9/da/fd 618520685 1 2023-12-05T09:26:16.550 INFO:tasks.workunit.client.1.smithi134.stdout:8/395: rmdir da 39 2023-12-05T09:26:16.552 INFO:tasks.workunit.client.0.smithi067.stdout:4/196: rmdir d0/d1d/d25/d2c 39 2023-12-05T09:26:16.552 INFO:tasks.workunit.client.0.smithi067.stdout:4/197: stat d0/d1d/c31 0 2023-12-05T09:26:16.553 INFO:tasks.workunit.client.1.smithi134.stdout:7/351: getdents d2/dd/d1a 0 2023-12-05T09:26:16.554 INFO:tasks.workunit.client.1.smithi134.stdout:7/352: chown d2/d7/dc/d22/f27 71 1 2023-12-05T09:26:16.557 INFO:tasks.workunit.client.0.smithi067.stdout:0/314: mknod d3/d7/d3c/d67/d59/d4e/c6d 0 2023-12-05T09:26:16.559 INFO:tasks.workunit.client.0.smithi067.stdout:6/191: dread f4 [0,4194304] 0 2023-12-05T09:26:16.560 INFO:tasks.workunit.client.0.smithi067.stdout:4/198: rename d0/f7 to d0/d1d/f42 0 2023-12-05T09:26:16.563 INFO:tasks.workunit.client.0.smithi067.stdout:0/315: mkdir d3/d6b/d6e 0 2023-12-05T09:26:16.564 INFO:tasks.workunit.client.1.smithi134.stdout:5/297: write d0/d1a/d1c/f23 [1580927,67398] 0 2023-12-05T09:26:16.566 INFO:tasks.workunit.client.1.smithi134.stdout:1/415: truncate d2/d9/f24 4717723 0 2023-12-05T09:26:16.566 INFO:tasks.workunit.client.1.smithi134.stdout:1/416: readlink d2/l21 0 2023-12-05T09:26:16.566 INFO:tasks.workunit.client.1.smithi134.stdout:1/417: read - d2/d27/d71/f79 zero size 2023-12-05T09:26:16.569 INFO:tasks.workunit.client.0.smithi067.stdout:3/154: write f3 [3032395,31286] 0 2023-12-05T09:26:16.569 INFO:tasks.workunit.client.0.smithi067.stdout:4/199: creat d0/d1d/d25/d2c/d34/f43 x:0 0 0 2023-12-05T09:26:16.569 INFO:tasks.workunit.client.0.smithi067.stdout:4/200: creat d0/d1d/d25/d32/f44 x:0 0 0 2023-12-05T09:26:16.571 INFO:tasks.workunit.client.1.smithi134.stdout:2/379: unlink d19/d28/d31/c6e 0 2023-12-05T09:26:16.572 INFO:tasks.workunit.client.0.smithi067.stdout:9/400: dwrite d1b/d25/d35/f5e [0,4194304] 0 2023-12-05T09:26:16.573 INFO:tasks.workunit.client.1.smithi134.stdout:4/368: dwrite d16/d21/f57 [0,4194304] 0 2023-12-05T09:26:16.573 INFO:tasks.workunit.client.1.smithi134.stdout:3/355: dwrite d4/d1f/f3a [0,4194304] 0 2023-12-05T09:26:16.574 INFO:tasks.workunit.client.0.smithi067.stdout:1/251: dwrite d2/d4f/d14/f42 [0,4194304] 0 2023-12-05T09:26:16.574 INFO:tasks.workunit.client.0.smithi067.stdout:1/252: write d2/d4f/d14/f3c [723980,106437] 0 2023-12-05T09:26:16.574 INFO:tasks.workunit.client.0.smithi067.stdout:1/253: write d2/d4f/d14/d20/f26 [1101564,16691] 0 2023-12-05T09:26:16.574 INFO:tasks.workunit.client.0.smithi067.stdout:1/254: write d2/d3/f1d [1960779,25115] 0 2023-12-05T09:26:16.576 INFO:tasks.workunit.client.0.smithi067.stdout:0/316: creat d3/d6b/f6f x:0 0 0 2023-12-05T09:26:16.576 INFO:tasks.workunit.client.0.smithi067.stdout:0/317: write d3/d7/d3c/d67/f5b [3851323,44517] 0 2023-12-05T09:26:16.576 INFO:tasks.workunit.client.0.smithi067.stdout:0/318: write d3/d6b/f6f [514686,40629] 0 2023-12-05T09:26:16.576 INFO:tasks.workunit.client.1.smithi134.stdout:9/309: rmdir d7/d8/d16/d52 39 2023-12-05T09:26:16.580 INFO:tasks.workunit.client.0.smithi067.stdout:2/182: sync 2023-12-05T09:26:16.580 INFO:tasks.workunit.client.0.smithi067.stdout:2/183: write d0/d10/d1e/f2d [388875,65775] 0 2023-12-05T09:26:16.582 INFO:tasks.workunit.client.0.smithi067.stdout:3/155: creat d9/da/d15/d17/f30 x:0 0 0 2023-12-05T09:26:16.587 INFO:tasks.workunit.client.1.smithi134.stdout:8/396: dread da/de/d16/d33/f56 [0,4194304] 0 2023-12-05T09:26:16.587 INFO:tasks.workunit.client.1.smithi134.stdout:8/397: truncate da/de/f7a 1175005 0 2023-12-05T09:26:16.590 INFO:tasks.workunit.client.1.smithi134.stdout:7/353: creat d2/d7/d2b/d2d/d67/f74 x:0 0 0 2023-12-05T09:26:16.596 INFO:tasks.workunit.client.1.smithi134.stdout:0/332: getdents d13/d14 0 2023-12-05T09:26:16.601 INFO:tasks.workunit.client.1.smithi134.stdout:6/342: rename d4/d2a/d3a/fe to d4/d39/d42/f65 0 2023-12-05T09:26:16.601 INFO:tasks.workunit.client.1.smithi134.stdout:6/343: readlink d4/d2a/d3a/da/d1b/l4a 0 2023-12-05T09:26:16.604 INFO:tasks.workunit.client.0.smithi067.stdout:4/201: mknod d0/d1d/d3c/c45 0 2023-12-05T09:26:16.616 INFO:tasks.workunit.client.1.smithi134.stdout:6/344: dread d4/d39/f31 [0,4194304] 0 2023-12-05T09:26:16.622 INFO:tasks.workunit.client.1.smithi134.stdout:3/356: link d4/d5/d45/f46 d4/d5/d45/d60/f72 0 2023-12-05T09:26:16.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/418: rename d2/d9/d10/d30/d4a/d85 to d2/d9/d10/d30/d66/d9b 0 2023-12-05T09:26:16.625 INFO:tasks.workunit.client.1.smithi134.stdout:9/310: unlink d7/d8/d14/f3d 0 2023-12-05T09:26:16.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/333: creat d13/d14/f70 x:0 0 0 2023-12-05T09:26:16.626 INFO:tasks.workunit.client.0.smithi067.stdout:1/255: unlink d2/d5/l9 0 2023-12-05T09:26:16.626 INFO:tasks.workunit.client.0.smithi067.stdout:1/256: chown d2/d4f/d14/d48 0 1 2023-12-05T09:26:16.632 INFO:tasks.workunit.client.0.smithi067.stdout:0/319: symlink d3/d7/d3c/d57/l70 0 2023-12-05T09:26:16.634 INFO:tasks.workunit.client.0.smithi067.stdout:2/184: creat d0/d2f/d39/f40 x:0 0 0 2023-12-05T09:26:16.638 INFO:tasks.workunit.client.1.smithi134.stdout:5/298: dwrite d0/d1a/d1c/d3f/d5b/f63 [0,4194304] 0 2023-12-05T09:26:16.638 INFO:tasks.workunit.client.1.smithi134.stdout:8/398: rename da/de/d11/d1d/f71 to da/de/d16/d33/f87 0 2023-12-05T09:26:16.638 INFO:tasks.workunit.client.1.smithi134.stdout:8/399: creat da/de/d16/d2d/f88 x:0 0 0 2023-12-05T09:26:16.638 INFO:tasks.workunit.client.0.smithi067.stdout:6/192: dwrite da/d10/f11 [0,4194304] 0 2023-12-05T09:26:16.638 INFO:tasks.workunit.client.0.smithi067.stdout:6/193: creat da/d10/d1e/d17/f40 x:0 0 0 2023-12-05T09:26:16.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/311: truncate d7/d8/d14/f54 1909236 0 2023-12-05T09:26:16.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/312: chown d7/d10/c44 1650 1 2023-12-05T09:26:16.654 INFO:tasks.workunit.client.0.smithi067.stdout:1/257: truncate d2/d4f/f1e 2219271 0 2023-12-05T09:26:16.654 INFO:tasks.workunit.client.0.smithi067.stdout:1/258: chown d2/d4f/d14/f3c 2844822 1 2023-12-05T09:26:16.659 INFO:tasks.workunit.client.0.smithi067.stdout:2/185: creat d0/f41 x:0 0 0 2023-12-05T09:26:16.659 INFO:tasks.workunit.client.0.smithi067.stdout:2/186: dread - d0/d10/d1e/f3e zero size 2023-12-05T09:26:16.661 INFO:tasks.workunit.client.1.smithi134.stdout:0/334: fsync d13/d14/d30/d4b/f4e 0 2023-12-05T09:26:16.673 INFO:tasks.workunit.client.1.smithi134.stdout:4/369: dwrite d16/d18/f6d [0,4194304] 0 2023-12-05T09:26:16.673 INFO:tasks.workunit.client.1.smithi134.stdout:7/354: dwrite d2/d7/d2b/d2d/f66 [0,4194304] 0 2023-12-05T09:26:16.673 INFO:tasks.workunit.client.1.smithi134.stdout:4/370: write f4 [3236574,112202] 0 2023-12-05T09:26:16.675 INFO:tasks.workunit.client.1.smithi134.stdout:2/380: dwrite d19/f25 [0,4194304] 0 2023-12-05T09:26:16.676 INFO:tasks.workunit.client.0.smithi067.stdout:6/194: unlink da/fe 0 2023-12-05T09:26:16.676 INFO:tasks.workunit.client.0.smithi067.stdout:6/195: creat da/d10/d1e/d17/f41 x:0 0 0 2023-12-05T09:26:16.676 INFO:tasks.workunit.client.1.smithi134.stdout:6/345: dwrite d4/d2a/f43 [0,4194304] 0 2023-12-05T09:26:16.679 INFO:tasks.workunit.client.0.smithi067.stdout:4/202: rmdir d0/d9/d12/d15 39 2023-12-05T09:26:16.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/400: creat da/f89 x:0 0 0 2023-12-05T09:26:16.683 INFO:tasks.workunit.client.1.smithi134.stdout:8/401: write da/de/f4c [792071,104465] 0 2023-12-05T09:26:16.684 INFO:tasks.workunit.client.0.smithi067.stdout:2/187: mkdir d0/d10/d1e/d42 0 2023-12-05T09:26:16.686 INFO:tasks.workunit.client.1.smithi134.stdout:9/313: mknod d7/d10/d4b/c6b 0 2023-12-05T09:26:16.686 INFO:tasks.workunit.client.1.smithi134.stdout:9/314: creat d7/d5b/d5e/f6c x:0 0 0 2023-12-05T09:26:16.689 INFO:tasks.workunit.client.0.smithi067.stdout:9/401: dwrite d1b/d25/d54/d5c/f72 [0,4194304] 0 2023-12-05T09:26:16.691 INFO:tasks.workunit.client.1.smithi134.stdout:8/402: dread da/de/d16/d33/f87 [0,4194304] 0 2023-12-05T09:26:16.692 INFO:tasks.workunit.client.1.smithi134.stdout:8/403: stat da/de/d16/f23 0 2023-12-05T09:26:16.692 INFO:tasks.workunit.client.1.smithi134.stdout:8/404: chown da/de/d4d 10357285 1 2023-12-05T09:26:16.692 INFO:tasks.workunit.client.1.smithi134.stdout:8/405: readlink da/d1b/d42/l6f 0 2023-12-05T09:26:16.697 INFO:tasks.workunit.client.0.smithi067.stdout:2/188: creat d0/d25/d3a/f43 x:0 0 0 2023-12-05T09:26:16.697 INFO:tasks.workunit.client.0.smithi067.stdout:7/275: sync 2023-12-05T09:26:16.704 INFO:tasks.workunit.client.1.smithi134.stdout:3/357: rmdir d4/d1f 39 2023-12-05T09:26:16.709 INFO:tasks.workunit.client.0.smithi067.stdout:4/203: write d0/d9/d12/f14 [3318340,33094] 0 2023-12-05T09:26:16.709 INFO:tasks.workunit.client.0.smithi067.stdout:4/204: truncate d0/d9/f2f 934462 0 2023-12-05T09:26:16.709 INFO:tasks.workunit.client.0.smithi067.stdout:3/156: dwrite f4 [0,4194304] 0 2023-12-05T09:26:16.710 INFO:tasks.workunit.client.0.smithi067.stdout:1/259: write d2/d4f/d14/f3c [690806,100199] 0 2023-12-05T09:26:16.710 INFO:tasks.workunit.client.0.smithi067.stdout:1/260: creat d2/d5/d7/de/d1a/f57 x:0 0 0 2023-12-05T09:26:16.711 INFO:tasks.workunit.client.0.smithi067.stdout:1/261: write d2/d3/f3d [260722,2944] 0 2023-12-05T09:26:16.712 INFO:tasks.workunit.client.1.smithi134.stdout:7/355: write d2/d7/d2b/d2d/d67/d73/d26/f1c [2821800,16766] 0 2023-12-05T09:26:16.714 INFO:tasks.workunit.client.0.smithi067.stdout:9/402: symlink d1b/l8b 0 2023-12-05T09:26:16.714 INFO:tasks.workunit.client.0.smithi067.stdout:9/403: write d1b/d25/d35/f83 [1133564,31010] 0 2023-12-05T09:26:16.714 INFO:tasks.workunit.client.0.smithi067.stdout:9/404: creat d1b/d25/d35/d56/f8c x:0 0 0 2023-12-05T09:26:16.717 INFO:tasks.workunit.client.1.smithi134.stdout:0/335: dread d13/d14/f5c [0,4194304] 0 2023-12-05T09:26:16.719 INFO:tasks.workunit.client.1.smithi134.stdout:0/336: write d13/d14/d30/d4b/f41 [111904,43936] 0 2023-12-05T09:26:16.727 INFO:tasks.workunit.client.0.smithi067.stdout:2/189: dread d0/d25/d34/f3d [0,4194304] 0 2023-12-05T09:26:16.776 INFO:tasks.workunit.client.0.smithi067.stdout:4/205: mknod d0/d1d/d25/d32/c46 0 2023-12-05T09:26:16.782 INFO:tasks.workunit.client.0.smithi067.stdout:6/196: dwrite da/d10/d1e/d17/d2f/d12/d19/f21 [0,4194304] 0 2023-12-05T09:26:16.782 INFO:tasks.workunit.client.0.smithi067.stdout:6/197: truncate da/d10/d1e/d17/f40 760947 0 2023-12-05T09:26:16.783 INFO:tasks.workunit.client.1.smithi134.stdout:4/371: creat d16/d18/d1b/f7d x:0 0 0 2023-12-05T09:26:16.783 INFO:tasks.workunit.client.1.smithi134.stdout:6/346: dwrite d4/f26 [0,4194304] 0 2023-12-05T09:26:16.785 INFO:tasks.workunit.client.0.smithi067.stdout:9/405: symlink d1b/d25/d54/l8d 0 2023-12-05T09:26:16.785 INFO:tasks.workunit.client.0.smithi067.stdout:7/276: dwrite d0/d9/d10/d37/d38/f51 [0,4194304] 0 2023-12-05T09:26:16.787 INFO:tasks.workunit.client.0.smithi067.stdout:2/190: mknod d0/d10/d1e/c44 0 2023-12-05T09:26:16.791 INFO:tasks.workunit.client.0.smithi067.stdout:4/206: symlink d0/d1d/d3c/l47 0 2023-12-05T09:26:16.792 INFO:tasks.workunit.client.0.smithi067.stdout:4/207: write d0/d9/d12/d15/f20 [5013748,102659] 0 2023-12-05T09:26:16.793 INFO:tasks.workunit.client.1.smithi134.stdout:2/381: creat d19/d5f/f7a x:0 0 0 2023-12-05T09:26:16.793 INFO:tasks.workunit.client.1.smithi134.stdout:2/382: dread - d19/f34 zero size 2023-12-05T09:26:16.793 INFO:tasks.workunit.client.1.smithi134.stdout:2/383: dread - d19/d28/d2b/f57 zero size 2023-12-05T09:26:16.793 INFO:tasks.workunit.client.0.smithi067.stdout:3/157: getdents d9 0 2023-12-05T09:26:16.795 INFO:tasks.workunit.client.0.smithi067.stdout:8/236: sync 2023-12-05T09:26:16.795 INFO:tasks.workunit.client.0.smithi067.stdout:8/237: dread - d5/dc/d1a/f2f zero size 2023-12-05T09:26:16.795 INFO:tasks.workunit.client.0.smithi067.stdout:6/198: write da/d10/d1e/d17/d2f/d1f/f25 [7723015,26752] 0 2023-12-05T09:26:16.800 INFO:tasks.workunit.client.1.smithi134.stdout:5/299: mkdir d0/d66 0 2023-12-05T09:26:16.803 INFO:tasks.workunit.client.0.smithi067.stdout:9/406: link d1b/d25/c2b d1b/d25/d35/d56/c8e 0 2023-12-05T09:26:16.806 INFO:tasks.workunit.client.0.smithi067.stdout:7/277: getdents d0 0 2023-12-05T09:26:16.807 INFO:tasks.workunit.client.0.smithi067.stdout:2/191: mknod d0/d2f/c45 0 2023-12-05T09:26:16.812 INFO:tasks.workunit.client.0.smithi067.stdout:4/208: mknod d0/d1d/d25/d38/c48 0 2023-12-05T09:26:16.812 INFO:tasks.workunit.client.0.smithi067.stdout:4/209: write d0/fc [114602,9255] 0 2023-12-05T09:26:16.813 INFO:tasks.workunit.client.0.smithi067.stdout:4/210: creat d0/d1d/d25/d38/f49 x:0 0 0 2023-12-05T09:26:16.814 INFO:tasks.workunit.client.1.smithi134.stdout:5/300: dread d0/dd/f17 [0,4194304] 0 2023-12-05T09:26:16.814 INFO:tasks.workunit.client.1.smithi134.stdout:5/301: truncate d0/d1a/f39 672312 0 2023-12-05T09:26:16.817 INFO:tasks.workunit.client.1.smithi134.stdout:4/372: dwrite d16/f7a [0,4194304] 0 2023-12-05T09:26:16.817 INFO:tasks.workunit.client.0.smithi067.stdout:3/158: mkdir d9/da/d15/d28/d31 0 2023-12-05T09:26:16.817 INFO:tasks.workunit.client.0.smithi067.stdout:3/159: creat d9/da/d15/d17/f32 x:0 0 0 2023-12-05T09:26:16.822 INFO:tasks.workunit.client.1.smithi134.stdout:9/315: symlink d7/d8/d16/d52/d65/l6d 0 2023-12-05T09:26:16.822 INFO:tasks.workunit.client.1.smithi134.stdout:9/316: chown d7/d8/d14/d26 6597660 1 2023-12-05T09:26:16.824 INFO:tasks.workunit.client.0.smithi067.stdout:7/278: creat d0/d9/f58 x:0 0 0 2023-12-05T09:26:16.825 INFO:tasks.workunit.client.1.smithi134.stdout:8/406: rename da/d1b to da/de/d8a 0 2023-12-05T09:26:16.828 INFO:tasks.workunit.client.1.smithi134.stdout:3/358: symlink d4/d1f/d50/d52/l73 0 2023-12-05T09:26:16.829 INFO:tasks.workunit.client.0.smithi067.stdout:3/160: creat d9/d24/f33 x:0 0 0 2023-12-05T09:26:16.829 INFO:tasks.workunit.client.0.smithi067.stdout:3/161: read - d9/d24/f26 zero size 2023-12-05T09:26:16.831 INFO:tasks.workunit.client.1.smithi134.stdout:7/356: getdents d2/df/d2a/d36 0 2023-12-05T09:26:16.836 INFO:tasks.workunit.client.1.smithi134.stdout:0/337: mkdir d13/d71 0 2023-12-05T09:26:16.840 INFO:tasks.workunit.client.0.smithi067.stdout:3/162: rmdir d9/d2e 0 2023-12-05T09:26:16.840 INFO:tasks.workunit.client.0.smithi067.stdout:3/163: creat d9/d24/f34 x:0 0 0 2023-12-05T09:26:16.846 INFO:tasks.workunit.client.0.smithi067.stdout:3/164: creat d9/da/d15/d17/d1a/f35 x:0 0 0 2023-12-05T09:26:16.848 INFO:tasks.workunit.client.0.smithi067.stdout:6/199: dwrite da/d10/d1e/d17/d2f/d1f/f25 [4194304,4194304] 0 2023-12-05T09:26:16.848 INFO:tasks.workunit.client.0.smithi067.stdout:3/165: creat d9/da/d15/d28/d29/f36 x:0 0 0 2023-12-05T09:26:16.848 INFO:tasks.workunit.client.0.smithi067.stdout:6/200: rename da/d10/d1e/d17/d2f to da/d10/d1e/d17/d2f/d2c/d34/d3b/d42 22 2023-12-05T09:26:16.850 INFO:tasks.workunit.client.1.smithi134.stdout:5/302: mknod d0/d11/c67 0 2023-12-05T09:26:16.853 INFO:tasks.workunit.client.0.smithi067.stdout:3/166: link f6 d9/da/d15/d17/f37 0 2023-12-05T09:26:16.856 INFO:tasks.workunit.client.0.smithi067.stdout:6/201: link da/l37 da/d10/d1e/d17/d2f/d1f/l43 0 2023-12-05T09:26:16.858 INFO:tasks.workunit.client.1.smithi134.stdout:9/317: symlink d7/d8/d16/l6e 0 2023-12-05T09:26:16.858 INFO:tasks.workunit.client.1.smithi134.stdout:9/318: readlink d7/d8/d14/l2c 0 2023-12-05T09:26:16.858 INFO:tasks.workunit.client.1.smithi134.stdout:9/319: fdatasync d7/d8/d2e/f42 0 2023-12-05T09:26:16.858 INFO:tasks.workunit.client.1.smithi134.stdout:9/320: chown d7/d5b/d5e/l62 0 1 2023-12-05T09:26:16.858 INFO:tasks.workunit.client.0.smithi067.stdout:3/167: symlink d9/da/d15/d17/d2b/l38 0 2023-12-05T09:26:16.861 INFO:tasks.workunit.client.1.smithi134.stdout:8/407: mkdir da/de/d11/d8b 0 2023-12-05T09:26:16.864 INFO:tasks.workunit.client.1.smithi134.stdout:2/384: rename d19/d3a/f65 to d19/d76/f7b 0 2023-12-05T09:26:16.864 INFO:tasks.workunit.client.1.smithi134.stdout:4/373: rename d16 to d16/d18/d1b/d7e 22 2023-12-05T09:26:16.864 INFO:tasks.workunit.client.1.smithi134.stdout:2/385: fdatasync d19/d3a/f52 0 2023-12-05T09:26:16.865 INFO:tasks.workunit.client.0.smithi067.stdout:3/168: mknod d9/da/d15/c39 0 2023-12-05T09:26:16.868 INFO:tasks.workunit.client.1.smithi134.stdout:3/359: mknod d4/d1f/d4e/d6a/c74 0 2023-12-05T09:26:16.868 INFO:tasks.workunit.client.1.smithi134.stdout:3/360: stat d4/d5/c3d 0 2023-12-05T09:26:16.868 INFO:tasks.workunit.client.1.smithi134.stdout:7/357: mkdir d2/dd/d71/d75 0 2023-12-05T09:26:16.874 INFO:tasks.workunit.client.1.smithi134.stdout:6/347: truncate d4/d39/f37 1150577 0 2023-12-05T09:26:16.874 INFO:tasks.workunit.client.1.smithi134.stdout:1/419: sync 2023-12-05T09:26:16.874 INFO:tasks.workunit.client.1.smithi134.stdout:5/303: link d0/fc d0/d1a/d1c/d25/d4d/f68 0 2023-12-05T09:26:16.878 INFO:tasks.workunit.client.1.smithi134.stdout:8/408: mkdir da/de/d11/d8b/d8c 0 2023-12-05T09:26:16.878 INFO:tasks.workunit.client.1.smithi134.stdout:8/409: chown da/de/d16/d33/f81 65466 1 2023-12-05T09:26:16.878 INFO:tasks.workunit.client.1.smithi134.stdout:8/410: chown da/de/d16 17452 1 2023-12-05T09:26:16.878 INFO:tasks.workunit.client.1.smithi134.stdout:8/411: fdatasync da/de/d11/f30 0 2023-12-05T09:26:16.884 INFO:tasks.workunit.client.1.smithi134.stdout:0/338: mknod d13/d14/d15/d67/c72 0 2023-12-05T09:26:16.884 INFO:tasks.workunit.client.1.smithi134.stdout:5/304: creat d0/d1a/d1c/d3f/d5b/d5d/f69 x:0 0 0 2023-12-05T09:26:16.890 INFO:tasks.workunit.client.1.smithi134.stdout:8/412: creat da/de/d4d/f8d x:0 0 0 2023-12-05T09:26:16.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/413: write da/de/d43/f5d [760637,10855] 0 2023-12-05T09:26:16.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/414: chown da/de/d16/d2d/f36 748670 1 2023-12-05T09:26:16.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/415: read da/de/f48 [3940792,29531] 0 2023-12-05T09:26:16.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/416: chown da/de/d16/d2d/c67 11019155 1 2023-12-05T09:26:16.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/417: read da/de/d8a/f1e [3686680,96899] 0 2023-12-05T09:26:16.892 INFO:tasks.workunit.client.1.smithi134.stdout:0/339: mkdir d13/d14/d15/d67/d73 0 2023-12-05T09:26:16.895 INFO:tasks.workunit.client.1.smithi134.stdout:5/305: mkdir d0/d1a/d1c/d25/d6a 0 2023-12-05T09:26:16.897 INFO:tasks.workunit.client.1.smithi134.stdout:8/418: truncate da/de/d16/d2d/f5e 2175043 0 2023-12-05T09:26:16.897 INFO:tasks.workunit.client.1.smithi134.stdout:7/358: dread d2/d7/f13 [0,4194304] 0 2023-12-05T09:26:16.901 INFO:tasks.workunit.client.1.smithi134.stdout:0/340: rmdir d13/d71 0 2023-12-05T09:26:16.902 INFO:tasks.workunit.client.1.smithi134.stdout:0/341: creat d13/d14/d15/d2a/f74 x:0 0 0 2023-12-05T09:26:16.902 INFO:tasks.workunit.client.1.smithi134.stdout:8/419: mknod da/de/d11/c8e 0 2023-12-05T09:26:16.902 INFO:tasks.workunit.client.1.smithi134.stdout:8/420: chown da/de/d16/d33 17419569 1 2023-12-05T09:26:16.905 INFO:tasks.workunit.client.0.smithi067.stdout:7/279: dread d0/d9/d10/f35 [0,4194304] 0 2023-12-05T09:26:16.907 INFO:tasks.workunit.client.0.smithi067.stdout:2/192: dwrite d0/d25/d3a/f43 [0,4194304] 0 2023-12-05T09:26:16.908 INFO:tasks.workunit.client.0.smithi067.stdout:4/211: dread d0/f6 [0,4194304] 0 2023-12-05T09:26:16.908 INFO:tasks.workunit.client.0.smithi067.stdout:2/193: chown d0/c5 1917 1 2023-12-05T09:26:16.908 INFO:tasks.workunit.client.0.smithi067.stdout:4/212: stat d0/f6 0 2023-12-05T09:26:16.909 INFO:tasks.workunit.client.0.smithi067.stdout:7/280: mknod d0/d9/d10/d1d/c59 0 2023-12-05T09:26:16.909 INFO:tasks.workunit.client.0.smithi067.stdout:7/281: fsync d0/f4a 0 2023-12-05T09:26:16.909 INFO:tasks.workunit.client.0.smithi067.stdout:7/282: readlink d0/l3d 0 2023-12-05T09:26:16.909 INFO:tasks.workunit.client.0.smithi067.stdout:7/283: fsync d0/f27 0 2023-12-05T09:26:16.912 INFO:tasks.workunit.client.0.smithi067.stdout:2/194: mknod d0/d10/c46 0 2023-12-05T09:26:16.913 INFO:tasks.workunit.client.1.smithi134.stdout:0/342: rmdir d13/d14/d30/d4b 39 2023-12-05T09:26:16.913 INFO:tasks.workunit.client.1.smithi134.stdout:0/343: chown d13/d14/d30/c2e 121896824 1 2023-12-05T09:26:16.913 INFO:tasks.workunit.client.1.smithi134.stdout:0/344: readlink d13/d14/d15/l6a 0 2023-12-05T09:26:16.913 INFO:tasks.workunit.client.1.smithi134.stdout:0/345: fdatasync f7 0 2023-12-05T09:26:16.914 INFO:tasks.workunit.client.1.smithi134.stdout:0/346: dread - d13/d14/d15/d2a/f49 zero size 2023-12-05T09:26:16.915 INFO:tasks.workunit.client.0.smithi067.stdout:4/213: creat d0/d9/f4a x:0 0 0 2023-12-05T09:26:16.919 INFO:tasks.workunit.client.0.smithi067.stdout:9/407: dwrite d1b/d25/d35/f6f [0,4194304] 0 2023-12-05T09:26:16.919 INFO:tasks.workunit.client.0.smithi067.stdout:9/408: chown d1b/d25/l45 3 1 2023-12-05T09:26:16.919 INFO:tasks.workunit.client.0.smithi067.stdout:9/409: write d1b/d25/d35/f5e [4816287,12587] 0 2023-12-05T09:26:16.922 INFO:tasks.workunit.client.1.smithi134.stdout:0/347: symlink d13/d14/d30/d4b/d66/l75 0 2023-12-05T09:26:16.922 INFO:tasks.workunit.client.1.smithi134.stdout:0/348: write d13/d14/d15/f69 [1003817,90688] 0 2023-12-05T09:26:16.924 INFO:tasks.workunit.client.0.smithi067.stdout:2/195: mknod d0/d25/d3f/c47 0 2023-12-05T09:26:16.926 INFO:tasks.workunit.client.1.smithi134.stdout:4/374: dwrite d16/d18/d1a/d3b/f5c [0,4194304] 0 2023-12-05T09:26:16.926 INFO:tasks.workunit.client.0.smithi067.stdout:4/214: symlink d0/d9/d12/l4b 0 2023-12-05T09:26:16.926 INFO:tasks.workunit.client.0.smithi067.stdout:2/196: getdents d0/d10/d1e/d42 0 2023-12-05T09:26:16.927 INFO:tasks.workunit.client.1.smithi134.stdout:0/349: chown d13/d14/l22 150171 1 2023-12-05T09:26:16.935 INFO:tasks.workunit.client.1.smithi134.stdout:4/375: symlink d16/d21/d48/d66/l7f 0 2023-12-05T09:26:16.941 INFO:tasks.workunit.client.1.smithi134.stdout:0/350: symlink d13/d14/d30/d4b/l76 0 2023-12-05T09:26:16.944 INFO:tasks.workunit.client.1.smithi134.stdout:8/421: dread da/de/f54 [0,4194304] 0 2023-12-05T09:26:16.944 INFO:tasks.workunit.client.1.smithi134.stdout:8/422: dread - da/de/d16/d33/f81 zero size 2023-12-05T09:26:16.946 INFO:tasks.workunit.client.1.smithi134.stdout:2/386: dwrite f10 [0,4194304] 0 2023-12-05T09:26:16.946 INFO:tasks.workunit.client.1.smithi134.stdout:2/387: creat d19/d28/d63/f7c x:0 0 0 2023-12-05T09:26:16.946 INFO:tasks.workunit.client.1.smithi134.stdout:2/388: write d19/d3a/f45 [1099267,100745] 0 2023-12-05T09:26:16.946 INFO:tasks.workunit.client.1.smithi134.stdout:2/389: readlink d19/d28/l53 0 2023-12-05T09:26:16.946 INFO:tasks.workunit.client.1.smithi134.stdout:2/390: creat d19/d28/d63/d70/f7d x:0 0 0 2023-12-05T09:26:16.949 INFO:tasks.workunit.client.1.smithi134.stdout:0/351: mkdir d13/d14/d30/d4b/d23/d77 0 2023-12-05T09:26:16.950 INFO:tasks.workunit.client.1.smithi134.stdout:8/423: mknod da/de/d8a/d42/c8f 0 2023-12-05T09:26:16.952 INFO:tasks.workunit.client.0.smithi067.stdout:2/197: rmdir d0 39 2023-12-05T09:26:16.957 INFO:tasks.workunit.client.0.smithi067.stdout:2/198: truncate d0/fd 798184 0 2023-12-05T09:26:16.957 INFO:tasks.workunit.client.0.smithi067.stdout:2/199: chown d0/d25/d3a 919 1 2023-12-05T09:26:16.959 INFO:tasks.workunit.client.0.smithi067.stdout:2/200: mkdir d0/d25/d48 0 2023-12-05T09:26:16.959 INFO:tasks.workunit.client.0.smithi067.stdout:2/201: chown d0/lb 14 1 2023-12-05T09:26:16.960 INFO:tasks.workunit.client.1.smithi134.stdout:4/376: write f13 [2877082,121262] 0 2023-12-05T09:26:16.961 INFO:tasks.workunit.client.0.smithi067.stdout:2/202: unlink d0/f9 0 2023-12-05T09:26:16.963 INFO:tasks.workunit.client.0.smithi067.stdout:2/203: mknod d0/d2f/d39/c49 0 2023-12-05T09:26:16.966 INFO:tasks.workunit.client.1.smithi134.stdout:2/391: dread d19/f2d [0,4194304] 0 2023-12-05T09:26:16.969 INFO:tasks.workunit.client.0.smithi067.stdout:6/202: dwrite da/d10/d1e/d17/d2f/d12/d19/f21 [0,4194304] 0 2023-12-05T09:26:16.969 INFO:tasks.workunit.client.0.smithi067.stdout:6/203: read - da/d10/d1e/d17/d2f/d2c/d34/f3e zero size 2023-12-05T09:26:16.969 INFO:tasks.workunit.client.0.smithi067.stdout:3/169: dwrite d9/d24/f26 [0,4194304] 0 2023-12-05T09:26:16.974 INFO:tasks.workunit.client.1.smithi134.stdout:5/306: dwrite d0/d1a/d1c/d25/f2d [0,4194304] 0 2023-12-05T09:26:16.976 INFO:tasks.workunit.client.1.smithi134.stdout:2/392: creat d19/d28/d31/f7e x:0 0 0 2023-12-05T09:26:16.980 INFO:tasks.workunit.client.1.smithi134.stdout:1/420: dwrite d2/d9/d10/d5b/f5c [0,4194304] 0 2023-12-05T09:26:16.988 INFO:tasks.workunit.client.1.smithi134.stdout:5/307: truncate d0/d45/f57 8280685 0 2023-12-05T09:26:17.001 INFO:tasks.workunit.client.1.smithi134.stdout:1/421: mknod d2/d27/d71/d80/c9c 0 2023-12-05T09:26:17.001 INFO:tasks.workunit.client.1.smithi134.stdout:1/422: dread - d2/f63 zero size 2023-12-05T09:26:17.001 INFO:tasks.workunit.client.1.smithi134.stdout:5/308: mknod d0/dd/d37/c6b 0 2023-12-05T09:26:17.002 INFO:tasks.workunit.client.1.smithi134.stdout:5/309: stat d0/d11/f62 0 2023-12-05T09:26:17.003 INFO:tasks.workunit.client.1.smithi134.stdout:4/377: read d16/d21/d48/f34 [610153,48576] 0 2023-12-05T09:26:17.006 INFO:tasks.workunit.client.1.smithi134.stdout:2/393: rename l14 to d19/d28/d31/d38/l7f 0 2023-12-05T09:26:17.007 INFO:tasks.workunit.client.1.smithi134.stdout:0/352: dwrite d13/f17 [0,4194304] 0 2023-12-05T09:26:17.009 INFO:tasks.workunit.client.1.smithi134.stdout:3/361: dwrite d4/d1f/f3a [0,4194304] 0 2023-12-05T09:26:17.009 INFO:tasks.workunit.client.1.smithi134.stdout:3/362: write d4/fb [978422,125494] 0 2023-12-05T09:26:17.009 INFO:tasks.workunit.client.1.smithi134.stdout:1/423: unlink d2/d9/f48 0 2023-12-05T09:26:17.015 INFO:tasks.workunit.client.1.smithi134.stdout:8/424: write da/de/d11/f30 [1142412,52274] 0 2023-12-05T09:26:17.016 INFO:tasks.workunit.client.1.smithi134.stdout:1/424: mkdir d2/d27/d9d 0 2023-12-05T09:26:17.020 INFO:tasks.workunit.client.1.smithi134.stdout:8/425: creat da/de/d16/d45/d72/f90 x:0 0 0 2023-12-05T09:26:17.020 INFO:tasks.workunit.client.1.smithi134.stdout:1/425: symlink d2/d9/d10/d30/d66/d9b/l9e 0 2023-12-05T09:26:17.021 INFO:tasks.workunit.client.1.smithi134.stdout:8/426: unlink da/de/d11/d1d/f76 0 2023-12-05T09:26:17.023 INFO:tasks.workunit.client.1.smithi134.stdout:8/427: creat da/de/d4d/f91 x:0 0 0 2023-12-05T09:26:17.023 INFO:tasks.workunit.client.1.smithi134.stdout:8/428: creat da/de/d11/d1d/f92 x:0 0 0 2023-12-05T09:26:17.038 INFO:tasks.workunit.client.0.smithi067.stdout:7/284: dwrite d0/d9/d3f/f47 [0,4194304] 0 2023-12-05T09:26:17.038 INFO:tasks.workunit.client.0.smithi067.stdout:7/285: read - d0/d9/d1b/d34/f46 zero size 2023-12-05T09:26:17.039 INFO:tasks.workunit.client.0.smithi067.stdout:5/232: sync 2023-12-05T09:26:17.039 INFO:tasks.workunit.client.0.smithi067.stdout:0/320: sync 2023-12-05T09:26:17.040 INFO:tasks.workunit.client.0.smithi067.stdout:9/410: dwrite d1b/d25/d5b/d62/f63 [0,4194304] 0 2023-12-05T09:26:17.041 INFO:tasks.workunit.client.0.smithi067.stdout:9/411: read - d1b/d25/f4b zero size 2023-12-05T09:26:17.041 INFO:tasks.workunit.client.0.smithi067.stdout:4/215: dwrite d0/fc [0,4194304] 0 2023-12-05T09:26:17.044 INFO:tasks.workunit.client.0.smithi067.stdout:0/321: rename d3/df/f16 to d3/d7/f71 0 2023-12-05T09:26:17.044 INFO:tasks.workunit.client.0.smithi067.stdout:3/170: dwrite d9/da/f19 [0,4194304] 0 2023-12-05T09:26:17.044 INFO:tasks.workunit.client.0.smithi067.stdout:6/204: dwrite da/d10/d1e/d17/d2f/d12/d19/f21 [0,4194304] 0 2023-12-05T09:26:17.047 INFO:tasks.workunit.client.0.smithi067.stdout:6/205: rename da/d10/d1e/d17/d2f/d12 to da/d10/d1e/d17/d2f/d12/d44 22 2023-12-05T09:26:17.047 INFO:tasks.workunit.client.0.smithi067.stdout:3/171: write d9/da/d15/d28/d29/f36 [715311,114600] 0 2023-12-05T09:26:17.047 INFO:tasks.workunit.client.0.smithi067.stdout:4/216: unlink d0/d1d/f23 0 2023-12-05T09:26:17.047 INFO:tasks.workunit.client.0.smithi067.stdout:9/412: mkdir d1b/d25/d54/d5c/d8f 0 2023-12-05T09:26:17.047 INFO:tasks.workunit.client.1.smithi134.stdout:1/426: write d2/d9/d10/f47 [1879638,50491] 0 2023-12-05T09:26:17.052 INFO:tasks.workunit.client.1.smithi134.stdout:1/427: mknod d2/d9/d10/d30/d4a/c9f 0 2023-12-05T09:26:17.052 INFO:tasks.workunit.client.1.smithi134.stdout:1/428: write d2/d9/f2d [1282699,39916] 0 2023-12-05T09:26:17.052 INFO:tasks.workunit.client.0.smithi067.stdout:4/217: symlink d0/d1d/d25/d2c/d34/l4c 0 2023-12-05T09:26:17.053 INFO:tasks.workunit.client.0.smithi067.stdout:0/322: creat d3/d6b/d6e/f72 x:0 0 0 2023-12-05T09:26:17.053 INFO:tasks.workunit.client.0.smithi067.stdout:4/218: chown d0/d1d/d25/d32/c46 192484458 1 2023-12-05T09:26:17.053 INFO:tasks.workunit.client.0.smithi067.stdout:0/323: fdatasync d3/df/f3e 0 2023-12-05T09:26:17.053 INFO:tasks.workunit.client.0.smithi067.stdout:4/219: chown d0/d9/f2f 130 1 2023-12-05T09:26:17.053 INFO:tasks.workunit.client.0.smithi067.stdout:4/220: readlink d0/d1d/d25/d32/l1b 0 2023-12-05T09:26:17.054 INFO:tasks.workunit.client.1.smithi134.stdout:1/429: getdents d2/d9/d10/d30 0 2023-12-05T09:26:17.057 INFO:tasks.workunit.client.0.smithi067.stdout:4/221: rmdir d0/d1d/d24 39 2023-12-05T09:26:17.057 INFO:tasks.workunit.client.0.smithi067.stdout:0/324: symlink d3/df/l73 0 2023-12-05T09:26:17.057 INFO:tasks.workunit.client.0.smithi067.stdout:0/325: chown d3/d7/d3c/d67/d59/c62 0 1 2023-12-05T09:26:17.057 INFO:tasks.workunit.client.0.smithi067.stdout:4/222: write d0/d1d/d25/d38/f49 [46944,24169] 0 2023-12-05T09:26:17.058 INFO:tasks.workunit.client.1.smithi134.stdout:1/430: mknod d2/d9/d10/d94/ca0 0 2023-12-05T09:26:17.059 INFO:tasks.workunit.client.0.smithi067.stdout:0/326: symlink d3/d6b/l74 0 2023-12-05T09:26:17.062 INFO:tasks.workunit.client.1.smithi134.stdout:1/431: truncate d2/f17 2079549 0 2023-12-05T09:26:17.063 INFO:tasks.workunit.client.1.smithi134.stdout:1/432: fdatasync d2/d56/d74/f7b 0 2023-12-05T09:26:17.063 INFO:tasks.workunit.client.1.smithi134.stdout:9/321: sync 2023-12-05T09:26:17.063 INFO:tasks.workunit.client.1.smithi134.stdout:1/433: truncate d2/f43 445897 0 2023-12-05T09:26:17.063 INFO:tasks.workunit.client.1.smithi134.stdout:9/322: fsync d7/d8/d14/d26/f4a 0 2023-12-05T09:26:17.063 INFO:tasks.workunit.client.1.smithi134.stdout:9/323: dread - d7/d10/d4b/d53/f63 zero size 2023-12-05T09:26:17.063 INFO:tasks.workunit.client.0.smithi067.stdout:0/327: link d3/d7/f2c d3/d7/d3c/f75 0 2023-12-05T09:26:17.066 INFO:tasks.workunit.client.1.smithi134.stdout:2/394: dwrite f12 [0,4194304] 0 2023-12-05T09:26:17.067 INFO:tasks.workunit.client.0.smithi067.stdout:9/413: read d1b/d25/d35/f49 [2059559,28366] 0 2023-12-05T09:26:17.067 INFO:tasks.workunit.client.0.smithi067.stdout:9/414: readlink d1b/d25/l45 0 2023-12-05T09:26:17.069 INFO:tasks.workunit.client.0.smithi067.stdout:3/172: dread d9/fb [0,4194304] 0 2023-12-05T09:26:17.070 INFO:tasks.workunit.client.1.smithi134.stdout:9/324: truncate d7/d8/d16/f1f 169349 0 2023-12-05T09:26:17.070 INFO:tasks.workunit.client.1.smithi134.stdout:9/325: fsync d7/d8/f6a 0 2023-12-05T09:26:17.070 INFO:tasks.workunit.client.1.smithi134.stdout:9/326: fdatasync f1 0 2023-12-05T09:26:17.072 INFO:tasks.workunit.client.0.smithi067.stdout:0/328: unlink d3/d7/d3c/d67/d59/l64 0 2023-12-05T09:26:17.072 INFO:tasks.workunit.client.0.smithi067.stdout:0/329: readlink d3/df/l73 0 2023-12-05T09:26:17.072 INFO:tasks.workunit.client.0.smithi067.stdout:0/330: fdatasync d3/df/f26 0 2023-12-05T09:26:17.072 INFO:tasks.workunit.client.0.smithi067.stdout:0/331: read - d3/df/f3f zero size 2023-12-05T09:26:17.074 INFO:tasks.workunit.client.0.smithi067.stdout:9/415: mkdir d1b/d25/d35/d56/d90 0 2023-12-05T09:26:17.075 INFO:tasks.workunit.client.0.smithi067.stdout:9/416: write d1b/d3e/f66 [1133829,1800] 0 2023-12-05T09:26:17.081 INFO:tasks.workunit.client.0.smithi067.stdout:0/332: mkdir d3/d7/d3c/d6c/d76 0 2023-12-05T09:26:17.083 INFO:tasks.workunit.client.0.smithi067.stdout:9/417: rename d1b/d25/d35/f52 to d1b/d3e/f91 0 2023-12-05T09:26:17.083 INFO:tasks.workunit.client.0.smithi067.stdout:9/418: readlink d1b/d25/d5b/l6b 0 2023-12-05T09:26:17.089 INFO:tasks.workunit.client.0.smithi067.stdout:0/333: rename d3/d7/d3c/d57 to d3/d7/d3c/d77 0 2023-12-05T09:26:17.094 INFO:tasks.workunit.client.0.smithi067.stdout:0/334: symlink d3/d7/d3c/d66/l78 0 2023-12-05T09:26:17.096 INFO:tasks.workunit.client.0.smithi067.stdout:0/335: creat d3/d7/d3c/d67/d59/d5c/d68/f79 x:0 0 0 2023-12-05T09:26:17.097 INFO:tasks.workunit.client.0.smithi067.stdout:0/336: chown d3/d7/d3c/d66 7790 1 2023-12-05T09:26:17.097 INFO:tasks.workunit.client.0.smithi067.stdout:0/337: fdatasync d3/f39 0 2023-12-05T09:26:17.098 INFO:tasks.workunit.client.1.smithi134.stdout:8/429: dwrite da/de/f4c [0,4194304] 0 2023-12-05T09:26:17.098 INFO:tasks.workunit.client.1.smithi134.stdout:8/430: fdatasync da/de/d11/f19 0 2023-12-05T09:26:17.099 INFO:tasks.workunit.client.1.smithi134.stdout:8/431: write da/de/d16/d33/f56 [502428,120369] 0 2023-12-05T09:26:17.100 INFO:tasks.workunit.client.0.smithi067.stdout:5/233: dread f9 [0,4194304] 0 2023-12-05T09:26:17.100 INFO:tasks.workunit.client.0.smithi067.stdout:5/234: stat db/df/d3f/f4a 0 2023-12-05T09:26:17.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/286: dwrite d0/f11 [4194304,4194304] 0 2023-12-05T09:26:17.102 INFO:tasks.workunit.client.1.smithi134.stdout:8/432: rename da to da/de/d43/d93 22 2023-12-05T09:26:17.102 INFO:tasks.workunit.client.1.smithi134.stdout:0/353: dwrite d13/f35 [0,4194304] 0 2023-12-05T09:26:17.102 INFO:tasks.workunit.client.1.smithi134.stdout:9/327: dread d7/d10/d4b/f57 [0,4194304] 0 2023-12-05T09:26:17.104 INFO:tasks.workunit.client.0.smithi067.stdout:5/235: rename db/df/d1a/d1d/d20/d47 to db/df/d36/d57 0 2023-12-05T09:26:17.110 INFO:tasks.workunit.client.0.smithi067.stdout:6/206: dwrite da/d10/d1e/d17/d2f/f2b [0,4194304] 0 2023-12-05T09:26:17.110 INFO:tasks.workunit.client.0.smithi067.stdout:6/207: chown da/d10/d1e/d17/d2f/c38 347692872 1 2023-12-05T09:26:17.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/287: mkdir d0/d9/d1b/d5a 0 2023-12-05T09:26:17.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/288: chown d0/d9/d1b/c2d 109 1 2023-12-05T09:26:17.112 INFO:tasks.workunit.client.1.smithi134.stdout:0/354: unlink fd 0 2023-12-05T09:26:17.114 INFO:tasks.workunit.client.0.smithi067.stdout:5/236: getdents db/df 0 2023-12-05T09:26:17.117 INFO:tasks.workunit.client.0.smithi067.stdout:7/289: link d0/f4c d0/d9/d56/f5b 0 2023-12-05T09:26:17.118 INFO:tasks.workunit.client.1.smithi134.stdout:9/328: symlink d7/d10/d4b/l6f 0 2023-12-05T09:26:17.118 INFO:tasks.workunit.client.1.smithi134.stdout:9/329: write d7/d10/d4b/d53/f63 [67074,2565] 0 2023-12-05T09:26:17.118 INFO:tasks.workunit.client.1.smithi134.stdout:9/330: write d7/d5b/d5e/f6c [12515,109652] 0 2023-12-05T09:26:17.118 INFO:tasks.workunit.client.1.smithi134.stdout:1/434: dwrite d2/d27/f59 [0,4194304] 0 2023-12-05T09:26:17.118 INFO:tasks.workunit.client.1.smithi134.stdout:1/435: write d2/d9/d10/d30/f37 [2836759,20280] 0 2023-12-05T09:26:17.119 INFO:tasks.workunit.client.1.smithi134.stdout:1/436: fdatasync d2/d9/d10/d30/d4a/f70 0 2023-12-05T09:26:17.119 INFO:tasks.workunit.client.1.smithi134.stdout:1/437: creat d2/d27/d71/fa1 x:0 0 0 2023-12-05T09:26:17.119 INFO:tasks.workunit.client.0.smithi067.stdout:0/338: rmdir d3/d7/d3c/d67/d59 39 2023-12-05T09:26:17.119 INFO:tasks.workunit.client.0.smithi067.stdout:0/339: write d3/d7/f29 [987737,62658] 0 2023-12-05T09:26:17.120 INFO:tasks.workunit.client.0.smithi067.stdout:0/340: write d3/df/d10/f20 [3419917,78343] 0 2023-12-05T09:26:17.120 INFO:tasks.workunit.client.0.smithi067.stdout:0/341: dread - d3/d7/d30/f6a zero size 2023-12-05T09:26:17.123 INFO:tasks.workunit.client.0.smithi067.stdout:0/342: link d3/df/l73 d3/df/l7a 0 2023-12-05T09:26:17.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/438: unlink d2/d27/d71/d80/c9c 0 2023-12-05T09:26:17.128 INFO:tasks.workunit.client.1.smithi134.stdout:1/439: chown d2/d9/d10/d30/l7d 250711 1 2023-12-05T09:26:17.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/348: sync 2023-12-05T09:26:17.129 INFO:tasks.workunit.client.1.smithi134.stdout:0/355: mkdir d13/d14/d59/d78 0 2023-12-05T09:26:17.129 INFO:tasks.workunit.client.0.smithi067.stdout:3/173: dwrite f3 [0,4194304] 0 2023-12-05T09:26:17.130 INFO:tasks.workunit.client.0.smithi067.stdout:3/174: creat d9/da/d15/d17/f3a x:0 0 0 2023-12-05T09:26:17.130 INFO:tasks.workunit.client.0.smithi067.stdout:0/343: creat d3/df/d10/f7b x:0 0 0 2023-12-05T09:26:17.130 INFO:tasks.workunit.client.0.smithi067.stdout:0/344: write d3/d7/d30/f55 [502720,20879] 0 2023-12-05T09:26:17.136 INFO:tasks.workunit.client.1.smithi134.stdout:9/331: dread d7/d8/d14/f59 [0,4194304] 0 2023-12-05T09:26:17.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/440: mkdir d2/d9/d8d/da2 0 2023-12-05T09:26:17.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/441: creat d2/d27/d71/fa3 x:0 0 0 2023-12-05T09:26:17.141 INFO:tasks.workunit.client.0.smithi067.stdout:6/208: dread da/d10/d1e/d17/d2f/f2b [0,4194304] 0 2023-12-05T09:26:17.141 INFO:tasks.workunit.client.0.smithi067.stdout:6/209: truncate f4 4612983 0 2023-12-05T09:26:17.142 INFO:tasks.workunit.client.1.smithi134.stdout:6/349: symlink d4/d2a/d3a/da/d1b/d59/l66 0 2023-12-05T09:26:17.147 INFO:tasks.workunit.client.0.smithi067.stdout:3/175: dread d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:17.150 INFO:tasks.workunit.client.1.smithi134.stdout:0/356: link d13/d14/d30/d4b/c24 d13/d14/d59/c79 0 2023-12-05T09:26:17.152 INFO:tasks.workunit.client.1.smithi134.stdout:8/433: dwrite da/de/d16/d33/f87 [0,4194304] 0 2023-12-05T09:26:17.152 INFO:tasks.workunit.client.1.smithi134.stdout:8/434: chown da/de/f54 239 1 2023-12-05T09:26:17.152 INFO:tasks.workunit.client.1.smithi134.stdout:8/435: write da/de/d8a/f1e [2439779,62246] 0 2023-12-05T09:26:17.152 INFO:tasks.workunit.client.1.smithi134.stdout:9/332: mknod d7/d8/c70 0 2023-12-05T09:26:17.152 INFO:tasks.workunit.client.1.smithi134.stdout:9/333: chown d7/d8/c28 194963 1 2023-12-05T09:26:17.152 INFO:tasks.workunit.client.1.smithi134.stdout:9/334: truncate d7/d10/d4b/f57 880163 0 2023-12-05T09:26:17.152 INFO:tasks.workunit.client.0.smithi067.stdout:6/210: mkdir da/d10/d1e/d17/d2f/d1f/d27/d45 0 2023-12-05T09:26:17.153 INFO:tasks.workunit.client.0.smithi067.stdout:6/211: dread - da/d10/d1e/d17/d2f/d2c/d34/f3e zero size 2023-12-05T09:26:17.153 INFO:tasks.workunit.client.0.smithi067.stdout:3/176: mkdir d9/da/d3b 0 2023-12-05T09:26:17.155 INFO:tasks.workunit.client.1.smithi134.stdout:1/442: truncate d2/d9/d10/f5a 3883958 0 2023-12-05T09:26:17.155 INFO:tasks.workunit.client.0.smithi067.stdout:5/237: dwrite db/df/d36/f4f [0,4194304] 0 2023-12-05T09:26:17.157 INFO:tasks.workunit.client.0.smithi067.stdout:6/212: link da/l37 da/d10/d1e/l46 0 2023-12-05T09:26:17.159 INFO:tasks.workunit.client.1.smithi134.stdout:6/350: link d4/c50 d4/d2a/d3a/da/d1b/d59/c67 0 2023-12-05T09:26:17.163 INFO:tasks.workunit.client.0.smithi067.stdout:3/177: symlink d9/da/d3b/l3c 0 2023-12-05T09:26:17.166 INFO:tasks.workunit.client.1.smithi134.stdout:0/357: creat d13/d14/d15/d67/f7a x:0 0 0 2023-12-05T09:26:17.170 INFO:tasks.workunit.client.0.smithi067.stdout:6/213: rename da/d10/d1e/d17/d2f/d12 to da/d10/d1e/d17/d2f/d47 0 2023-12-05T09:26:17.170 INFO:tasks.workunit.client.0.smithi067.stdout:6/214: chown da/d10/d1e/d17/d2f/d47/d19/c2a 970914 1 2023-12-05T09:26:17.175 INFO:tasks.workunit.client.0.smithi067.stdout:6/215: symlink da/d10/d1e/d17/d2f/d2c/d34/l48 0 2023-12-05T09:26:17.175 INFO:tasks.workunit.client.0.smithi067.stdout:5/238: dread db/df/d3f/f4a [0,4194304] 0 2023-12-05T09:26:17.176 INFO:tasks.workunit.client.1.smithi134.stdout:8/436: symlink da/de/d11/d8b/l94 0 2023-12-05T09:26:17.176 INFO:tasks.workunit.client.1.smithi134.stdout:9/335: mknod d7/d8/d14/d26/c71 0 2023-12-05T09:26:17.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/443: dread d2/d27/d40/f51 [0,4194304] 0 2023-12-05T09:26:17.178 INFO:tasks.workunit.client.0.smithi067.stdout:5/239: unlink db/df/d36/f4f 0 2023-12-05T09:26:17.181 INFO:tasks.workunit.client.1.smithi134.stdout:9/336: write d7/d8/d14/f25 [4332839,47367] 0 2023-12-05T09:26:17.181 INFO:tasks.workunit.client.1.smithi134.stdout:9/337: write d7/d8/f50 [425672,88106] 0 2023-12-05T09:26:17.181 INFO:tasks.workunit.client.1.smithi134.stdout:0/358: symlink d13/d14/d30/d4b/d66/l7b 0 2023-12-05T09:26:17.185 INFO:tasks.workunit.client.1.smithi134.stdout:1/444: truncate d2/d9/d10/d30/f37 400579 0 2023-12-05T09:26:17.189 INFO:tasks.workunit.client.1.smithi134.stdout:9/338: mknod d7/c72 0 2023-12-05T09:26:17.189 INFO:tasks.workunit.client.1.smithi134.stdout:9/339: chown d7/d8/l67 1412318 1 2023-12-05T09:26:17.189 INFO:tasks.workunit.client.1.smithi134.stdout:1/445: truncate d2/d9/d10/f3f 702643 0 2023-12-05T09:26:17.189 INFO:tasks.workunit.client.1.smithi134.stdout:1/446: fdatasync d2/d27/f3a 0 2023-12-05T09:26:17.189 INFO:tasks.workunit.client.1.smithi134.stdout:1/447: fsync d2/d9/d10/d30/d4a/f70 0 2023-12-05T09:26:17.192 INFO:tasks.workunit.client.1.smithi134.stdout:1/448: unlink d2/d9/c18 0 2023-12-05T09:26:17.192 INFO:tasks.workunit.client.1.smithi134.stdout:1/449: fsync d2/d9/f44 0 2023-12-05T09:26:17.192 INFO:tasks.workunit.client.1.smithi134.stdout:1/450: write d2/d56/f7f [44399,61005] 0 2023-12-05T09:26:17.192 INFO:tasks.workunit.client.1.smithi134.stdout:1/451: creat d2/d27/fa4 x:0 0 0 2023-12-05T09:26:17.192 INFO:tasks.workunit.client.1.smithi134.stdout:1/452: chown d2/d56/d74/f77 287819 1 2023-12-05T09:26:17.197 INFO:tasks.workunit.client.1.smithi134.stdout:7/359: sync 2023-12-05T09:26:17.197 INFO:tasks.workunit.client.1.smithi134.stdout:3/363: sync 2023-12-05T09:26:17.198 INFO:tasks.workunit.client.0.smithi067.stdout:5/240: dread f9 [0,4194304] 0 2023-12-05T09:26:17.198 INFO:tasks.workunit.client.0.smithi067.stdout:5/241: dread - db/df/d1a/f29 zero size 2023-12-05T09:26:17.198 INFO:tasks.workunit.client.0.smithi067.stdout:5/242: fdatasync db/df/f16 0 2023-12-05T09:26:17.198 INFO:tasks.workunit.client.1.smithi134.stdout:5/310: sync 2023-12-05T09:26:17.200 INFO:tasks.workunit.client.1.smithi134.stdout:3/364: creat d4/d1f/f75 x:0 0 0 2023-12-05T09:26:17.201 INFO:tasks.workunit.client.0.smithi067.stdout:5/243: getdents db/df/d1a/d1d/d20/d46 0 2023-12-05T09:26:17.204 INFO:tasks.workunit.client.1.smithi134.stdout:5/311: creat d0/d1a/d1c/d25/d6a/f6c x:0 0 0 2023-12-05T09:26:17.205 INFO:tasks.workunit.client.1.smithi134.stdout:5/312: mknod d0/d1a/d3a/c6d 0 2023-12-05T09:26:17.205 INFO:tasks.workunit.client.1.smithi134.stdout:5/313: chown d0/d1a/d3a/f49 142 1 2023-12-05T09:26:17.206 INFO:tasks.workunit.client.1.smithi134.stdout:4/378: sync 2023-12-05T09:26:17.207 INFO:tasks.workunit.client.1.smithi134.stdout:5/314: mknod d0/d66/c6e 0 2023-12-05T09:26:17.207 INFO:tasks.workunit.client.1.smithi134.stdout:5/315: stat d0/d1a/d1c/d3f/l4a 0 2023-12-05T09:26:17.207 INFO:tasks.workunit.client.1.smithi134.stdout:5/316: fdatasync d0/dd/f20 0 2023-12-05T09:26:17.208 INFO:tasks.workunit.client.1.smithi134.stdout:4/379: mkdir d16/d21/d48/d80 0 2023-12-05T09:26:17.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/360: dread d2/d7/dc/d2e/d3a/f49 [0,4194304] 0 2023-12-05T09:26:17.210 INFO:tasks.workunit.client.1.smithi134.stdout:5/317: mknod d0/d1a/c6f 0 2023-12-05T09:26:17.210 INFO:tasks.workunit.client.1.smithi134.stdout:2/395: sync 2023-12-05T09:26:17.210 INFO:tasks.workunit.client.1.smithi134.stdout:6/351: write d4/d39/f3e [77477,2294] 0 2023-12-05T09:26:17.213 INFO:tasks.workunit.client.1.smithi134.stdout:9/340: read d7/f1c [6156326,57687] 0 2023-12-05T09:26:17.214 INFO:tasks.workunit.client.1.smithi134.stdout:4/380: mknod d16/d21/d69/c81 0 2023-12-05T09:26:17.215 INFO:tasks.workunit.client.1.smithi134.stdout:9/341: mknod d7/d10/d56/c73 0 2023-12-05T09:26:17.215 INFO:tasks.workunit.client.1.smithi134.stdout:9/342: write d7/d8/d2e/f68 [219933,47818] 0 2023-12-05T09:26:17.216 INFO:tasks.workunit.client.0.smithi067.stdout:3/178: dwrite d9/da/d15/d17/f37 [0,4194304] 0 2023-12-05T09:26:17.217 INFO:tasks.workunit.client.0.smithi067.stdout:0/345: dwrite d3/f1d [0,4194304] 0 2023-12-05T09:26:17.217 INFO:tasks.workunit.client.0.smithi067.stdout:0/346: fdatasync d3/df/f21 0 2023-12-05T09:26:17.219 INFO:tasks.workunit.client.0.smithi067.stdout:5/244: dread f9 [0,4194304] 0 2023-12-05T09:26:17.219 INFO:tasks.workunit.client.0.smithi067.stdout:3/179: mkdir d9/da/d15/d28/d3d 0 2023-12-05T09:26:17.220 INFO:tasks.workunit.client.1.smithi134.stdout:5/318: unlink d0/l13 0 2023-12-05T09:26:17.223 INFO:tasks.workunit.client.0.smithi067.stdout:0/347: link d3/f32 d3/d7/d3c/d66/f7c 0 2023-12-05T09:26:17.223 INFO:tasks.workunit.client.1.smithi134.stdout:3/365: dread d4/d1f/d50/d52/d42/f2a [0,4194304] 0 2023-12-05T09:26:17.223 INFO:tasks.workunit.client.1.smithi134.stdout:3/366: readlink d4/d5/l21 0 2023-12-05T09:26:17.223 INFO:tasks.workunit.client.0.smithi067.stdout:0/348: chown d3/f31 5373771 1 2023-12-05T09:26:17.223 INFO:tasks.workunit.client.0.smithi067.stdout:0/349: chown d3/df 11876223 1 2023-12-05T09:26:17.225 INFO:tasks.workunit.client.1.smithi134.stdout:3/367: mkdir d4/d5/d6f/d76 0 2023-12-05T09:26:17.225 INFO:tasks.workunit.client.1.smithi134.stdout:3/368: fdatasync d4/f1b 0 2023-12-05T09:26:17.225 INFO:tasks.workunit.client.1.smithi134.stdout:3/369: readlink d4/lf 0 2023-12-05T09:26:17.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/370: mknod d4/d5/d6f/c77 0 2023-12-05T09:26:17.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/371: chown d4/d5/d45 950169 1 2023-12-05T09:26:17.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/372: creat d4/d5/d45/f78 x:0 0 0 2023-12-05T09:26:17.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/373: readlink d4/d1f/d50/d52/l49 0 2023-12-05T09:26:17.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/262: sync 2023-12-05T09:26:17.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/263: readlink d2/d3/l41 0 2023-12-05T09:26:17.234 INFO:tasks.workunit.client.0.smithi067.stdout:8/238: sync 2023-12-05T09:26:17.241 INFO:tasks.workunit.client.0.smithi067.stdout:8/239: symlink d5/dc/d1a/d20/d2d/d41/l46 0 2023-12-05T09:26:17.241 INFO:tasks.workunit.client.1.smithi134.stdout:8/437: dread da/de/d11/f19 [4194304,4194304] 0 2023-12-05T09:26:17.242 INFO:tasks.workunit.client.0.smithi067.stdout:8/240: read d5/f28 [420106,81684] 0 2023-12-05T09:26:17.242 INFO:tasks.workunit.client.0.smithi067.stdout:8/241: write d5/dc/d1a/d20/d3e/f42 [490555,18846] 0 2023-12-05T09:26:17.242 INFO:tasks.workunit.client.0.smithi067.stdout:8/242: write d5/f28 [386914,21916] 0 2023-12-05T09:26:17.243 INFO:tasks.workunit.client.1.smithi134.stdout:3/374: write d4/f13 [24136,48232] 0 2023-12-05T09:26:17.244 INFO:tasks.workunit.client.1.smithi134.stdout:6/352: dread d4/d2a/d3a/da/d1b/f21 [4194304,4194304] 0 2023-12-05T09:26:17.248 INFO:tasks.workunit.client.1.smithi134.stdout:9/343: write d7/f1c [325777,67327] 0 2023-12-05T09:26:17.257 INFO:tasks.workunit.client.1.smithi134.stdout:7/361: dread d2/d7/dc/d2e/d3a/f3b [0,4194304] 0 2023-12-05T09:26:17.257 INFO:tasks.workunit.client.1.smithi134.stdout:7/362: dread - d2/d7/d2b/d2d/d67/d73/d26/f58 zero size 2023-12-05T09:26:17.257 INFO:tasks.workunit.client.1.smithi134.stdout:7/363: truncate d2/d7/d2b/d2d/d67/d73/d26/f1c 5037479 0 2023-12-05T09:26:17.272 INFO:tasks.workunit.client.1.smithi134.stdout:5/319: dwrite d0/dd/f14 [0,4194304] 0 2023-12-05T09:26:17.273 INFO:tasks.workunit.client.1.smithi134.stdout:5/320: fsync d0/d11/f62 0 2023-12-05T09:26:17.276 INFO:tasks.workunit.client.1.smithi134.stdout:6/353: dread d4/d2a/d3a/da/d1b/f29 [0,4194304] 0 2023-12-05T09:26:17.277 INFO:tasks.workunit.client.1.smithi134.stdout:5/321: creat d0/d1a/d1c/d25/d4d/f70 x:0 0 0 2023-12-05T09:26:17.282 INFO:tasks.workunit.client.1.smithi134.stdout:6/354: unlink d4/f17 0 2023-12-05T09:26:17.282 INFO:tasks.workunit.client.1.smithi134.stdout:5/322: mkdir d0/d50/d71 0 2023-12-05T09:26:17.283 INFO:tasks.workunit.client.1.smithi134.stdout:1/453: dread d2/d9/d10/f1d [0,4194304] 0 2023-12-05T09:26:17.286 INFO:tasks.workunit.client.1.smithi134.stdout:2/396: dwrite f8 [0,4194304] 0 2023-12-05T09:26:17.286 INFO:tasks.workunit.client.1.smithi134.stdout:3/375: dread d4/fb [0,4194304] 0 2023-12-05T09:26:17.286 INFO:tasks.workunit.client.1.smithi134.stdout:3/376: chown d4/l29 9 1 2023-12-05T09:26:17.287 INFO:tasks.workunit.client.0.smithi067.stdout:6/216: dwrite da/d10/d1e/f36 [0,4194304] 0 2023-12-05T09:26:17.289 INFO:tasks.workunit.client.1.smithi134.stdout:1/454: rename d2/d9/d10/d30/l3b to d2/d27/la5 0 2023-12-05T09:26:17.289 INFO:tasks.workunit.client.1.smithi134.stdout:5/323: mknod d0/c72 0 2023-12-05T09:26:17.289 INFO:tasks.workunit.client.1.smithi134.stdout:1/455: dread - d2/d9/d10/d30/d4a/f9a zero size 2023-12-05T09:26:17.289 INFO:tasks.workunit.client.1.smithi134.stdout:1/456: chown d2/d27/f8a 1 1 2023-12-05T09:26:17.292 INFO:tasks.workunit.client.1.smithi134.stdout:9/344: dread d7/d10/f37 [0,4194304] 0 2023-12-05T09:26:17.292 INFO:tasks.workunit.client.1.smithi134.stdout:9/345: fdatasync d7/d8/f50 0 2023-12-05T09:26:17.292 INFO:tasks.workunit.client.1.smithi134.stdout:9/346: truncate d7/d10/d4b/d53/f63 583232 0 2023-12-05T09:26:17.293 INFO:tasks.workunit.client.1.smithi134.stdout:4/381: dwrite d16/d18/d1a/f32 [0,4194304] 0 2023-12-05T09:26:17.293 INFO:tasks.workunit.client.1.smithi134.stdout:6/355: dread d4/ff [0,4194304] 0 2023-12-05T09:26:17.294 INFO:tasks.workunit.client.1.smithi134.stdout:6/356: stat d4/d2a/d3a/f3c 0 2023-12-05T09:26:17.295 INFO:tasks.workunit.client.1.smithi134.stdout:3/377: getdents d4/d1f/d4e/d6a 0 2023-12-05T09:26:17.295 INFO:tasks.workunit.client.1.smithi134.stdout:3/378: fsync d4/d1f/f25 0 2023-12-05T09:26:17.295 INFO:tasks.workunit.client.1.smithi134.stdout:3/379: write d4/d1f/f28 [785953,51503] 0 2023-12-05T09:26:17.297 INFO:tasks.workunit.client.0.smithi067.stdout:5/245: dwrite f5 [0,4194304] 0 2023-12-05T09:26:17.299 INFO:tasks.workunit.client.1.smithi134.stdout:1/457: rename d2/d9/d10/f1d to d2/d27/d9d/fa6 0 2023-12-05T09:26:17.308 INFO:tasks.workunit.client.1.smithi134.stdout:4/382: creat d16/d21/d69/d6e/f82 x:0 0 0 2023-12-05T09:26:17.311 INFO:tasks.workunit.client.1.smithi134.stdout:9/347: dread d7/d8/d14/f46 [0,4194304] 0 2023-12-05T09:26:17.312 INFO:tasks.workunit.client.1.smithi134.stdout:9/348: write d7/f47 [113611,71417] 0 2023-12-05T09:26:17.313 INFO:tasks.workunit.client.0.smithi067.stdout:5/246: creat db/df/d1a/f58 x:0 0 0 2023-12-05T09:26:17.315 INFO:tasks.workunit.client.1.smithi134.stdout:3/380: truncate f0 1662929 0 2023-12-05T09:26:17.315 INFO:tasks.workunit.client.1.smithi134.stdout:3/381: write f3 [1047951,1599] 0 2023-12-05T09:26:17.315 INFO:tasks.workunit.client.1.smithi134.stdout:3/382: creat d4/d1f/f79 x:0 0 0 2023-12-05T09:26:17.316 INFO:tasks.workunit.client.1.smithi134.stdout:3/383: getdents d4/d5/d6f/d76 0 2023-12-05T09:26:17.316 INFO:tasks.workunit.client.1.smithi134.stdout:3/384: creat d4/d1f/f7a x:0 0 0 2023-12-05T09:26:17.316 INFO:tasks.workunit.client.1.smithi134.stdout:3/385: write d4/d1f/f35 [594492,108404] 0 2023-12-05T09:26:17.316 INFO:tasks.workunit.client.1.smithi134.stdout:9/349: mkdir d7/d8/d16/d52/d74 0 2023-12-05T09:26:17.318 INFO:tasks.workunit.client.0.smithi067.stdout:5/247: truncate db/df/f53 1052078 0 2023-12-05T09:26:17.322 INFO:tasks.workunit.client.0.smithi067.stdout:5/248: unlink db/df/d1a/f29 0 2023-12-05T09:26:17.322 INFO:tasks.workunit.client.0.smithi067.stdout:5/249: chown db/df/d36 2767194 1 2023-12-05T09:26:17.323 INFO:tasks.workunit.client.1.smithi134.stdout:8/438: dwrite da/de/d11/d1d/f2e [0,4194304] 0 2023-12-05T09:26:17.323 INFO:tasks.workunit.client.1.smithi134.stdout:3/386: symlink d4/d1f/l7b 0 2023-12-05T09:26:17.324 INFO:tasks.workunit.client.1.smithi134.stdout:9/350: mknod d7/d8/d14/d26/d5a/c75 0 2023-12-05T09:26:17.324 INFO:tasks.workunit.client.1.smithi134.stdout:9/351: chown f1 13005 1 2023-12-05T09:26:17.326 INFO:tasks.workunit.client.0.smithi067.stdout:5/250: write db/df/d1a/d1d/d20/f2a [1918029,107232] 0 2023-12-05T09:26:17.327 INFO:tasks.workunit.client.1.smithi134.stdout:1/458: dread d2/d9/d10/f53 [0,4194304] 0 2023-12-05T09:26:17.329 INFO:tasks.workunit.client.0.smithi067.stdout:5/251: mkdir db/df/d1a/d59 0 2023-12-05T09:26:17.334 INFO:tasks.workunit.client.1.smithi134.stdout:1/459: rmdir d2/d9/d10/d5b 39 2023-12-05T09:26:17.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/180: dwrite d9/da/f22 [0,4194304] 0 2023-12-05T09:26:17.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/181: truncate d9/f2d 270226 0 2023-12-05T09:26:17.342 INFO:tasks.workunit.client.1.smithi134.stdout:4/383: read d16/d18/f6d [3641786,5369] 0 2023-12-05T09:26:17.342 INFO:tasks.workunit.client.1.smithi134.stdout:4/384: fdatasync f15 0 2023-12-05T09:26:17.342 INFO:tasks.workunit.client.1.smithi134.stdout:4/385: write d16/d18/d1b/f31 [431199,43107] 0 2023-12-05T09:26:17.342 INFO:tasks.workunit.client.1.smithi134.stdout:8/439: write da/de/d16/f24 [2568026,43554] 0 2023-12-05T09:26:17.343 INFO:tasks.workunit.client.1.smithi134.stdout:8/440: truncate da/de/d4d/d68/f84 1016930 0 2023-12-05T09:26:17.343 INFO:tasks.workunit.client.1.smithi134.stdout:8/441: chown da/de/d16/d33/f56 1 1 2023-12-05T09:26:17.345 INFO:tasks.workunit.client.1.smithi134.stdout:8/442: symlink da/de/d4d/l95 0 2023-12-05T09:26:17.345 INFO:tasks.workunit.client.1.smithi134.stdout:8/443: dread - da/de/f75 zero size 2023-12-05T09:26:17.351 INFO:tasks.workunit.client.1.smithi134.stdout:2/397: dwrite f15 [0,4194304] 0 2023-12-05T09:26:17.358 INFO:tasks.workunit.client.0.smithi067.stdout:1/264: dwrite d2/d5/d7/de/d1a/f44 [0,4194304] 0 2023-12-05T09:26:17.358 INFO:tasks.workunit.client.0.smithi067.stdout:1/265: readlink d2/d4f/d15/l52 0 2023-12-05T09:26:17.359 INFO:tasks.workunit.client.0.smithi067.stdout:1/266: fdatasync d2/f39 0 2023-12-05T09:26:17.363 INFO:tasks.workunit.client.1.smithi134.stdout:8/444: dread da/f2a [0,4194304] 0 2023-12-05T09:26:17.365 INFO:tasks.workunit.client.0.smithi067.stdout:0/350: dwrite d3/f58 [0,4194304] 0 2023-12-05T09:26:17.365 INFO:tasks.workunit.client.1.smithi134.stdout:4/386: write d16/d18/d1a/d3b/f5c [2720289,126893] 0 2023-12-05T09:26:17.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/357: dwrite d4/d2a/d3a/f3d [0,4194304] 0 2023-12-05T09:26:17.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/358: readlink d4/d2a/d3a/l22 0 2023-12-05T09:26:17.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/359: chown d4/d2a/d3a/l1e 14026 1 2023-12-05T09:26:17.373 INFO:tasks.workunit.client.0.smithi067.stdout:3/182: dread d9/fb [0,4194304] 0 2023-12-05T09:26:17.378 INFO:tasks.workunit.client.1.smithi134.stdout:1/460: dwrite d2/d9/d10/d30/d4a/f70 [0,4194304] 0 2023-12-05T09:26:17.385 INFO:tasks.workunit.client.0.smithi067.stdout:0/351: dread d3/d7/d3c/d67/d59/f41 [0,4194304] 0 2023-12-05T09:26:17.389 INFO:tasks.workunit.client.0.smithi067.stdout:6/217: dwrite da/d10/d1e/f36 [0,4194304] 0 2023-12-05T09:26:17.395 INFO:tasks.workunit.client.1.smithi134.stdout:1/461: dread d2/d27/f59 [0,4194304] 0 2023-12-05T09:26:17.410 INFO:tasks.workunit.client.0.smithi067.stdout:8/243: dwrite d5/dc/d1a/d20/d3e/f42 [0,4194304] 0 2023-12-05T09:26:17.410 INFO:tasks.workunit.client.1.smithi134.stdout:6/360: dwrite d4/d32/d57/f5d [0,4194304] 0 2023-12-05T09:26:17.417 INFO:tasks.workunit.client.1.smithi134.stdout:6/361: dread d4/d2a/d3a/da/d1b/f29 [0,4194304] 0 2023-12-05T09:26:17.417 INFO:tasks.workunit.client.1.smithi134.stdout:6/362: fdatasync d4/d39/d42/f65 0 2023-12-05T09:26:17.418 INFO:tasks.workunit.client.0.smithi067.stdout:0/352: dwrite d3/df/d10/f37 [4194304,4194304] 0 2023-12-05T09:26:17.476 INFO:tasks.workunit.client.1.smithi134.stdout:3/387: getdents d4/d1f 0 2023-12-05T09:26:17.479 INFO:tasks.workunit.client.1.smithi134.stdout:8/445: mkdir da/de/d96 0 2023-12-05T09:26:17.481 INFO:tasks.workunit.client.1.smithi134.stdout:0/359: sync 2023-12-05T09:26:17.483 INFO:tasks.workunit.client.1.smithi134.stdout:4/387: creat d16/d21/d69/f83 x:0 0 0 2023-12-05T09:26:17.483 INFO:tasks.workunit.client.1.smithi134.stdout:4/388: write d16/d21/f7c [333496,70216] 0 2023-12-05T09:26:17.490 INFO:tasks.workunit.client.0.smithi067.stdout:1/267: creat d2/d4f/d54/f58 x:0 0 0 2023-12-05T09:26:17.490 INFO:tasks.workunit.client.0.smithi067.stdout:3/183: rename d9/d24/f26 to d9/da/d15/d17/d2b/f3e 0 2023-12-05T09:26:17.495 INFO:tasks.workunit.client.1.smithi134.stdout:0/360: write d13/f38 [1165645,74616] 0 2023-12-05T09:26:17.501 INFO:tasks.workunit.client.1.smithi134.stdout:8/446: dread da/de/d11/f1a [0,4194304] 0 2023-12-05T09:26:17.505 INFO:tasks.workunit.client.0.smithi067.stdout:6/218: symlink da/d10/d1e/d17/d2f/d47/d19/l49 0 2023-12-05T09:26:17.508 INFO:tasks.workunit.client.1.smithi134.stdout:7/364: sync 2023-12-05T09:26:17.512 INFO:tasks.workunit.client.0.smithi067.stdout:8/244: symlink d5/dc/d1a/d20/d2d/d41/l47 0 2023-12-05T09:26:17.514 INFO:tasks.workunit.client.1.smithi134.stdout:9/352: sync 2023-12-05T09:26:17.514 INFO:tasks.workunit.client.1.smithi134.stdout:2/398: sync 2023-12-05T09:26:17.514 INFO:tasks.workunit.client.1.smithi134.stdout:5/324: sync 2023-12-05T09:26:17.514 INFO:tasks.workunit.client.1.smithi134.stdout:9/353: fdatasync d7/d8/f50 0 2023-12-05T09:26:17.514 INFO:tasks.workunit.client.1.smithi134.stdout:2/399: dread - d19/d28/d63/d70/f74 zero size 2023-12-05T09:26:17.514 INFO:tasks.workunit.client.1.smithi134.stdout:2/400: creat d19/d28/d2b/f80 x:0 0 0 2023-12-05T09:26:17.515 INFO:tasks.workunit.client.0.smithi067.stdout:0/353: symlink d3/d7/d3c/d67/d59/d5c/d68/l7d 0 2023-12-05T09:26:17.515 INFO:tasks.workunit.client.1.smithi134.stdout:2/401: read d19/f69 [22713,16996] 0 2023-12-05T09:26:17.517 INFO:tasks.workunit.client.1.smithi134.stdout:6/363: rename d4/d39/f31 to d4/d39/d42/d4f/f68 0 2023-12-05T09:26:17.517 INFO:tasks.workunit.client.1.smithi134.stdout:6/364: chown d4/f26 0 1 2023-12-05T09:26:17.518 INFO:tasks.workunit.client.0.smithi067.stdout:2/204: sync 2023-12-05T09:26:17.524 INFO:tasks.workunit.client.1.smithi134.stdout:3/388: mkdir d4/d5/d7c 0 2023-12-05T09:26:17.528 INFO:tasks.workunit.client.0.smithi067.stdout:8/245: dread d5/dc/f19 [0,4194304] 0 2023-12-05T09:26:17.528 INFO:tasks.workunit.client.0.smithi067.stdout:3/184: rmdir d9/da/d15/d28 39 2023-12-05T09:26:17.528 INFO:tasks.workunit.client.0.smithi067.stdout:3/185: chown d9/da/d15/d28 15500 1 2023-12-05T09:26:17.528 INFO:tasks.workunit.client.1.smithi134.stdout:1/462: getdents d2/d27/d71/d80 0 2023-12-05T09:26:17.528 INFO:tasks.workunit.client.1.smithi134.stdout:1/463: dread - d2/d27/fa4 zero size 2023-12-05T09:26:17.529 INFO:tasks.workunit.client.0.smithi067.stdout:0/354: unlink d3/d7/f2c 0 2023-12-05T09:26:17.534 INFO:tasks.workunit.client.0.smithi067.stdout:2/205: mkdir d0/d25/d34/d4a 0 2023-12-05T09:26:17.534 INFO:tasks.workunit.client.0.smithi067.stdout:2/206: chown d0/d10/c13 15 1 2023-12-05T09:26:17.537 INFO:tasks.workunit.client.0.smithi067.stdout:1/268: dwrite d2/d4f/d54/f58 [0,4194304] 0 2023-12-05T09:26:17.537 INFO:tasks.workunit.client.0.smithi067.stdout:3/186: mknod d9/da/d15/d28/d3d/c3f 0 2023-12-05T09:26:17.539 INFO:tasks.workunit.client.1.smithi134.stdout:8/447: rmdir da/de/d16/d45 39 2023-12-05T09:26:17.542 INFO:tasks.workunit.client.1.smithi134.stdout:7/365: symlink d2/d7/dc/d22/l76 0 2023-12-05T09:26:17.543 INFO:tasks.workunit.client.0.smithi067.stdout:2/207: dread d0/d10/d1e/f35 [0,4194304] 0 2023-12-05T09:26:17.547 INFO:tasks.workunit.client.1.smithi134.stdout:5/325: stat d0/dd/c52 0 2023-12-05T09:26:17.547 INFO:tasks.workunit.client.1.smithi134.stdout:5/326: stat d0/d1a/d1c/d25/d6a/f6c 0 2023-12-05T09:26:17.547 INFO:tasks.workunit.client.1.smithi134.stdout:9/354: truncate d7/d8/d2e/f42 2586843 0 2023-12-05T09:26:17.552 INFO:tasks.workunit.client.0.smithi067.stdout:1/269: creat d2/d4f/d14/d48/f59 x:0 0 0 2023-12-05T09:26:17.556 INFO:tasks.workunit.client.0.smithi067.stdout:3/187: rename d9/da/d15/d17/f37 to d9/da/d3b/f40 0 2023-12-05T09:26:17.556 INFO:tasks.workunit.client.0.smithi067.stdout:3/188: fdatasync d9/da/d15/d17/f32 0 2023-12-05T09:26:17.557 INFO:tasks.workunit.client.1.smithi134.stdout:2/402: write f12 [2261365,18572] 0 2023-12-05T09:26:17.560 INFO:tasks.workunit.client.0.smithi067.stdout:2/208: mknod d0/d10/d1e/d42/c4b 0 2023-12-05T09:26:17.561 INFO:tasks.workunit.client.1.smithi134.stdout:4/389: rename d16/d18/d5b/l64 to d16/d21/l84 0 2023-12-05T09:26:17.564 INFO:tasks.workunit.client.1.smithi134.stdout:8/448: symlink da/de/d16/d33/l97 0 2023-12-05T09:26:17.564 INFO:tasks.workunit.client.0.smithi067.stdout:3/189: truncate d9/fb 1700047 0 2023-12-05T09:26:17.569 INFO:tasks.workunit.client.1.smithi134.stdout:9/355: link d7/d8/f6a d7/d8/d2e/f76 0 2023-12-05T09:26:17.574 INFO:tasks.workunit.client.1.smithi134.stdout:1/464: dread d2/d9/f57 [0,4194304] 0 2023-12-05T09:26:17.574 INFO:tasks.workunit.client.1.smithi134.stdout:1/465: chown d2/d9/d10/d30/d4a/d81 6058506 1 2023-12-05T09:26:17.574 INFO:tasks.workunit.client.1.smithi134.stdout:8/449: dread da/de/f66 [0,4194304] 0 2023-12-05T09:26:17.574 INFO:tasks.workunit.client.1.smithi134.stdout:8/450: write da/de/d16/f26 [5094722,74520] 0 2023-12-05T09:26:17.575 INFO:tasks.workunit.client.0.smithi067.stdout:2/209: symlink d0/d2f/l4c 0 2023-12-05T09:26:17.578 INFO:tasks.workunit.client.0.smithi067.stdout:3/190: creat d9/da/d15/d28/f41 x:0 0 0 2023-12-05T09:26:17.581 INFO:tasks.workunit.client.0.smithi067.stdout:6/219: dwrite da/d10/d1e/d17/f29 [4194304,4194304] 0 2023-12-05T09:26:17.584 INFO:tasks.workunit.client.1.smithi134.stdout:3/389: dwrite d4/d1f/d4e/f65 [0,4194304] 0 2023-12-05T09:26:17.584 INFO:tasks.workunit.client.1.smithi134.stdout:3/390: write d4/d5/d45/d60/f72 [1270100,72340] 0 2023-12-05T09:26:17.585 INFO:tasks.workunit.client.0.smithi067.stdout:0/355: write d3/d7/d3c/d67/d59/f41 [1767319,88227] 0 2023-12-05T09:26:17.592 INFO:tasks.workunit.client.1.smithi134.stdout:6/365: dwrite d4/f46 [8388608,4194304] 0 2023-12-05T09:26:17.593 INFO:tasks.workunit.client.1.smithi134.stdout:2/403: rename d19/d28/d31/f3e to d19/d28/f81 0 2023-12-05T09:26:17.594 INFO:tasks.workunit.client.1.smithi134.stdout:8/451: mkdir da/de/d16/d98 0 2023-12-05T09:26:17.596 INFO:tasks.workunit.client.0.smithi067.stdout:6/220: rename da/d10/d1e/d17/d2f/d1f/l43 to da/l4a 0 2023-12-05T09:26:17.610 INFO:tasks.workunit.client.1.smithi134.stdout:3/391: read d4/d1f/f28 [327471,27980] 0 2023-12-05T09:26:17.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/404: link f16 d19/d28/d2b/f82 0 2023-12-05T09:26:17.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/405: truncate d19/d76/f7b 837257 0 2023-12-05T09:26:17.616 INFO:tasks.workunit.client.0.smithi067.stdout:0/356: mknod d3/d7/d3c/d6c/c7e 0 2023-12-05T09:26:17.617 INFO:tasks.workunit.client.1.smithi134.stdout:2/406: unlink d19/c55 0 2023-12-05T09:26:17.620 INFO:tasks.workunit.client.1.smithi134.stdout:5/327: dwrite d0/d1a/d1c/d25/f56 [0,4194304] 0 2023-12-05T09:26:17.621 INFO:tasks.workunit.client.1.smithi134.stdout:4/390: dwrite d16/d18/d1c/f3a [4194304,4194304] 0 2023-12-05T09:26:17.621 INFO:tasks.workunit.client.1.smithi134.stdout:4/391: chown d16/d18/d1a/f79 2 1 2023-12-05T09:26:17.629 INFO:tasks.workunit.client.1.smithi134.stdout:5/328: mkdir d0/d1a/d1c/d25/d4d/d60/d73 0 2023-12-05T09:26:17.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/366: dwrite d2/d7/d2b/d2d/d67/d73/d26/f35 [0,4194304] 0 2023-12-05T09:26:17.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/392: creat d16/d21/d48/d80/f85 x:0 0 0 2023-12-05T09:26:17.639 INFO:tasks.workunit.client.0.smithi067.stdout:1/270: dwrite d2/d5/f4e [0,4194304] 0 2023-12-05T09:26:17.639 INFO:tasks.workunit.client.1.smithi134.stdout:2/407: write f15 [1920135,34841] 0 2023-12-05T09:26:17.647 INFO:tasks.workunit.client.0.smithi067.stdout:8/246: dwrite d5/da/f33 [0,4194304] 0 2023-12-05T09:26:17.655 INFO:tasks.workunit.client.1.smithi134.stdout:4/393: unlink d16/d18/d1b/d24/l3c 0 2023-12-05T09:26:17.660 INFO:tasks.workunit.client.1.smithi134.stdout:1/466: dwrite d2/d27/d40/f89 [0,4194304] 0 2023-12-05T09:26:17.663 INFO:tasks.workunit.client.1.smithi134.stdout:4/394: symlink d16/d21/d47/d4b/l86 0 2023-12-05T09:26:17.663 INFO:tasks.workunit.client.1.smithi134.stdout:4/395: fdatasync d16/d21/d48/f34 0 2023-12-05T09:26:17.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/357: dwrite d3/d6b/d6e/f72 [0,4194304] 0 2023-12-05T09:26:17.676 INFO:tasks.workunit.client.0.smithi067.stdout:0/358: chown d3/d7/d30/l45 1414463 1 2023-12-05T09:26:17.676 INFO:tasks.workunit.client.1.smithi134.stdout:1/467: rename d2/d9/d10/d94/ca0 to d2/d9/d8d/da2/ca7 0 2023-12-05T09:26:17.679 INFO:tasks.workunit.client.0.smithi067.stdout:8/247: dread d5/dc/d1a/d20/d3e/f42 [0,4194304] 0 2023-12-05T09:26:17.680 INFO:tasks.workunit.client.1.smithi134.stdout:4/396: creat d16/d7b/d6f/f87 x:0 0 0 2023-12-05T09:26:17.680 INFO:tasks.workunit.client.1.smithi134.stdout:4/397: write d16/d18/d1c/d63/f73 [788634,48415] 0 2023-12-05T09:26:17.680 INFO:tasks.workunit.client.1.smithi134.stdout:4/398: truncate d16/d21/d47/f67 361565 0 2023-12-05T09:26:17.682 INFO:tasks.workunit.client.0.smithi067.stdout:3/191: dwrite d9/da/d15/d17/d1a/f35 [0,4194304] 0 2023-12-05T09:26:17.682 INFO:tasks.workunit.client.0.smithi067.stdout:3/192: dread - d9/d24/f33 zero size 2023-12-05T09:26:17.682 INFO:tasks.workunit.client.0.smithi067.stdout:3/193: fdatasync d9/fb 0 2023-12-05T09:26:17.683 INFO:tasks.workunit.client.1.smithi134.stdout:0/361: sync 2023-12-05T09:26:17.690 INFO:tasks.workunit.client.1.smithi134.stdout:5/329: dwrite d0/d1a/d1c/d25/f56 [0,4194304] 0 2023-12-05T09:26:17.690 INFO:tasks.workunit.client.1.smithi134.stdout:8/452: dread da/de/d11/d1d/d70/f82 [0,4194304] 0 2023-12-05T09:26:17.694 INFO:tasks.workunit.client.1.smithi134.stdout:1/468: rename d2/d27/f3d to d2/d9/d10/d5b/d5e/fa8 0 2023-12-05T09:26:17.697 INFO:tasks.workunit.client.0.smithi067.stdout:2/210: dwrite d0/d25/d3a/f43 [0,4194304] 0 2023-12-05T09:26:17.697 INFO:tasks.workunit.client.0.smithi067.stdout:2/211: truncate d0/d2f/d39/f40 714906 0 2023-12-05T09:26:17.697 INFO:tasks.workunit.client.0.smithi067.stdout:2/212: chown d0/d25 882 1 2023-12-05T09:26:17.697 INFO:tasks.workunit.client.0.smithi067.stdout:2/213: write d0/d10/f1d [5340796,21435] 0 2023-12-05T09:26:17.698 INFO:tasks.workunit.client.1.smithi134.stdout:4/399: creat d16/d21/d48/f88 x:0 0 0 2023-12-05T09:26:17.709 INFO:tasks.workunit.client.1.smithi134.stdout:5/330: creat d0/d1a/d3a/f74 x:0 0 0 2023-12-05T09:26:17.709 INFO:tasks.workunit.client.1.smithi134.stdout:5/331: chown d0/d11/f22 16011 1 2023-12-05T09:26:17.709 INFO:tasks.workunit.client.1.smithi134.stdout:7/367: write d2/df/d2a/d36/f5c [2982419,92141] 0 2023-12-05T09:26:17.712 INFO:tasks.workunit.client.1.smithi134.stdout:8/453: mkdir da/de/d8a/d42/d99 0 2023-12-05T09:26:17.712 INFO:tasks.workunit.client.1.smithi134.stdout:8/454: truncate da/de/d16/d2d/f7b 992425 0 2023-12-05T09:26:17.716 INFO:tasks.workunit.client.0.smithi067.stdout:6/221: dwrite da/d10/f11 [0,4194304] 0 2023-12-05T09:26:17.716 INFO:tasks.workunit.client.0.smithi067.stdout:6/222: chown da/d10/d1e/d17/d2f/l13 65 1 2023-12-05T09:26:17.716 INFO:tasks.workunit.client.0.smithi067.stdout:6/223: readlink da/l37 0 2023-12-05T09:26:17.717 INFO:tasks.workunit.client.0.smithi067.stdout:3/194: symlink d9/da/l42 0 2023-12-05T09:26:17.718 INFO:tasks.workunit.client.1.smithi134.stdout:4/400: mknod d16/d18/d5b/c89 0 2023-12-05T09:26:17.718 INFO:tasks.workunit.client.1.smithi134.stdout:4/401: truncate d16/d18/d1b/f7d 792185 0 2023-12-05T09:26:17.718 INFO:tasks.workunit.client.1.smithi134.stdout:4/402: readlink d16/d18/d5b/l75 0 2023-12-05T09:26:17.719 INFO:tasks.workunit.client.1.smithi134.stdout:0/362: rmdir d13/d14/d30/d2c 39 2023-12-05T09:26:17.722 INFO:tasks.workunit.client.1.smithi134.stdout:5/332: mkdir d0/d11/d61/d75 0 2023-12-05T09:26:17.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/359: symlink d3/d7/d3c/l7f 0 2023-12-05T09:26:17.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/360: readlink d3/df/l60 0 2023-12-05T09:26:17.724 INFO:tasks.workunit.client.0.smithi067.stdout:0/361: dread - d3/df/f52 zero size 2023-12-05T09:26:17.725 INFO:tasks.workunit.client.1.smithi134.stdout:9/356: dwrite d7/d8/d2e/f31 [0,4194304] 0 2023-12-05T09:26:17.725 INFO:tasks.workunit.client.1.smithi134.stdout:9/357: truncate d7/d8/d2e/f68 1192179 0 2023-12-05T09:26:17.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/368: creat d2/df/d2a/d63/f77 x:0 0 0 2023-12-05T09:26:17.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/369: read - d2/df/f68 zero size 2023-12-05T09:26:17.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/370: dread - d2/df/d2a/d36/f5d zero size 2023-12-05T09:26:17.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/371: creat d2/d7/dc/f78 x:0 0 0 2023-12-05T09:26:17.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/372: creat d2/df/f79 x:0 0 0 2023-12-05T09:26:17.728 INFO:tasks.workunit.client.0.smithi067.stdout:6/224: creat da/d10/d1e/f4b x:0 0 0 2023-12-05T09:26:17.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/469: rename d2/d56 to d2/d9/d10/d30/d66/da9 0 2023-12-05T09:26:17.731 INFO:tasks.workunit.client.1.smithi134.stdout:1/470: write d2/d9/d10/d5b/d5e/f6d [396575,44030] 0 2023-12-05T09:26:17.733 INFO:tasks.workunit.client.0.smithi067.stdout:3/195: link d9/da/f22 d9/f43 0 2023-12-05T09:26:17.735 INFO:tasks.workunit.client.0.smithi067.stdout:0/362: write d3/d7/d3c/d67/f5b [3200740,34725] 0 2023-12-05T09:26:17.735 INFO:tasks.workunit.client.1.smithi134.stdout:0/363: link d13/d14/d15/d2a/l6d d13/d14/d30/d4b/d23/d77/l7c 0 2023-12-05T09:26:17.736 INFO:tasks.workunit.client.1.smithi134.stdout:9/358: mknod d7/d5b/d5e/c77 0 2023-12-05T09:26:17.736 INFO:tasks.workunit.client.1.smithi134.stdout:2/408: dwrite d19/d28/d63/d70/f7d [0,4194304] 0 2023-12-05T09:26:17.737 INFO:tasks.workunit.client.0.smithi067.stdout:6/225: getdents da/d10/d1e/d17/d2f/d2c 0 2023-12-05T09:26:17.743 INFO:tasks.workunit.client.0.smithi067.stdout:3/196: symlink d9/da/d15/d28/l44 0 2023-12-05T09:26:17.747 INFO:tasks.workunit.client.1.smithi134.stdout:3/392: dwrite d4/d1f/f25 [0,4194304] 0 2023-12-05T09:26:17.748 INFO:tasks.workunit.client.1.smithi134.stdout:3/393: stat d4/d5/d6f/f5e 0 2023-12-05T09:26:17.748 INFO:tasks.workunit.client.1.smithi134.stdout:5/333: dread d0/d45/f57 [0,4194304] 0 2023-12-05T09:26:17.749 INFO:tasks.workunit.client.0.smithi067.stdout:2/214: dread d0/d10/d1e/f2d [0,4194304] 0 2023-12-05T09:26:17.749 INFO:tasks.workunit.client.0.smithi067.stdout:2/215: dread - d0/d10/d1e/f3e zero size 2023-12-05T09:26:17.752 INFO:tasks.workunit.client.1.smithi134.stdout:3/394: read d4/d1f/d4e/f61 [258419,90272] 0 2023-12-05T09:26:17.752 INFO:tasks.workunit.client.1.smithi134.stdout:3/395: dread - d4/f1d zero size 2023-12-05T09:26:17.752 INFO:tasks.workunit.client.1.smithi134.stdout:3/396: write d4/d1f/f7a [500461,65673] 0 2023-12-05T09:26:17.752 INFO:tasks.workunit.client.1.smithi134.stdout:3/397: stat d4/d5/d6f/f68 0 2023-12-05T09:26:17.754 INFO:tasks.workunit.client.1.smithi134.stdout:1/471: rename d2/c14 to d2/d9/d10/d30/d4a/caa 0 2023-12-05T09:26:17.754 INFO:tasks.workunit.client.1.smithi134.stdout:1/472: read d2/d9/f24 [2801,60011] 0 2023-12-05T09:26:17.754 INFO:tasks.workunit.client.1.smithi134.stdout:1/473: fsync d2/d27/d71/f79 0 2023-12-05T09:26:17.755 INFO:tasks.workunit.client.0.smithi067.stdout:0/363: write d3/f3d [31833,125990] 0 2023-12-05T09:26:17.755 INFO:tasks.workunit.client.0.smithi067.stdout:0/364: write d3/d7/d3c/d67/d59/d5c/d68/f79 [769908,1633] 0 2023-12-05T09:26:17.757 INFO:tasks.workunit.client.0.smithi067.stdout:1/271: dwrite d2/d4f/d14/d48/f4d [0,4194304] 0 2023-12-05T09:26:17.762 INFO:tasks.workunit.client.0.smithi067.stdout:6/226: creat da/d10/d1e/d17/d2f/d47/f4c x:0 0 0 2023-12-05T09:26:17.763 INFO:tasks.workunit.client.1.smithi134.stdout:4/403: read d16/f7a [1199192,89680] 0 2023-12-05T09:26:17.763 INFO:tasks.workunit.client.1.smithi134.stdout:4/404: creat d16/d18/d5b/f8a x:0 0 0 2023-12-05T09:26:17.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/223: sync 2023-12-05T09:26:17.765 INFO:tasks.workunit.client.0.smithi067.stdout:4/224: stat d0/d9/d12/d15/f20 0 2023-12-05T09:26:17.785 INFO:tasks.workunit.client.1.smithi134.stdout:0/364: mkdir d13/d14/d59/d7d 0 2023-12-05T09:26:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:8/248: dwrite d5/f36 [0,4194304] 0 2023-12-05T09:26:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:8/249: fdatasync d5/f45 0 2023-12-05T09:26:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:8/250: stat d5/dc/l1b 0 2023-12-05T09:26:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:8/251: truncate d5/da/f1f 1323999 0 2023-12-05T09:26:17.786 INFO:tasks.workunit.client.0.smithi067.stdout:8/252: chown d5/dc/d1a/d20/d2d 4701257 1 2023-12-05T09:26:17.791 INFO:tasks.workunit.client.1.smithi134.stdout:2/409: mknod d19/d3f/c83 0 2023-12-05T09:26:17.791 INFO:tasks.workunit.client.1.smithi134.stdout:2/410: chown d19/c4f 1 1 2023-12-05T09:26:17.791 INFO:tasks.workunit.client.1.smithi134.stdout:2/411: chown d19/d28/d2b/f57 14 1 2023-12-05T09:26:17.791 INFO:tasks.workunit.client.0.smithi067.stdout:3/197: dwrite d9/d24/f34 [0,4194304] 0 2023-12-05T09:26:17.791 INFO:tasks.workunit.client.0.smithi067.stdout:3/198: chown d9/f27 146 1 2023-12-05T09:26:17.793 INFO:tasks.workunit.client.1.smithi134.stdout:7/373: dwrite d2/dd/d1a/f23 [0,4194304] 0 2023-12-05T09:26:17.794 INFO:tasks.workunit.client.1.smithi134.stdout:7/374: creat d2/d7/dc/d2e/d3a/f7a x:0 0 0 2023-12-05T09:26:17.801 INFO:tasks.workunit.client.0.smithi067.stdout:2/216: mkdir d0/d25/d34/d4d 0 2023-12-05T09:26:17.805 INFO:tasks.workunit.client.1.smithi134.stdout:2/412: write d19/d28/d31/d38/f59 [531015,5918] 0 2023-12-05T09:26:17.805 INFO:tasks.workunit.client.1.smithi134.stdout:2/413: fsync d19/f25 0 2023-12-05T09:26:17.817 INFO:tasks.workunit.client.0.smithi067.stdout:6/227: dwrite da/d10/d1e/d17/f23 [0,4194304] 0 2023-12-05T09:26:17.817 INFO:tasks.workunit.client.0.smithi067.stdout:6/228: creat da/d10/d1e/d17/d2f/d47/f4d x:0 0 0 2023-12-05T09:26:17.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/253: mknod d5/dc/d1a/d20/d3e/c48 0 2023-12-05T09:26:17.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/254: chown d5/f36 3811 1 2023-12-05T09:26:17.826 INFO:tasks.workunit.client.1.smithi134.stdout:4/405: dwrite d16/d21/d69/f83 [0,4194304] 0 2023-12-05T09:26:17.826 INFO:tasks.workunit.client.1.smithi134.stdout:4/406: chown d16/d18/d1c/l1f 52 1 2023-12-05T09:26:17.828 INFO:tasks.workunit.client.0.smithi067.stdout:9/419: sync 2023-12-05T09:26:17.828 INFO:tasks.workunit.client.0.smithi067.stdout:7/290: sync 2023-12-05T09:26:17.828 INFO:tasks.workunit.client.0.smithi067.stdout:5/252: sync 2023-12-05T09:26:17.831 INFO:tasks.workunit.client.0.smithi067.stdout:3/199: link d9/da/d15/d28/d29/c2f d9/da/d15/d28/d31/c45 0 2023-12-05T09:26:17.835 INFO:tasks.workunit.client.0.smithi067.stdout:0/365: symlink d3/d7/d3c/d66/l80 0 2023-12-05T09:26:17.838 INFO:tasks.workunit.client.1.smithi134.stdout:5/334: stat d0/l12 0 2023-12-05T09:26:17.844 INFO:tasks.workunit.client.0.smithi067.stdout:6/229: mknod da/d10/d1e/d17/d2f/d2c/d34/d3b/c4e 0 2023-12-05T09:26:17.844 INFO:tasks.workunit.client.1.smithi134.stdout:3/398: mknod d4/d5/d6f/c7d 0 2023-12-05T09:26:17.845 INFO:tasks.workunit.client.1.smithi134.stdout:3/399: chown d4/f1b 1809688 1 2023-12-05T09:26:17.845 INFO:tasks.workunit.client.1.smithi134.stdout:3/400: write f3 [2396570,28333] 0 2023-12-05T09:26:17.846 INFO:tasks.workunit.client.1.smithi134.stdout:9/359: rename d7/d8/d14/d26/d5a/l60 to d7/d8/d16/l78 0 2023-12-05T09:26:17.847 INFO:tasks.workunit.client.1.smithi134.stdout:9/360: write d7/d8/d2e/f31 [4964401,129778] 0 2023-12-05T09:26:17.849 INFO:tasks.workunit.client.1.smithi134.stdout:1/474: symlink d2/d27/d9d/lab 0 2023-12-05T09:26:17.849 INFO:tasks.workunit.client.1.smithi134.stdout:1/475: truncate d2/d27/d71/fa1 727406 0 2023-12-05T09:26:17.849 INFO:tasks.workunit.client.1.smithi134.stdout:1/476: creat d2/d9/d10/fac x:0 0 0 2023-12-05T09:26:17.849 INFO:tasks.workunit.client.1.smithi134.stdout:1/477: truncate d2/f63 231951 0 2023-12-05T09:26:17.849 INFO:tasks.workunit.client.1.smithi134.stdout:1/478: creat d2/d9/fad x:0 0 0 2023-12-05T09:26:17.850 INFO:tasks.workunit.client.0.smithi067.stdout:1/272: dwrite d2/d4f/d54/f58 [0,4194304] 0 2023-12-05T09:26:17.850 INFO:tasks.workunit.client.0.smithi067.stdout:7/291: rename d0/d9/d1b/d34/l52 to d0/d45/l5c 0 2023-12-05T09:26:17.852 INFO:tasks.workunit.client.1.smithi134.stdout:6/366: sync 2023-12-05T09:26:17.852 INFO:tasks.workunit.client.1.smithi134.stdout:6/367: chown d4/d39/d42/f4d 244174214 1 2023-12-05T09:26:17.853 INFO:tasks.workunit.client.0.smithi067.stdout:5/253: link db/df/d1a/c2e db/df/d1a/d59/c5a 0 2023-12-05T09:26:17.856 INFO:tasks.workunit.client.1.smithi134.stdout:0/365: creat d13/d14/d30/f7e x:0 0 0 2023-12-05T09:26:17.856 INFO:tasks.workunit.client.0.smithi067.stdout:0/366: readlink d3/d7/d3c/d77/l70 0 2023-12-05T09:26:17.858 INFO:tasks.workunit.client.0.smithi067.stdout:6/230: mkdir da/d10/d1e/d17/d2f/d1f/d27/d4f 0 2023-12-05T09:26:17.862 INFO:tasks.workunit.client.0.smithi067.stdout:7/292: creat d0/d9/d10/f5d x:0 0 0 2023-12-05T09:26:17.862 INFO:tasks.workunit.client.0.smithi067.stdout:7/293: stat d0/c13 0 2023-12-05T09:26:17.864 INFO:tasks.workunit.client.1.smithi134.stdout:7/375: symlink d2/df/l7b 0 2023-12-05T09:26:17.867 INFO:tasks.workunit.client.1.smithi134.stdout:2/414: creat d19/d28/d31/d6f/f84 x:0 0 0 2023-12-05T09:26:17.872 INFO:tasks.workunit.client.0.smithi067.stdout:0/367: symlink d3/d6b/l81 0 2023-12-05T09:26:17.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/231: rename da/d10/d1e/d17/c2e to da/d10/d1e/d17/d2f/d47/c50 0 2023-12-05T09:26:17.873 INFO:tasks.workunit.client.1.smithi134.stdout:4/407: mknod d16/d21/d69/d6e/c8b 0 2023-12-05T09:26:17.875 INFO:tasks.workunit.client.1.smithi134.stdout:3/401: rmdir d4/d1f/d4e/d6a 39 2023-12-05T09:26:17.877 INFO:tasks.workunit.client.0.smithi067.stdout:7/294: rename d0/f6 to d0/d9/d1b/d54/f5e 0 2023-12-05T09:26:17.880 INFO:tasks.workunit.client.1.smithi134.stdout:5/335: rename d0/d11/f62 to d0/d66/f76 0 2023-12-05T09:26:17.882 INFO:tasks.workunit.client.1.smithi134.stdout:9/361: symlink d7/d5b/l79 0 2023-12-05T09:26:17.882 INFO:tasks.workunit.client.1.smithi134.stdout:9/362: truncate d7/d8/d16/f1f 992458 0 2023-12-05T09:26:17.887 INFO:tasks.workunit.client.0.smithi067.stdout:8/255: dread d5/dc/f19 [0,4194304] 0 2023-12-05T09:26:17.888 INFO:tasks.workunit.client.0.smithi067.stdout:4/225: dwrite d0/d1d/d25/f29 [0,4194304] 0 2023-12-05T09:26:17.888 INFO:tasks.workunit.client.0.smithi067.stdout:4/226: fdatasync d0/d1d/d25/d2c/d34/f43 0 2023-12-05T09:26:17.888 INFO:tasks.workunit.client.1.smithi134.stdout:1/479: symlink d2/d9/d10/d30/d4a/lae 0 2023-12-05T09:26:17.888 INFO:tasks.workunit.client.1.smithi134.stdout:1/480: chown d2/d27/d40/f5d 453373 1 2023-12-05T09:26:17.890 INFO:tasks.workunit.client.1.smithi134.stdout:2/415: write d19/d28/d31/d38/f48 [3139170,45291] 0 2023-12-05T09:26:17.890 INFO:tasks.workunit.client.1.smithi134.stdout:2/416: fdatasync d19/d28/d2b/f64 0 2023-12-05T09:26:17.890 INFO:tasks.workunit.client.1.smithi134.stdout:2/417: truncate d19/d28/d2b/f82 932954 0 2023-12-05T09:26:17.890 INFO:tasks.workunit.client.1.smithi134.stdout:6/368: unlink d4/d2a/d3a/da/d1b/c40 0 2023-12-05T09:26:17.893 INFO:tasks.workunit.client.1.smithi134.stdout:2/418: write d19/d3a/f52 [238890,41416] 0 2023-12-05T09:26:17.893 INFO:tasks.workunit.client.0.smithi067.stdout:1/273: dread d2/d4f/d14/d48/f4d [0,4194304] 0 2023-12-05T09:26:17.894 INFO:tasks.workunit.client.0.smithi067.stdout:7/295: rename d0/d9/d40/f4b to d0/d9/f5f 0 2023-12-05T09:26:17.894 INFO:tasks.workunit.client.1.smithi134.stdout:3/402: symlink d4/d5/d6f/l7e 0 2023-12-05T09:26:17.900 INFO:tasks.workunit.client.1.smithi134.stdout:0/366: rename d13/f53 to d13/d14/d59/f7f 0 2023-12-05T09:26:17.904 INFO:tasks.workunit.client.1.smithi134.stdout:5/336: mknod d0/d50/c77 0 2023-12-05T09:26:17.910 INFO:tasks.workunit.client.1.smithi134.stdout:8/455: sync 2023-12-05T09:26:17.916 INFO:tasks.workunit.client.0.smithi067.stdout:1/274: unlink d2/d3/f18 0 2023-12-05T09:26:17.918 INFO:tasks.workunit.client.0.smithi067.stdout:8/256: dread d5/d3b/f3d [0,4194304] 0 2023-12-05T09:26:17.920 INFO:tasks.workunit.client.0.smithi067.stdout:3/200: dwrite d9/da/d15/f1b [4194304,4194304] 0 2023-12-05T09:26:17.920 INFO:tasks.workunit.client.0.smithi067.stdout:1/275: mkdir d2/d4f/d5a 0 2023-12-05T09:26:17.923 INFO:tasks.workunit.client.1.smithi134.stdout:6/369: symlink d4/d39/d42/l69 0 2023-12-05T09:26:17.923 INFO:tasks.workunit.client.1.smithi134.stdout:2/419: symlink d19/d28/d31/d38/l85 0 2023-12-05T09:26:17.929 INFO:tasks.workunit.client.1.smithi134.stdout:5/337: dread d0/fc [4194304,4194304] 0 2023-12-05T09:26:17.929 INFO:tasks.workunit.client.0.smithi067.stdout:6/232: rmdir da/d10/d1e/d17 39 2023-12-05T09:26:17.932 INFO:tasks.workunit.client.0.smithi067.stdout:9/420: dwrite d1b/f1c [0,4194304] 0 2023-12-05T09:26:17.934 INFO:tasks.workunit.client.0.smithi067.stdout:0/368: dwrite d3/df/f3e [0,4194304] 0 2023-12-05T09:26:17.934 INFO:tasks.workunit.client.1.smithi134.stdout:4/408: dwrite f4 [4194304,4194304] 0 2023-12-05T09:26:17.934 INFO:tasks.workunit.client.1.smithi134.stdout:4/409: creat d16/d18/d1a/f8c x:0 0 0 2023-12-05T09:26:17.937 INFO:tasks.workunit.client.0.smithi067.stdout:0/369: read d3/d7/d3c/d67/d59/f41 [866306,53714] 0 2023-12-05T09:26:17.937 INFO:tasks.workunit.client.0.smithi067.stdout:1/276: creat d2/d5/d7/de/d19/d53/f5b x:0 0 0 2023-12-05T09:26:17.938 INFO:tasks.workunit.client.1.smithi134.stdout:9/363: dwrite f1 [4194304,4194304] 0 2023-12-05T09:26:17.938 INFO:tasks.workunit.client.1.smithi134.stdout:2/420: dread d19/f5d [0,4194304] 0 2023-12-05T09:26:17.938 INFO:tasks.workunit.client.1.smithi134.stdout:9/364: fsync d7/d8/d16/d52/d65/f66 0 2023-12-05T09:26:17.939 INFO:tasks.workunit.client.0.smithi067.stdout:6/233: unlink da/d10/d1e/d17/d2f/d47/d19/l49 0 2023-12-05T09:26:17.943 INFO:tasks.workunit.client.0.smithi067.stdout:9/421: rename f11 to d1b/d25/d54/d5c/d6a/d6c/f92 0 2023-12-05T09:26:17.945 INFO:tasks.workunit.client.0.smithi067.stdout:9/422: write d1b/f31 [1369042,77128] 0 2023-12-05T09:26:17.945 INFO:tasks.workunit.client.1.smithi134.stdout:7/376: rmdir d2/d7 39 2023-12-05T09:26:17.945 INFO:tasks.workunit.client.1.smithi134.stdout:7/377: fdatasync d2/dd/f6b 0 2023-12-05T09:26:17.948 INFO:tasks.workunit.client.1.smithi134.stdout:3/403: symlink d4/d5/d45/d60/l7f 0 2023-12-05T09:26:17.952 INFO:tasks.workunit.client.1.smithi134.stdout:0/367: unlink d13/d14/d30/l1e 0 2023-12-05T09:26:17.954 INFO:tasks.workunit.client.1.smithi134.stdout:1/481: getdents d2/d9 0 2023-12-05T09:26:17.956 INFO:tasks.workunit.client.0.smithi067.stdout:1/277: link d2/d4f/d14/f42 d2/f5c 0 2023-12-05T09:26:17.960 INFO:tasks.workunit.client.0.smithi067.stdout:6/234: mkdir da/d10/d1e/d51 0 2023-12-05T09:26:17.960 INFO:tasks.workunit.client.0.smithi067.stdout:6/235: chown da/d10 7957647 1 2023-12-05T09:26:17.960 INFO:tasks.workunit.client.1.smithi134.stdout:6/370: dwrite d4/d2a/d3a/f3c [4194304,4194304] 0 2023-12-05T09:26:17.962 INFO:tasks.workunit.client.1.smithi134.stdout:5/338: mkdir d0/d1a/d1c/d3f/d5b/d5d/d78 0 2023-12-05T09:26:17.962 INFO:tasks.workunit.client.1.smithi134.stdout:5/339: chown d0/dd/f17 7554903 1 2023-12-05T09:26:17.965 INFO:tasks.workunit.client.0.smithi067.stdout:7/296: dwrite d0/d9/d10/f35 [0,4194304] 0 2023-12-05T09:26:17.967 INFO:tasks.workunit.client.0.smithi067.stdout:0/370: link d3/f4d d3/d7/d3c/d6c/d76/f82 0 2023-12-05T09:26:17.971 INFO:tasks.workunit.client.0.smithi067.stdout:1/278: rename d2/d4f/d5a to d2/d4f/d14/d5d 0 2023-12-05T09:26:17.974 INFO:tasks.workunit.client.1.smithi134.stdout:4/410: getdents d16/d7b 0 2023-12-05T09:26:17.976 INFO:tasks.workunit.client.0.smithi067.stdout:6/236: unlink da/d10/d1e/d17/d2f/c28 0 2023-12-05T09:26:17.980 INFO:tasks.workunit.client.0.smithi067.stdout:9/423: getdents d1b/d25/d54/d5c/d6a/d6c 0 2023-12-05T09:26:17.983 INFO:tasks.workunit.client.1.smithi134.stdout:9/365: rename d7/c9 to d7/d10/c7a 0 2023-12-05T09:26:17.987 INFO:tasks.workunit.client.1.smithi134.stdout:7/378: symlink d2/d7/d2b/d2d/d67/d73/l7c 0 2023-12-05T09:26:17.990 INFO:tasks.workunit.client.0.smithi067.stdout:0/371: creat d3/d7/d3c/d67/d59/d4e/f83 x:0 0 0 2023-12-05T09:26:17.992 INFO:tasks.workunit.client.1.smithi134.stdout:3/404: mkdir d4/d80 0 2023-12-05T09:26:17.992 INFO:tasks.workunit.client.1.smithi134.stdout:3/405: readlink d4/d5/d45/d60/l6d 0 2023-12-05T09:26:17.992 INFO:tasks.workunit.client.1.smithi134.stdout:3/406: fsync d4/d1f/d4e/f59 0 2023-12-05T09:26:17.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/368: creat d13/d14/d15/d67/d73/f80 x:0 0 0 2023-12-05T09:26:17.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/369: write d13/d14/d15/f62 [640352,72530] 0 2023-12-05T09:26:17.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/370: read - d13/d14/d15/d2a/f58 zero size 2023-12-05T09:26:17.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/371: creat d13/d14/d15/d67/d73/f81 x:0 0 0 2023-12-05T09:26:17.997 INFO:tasks.workunit.client.0.smithi067.stdout:1/279: mknod d2/d4f/c5e 0 2023-12-05T09:26:17.998 INFO:tasks.workunit.client.1.smithi134.stdout:1/482: symlink d2/d9/d10/d94/laf 0 2023-12-05T09:26:18.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/456: rmdir da/de/d16/d45/d3b 39 2023-12-05T09:26:18.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/457: write da/de/d4d/f8d [612780,83298] 0 2023-12-05T09:26:18.004 INFO:tasks.workunit.client.0.smithi067.stdout:9/424: truncate d1b/d25/d35/f4a 2687618 0 2023-12-05T09:26:18.004 INFO:tasks.workunit.client.0.smithi067.stdout:9/425: write d1b/d3e/f91 [275408,104377] 0 2023-12-05T09:26:18.010 INFO:tasks.workunit.client.0.smithi067.stdout:0/372: rename d3/d7/c2f to d3/d6b/c84 0 2023-12-05T09:26:18.010 INFO:tasks.workunit.client.0.smithi067.stdout:8/257: dwrite d5/dc/d1a/d20/f22 [4194304,4194304] 0 2023-12-05T09:26:18.010 INFO:tasks.workunit.client.0.smithi067.stdout:1/280: mkdir d2/d5/d7/de/d19/d49/d5f 0 2023-12-05T09:26:18.010 INFO:tasks.workunit.client.1.smithi134.stdout:6/371: symlink d4/d39/d5c/l6a 0 2023-12-05T09:26:18.010 INFO:tasks.workunit.client.1.smithi134.stdout:5/340: creat d0/d11/d61/d75/f79 x:0 0 0 2023-12-05T09:26:18.011 INFO:tasks.workunit.client.1.smithi134.stdout:5/341: read d0/d1a/d1c/f23 [177066,13455] 0 2023-12-05T09:26:18.011 INFO:tasks.workunit.client.0.smithi067.stdout:6/237: getdents da/d10/d1e/d17/d2f/d47/d19 0 2023-12-05T09:26:18.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/421: rmdir d19/d3a 39 2023-12-05T09:26:18.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/422: fsync d19/f20 0 2023-12-05T09:26:18.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/423: chown c9 21731 1 2023-12-05T09:26:18.020 INFO:tasks.workunit.client.1.smithi134.stdout:9/366: mkdir d7/d10/d4b/d53/d7b 0 2023-12-05T09:26:18.021 INFO:tasks.workunit.client.1.smithi134.stdout:7/379: creat d2/d7/dc/d2e/d3a/d6d/f7d x:0 0 0 2023-12-05T09:26:18.023 INFO:tasks.workunit.client.0.smithi067.stdout:9/426: rename d1b/d25/d5b/c84 to d1b/d25/d54/d5c/d8f/c93 0 2023-12-05T09:26:18.023 INFO:tasks.workunit.client.0.smithi067.stdout:9/427: chown d1b/d25/d54/d5c/d6a/d6c/d78 8393 1 2023-12-05T09:26:18.025 INFO:tasks.workunit.client.1.smithi134.stdout:3/407: symlink d4/l81 0 2023-12-05T09:26:18.025 INFO:tasks.workunit.client.1.smithi134.stdout:3/408: fsync d4/f2f 0 2023-12-05T09:26:18.025 INFO:tasks.workunit.client.1.smithi134.stdout:9/367: dread d7/d10/d4b/f57 [0,4194304] 0 2023-12-05T09:26:18.027 INFO:tasks.workunit.client.0.smithi067.stdout:1/281: unlink d2/d5/d7/l40 0 2023-12-05T09:26:18.031 INFO:tasks.workunit.client.0.smithi067.stdout:8/258: write d5/d3b/f3d [1722978,55481] 0 2023-12-05T09:26:18.031 INFO:tasks.workunit.client.0.smithi067.stdout:8/259: dread - d5/f40 zero size 2023-12-05T09:26:18.035 INFO:tasks.workunit.client.1.smithi134.stdout:0/372: creat d13/d14/d59/f82 x:0 0 0 2023-12-05T09:26:18.037 INFO:tasks.workunit.client.1.smithi134.stdout:9/368: dread d7/d10/d4b/d53/f63 [0,4194304] 0 2023-12-05T09:26:18.037 INFO:tasks.workunit.client.1.smithi134.stdout:9/369: chown d7/d10/d4b/c61 770 1 2023-12-05T09:26:18.039 INFO:tasks.workunit.client.1.smithi134.stdout:1/483: symlink d2/d27/lb0 0 2023-12-05T09:26:18.039 INFO:tasks.workunit.client.1.smithi134.stdout:1/484: getdents d2/d9 0 2023-12-05T09:26:18.039 INFO:tasks.workunit.client.1.smithi134.stdout:1/485: truncate d2/d9/d10/d30/d4a/f9a 1032899 0 2023-12-05T09:26:18.039 INFO:tasks.workunit.client.1.smithi134.stdout:1/486: write d2/d9/d10/f47 [1416870,4998] 0 2023-12-05T09:26:18.041 INFO:tasks.workunit.client.0.smithi067.stdout:8/260: unlink d5/ce 0 2023-12-05T09:26:18.042 INFO:tasks.workunit.client.1.smithi134.stdout:8/458: mknod da/de/d8a/c9a 0 2023-12-05T09:26:18.042 INFO:tasks.workunit.client.1.smithi134.stdout:8/459: dread - da/de/d16/d2d/f85 zero size 2023-12-05T09:26:18.042 INFO:tasks.workunit.client.1.smithi134.stdout:8/460: fdatasync da/de/f54 0 2023-12-05T09:26:18.045 INFO:tasks.workunit.client.1.smithi134.stdout:6/372: creat d4/f6b x:0 0 0 2023-12-05T09:26:18.045 INFO:tasks.workunit.client.1.smithi134.stdout:6/373: fsync d4/d2a/d3a/f3c 0 2023-12-05T09:26:18.048 INFO:tasks.workunit.client.1.smithi134.stdout:6/374: write d4/ff [138670,34034] 0 2023-12-05T09:26:18.051 INFO:tasks.workunit.client.1.smithi134.stdout:5/342: dwrite d0/d1a/d3a/f3b [4194304,4194304] 0 2023-12-05T09:26:18.052 INFO:tasks.workunit.client.1.smithi134.stdout:5/343: write d0/d45/f5a [435692,89327] 0 2023-12-05T09:26:18.053 INFO:tasks.workunit.client.1.smithi134.stdout:4/411: getdents d16/d21/d35 0 2023-12-05T09:26:18.056 INFO:tasks.workunit.client.0.smithi067.stdout:7/297: dwrite d0/d9/d10/f2f [0,4194304] 0 2023-12-05T09:26:18.056 INFO:tasks.workunit.client.0.smithi067.stdout:8/261: mknod d5/dc/d1a/d20/d2d/d41/c49 0 2023-12-05T09:26:18.056 INFO:tasks.workunit.client.0.smithi067.stdout:8/262: truncate d5/f45 637576 0 2023-12-05T09:26:18.059 INFO:tasks.workunit.client.1.smithi134.stdout:2/424: rename d19/d3a/d60/c77 to d19/d28/d31/c86 0 2023-12-05T09:26:18.059 INFO:tasks.workunit.client.1.smithi134.stdout:2/425: creat d19/d28/d63/d70/f87 x:0 0 0 2023-12-05T09:26:18.059 INFO:tasks.workunit.client.1.smithi134.stdout:2/426: creat d19/d3f/f88 x:0 0 0 2023-12-05T09:26:18.059 INFO:tasks.workunit.client.1.smithi134.stdout:2/427: fsync fa 0 2023-12-05T09:26:18.060 INFO:tasks.workunit.client.1.smithi134.stdout:7/380: truncate d2/dd/d1a/f23 3729829 0 2023-12-05T09:26:18.060 INFO:tasks.workunit.client.1.smithi134.stdout:7/381: chown d2/d7/d2b/d2d/d67/f6e 60 1 2023-12-05T09:26:18.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/409: link d4/d5/d45/d60/f72 d4/d5/d45/d60/f82 0 2023-12-05T09:26:18.068 INFO:tasks.workunit.client.1.smithi134.stdout:9/370: mknod d7/c7c 0 2023-12-05T09:26:18.068 INFO:tasks.workunit.client.1.smithi134.stdout:9/371: stat f3 0 2023-12-05T09:26:18.068 INFO:tasks.workunit.client.1.smithi134.stdout:9/372: write d7/d8/d14/d26/f48 [2439,123109] 0 2023-12-05T09:26:18.068 INFO:tasks.workunit.client.1.smithi134.stdout:9/373: readlink d7/d8/la 0 2023-12-05T09:26:18.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/487: mkdir d2/d9/d8d/da2/db1 0 2023-12-05T09:26:18.072 INFO:tasks.workunit.client.1.smithi134.stdout:8/461: mkdir da/de/d11/d1d/d5f/d9b 0 2023-12-05T09:26:18.073 INFO:tasks.workunit.client.0.smithi067.stdout:8/263: dread d5/dc/d1a/d20/f22 [4194304,4194304] 0 2023-12-05T09:26:18.073 INFO:tasks.workunit.client.0.smithi067.stdout:8/264: write d5/f36 [4399773,122886] 0 2023-12-05T09:26:18.073 INFO:tasks.workunit.client.0.smithi067.stdout:8/265: chown d5/dc/d1a/d20/f25 946 1 2023-12-05T09:26:18.073 INFO:tasks.workunit.client.0.smithi067.stdout:8/266: write d5/dc/d1a/f2f [1015179,71399] 0 2023-12-05T09:26:18.074 INFO:tasks.workunit.client.1.smithi134.stdout:3/410: dread d4/f1b [4194304,4194304] 0 2023-12-05T09:26:18.077 INFO:tasks.workunit.client.1.smithi134.stdout:6/375: unlink d4/d2a/d3a/da/d1b/f21 0 2023-12-05T09:26:18.078 INFO:tasks.workunit.client.1.smithi134.stdout:6/376: dread - d4/d39/f34 zero size 2023-12-05T09:26:18.085 INFO:tasks.workunit.client.0.smithi067.stdout:0/373: dwrite d3/d7/d3c/d67/d59/d4e/f83 [0,4194304] 0 2023-12-05T09:26:18.089 INFO:tasks.workunit.client.0.smithi067.stdout:7/298: dread d0/f42 [0,4194304] 0 2023-12-05T09:26:18.097 INFO:tasks.workunit.client.1.smithi134.stdout:5/344: stat d0/dd/l4c 0 2023-12-05T09:26:18.104 INFO:tasks.workunit.client.1.smithi134.stdout:0/373: rename d13/d14/d15/f37 to d13/d14/d30/d4b/d23/f83 0 2023-12-05T09:26:18.105 INFO:tasks.workunit.client.0.smithi067.stdout:6/238: dwrite da/d10/d1e/d17/d2f/d47/d19/f21 [4194304,4194304] 0 2023-12-05T09:26:18.106 INFO:tasks.workunit.client.0.smithi067.stdout:0/374: symlink d3/df/d10/l85 0 2023-12-05T09:26:18.114 INFO:tasks.workunit.client.0.smithi067.stdout:7/299: rename d0/d9/d10/d37/l25 to d0/d9/d1b/d34/l60 0 2023-12-05T09:26:18.123 INFO:tasks.workunit.client.1.smithi134.stdout:2/428: mknod d19/d28/c89 0 2023-12-05T09:26:18.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/239: getdents da/d10/d1e/d17/d2f/d2c/d34/d3b 0 2023-12-05T09:26:18.126 INFO:tasks.workunit.client.1.smithi134.stdout:7/382: creat d2/d7/d2b/d2d/d67/d73/f7e x:0 0 0 2023-12-05T09:26:18.126 INFO:tasks.workunit.client.1.smithi134.stdout:7/383: stat d2/d7/d2b/d2d/d67/d73/d26/f35 0 2023-12-05T09:26:18.126 INFO:tasks.workunit.client.1.smithi134.stdout:7/384: creat d2/df/d2a/d63/f7f x:0 0 0 2023-12-05T09:26:18.126 INFO:tasks.workunit.client.0.smithi067.stdout:0/375: creat d3/d7/d3c/d6c/f86 x:0 0 0 2023-12-05T09:26:18.126 INFO:tasks.workunit.client.0.smithi067.stdout:0/376: write d3/df/d10/f7b [369903,41225] 0 2023-12-05T09:26:18.128 INFO:tasks.workunit.client.1.smithi134.stdout:1/488: mknod d2/d9/d8d/da2/cb2 0 2023-12-05T09:26:18.130 INFO:tasks.workunit.client.1.smithi134.stdout:3/411: creat d4/d5/d7c/f83 x:0 0 0 2023-12-05T09:26:18.131 INFO:tasks.workunit.client.0.smithi067.stdout:6/240: symlink da/d10/d1e/d17/d2f/d2c/d34/l52 0 2023-12-05T09:26:18.131 INFO:tasks.workunit.client.0.smithi067.stdout:6/241: chown da/d10/d1e/d17/d2f/d47/d19/f21 24555292 1 2023-12-05T09:26:18.131 INFO:tasks.workunit.client.0.smithi067.stdout:6/242: write da/d10/d1e/d17/f29 [9005306,124188] 0 2023-12-05T09:26:18.131 INFO:tasks.workunit.client.1.smithi134.stdout:6/377: creat d4/d2a/d3a/da/d1b/d59/f6c x:0 0 0 2023-12-05T09:26:18.132 INFO:tasks.workunit.client.1.smithi134.stdout:4/412: getdents d16/d21/d47 0 2023-12-05T09:26:18.132 INFO:tasks.workunit.client.1.smithi134.stdout:4/413: fdatasync d16/d18/d1a/f43 0 2023-12-05T09:26:18.132 INFO:tasks.workunit.client.1.smithi134.stdout:4/414: creat d16/d18/d5b/f8d x:0 0 0 2023-12-05T09:26:18.132 INFO:tasks.workunit.client.0.smithi067.stdout:0/377: symlink d3/d7/d3c/d6c/d76/l87 0 2023-12-05T09:26:18.135 INFO:tasks.workunit.client.0.smithi067.stdout:9/428: dwrite d1b/f20 [0,4194304] 0 2023-12-05T09:26:18.135 INFO:tasks.workunit.client.1.smithi134.stdout:9/374: dwrite d7/d10/d4b/d53/f63 [0,4194304] 0 2023-12-05T09:26:18.135 INFO:tasks.workunit.client.1.smithi134.stdout:0/374: symlink d13/d14/d30/d4b/l84 0 2023-12-05T09:26:18.136 INFO:tasks.workunit.client.1.smithi134.stdout:9/375: write d7/d8/d14/f25 [2979270,84776] 0 2023-12-05T09:26:18.136 INFO:tasks.workunit.client.1.smithi134.stdout:0/375: write d13/d14/d15/d2a/f4a [326531,48350] 0 2023-12-05T09:26:18.136 INFO:tasks.workunit.client.0.smithi067.stdout:1/282: dwrite d2/d5/d7/de/d19/d49/f56 [0,4194304] 0 2023-12-05T09:26:18.136 INFO:tasks.workunit.client.1.smithi134.stdout:7/385: unlink d2/df/d2a/c69 0 2023-12-05T09:26:18.137 INFO:tasks.workunit.client.1.smithi134.stdout:1/489: creat d2/d9/fb3 x:0 0 0 2023-12-05T09:26:18.138 INFO:tasks.workunit.client.1.smithi134.stdout:8/462: rmdir da/de/d4d/d68 39 2023-12-05T09:26:18.138 INFO:tasks.workunit.client.0.smithi067.stdout:0/378: creat d3/d7/d3c/d67/d59/f88 x:0 0 0 2023-12-05T09:26:18.139 INFO:tasks.workunit.client.1.smithi134.stdout:3/412: creat d4/d80/f84 x:0 0 0 2023-12-05T09:26:18.150 INFO:tasks.workunit.client.1.smithi134.stdout:3/413: dread d4/d5/d45/d60/f82 [0,4194304] 0 2023-12-05T09:26:18.150 INFO:tasks.workunit.client.1.smithi134.stdout:8/463: dread da/de/d11/f1a [4194304,4194304] 0 2023-12-05T09:26:18.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/283: mkdir d2/d4f/d15/d60 0 2023-12-05T09:26:18.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/284: stat d2/d3/l28 0 2023-12-05T09:26:18.153 INFO:tasks.workunit.client.1.smithi134.stdout:6/378: dread d4/f46 [0,4194304] 0 2023-12-05T09:26:18.154 INFO:tasks.workunit.client.1.smithi134.stdout:4/415: dread d16/d18/d1a/f79 [0,4194304] 0 2023-12-05T09:26:18.155 INFO:tasks.workunit.client.0.smithi067.stdout:0/379: truncate d3/f39 1309716 0 2023-12-05T09:26:18.156 INFO:tasks.workunit.client.0.smithi067.stdout:8/267: dwrite d5/f28 [0,4194304] 0 2023-12-05T09:26:18.162 INFO:tasks.workunit.client.0.smithi067.stdout:1/285: mkdir d2/d5/d7/de/d19/d49/d5f/d61 0 2023-12-05T09:26:18.162 INFO:tasks.workunit.client.0.smithi067.stdout:1/286: write d2/d4f/d15/f29 [3336763,21789] 0 2023-12-05T09:26:18.169 INFO:tasks.workunit.client.1.smithi134.stdout:9/376: mkdir d7/d7d 0 2023-12-05T09:26:18.169 INFO:tasks.workunit.client.1.smithi134.stdout:9/377: write d7/d8/d14/f25 [5499119,10329] 0 2023-12-05T09:26:18.172 INFO:tasks.workunit.client.1.smithi134.stdout:0/376: truncate f8 3649066 0 2023-12-05T09:26:18.174 INFO:tasks.workunit.client.0.smithi067.stdout:6/243: dread da/d10/d1e/d17/f29 [0,4194304] 0 2023-12-05T09:26:18.177 INFO:tasks.workunit.client.0.smithi067.stdout:7/300: dwrite d0/f4a [0,4194304] 0 2023-12-05T09:26:18.182 INFO:tasks.workunit.client.1.smithi134.stdout:7/386: symlink d2/dd/d71/l80 0 2023-12-05T09:26:18.184 INFO:tasks.workunit.client.1.smithi134.stdout:1/490: mkdir d2/d27/db4 0 2023-12-05T09:26:18.184 INFO:tasks.workunit.client.1.smithi134.stdout:1/491: chown d2/c4f 14651133 1 2023-12-05T09:26:18.188 INFO:tasks.workunit.client.1.smithi134.stdout:3/414: mkdir d4/d5/d45/d60/d85 0 2023-12-05T09:26:18.191 INFO:tasks.workunit.client.1.smithi134.stdout:8/464: mknod da/de/d4d/c9c 0 2023-12-05T09:26:18.195 INFO:tasks.workunit.client.1.smithi134.stdout:0/377: read d13/d14/d30/d4b/f4e [2114358,323] 0 2023-12-05T09:26:18.198 INFO:tasks.workunit.client.1.smithi134.stdout:1/492: write d2/d27/d9d/fa6 [561945,121679] 0 2023-12-05T09:26:18.199 INFO:tasks.workunit.client.0.smithi067.stdout:9/429: dwrite d1b/d25/d35/d56/f68 [0,4194304] 0 2023-12-05T09:26:18.200 INFO:tasks.workunit.client.0.smithi067.stdout:0/380: symlink d3/d7/d3c/d67/d59/d5c/d68/l89 0 2023-12-05T09:26:18.200 INFO:tasks.workunit.client.1.smithi134.stdout:6/379: dwrite d4/d39/f53 [0,4194304] 0 2023-12-05T09:26:18.202 INFO:tasks.workunit.client.0.smithi067.stdout:8/268: symlink d5/dc/d1a/l4a 0 2023-12-05T09:26:18.204 INFO:tasks.workunit.client.1.smithi134.stdout:9/378: dwrite d7/d8/d14/f59 [0,4194304] 0 2023-12-05T09:26:18.204 INFO:tasks.workunit.client.1.smithi134.stdout:9/379: write f3 [8571028,129025] 0 2023-12-05T09:26:18.205 INFO:tasks.workunit.client.1.smithi134.stdout:9/380: write d7/d10/d4b/f57 [133544,50750] 0 2023-12-05T09:26:18.206 INFO:tasks.workunit.client.0.smithi067.stdout:1/287: mknod d2/d5/d7/de/c62 0 2023-12-05T09:26:18.217 INFO:tasks.workunit.client.0.smithi067.stdout:6/244: mknod da/d10/d1e/d17/d2f/d2c/d34/d3b/c53 0 2023-12-05T09:26:18.225 INFO:tasks.workunit.client.1.smithi134.stdout:4/416: mkdir d16/d18/d1a/d3b/d8e 0 2023-12-05T09:26:18.225 INFO:tasks.workunit.client.1.smithi134.stdout:4/417: creat d16/d21/d69/d6e/f8f x:0 0 0 2023-12-05T09:26:18.226 INFO:tasks.workunit.client.1.smithi134.stdout:8/465: read da/de/d11/f6a [1690425,106903] 0 2023-12-05T09:26:18.226 INFO:tasks.workunit.client.1.smithi134.stdout:8/466: chown da/de/d8a/d42/f63 181753 1 2023-12-05T09:26:18.227 INFO:tasks.workunit.client.1.smithi134.stdout:3/415: dwrite d4/f2f [0,4194304] 0 2023-12-05T09:26:18.227 INFO:tasks.workunit.client.0.smithi067.stdout:7/301: getdents d0 0 2023-12-05T09:26:18.227 INFO:tasks.workunit.client.0.smithi067.stdout:7/302: chown d0/d9/d10/f44 270 1 2023-12-05T09:26:18.230 INFO:tasks.workunit.client.1.smithi134.stdout:7/387: mkdir d2/df/d81 0 2023-12-05T09:26:18.230 INFO:tasks.workunit.client.1.smithi134.stdout:7/388: chown f1 32 1 2023-12-05T09:26:18.230 INFO:tasks.workunit.client.1.smithi134.stdout:7/389: stat d2/d7/l18 0 2023-12-05T09:26:18.232 INFO:tasks.workunit.client.1.smithi134.stdout:0/378: mknod d13/d14/d15/d67/c85 0 2023-12-05T09:26:18.232 INFO:tasks.workunit.client.1.smithi134.stdout:0/379: write d13/d14/d30/d2c/f34 [1191803,38787] 0 2023-12-05T09:26:18.234 INFO:tasks.workunit.client.0.smithi067.stdout:9/430: mkdir d1b/d25/d94 0 2023-12-05T09:26:18.234 INFO:tasks.workunit.client.0.smithi067.stdout:9/431: chown d1b/d3e/f6e 3 1 2023-12-05T09:26:18.237 INFO:tasks.workunit.client.0.smithi067.stdout:0/381: mkdir d3/d7/d3c/d6c/d8a 0 2023-12-05T09:26:18.237 INFO:tasks.workunit.client.0.smithi067.stdout:0/382: write d3/df/d10/f7b [506622,26685] 0 2023-12-05T09:26:18.239 INFO:tasks.workunit.client.1.smithi134.stdout:1/493: link d2/d9/d10/l4c d2/d9/d10/d30/lb5 0 2023-12-05T09:26:18.239 INFO:tasks.workunit.client.1.smithi134.stdout:1/494: write d2/d9/d10/d30/d66/da9/d74/f77 [1361185,114919] 0 2023-12-05T09:26:18.239 INFO:tasks.workunit.client.1.smithi134.stdout:1/495: dread - d2/d27/d71/fa3 zero size 2023-12-05T09:26:18.240 INFO:tasks.workunit.client.1.smithi134.stdout:0/380: dread d13/f38 [0,4194304] 0 2023-12-05T09:26:18.241 INFO:tasks.workunit.client.1.smithi134.stdout:0/381: fsync f8 0 2023-12-05T09:26:18.242 INFO:tasks.workunit.client.0.smithi067.stdout:6/245: symlink da/d10/d1e/d17/d2f/d2c/d34/l54 0 2023-12-05T09:26:18.243 INFO:tasks.workunit.client.0.smithi067.stdout:6/246: write da/d10/d1e/d17/d2f/d2c/d34/f3e [1044763,68013] 0 2023-12-05T09:26:18.244 INFO:tasks.workunit.client.0.smithi067.stdout:2/217: sync 2023-12-05T09:26:18.244 INFO:tasks.workunit.client.0.smithi067.stdout:2/218: chown d0/d25/d34/f3d 38958687 1 2023-12-05T09:26:18.244 INFO:tasks.workunit.client.0.smithi067.stdout:2/219: write d0/d15/f2a [1150289,76503] 0 2023-12-05T09:26:18.251 INFO:tasks.workunit.client.0.smithi067.stdout:7/303: mknod d0/d9/d1b/d5a/c61 0 2023-12-05T09:26:18.251 INFO:tasks.workunit.client.0.smithi067.stdout:7/304: fsync d0/d9/d56/f5b 0 2023-12-05T09:26:18.253 INFO:tasks.workunit.client.0.smithi067.stdout:9/432: rmdir d1b/d25/d54/d5c/d6a/d6c 39 2023-12-05T09:26:18.253 INFO:tasks.workunit.client.0.smithi067.stdout:9/433: chown d1b 0 1 2023-12-05T09:26:18.264 INFO:tasks.workunit.client.0.smithi067.stdout:1/288: rmdir d2/d4f/d54 39 2023-12-05T09:26:18.265 INFO:tasks.workunit.client.0.smithi067.stdout:8/269: dwrite d5/dc/d1a/d20/f31 [0,4194304] 0 2023-12-05T09:26:18.265 INFO:tasks.workunit.client.0.smithi067.stdout:8/270: truncate d5/f40 43759 0 2023-12-05T09:26:18.266 INFO:tasks.workunit.client.0.smithi067.stdout:8/271: creat d5/da/f4b x:0 0 0 2023-12-05T09:26:18.269 INFO:tasks.workunit.client.1.smithi134.stdout:2/429: sync 2023-12-05T09:26:18.269 INFO:tasks.workunit.client.1.smithi134.stdout:5/345: sync 2023-12-05T09:26:18.269 INFO:tasks.workunit.client.1.smithi134.stdout:2/430: chown d19/d3a/d60/c68 397608 1 2023-12-05T09:26:18.270 INFO:tasks.workunit.client.1.smithi134.stdout:2/431: chown d19/d3f 15 1 2023-12-05T09:26:18.270 INFO:tasks.workunit.client.1.smithi134.stdout:5/346: dread - d0/dd/f51 zero size 2023-12-05T09:26:18.272 INFO:tasks.workunit.client.1.smithi134.stdout:9/381: getdents d7/d8/d14/d26/d5a 0 2023-12-05T09:26:18.276 INFO:tasks.workunit.client.0.smithi067.stdout:2/220: truncate d0/fd 448747 0 2023-12-05T09:26:18.276 INFO:tasks.workunit.client.0.smithi067.stdout:0/383: symlink d3/l8b 0 2023-12-05T09:26:18.276 INFO:tasks.workunit.client.0.smithi067.stdout:0/384: chown d3 9366224 1 2023-12-05T09:26:18.276 INFO:tasks.workunit.client.0.smithi067.stdout:0/385: chown d3/d7/d3c/d67/d59/d5c/d68/f79 0 1 2023-12-05T09:26:18.276 INFO:tasks.workunit.client.0.smithi067.stdout:0/386: creat d3/d7/d30/f8c x:0 0 0 2023-12-05T09:26:18.278 INFO:tasks.workunit.client.1.smithi134.stdout:4/418: rename d16/d18/l46 to d16/d18/l90 0 2023-12-05T09:26:18.278 INFO:tasks.workunit.client.1.smithi134.stdout:4/419: write d16/d18/d1b/f7d [908915,119304] 0 2023-12-05T09:26:18.279 INFO:tasks.workunit.client.1.smithi134.stdout:4/420: write d16/d7b/f51 [1802450,65755] 0 2023-12-05T09:26:18.279 INFO:tasks.workunit.client.1.smithi134.stdout:4/421: write d16/d18/d1a/f43 [894111,13935] 0 2023-12-05T09:26:18.289 INFO:tasks.workunit.client.1.smithi134.stdout:8/467: mkdir da/de/d96/d9d 0 2023-12-05T09:26:18.292 INFO:tasks.workunit.client.1.smithi134.stdout:3/416: mkdir d4/d5/d45/d86 0 2023-12-05T09:26:18.293 INFO:tasks.workunit.client.0.smithi067.stdout:1/289: mkdir d2/d3/d63 0 2023-12-05T09:26:18.293 INFO:tasks.workunit.client.0.smithi067.stdout:1/290: fdatasync d2/d4f/d14/d20/f26 0 2023-12-05T09:26:18.293 INFO:tasks.workunit.client.1.smithi134.stdout:0/382: dwrite d13/d14/d15/d2a/f4c [0,4194304] 0 2023-12-05T09:26:18.295 INFO:tasks.workunit.client.1.smithi134.stdout:7/390: mknod d2/d7/d2b/d2d/d67/d73/c82 0 2023-12-05T09:26:18.295 INFO:tasks.workunit.client.1.smithi134.stdout:1/496: mknod d2/d9/d10/d30/d4a/cb6 0 2023-12-05T09:26:18.295 INFO:tasks.workunit.client.1.smithi134.stdout:1/497: chown d2/d9/c1c 262102 1 2023-12-05T09:26:18.298 INFO:tasks.workunit.client.0.smithi067.stdout:1/291: symlink d2/d5/d50/l64 0 2023-12-05T09:26:18.298 INFO:tasks.workunit.client.0.smithi067.stdout:1/292: dread - d2/d5/d7/de/d1a/f57 zero size 2023-12-05T09:26:18.299 INFO:tasks.workunit.client.1.smithi134.stdout:2/432: truncate d19/d28/d63/d70/f7d 2679165 0 2023-12-05T09:26:18.301 INFO:tasks.workunit.client.1.smithi134.stdout:1/498: write d2/d9/d10/f3f [445712,44427] 0 2023-12-05T09:26:18.302 INFO:tasks.workunit.client.0.smithi067.stdout:2/221: dread d0/d25/d3a/f43 [0,4194304] 0 2023-12-05T09:26:18.305 INFO:tasks.workunit.client.0.smithi067.stdout:0/387: mkdir d3/d7/d3c/d8d 0 2023-12-05T09:26:18.306 INFO:tasks.workunit.client.1.smithi134.stdout:5/347: symlink d0/d50/d71/l7a 0 2023-12-05T09:26:18.310 INFO:tasks.workunit.client.0.smithi067.stdout:9/434: dwrite d1b/d25/d35/f6f [4194304,4194304] 0 2023-12-05T09:26:18.312 INFO:tasks.workunit.client.1.smithi134.stdout:9/382: mknod d7/d8/d14/d26/c7e 0 2023-12-05T09:26:18.312 INFO:tasks.workunit.client.1.smithi134.stdout:9/383: write d7/d8/d14/f54 [1980148,72471] 0 2023-12-05T09:26:18.313 INFO:tasks.workunit.client.0.smithi067.stdout:2/222: creat d0/d25/f4e x:0 0 0 2023-12-05T09:26:18.314 INFO:tasks.workunit.client.1.smithi134.stdout:7/391: dread f1 [0,4194304] 0 2023-12-05T09:26:18.314 INFO:tasks.workunit.client.1.smithi134.stdout:7/392: dread - d2/d7/dc/d22/f4a zero size 2023-12-05T09:26:18.315 INFO:tasks.workunit.client.0.smithi067.stdout:0/388: symlink d3/d7/d3c/d6c/d8a/l8e 0 2023-12-05T09:26:18.318 INFO:tasks.workunit.client.1.smithi134.stdout:3/417: write d4/f1b [464088,120000] 0 2023-12-05T09:26:18.319 INFO:tasks.workunit.client.0.smithi067.stdout:9/435: creat d1b/d3e/d7f/f95 x:0 0 0 2023-12-05T09:26:18.321 INFO:tasks.workunit.client.1.smithi134.stdout:4/422: link d16/l26 d16/d18/d1c/d63/l91 0 2023-12-05T09:26:18.321 INFO:tasks.workunit.client.1.smithi134.stdout:4/423: chown d16/d18/d1a/f8c 147403 1 2023-12-05T09:26:18.321 INFO:tasks.workunit.client.1.smithi134.stdout:4/424: dread - d16/d21/d48/f88 zero size 2023-12-05T09:26:18.321 INFO:tasks.workunit.client.0.smithi067.stdout:7/305: dwrite d0/f27 [0,4194304] 0 2023-12-05T09:26:18.322 INFO:tasks.workunit.client.0.smithi067.stdout:2/223: symlink d0/d25/d34/d4d/l4f 0 2023-12-05T09:26:18.322 INFO:tasks.workunit.client.1.smithi134.stdout:8/468: mknod da/de/d11/d1d/d5f/c9e 0 2023-12-05T09:26:18.324 INFO:tasks.workunit.client.0.smithi067.stdout:0/389: creat d3/d7/f8f x:0 0 0 2023-12-05T09:26:18.326 INFO:tasks.workunit.client.0.smithi067.stdout:9/436: mkdir d1b/d25/d54/d5c/d81/d96 0 2023-12-05T09:26:18.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/437: creat d1b/d3e/d7f/f97 x:0 0 0 2023-12-05T09:26:18.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/438: stat d1b/d25/d35/d56/f5a 0 2023-12-05T09:26:18.329 INFO:tasks.workunit.client.0.smithi067.stdout:2/224: read d0/fd [289364,60329] 0 2023-12-05T09:26:18.329 INFO:tasks.workunit.client.0.smithi067.stdout:2/225: fsync d0/fe 0 2023-12-05T09:26:18.330 INFO:tasks.workunit.client.1.smithi134.stdout:0/383: mkdir d13/d14/d59/d86 0 2023-12-05T09:26:18.331 INFO:tasks.workunit.client.1.smithi134.stdout:0/384: write d13/d14/d30/d4b/f42 [984207,60923] 0 2023-12-05T09:26:18.331 INFO:tasks.workunit.client.0.smithi067.stdout:8/272: dwrite d5/f36 [4194304,4194304] 0 2023-12-05T09:26:18.331 INFO:tasks.workunit.client.0.smithi067.stdout:8/273: readlink d5/dc/d1a/d20/d2d/l37 0 2023-12-05T09:26:18.334 INFO:tasks.workunit.client.1.smithi134.stdout:1/499: symlink d2/d27/d40/lb7 0 2023-12-05T09:26:18.336 INFO:tasks.workunit.client.0.smithi067.stdout:2/226: symlink d0/d25/d34/l50 0 2023-12-05T09:26:18.336 INFO:tasks.workunit.client.0.smithi067.stdout:2/227: truncate d0/d10/d1e/f35 583287 0 2023-12-05T09:26:18.336 INFO:tasks.workunit.client.0.smithi067.stdout:2/228: write d0/fd [827282,102169] 0 2023-12-05T09:26:18.342 INFO:tasks.workunit.client.1.smithi134.stdout:5/348: mkdir d0/d1a/d1c/d3f/d5b/d5d/d78/d7b 0 2023-12-05T09:26:18.342 INFO:tasks.workunit.client.1.smithi134.stdout:5/349: chown d0/fc 4079 1 2023-12-05T09:26:18.342 INFO:tasks.workunit.client.1.smithi134.stdout:5/350: chown d0 4 1 2023-12-05T09:26:18.345 INFO:tasks.workunit.client.0.smithi067.stdout:4/227: sync 2023-12-05T09:26:18.346 INFO:tasks.workunit.client.0.smithi067.stdout:2/229: mknod d0/d10/c51 0 2023-12-05T09:26:18.346 INFO:tasks.workunit.client.0.smithi067.stdout:2/230: chown d0/d25/d34 408776 1 2023-12-05T09:26:18.346 INFO:tasks.workunit.client.0.smithi067.stdout:2/231: chown d0/l17 355 1 2023-12-05T09:26:18.346 INFO:tasks.workunit.client.0.smithi067.stdout:2/232: chown d0/d10/c23 592153864 1 2023-12-05T09:26:18.347 INFO:tasks.workunit.client.1.smithi134.stdout:9/384: mkdir d7/d8/d14/d26/d7f 0 2023-12-05T09:26:18.347 INFO:tasks.workunit.client.1.smithi134.stdout:7/393: unlink d2/d7/dc/d2e/f43 0 2023-12-05T09:26:18.347 INFO:tasks.workunit.client.1.smithi134.stdout:7/394: read d2/d7/dc/d22/f27 [3661564,36365] 0 2023-12-05T09:26:18.347 INFO:tasks.workunit.client.1.smithi134.stdout:7/395: write d2/d7/dc/d22/f27 [4150873,98479] 0 2023-12-05T09:26:18.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/396: readlink d2/df/l62 0 2023-12-05T09:26:18.352 INFO:tasks.workunit.client.0.smithi067.stdout:4/228: mkdir d0/d1d/d4d 0 2023-12-05T09:26:18.362 INFO:tasks.workunit.client.1.smithi134.stdout:5/351: dread d0/f43 [0,4194304] 0 2023-12-05T09:26:18.366 INFO:tasks.workunit.client.0.smithi067.stdout:4/229: mkdir d0/d1d/d25/d2c/d34/d4e 0 2023-12-05T09:26:18.368 INFO:tasks.workunit.client.1.smithi134.stdout:8/469: getdents da/de/d4d 0 2023-12-05T09:26:18.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:18 smithi067 ceph-mon[107174]: pgmap v24: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 157 MiB/s rd, 189 MiB/s wr, 700 op/s 2023-12-05T09:26:18.370 INFO:tasks.workunit.client.1.smithi134.stdout:1/500: mkdir d2/d27/d71/d80/db8 0 2023-12-05T09:26:18.370 INFO:tasks.workunit.client.1.smithi134.stdout:1/501: chown d2/d9/d10 144256 1 2023-12-05T09:26:18.373 INFO:tasks.workunit.client.1.smithi134.stdout:7/397: symlink d2/df/d2a/l83 0 2023-12-05T09:26:18.373 INFO:tasks.workunit.client.1.smithi134.stdout:7/398: fsync d2/dd/f47 0 2023-12-05T09:26:18.374 INFO:tasks.workunit.client.1.smithi134.stdout:6/380: rename d4/d2a to d4/d39/d42/d4f/d6d 0 2023-12-05T09:26:18.375 INFO:tasks.workunit.client.1.smithi134.stdout:6/381: creat d4/d32/d57/f6e x:0 0 0 2023-12-05T09:26:18.375 INFO:tasks.workunit.client.0.smithi067.stdout:4/230: mknod d0/d9/c4f 0 2023-12-05T09:26:18.376 INFO:tasks.workunit.client.1.smithi134.stdout:4/425: rmdir d16/d18/d1c/d63 39 2023-12-05T09:26:18.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:18 smithi134 ceph-mon[116304]: pgmap v24: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 157 MiB/s rd, 189 MiB/s wr, 700 op/s 2023-12-05T09:26:18.383 INFO:tasks.workunit.client.1.smithi134.stdout:8/470: link da/de/d11/f30 da/de/d11/d1d/d5f/d9b/f9f 0 2023-12-05T09:26:18.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/502: creat d2/d9/d10/d94/fb9 x:0 0 0 2023-12-05T09:26:18.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/503: write d2/d9/f2c [194724,74701] 0 2023-12-05T09:26:18.388 INFO:tasks.workunit.client.1.smithi134.stdout:3/418: dwrite d4/d5/f1e [0,4194304] 0 2023-12-05T09:26:18.388 INFO:tasks.workunit.client.1.smithi134.stdout:3/419: fdatasync d4/d5/d45/d60/f72 0 2023-12-05T09:26:18.389 INFO:tasks.workunit.client.1.smithi134.stdout:7/399: mknod d2/d7/dc/d2e/c84 0 2023-12-05T09:26:18.391 INFO:tasks.workunit.client.1.smithi134.stdout:2/433: dwrite d19/d28/f39 [0,4194304] 0 2023-12-05T09:26:18.391 INFO:tasks.workunit.client.1.smithi134.stdout:2/434: write d19/d28/d63/f7c [307584,96050] 0 2023-12-05T09:26:18.391 INFO:tasks.workunit.client.1.smithi134.stdout:2/435: truncate d19/f20 1967494 0 2023-12-05T09:26:18.391 INFO:tasks.workunit.client.1.smithi134.stdout:2/436: stat d19/c22 0 2023-12-05T09:26:18.392 INFO:tasks.workunit.client.1.smithi134.stdout:2/437: chown d19/c1a 49852221 1 2023-12-05T09:26:18.392 INFO:tasks.workunit.client.0.smithi067.stdout:9/439: dwrite d1b/d25/d54/d5c/d6a/d6c/d76/f8a [0,4194304] 0 2023-12-05T09:26:18.392 INFO:tasks.workunit.client.1.smithi134.stdout:6/382: symlink d4/d39/d42/d4f/d6d/l6f 0 2023-12-05T09:26:18.393 INFO:tasks.workunit.client.1.smithi134.stdout:6/383: write d4/d39/d42/d4f/d6d/f48 [880670,47895] 0 2023-12-05T09:26:18.393 INFO:tasks.workunit.client.1.smithi134.stdout:6/384: write d4/d39/d42/d4f/d6d/d3a/f54 [222751,53100] 0 2023-12-05T09:26:18.393 INFO:tasks.workunit.client.1.smithi134.stdout:6/385: stat d4/d39/d42/d4f/d6d/d3a/c5e 0 2023-12-05T09:26:18.397 INFO:tasks.workunit.client.1.smithi134.stdout:7/400: dread d2/d7/dc/d2e/d3a/f3b [0,4194304] 0 2023-12-05T09:26:18.398 INFO:tasks.workunit.client.1.smithi134.stdout:9/385: dwrite d7/d5b/d5e/f6c [0,4194304] 0 2023-12-05T09:26:18.398 INFO:tasks.workunit.client.0.smithi067.stdout:7/306: dwrite d0/f42 [0,4194304] 0 2023-12-05T09:26:18.401 INFO:tasks.workunit.client.1.smithi134.stdout:8/471: truncate f2 802884 0 2023-12-05T09:26:18.403 INFO:tasks.workunit.client.0.smithi067.stdout:4/231: rename d0/d9/d12 to d0/d1d/d2b/d50 0 2023-12-05T09:26:18.407 INFO:tasks.workunit.client.1.smithi134.stdout:1/504: unlink d2/d27/d40/f89 0 2023-12-05T09:26:18.407 INFO:tasks.workunit.client.1.smithi134.stdout:1/505: chown d2/d27/d71/fa3 992160943 1 2023-12-05T09:26:18.407 INFO:tasks.workunit.client.1.smithi134.stdout:1/506: chown d2/d9/d10/l4c 8211925 1 2023-12-05T09:26:18.413 INFO:tasks.workunit.client.0.smithi067.stdout:9/440: rename d1b/d25/d54/d5c/d6a/d6c/d76/f89 to d1b/d25/d54/d5c/f98 0 2023-12-05T09:26:18.413 INFO:tasks.workunit.client.0.smithi067.stdout:7/307: symlink d0/d9/d10/l62 0 2023-12-05T09:26:18.413 INFO:tasks.workunit.client.0.smithi067.stdout:9/441: fsync d1b/d3e/d7f/f97 0 2023-12-05T09:26:18.415 INFO:tasks.workunit.client.0.smithi067.stdout:7/308: creat d0/d9/d40/d48/f63 x:0 0 0 2023-12-05T09:26:18.417 INFO:tasks.workunit.client.0.smithi067.stdout:9/442: symlink d1b/d3e/l99 0 2023-12-05T09:26:18.421 INFO:tasks.workunit.client.0.smithi067.stdout:9/443: creat d1b/d25/d54/d5c/d6a/d82/f9a x:0 0 0 2023-12-05T09:26:18.424 INFO:tasks.workunit.client.0.smithi067.stdout:9/444: mkdir d1b/d25/d35/d9b 0 2023-12-05T09:26:18.426 INFO:tasks.workunit.client.1.smithi134.stdout:0/385: rename d13/d14/d15/f62 to d13/d14/f87 0 2023-12-05T09:26:18.428 INFO:tasks.workunit.client.1.smithi134.stdout:7/401: creat d2/d7/dc/d22/f85 x:0 0 0 2023-12-05T09:26:18.444 INFO:tasks.workunit.client.1.smithi134.stdout:8/472: symlink da/la0 0 2023-12-05T09:26:18.447 INFO:tasks.workunit.client.1.smithi134.stdout:4/426: rename d16/d7b/f51 to d16/d18/f92 0 2023-12-05T09:26:18.447 INFO:tasks.workunit.client.1.smithi134.stdout:9/386: dwrite d7/d8/d14/f54 [0,4194304] 0 2023-12-05T09:26:18.449 INFO:tasks.workunit.client.1.smithi134.stdout:7/402: mknod d2/d7/d2b/d2d/d67/d73/c86 0 2023-12-05T09:26:18.450 INFO:tasks.workunit.client.1.smithi134.stdout:1/507: getdents d2/d9/d10/d94 0 2023-12-05T09:26:18.450 INFO:tasks.workunit.client.1.smithi134.stdout:1/508: truncate d2/d9/d10/d5b/d5e/fa8 336062 0 2023-12-05T09:26:18.451 INFO:tasks.workunit.client.1.smithi134.stdout:1/509: stat d2/d9/d10/l12 0 2023-12-05T09:26:18.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/420: rename d4/d1f/c63 to d4/d5/c87 0 2023-12-05T09:26:18.452 INFO:tasks.workunit.client.1.smithi134.stdout:9/387: mknod d7/d7d/c80 0 2023-12-05T09:26:18.453 INFO:tasks.workunit.client.1.smithi134.stdout:9/388: write d7/d5b/d5e/f64 [912066,5213] 0 2023-12-05T09:26:18.454 INFO:tasks.workunit.client.1.smithi134.stdout:7/403: unlink d2/dd/f47 0 2023-12-05T09:26:18.456 INFO:tasks.workunit.client.1.smithi134.stdout:1/510: creat d2/d9/d10/d30/d66/d9b/fba x:0 0 0 2023-12-05T09:26:18.456 INFO:tasks.workunit.client.1.smithi134.stdout:1/511: read d2/d27/f3a [3967540,3086] 0 2023-12-05T09:26:18.457 INFO:tasks.workunit.client.1.smithi134.stdout:1/512: fsync d2/d9/f1b 0 2023-12-05T09:26:18.459 INFO:tasks.workunit.client.1.smithi134.stdout:8/473: rename da/de/d16/d2d/f85 to da/de/d96/fa1 0 2023-12-05T09:26:18.460 INFO:tasks.workunit.client.1.smithi134.stdout:9/389: mknod d7/d8/d14/d26/d7f/c81 0 2023-12-05T09:26:18.460 INFO:tasks.workunit.client.1.smithi134.stdout:3/421: truncate d4/d1f/f20 304536 0 2023-12-05T09:26:18.462 INFO:tasks.workunit.client.1.smithi134.stdout:4/427: rename d16/d21/d47/d4b/l86 to d16/d7b/l93 0 2023-12-05T09:26:18.463 INFO:tasks.workunit.client.1.smithi134.stdout:0/386: dwrite d13/d14/d15/f21 [0,4194304] 0 2023-12-05T09:26:18.464 INFO:tasks.workunit.client.1.smithi134.stdout:9/390: unlink d7/d10/d4b/c6b 0 2023-12-05T09:26:18.464 INFO:tasks.workunit.client.1.smithi134.stdout:9/391: chown d7/d8/d16/l78 39 1 2023-12-05T09:26:18.464 INFO:tasks.workunit.client.1.smithi134.stdout:9/392: chown d7/d10/d4b/d53/f63 20 1 2023-12-05T09:26:18.465 INFO:tasks.workunit.client.1.smithi134.stdout:4/428: symlink d16/d18/d1c/d63/l94 0 2023-12-05T09:26:18.474 INFO:tasks.workunit.client.0.smithi067.stdout:4/232: dwrite d0/d1d/d25/f29 [0,4194304] 0 2023-12-05T09:26:18.482 INFO:tasks.workunit.client.0.smithi067.stdout:4/233: mkdir d0/d1d/d3c/d51 0 2023-12-05T09:26:18.486 INFO:tasks.workunit.client.1.smithi134.stdout:0/387: write d13/d14/f6c [649669,21498] 0 2023-12-05T09:26:18.487 INFO:tasks.workunit.client.0.smithi067.stdout:4/234: link d0/d1d/d25/f29 d0/d1d/d25/d2c/d34/d4e/f52 0 2023-12-05T09:26:18.487 INFO:tasks.workunit.client.0.smithi067.stdout:4/235: stat d0/d1d/d25/d32 0 2023-12-05T09:26:18.488 INFO:tasks.workunit.client.1.smithi134.stdout:9/393: creat d7/d7d/f82 x:0 0 0 2023-12-05T09:26:18.490 INFO:tasks.workunit.client.1.smithi134.stdout:1/513: dread d2/d9/d10/f67 [0,4194304] 0 2023-12-05T09:26:18.491 INFO:tasks.workunit.client.1.smithi134.stdout:4/429: symlink d16/d21/d35/l95 0 2023-12-05T09:26:18.491 INFO:tasks.workunit.client.1.smithi134.stdout:4/430: write d16/d21/d48/f34 [4727155,13607] 0 2023-12-05T09:26:18.493 INFO:tasks.workunit.client.0.smithi067.stdout:4/236: mkdir d0/d1d/d53 0 2023-12-05T09:26:18.494 INFO:tasks.workunit.client.0.smithi067.stdout:4/237: readlink d0/d1d/d25/d32/l1b 0 2023-12-05T09:26:18.494 INFO:tasks.workunit.client.1.smithi134.stdout:3/422: dread d4/d1f/d4e/f65 [0,4194304] 0 2023-12-05T09:26:18.494 INFO:tasks.workunit.client.1.smithi134.stdout:3/423: fdatasync d4/f6b 0 2023-12-05T09:26:18.494 INFO:tasks.workunit.client.1.smithi134.stdout:3/424: truncate d4/d5/d6f/f68 1026602 0 2023-12-05T09:26:18.498 INFO:tasks.workunit.client.1.smithi134.stdout:0/388: link d13/d14/d15/d2a/f3e d13/d14/d30/f88 0 2023-12-05T09:26:18.499 INFO:tasks.workunit.client.1.smithi134.stdout:0/389: stat d13/d14/f6c 0 2023-12-05T09:26:18.499 INFO:tasks.workunit.client.1.smithi134.stdout:7/404: dwrite d2/d7/dc/d22/f85 [0,4194304] 0 2023-12-05T09:26:18.500 INFO:tasks.workunit.client.1.smithi134.stdout:9/394: symlink d7/d8/d16/d52/d74/l83 0 2023-12-05T09:26:18.504 INFO:tasks.workunit.client.0.smithi067.stdout:4/238: symlink d0/d1d/l54 0 2023-12-05T09:26:18.504 INFO:tasks.workunit.client.0.smithi067.stdout:4/239: read d0/d1d/d2b/d50/f14 [2616712,68810] 0 2023-12-05T09:26:18.504 INFO:tasks.workunit.client.0.smithi067.stdout:4/240: chown d0/d1d/d25/d32/f3f 1145751127 1 2023-12-05T09:26:18.504 INFO:tasks.workunit.client.1.smithi134.stdout:1/514: mknod d2/d27/d71/cbb 0 2023-12-05T09:26:18.506 INFO:tasks.workunit.client.1.smithi134.stdout:4/431: creat d16/d21/d47/f96 x:0 0 0 2023-12-05T09:26:18.506 INFO:tasks.workunit.client.1.smithi134.stdout:4/432: write d16/d18/d1b/f31 [2648260,105354] 0 2023-12-05T09:26:18.506 INFO:tasks.workunit.client.1.smithi134.stdout:3/425: rmdir d4/d1f/d50/d52/d42 39 2023-12-05T09:26:18.510 INFO:tasks.workunit.client.1.smithi134.stdout:5/352: sync 2023-12-05T09:26:18.510 INFO:tasks.workunit.client.1.smithi134.stdout:6/386: sync 2023-12-05T09:26:18.510 INFO:tasks.workunit.client.1.smithi134.stdout:2/438: sync 2023-12-05T09:26:18.510 INFO:tasks.workunit.client.1.smithi134.stdout:2/439: write d19/f34 [962718,31374] 0 2023-12-05T09:26:18.510 INFO:tasks.workunit.client.1.smithi134.stdout:2/440: write d19/f2c [1704742,104570] 0 2023-12-05T09:26:18.513 INFO:tasks.workunit.client.1.smithi134.stdout:0/390: mkdir d13/d14/d59/d86/d89 0 2023-12-05T09:26:18.513 INFO:tasks.workunit.client.1.smithi134.stdout:0/391: dread - d13/d14/d15/d2a/f74 zero size 2023-12-05T09:26:18.513 INFO:tasks.workunit.client.1.smithi134.stdout:0/392: write d13/d14/f6c [1144198,71607] 0 2023-12-05T09:26:18.517 INFO:tasks.workunit.client.1.smithi134.stdout:7/405: mkdir d2/d7/d2b/d2d/d67/d87 0 2023-12-05T09:26:18.520 INFO:tasks.workunit.client.1.smithi134.stdout:4/433: link d16/d21/f7c d16/d18/d1b/f97 0 2023-12-05T09:26:18.523 INFO:tasks.workunit.client.1.smithi134.stdout:3/426: truncate d4/d1f/f35 1391551 0 2023-12-05T09:26:18.523 INFO:tasks.workunit.client.1.smithi134.stdout:3/427: write d4/d1f/f5d [902781,75941] 0 2023-12-05T09:26:18.523 INFO:tasks.workunit.client.1.smithi134.stdout:3/428: dread - d4/d5/d45/f4d zero size 2023-12-05T09:26:18.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/441: symlink d19/d28/d2b/l8a 0 2023-12-05T09:26:18.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/442: dread - d19/d3f/f58 zero size 2023-12-05T09:26:18.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/443: write d19/d28/d2b/f4b [1496695,54249] 0 2023-12-05T09:26:18.526 INFO:tasks.workunit.client.1.smithi134.stdout:0/393: mknod d13/d14/d30/c8a 0 2023-12-05T09:26:18.526 INFO:tasks.workunit.client.1.smithi134.stdout:0/394: chown d13/f17 11306901 1 2023-12-05T09:26:18.530 INFO:tasks.workunit.client.1.smithi134.stdout:7/406: symlink d2/d7/d65/l88 0 2023-12-05T09:26:18.531 INFO:tasks.workunit.client.1.smithi134.stdout:7/407: chown d2/d7/dc/d2e/d3a 1717608 1 2023-12-05T09:26:18.532 INFO:tasks.workunit.client.1.smithi134.stdout:9/395: getdents d7/d10/d4b 0 2023-12-05T09:26:18.533 INFO:tasks.workunit.client.1.smithi134.stdout:2/444: rmdir d19/d49 39 2023-12-05T09:26:18.536 INFO:tasks.workunit.client.1.smithi134.stdout:0/395: unlink d13/d14/d30/f57 0 2023-12-05T09:26:18.537 INFO:tasks.workunit.client.1.smithi134.stdout:0/396: write d13/d14/d15/d2a/f74 [977873,78822] 0 2023-12-05T09:26:18.539 INFO:tasks.workunit.client.1.smithi134.stdout:7/408: rename d2/d7/d2b/f55 to d2/d7/dc/d2e/f89 0 2023-12-05T09:26:18.543 INFO:tasks.workunit.client.1.smithi134.stdout:9/396: truncate d7/d8/d14/f46 509618 0 2023-12-05T09:26:18.545 INFO:tasks.workunit.client.1.smithi134.stdout:0/397: rename d13/d14/d15/d2a/f64 to d13/d14/d30/d2c/f8b 0 2023-12-05T09:26:18.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/398: readlink d13/d14/d15/d67/l51 0 2023-12-05T09:26:18.546 INFO:tasks.workunit.client.1.smithi134.stdout:8/474: dwrite da/de/d16/d33/f81 [0,4194304] 0 2023-12-05T09:26:18.546 INFO:tasks.workunit.client.1.smithi134.stdout:7/409: mknod d2/d7/dc/d2e/d3a/d6d/c8a 0 2023-12-05T09:26:18.551 INFO:tasks.workunit.client.1.smithi134.stdout:0/399: unlink d13/d14/d15/f69 0 2023-12-05T09:26:18.553 INFO:tasks.workunit.client.1.smithi134.stdout:7/410: link d2/df/d2a/d63/f77 d2/dd/d1a/f8b 0 2023-12-05T09:26:18.556 INFO:tasks.workunit.client.1.smithi134.stdout:0/400: unlink d13/d14/d15/d67/l51 0 2023-12-05T09:26:18.558 INFO:tasks.workunit.client.1.smithi134.stdout:7/411: unlink d2/d7/d2b/d2d/d67/d73/d26/f35 0 2023-12-05T09:26:18.560 INFO:tasks.workunit.client.0.smithi067.stdout:5/254: sync 2023-12-05T09:26:18.560 INFO:tasks.workunit.client.0.smithi067.stdout:3/201: sync 2023-12-05T09:26:18.564 INFO:tasks.workunit.client.1.smithi134.stdout:1/515: dwrite d2/d9/d10/d5b/d5e/f6d [0,4194304] 0 2023-12-05T09:26:18.568 INFO:tasks.workunit.client.1.smithi134.stdout:3/429: write d4/d5/d45/f5b [3116377,60918] 0 2023-12-05T09:26:18.568 INFO:tasks.workunit.client.1.smithi134.stdout:3/430: fdatasync d4/d1f/d50/d52/f58 0 2023-12-05T09:26:18.568 INFO:tasks.workunit.client.1.smithi134.stdout:3/431: stat d4/f2f 0 2023-12-05T09:26:18.568 INFO:tasks.workunit.client.0.smithi067.stdout:3/202: rmdir d9/da/d15/d17/d2b 39 2023-12-05T09:26:18.569 INFO:tasks.workunit.client.1.smithi134.stdout:5/353: dwrite d0/d11/f15 [0,4194304] 0 2023-12-05T09:26:18.569 INFO:tasks.workunit.client.1.smithi134.stdout:5/354: write d0/dd/d37/f53 [1061351,17280] 0 2023-12-05T09:26:18.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/203: symlink d9/da/d15/d28/l46 0 2023-12-05T09:26:18.579 INFO:tasks.workunit.client.1.smithi134.stdout:4/434: dwrite d16/d18/d5b/f6c [0,4194304] 0 2023-12-05T09:26:18.579 INFO:tasks.workunit.client.1.smithi134.stdout:4/435: stat d16/d18/d5b 0 2023-12-05T09:26:18.579 INFO:tasks.workunit.client.1.smithi134.stdout:4/436: stat d16/d21/l44 0 2023-12-05T09:26:18.579 INFO:tasks.workunit.client.1.smithi134.stdout:4/437: chown d16/l6a 0 1 2023-12-05T09:26:18.579 INFO:tasks.workunit.client.1.smithi134.stdout:4/438: write d16/d21/d48/f34 [133577,53206] 0 2023-12-05T09:26:18.584 INFO:tasks.workunit.client.1.smithi134.stdout:0/401: dread d13/f35 [0,4194304] 0 2023-12-05T09:26:18.584 INFO:tasks.workunit.client.1.smithi134.stdout:4/439: symlink d16/d18/d1c/d63/l98 0 2023-12-05T09:26:18.584 INFO:tasks.workunit.client.1.smithi134.stdout:4/440: readlink d16/d21/d48/d66/l7f 0 2023-12-05T09:26:18.585 INFO:tasks.workunit.client.1.smithi134.stdout:4/441: chown d16/d21/d69/d6e/f8f 1021751 1 2023-12-05T09:26:18.587 INFO:tasks.workunit.client.1.smithi134.stdout:9/397: write d7/d5b/d5e/f6c [3041564,34524] 0 2023-12-05T09:26:18.587 INFO:tasks.workunit.client.1.smithi134.stdout:3/432: truncate f0 42935 0 2023-12-05T09:26:18.589 INFO:tasks.workunit.client.0.smithi067.stdout:4/241: dwrite d0/f41 [0,4194304] 0 2023-12-05T09:26:18.589 INFO:tasks.workunit.client.0.smithi067.stdout:4/242: creat d0/d1d/d25/d2c/d34/f55 x:0 0 0 2023-12-05T09:26:18.590 INFO:tasks.workunit.client.1.smithi134.stdout:5/355: dread d0/d45/f5a [0,4194304] 0 2023-12-05T09:26:18.606 INFO:tasks.workunit.client.1.smithi134.stdout:2/445: dwrite d19/d28/d2b/f4b [0,4194304] 0 2023-12-05T09:26:18.606 INFO:tasks.workunit.client.1.smithi134.stdout:0/402: dread f3 [0,4194304] 0 2023-12-05T09:26:18.606 INFO:tasks.workunit.client.1.smithi134.stdout:0/403: fsync d13/d14/d15/d67/d73/f80 0 2023-12-05T09:26:18.606 INFO:tasks.workunit.client.1.smithi134.stdout:2/446: write d19/d28/d63/d70/f74 [115941,34275] 0 2023-12-05T09:26:18.606 INFO:tasks.workunit.client.1.smithi134.stdout:2/447: chown d19/d28/f30 132593280 1 2023-12-05T09:26:18.606 INFO:tasks.workunit.client.1.smithi134.stdout:2/448: chown d19/d3f/f5a 16331935 1 2023-12-05T09:26:18.606 INFO:tasks.workunit.client.1.smithi134.stdout:2/449: fsync d19/d28/d2b/f64 0 2023-12-05T09:26:18.617 INFO:tasks.workunit.client.1.smithi134.stdout:7/412: getdents d2/dd/d1a 0 2023-12-05T09:26:18.617 INFO:tasks.workunit.client.1.smithi134.stdout:9/398: dread d7/d8/d16/f1f [0,4194304] 0 2023-12-05T09:26:18.617 INFO:tasks.workunit.client.1.smithi134.stdout:3/433: getdents d4/d5/d45/d60 0 2023-12-05T09:26:18.617 INFO:tasks.workunit.client.1.smithi134.stdout:3/434: chown d4/d1f/d50/d52/d42 6 1 2023-12-05T09:26:18.617 INFO:tasks.workunit.client.1.smithi134.stdout:9/399: write d7/d7d/f82 [373521,41558] 0 2023-12-05T09:26:18.617 INFO:tasks.workunit.client.1.smithi134.stdout:9/400: fsync d7/f47 0 2023-12-05T09:26:18.617 INFO:tasks.workunit.client.1.smithi134.stdout:9/401: fsync d7/d8/d14/d26/f4a 0 2023-12-05T09:26:18.624 INFO:tasks.workunit.client.1.smithi134.stdout:0/404: dread d13/d14/d30/d2c/f47 [0,4194304] 0 2023-12-05T09:26:18.626 INFO:tasks.workunit.client.0.smithi067.stdout:5/255: dwrite db/df/d1a/d1d/d20/f37 [0,4194304] 0 2023-12-05T09:26:18.631 INFO:tasks.workunit.client.1.smithi134.stdout:9/402: dread d7/d10/d4b/f57 [0,4194304] 0 2023-12-05T09:26:18.631 INFO:tasks.workunit.client.1.smithi134.stdout:2/450: rename d19/d28/d63/d70/c79 to d19/d3f/c8b 0 2023-12-05T09:26:18.632 INFO:tasks.workunit.client.1.smithi134.stdout:5/356: write d0/fc [7170423,13419] 0 2023-12-05T09:26:18.632 INFO:tasks.workunit.client.1.smithi134.stdout:7/413: unlink d2/d7/d2b/d2d/d67/d73/l7c 0 2023-12-05T09:26:18.632 INFO:tasks.workunit.client.1.smithi134.stdout:7/414: chown d2/d7/dc/d2e/d3a/d6d 403352 1 2023-12-05T09:26:18.632 INFO:tasks.workunit.client.1.smithi134.stdout:8/475: dwrite da/de/d8a/f6e [0,4194304] 0 2023-12-05T09:26:18.632 INFO:tasks.workunit.client.1.smithi134.stdout:9/403: truncate d7/f47 882205 0 2023-12-05T09:26:18.632 INFO:tasks.workunit.client.1.smithi134.stdout:0/405: mkdir d13/d14/d15/d2a/d8c 0 2023-12-05T09:26:18.632 INFO:tasks.workunit.client.1.smithi134.stdout:9/404: creat d7/d8/f84 x:0 0 0 2023-12-05T09:26:18.633 INFO:tasks.workunit.client.1.smithi134.stdout:9/405: write d7/d7d/f82 [412132,115157] 0 2023-12-05T09:26:18.633 INFO:tasks.workunit.client.1.smithi134.stdout:3/435: creat d4/d1f/d50/d52/f88 x:0 0 0 2023-12-05T09:26:18.633 INFO:tasks.workunit.client.1.smithi134.stdout:3/436: chown d4/d1f/f5d 8 1 2023-12-05T09:26:18.633 INFO:tasks.workunit.client.1.smithi134.stdout:2/451: symlink d19/d76/l8c 0 2023-12-05T09:26:18.633 INFO:tasks.workunit.client.1.smithi134.stdout:2/452: chown d19/d49 1 1 2023-12-05T09:26:18.637 INFO:tasks.workunit.client.1.smithi134.stdout:7/415: rename d2/d7/f37 to d2/d7/dc/d2e/f8c 0 2023-12-05T09:26:18.638 INFO:tasks.workunit.client.1.smithi134.stdout:7/416: readlink d2/d7/d2b/d2d/d67/d73/d26/l5a 0 2023-12-05T09:26:18.638 INFO:tasks.workunit.client.1.smithi134.stdout:8/476: mkdir da/de/d8a/d42/da2 0 2023-12-05T09:26:18.639 INFO:tasks.workunit.client.1.smithi134.stdout:3/437: mknod d4/d5/d45/d60/c89 0 2023-12-05T09:26:18.641 INFO:tasks.workunit.client.1.smithi134.stdout:3/438: truncate d4/d1f/f25 1813286 0 2023-12-05T09:26:18.641 INFO:tasks.workunit.client.1.smithi134.stdout:3/439: read - d4/f6b zero size 2023-12-05T09:26:18.643 INFO:tasks.workunit.client.1.smithi134.stdout:2/453: truncate d19/d28/f41 301745 0 2023-12-05T09:26:18.643 INFO:tasks.workunit.client.1.smithi134.stdout:1/516: dwrite d2/d9/f44 [0,4194304] 0 2023-12-05T09:26:18.645 INFO:tasks.workunit.client.1.smithi134.stdout:3/440: mkdir d4/d5/d45/d60/d8a 0 2023-12-05T09:26:18.645 INFO:tasks.workunit.client.1.smithi134.stdout:3/441: chown d4/d1f/f5d 120 1 2023-12-05T09:26:18.650 INFO:tasks.workunit.client.0.smithi067.stdout:3/204: dwrite f3 [0,4194304] 0 2023-12-05T09:26:18.657 INFO:tasks.workunit.client.0.smithi067.stdout:3/205: getdents d9 0 2023-12-05T09:26:18.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/357: dread d0/dd/f2c [0,4194304] 0 2023-12-05T09:26:18.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/358: write d0/f55 [122902,32027] 0 2023-12-05T09:26:18.659 INFO:tasks.workunit.client.1.smithi134.stdout:2/454: mknod d19/d28/d63/d70/c8d 0 2023-12-05T09:26:18.659 INFO:tasks.workunit.client.1.smithi134.stdout:2/455: dread - d19/d28/d31/f7e zero size 2023-12-05T09:26:18.667 INFO:tasks.workunit.client.1.smithi134.stdout:1/517: mknod d2/d9/d10/d30/d4a/d81/cbc 0 2023-12-05T09:26:18.667 INFO:tasks.workunit.client.1.smithi134.stdout:9/406: dread d7/d5b/d5e/f6c [0,4194304] 0 2023-12-05T09:26:18.667 INFO:tasks.workunit.client.1.smithi134.stdout:5/359: mknod d0/d1a/d1c/d25/c7c 0 2023-12-05T09:26:18.667 INFO:tasks.workunit.client.1.smithi134.stdout:5/360: write d0/f7 [956880,7913] 0 2023-12-05T09:26:18.667 INFO:tasks.workunit.client.1.smithi134.stdout:1/518: fsync d2/d27/f54 0 2023-12-05T09:26:18.669 INFO:tasks.workunit.client.1.smithi134.stdout:5/361: mkdir d0/dd/d37/d7d 0 2023-12-05T09:26:18.669 INFO:tasks.workunit.client.1.smithi134.stdout:5/362: fdatasync d0/d11/f1e 0 2023-12-05T09:26:18.670 INFO:tasks.workunit.client.1.smithi134.stdout:1/519: creat d2/d9/d10/d30/d66/da9/d74/d99/fbd x:0 0 0 2023-12-05T09:26:18.670 INFO:tasks.workunit.client.1.smithi134.stdout:1/520: chown d2/d9/c1c 60516772 1 2023-12-05T09:26:18.671 INFO:tasks.workunit.client.1.smithi134.stdout:1/521: fdatasync d2/d9/f2d 0 2023-12-05T09:26:18.672 INFO:tasks.workunit.client.0.smithi067.stdout:4/243: dwrite d0/d1d/d2b/d50/d15/f33 [0,4194304] 0 2023-12-05T09:26:18.672 INFO:tasks.workunit.client.0.smithi067.stdout:4/244: chown d0/d1d/d25/d32/c46 8073982 1 2023-12-05T09:26:18.672 INFO:tasks.workunit.client.1.smithi134.stdout:4/442: dwrite d16/d21/d47/f96 [0,4194304] 0 2023-12-05T09:26:18.682 INFO:tasks.workunit.client.1.smithi134.stdout:5/363: rename d0/l12 to d0/d11/d61/d75/l7e 0 2023-12-05T09:26:18.683 INFO:tasks.workunit.client.1.smithi134.stdout:5/364: fsync d0/d1a/d3a/f58 0 2023-12-05T09:26:18.683 INFO:tasks.workunit.client.1.smithi134.stdout:5/365: readlink d0/d1a/d1c/l48 0 2023-12-05T09:26:18.684 INFO:tasks.workunit.client.0.smithi067.stdout:3/206: dread d9/f43 [0,4194304] 0 2023-12-05T09:26:18.690 INFO:tasks.workunit.client.1.smithi134.stdout:4/443: link d16/d18/d1a/d3b/l56 d16/d21/d48/d66/l99 0 2023-12-05T09:26:18.690 INFO:tasks.workunit.client.1.smithi134.stdout:7/417: dwrite f1 [4194304,4194304] 0 2023-12-05T09:26:18.693 INFO:tasks.workunit.client.0.smithi067.stdout:5/256: dwrite db/df/d1a/d1d/f23 [0,4194304] 0 2023-12-05T09:26:18.696 INFO:tasks.workunit.client.1.smithi134.stdout:4/444: mknod d16/d18/d1a/c9a 0 2023-12-05T09:26:18.696 INFO:tasks.workunit.client.1.smithi134.stdout:4/445: chown d16/d21/d48 768416173 1 2023-12-05T09:26:18.703 INFO:tasks.workunit.client.1.smithi134.stdout:0/406: dwrite d13/d14/d15/f21 [4194304,4194304] 0 2023-12-05T09:26:18.710 INFO:tasks.workunit.client.1.smithi134.stdout:7/418: rmdir d2/df 39 2023-12-05T09:26:18.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/387: sync 2023-12-05T09:26:18.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/388: fsync d4/f6b 0 2023-12-05T09:26:18.710 INFO:tasks.workunit.client.1.smithi134.stdout:9/407: dread d7/d10/f37 [4194304,4194304] 0 2023-12-05T09:26:18.710 INFO:tasks.workunit.client.1.smithi134.stdout:3/442: dwrite d4/d5/d45/f78 [0,4194304] 0 2023-12-05T09:26:18.710 INFO:tasks.workunit.client.1.smithi134.stdout:3/443: truncate d4/d80/f84 252094 0 2023-12-05T09:26:18.713 INFO:tasks.workunit.client.1.smithi134.stdout:8/477: dwrite da/de/d8a/f6e [0,4194304] 0 2023-12-05T09:26:18.714 INFO:tasks.workunit.client.1.smithi134.stdout:9/408: mknod d7/d8/d14/d26/c85 0 2023-12-05T09:26:18.714 INFO:tasks.workunit.client.1.smithi134.stdout:9/409: readlink d7/d10/l22 0 2023-12-05T09:26:18.714 INFO:tasks.workunit.client.1.smithi134.stdout:9/410: write d7/d8/d14/d26/f3e [298831,97879] 0 2023-12-05T09:26:18.717 INFO:tasks.workunit.client.1.smithi134.stdout:3/444: symlink d4/d5/d45/l8b 0 2023-12-05T09:26:18.719 INFO:tasks.workunit.client.1.smithi134.stdout:2/456: dwrite d19/d28/d31/f3c [0,4194304] 0 2023-12-05T09:26:18.719 INFO:tasks.workunit.client.1.smithi134.stdout:0/407: getdents d13/d14/d15/d67 0 2023-12-05T09:26:18.723 INFO:tasks.workunit.client.1.smithi134.stdout:8/478: creat da/de/d43/fa3 x:0 0 0 2023-12-05T09:26:18.724 INFO:tasks.workunit.client.1.smithi134.stdout:6/389: symlink d4/d39/d42/d4f/d6d/d3a/da/l70 0 2023-12-05T09:26:18.725 INFO:tasks.workunit.client.0.smithi067.stdout:5/257: write db/df/d1a/d1d/d20/f2d [1326751,90083] 0 2023-12-05T09:26:18.726 INFO:tasks.workunit.client.1.smithi134.stdout:4/446: dread d16/d18/d1a/f3e [0,4194304] 0 2023-12-05T09:26:18.726 INFO:tasks.workunit.client.1.smithi134.stdout:4/447: creat d16/d18/d1b/f9b x:0 0 0 2023-12-05T09:26:18.726 INFO:tasks.workunit.client.1.smithi134.stdout:9/411: rename d7/d8/d14/l5c to d7/d10/d4b/l86 0 2023-12-05T09:26:18.727 INFO:tasks.workunit.client.1.smithi134.stdout:3/445: mkdir d4/d5/d45/d60/d8a/d8c 0 2023-12-05T09:26:18.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/408: creat d13/d14/d30/d4b/f8d x:0 0 0 2023-12-05T09:26:18.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/409: read - d13/d14/d15/d2a/f58 zero size 2023-12-05T09:26:18.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/410: readlink d13/d14/d15/l6a 0 2023-12-05T09:26:18.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/411: write d13/d14/d30/f7e [820231,77885] 0 2023-12-05T09:26:18.733 INFO:tasks.workunit.client.1.smithi134.stdout:8/479: symlink da/de/d16/d2d/la4 0 2023-12-05T09:26:18.734 INFO:tasks.workunit.client.0.smithi067.stdout:5/258: dread db/df/d1a/f21 [0,4194304] 0 2023-12-05T09:26:18.734 INFO:tasks.workunit.client.0.smithi067.stdout:5/259: fdatasync f9 0 2023-12-05T09:26:18.736 INFO:tasks.workunit.client.1.smithi134.stdout:4/448: mkdir d16/d9c 0 2023-12-05T09:26:18.739 INFO:tasks.workunit.client.1.smithi134.stdout:2/457: rename f10 to d19/d49/f8e 0 2023-12-05T09:26:18.739 INFO:tasks.workunit.client.1.smithi134.stdout:2/458: write f12 [1483682,39716] 0 2023-12-05T09:26:18.739 INFO:tasks.workunit.client.1.smithi134.stdout:6/390: dread d4/d39/d42/d4f/d6d/f48 [0,4194304] 0 2023-12-05T09:26:18.739 INFO:tasks.workunit.client.1.smithi134.stdout:2/459: chown d19/f35 314046 1 2023-12-05T09:26:18.739 INFO:tasks.workunit.client.0.smithi067.stdout:4/245: dwrite d0/d1d/d2b/d50/f14 [0,4194304] 0 2023-12-05T09:26:18.739 INFO:tasks.workunit.client.0.smithi067.stdout:4/246: dread - d0/d1d/d25/d32/f44 zero size 2023-12-05T09:26:18.740 INFO:tasks.workunit.client.0.smithi067.stdout:5/260: symlink db/df/d1a/d59/l5b 0 2023-12-05T09:26:18.742 INFO:tasks.workunit.client.0.smithi067.stdout:6/247: sync 2023-12-05T09:26:18.742 INFO:tasks.workunit.client.1.smithi134.stdout:9/412: mknod d7/d8/d16/c87 0 2023-12-05T09:26:18.744 INFO:tasks.workunit.client.1.smithi134.stdout:3/446: symlink d4/d1f/d4e/d6a/l8d 0 2023-12-05T09:26:18.744 INFO:tasks.workunit.client.1.smithi134.stdout:3/447: chown d4/d80 361947 1 2023-12-05T09:26:18.744 INFO:tasks.workunit.client.1.smithi134.stdout:3/448: fdatasync d4/d1f/f79 0 2023-12-05T09:26:18.744 INFO:tasks.workunit.client.1.smithi134.stdout:3/449: dread - d4/d5/d7c/f83 zero size 2023-12-05T09:26:18.745 INFO:tasks.workunit.client.0.smithi067.stdout:4/247: creat d0/f56 x:0 0 0 2023-12-05T09:26:18.745 INFO:tasks.workunit.client.0.smithi067.stdout:4/248: dread - d0/d1d/d25/d32/f44 zero size 2023-12-05T09:26:18.745 INFO:tasks.workunit.client.0.smithi067.stdout:4/249: chown d0/d1d/d25/d32/f3f 52235474 1 2023-12-05T09:26:18.746 INFO:tasks.workunit.client.1.smithi134.stdout:0/412: symlink d13/d14/d30/d4b/d23/d77/l8e 0 2023-12-05T09:26:18.748 INFO:tasks.workunit.client.0.smithi067.stdout:5/261: link db/df/d1a/f4c db/df/d1a/d1d/d20/d46/f5c 0 2023-12-05T09:26:18.749 INFO:tasks.workunit.client.1.smithi134.stdout:4/449: creat d16/d21/d35/f9d x:0 0 0 2023-12-05T09:26:18.750 INFO:tasks.workunit.client.0.smithi067.stdout:6/248: mknod da/d10/d1e/d17/d2f/d1f/c55 0 2023-12-05T09:26:18.753 INFO:tasks.workunit.client.0.smithi067.stdout:4/250: rename d0/d1d/f42 to d0/d1d/d25/d38/f57 0 2023-12-05T09:26:18.753 INFO:tasks.workunit.client.0.smithi067.stdout:4/251: chown d0 21369292 1 2023-12-05T09:26:18.753 INFO:tasks.workunit.client.0.smithi067.stdout:4/252: creat d0/d1d/f58 x:0 0 0 2023-12-05T09:26:18.753 INFO:tasks.workunit.client.0.smithi067.stdout:4/253: chown d0/f4 104211 1 2023-12-05T09:26:18.753 INFO:tasks.workunit.client.0.smithi067.stdout:4/254: write d0/d1d/d25/d32/f3f [1508668,85174] 0 2023-12-05T09:26:18.754 INFO:tasks.workunit.client.1.smithi134.stdout:6/391: readlink d4/d39/d42/d4f/d6d/d3a/da/l14 0 2023-12-05T09:26:18.754 INFO:tasks.workunit.client.1.smithi134.stdout:6/392: write d4/d39/d42/d4f/d6d/d3a/da/d1b/d59/f6c [1004232,25570] 0 2023-12-05T09:26:18.754 INFO:tasks.workunit.client.1.smithi134.stdout:5/366: dwrite d0/d1a/d1c/f23 [4194304,4194304] 0 2023-12-05T09:26:18.754 INFO:tasks.workunit.client.0.smithi067.stdout:3/207: dwrite d9/f43 [0,4194304] 0 2023-12-05T09:26:18.757 INFO:tasks.workunit.client.0.smithi067.stdout:5/262: link db/df/d1a/d1d/f24 db/df/d36/d57/f5d 0 2023-12-05T09:26:18.757 INFO:tasks.workunit.client.0.smithi067.stdout:6/249: unlink da/d10/d1e/d17/d2f/d47/d19/f21 0 2023-12-05T09:26:18.758 INFO:tasks.workunit.client.1.smithi134.stdout:3/450: symlink d4/d5/d45/d86/l8e 0 2023-12-05T09:26:18.760 INFO:tasks.workunit.client.1.smithi134.stdout:0/413: symlink d13/d14/d30/d4b/d66/l8f 0 2023-12-05T09:26:18.761 INFO:tasks.workunit.client.1.smithi134.stdout:7/419: dwrite d2/d7/dc/d2e/d3a/f4e [0,4194304] 0 2023-12-05T09:26:18.765 INFO:tasks.workunit.client.1.smithi134.stdout:4/450: link l7 d16/d18/d5b/l9e 0 2023-12-05T09:26:18.766 INFO:tasks.workunit.client.0.smithi067.stdout:4/255: creat d0/d1d/d2b/d50/f59 x:0 0 0 2023-12-05T09:26:18.768 INFO:tasks.workunit.client.0.smithi067.stdout:5/263: mknod db/df/d38/c5e 0 2023-12-05T09:26:18.769 INFO:tasks.workunit.client.1.smithi134.stdout:6/393: getdents d4/d39/d42/d4f/d6d/d45 0 2023-12-05T09:26:18.772 INFO:tasks.workunit.client.1.smithi134.stdout:5/367: rmdir d0/d1a/d1c/d25/d4d/d60/d73 0 2023-12-05T09:26:18.775 INFO:tasks.workunit.client.0.smithi067.stdout:5/264: mknod db/c5f 0 2023-12-05T09:26:18.777 INFO:tasks.workunit.client.0.smithi067.stdout:6/250: dread da/d10/f11 [0,4194304] 0 2023-12-05T09:26:18.781 INFO:tasks.workunit.client.1.smithi134.stdout:3/451: rename d4/d1f/d50/d52/d42/c4b to d4/c8f 0 2023-12-05T09:26:18.781 INFO:tasks.workunit.client.1.smithi134.stdout:3/452: stat d4/d1f/d50/d52/d42/f70 0 2023-12-05T09:26:18.782 INFO:tasks.workunit.client.0.smithi067.stdout:5/265: creat db/df/d3f/f60 x:0 0 0 2023-12-05T09:26:18.782 INFO:tasks.workunit.client.0.smithi067.stdout:3/208: dread f6 [0,4194304] 0 2023-12-05T09:26:18.782 INFO:tasks.workunit.client.0.smithi067.stdout:3/209: fsync d9/fe 0 2023-12-05T09:26:18.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/368: unlink d0/d1a/l54 0 2023-12-05T09:26:18.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/369: dread - d0/d11/d61/d75/f79 zero size 2023-12-05T09:26:18.787 INFO:tasks.workunit.client.1.smithi134.stdout:3/453: symlink d4/d5/d6f/l90 0 2023-12-05T09:26:18.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/210: rename d9/da/d15/d28/d3d to d9/da/d15/d28/d29/d47 0 2023-12-05T09:26:18.791 INFO:tasks.workunit.client.1.smithi134.stdout:2/460: dwrite d19/d28/d31/d6f/f84 [0,4194304] 0 2023-12-05T09:26:18.794 INFO:tasks.workunit.client.1.smithi134.stdout:5/370: link d0/d1a/d3a/c5f d0/d1a/d3a/c7f 0 2023-12-05T09:26:18.797 INFO:tasks.workunit.client.1.smithi134.stdout:3/454: mknod d4/d1f/d4e/d6a/c91 0 2023-12-05T09:26:18.797 INFO:tasks.workunit.client.1.smithi134.stdout:3/455: fsync d4/d1f/d4e/f59 0 2023-12-05T09:26:18.799 INFO:tasks.workunit.client.0.smithi067.stdout:6/251: dread da/d10/d1e/d17/f29 [4194304,4194304] 0 2023-12-05T09:26:18.799 INFO:tasks.workunit.client.0.smithi067.stdout:6/252: dread - da/d10/d1e/f4b zero size 2023-12-05T09:26:18.800 INFO:tasks.workunit.client.1.smithi134.stdout:3/456: mkdir d4/d5/d7c/d92 0 2023-12-05T09:26:18.800 INFO:tasks.workunit.client.1.smithi134.stdout:2/461: dread d19/d28/d63/d70/f74 [0,4194304] 0 2023-12-05T09:26:18.800 INFO:tasks.workunit.client.0.smithi067.stdout:6/253: mkdir da/d10/d1e/d17/d2f/d2c/d34/d3b/d56 0 2023-12-05T09:26:18.804 INFO:tasks.workunit.client.1.smithi134.stdout:5/371: mknod d0/c80 0 2023-12-05T09:26:18.808 INFO:tasks.workunit.client.1.smithi134.stdout:4/451: getdents d16 0 2023-12-05T09:26:18.808 INFO:tasks.workunit.client.1.smithi134.stdout:2/462: rename d19/d28/d2b/f80 to d19/f8f 0 2023-12-05T09:26:18.811 INFO:tasks.workunit.client.1.smithi134.stdout:5/372: mkdir d0/d1a/d1c/d3f/d81 0 2023-12-05T09:26:18.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/452: rename d16/d18/d1c/c54 to d16/c9f 0 2023-12-05T09:26:18.814 INFO:tasks.workunit.client.1.smithi134.stdout:4/453: stat d16/l6a 0 2023-12-05T09:26:18.817 INFO:tasks.workunit.client.1.smithi134.stdout:5/373: symlink d0/d1a/d1c/d25/d4d/l82 0 2023-12-05T09:26:18.819 INFO:tasks.workunit.client.1.smithi134.stdout:4/454: creat d16/d18/d1a/d3b/fa0 x:0 0 0 2023-12-05T09:26:18.820 INFO:tasks.workunit.client.1.smithi134.stdout:5/374: getdents d0/d11 0 2023-12-05T09:26:18.823 INFO:tasks.workunit.client.1.smithi134.stdout:4/455: mknod d16/d21/d48/d66/ca1 0 2023-12-05T09:26:18.825 INFO:tasks.workunit.client.1.smithi134.stdout:5/375: link d0/c16 d0/d11/d5c/c83 0 2023-12-05T09:26:18.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/456: link d16/d21/d35/l95 d16/d18/d1a/d3b/d8e/la2 0 2023-12-05T09:26:18.832 INFO:tasks.workunit.client.1.smithi134.stdout:5/376: creat d0/d1a/d1c/d25/f84 x:0 0 0 2023-12-05T09:26:18.834 INFO:tasks.workunit.client.1.smithi134.stdout:9/413: dwrite d7/d8/d14/d26/f48 [0,4194304] 0 2023-12-05T09:26:18.834 INFO:tasks.workunit.client.1.smithi134.stdout:5/377: symlink d0/d1a/d3a/l85 0 2023-12-05T09:26:18.834 INFO:tasks.workunit.client.1.smithi134.stdout:5/378: creat d0/d1a/d1c/d3f/d5b/d5d/f86 x:0 0 0 2023-12-05T09:26:18.835 INFO:tasks.workunit.client.1.smithi134.stdout:0/414: rmdir d13/d14 39 2023-12-05T09:26:18.838 INFO:tasks.workunit.client.1.smithi134.stdout:4/457: getdents d16/d21/d47/d4b 0 2023-12-05T09:26:18.840 INFO:tasks.workunit.client.0.smithi067.stdout:5/266: dwrite db/df/d1a/d1d/f24 [0,4194304] 0 2023-12-05T09:26:18.841 INFO:tasks.workunit.client.1.smithi134.stdout:6/394: dwrite d4/d39/d42/d4f/d6d/d3a/da/d1b/f29 [0,4194304] 0 2023-12-05T09:26:18.841 INFO:tasks.workunit.client.1.smithi134.stdout:3/457: dread d4/d5/f32 [0,4194304] 0 2023-12-05T09:26:18.841 INFO:tasks.workunit.client.1.smithi134.stdout:3/458: write d4/f34 [298802,73873] 0 2023-12-05T09:26:18.841 INFO:tasks.workunit.client.1.smithi134.stdout:3/459: truncate d4/d1f/f75 475338 0 2023-12-05T09:26:18.841 INFO:tasks.workunit.client.1.smithi134.stdout:3/460: truncate d4/d5/d45/d60/f66 703614 0 2023-12-05T09:26:18.842 INFO:tasks.workunit.client.0.smithi067.stdout:4/256: dwrite d0/d1d/d25/d38/f39 [0,4194304] 0 2023-12-05T09:26:18.844 INFO:tasks.workunit.client.1.smithi134.stdout:9/414: rename d7/d8/d14/d26/d5a/c75 to d7/d7d/c88 0 2023-12-05T09:26:18.846 INFO:tasks.workunit.client.1.smithi134.stdout:0/415: dread d13/d14/d15/d2a/f74 [0,4194304] 0 2023-12-05T09:26:18.846 INFO:tasks.workunit.client.1.smithi134.stdout:0/416: chown d13/d14/d30/c2d 78835257 1 2023-12-05T09:26:18.847 INFO:tasks.workunit.client.1.smithi134.stdout:5/379: mknod d0/d1a/d1c/c87 0 2023-12-05T09:26:18.847 INFO:tasks.workunit.client.1.smithi134.stdout:5/380: write d0/d45/f5a [1102258,51035] 0 2023-12-05T09:26:18.851 INFO:tasks.workunit.client.1.smithi134.stdout:3/461: dread d4/d1f/f20 [0,4194304] 0 2023-12-05T09:26:18.851 INFO:tasks.workunit.client.1.smithi134.stdout:3/462: creat d4/d80/f93 x:0 0 0 2023-12-05T09:26:18.853 INFO:tasks.workunit.client.1.smithi134.stdout:4/458: mknod d16/d7b/ca3 0 2023-12-05T09:26:18.854 INFO:tasks.workunit.client.1.smithi134.stdout:4/459: chown d16/d21/d48/f58 45197119 1 2023-12-05T09:26:18.856 INFO:tasks.workunit.client.1.smithi134.stdout:9/415: truncate d7/d8/d2e/f31 4166434 0 2023-12-05T09:26:18.859 INFO:tasks.workunit.client.1.smithi134.stdout:0/417: creat d13/d14/d30/d4b/d23/d77/f90 x:0 0 0 2023-12-05T09:26:18.860 INFO:tasks.workunit.client.1.smithi134.stdout:5/381: link d0/dd/l28 d0/d1a/d1c/d3f/d5b/l88 0 2023-12-05T09:26:18.865 INFO:tasks.workunit.client.1.smithi134.stdout:9/416: mknod d7/d8/d14/d26/d5a/c89 0 2023-12-05T09:26:18.865 INFO:tasks.workunit.client.1.smithi134.stdout:9/417: write d7/d10/d4b/f57 [1506281,39366] 0 2023-12-05T09:26:18.866 INFO:tasks.workunit.client.0.smithi067.stdout:4/257: dread d0/f6 [0,4194304] 0 2023-12-05T09:26:18.866 INFO:tasks.workunit.client.0.smithi067.stdout:4/258: chown d0/d1d/d24/c27 0 1 2023-12-05T09:26:18.867 INFO:tasks.workunit.client.1.smithi134.stdout:6/395: rmdir d4/d39/d42/d4f/d6d/d3a 39 2023-12-05T09:26:18.868 INFO:tasks.workunit.client.0.smithi067.stdout:3/211: dwrite d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:18.868 INFO:tasks.workunit.client.1.smithi134.stdout:0/418: mknod d13/d14/d30/d2c/c91 0 2023-12-05T09:26:18.870 INFO:tasks.workunit.client.1.smithi134.stdout:5/382: truncate d0/d1a/d1c/f65 2599907 0 2023-12-05T09:26:18.871 INFO:tasks.workunit.client.1.smithi134.stdout:5/383: fdatasync d0/dd/f51 0 2023-12-05T09:26:18.871 INFO:tasks.workunit.client.1.smithi134.stdout:5/384: read - d0/d1a/d1c/d3f/d5b/d5d/f69 zero size 2023-12-05T09:26:18.872 INFO:tasks.workunit.client.1.smithi134.stdout:3/463: write d4/f3b [3367879,36604] 0 2023-12-05T09:26:18.873 INFO:tasks.workunit.client.1.smithi134.stdout:6/396: mknod d4/d39/d42/d4f/d6d/d3a/c71 0 2023-12-05T09:26:18.875 INFO:tasks.workunit.client.0.smithi067.stdout:3/212: symlink d9/d20/l48 0 2023-12-05T09:26:18.875 INFO:tasks.workunit.client.0.smithi067.stdout:3/213: readlink d9/l1f 0 2023-12-05T09:26:18.876 INFO:tasks.workunit.client.0.smithi067.stdout:4/259: dread d0/d9/f2f [0,4194304] 0 2023-12-05T09:26:18.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/419: unlink c10 0 2023-12-05T09:26:18.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/420: write f7 [1483117,118612] 0 2023-12-05T09:26:18.879 INFO:tasks.workunit.client.1.smithi134.stdout:5/385: creat d0/d11/f89 x:0 0 0 2023-12-05T09:26:18.879 INFO:tasks.workunit.client.1.smithi134.stdout:5/386: stat d0/d1a/d3a 0 2023-12-05T09:26:18.880 INFO:tasks.workunit.client.1.smithi134.stdout:5/387: read d0/d1a/d3a/f49 [46315,127312] 0 2023-12-05T09:26:18.880 INFO:tasks.workunit.client.1.smithi134.stdout:5/388: read - d0/d1a/d1c/d3f/d5b/d5d/f69 zero size 2023-12-05T09:26:18.880 INFO:tasks.workunit.client.1.smithi134.stdout:5/389: write d0/d1a/d1c/d25/f84 [627104,123200] 0 2023-12-05T09:26:18.882 INFO:tasks.workunit.client.1.smithi134.stdout:6/397: creat d4/d39/d42/d4f/d6d/d3a/da/f72 x:0 0 0 2023-12-05T09:26:18.882 INFO:tasks.workunit.client.1.smithi134.stdout:6/398: readlink d4/d39/d5c/l6a 0 2023-12-05T09:26:18.883 INFO:tasks.workunit.client.0.smithi067.stdout:4/260: dread d0/d9/f2f [0,4194304] 0 2023-12-05T09:26:18.883 INFO:tasks.workunit.client.0.smithi067.stdout:4/261: readlink d0/d1d/d25/d2c/d34/l4c 0 2023-12-05T09:26:18.884 INFO:tasks.workunit.client.0.smithi067.stdout:5/267: dwrite db/df/d1a/f28 [0,4194304] 0 2023-12-05T09:26:18.886 INFO:tasks.workunit.client.1.smithi134.stdout:2/463: dwrite fa [0,4194304] 0 2023-12-05T09:26:18.887 INFO:tasks.workunit.client.0.smithi067.stdout:4/262: mkdir d0/d1d/d25/d2c/d34/d4e/d5a 0 2023-12-05T09:26:18.898 INFO:tasks.workunit.client.0.smithi067.stdout:4/263: rename d0/d1d/d2a/l40 to d0/d1d/d3c/l5b 0 2023-12-05T09:26:18.904 INFO:tasks.workunit.client.1.smithi134.stdout:0/421: creat d13/d14/d30/d2c/f92 x:0 0 0 2023-12-05T09:26:18.908 INFO:tasks.workunit.client.1.smithi134.stdout:5/390: mkdir d0/d1a/d1c/d3f/d81/d8a 0 2023-12-05T09:26:18.909 INFO:tasks.workunit.client.0.smithi067.stdout:5/268: dread db/df/d3f/f4a [0,4194304] 0 2023-12-05T09:26:18.909 INFO:tasks.workunit.client.0.smithi067.stdout:5/269: truncate db/df/f16 234334 0 2023-12-05T09:26:18.909 INFO:tasks.workunit.client.0.smithi067.stdout:5/270: fsync db/df/f15 0 2023-12-05T09:26:18.910 INFO:tasks.workunit.client.1.smithi134.stdout:4/460: dwrite d16/d18/d1c/f2c [4194304,4194304] 0 2023-12-05T09:26:18.910 INFO:tasks.workunit.client.1.smithi134.stdout:6/399: symlink d4/d32/l73 0 2023-12-05T09:26:18.911 INFO:tasks.workunit.client.0.smithi067.stdout:4/264: rmdir d0/d1d/d25/d38 39 2023-12-05T09:26:18.911 INFO:tasks.workunit.client.0.smithi067.stdout:4/265: write d0/d1d/d25/d2c/d34/f43 [1017363,24202] 0 2023-12-05T09:26:18.912 INFO:tasks.workunit.client.0.smithi067.stdout:4/266: stat d0/d1d/d25/d2c 0 2023-12-05T09:26:18.914 INFO:tasks.workunit.client.1.smithi134.stdout:7/420: sync 2023-12-05T09:26:18.914 INFO:tasks.workunit.client.1.smithi134.stdout:2/464: mknod d19/d28/d31/d38/c90 0 2023-12-05T09:26:18.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/522: sync 2023-12-05T09:26:18.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/523: chown d2/d9/d10/d30/d4a 876 1 2023-12-05T09:26:18.914 INFO:tasks.workunit.client.1.smithi134.stdout:8/480: sync 2023-12-05T09:26:18.914 INFO:tasks.workunit.client.1.smithi134.stdout:8/481: readlink da/de/d11/l4f 0 2023-12-05T09:26:18.914 INFO:tasks.workunit.client.0.smithi067.stdout:5/271: mknod db/df/d3f/c61 0 2023-12-05T09:26:18.915 INFO:tasks.workunit.client.1.smithi134.stdout:0/422: mkdir d13/d14/d15/d93 0 2023-12-05T09:26:18.917 INFO:tasks.workunit.client.0.smithi067.stdout:4/267: mkdir d0/d1d/d25/d5c 0 2023-12-05T09:26:18.922 INFO:tasks.workunit.client.1.smithi134.stdout:5/391: getdents d0/dd/d37 0 2023-12-05T09:26:18.922 INFO:tasks.workunit.client.0.smithi067.stdout:5/272: stat db/df/c2f 0 2023-12-05T09:26:18.926 INFO:tasks.workunit.client.1.smithi134.stdout:6/400: unlink d4/d39/d42/d4f/f68 0 2023-12-05T09:26:18.928 INFO:tasks.workunit.client.1.smithi134.stdout:7/421: unlink d2/df/d2a/l83 0 2023-12-05T09:26:18.928 INFO:tasks.workunit.client.1.smithi134.stdout:7/422: chown d2/df/d2a/d36/c57 1925051 1 2023-12-05T09:26:18.929 INFO:tasks.workunit.client.0.smithi067.stdout:5/273: creat db/df/d1a/d1d/d20/d46/f62 x:0 0 0 2023-12-05T09:26:18.932 INFO:tasks.workunit.client.1.smithi134.stdout:2/465: mknod d19/d5f/c91 0 2023-12-05T09:26:18.932 INFO:tasks.workunit.client.1.smithi134.stdout:1/524: rmdir d2/d9/d8d/da2 39 2023-12-05T09:26:18.933 INFO:tasks.workunit.client.0.smithi067.stdout:5/274: mkdir db/df/d35/d63 0 2023-12-05T09:26:18.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/482: mknod da/de/d11/d1d/d5f/d9b/ca5 0 2023-12-05T09:26:18.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/483: write da/de/d4d/f79 [549064,47660] 0 2023-12-05T09:26:18.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/275: symlink db/df/d1a/d1d/d20/d46/l64 0 2023-12-05T09:26:18.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/276: dread - db/df/d1a/d1d/d20/f42 zero size 2023-12-05T09:26:18.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/277: stat db/df/d1a/d1d/c27 0 2023-12-05T09:26:18.938 INFO:tasks.workunit.client.0.smithi067.stdout:5/278: truncate db/df/d1a/d1d/f24 5185941 0 2023-12-05T09:26:18.946 INFO:tasks.workunit.client.1.smithi134.stdout:5/392: symlink d0/d50/d71/l8b 0 2023-12-05T09:26:18.946 INFO:tasks.workunit.client.1.smithi134.stdout:5/393: readlink d0/d50/d71/l7a 0 2023-12-05T09:26:18.947 INFO:tasks.workunit.client.1.smithi134.stdout:5/394: fdatasync d0/dd/f2c 0 2023-12-05T09:26:18.950 INFO:tasks.workunit.client.1.smithi134.stdout:3/464: dwrite d4/f3b [0,4194304] 0 2023-12-05T09:26:18.950 INFO:tasks.workunit.client.1.smithi134.stdout:3/465: stat d4/d5/l41 0 2023-12-05T09:26:18.951 INFO:tasks.workunit.client.1.smithi134.stdout:2/466: dread f15 [0,4194304] 0 2023-12-05T09:26:18.952 INFO:tasks.workunit.client.1.smithi134.stdout:6/401: unlink d4/d39/d42/d4f/d6d/d3a/c71 0 2023-12-05T09:26:18.953 INFO:tasks.workunit.client.1.smithi134.stdout:7/423: link d2/d7/dc/d2e/l72 d2/d7/dc/d2e/l8d 0 2023-12-05T09:26:18.953 INFO:tasks.workunit.client.1.smithi134.stdout:7/424: write d2/f8 [2550398,45065] 0 2023-12-05T09:26:18.954 INFO:tasks.workunit.client.0.smithi067.stdout:5/279: read db/df/f32 [2857545,17691] 0 2023-12-05T09:26:18.956 INFO:tasks.workunit.client.1.smithi134.stdout:1/525: rename d2/d9/d10/d30/d66/da9/d74/f77 to d2/d27/db4/fbe 0 2023-12-05T09:26:18.957 INFO:tasks.workunit.client.0.smithi067.stdout:4/268: write d0/d1d/d25/f29 [1831389,63077] 0 2023-12-05T09:26:18.957 INFO:tasks.workunit.client.0.smithi067.stdout:4/269: write d0/d9/f4a [328398,18751] 0 2023-12-05T09:26:18.960 INFO:tasks.workunit.client.0.smithi067.stdout:3/214: dwrite d9/da/fd [0,4194304] 0 2023-12-05T09:26:18.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/280: link db/df/d1a/d1d/d20/c39 db/df/d1a/c65 0 2023-12-05T09:26:18.963 INFO:tasks.workunit.client.0.smithi067.stdout:4/270: symlink d0/d1d/d25/d2c/d34/l5d 0 2023-12-05T09:26:18.963 INFO:tasks.workunit.client.0.smithi067.stdout:4/271: fdatasync d0/d1d/d25/d2c/f3a 0 2023-12-05T09:26:18.964 INFO:tasks.workunit.client.1.smithi134.stdout:6/402: mkdir d4/d32/d74 0 2023-12-05T09:26:18.965 INFO:tasks.workunit.client.1.smithi134.stdout:6/403: stat d4/d39/d42/d4f/d6d/d3a/da/l14 0 2023-12-05T09:26:18.970 INFO:tasks.workunit.client.1.smithi134.stdout:3/466: rename d4/d1f/d50/d52/d42/l6e to d4/d5/d45/l94 0 2023-12-05T09:26:18.970 INFO:tasks.workunit.client.1.smithi134.stdout:3/467: truncate d4/d5/d6f/f68 1116607 0 2023-12-05T09:26:18.971 INFO:tasks.workunit.client.1.smithi134.stdout:7/425: dread d2/d7/dc/d2e/f4c [0,4194304] 0 2023-12-05T09:26:18.971 INFO:tasks.workunit.client.1.smithi134.stdout:7/426: chown d2/d7/dc/d22/f85 51450 1 2023-12-05T09:26:18.972 INFO:tasks.workunit.client.0.smithi067.stdout:3/215: mkdir d9/d49 0 2023-12-05T09:26:18.974 INFO:tasks.workunit.client.0.smithi067.stdout:5/281: symlink db/df/d3f/l66 0 2023-12-05T09:26:18.976 INFO:tasks.workunit.client.1.smithi134.stdout:5/395: getdents d0/d11 0 2023-12-05T09:26:18.979 INFO:tasks.workunit.client.1.smithi134.stdout:6/404: rename d4/d39/d42/d4f/d6d/d3a/da/d1b to d4/d39/d42/d4f/d6d/d3a/d75 0 2023-12-05T09:26:18.980 INFO:tasks.workunit.client.0.smithi067.stdout:5/282: unlink db/df/d52/c56 0 2023-12-05T09:26:18.982 INFO:tasks.workunit.client.1.smithi134.stdout:3/468: unlink d4/d1f/d50/d52/f48 0 2023-12-05T09:26:18.983 INFO:tasks.workunit.client.1.smithi134.stdout:5/396: symlink d0/d1a/d3a/l8c 0 2023-12-05T09:26:18.987 INFO:tasks.workunit.client.1.smithi134.stdout:3/469: creat d4/d5/f95 x:0 0 0 2023-12-05T09:26:18.989 INFO:tasks.workunit.client.1.smithi134.stdout:7/427: dread d2/d7/dc/d2e/d3a/f4e [0,4194304] 0 2023-12-05T09:26:18.991 INFO:tasks.workunit.client.0.smithi067.stdout:5/283: link db/c18 db/df/d36/c67 0 2023-12-05T09:26:18.991 INFO:tasks.workunit.client.0.smithi067.stdout:5/284: read - db/df/d1a/d1d/d20/f42 zero size 2023-12-05T09:26:18.991 INFO:tasks.workunit.client.0.smithi067.stdout:5/285: write db/df/d1a/d1d/d20/f51 [671987,86461] 0 2023-12-05T09:26:18.991 INFO:tasks.workunit.client.0.smithi067.stdout:3/216: dread f7 [0,4194304] 0 2023-12-05T09:26:18.994 INFO:tasks.workunit.client.1.smithi134.stdout:7/428: unlink d2/d7/d2b/d2d/d67/f74 0 2023-12-05T09:26:18.995 INFO:tasks.workunit.client.1.smithi134.stdout:1/526: getdents d2/d27/db4 0 2023-12-05T09:26:18.997 INFO:tasks.workunit.client.1.smithi134.stdout:1/527: link d2/d9/c35 d2/d27/d71/d80/cbf 0 2023-12-05T09:26:18.997 INFO:tasks.workunit.client.1.smithi134.stdout:1/528: write d2/d9/d10/d30/d66/da9/d74/d99/fbd [264516,73000] 0 2023-12-05T09:26:18.997 INFO:tasks.workunit.client.1.smithi134.stdout:9/418: sync 2023-12-05T09:26:18.999 INFO:tasks.workunit.client.1.smithi134.stdout:1/529: creat d2/d9/d8d/da2/db1/fc0 x:0 0 0 2023-12-05T09:26:18.999 INFO:tasks.workunit.client.1.smithi134.stdout:3/470: dread d4/d5/d45/d60/f72 [0,4194304] 0 2023-12-05T09:26:19.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/419: mkdir d7/d8/d16/d52/d65/d8a 0 2023-12-05T09:26:19.000 INFO:tasks.workunit.client.1.smithi134.stdout:2/467: dwrite f16 [0,4194304] 0 2023-12-05T09:26:19.001 INFO:tasks.workunit.client.1.smithi134.stdout:7/429: fdatasync d2/f8 0 2023-12-05T09:26:19.001 INFO:tasks.workunit.client.1.smithi134.stdout:7/430: dread - d2/d7/d2b/d2d/d67/d73/d26/f58 zero size 2023-12-05T09:26:19.002 INFO:tasks.workunit.client.1.smithi134.stdout:1/530: mknod d2/d9/d8d/da2/cc1 0 2023-12-05T09:26:19.002 INFO:tasks.workunit.client.1.smithi134.stdout:1/531: write d2/d9/d10/fac [614634,81261] 0 2023-12-05T09:26:19.003 INFO:tasks.workunit.client.1.smithi134.stdout:6/405: dread d4/d39/d42/d4f/d6d/d3a/d75/f30 [0,4194304] 0 2023-12-05T09:26:19.003 INFO:tasks.workunit.client.1.smithi134.stdout:6/406: fdatasync d4/d39/f34 0 2023-12-05T09:26:19.003 INFO:tasks.workunit.client.1.smithi134.stdout:5/397: dread d0/d1a/d1c/d25/f56 [0,4194304] 0 2023-12-05T09:26:19.004 INFO:tasks.workunit.client.0.smithi067.stdout:1/293: sync 2023-12-05T09:26:19.004 INFO:tasks.workunit.client.0.smithi067.stdout:1/294: chown d2/d4f/d14/d48 3 1 2023-12-05T09:26:19.004 INFO:tasks.workunit.client.1.smithi134.stdout:3/471: unlink d4/d5/d6f/f68 0 2023-12-05T09:26:19.005 INFO:tasks.workunit.client.0.smithi067.stdout:0/390: sync 2023-12-05T09:26:19.006 INFO:tasks.workunit.client.1.smithi134.stdout:9/420: rmdir d7/d8/d14/d26 39 2023-12-05T09:26:19.006 INFO:tasks.workunit.client.1.smithi134.stdout:9/421: stat d7/d5b/l79 0 2023-12-05T09:26:19.007 INFO:tasks.workunit.client.0.smithi067.stdout:5/286: write db/f13 [1127683,50109] 0 2023-12-05T09:26:19.008 INFO:tasks.workunit.client.0.smithi067.stdout:1/295: unlink d2/d5/f4e 0 2023-12-05T09:26:19.008 INFO:tasks.workunit.client.0.smithi067.stdout:1/296: fdatasync d2/d4f/d15/f29 0 2023-12-05T09:26:19.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/398: dread d0/d1a/d1c/f31 [0,4194304] 0 2023-12-05T09:26:19.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/399: chown d0/dd/f17 37269 1 2023-12-05T09:26:19.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/400: dread - d0/d1a/d1c/d25/d6a/f6c zero size 2023-12-05T09:26:19.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/401: fsync d0/dd/f20 0 2023-12-05T09:26:19.014 INFO:tasks.workunit.client.0.smithi067.stdout:0/391: rename d3/d7/d3c/d77 to d3/d7/d3c/d66/d90 0 2023-12-05T09:26:19.015 INFO:tasks.workunit.client.0.smithi067.stdout:3/217: write f3 [3546467,25660] 0 2023-12-05T09:26:19.017 INFO:tasks.workunit.client.0.smithi067.stdout:5/287: dread db/df/d1a/f21 [0,4194304] 0 2023-12-05T09:26:19.018 INFO:tasks.workunit.client.0.smithi067.stdout:1/297: creat d2/d4f/d14/d20/d4c/f65 x:0 0 0 2023-12-05T09:26:19.021 INFO:tasks.workunit.client.0.smithi067.stdout:3/218: rename d9/da/d15/d28/d29/d47/c3f to d9/d20/c4a 0 2023-12-05T09:26:19.021 INFO:tasks.workunit.client.0.smithi067.stdout:5/288: mknod db/df/d1a/d1d/d20/d46/c68 0 2023-12-05T09:26:19.024 INFO:tasks.workunit.client.0.smithi067.stdout:1/298: creat d2/d4f/d15/d60/f66 x:0 0 0 2023-12-05T09:26:19.028 INFO:tasks.workunit.client.0.smithi067.stdout:5/289: unlink f5 0 2023-12-05T09:26:19.033 INFO:tasks.workunit.client.0.smithi067.stdout:0/392: write d3/df/d10/f37 [3748977,82252] 0 2023-12-05T09:26:19.037 INFO:tasks.workunit.client.0.smithi067.stdout:3/219: unlink d9/f2d 0 2023-12-05T09:26:19.039 INFO:tasks.workunit.client.1.smithi134.stdout:2/468: mknod d19/d5f/c92 0 2023-12-05T09:26:19.042 INFO:tasks.workunit.client.0.smithi067.stdout:1/299: mknod d2/d4f/d54/c67 0 2023-12-05T09:26:19.048 INFO:tasks.workunit.client.0.smithi067.stdout:1/300: mkdir d2/d4f/d15/d60/d68 0 2023-12-05T09:26:19.048 INFO:tasks.workunit.client.0.smithi067.stdout:5/290: dread db/df/f15 [0,4194304] 0 2023-12-05T09:26:19.049 INFO:tasks.workunit.client.1.smithi134.stdout:9/422: creat d7/d8/d16/d52/f8b x:0 0 0 2023-12-05T09:26:19.053 INFO:tasks.workunit.client.1.smithi134.stdout:5/402: link d0/d1a/d1c/d3f/d5b/l88 d0/d45/l8d 0 2023-12-05T09:26:19.054 INFO:tasks.workunit.client.1.smithi134.stdout:1/532: dwrite d2/d9/f86 [0,4194304] 0 2023-12-05T09:26:19.054 INFO:tasks.workunit.client.1.smithi134.stdout:1/533: dread - d2/d9/d10/d5b/d5e/f93 zero size 2023-12-05T09:26:19.057 INFO:tasks.workunit.client.0.smithi067.stdout:1/301: symlink d2/d5/d7/de/d19/d49/d5f/d61/l69 0 2023-12-05T09:26:19.059 INFO:tasks.workunit.client.1.smithi134.stdout:2/469: rename d19/d28/f30 to d19/d5f/f93 0 2023-12-05T09:26:19.061 INFO:tasks.workunit.client.1.smithi134.stdout:5/403: dread d0/d1a/d3a/f58 [0,4194304] 0 2023-12-05T09:26:19.062 INFO:tasks.workunit.client.1.smithi134.stdout:8/484: sync 2023-12-05T09:26:19.062 INFO:tasks.workunit.client.1.smithi134.stdout:4/461: sync 2023-12-05T09:26:19.062 INFO:tasks.workunit.client.1.smithi134.stdout:0/423: sync 2023-12-05T09:26:19.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/485: fsync da/de/d11/f19 0 2023-12-05T09:26:19.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/486: creat da/de/d16/d45/d72/fa6 x:0 0 0 2023-12-05T09:26:19.065 INFO:tasks.workunit.client.0.smithi067.stdout:4/272: dwrite d0/d1d/d2b/f2e [0,4194304] 0 2023-12-05T09:26:19.065 INFO:tasks.workunit.client.0.smithi067.stdout:3/220: dread d9/fe [0,4194304] 0 2023-12-05T09:26:19.065 INFO:tasks.workunit.client.0.smithi067.stdout:3/221: read - d9/d24/f33 zero size 2023-12-05T09:26:19.065 INFO:tasks.workunit.client.0.smithi067.stdout:4/273: creat d0/d1d/d25/d2c/d34/f5e x:0 0 0 2023-12-05T09:26:19.068 INFO:tasks.workunit.client.1.smithi134.stdout:6/407: getdents d4/d39/d42/d4f/d6d/d3a 0 2023-12-05T09:26:19.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/534: read d2/d9/d10/d5b/d5e/f6d [4138237,99283] 0 2023-12-05T09:26:19.071 INFO:tasks.workunit.client.0.smithi067.stdout:1/302: mkdir d2/d5/d7/d6a 0 2023-12-05T09:26:19.073 INFO:tasks.workunit.client.1.smithi134.stdout:7/431: dwrite d2/d7/dc/f2c [0,4194304] 0 2023-12-05T09:26:19.073 INFO:tasks.workunit.client.1.smithi134.stdout:7/432: read - d2/df/f79 zero size 2023-12-05T09:26:19.093 INFO:tasks.workunit.client.1.smithi134.stdout:9/423: rename d7/d8/d14/f54 to d7/d5b/d5e/f8c 0 2023-12-05T09:26:19.106 INFO:tasks.workunit.client.1.smithi134.stdout:5/404: mkdir d0/d1a/d1c/d3f/d81/d8e 0 2023-12-05T09:26:19.107 INFO:tasks.workunit.client.1.smithi134.stdout:3/472: rmdir d4/d1f/d50/d52 39 2023-12-05T09:26:19.111 INFO:tasks.workunit.client.1.smithi134.stdout:8/487: creat da/de/d11/d8b/d8c/fa7 x:0 0 0 2023-12-05T09:26:19.111 INFO:tasks.workunit.client.1.smithi134.stdout:8/488: chown da/f3e 12489 1 2023-12-05T09:26:19.113 INFO:tasks.workunit.client.1.smithi134.stdout:1/535: unlink d2/d27/d40/f46 0 2023-12-05T09:26:19.116 INFO:tasks.workunit.client.1.smithi134.stdout:7/433: getdents d2/df/d2a/d63 0 2023-12-05T09:26:19.116 INFO:tasks.workunit.client.1.smithi134.stdout:9/424: dread f3 [4194304,4194304] 0 2023-12-05T09:26:19.116 INFO:tasks.workunit.client.1.smithi134.stdout:7/434: chown d2/dd/f19 21 1 2023-12-05T09:26:19.121 INFO:tasks.workunit.client.0.smithi067.stdout:5/291: dwrite db/f14 [4194304,4194304] 0 2023-12-05T09:26:19.122 INFO:tasks.workunit.client.1.smithi134.stdout:0/424: rename d13/d14/d59/c79 to d13/d14/d30/d4b/d23/c94 0 2023-12-05T09:26:19.123 INFO:tasks.workunit.client.1.smithi134.stdout:3/473: dread d4/d1f/f2b [0,4194304] 0 2023-12-05T09:26:19.125 INFO:tasks.workunit.client.1.smithi134.stdout:1/536: symlink d2/d27/d40/lc2 0 2023-12-05T09:26:19.125 INFO:tasks.workunit.client.1.smithi134.stdout:1/537: fsync d2/d9/f24 0 2023-12-05T09:26:19.125 INFO:tasks.workunit.client.1.smithi134.stdout:1/538: chown d2/d9/d10/d30/d4a/l82 343157313 1 2023-12-05T09:26:19.125 INFO:tasks.workunit.client.0.smithi067.stdout:4/274: dwrite d0/d1d/d25/d32/f16 [0,4194304] 0 2023-12-05T09:26:19.130 INFO:tasks.workunit.client.1.smithi134.stdout:9/425: creat d7/d8/d14/d26/d5a/f8d x:0 0 0 2023-12-05T09:26:19.130 INFO:tasks.workunit.client.1.smithi134.stdout:2/470: dwrite d19/f34 [0,4194304] 0 2023-12-05T09:26:19.130 INFO:tasks.workunit.client.1.smithi134.stdout:2/471: fdatasync f5 0 2023-12-05T09:26:19.130 INFO:tasks.workunit.client.1.smithi134.stdout:2/472: chown d19/d3a/l4d 245 1 2023-12-05T09:26:19.133 INFO:tasks.workunit.client.1.smithi134.stdout:3/474: dread f0 [0,4194304] 0 2023-12-05T09:26:19.135 INFO:tasks.workunit.client.0.smithi067.stdout:5/292: link db/df/d3f/f4a db/df/d35/d63/f69 0 2023-12-05T09:26:19.136 INFO:tasks.workunit.client.0.smithi067.stdout:0/393: dwrite d3/fa [0,4194304] 0 2023-12-05T09:26:19.136 INFO:tasks.workunit.client.0.smithi067.stdout:0/394: read d3/df/f18 [140809,3356] 0 2023-12-05T09:26:19.138 INFO:tasks.workunit.client.1.smithi134.stdout:9/426: creat d7/d10/d4b/f8e x:0 0 0 2023-12-05T09:26:19.141 INFO:tasks.workunit.client.1.smithi134.stdout:5/405: dread d0/fc [4194304,4194304] 0 2023-12-05T09:26:19.141 INFO:tasks.workunit.client.1.smithi134.stdout:5/406: write d0/d11/f1f [657510,59054] 0 2023-12-05T09:26:19.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/275: link d0/d1d/d25/d38/f49 d0/d1d/d25/f5f 0 2023-12-05T09:26:19.151 INFO:tasks.workunit.client.1.smithi134.stdout:6/408: rename d4/d39/d42/d4f/d6d/d3a/da/l23 to d4/d39/d42/d4f/d6d/d3a/l76 0 2023-12-05T09:26:19.152 INFO:tasks.workunit.client.1.smithi134.stdout:2/473: mknod d19/d5f/c94 0 2023-12-05T09:26:19.152 INFO:tasks.workunit.client.1.smithi134.stdout:6/409: truncate d4/d39/f34 796127 0 2023-12-05T09:26:19.152 INFO:tasks.workunit.client.1.smithi134.stdout:6/410: stat d4/d39/d42/l69 0 2023-12-05T09:26:19.158 INFO:tasks.workunit.client.0.smithi067.stdout:0/395: link d3/d7/d3c/d67/d59/d5c/f65 d3/df/d10/f91 0 2023-12-05T09:26:19.158 INFO:tasks.workunit.client.0.smithi067.stdout:0/396: creat d3/d7/d3c/d6c/f92 x:0 0 0 2023-12-05T09:26:19.162 INFO:tasks.workunit.client.0.smithi067.stdout:5/293: rename db/df/d1a/d1d/d20/f2c to db/df/d1a/f6a 0 2023-12-05T09:26:19.164 INFO:tasks.workunit.client.0.smithi067.stdout:1/303: dwrite d2/f39 [0,4194304] 0 2023-12-05T09:26:19.166 INFO:tasks.workunit.client.1.smithi134.stdout:3/475: mkdir d4/d5/d45/d60/d85/d96 0 2023-12-05T09:26:19.166 INFO:tasks.workunit.client.1.smithi134.stdout:7/435: rename d2/f6c to d2/d7/d2b/f8e 0 2023-12-05T09:26:19.168 INFO:tasks.workunit.client.0.smithi067.stdout:0/397: getdents d3/d7/d3c/d67/d59/d5c 0 2023-12-05T09:26:19.173 INFO:tasks.workunit.client.1.smithi134.stdout:7/436: rmdir d2/dd/d71/d75 0 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:8/274: sync 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:8/275: fsync d5/da/f2a 0 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:2/233: sync 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:2/234: truncate d0/d10/d1e/f2e 381398 0 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:4/276: write d0/d1d/d2b/f2e [8231211,116487] 0 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:4/277: fdatasync d0/f8 0 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:3/222: dwrite d9/da/d15/d17/d2b/f3e [4194304,4194304] 0 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:3/223: creat d9/da/d15/d17/d1a/f4b x:0 0 0 2023-12-05T09:26:19.178 INFO:tasks.workunit.client.0.smithi067.stdout:3/224: chown d9/da/d15/d28/d29 3057496 1 2023-12-05T09:26:19.179 INFO:tasks.workunit.client.0.smithi067.stdout:3/225: fsync d9/f27 0 2023-12-05T09:26:19.179 INFO:tasks.workunit.client.1.smithi134.stdout:3/476: mkdir d4/d5/d6f/d97 0 2023-12-05T09:26:19.179 INFO:tasks.workunit.client.1.smithi134.stdout:3/477: chown d4/f2f 2036 1 2023-12-05T09:26:19.184 INFO:tasks.workunit.client.0.smithi067.stdout:1/304: rename d2/d4f/d14/f47 to d2/d4f/d14/d48/f6b 0 2023-12-05T09:26:19.184 INFO:tasks.workunit.client.0.smithi067.stdout:8/276: truncate d5/dc/d1a/d20/f25 2545526 0 2023-12-05T09:26:19.191 INFO:tasks.workunit.client.1.smithi134.stdout:8/489: dwrite da/de/d4d/f91 [0,4194304] 0 2023-12-05T09:26:19.194 INFO:tasks.workunit.client.1.smithi134.stdout:1/539: dread d2/f65 [0,4194304] 0 2023-12-05T09:26:19.195 INFO:tasks.workunit.client.1.smithi134.stdout:0/425: dwrite d13/d14/d30/d4b/d23/f65 [0,4194304] 0 2023-12-05T09:26:19.195 INFO:tasks.workunit.client.1.smithi134.stdout:7/437: write f1 [5616013,76322] 0 2023-12-05T09:26:19.196 INFO:tasks.workunit.client.0.smithi067.stdout:0/398: write d3/f58 [626492,95590] 0 2023-12-05T09:26:19.196 INFO:tasks.workunit.client.0.smithi067.stdout:0/399: chown d3/d7/d3c/d67/d59/d4e/f83 1138 1 2023-12-05T09:26:19.196 INFO:tasks.workunit.client.0.smithi067.stdout:0/400: fdatasync d3/df/d10/f91 0 2023-12-05T09:26:19.196 INFO:tasks.workunit.client.0.smithi067.stdout:0/401: creat d3/d7/d30/f93 x:0 0 0 2023-12-05T09:26:19.197 INFO:tasks.workunit.client.1.smithi134.stdout:3/478: truncate d4/d1f/d50/d52/d42/f56 384430 0 2023-12-05T09:26:19.208 INFO:tasks.workunit.client.1.smithi134.stdout:8/490: creat da/de/d16/d45/fa8 x:0 0 0 2023-12-05T09:26:19.208 INFO:tasks.workunit.client.1.smithi134.stdout:8/491: write da/de/d11/f34 [1585043,39846] 0 2023-12-05T09:26:19.208 INFO:tasks.workunit.client.1.smithi134.stdout:8/492: write da/de/d11/f6a [5229551,74130] 0 2023-12-05T09:26:19.210 INFO:tasks.workunit.client.0.smithi067.stdout:4/278: rename d0/d9/c4f to d0/d1d/d24/c60 0 2023-12-05T09:26:19.213 INFO:tasks.workunit.client.1.smithi134.stdout:7/438: mkdir d2/d8f 0 2023-12-05T09:26:19.214 INFO:tasks.workunit.client.1.smithi134.stdout:7/439: chown d2/dd/d71 7418 1 2023-12-05T09:26:19.214 INFO:tasks.workunit.client.1.smithi134.stdout:9/427: rename d7/d8/d16/d52/d65 to d7/d10/d4b/d53/d7b/d8f 0 2023-12-05T09:26:19.214 INFO:tasks.workunit.client.1.smithi134.stdout:2/474: dwrite d19/d3a/f44 [0,4194304] 0 2023-12-05T09:26:19.214 INFO:tasks.workunit.client.1.smithi134.stdout:2/475: fdatasync d19/d28/d31/d38/f59 0 2023-12-05T09:26:19.216 INFO:tasks.workunit.client.1.smithi134.stdout:3/479: unlink d4/d5/l6c 0 2023-12-05T09:26:19.217 INFO:tasks.workunit.client.0.smithi067.stdout:3/226: dread f3 [0,4194304] 0 2023-12-05T09:26:19.219 INFO:tasks.workunit.client.0.smithi067.stdout:1/305: dread d2/d4f/d15/f29 [0,4194304] 0 2023-12-05T09:26:19.220 INFO:tasks.workunit.client.0.smithi067.stdout:1/306: fdatasync d2/f24 0 2023-12-05T09:26:19.220 INFO:tasks.workunit.client.0.smithi067.stdout:1/307: write d2/d3/f1d [3252093,58823] 0 2023-12-05T09:26:19.223 INFO:tasks.workunit.client.1.smithi134.stdout:0/426: write f3 [3679910,77278] 0 2023-12-05T09:26:19.223 INFO:tasks.workunit.client.1.smithi134.stdout:8/493: mknod da/de/d11/d1d/d5f/d9b/ca9 0 2023-12-05T09:26:19.224 INFO:tasks.workunit.client.0.smithi067.stdout:0/402: mkdir d3/d7/d3c/d67/d59/d4e/d94 0 2023-12-05T09:26:19.227 INFO:tasks.workunit.client.0.smithi067.stdout:4/279: truncate d0/f6 3086946 0 2023-12-05T09:26:19.230 INFO:tasks.workunit.client.0.smithi067.stdout:3/227: link d9/da/f19 d9/da/d15/d28/d31/f4c 0 2023-12-05T09:26:19.236 INFO:tasks.workunit.client.1.smithi134.stdout:2/476: link d19/d28/d2b/l8a d19/d28/d63/d70/l95 0 2023-12-05T09:26:19.236 INFO:tasks.workunit.client.1.smithi134.stdout:2/477: chown d19/d3f/f58 21 1 2023-12-05T09:26:19.237 INFO:tasks.workunit.client.1.smithi134.stdout:2/478: fsync fd 0 2023-12-05T09:26:19.237 INFO:tasks.workunit.client.1.smithi134.stdout:2/479: stat d19/d28/d2b/f2f 0 2023-12-05T09:26:19.238 INFO:tasks.workunit.client.0.smithi067.stdout:1/308: mknod d2/d5/d7/c6c 0 2023-12-05T09:26:19.240 INFO:tasks.workunit.client.1.smithi134.stdout:3/480: symlink d4/d1f/d4e/l98 0 2023-12-05T09:26:19.241 INFO:tasks.workunit.client.1.smithi134.stdout:3/481: readlink d4/d1f/l43 0 2023-12-05T09:26:19.241 INFO:tasks.workunit.client.1.smithi134.stdout:3/482: truncate d4/d1f/d50/d52/d42/f70 189594 0 2023-12-05T09:26:19.242 INFO:tasks.workunit.client.0.smithi067.stdout:6/254: sync 2023-12-05T09:26:19.242 INFO:tasks.workunit.client.0.smithi067.stdout:9/445: sync 2023-12-05T09:26:19.242 INFO:tasks.workunit.client.0.smithi067.stdout:9/446: chown d1b/d25/d54/c55 6375 1 2023-12-05T09:26:19.242 INFO:tasks.workunit.client.0.smithi067.stdout:7/309: sync 2023-12-05T09:26:19.242 INFO:tasks.workunit.client.0.smithi067.stdout:0/403: creat d3/df/f95 x:0 0 0 2023-12-05T09:26:19.245 INFO:tasks.workunit.client.1.smithi134.stdout:0/427: unlink d13/f35 0 2023-12-05T09:26:19.245 INFO:tasks.workunit.client.1.smithi134.stdout:0/428: fsync d13/d14/d30/d4b/d23/f60 0 2023-12-05T09:26:19.248 INFO:tasks.workunit.client.0.smithi067.stdout:4/280: rename d0/d1d/d2b/d50/c1a to d0/d1d/d25/d38/c61 0 2023-12-05T09:26:19.249 INFO:tasks.workunit.client.1.smithi134.stdout:8/494: symlink da/de/d11/d1d/laa 0 2023-12-05T09:26:19.249 INFO:tasks.workunit.client.1.smithi134.stdout:3/483: mkdir d4/d5/d45/d60/d85/d99 0 2023-12-05T09:26:19.252 INFO:tasks.workunit.client.1.smithi134.stdout:3/484: write d4/fb [669322,108013] 0 2023-12-05T09:26:19.253 INFO:tasks.workunit.client.1.smithi134.stdout:8/495: unlink da/de/d8a/c9a 0 2023-12-05T09:26:19.254 INFO:tasks.workunit.client.0.smithi067.stdout:9/447: creat d1b/d25/d54/d5c/d81/d96/f9c x:0 0 0 2023-12-05T09:26:19.254 INFO:tasks.workunit.client.0.smithi067.stdout:0/404: fdatasync d3/f4 0 2023-12-05T09:26:19.254 INFO:tasks.workunit.client.0.smithi067.stdout:0/405: readlink d3/df/l73 0 2023-12-05T09:26:19.264 INFO:tasks.workunit.client.0.smithi067.stdout:6/255: dread da/d10/d1e/d17/f23 [4194304,4194304] 0 2023-12-05T09:26:19.267 INFO:tasks.workunit.client.0.smithi067.stdout:6/256: symlink da/d10/d1e/d17/d2f/d2c/d34/d3b/d56/l57 0 2023-12-05T09:26:19.267 INFO:tasks.workunit.client.0.smithi067.stdout:6/257: readlink da/d10/d1e/d17/d2f/l13 0 2023-12-05T09:26:19.269 INFO:tasks.workunit.client.1.smithi134.stdout:3/485: dread d4/f38 [0,4194304] 0 2023-12-05T09:26:19.270 INFO:tasks.workunit.client.0.smithi067.stdout:6/258: write da/d10/d1e/d17/d2f/d1f/f25 [8861129,107928] 0 2023-12-05T09:26:19.277 INFO:tasks.workunit.client.1.smithi134.stdout:3/486: unlink d4/d1f/f79 0 2023-12-05T09:26:19.282 INFO:tasks.workunit.client.0.smithi067.stdout:1/309: rename d2/d5/d7/de/d19/d53 to d2/d5/d7/de/d19/d49/d6d 0 2023-12-05T09:26:19.282 INFO:tasks.workunit.client.0.smithi067.stdout:1/310: fdatasync d2/d4f/d14/d20/d4c/f65 0 2023-12-05T09:26:19.285 INFO:tasks.workunit.client.1.smithi134.stdout:7/440: dwrite d2/d7/dc/f2c [0,4194304] 0 2023-12-05T09:26:19.285 INFO:tasks.workunit.client.1.smithi134.stdout:5/407: dwrite d0/d1a/d3a/f4e [0,4194304] 0 2023-12-05T09:26:19.286 INFO:tasks.workunit.client.1.smithi134.stdout:3/487: rename d4/f1d to d4/d5/d45/d86/f9a 0 2023-12-05T09:26:19.286 INFO:tasks.workunit.client.1.smithi134.stdout:6/411: dwrite d4/f26 [0,4194304] 0 2023-12-05T09:26:19.289 INFO:tasks.workunit.client.0.smithi067.stdout:5/294: dwrite db/df/f50 [0,4194304] 0 2023-12-05T09:26:19.289 INFO:tasks.workunit.client.1.smithi134.stdout:0/429: write d13/d14/d30/f32 [195200,49930] 0 2023-12-05T09:26:19.290 INFO:tasks.workunit.client.0.smithi067.stdout:2/235: dwrite d0/fe [0,4194304] 0 2023-12-05T09:26:19.295 INFO:tasks.workunit.client.1.smithi134.stdout:2/480: dread d19/f5d [0,4194304] 0 2023-12-05T09:26:19.297 INFO:tasks.workunit.client.0.smithi067.stdout:8/277: dwrite d5/dc/f3f [0,4194304] 0 2023-12-05T09:26:19.298 INFO:tasks.workunit.client.1.smithi134.stdout:4/462: sync 2023-12-05T09:26:19.302 INFO:tasks.workunit.client.0.smithi067.stdout:5/295: creat db/df/f6b x:0 0 0 2023-12-05T09:26:19.302 INFO:tasks.workunit.client.0.smithi067.stdout:1/311: rename d2/d5/f34 to d2/d5/d7/de/d19/d49/d5f/d61/f6e 0 2023-12-05T09:26:19.303 INFO:tasks.workunit.client.1.smithi134.stdout:8/496: write da/de/d8a/d42/f63 [3447081,60162] 0 2023-12-05T09:26:19.303 INFO:tasks.workunit.client.1.smithi134.stdout:8/497: chown da 26271 1 2023-12-05T09:26:19.305 INFO:tasks.workunit.client.1.smithi134.stdout:7/441: rename d2/f41 to d2/d7/d6f/f90 0 2023-12-05T09:26:19.309 INFO:tasks.workunit.client.0.smithi067.stdout:9/448: dread d1b/d25/d54/d5c/f72 [0,4194304] 0 2023-12-05T09:26:19.331 INFO:tasks.workunit.client.0.smithi067.stdout:7/310: dwrite d0/d9/f2c [8388608,4194304] 0 2023-12-05T09:26:19.331 INFO:tasks.workunit.client.0.smithi067.stdout:7/311: write d0/f4c [1568764,120488] 0 2023-12-05T09:26:19.338 INFO:tasks.workunit.client.0.smithi067.stdout:6/259: dread da/d10/d1e/d17/d2f/d1f/f25 [4194304,4194304] 0 2023-12-05T09:26:19.338 INFO:tasks.workunit.client.1.smithi134.stdout:0/430: creat d13/d14/d30/d4b/d23/f95 x:0 0 0 2023-12-05T09:26:19.339 INFO:tasks.workunit.client.1.smithi134.stdout:1/540: dwrite d2/d9/d10/d94/fb9 [0,4194304] 0 2023-12-05T09:26:19.339 INFO:tasks.workunit.client.1.smithi134.stdout:1/541: chown d2/d9/c23 1 1 2023-12-05T09:26:19.344 INFO:tasks.workunit.client.0.smithi067.stdout:2/236: write d0/d25/d3a/f43 [3960360,106999] 0 2023-12-05T09:26:19.350 INFO:tasks.workunit.client.1.smithi134.stdout:8/498: mknod da/de/d43/cab 0 2023-12-05T09:26:19.354 INFO:tasks.workunit.client.0.smithi067.stdout:8/278: mknod d5/dc/d1a/c4c 0 2023-12-05T09:26:19.355 INFO:tasks.workunit.client.0.smithi067.stdout:8/279: readlink d5/dc/d1a/d20/d2d/d41/l46 0 2023-12-05T09:26:19.356 INFO:tasks.workunit.client.1.smithi134.stdout:7/442: creat d2/df/d81/f91 x:0 0 0 2023-12-05T09:26:19.356 INFO:tasks.workunit.client.1.smithi134.stdout:7/443: chown d2/d7/d2b/d2d/d67/d87 475220856 1 2023-12-05T09:26:19.356 INFO:tasks.workunit.client.1.smithi134.stdout:7/444: read d2/d7/dc/d2e/d3a/f3b [706178,106300] 0 2023-12-05T09:26:19.357 INFO:tasks.workunit.client.0.smithi067.stdout:1/312: creat d2/d5/f6f x:0 0 0 2023-12-05T09:26:19.358 INFO:tasks.workunit.client.0.smithi067.stdout:1/313: chown d2/d4f/d14/d20/f26 6455 1 2023-12-05T09:26:19.361 INFO:tasks.workunit.client.0.smithi067.stdout:1/314: write d2/f24 [1111458,102661] 0 2023-12-05T09:26:19.361 INFO:tasks.workunit.client.0.smithi067.stdout:1/315: stat d2/d5/d7/de/c62 0 2023-12-05T09:26:19.362 INFO:tasks.workunit.client.0.smithi067.stdout:4/281: dwrite d0/d1d/f58 [0,4194304] 0 2023-12-05T09:26:19.365 INFO:tasks.workunit.client.0.smithi067.stdout:9/449: rename d1b/c2f to d1b/d25/d54/d5c/d6a/d82/c9d 0 2023-12-05T09:26:19.367 INFO:tasks.workunit.client.1.smithi134.stdout:0/431: rename d13/d14/d15/f43 to d13/d14/d59/d7d/f96 0 2023-12-05T09:26:19.368 INFO:tasks.workunit.client.1.smithi134.stdout:7/445: dread d2/d7/d2b/d2d/f66 [0,4194304] 0 2023-12-05T09:26:19.371 INFO:tasks.workunit.client.0.smithi067.stdout:2/237: creat d0/d25/d34/d4a/f52 x:0 0 0 2023-12-05T09:26:19.371 INFO:tasks.workunit.client.0.smithi067.stdout:2/238: readlink d0/d2f/l4c 0 2023-12-05T09:26:19.373 INFO:tasks.workunit.client.1.smithi134.stdout:8/499: write da/de/f2b [3818098,5749] 0 2023-12-05T09:26:19.373 INFO:tasks.workunit.client.1.smithi134.stdout:8/500: write da/de/f27 [1227819,66051] 0 2023-12-05T09:26:19.374 INFO:tasks.workunit.client.0.smithi067.stdout:1/316: mkdir d2/d4f/d54/d70 0 2023-12-05T09:26:19.375 INFO:tasks.workunit.client.1.smithi134.stdout:2/481: dwrite d19/d3f/f78 [0,4194304] 0 2023-12-05T09:26:19.375 INFO:tasks.workunit.client.1.smithi134.stdout:2/482: fsync d19/d28/d31/f7e 0 2023-12-05T09:26:19.376 INFO:tasks.workunit.client.1.smithi134.stdout:5/408: dwrite d0/dd/f32 [0,4194304] 0 2023-12-05T09:26:19.377 INFO:tasks.workunit.client.1.smithi134.stdout:3/488: dwrite d4/d1f/d4e/f61 [0,4194304] 0 2023-12-05T09:26:19.377 INFO:tasks.workunit.client.1.smithi134.stdout:3/489: stat d4/d5/d6f 0 2023-12-05T09:26:19.378 INFO:tasks.workunit.client.0.smithi067.stdout:5/296: dwrite db/df/d1a/d1d/d20/f51 [0,4194304] 0 2023-12-05T09:26:19.378 INFO:tasks.workunit.client.1.smithi134.stdout:1/542: symlink d2/d9/d10/d30/d4a/lc3 0 2023-12-05T09:26:19.380 INFO:tasks.workunit.client.1.smithi134.stdout:2/483: dread d19/d28/d2b/f2f [0,4194304] 0 2023-12-05T09:26:19.386 INFO:tasks.workunit.client.1.smithi134.stdout:9/428: dwrite d7/d8/f84 [0,4194304] 0 2023-12-05T09:26:19.388 INFO:tasks.workunit.client.1.smithi134.stdout:2/484: dread d19/d28/d63/d70/f74 [0,4194304] 0 2023-12-05T09:26:19.389 INFO:tasks.workunit.client.0.smithi067.stdout:9/450: link d1b/d25/d35/d56/c8e d1b/d25/d5b/c9e 0 2023-12-05T09:26:19.389 INFO:tasks.workunit.client.0.smithi067.stdout:9/451: truncate d1b/d25/f46 892000 0 2023-12-05T09:26:19.390 INFO:tasks.workunit.client.1.smithi134.stdout:6/412: rmdir d4/d39/d42/d4f 39 2023-12-05T09:26:19.391 INFO:tasks.workunit.client.0.smithi067.stdout:2/239: rename d0/d10 to d0/d15/d53 0 2023-12-05T09:26:19.391 INFO:tasks.workunit.client.0.smithi067.stdout:2/240: fdatasync d0/fe 0 2023-12-05T09:26:19.392 INFO:tasks.workunit.client.1.smithi134.stdout:0/432: creat d13/d14/d59/d78/f97 x:0 0 0 2023-12-05T09:26:19.397 INFO:tasks.workunit.client.0.smithi067.stdout:7/312: dread d0/d9/d56/f5b [0,4194304] 0 2023-12-05T09:26:19.397 INFO:tasks.workunit.client.0.smithi067.stdout:7/313: write d0/f7 [4899296,34503] 0 2023-12-05T09:26:19.398 INFO:tasks.workunit.client.0.smithi067.stdout:1/317: mkdir d2/d5/d7/de/d19/d71 0 2023-12-05T09:26:19.399 INFO:tasks.workunit.client.0.smithi067.stdout:1/318: readlink d2/l6 0 2023-12-05T09:26:19.402 INFO:tasks.workunit.client.1.smithi134.stdout:8/501: unlink da/de/f75 0 2023-12-05T09:26:19.404 INFO:tasks.workunit.client.0.smithi067.stdout:9/452: mknod d1b/d25/d54/d5c/d6a/d6c/d78/c9f 0 2023-12-05T09:26:19.404 INFO:tasks.workunit.client.0.smithi067.stdout:9/453: write d1b/f5f [2187539,81585] 0 2023-12-05T09:26:19.408 INFO:tasks.workunit.client.1.smithi134.stdout:9/429: write d7/d8/d16/f33 [822492,57195] 0 2023-12-05T09:26:19.415 INFO:tasks.workunit.client.1.smithi134.stdout:9/430: dread d7/d8/d14/d26/f4a [0,4194304] 0 2023-12-05T09:26:19.415 INFO:tasks.workunit.client.1.smithi134.stdout:9/431: fsync d7/d8/f6a 0 2023-12-05T09:26:19.421 INFO:tasks.workunit.client.1.smithi134.stdout:8/502: write da/de/d16/d45/f61 [245776,76745] 0 2023-12-05T09:26:19.421 INFO:tasks.workunit.client.1.smithi134.stdout:4/463: dwrite d16/d18/d1b/d24/f61 [0,4194304] 0 2023-12-05T09:26:19.424 INFO:tasks.workunit.client.0.smithi067.stdout:9/454: rmdir d1b/d25/d54/d5c 39 2023-12-05T09:26:19.424 INFO:tasks.workunit.client.0.smithi067.stdout:9/455: fdatasync d1b/d25/d54/d5c/d6a/f80 0 2023-12-05T09:26:19.424 INFO:tasks.workunit.client.1.smithi134.stdout:3/490: dwrite f0 [0,4194304] 0 2023-12-05T09:26:19.424 INFO:tasks.workunit.client.1.smithi134.stdout:3/491: creat d4/d5/d7c/f9b x:0 0 0 2023-12-05T09:26:19.426 INFO:tasks.workunit.client.0.smithi067.stdout:2/241: read d0/d15/f1b [178722,85966] 0 2023-12-05T09:26:19.430 INFO:tasks.workunit.client.0.smithi067.stdout:0/406: dwrite d3/df/f36 [0,4194304] 0 2023-12-05T09:26:19.431 INFO:tasks.workunit.client.1.smithi134.stdout:5/409: creat d0/d1a/f8f x:0 0 0 2023-12-05T09:26:19.435 INFO:tasks.workunit.client.0.smithi067.stdout:5/297: read db/df/d1a/d1d/d20/f2a [1760492,40680] 0 2023-12-05T09:26:19.437 INFO:tasks.workunit.client.1.smithi134.stdout:4/464: write d16/d21/f62 [452836,24349] 0 2023-12-05T09:26:19.438 INFO:tasks.workunit.client.0.smithi067.stdout:7/314: rename d0/d9/d1b to d0/d9/d10/d37/d38/d64 0 2023-12-05T09:26:19.438 INFO:tasks.workunit.client.1.smithi134.stdout:2/485: dwrite d19/d28/f81 [0,4194304] 0 2023-12-05T09:26:19.439 INFO:tasks.workunit.client.1.smithi134.stdout:1/543: mkdir d2/d9/d10/d5b/dc4 0 2023-12-05T09:26:19.439 INFO:tasks.workunit.client.1.smithi134.stdout:1/544: creat d2/d9/d10/d30/d66/da9/d74/d99/fc5 x:0 0 0 2023-12-05T09:26:19.441 INFO:tasks.workunit.client.0.smithi067.stdout:9/456: symlink d1b/d25/d5b/d62/la0 0 2023-12-05T09:26:19.441 INFO:tasks.workunit.client.0.smithi067.stdout:9/457: write d1b/d3e/d7f/f97 [920063,43296] 0 2023-12-05T09:26:19.446 INFO:tasks.workunit.client.0.smithi067.stdout:0/407: truncate d3/df/f2b 3975532 0 2023-12-05T09:26:19.455 INFO:tasks.workunit.client.0.smithi067.stdout:1/319: rename d2/d4f/c5e to d2/d5/d7/de/d19/d49/d5f/c72 0 2023-12-05T09:26:19.455 INFO:tasks.workunit.client.0.smithi067.stdout:1/320: dread - d2/d5/d7/de/d19/d49/d6d/f5b zero size 2023-12-05T09:26:19.457 INFO:tasks.workunit.client.1.smithi134.stdout:6/413: getdents d4/d39/d42/d4f/d6d/d3a/da 0 2023-12-05T09:26:19.460 INFO:tasks.workunit.client.0.smithi067.stdout:0/408: unlink d3/d7/d30/f6a 0 2023-12-05T09:26:19.461 INFO:tasks.workunit.client.1.smithi134.stdout:0/433: mknod d13/d14/d15/d67/d73/c98 0 2023-12-05T09:26:19.462 INFO:tasks.workunit.client.0.smithi067.stdout:7/315: dread d0/d9/d10/f2f [0,4194304] 0 2023-12-05T09:26:19.463 INFO:tasks.workunit.client.0.smithi067.stdout:2/242: rename d0/d15/d53/d1e/d42 to d0/d25/d34/d4d/d54 0 2023-12-05T09:26:19.464 INFO:tasks.workunit.client.1.smithi134.stdout:4/465: dread f4 [0,4194304] 0 2023-12-05T09:26:19.464 INFO:tasks.workunit.client.1.smithi134.stdout:4/466: write d16/d18/d1a/f8c [1029488,111885] 0 2023-12-05T09:26:19.465 INFO:tasks.workunit.client.0.smithi067.stdout:1/321: mknod d2/d4f/c73 0 2023-12-05T09:26:19.467 INFO:tasks.workunit.client.0.smithi067.stdout:8/280: dwrite d5/f1c [0,4194304] 0 2023-12-05T09:26:19.468 INFO:tasks.workunit.client.1.smithi134.stdout:7/446: getdents d2/d7/dc/d2e/d3a/d6d 0 2023-12-05T09:26:19.469 INFO:tasks.workunit.client.1.smithi134.stdout:9/432: link d7/d8/d14/d26/c7e d7/d8/d14/d26/c90 0 2023-12-05T09:26:19.469 INFO:tasks.workunit.client.1.smithi134.stdout:9/433: creat d7/d8/f91 x:0 0 0 2023-12-05T09:26:19.471 INFO:tasks.workunit.client.0.smithi067.stdout:2/243: link d0/d15/d53/c12 d0/d25/d3a/c55 0 2023-12-05T09:26:19.472 INFO:tasks.workunit.client.0.smithi067.stdout:0/409: dread d3/f32 [0,4194304] 0 2023-12-05T09:26:19.473 INFO:tasks.workunit.client.1.smithi134.stdout:5/410: dwrite d0/dd/f14 [0,4194304] 0 2023-12-05T09:26:19.476 INFO:tasks.workunit.client.0.smithi067.stdout:4/282: dwrite d0/d1d/d25/d38/f57 [0,4194304] 0 2023-12-05T09:26:19.476 INFO:tasks.workunit.client.0.smithi067.stdout:9/458: dread d1b/f20 [0,4194304] 0 2023-12-05T09:26:19.477 INFO:tasks.workunit.client.0.smithi067.stdout:7/316: rename d0/d9/d40/d48/f50 to d0/d9/d10/d37/d38/d64/d54/f65 0 2023-12-05T09:26:19.480 INFO:tasks.workunit.client.0.smithi067.stdout:1/322: mkdir d2/d4f/d15/d74 0 2023-12-05T09:26:19.483 INFO:tasks.workunit.client.0.smithi067.stdout:5/298: dwrite db/df/d1a/f4c [4194304,4194304] 0 2023-12-05T09:26:19.483 INFO:tasks.workunit.client.1.smithi134.stdout:8/503: rename da/de/d11/f34 to da/de/d16/d45/d3b/fac 0 2023-12-05T09:26:19.483 INFO:tasks.workunit.client.0.smithi067.stdout:9/459: creat d1b/d25/d94/fa1 x:0 0 0 2023-12-05T09:26:19.486 INFO:tasks.workunit.client.0.smithi067.stdout:0/410: rename d3/d7/d3c/d66/l80 to d3/d7/d30/l96 0 2023-12-05T09:26:19.494 INFO:tasks.workunit.client.1.smithi134.stdout:2/486: mknod d19/d28/d2b/c96 0 2023-12-05T09:26:19.495 INFO:tasks.workunit.client.0.smithi067.stdout:5/299: mkdir db/df/d36/d6c 0 2023-12-05T09:26:19.495 INFO:tasks.workunit.client.0.smithi067.stdout:5/300: chown db/df/d36/d6c 48376825 1 2023-12-05T09:26:19.499 INFO:tasks.workunit.client.1.smithi134.stdout:1/545: link d2/ld d2/d9/d10/d94/lc6 0 2023-12-05T09:26:19.505 INFO:tasks.workunit.client.1.smithi134.stdout:6/414: creat d4/d39/d42/d4f/d6d/d3a/da/f77 x:0 0 0 2023-12-05T09:26:19.508 INFO:tasks.workunit.client.1.smithi134.stdout:0/434: mknod d13/d14/d59/d78/c99 0 2023-12-05T09:26:19.510 INFO:tasks.workunit.client.0.smithi067.stdout:1/323: rename d2/d4f/f3e to d2/d4f/d15/d60/d68/f75 0 2023-12-05T09:26:19.513 INFO:tasks.workunit.client.1.smithi134.stdout:7/447: unlink d2/d7/dc/f31 0 2023-12-05T09:26:19.514 INFO:tasks.workunit.client.0.smithi067.stdout:0/411: symlink d3/d6b/d6e/l97 0 2023-12-05T09:26:19.515 INFO:tasks.workunit.client.1.smithi134.stdout:4/467: dwrite d16/d18/d1a/d3b/f5d [0,4194304] 0 2023-12-05T09:26:19.515 INFO:tasks.workunit.client.1.smithi134.stdout:5/411: dwrite d0/d1a/d1c/d25/d4d/f68 [8388608,4194304] 0 2023-12-05T09:26:19.518 INFO:tasks.workunit.client.0.smithi067.stdout:1/324: mkdir d2/d4f/d15/d74/d76 0 2023-12-05T09:26:19.518 INFO:tasks.workunit.client.0.smithi067.stdout:1/325: chown d2/d4f/d15/d60/d68/f75 5643 1 2023-12-05T09:26:19.518 INFO:tasks.workunit.client.0.smithi067.stdout:1/326: chown d2/d4f/d14/d48/f59 3040 1 2023-12-05T09:26:19.520 INFO:tasks.workunit.client.1.smithi134.stdout:3/492: rename d4/c5c to d4/d5/d6f/d76/c9c 0 2023-12-05T09:26:19.521 INFO:tasks.workunit.client.1.smithi134.stdout:5/412: write d0/f43 [1653938,20134] 0 2023-12-05T09:26:19.522 INFO:tasks.workunit.client.1.smithi134.stdout:2/487: creat d19/f97 x:0 0 0 2023-12-05T09:26:19.522 INFO:tasks.workunit.client.1.smithi134.stdout:2/488: write d19/d28/d31/f7e [952946,100112] 0 2023-12-05T09:26:19.523 INFO:tasks.workunit.client.1.smithi134.stdout:1/546: mknod d2/d7e/cc7 0 2023-12-05T09:26:19.524 INFO:tasks.workunit.client.1.smithi134.stdout:6/415: mkdir d4/d78 0 2023-12-05T09:26:19.524 INFO:tasks.workunit.client.1.smithi134.stdout:6/416: stat d4/d39/f3e 0 2023-12-05T09:26:19.527 INFO:tasks.workunit.client.0.smithi067.stdout:0/412: dread d3/f39 [0,4194304] 0 2023-12-05T09:26:19.531 INFO:tasks.workunit.client.1.smithi134.stdout:7/448: rmdir d2/df/d2a/d36 39 2023-12-05T09:26:19.531 INFO:tasks.workunit.client.1.smithi134.stdout:7/449: write d2/df/d2a/d36/f5c [4700646,15351] 0 2023-12-05T09:26:19.531 INFO:tasks.workunit.client.0.smithi067.stdout:9/460: write d1b/d25/d35/f4a [3141058,18986] 0 2023-12-05T09:26:19.532 INFO:tasks.workunit.client.0.smithi067.stdout:9/461: write d1b/d25/d54/d5c/d6a/f80 [458413,85577] 0 2023-12-05T09:26:19.537 INFO:tasks.workunit.client.1.smithi134.stdout:4/468: link ff d16/d18/d1c/d63/fa4 0 2023-12-05T09:26:19.537 INFO:tasks.workunit.client.1.smithi134.stdout:4/469: readlink l9 0 2023-12-05T09:26:19.542 INFO:tasks.workunit.client.1.smithi134.stdout:3/493: creat d4/d5/d45/d60/d85/d96/f9d x:0 0 0 2023-12-05T09:26:19.543 INFO:tasks.workunit.client.1.smithi134.stdout:2/489: dread f1 [0,4194304] 0 2023-12-05T09:26:19.543 INFO:tasks.workunit.client.1.smithi134.stdout:5/413: getdents d0/d1a/d1c 0 2023-12-05T09:26:19.543 INFO:tasks.workunit.client.1.smithi134.stdout:2/490: truncate d19/d49/f56 170886 0 2023-12-05T09:26:19.543 INFO:tasks.workunit.client.1.smithi134.stdout:5/414: chown d0/d1a/d3a/c5f 1 1 2023-12-05T09:26:19.545 INFO:tasks.workunit.client.1.smithi134.stdout:1/547: mknod d2/d9/d10/d5b/dc4/cc8 0 2023-12-05T09:26:19.545 INFO:tasks.workunit.client.1.smithi134.stdout:1/548: chown d2/d9/d10/d30/d4a/lae 2147685 1 2023-12-05T09:26:19.546 INFO:tasks.workunit.client.0.smithi067.stdout:7/317: write d0/d9/d10/d1d/f1f [1186725,54372] 0 2023-12-05T09:26:19.549 INFO:tasks.workunit.client.1.smithi134.stdout:4/470: unlink d16/d18/d1b/f97 0 2023-12-05T09:26:19.549 INFO:tasks.workunit.client.1.smithi134.stdout:4/471: creat d16/d21/d35/fa5 x:0 0 0 2023-12-05T09:26:19.549 INFO:tasks.workunit.client.0.smithi067.stdout:7/318: rename d0/d9/f30 to d0/d9/d40/d48/f66 0 2023-12-05T09:26:19.551 INFO:tasks.workunit.client.1.smithi134.stdout:3/494: mknod d4/d1f/c9e 0 2023-12-05T09:26:19.558 INFO:tasks.workunit.client.1.smithi134.stdout:0/435: dread d13/d14/d30/d2c/f47 [0,4194304] 0 2023-12-05T09:26:19.565 INFO:tasks.workunit.client.0.smithi067.stdout:1/327: write d2/d5/d7/de/d19/d49/d5f/d61/f6e [3557402,32616] 0 2023-12-05T09:26:19.567 INFO:tasks.workunit.client.1.smithi134.stdout:5/415: read d0/d66/f76 [1525287,2998] 0 2023-12-05T09:26:19.567 INFO:tasks.workunit.client.1.smithi134.stdout:5/416: write d0/d11/f1b [1680572,42550] 0 2023-12-05T09:26:19.589 INFO:tasks.workunit.client.1.smithi134.stdout:2/491: truncate d19/d28/d2b/f82 1952351 0 2023-12-05T09:26:19.589 INFO:tasks.workunit.client.1.smithi134.stdout:2/492: stat d19/d5f/f7a 0 2023-12-05T09:26:19.594 INFO:tasks.workunit.client.1.smithi134.stdout:1/549: creat d2/d27/db4/fc9 x:0 0 0 2023-12-05T09:26:19.596 INFO:tasks.workunit.client.1.smithi134.stdout:6/417: rmdir d4/d32/d57 39 2023-12-05T09:26:19.606 INFO:tasks.workunit.client.1.smithi134.stdout:9/434: rename d7/d10/d4b to d7/d8/d14/d26/d7f/d92 0 2023-12-05T09:26:19.606 INFO:tasks.workunit.client.1.smithi134.stdout:9/435: chown d7/d7d/f82 7141809 1 2023-12-05T09:26:19.606 INFO:tasks.workunit.client.1.smithi134.stdout:9/436: readlink d7/d8/d14/l2c 0 2023-12-05T09:26:19.606 INFO:tasks.workunit.client.1.smithi134.stdout:8/504: rename da/de to da/de/d16/d45/d3b/dad 22 2023-12-05T09:26:19.606 INFO:tasks.workunit.client.1.smithi134.stdout:8/505: read - da/de/d96/fa1 zero size 2023-12-05T09:26:19.607 INFO:tasks.workunit.client.1.smithi134.stdout:8/506: creat da/de/d43/fae x:0 0 0 2023-12-05T09:26:19.607 INFO:tasks.workunit.client.1.smithi134.stdout:8/507: readlink da/de/d16/l31 0 2023-12-05T09:26:19.607 INFO:tasks.workunit.client.1.smithi134.stdout:8/508: creat da/de/d43/faf x:0 0 0 2023-12-05T09:26:19.607 INFO:tasks.workunit.client.1.smithi134.stdout:8/509: write da/de/d4d/f6c [746118,12031] 0 2023-12-05T09:26:19.607 INFO:tasks.workunit.client.0.smithi067.stdout:8/281: dwrite d5/dc/d1a/d20/f22 [4194304,4194304] 0 2023-12-05T09:26:19.608 INFO:tasks.workunit.client.0.smithi067.stdout:5/301: dwrite db/df/d35/d63/f69 [0,4194304] 0 2023-12-05T09:26:19.608 INFO:tasks.workunit.client.0.smithi067.stdout:5/302: write db/df/f6b [288384,109165] 0 2023-12-05T09:26:19.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/450: dwrite d2/dd/f19 [0,4194304] 0 2023-12-05T09:26:19.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/451: stat d2/df/f79 0 2023-12-05T09:26:19.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/452: truncate d2/d7/d2b/f8e 919190 0 2023-12-05T09:26:19.611 INFO:tasks.workunit.client.1.smithi134.stdout:3/495: creat d4/d1f/d4e/f9f x:0 0 0 2023-12-05T09:26:19.611 INFO:tasks.workunit.client.1.smithi134.stdout:3/496: write d4/d1f/f75 [956287,22683] 0 2023-12-05T09:26:19.611 INFO:tasks.workunit.client.0.smithi067.stdout:9/462: dwrite d1b/f5f [0,4194304] 0 2023-12-05T09:26:19.611 INFO:tasks.workunit.client.0.smithi067.stdout:9/463: fsync d1b/d3e/d7f/f97 0 2023-12-05T09:26:19.611 INFO:tasks.workunit.client.0.smithi067.stdout:4/283: dwrite d0/d1d/d25/d32/f44 [0,4194304] 0 2023-12-05T09:26:19.618 INFO:tasks.workunit.client.0.smithi067.stdout:7/319: mkdir d0/d9/d10/d37/d38/d64/d34/d67 0 2023-12-05T09:26:19.618 INFO:tasks.workunit.client.0.smithi067.stdout:7/320: fsync d0/d9/d10/f1a 0 2023-12-05T09:26:19.618 INFO:tasks.workunit.client.0.smithi067.stdout:7/321: write d0/d9/d10/f1a [2076655,126492] 0 2023-12-05T09:26:19.623 INFO:tasks.workunit.client.1.smithi134.stdout:5/417: dwrite d0/d1a/d3a/f47 [0,4194304] 0 2023-12-05T09:26:19.623 INFO:tasks.workunit.client.1.smithi134.stdout:5/418: chown d0/d1a/d1c/d25/c7c 28510 1 2023-12-05T09:26:19.623 INFO:tasks.workunit.client.1.smithi134.stdout:0/436: dread d13/d14/d30/d2c/f34 [0,4194304] 0 2023-12-05T09:26:19.624 INFO:tasks.workunit.client.1.smithi134.stdout:1/550: creat d2/d9/d10/d30/d66/da9/d74/fca x:0 0 0 2023-12-05T09:26:19.625 INFO:tasks.workunit.client.1.smithi134.stdout:1/551: readlink d2/d9/d10/d30/d66/da9/d74/l98 0 2023-12-05T09:26:19.627 INFO:tasks.workunit.client.0.smithi067.stdout:5/303: symlink db/df/d35/d63/l6d 0 2023-12-05T09:26:19.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/418: mknod d4/d39/d42/d4f/d6d/d3a/d75/d59/c79 0 2023-12-05T09:26:19.630 INFO:tasks.workunit.client.0.smithi067.stdout:8/282: dread d5/f28 [0,4194304] 0 2023-12-05T09:26:19.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/472: getdents d16/d18/d1a/d3b 0 2023-12-05T09:26:19.639 INFO:tasks.workunit.client.0.smithi067.stdout:9/464: dread f10 [0,4194304] 0 2023-12-05T09:26:19.640 INFO:tasks.workunit.client.0.smithi067.stdout:0/413: dwrite d3/d7/d3c/d67/f5b [0,4194304] 0 2023-12-05T09:26:19.641 INFO:tasks.workunit.client.1.smithi134.stdout:9/437: symlink d7/d8/d2e/l93 0 2023-12-05T09:26:19.642 INFO:tasks.workunit.client.1.smithi134.stdout:9/438: chown d7/d8/d14/c4d 1817 1 2023-12-05T09:26:19.651 INFO:tasks.workunit.client.1.smithi134.stdout:4/473: write d16/d18/d1c/d63/fa4 [6879100,67072] 0 2023-12-05T09:26:19.651 INFO:tasks.workunit.client.1.smithi134.stdout:4/474: readlink d16/d18/d1c/d63/l91 0 2023-12-05T09:26:19.652 INFO:tasks.workunit.client.1.smithi134.stdout:8/510: mkdir da/de/d11/d1d/d70/db0 0 2023-12-05T09:26:19.655 INFO:tasks.workunit.client.1.smithi134.stdout:4/475: write d16/d18/d1c/d63/f73 [535024,24602] 0 2023-12-05T09:26:19.658 INFO:tasks.workunit.client.1.smithi134.stdout:7/453: rename d2/d7/dc/f34 to d2/d7/d65/f92 0 2023-12-05T09:26:19.659 INFO:tasks.workunit.client.0.smithi067.stdout:5/304: symlink db/df/d1a/d59/l6e 0 2023-12-05T09:26:19.661 INFO:tasks.workunit.client.1.smithi134.stdout:3/497: mknod d4/d5/d6f/d97/ca0 0 2023-12-05T09:26:19.664 INFO:tasks.workunit.client.0.smithi067.stdout:0/414: creat d3/d7/d3c/d6c/d8a/f98 x:0 0 0 2023-12-05T09:26:19.664 INFO:tasks.workunit.client.0.smithi067.stdout:3/228: sync 2023-12-05T09:26:19.664 INFO:tasks.workunit.client.1.smithi134.stdout:2/493: getdents d19/d28/d31/d6f 0 2023-12-05T09:26:19.665 INFO:tasks.workunit.client.1.smithi134.stdout:2/494: dread - d19/d3f/f88 zero size 2023-12-05T09:26:19.665 INFO:tasks.workunit.client.1.smithi134.stdout:2/495: chown d19/d28/d63/d70/c8d 8374 1 2023-12-05T09:26:19.672 INFO:tasks.workunit.client.1.smithi134.stdout:3/498: write d4/d5/f32 [3807750,37996] 0 2023-12-05T09:26:19.672 INFO:tasks.workunit.client.1.smithi134.stdout:2/496: read d19/d28/f33 [103364,75000] 0 2023-12-05T09:26:19.673 INFO:tasks.workunit.client.1.smithi134.stdout:5/419: mkdir d0/dd/d37/d90 0 2023-12-05T09:26:19.674 INFO:tasks.workunit.client.1.smithi134.stdout:1/552: mknod d2/ccb 0 2023-12-05T09:26:19.677 INFO:tasks.workunit.client.0.smithi067.stdout:7/322: rmdir d0/d9/d40 39 2023-12-05T09:26:19.677 INFO:tasks.workunit.client.0.smithi067.stdout:0/415: mkdir d3/d7/d3c/d66/d90/d99 0 2023-12-05T09:26:19.677 INFO:tasks.workunit.client.0.smithi067.stdout:3/229: creat d9/da/d15/d17/d2b/f4d x:0 0 0 2023-12-05T09:26:19.677 INFO:tasks.workunit.client.0.smithi067.stdout:3/230: readlink d9/da/d15/d17/l23 0 2023-12-05T09:26:19.678 INFO:tasks.workunit.client.1.smithi134.stdout:6/419: mkdir d4/d78/d7a 0 2023-12-05T09:26:19.678 INFO:tasks.workunit.client.1.smithi134.stdout:6/420: fdatasync d4/d39/d42/d4f/d6d/f60 0 2023-12-05T09:26:19.678 INFO:tasks.workunit.client.1.smithi134.stdout:6/421: getdents d4/d39/d42/d4f/d6d/d45 0 2023-12-05T09:26:19.680 INFO:tasks.workunit.client.0.smithi067.stdout:8/283: read d5/dc/d1a/d20/d3e/f42 [1779485,118756] 0 2023-12-05T09:26:19.683 INFO:tasks.workunit.client.1.smithi134.stdout:8/511: creat da/de/d16/d45/d3b/fb1 x:0 0 0 2023-12-05T09:26:19.685 INFO:tasks.workunit.client.0.smithi067.stdout:0/416: rename d3/df/c1c to d3/d6b/d6e/c9a 0 2023-12-05T09:26:19.686 INFO:tasks.workunit.client.1.smithi134.stdout:2/497: dread d19/d28/d31/f3c [0,4194304] 0 2023-12-05T09:26:19.686 INFO:tasks.workunit.client.1.smithi134.stdout:2/498: truncate d19/d28/d2b/f57 981374 0 2023-12-05T09:26:19.686 INFO:tasks.workunit.client.1.smithi134.stdout:4/476: mknod d16/d21/d47/d4b/ca6 0 2023-12-05T09:26:19.687 INFO:tasks.workunit.client.1.smithi134.stdout:0/437: rmdir d13/d14/d30/d4b 39 2023-12-05T09:26:19.687 INFO:tasks.workunit.client.0.smithi067.stdout:3/231: symlink d9/da/d15/d28/l4e 0 2023-12-05T09:26:19.688 INFO:tasks.workunit.client.0.smithi067.stdout:8/284: getdents d5/d3b 0 2023-12-05T09:26:19.690 INFO:tasks.workunit.client.1.smithi134.stdout:9/439: rename d7/d8/d14/d26/d7f/d92/l86 to d7/d8/d14/d26/d7f/l94 0 2023-12-05T09:26:19.700 INFO:tasks.workunit.client.1.smithi134.stdout:7/454: mkdir d2/d7/d93 0 2023-12-05T09:26:19.700 INFO:tasks.workunit.client.1.smithi134.stdout:7/455: dread - d2/df/f68 zero size 2023-12-05T09:26:19.700 INFO:tasks.workunit.client.1.smithi134.stdout:7/456: dread - d2/d7/d2b/d2d/d67/f6e zero size 2023-12-05T09:26:19.701 INFO:tasks.workunit.client.0.smithi067.stdout:3/232: creat d9/d20/f4f x:0 0 0 2023-12-05T09:26:19.704 INFO:tasks.workunit.client.0.smithi067.stdout:8/285: creat d5/dc/d1a/d20/d2d/d41/f4d x:0 0 0 2023-12-05T09:26:19.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/499: mknod d4/d5/d45/d60/d85/ca1 0 2023-12-05T09:26:19.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/500: dread - d4/d5/d7c/f9b zero size 2023-12-05T09:26:19.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/501: creat d4/d5/fa2 x:0 0 0 2023-12-05T09:26:19.707 INFO:tasks.workunit.client.1.smithi134.stdout:5/420: creat d0/d1a/d1c/d3f/d5b/d5d/d78/f91 x:0 0 0 2023-12-05T09:26:19.708 INFO:tasks.workunit.client.0.smithi067.stdout:0/417: rename d3/f28 to d3/d7/d30/f9b 0 2023-12-05T09:26:19.708 INFO:tasks.workunit.client.0.smithi067.stdout:3/233: creat d9/da/d15/f50 x:0 0 0 2023-12-05T09:26:19.709 INFO:tasks.workunit.client.0.smithi067.stdout:3/234: chown d9/da/d15/d17/d1a 12793 1 2023-12-05T09:26:19.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/422: getdents d4/d39/d42/d4f/d6d/d3a/d75/d59 0 2023-12-05T09:26:19.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/423: write d4/d39/d42/d4f/d6d/f48 [394765,20714] 0 2023-12-05T09:26:19.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/424: truncate d4/d39/d42/d4f/d6d/d3a/da/f77 480472 0 2023-12-05T09:26:19.711 INFO:tasks.workunit.client.1.smithi134.stdout:6/425: fsync d4/d39/d42/d4f/d6d/f43 0 2023-12-05T09:26:19.712 INFO:tasks.workunit.client.0.smithi067.stdout:0/418: mknod d3/d7/d3c/d8d/c9c 0 2023-12-05T09:26:19.717 INFO:tasks.workunit.client.1.smithi134.stdout:2/499: mkdir d19/d28/d31/d38/d98 0 2023-12-05T09:26:19.723 INFO:tasks.workunit.client.1.smithi134.stdout:1/553: rename d2/d9/d10/l72 to d2/d9/d10/d30/d66/da9/d74/d99/lcc 0 2023-12-05T09:26:19.724 INFO:tasks.workunit.client.1.smithi134.stdout:0/438: dread f7 [0,4194304] 0 2023-12-05T09:26:19.725 INFO:tasks.workunit.client.1.smithi134.stdout:9/440: truncate f1 7329059 0 2023-12-05T09:26:19.727 INFO:tasks.workunit.client.1.smithi134.stdout:1/554: read d2/d9/d10/d30/d4a/f9a [795349,126366] 0 2023-12-05T09:26:19.728 INFO:tasks.workunit.client.1.smithi134.stdout:7/457: fsync d2/d7/dc/d2e/d3a/f3b 0 2023-12-05T09:26:19.730 INFO:tasks.workunit.client.1.smithi134.stdout:4/477: getdents d16/d18/d1b 0 2023-12-05T09:26:19.730 INFO:tasks.workunit.client.1.smithi134.stdout:4/478: dread - d16/d7b/d6f/f87 zero size 2023-12-05T09:26:19.732 INFO:tasks.workunit.client.0.smithi067.stdout:5/305: dwrite db/df/d1a/d1d/d20/f42 [0,4194304] 0 2023-12-05T09:26:19.732 INFO:tasks.workunit.client.1.smithi134.stdout:5/421: dread d0/dd/f32 [0,4194304] 0 2023-12-05T09:26:19.738 INFO:tasks.workunit.client.0.smithi067.stdout:5/306: symlink db/df/d35/l6f 0 2023-12-05T09:26:19.738 INFO:tasks.workunit.client.1.smithi134.stdout:6/426: rename d4/d39/d42/d4f/d6d/d3a/l11 to d4/d78/d7a/l7b 0 2023-12-05T09:26:19.739 INFO:tasks.workunit.client.1.smithi134.stdout:9/441: mknod d7/d8/d14/d26/d7f/d92/d53/d7b/c95 0 2023-12-05T09:26:19.739 INFO:tasks.workunit.client.1.smithi134.stdout:9/442: truncate d7/d8/d14/f25 5825524 0 2023-12-05T09:26:19.739 INFO:tasks.workunit.client.1.smithi134.stdout:1/555: symlink d2/d9/d10/d30/lcd 0 2023-12-05T09:26:19.739 INFO:tasks.workunit.client.1.smithi134.stdout:8/512: dwrite da/de/d16/d45/fa8 [0,4194304] 0 2023-12-05T09:26:19.739 INFO:tasks.workunit.client.1.smithi134.stdout:8/513: truncate da/de/d96/fa1 679043 0 2023-12-05T09:26:19.739 INFO:tasks.workunit.client.1.smithi134.stdout:3/502: getdents d4/d80 0 2023-12-05T09:26:19.739 INFO:tasks.workunit.client.0.smithi067.stdout:4/284: dwrite d0/d1d/d2b/d50/d15/f20 [4194304,4194304] 0 2023-12-05T09:26:19.741 INFO:tasks.workunit.client.1.smithi134.stdout:2/500: rename d19/d28/d31/f7e to d19/d28/d63/d70/f99 0 2023-12-05T09:26:19.742 INFO:tasks.workunit.client.0.smithi067.stdout:5/307: write db/df/f53 [955812,87675] 0 2023-12-05T09:26:19.742 INFO:tasks.workunit.client.0.smithi067.stdout:5/308: creat db/df/d1a/d1d/d20/f70 x:0 0 0 2023-12-05T09:26:19.746 INFO:tasks.workunit.client.1.smithi134.stdout:9/443: unlink d7/d8/f6a 0 2023-12-05T09:26:19.746 INFO:tasks.workunit.client.1.smithi134.stdout:9/444: truncate d7/d5b/d5e/f64 1947787 0 2023-12-05T09:26:19.746 INFO:tasks.workunit.client.1.smithi134.stdout:1/556: truncate d2/d9/f44 4157389 0 2023-12-05T09:26:19.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/235: fsync d9/da/d15/f50 0 2023-12-05T09:26:19.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/236: chown d9/da/d15/d28/f41 126352283 1 2023-12-05T09:26:19.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/237: read d9/fb [987351,41549] 0 2023-12-05T09:26:19.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/238: write d9/d24/f33 [251956,10210] 0 2023-12-05T09:26:19.747 INFO:tasks.workunit.client.0.smithi067.stdout:4/285: mkdir d0/d1d/d53/d62 0 2023-12-05T09:26:19.747 INFO:tasks.workunit.client.0.smithi067.stdout:4/286: rename d0/d1d/d2b/d50 to d0/d1d/d2b/d50/d15/d63 22 2023-12-05T09:26:19.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/239: read d9/d24/f33 [222188,106346] 0 2023-12-05T09:26:19.752 INFO:tasks.workunit.client.1.smithi134.stdout:7/458: fsync d2/df/d2a/d36/f5c 0 2023-12-05T09:26:19.755 INFO:tasks.workunit.client.1.smithi134.stdout:8/514: mknod da/de/d8a/d42/d99/cb2 0 2023-12-05T09:26:19.757 INFO:tasks.workunit.client.1.smithi134.stdout:2/501: creat d19/d76/f9a x:0 0 0 2023-12-05T09:26:19.758 INFO:tasks.workunit.client.0.smithi067.stdout:3/240: mkdir d9/da/d15/d17/d1a/d51 0 2023-12-05T09:26:19.758 INFO:tasks.workunit.client.0.smithi067.stdout:5/309: write db/df/d1a/f1c [3913964,113879] 0 2023-12-05T09:26:19.759 INFO:tasks.workunit.client.0.smithi067.stdout:8/286: dread d5/dc/d1a/f2e [0,4194304] 0 2023-12-05T09:26:19.762 INFO:tasks.workunit.client.0.smithi067.stdout:4/287: rename d0/d1d/d25/d38/c48 to d0/c64 0 2023-12-05T09:26:19.762 INFO:tasks.workunit.client.1.smithi134.stdout:9/445: mknod d7/d5b/d5e/c96 0 2023-12-05T09:26:19.763 INFO:tasks.workunit.client.1.smithi134.stdout:1/557: unlink d2/d9/d10/d30/d66/da9/d74/l88 0 2023-12-05T09:26:19.764 INFO:tasks.workunit.client.0.smithi067.stdout:7/323: dwrite d0/d9/d10/f1a [4194304,4194304] 0 2023-12-05T09:26:19.764 INFO:tasks.workunit.client.0.smithi067.stdout:0/419: dread d3/df/d10/f20 [0,4194304] 0 2023-12-05T09:26:19.768 INFO:tasks.workunit.client.0.smithi067.stdout:3/241: mknod d9/d49/c52 0 2023-12-05T09:26:19.776 INFO:tasks.workunit.client.1.smithi134.stdout:7/459: mkdir d2/d7/d2b/d94 0 2023-12-05T09:26:19.776 INFO:tasks.workunit.client.1.smithi134.stdout:4/479: dread d16/d21/d69/f83 [0,4194304] 0 2023-12-05T09:26:19.776 INFO:tasks.workunit.client.1.smithi134.stdout:4/480: chown l7 13237 1 2023-12-05T09:26:19.779 INFO:tasks.workunit.client.1.smithi134.stdout:6/427: dread d4/d39/d42/d4f/d6d/d3a/d75/f29 [0,4194304] 0 2023-12-05T09:26:19.779 INFO:tasks.workunit.client.1.smithi134.stdout:6/428: fdatasync d4/d39/d42/d4f/d6d/d3a/d75/f30 0 2023-12-05T09:26:19.780 INFO:tasks.workunit.client.1.smithi134.stdout:2/502: creat d19/d28/d31/d38/d98/f9b x:0 0 0 2023-12-05T09:26:19.780 INFO:tasks.workunit.client.1.smithi134.stdout:2/503: read d19/d5f/f93 [1789225,22438] 0 2023-12-05T09:26:19.783 INFO:tasks.workunit.client.0.smithi067.stdout:5/310: write db/f14 [6815113,93391] 0 2023-12-05T09:26:19.783 INFO:tasks.workunit.client.0.smithi067.stdout:5/311: write db/df/d1a/f58 [754456,118589] 0 2023-12-05T09:26:19.784 INFO:tasks.workunit.client.1.smithi134.stdout:6/429: read d4/d39/f34 [41247,62139] 0 2023-12-05T09:26:19.788 INFO:tasks.workunit.client.0.smithi067.stdout:8/287: dread d5/dc/d1a/d20/f22 [4194304,4194304] 0 2023-12-05T09:26:19.792 INFO:tasks.workunit.client.1.smithi134.stdout:4/481: truncate d16/d18/d1a/f20 3047112 0 2023-12-05T09:26:19.792 INFO:tasks.workunit.client.1.smithi134.stdout:4/482: dread - d16/d21/d47/d4b/f77 zero size 2023-12-05T09:26:19.792 INFO:tasks.workunit.client.1.smithi134.stdout:4/483: truncate d16/d18/d1b/f7d 1571739 0 2023-12-05T09:26:19.792 INFO:tasks.workunit.client.1.smithi134.stdout:4/484: chown d16/d18/d1c/d63/fa4 52057119 1 2023-12-05T09:26:19.793 INFO:tasks.workunit.client.1.smithi134.stdout:4/485: chown d16/f7a 15620253 1 2023-12-05T09:26:19.795 INFO:tasks.workunit.client.1.smithi134.stdout:1/558: read d2/d9/f86 [3735986,14896] 0 2023-12-05T09:26:19.795 INFO:tasks.workunit.client.1.smithi134.stdout:1/559: write d2/d27/f3a [4400054,107758] 0 2023-12-05T09:26:19.798 INFO:tasks.workunit.client.1.smithi134.stdout:7/460: dread d2/d7/dc/d22/f85 [0,4194304] 0 2023-12-05T09:26:19.798 INFO:tasks.workunit.client.1.smithi134.stdout:7/461: read - d2/d7/dc/f78 zero size 2023-12-05T09:26:19.798 INFO:tasks.workunit.client.1.smithi134.stdout:2/504: dread d19/d28/d31/d38/f6a [0,4194304] 0 2023-12-05T09:26:19.799 INFO:tasks.workunit.client.0.smithi067.stdout:3/242: unlink d9/da/d15/d17/d2b/l38 0 2023-12-05T09:26:19.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/560: rename d2/c31 to d2/d9/d10/d30/d66/cce 0 2023-12-05T09:26:19.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/561: fdatasync d2/d9/d10/f3f 0 2023-12-05T09:26:19.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/562: readlink d2/d9/d10/l6a 0 2023-12-05T09:26:19.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/563: chown d2/d9/d10/d5b/c62 598454 1 2023-12-05T09:26:19.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/564: read d2/d9/f2d [1278452,50060] 0 2023-12-05T09:26:19.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/565: readlink d2/l34 0 2023-12-05T09:26:19.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/566: chown d2/d27/l33 13044110 1 2023-12-05T09:26:19.803 INFO:tasks.workunit.client.1.smithi134.stdout:1/567: creat d2/d27/db4/fcf x:0 0 0 2023-12-05T09:26:19.803 INFO:tasks.workunit.client.1.smithi134.stdout:0/439: dwrite d13/f38 [0,4194304] 0 2023-12-05T09:26:19.803 INFO:tasks.workunit.client.1.smithi134.stdout:3/503: dread d4/d5/f1e [0,4194304] 0 2023-12-05T09:26:19.805 INFO:tasks.workunit.client.1.smithi134.stdout:7/462: unlink d2/d7/d2b/d2d/d67/f6e 0 2023-12-05T09:26:19.809 INFO:tasks.workunit.client.1.smithi134.stdout:2/505: symlink d19/d28/d31/d38/l9c 0 2023-12-05T09:26:19.810 INFO:tasks.workunit.client.1.smithi134.stdout:8/515: write f2 [1765772,92083] 0 2023-12-05T09:26:19.813 INFO:tasks.workunit.client.0.smithi067.stdout:5/312: rename db/df/d1a/l41 to db/df/d38/l71 0 2023-12-05T09:26:19.818 INFO:tasks.workunit.client.0.smithi067.stdout:8/288: truncate d5/dc/d1a/d20/f31 3453682 0 2023-12-05T09:26:19.819 INFO:tasks.workunit.client.1.smithi134.stdout:1/568: dread d2/d9/d10/d30/d66/da9/d74/d99/fbd [0,4194304] 0 2023-12-05T09:26:19.820 INFO:tasks.workunit.client.0.smithi067.stdout:3/243: rename d9/l1f to d9/da/l53 0 2023-12-05T09:26:19.820 INFO:tasks.workunit.client.0.smithi067.stdout:5/313: read db/df/f6b [154958,28433] 0 2023-12-05T09:26:19.820 INFO:tasks.workunit.client.0.smithi067.stdout:5/314: stat db/df/d1a/d1d/d20/f51 0 2023-12-05T09:26:19.820 INFO:tasks.workunit.client.0.smithi067.stdout:5/315: fdatasync db/df/d1a/d1d/d20/d46/f5c 0 2023-12-05T09:26:19.820 INFO:tasks.workunit.client.0.smithi067.stdout:5/316: fdatasync db/df/d35/d63/f69 0 2023-12-05T09:26:19.820 INFO:tasks.workunit.client.0.smithi067.stdout:5/317: write db/df/d1a/d1d/d20/f51 [4387643,28742] 0 2023-12-05T09:26:19.820 INFO:tasks.workunit.client.0.smithi067.stdout:5/318: stat db/df/f3d 0 2023-12-05T09:26:19.822 INFO:tasks.workunit.client.1.smithi134.stdout:7/463: creat d2/d70/f95 x:0 0 0 2023-12-05T09:26:19.823 INFO:tasks.workunit.client.1.smithi134.stdout:3/504: truncate f3 1192733 0 2023-12-05T09:26:19.823 INFO:tasks.workunit.client.1.smithi134.stdout:3/505: chown d4/d1f/d50/d52/c4a 454592 1 2023-12-05T09:26:19.826 INFO:tasks.workunit.client.1.smithi134.stdout:8/516: creat da/de/d8a/fb3 x:0 0 0 2023-12-05T09:26:19.826 INFO:tasks.workunit.client.1.smithi134.stdout:8/517: chown da/de/f27 15035550 1 2023-12-05T09:26:19.826 INFO:tasks.workunit.client.1.smithi134.stdout:8/518: truncate da/de/d8a/d42/f5b 520128 0 2023-12-05T09:26:19.829 INFO:tasks.workunit.client.1.smithi134.stdout:1/569: symlink d2/d7e/ld0 0 2023-12-05T09:26:19.833 INFO:tasks.workunit.client.0.smithi067.stdout:3/244: mknod d9/d49/c54 0 2023-12-05T09:26:19.833 INFO:tasks.workunit.client.0.smithi067.stdout:3/245: creat d9/da/d15/d17/f55 x:0 0 0 2023-12-05T09:26:19.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/319: symlink db/df/d1a/d1d/d20/d46/l72 0 2023-12-05T09:26:19.833 INFO:tasks.workunit.client.0.smithi067.stdout:7/324: dwrite d0/f4a [4194304,4194304] 0 2023-12-05T09:26:19.836 INFO:tasks.workunit.client.0.smithi067.stdout:5/320: creat db/df/d36/d57/f73 x:0 0 0 2023-12-05T09:26:19.836 INFO:tasks.workunit.client.0.smithi067.stdout:4/288: dwrite d0/f6 [0,4194304] 0 2023-12-05T09:26:19.843 INFO:tasks.workunit.client.1.smithi134.stdout:7/464: creat d2/d7/dc/d2e/d3a/d6d/f96 x:0 0 0 2023-12-05T09:26:19.843 INFO:tasks.workunit.client.1.smithi134.stdout:8/519: dread da/de/d16/d33/f87 [0,4194304] 0 2023-12-05T09:26:19.843 INFO:tasks.workunit.client.1.smithi134.stdout:7/465: truncate d2/df/d2a/f40 674402 0 2023-12-05T09:26:19.844 INFO:tasks.workunit.client.0.smithi067.stdout:7/325: link d0/f11 d0/d9/d40/f68 0 2023-12-05T09:26:19.845 INFO:tasks.workunit.client.1.smithi134.stdout:5/422: dwrite d0/d1a/f8f [0,4194304] 0 2023-12-05T09:26:19.846 INFO:tasks.workunit.client.1.smithi134.stdout:5/423: dread - d0/d1a/d1c/d25/d6a/f6c zero size 2023-12-05T09:26:19.846 INFO:tasks.workunit.client.1.smithi134.stdout:3/506: unlink d4/d1f/d50/d52/d42/f56 0 2023-12-05T09:26:19.850 INFO:tasks.workunit.client.1.smithi134.stdout:4/486: dread d16/d18/d1a/d3b/f5c [0,4194304] 0 2023-12-05T09:26:19.850 INFO:tasks.workunit.client.0.smithi067.stdout:4/289: rename d0/f6 to d0/d1d/d25/d32/f65 0 2023-12-05T09:26:19.850 INFO:tasks.workunit.client.0.smithi067.stdout:4/290: chown d0/d1d/d3c 11438998 1 2023-12-05T09:26:19.854 INFO:tasks.workunit.client.0.smithi067.stdout:3/246: write d9/da/d15/f1b [5632853,119043] 0 2023-12-05T09:26:19.854 INFO:tasks.workunit.client.1.smithi134.stdout:1/570: creat d2/fd1 x:0 0 0 2023-12-05T09:26:19.854 INFO:tasks.workunit.client.1.smithi134.stdout:1/571: chown d2 523 1 2023-12-05T09:26:19.855 INFO:tasks.workunit.client.0.smithi067.stdout:7/326: rmdir d0/d9/d40/d48 39 2023-12-05T09:26:19.861 INFO:tasks.workunit.client.1.smithi134.stdout:9/446: dwrite d7/f47 [0,4194304] 0 2023-12-05T09:26:19.861 INFO:tasks.workunit.client.1.smithi134.stdout:9/447: fdatasync d7/f1a 0 2023-12-05T09:26:19.864 INFO:tasks.workunit.client.0.smithi067.stdout:3/247: symlink d9/d20/l56 0 2023-12-05T09:26:19.864 INFO:tasks.workunit.client.0.smithi067.stdout:3/248: fdatasync d9/da/d15/d17/f30 0 2023-12-05T09:26:19.864 INFO:tasks.workunit.client.0.smithi067.stdout:3/249: readlink d9/d20/l48 0 2023-12-05T09:26:19.864 INFO:tasks.workunit.client.0.smithi067.stdout:5/321: dread db/df/d1a/d1d/f24 [0,4194304] 0 2023-12-05T09:26:19.864 INFO:tasks.workunit.client.0.smithi067.stdout:5/322: read - db/df/d1a/d1d/d20/f70 zero size 2023-12-05T09:26:19.864 INFO:tasks.workunit.client.0.smithi067.stdout:7/327: symlink d0/d9/d10/d37/d38/d64/d54/l69 0 2023-12-05T09:26:19.864 INFO:tasks.workunit.client.0.smithi067.stdout:7/328: chown d0/d9/d56 104833 1 2023-12-05T09:26:19.866 INFO:tasks.workunit.client.0.smithi067.stdout:4/291: read d0/d1d/d25/d32/f3f [379869,130219] 0 2023-12-05T09:26:19.866 INFO:tasks.workunit.client.0.smithi067.stdout:4/292: truncate d0/d1d/d25/d38/f39 5047195 0 2023-12-05T09:26:19.866 INFO:tasks.workunit.client.0.smithi067.stdout:4/293: read - d0/d1d/d25/d2c/d34/f55 zero size 2023-12-05T09:26:19.868 INFO:tasks.workunit.client.0.smithi067.stdout:0/420: truncate d3/d7/d3c/d67/f5b 745878 0 2023-12-05T09:26:19.877 INFO:tasks.workunit.client.1.smithi134.stdout:2/506: rmdir d19/d28 39 2023-12-05T09:26:19.879 INFO:tasks.workunit.client.0.smithi067.stdout:3/250: rename d9/fb to d9/da/f57 0 2023-12-05T09:26:19.879 INFO:tasks.workunit.client.1.smithi134.stdout:6/430: dwrite d4/ff [0,4194304] 0 2023-12-05T09:26:19.879 INFO:tasks.workunit.client.1.smithi134.stdout:6/431: write d4/d39/f3e [231522,109379] 0 2023-12-05T09:26:19.879 INFO:tasks.workunit.client.1.smithi134.stdout:6/432: stat d4/d32/d57/f5d 0 2023-12-05T09:26:19.883 INFO:tasks.workunit.client.1.smithi134.stdout:8/520: creat da/de/d16/d98/fb4 x:0 0 0 2023-12-05T09:26:19.883 INFO:tasks.workunit.client.1.smithi134.stdout:8/521: creat da/de/d16/d98/fb5 x:0 0 0 2023-12-05T09:26:19.883 INFO:tasks.workunit.client.1.smithi134.stdout:8/522: chown da/de/f54 259 1 2023-12-05T09:26:19.885 INFO:tasks.workunit.client.0.smithi067.stdout:4/294: truncate d0/d1d/d25/d38/f49 8968 0 2023-12-05T09:26:19.887 INFO:tasks.workunit.client.1.smithi134.stdout:7/466: mknod d2/df/d81/c97 0 2023-12-05T09:26:19.889 INFO:tasks.workunit.client.0.smithi067.stdout:5/323: mknod db/df/d1a/c74 0 2023-12-05T09:26:19.892 INFO:tasks.workunit.client.1.smithi134.stdout:8/523: write da/de/d16/d33/f87 [150685,41326] 0 2023-12-05T09:26:19.892 INFO:tasks.workunit.client.1.smithi134.stdout:8/524: chown da/de/d11/c8e 1292634400 1 2023-12-05T09:26:19.896 INFO:tasks.workunit.client.0.smithi067.stdout:5/324: unlink c2 0 2023-12-05T09:26:19.896 INFO:tasks.workunit.client.0.smithi067.stdout:5/325: write db/df/d1a/f28 [4734026,34796] 0 2023-12-05T09:26:19.899 INFO:tasks.workunit.client.1.smithi134.stdout:4/487: symlink d16/d18/d1a/d3b/d8e/la7 0 2023-12-05T09:26:19.900 INFO:tasks.workunit.client.1.smithi134.stdout:4/488: readlink d16/d21/d48/d66/l99 0 2023-12-05T09:26:19.900 INFO:tasks.workunit.client.1.smithi134.stdout:1/572: mknod d2/d9/d10/d5b/cd2 0 2023-12-05T09:26:19.906 INFO:tasks.workunit.client.1.smithi134.stdout:9/448: mkdir d7/d8/d16/d52/d74/d97 0 2023-12-05T09:26:19.907 INFO:tasks.workunit.client.0.smithi067.stdout:5/326: dread db/f14 [4194304,4194304] 0 2023-12-05T09:26:19.908 INFO:tasks.workunit.client.1.smithi134.stdout:8/525: dread da/de/d16/d2d/f36 [0,4194304] 0 2023-12-05T09:26:19.911 INFO:tasks.workunit.client.1.smithi134.stdout:2/507: link d19/d3f/l4c d19/d28/d31/d38/d98/l9d 0 2023-12-05T09:26:19.919 INFO:tasks.workunit.client.1.smithi134.stdout:8/526: write da/f2a [337223,52328] 0 2023-12-05T09:26:19.920 INFO:tasks.workunit.client.1.smithi134.stdout:8/527: truncate da/f89 45168 0 2023-12-05T09:26:19.920 INFO:tasks.workunit.client.1.smithi134.stdout:8/528: write da/de/d16/d2d/f88 [99537,44093] 0 2023-12-05T09:26:19.920 INFO:tasks.workunit.client.1.smithi134.stdout:8/529: truncate da/de/d16/d33/f87 4940372 0 2023-12-05T09:26:19.920 INFO:tasks.workunit.client.0.smithi067.stdout:7/329: write d0/f4a [1504731,19872] 0 2023-12-05T09:26:19.921 INFO:tasks.workunit.client.0.smithi067.stdout:7/330: fsync d0/d9/d40/d48/f66 0 2023-12-05T09:26:19.921 INFO:tasks.workunit.client.0.smithi067.stdout:7/331: dread - d0/d9/f58 zero size 2023-12-05T09:26:19.921 INFO:tasks.workunit.client.0.smithi067.stdout:6/260: sync 2023-12-05T09:26:19.921 INFO:tasks.workunit.client.0.smithi067.stdout:8/289: dwrite d5/da/f4b [0,4194304] 0 2023-12-05T09:26:19.921 INFO:tasks.workunit.client.0.smithi067.stdout:8/290: creat d5/dc/d1a/d20/f4e x:0 0 0 2023-12-05T09:26:19.921 INFO:tasks.workunit.client.0.smithi067.stdout:8/291: fdatasync d5/da/f1f 0 2023-12-05T09:26:19.924 INFO:tasks.workunit.client.0.smithi067.stdout:2/244: sync 2023-12-05T09:26:19.933 INFO:tasks.workunit.client.1.smithi134.stdout:8/530: dread da/de/f2b [0,4194304] 0 2023-12-05T09:26:19.933 INFO:tasks.workunit.client.1.smithi134.stdout:8/531: readlink da/de/d8a/d42/l6f 0 2023-12-05T09:26:19.936 INFO:tasks.workunit.client.0.smithi067.stdout:7/332: mknod d0/d9/d10/d37/d38/d64/d34/c6a 0 2023-12-05T09:26:19.936 INFO:tasks.workunit.client.0.smithi067.stdout:7/333: fsync d0/d9/d10/f32 0 2023-12-05T09:26:19.936 INFO:tasks.workunit.client.0.smithi067.stdout:7/334: chown d0/d45/l5c 7568 1 2023-12-05T09:26:19.940 INFO:tasks.workunit.client.0.smithi067.stdout:8/292: symlink d5/dc/l4f 0 2023-12-05T09:26:19.942 INFO:tasks.workunit.client.0.smithi067.stdout:2/245: mkdir d0/d25/d34/d4d/d54/d56 0 2023-12-05T09:26:19.942 INFO:tasks.workunit.client.0.smithi067.stdout:2/246: write d0/d15/d53/d1e/f3e [632001,68832] 0 2023-12-05T09:26:19.946 INFO:tasks.workunit.client.0.smithi067.stdout:8/293: truncate d5/dc/d1a/f2f 866505 0 2023-12-05T09:26:19.946 INFO:tasks.workunit.client.0.smithi067.stdout:8/294: chown d5/da/c43 1692 1 2023-12-05T09:26:19.955 INFO:tasks.workunit.client.1.smithi134.stdout:7/467: symlink d2/d70/l98 0 2023-12-05T09:26:19.956 INFO:tasks.workunit.client.0.smithi067.stdout:2/247: mknod d0/d25/d34/d4d/d54/d56/c57 0 2023-12-05T09:26:19.956 INFO:tasks.workunit.client.0.smithi067.stdout:4/295: dread d0/d1d/d2b/d50/d15/f33 [0,4194304] 0 2023-12-05T09:26:19.956 INFO:tasks.workunit.client.0.smithi067.stdout:0/421: dwrite d3/d7/fc [0,4194304] 0 2023-12-05T09:26:19.957 INFO:tasks.workunit.client.1.smithi134.stdout:9/449: dread d7/d8/d16/f33 [0,4194304] 0 2023-12-05T09:26:19.957 INFO:tasks.workunit.client.1.smithi134.stdout:9/450: chown d7/d8/d14/d26/c7e 52625084 1 2023-12-05T09:26:19.958 INFO:tasks.workunit.client.1.smithi134.stdout:9/451: truncate d7/d8/d16/d52/f8b 833749 0 2023-12-05T09:26:19.959 INFO:tasks.workunit.client.0.smithi067.stdout:8/295: mknod d5/c50 0 2023-12-05T09:26:19.965 INFO:tasks.workunit.client.0.smithi067.stdout:7/335: dread d0/d9/d10/d37/f28 [4194304,4194304] 0 2023-12-05T09:26:19.966 INFO:tasks.workunit.client.1.smithi134.stdout:5/424: rmdir d0/d11/d61/d75 39 2023-12-05T09:26:19.969 INFO:tasks.workunit.client.1.smithi134.stdout:1/573: dwrite d2/d9/f57 [0,4194304] 0 2023-12-05T09:26:19.970 INFO:tasks.workunit.client.0.smithi067.stdout:0/422: rmdir d3/d7/d3c/d67/d59/d5c/d68 39 2023-12-05T09:26:19.971 INFO:tasks.workunit.client.1.smithi134.stdout:2/508: dwrite d19/d3f/f78 [0,4194304] 0 2023-12-05T09:26:19.972 INFO:tasks.workunit.client.1.smithi134.stdout:4/489: mknod d16/d18/d1b/ca8 0 2023-12-05T09:26:19.972 INFO:tasks.workunit.client.1.smithi134.stdout:4/490: truncate d16/d18/d1b/f31 4787710 0 2023-12-05T09:26:19.973 INFO:tasks.workunit.client.0.smithi067.stdout:7/336: rename d0/f42 to d0/d9/d10/d1d/f6b 0 2023-12-05T09:26:19.974 INFO:tasks.workunit.client.1.smithi134.stdout:9/452: write f1 [2044387,126900] 0 2023-12-05T09:26:19.974 INFO:tasks.workunit.client.1.smithi134.stdout:9/453: write d7/d8/d16/f33 [3998898,82340] 0 2023-12-05T09:26:19.976 INFO:tasks.workunit.client.0.smithi067.stdout:0/423: creat d3/d7/d3c/f9d x:0 0 0 2023-12-05T09:26:19.976 INFO:tasks.workunit.client.0.smithi067.stdout:0/424: fsync d3/df/d10/f20 0 2023-12-05T09:26:19.977 INFO:tasks.workunit.client.0.smithi067.stdout:5/327: dwrite db/df/d3f/f60 [0,4194304] 0 2023-12-05T09:26:19.981 INFO:tasks.workunit.client.0.smithi067.stdout:1/328: sync 2023-12-05T09:26:19.981 INFO:tasks.workunit.client.0.smithi067.stdout:7/337: rename d0/d9/d10/l12 to d0/d9/d10/d37/d38/d64/d5a/l6c 0 2023-12-05T09:26:19.981 INFO:tasks.workunit.client.0.smithi067.stdout:7/338: dread - d0/d9/d10/f5d zero size 2023-12-05T09:26:19.982 INFO:tasks.workunit.client.1.smithi134.stdout:8/532: creat da/de/d8a/d42/d99/fb6 x:0 0 0 2023-12-05T09:26:19.983 INFO:tasks.workunit.client.1.smithi134.stdout:1/574: dread d2/d27/f59 [0,4194304] 0 2023-12-05T09:26:19.984 INFO:tasks.workunit.client.0.smithi067.stdout:0/425: mknod d3/d7/d3c/d66/d90/c9e 0 2023-12-05T09:26:19.986 INFO:tasks.workunit.client.1.smithi134.stdout:7/468: symlink d2/d7/dc/d22/l99 0 2023-12-05T09:26:19.990 INFO:tasks.workunit.client.1.smithi134.stdout:6/433: rmdir d4/d39/d42/d4f/d6d/d3a/da 39 2023-12-05T09:26:19.990 INFO:tasks.workunit.client.1.smithi134.stdout:6/434: fdatasync d4/d39/d42/d4f/d6d/d45/f5f 0 2023-12-05T09:26:19.995 INFO:tasks.workunit.client.1.smithi134.stdout:5/425: link d0/dd/f32 d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/f92 0 2023-12-05T09:26:19.996 INFO:tasks.workunit.client.1.smithi134.stdout:5/426: fsync d0/d1a/d1c/d25/f56 0 2023-12-05T09:26:19.996 INFO:tasks.workunit.client.1.smithi134.stdout:5/427: truncate d0/d1a/d3a/f74 160409 0 2023-12-05T09:26:19.997 INFO:tasks.workunit.client.0.smithi067.stdout:5/328: mkdir db/df/d35/d63/d75 0 2023-12-05T09:26:19.997 INFO:tasks.workunit.client.0.smithi067.stdout:5/329: fsync db/df/d1a/d1d/d20/f70 0 2023-12-05T09:26:20.003 INFO:tasks.workunit.client.0.smithi067.stdout:7/339: link d0/d9/d40/d48/f63 d0/d9/d10/d1d/f6d 0 2023-12-05T09:26:20.008 INFO:tasks.workunit.client.1.smithi134.stdout:2/509: truncate d19/d49/f8e 633359 0 2023-12-05T09:26:20.011 INFO:tasks.workunit.client.0.smithi067.stdout:0/426: write d3/d7/fc [2388225,99978] 0 2023-12-05T09:26:20.012 INFO:tasks.workunit.client.0.smithi067.stdout:7/340: rename d0/l8 to d0/d9/d10/d1d/l6e 0 2023-12-05T09:26:20.013 INFO:tasks.workunit.client.0.smithi067.stdout:7/341: creat d0/d9/f6f x:0 0 0 2023-12-05T09:26:20.017 INFO:tasks.workunit.client.0.smithi067.stdout:9/465: sync 2023-12-05T09:26:20.018 INFO:tasks.workunit.client.1.smithi134.stdout:4/491: mknod d16/d7b/d6f/ca9 0 2023-12-05T09:26:20.018 INFO:tasks.workunit.client.1.smithi134.stdout:9/454: getdents d7/d8/d14/d26/d7f 0 2023-12-05T09:26:20.018 INFO:tasks.workunit.client.0.smithi067.stdout:0/427: creat d3/d7/d3c/d66/d90/d99/f9f x:0 0 0 2023-12-05T09:26:20.019 INFO:tasks.workunit.client.0.smithi067.stdout:0/428: creat d3/d7/d3c/d67/d59/d4e/fa0 x:0 0 0 2023-12-05T09:26:20.019 INFO:tasks.workunit.client.1.smithi134.stdout:3/507: sync 2023-12-05T09:26:20.020 INFO:tasks.workunit.client.1.smithi134.stdout:0/440: sync 2023-12-05T09:26:20.020 INFO:tasks.workunit.client.1.smithi134.stdout:3/508: read d4/f38 [662478,129527] 0 2023-12-05T09:26:20.022 INFO:tasks.workunit.client.1.smithi134.stdout:8/533: rename da/de/d11/d1d/d70/f82 to da/de/fb7 0 2023-12-05T09:26:20.022 INFO:tasks.workunit.client.1.smithi134.stdout:8/534: chown da/de/f7a 252586114 1 2023-12-05T09:26:20.023 INFO:tasks.workunit.client.1.smithi134.stdout:1/575: creat d2/d27/d71/d80/db8/fd3 x:0 0 0 2023-12-05T09:26:20.026 INFO:tasks.workunit.client.0.smithi067.stdout:7/342: truncate d0/d9/d40/f68 312207 0 2023-12-05T09:26:20.027 INFO:tasks.workunit.client.1.smithi134.stdout:7/469: unlink d2/df/c44 0 2023-12-05T09:26:20.029 INFO:tasks.workunit.client.0.smithi067.stdout:9/466: creat d1b/fa2 x:0 0 0 2023-12-05T09:26:20.030 INFO:tasks.workunit.client.0.smithi067.stdout:9/467: write d1b/d25/d94/fa1 [839188,36101] 0 2023-12-05T09:26:20.035 INFO:tasks.workunit.client.1.smithi134.stdout:5/428: creat d0/d1a/d1c/d3f/d81/d8a/f93 x:0 0 0 2023-12-05T09:26:20.035 INFO:tasks.workunit.client.1.smithi134.stdout:5/429: chown d0/d11/c21 3 1 2023-12-05T09:26:20.037 INFO:tasks.workunit.client.0.smithi067.stdout:0/429: mkdir d3/d7/d3c/d67/da1 0 2023-12-05T09:26:20.041 INFO:tasks.workunit.client.0.smithi067.stdout:4/296: dwrite d0/d1d/d25/d38/f49 [0,4194304] 0 2023-12-05T09:26:20.041 INFO:tasks.workunit.client.0.smithi067.stdout:4/297: chown d0/d1d/d25/d2c/l2d 1883241 1 2023-12-05T09:26:20.042 INFO:tasks.workunit.client.1.smithi134.stdout:2/510: mkdir d19/d28/d9e 0 2023-12-05T09:26:20.043 INFO:tasks.workunit.client.1.smithi134.stdout:6/435: dwrite d4/d39/d42/d4f/d6d/d3a/f3d [0,4194304] 0 2023-12-05T09:26:20.043 INFO:tasks.workunit.client.1.smithi134.stdout:6/436: chown d4/d39/d42/d4f/c62 1 1 2023-12-05T09:26:20.043 INFO:tasks.workunit.client.0.smithi067.stdout:7/343: symlink d0/d9/d10/d37/d38/d64/l70 0 2023-12-05T09:26:20.045 INFO:tasks.workunit.client.0.smithi067.stdout:5/330: dread db/df/d1a/d1d/f24 [0,4194304] 0 2023-12-05T09:26:20.045 INFO:tasks.workunit.client.1.smithi134.stdout:9/455: symlink d7/d8/d14/d26/d7f/d92/l98 0 2023-12-05T09:26:20.046 INFO:tasks.workunit.client.1.smithi134.stdout:9/456: read - d7/d8/d14/d26/d5a/f8d zero size 2023-12-05T09:26:20.046 INFO:tasks.workunit.client.1.smithi134.stdout:9/457: write d7/d8/d14/d26/f4a [907779,68669] 0 2023-12-05T09:26:20.046 INFO:tasks.workunit.client.0.smithi067.stdout:9/468: mknod d1b/d25/ca3 0 2023-12-05T09:26:20.046 INFO:tasks.workunit.client.0.smithi067.stdout:9/469: creat d1b/d25/d54/d5c/d6a/d6c/d76/fa4 x:0 0 0 2023-12-05T09:26:20.047 INFO:tasks.workunit.client.0.smithi067.stdout:9/470: truncate d1b/f5f 4300168 0 2023-12-05T09:26:20.050 INFO:tasks.workunit.client.1.smithi134.stdout:3/509: getdents d4/d1f/d4e 0 2023-12-05T09:26:20.050 INFO:tasks.workunit.client.1.smithi134.stdout:0/441: dread d13/d14/d30/d4b/f4e [0,4194304] 0 2023-12-05T09:26:20.050 INFO:tasks.workunit.client.1.smithi134.stdout:0/442: write d13/d14/d30/f88 [331937,49106] 0 2023-12-05T09:26:20.051 INFO:tasks.workunit.client.0.smithi067.stdout:1/329: dwrite d2/f24 [0,4194304] 0 2023-12-05T09:26:20.069 INFO:tasks.workunit.client.0.smithi067.stdout:4/298: creat d0/d1d/d24/f66 x:0 0 0 2023-12-05T09:26:20.069 INFO:tasks.workunit.client.0.smithi067.stdout:4/299: read d0/d1d/d25/f29 [873694,4555] 0 2023-12-05T09:26:20.070 INFO:tasks.workunit.client.1.smithi134.stdout:7/470: write d2/d7/d6f/f90 [6486569,27812] 0 2023-12-05T09:26:20.070 INFO:tasks.workunit.client.1.smithi134.stdout:2/511: creat d19/d28/d63/d70/f9f x:0 0 0 2023-12-05T09:26:20.070 INFO:tasks.workunit.client.1.smithi134.stdout:2/512: stat d19/d28/c75 0 2023-12-05T09:26:20.070 INFO:tasks.workunit.client.1.smithi134.stdout:7/471: fdatasync d2/df/d2a/d36/f5c 0 2023-12-05T09:26:20.070 INFO:tasks.workunit.client.1.smithi134.stdout:7/472: chown d2/d70/l98 207621763 1 2023-12-05T09:26:20.073 INFO:tasks.workunit.client.1.smithi134.stdout:6/437: link d4/d39/d42/d4f/d6d/f43 d4/d39/d42/d4f/d6d/d3a/d75/d59/f7c 0 2023-12-05T09:26:20.073 INFO:tasks.workunit.client.1.smithi134.stdout:3/510: write d4/fb [437628,44404] 0 2023-12-05T09:26:20.078 INFO:tasks.workunit.client.0.smithi067.stdout:1/330: write d2/f39 [2753689,130314] 0 2023-12-05T09:26:20.079 INFO:tasks.workunit.client.1.smithi134.stdout:1/576: dwrite d2/d9/f24 [0,4194304] 0 2023-12-05T09:26:20.079 INFO:tasks.workunit.client.1.smithi134.stdout:1/577: write d2/d9/f2c [581403,23299] 0 2023-12-05T09:26:20.079 INFO:tasks.workunit.client.1.smithi134.stdout:1/578: stat d2/d9/d10/d30/d66/da9/d74/d99 0 2023-12-05T09:26:20.081 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:20 smithi067 ceph-mon[107174]: pgmap v25: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 154 MiB/s rd, 183 MiB/s wr, 251 op/s 2023-12-05T09:26:20.081 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:20 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:20.082 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:20 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:20.082 INFO:tasks.workunit.client.0.smithi067.stdout:2/248: dwrite d0/d25/d34/f3d [0,4194304] 0 2023-12-05T09:26:20.082 INFO:tasks.workunit.client.0.smithi067.stdout:5/331: creat db/df/d35/f76 x:0 0 0 2023-12-05T09:26:20.082 INFO:tasks.workunit.client.0.smithi067.stdout:5/332: chown db/df/d1a/f6a 1989 1 2023-12-05T09:26:20.082 INFO:tasks.workunit.client.0.smithi067.stdout:5/333: chown db/df/d1a/f4c 1788 1 2023-12-05T09:26:20.082 INFO:tasks.workunit.client.0.smithi067.stdout:5/334: stat db/df/d3f/f60 0 2023-12-05T09:26:20.082 INFO:tasks.workunit.client.0.smithi067.stdout:5/335: readlink db/df/d3f/l49 0 2023-12-05T09:26:20.082 INFO:tasks.workunit.client.1.smithi134.stdout:9/458: mkdir d7/d8/d16/d52/d74/d97/d99 0 2023-12-05T09:26:20.083 INFO:tasks.workunit.client.1.smithi134.stdout:8/535: dwrite da/de/d43/fae [0,4194304] 0 2023-12-05T09:26:20.093 INFO:tasks.workunit.client.0.smithi067.stdout:9/471: creat d1b/d25/d54/d5c/d6a/d6c/fa5 x:0 0 0 2023-12-05T09:26:20.097 INFO:tasks.workunit.client.1.smithi134.stdout:0/443: stat d13/d14/d30/d4b/c24 0 2023-12-05T09:26:20.103 INFO:tasks.workunit.client.1.smithi134.stdout:5/430: dwrite d0/d1a/d1c/d3f/d5b/d5d/d78/f91 [0,4194304] 0 2023-12-05T09:26:20.105 INFO:tasks.workunit.client.0.smithi067.stdout:7/344: dwrite d0/d9/d10/d37/f2a [0,4194304] 0 2023-12-05T09:26:20.117 INFO:tasks.workunit.client.0.smithi067.stdout:0/430: rename d3/d7/d3c/d67/d59/d5c/d68 to d3/da2 0 2023-12-05T09:26:20.118 INFO:tasks.workunit.client.1.smithi134.stdout:6/438: write d4/d39/d42/d4f/d6d/d3a/da/f19 [3035451,92383] 0 2023-12-05T09:26:20.119 INFO:tasks.workunit.client.1.smithi134.stdout:6/439: write d4/d32/d57/f6e [118847,16641] 0 2023-12-05T09:26:20.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/300: symlink d0/d1d/d24/l67 0 2023-12-05T09:26:20.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/301: chown d0/d1d/d25/d5c 1 1 2023-12-05T09:26:20.129 INFO:tasks.workunit.client.0.smithi067.stdout:5/336: creat db/df/d1a/f77 x:0 0 0 2023-12-05T09:26:20.131 INFO:tasks.workunit.client.0.smithi067.stdout:9/472: mkdir d1b/d25/d54/d5c/da6 0 2023-12-05T09:26:20.132 INFO:tasks.workunit.client.1.smithi134.stdout:8/536: mkdir da/de/d11/d1d/db8 0 2023-12-05T09:26:20.132 INFO:tasks.workunit.client.1.smithi134.stdout:8/537: stat da/de/d16/f26 0 2023-12-05T09:26:20.137 INFO:tasks.workunit.client.0.smithi067.stdout:2/249: dread d0/d15/d53/d1e/f2e [0,4194304] 0 2023-12-05T09:26:20.137 INFO:tasks.workunit.client.1.smithi134.stdout:3/511: dwrite d4/d1f/d50/d52/d42/f30 [0,4194304] 0 2023-12-05T09:26:20.137 INFO:tasks.workunit.client.1.smithi134.stdout:3/512: chown d4/d1f/d50 59 1 2023-12-05T09:26:20.152 INFO:tasks.workunit.client.1.smithi134.stdout:4/492: rename d16/d18/d1a to d16/d21/d69/d6e/daa 0 2023-12-05T09:26:20.152 INFO:tasks.workunit.client.1.smithi134.stdout:4/493: fsync d16/d21/d35/f9d 0 2023-12-05T09:26:20.152 INFO:tasks.workunit.client.1.smithi134.stdout:4/494: chown d16/d18/d1b/l27 46 1 2023-12-05T09:26:20.152 INFO:tasks.workunit.client.1.smithi134.stdout:4/495: truncate d16/d21/d69/d6e/daa/d3b/fa0 518525 0 2023-12-05T09:26:20.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/331: dwrite d2/d4f/d15/f29 [0,4194304] 0 2023-12-05T09:26:20.154 INFO:tasks.workunit.client.1.smithi134.stdout:1/579: dwrite d2/d27/d40/f84 [0,4194304] 0 2023-12-05T09:26:20.157 INFO:tasks.workunit.client.1.smithi134.stdout:2/513: rmdir d19/d3f 39 2023-12-05T09:26:20.157 INFO:tasks.workunit.client.1.smithi134.stdout:2/514: write d19/d3f/f88 [446566,7158] 0 2023-12-05T09:26:20.158 INFO:tasks.workunit.client.0.smithi067.stdout:4/302: write d0/f8 [4702387,107651] 0 2023-12-05T09:26:20.159 INFO:tasks.workunit.client.1.smithi134.stdout:3/513: dread d4/d5/f10 [0,4194304] 0 2023-12-05T09:26:20.159 INFO:tasks.workunit.client.1.smithi134.stdout:3/514: chown d4/d1f/f5d 862 1 2023-12-05T09:26:20.163 INFO:tasks.workunit.client.0.smithi067.stdout:5/337: getdents db/df/d36/d57 0 2023-12-05T09:26:20.166 INFO:tasks.workunit.client.1.smithi134.stdout:6/440: mknod d4/d39/d42/d4f/d6d/d3a/c7d 0 2023-12-05T09:26:20.168 INFO:tasks.workunit.client.0.smithi067.stdout:0/431: link d3/df/d10/f91 d3/d7/d3c/fa3 0 2023-12-05T09:26:20.169 INFO:tasks.workunit.client.0.smithi067.stdout:4/303: symlink d0/d1d/d25/d32/l68 0 2023-12-05T09:26:20.172 INFO:tasks.workunit.client.0.smithi067.stdout:5/338: mknod db/df/d35/d63/d75/c78 0 2023-12-05T09:26:20.172 INFO:tasks.workunit.client.0.smithi067.stdout:5/339: fdatasync db/df/d1a/d1d/d20/d46/f5c 0 2023-12-05T09:26:20.173 INFO:tasks.workunit.client.0.smithi067.stdout:0/432: truncate d3/d7/d3c/d67/d59/f41 1221229 0 2023-12-05T09:26:20.177 INFO:tasks.workunit.client.1.smithi134.stdout:2/515: write d19/d28/d2b/f4b [1812190,113771] 0 2023-12-05T09:26:20.178 INFO:tasks.workunit.client.0.smithi067.stdout:7/345: dwrite d0/f7 [4194304,4194304] 0 2023-12-05T09:26:20.178 INFO:tasks.workunit.client.0.smithi067.stdout:7/346: creat d0/d9/f71 x:0 0 0 2023-12-05T09:26:20.178 INFO:tasks.workunit.client.0.smithi067.stdout:1/332: dread d2/d4f/d15/f29 [0,4194304] 0 2023-12-05T09:26:20.178 INFO:tasks.workunit.client.0.smithi067.stdout:4/304: creat d0/d1d/d2b/f69 x:0 0 0 2023-12-05T09:26:20.178 INFO:tasks.workunit.client.0.smithi067.stdout:4/305: chown d0/d1d/d25/d2c/d34/l4c 1498 1 2023-12-05T09:26:20.178 INFO:tasks.workunit.client.0.smithi067.stdout:4/306: readlink d0/d1d/d3c/l47 0 2023-12-05T09:26:20.180 INFO:tasks.workunit.client.1.smithi134.stdout:0/444: dwrite d13/d14/d30/d2c/f34 [0,4194304] 0 2023-12-05T09:26:20.180 INFO:tasks.workunit.client.1.smithi134.stdout:5/431: dwrite d0/d11/f22 [0,4194304] 0 2023-12-05T09:26:20.180 INFO:tasks.workunit.client.1.smithi134.stdout:5/432: fdatasync d0/d1a/d1c/d3f/f41 0 2023-12-05T09:26:20.180 INFO:tasks.workunit.client.1.smithi134.stdout:5/433: chown d0/d11/d61/d75/f79 129 1 2023-12-05T09:26:20.181 INFO:tasks.workunit.client.0.smithi067.stdout:5/340: symlink db/df/d36/d57/l79 0 2023-12-05T09:26:20.183 INFO:tasks.workunit.client.0.smithi067.stdout:0/433: mknod d3/d7/d3c/d67/d59/d4e/d94/ca4 0 2023-12-05T09:26:20.184 INFO:tasks.workunit.client.0.smithi067.stdout:0/434: read d3/f31 [43909,53084] 0 2023-12-05T09:26:20.184 INFO:tasks.workunit.client.0.smithi067.stdout:0/435: creat d3/d7/d3c/d6c/fa5 x:0 0 0 2023-12-05T09:26:20.184 INFO:tasks.workunit.client.0.smithi067.stdout:0/436: chown d3/d7/fc 26259502 1 2023-12-05T09:26:20.185 INFO:tasks.workunit.client.0.smithi067.stdout:9/473: dwrite d1b/f24 [0,4194304] 0 2023-12-05T09:26:20.191 INFO:tasks.workunit.client.0.smithi067.stdout:1/333: rename d2/c2b to d2/d4f/d14/d5d/c77 0 2023-12-05T09:26:20.195 INFO:tasks.workunit.client.1.smithi134.stdout:1/580: dwrite d2/d9/d10/d30/f37 [0,4194304] 0 2023-12-05T09:26:20.196 INFO:tasks.workunit.client.0.smithi067.stdout:4/307: symlink d0/d1d/d25/l6a 0 2023-12-05T09:26:20.198 INFO:tasks.workunit.client.0.smithi067.stdout:7/347: dread d0/d9/d10/d37/d38/d64/d54/f65 [0,4194304] 0 2023-12-05T09:26:20.201 INFO:tasks.workunit.client.1.smithi134.stdout:5/434: dread d0/d1a/d1c/d3f/d5b/d5d/d78/f91 [0,4194304] 0 2023-12-05T09:26:20.201 INFO:tasks.workunit.client.1.smithi134.stdout:5/435: creat d0/dd/f94 x:0 0 0 2023-12-05T09:26:20.201 INFO:tasks.workunit.client.1.smithi134.stdout:5/436: chown d0/dd 349470056 1 2023-12-05T09:26:20.201 INFO:tasks.workunit.client.1.smithi134.stdout:5/437: chown d0/d50/d71/l8b 33 1 2023-12-05T09:26:20.201 INFO:tasks.workunit.client.1.smithi134.stdout:5/438: creat d0/d1a/d1c/d25/d6a/f95 x:0 0 0 2023-12-05T09:26:20.202 INFO:tasks.workunit.client.0.smithi067.stdout:5/341: creat db/df/d38/f7a x:0 0 0 2023-12-05T09:26:20.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/437: write d3/d7/d3c/f48 [746373,99019] 0 2023-12-05T09:26:20.207 INFO:tasks.workunit.client.0.smithi067.stdout:0/438: creat d3/df/fa6 x:0 0 0 2023-12-05T09:26:20.211 INFO:tasks.workunit.client.0.smithi067.stdout:9/474: truncate f19 533692 0 2023-12-05T09:26:20.213 INFO:tasks.workunit.client.0.smithi067.stdout:1/334: mkdir d2/d5/d7/de/d19/d49/d5f/d61/d78 0 2023-12-05T09:26:20.213 INFO:tasks.workunit.client.0.smithi067.stdout:1/335: write d2/d4f/d15/d60/f66 [75115,12749] 0 2023-12-05T09:26:20.213 INFO:tasks.workunit.client.0.smithi067.stdout:1/336: read d2/d4f/d14/f3c [554287,63161] 0 2023-12-05T09:26:20.224 INFO:tasks.workunit.client.0.smithi067.stdout:9/475: unlink d1b/d25/d54/f59 0 2023-12-05T09:26:20.228 INFO:tasks.workunit.client.0.smithi067.stdout:1/337: rename d2/d4f/f1e to d2/d5/d7/de/d19/d49/d5f/f79 0 2023-12-05T09:26:20.235 INFO:tasks.workunit.client.1.smithi134.stdout:3/515: creat d4/d5/d7c/d92/fa3 x:0 0 0 2023-12-05T09:26:20.235 INFO:tasks.workunit.client.1.smithi134.stdout:3/516: chown d4/d5/d45/f4d 17278 1 2023-12-05T09:26:20.235 INFO:tasks.workunit.client.1.smithi134.stdout:3/517: read - d4/d1f/d50/d52/f88 zero size 2023-12-05T09:26:20.236 INFO:tasks.workunit.client.1.smithi134.stdout:6/441: creat d4/d39/d42/f7e x:0 0 0 2023-12-05T09:26:20.237 INFO:tasks.workunit.client.0.smithi067.stdout:5/342: rmdir db/df/d3f 39 2023-12-05T09:26:20.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/338: mkdir d2/d4f/d15/d74/d7a 0 2023-12-05T09:26:20.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/339: write d2/d5/d7/de/d1a/f1b [717091,61948] 0 2023-12-05T09:26:20.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/340: dread - d2/d5/f6f zero size 2023-12-05T09:26:20.237 INFO:tasks.workunit.client.0.smithi067.stdout:1/341: stat d2/d4f/d54/d70 0 2023-12-05T09:26:20.241 INFO:tasks.workunit.client.0.smithi067.stdout:1/342: getdents d2/d5/d7 0 2023-12-05T09:26:20.242 INFO:tasks.workunit.client.1.smithi134.stdout:3/518: read d4/d1f/f25 [917133,113397] 0 2023-12-05T09:26:20.246 INFO:tasks.workunit.client.0.smithi067.stdout:9/476: dread d1b/f24 [0,4194304] 0 2023-12-05T09:26:20.246 INFO:tasks.workunit.client.1.smithi134.stdout:8/538: rmdir da/de 39 2023-12-05T09:26:20.249 INFO:tasks.workunit.client.1.smithi134.stdout:2/516: creat d19/d3a/fa0 x:0 0 0 2023-12-05T09:26:20.251 INFO:tasks.workunit.client.1.smithi134.stdout:0/445: symlink d13/d14/d15/d93/l9a 0 2023-12-05T09:26:20.251 INFO:tasks.workunit.client.1.smithi134.stdout:0/446: readlink l12 0 2023-12-05T09:26:20.252 INFO:tasks.workunit.client.1.smithi134.stdout:7/473: rename d2/d7/dc/d2e/d3a/f7a to d2/d7/dc/d2e/f9a 0 2023-12-05T09:26:20.252 INFO:tasks.workunit.client.1.smithi134.stdout:7/474: write d2/df/d81/f91 [198504,48243] 0 2023-12-05T09:26:20.252 INFO:tasks.workunit.client.1.smithi134.stdout:7/475: stat d2/d7/d2b/d94 0 2023-12-05T09:26:20.252 INFO:tasks.workunit.client.1.smithi134.stdout:7/476: getdents d2/df/d2a/d36 0 2023-12-05T09:26:20.252 INFO:tasks.workunit.client.1.smithi134.stdout:4/496: getdents d16/d21/d48/d66 0 2023-12-05T09:26:20.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/581: unlink d2/l52 0 2023-12-05T09:26:20.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/582: fdatasync d2/d9/d10/f92 0 2023-12-05T09:26:20.256 INFO:tasks.workunit.client.1.smithi134.stdout:5/439: truncate d0/d11/f1b 445162 0 2023-12-05T09:26:20.257 INFO:tasks.workunit.client.1.smithi134.stdout:6/442: creat d4/d39/d42/d4f/d6d/d3a/d75/d59/f7f x:0 0 0 2023-12-05T09:26:20.259 INFO:tasks.workunit.client.1.smithi134.stdout:8/539: mkdir da/de/d8a/d42/d99/db9 0 2023-12-05T09:26:20.260 INFO:tasks.workunit.client.1.smithi134.stdout:2/517: creat d19/d28/d31/d6f/fa1 x:0 0 0 2023-12-05T09:26:20.260 INFO:tasks.workunit.client.1.smithi134.stdout:2/518: stat f15 0 2023-12-05T09:26:20.260 INFO:tasks.workunit.client.1.smithi134.stdout:2/519: fdatasync d19/d28/d63/d70/f99 0 2023-12-05T09:26:20.261 INFO:tasks.workunit.client.0.smithi067.stdout:7/348: dread d0/d9/d10/d37/d38/d64/d54/f5e [0,4194304] 0 2023-12-05T09:26:20.261 INFO:tasks.workunit.client.1.smithi134.stdout:7/477: mknod d2/dd/d1a/c9b 0 2023-12-05T09:26:20.262 INFO:tasks.workunit.client.1.smithi134.stdout:4/497: creat d16/d18/d1c/d63/fab x:0 0 0 2023-12-05T09:26:20.263 INFO:tasks.workunit.client.1.smithi134.stdout:1/583: mkdir d2/d9/d10/d30/dd4 0 2023-12-05T09:26:20.264 INFO:tasks.workunit.client.1.smithi134.stdout:5/440: mknod d0/d1a/d1c/d25/c96 0 2023-12-05T09:26:20.265 INFO:tasks.workunit.client.0.smithi067.stdout:7/349: rmdir d0/d9/d10 39 2023-12-05T09:26:20.266 INFO:tasks.workunit.client.1.smithi134.stdout:8/540: creat da/de/d96/fba x:0 0 0 2023-12-05T09:26:20.269 INFO:tasks.workunit.client.0.smithi067.stdout:7/350: mkdir d0/d9/d10/d37/d38/d64/d34/d67/d72 0 2023-12-05T09:26:20.269 INFO:tasks.workunit.client.1.smithi134.stdout:2/520: rmdir d19/d3f 39 2023-12-05T09:26:20.272 INFO:tasks.workunit.client.0.smithi067.stdout:7/351: rename d0/d9/d10/d37/d38/d64/l70 to d0/d9/d10/d37/d38/d64/d5a/l73 0 2023-12-05T09:26:20.274 INFO:tasks.workunit.client.1.smithi134.stdout:6/443: rmdir d4/d39/d42/d4f/d6d/d3a 39 2023-12-05T09:26:20.274 INFO:tasks.workunit.client.1.smithi134.stdout:6/444: write d4/d39/f3e [352895,78779] 0 2023-12-05T09:26:20.276 INFO:tasks.workunit.client.1.smithi134.stdout:5/441: rename d0/d50/d71 to d0/d1a/d1c/d25/d4d/d97 0 2023-12-05T09:26:20.276 INFO:tasks.workunit.client.1.smithi134.stdout:1/584: symlink d2/d9/d10/d30/d4a/d81/ld5 0 2023-12-05T09:26:20.276 INFO:tasks.workunit.client.1.smithi134.stdout:1/585: truncate d2/f63 334596 0 2023-12-05T09:26:20.277 INFO:tasks.workunit.client.0.smithi067.stdout:7/352: symlink d0/d9/d40/d48/l74 0 2023-12-05T09:26:20.277 INFO:tasks.workunit.client.1.smithi134.stdout:8/541: mknod da/de/d11/d1d/d5f/d9b/cbb 0 2023-12-05T09:26:20.278 INFO:tasks.workunit.client.1.smithi134.stdout:1/586: creat d2/d27/d9d/fd6 x:0 0 0 2023-12-05T09:26:20.278 INFO:tasks.workunit.client.1.smithi134.stdout:7/478: symlink d2/d7/dc/d2e/l9c 0 2023-12-05T09:26:20.282 INFO:tasks.workunit.client.1.smithi134.stdout:4/498: dread d16/d21/d69/f83 [0,4194304] 0 2023-12-05T09:26:20.282 INFO:tasks.workunit.client.1.smithi134.stdout:1/587: creat d2/d9/d10/d30/fd7 x:0 0 0 2023-12-05T09:26:20.282 INFO:tasks.workunit.client.1.smithi134.stdout:1/588: dread - d2/d27/f54 zero size 2023-12-05T09:26:20.282 INFO:tasks.workunit.client.1.smithi134.stdout:1/589: fdatasync d2/d9/d10/d30/d66/da9/d74/fca 0 2023-12-05T09:26:20.284 INFO:tasks.workunit.client.1.smithi134.stdout:4/499: mkdir d16/d9c/dac 0 2023-12-05T09:26:20.284 INFO:tasks.workunit.client.1.smithi134.stdout:4/500: dread - d16/d21/d69/d6e/f82 zero size 2023-12-05T09:26:20.287 INFO:tasks.workunit.client.0.smithi067.stdout:9/477: dwrite d1b/f20 [0,4194304] 0 2023-12-05T09:26:20.288 INFO:tasks.workunit.client.1.smithi134.stdout:8/542: dread da/de/d16/d45/d3b/f65 [0,4194304] 0 2023-12-05T09:26:20.293 INFO:tasks.workunit.client.1.smithi134.stdout:5/442: write d0/d1a/d3a/f47 [2270927,71490] 0 2023-12-05T09:26:20.296 INFO:tasks.workunit.client.1.smithi134.stdout:1/590: mknod d2/d9/d8d/da2/cd8 0 2023-12-05T09:26:20.297 INFO:tasks.workunit.client.1.smithi134.stdout:4/501: mkdir d16/d18/dad 0 2023-12-05T09:26:20.297 INFO:tasks.workunit.client.1.smithi134.stdout:4/502: stat d16/d21/d48/d66/f71 0 2023-12-05T09:26:20.297 INFO:tasks.workunit.client.1.smithi134.stdout:4/503: write f0 [4263679,128584] 0 2023-12-05T09:26:20.297 INFO:tasks.workunit.client.1.smithi134.stdout:4/504: write d16/d21/d69/d6e/daa/d3b/f5c [2144127,71638] 0 2023-12-05T09:26:20.305 INFO:tasks.workunit.client.1.smithi134.stdout:8/543: symlink da/de/d8a/d42/lbc 0 2023-12-05T09:26:20.305 INFO:tasks.workunit.client.1.smithi134.stdout:5/443: symlink d0/dd/d37/d7d/l98 0 2023-12-05T09:26:20.305 INFO:tasks.workunit.client.1.smithi134.stdout:8/544: stat da/de/d11/c8e 0 2023-12-05T09:26:20.305 INFO:tasks.workunit.client.1.smithi134.stdout:5/444: fsync d0/d1a/d1c/d3f/f41 0 2023-12-05T09:26:20.305 INFO:tasks.workunit.client.1.smithi134.stdout:8/545: fsync f2 0 2023-12-05T09:26:20.305 INFO:tasks.workunit.client.1.smithi134.stdout:8/546: chown da/de/d16/d45/d3b/fb1 264062 1 2023-12-05T09:26:20.305 INFO:tasks.workunit.client.1.smithi134.stdout:8/547: chown da/de/d11/f19 162 1 2023-12-05T09:26:20.305 INFO:tasks.workunit.client.1.smithi134.stdout:8/548: chown da/de/d8a/d42/d99/cb2 106077 1 2023-12-05T09:26:20.310 INFO:tasks.workunit.client.1.smithi134.stdout:1/591: creat d2/d9/d10/d94/fd9 x:0 0 0 2023-12-05T09:26:20.312 INFO:tasks.workunit.client.0.smithi067.stdout:5/343: write db/df/d1a/f28 [480635,45974] 0 2023-12-05T09:26:20.312 INFO:tasks.workunit.client.0.smithi067.stdout:5/344: read - db/df/d1a/d1d/d20/d46/f62 zero size 2023-12-05T09:26:20.314 INFO:tasks.workunit.client.1.smithi134.stdout:3/519: dwrite d4/f38 [0,4194304] 0 2023-12-05T09:26:20.314 INFO:tasks.workunit.client.1.smithi134.stdout:3/520: creat d4/d5/d45/d60/d85/d96/fa4 x:0 0 0 2023-12-05T09:26:20.317 INFO:tasks.workunit.client.1.smithi134.stdout:4/505: unlink d16/d18/d5b/f8d 0 2023-12-05T09:26:20.317 INFO:tasks.workunit.client.1.smithi134.stdout:5/445: unlink d0/c16 0 2023-12-05T09:26:20.318 INFO:tasks.workunit.client.1.smithi134.stdout:8/549: mkdir da/de/d11/d1d/dbd 0 2023-12-05T09:26:20.318 INFO:tasks.workunit.client.1.smithi134.stdout:8/550: stat da/la0 0 2023-12-05T09:26:20.325 INFO:tasks.workunit.client.1.smithi134.stdout:6/445: dwrite d4/d39/d42/d4f/d6d/d45/f5f [0,4194304] 0 2023-12-05T09:26:20.327 INFO:tasks.workunit.client.1.smithi134.stdout:3/521: symlink d4/d5/d7c/d92/la5 0 2023-12-05T09:26:20.328 INFO:tasks.workunit.client.1.smithi134.stdout:8/551: mkdir da/de/d16/dbe 0 2023-12-05T09:26:20.329 INFO:tasks.workunit.client.1.smithi134.stdout:6/446: mkdir d4/d39/d42/d4f/d6d/d3a/d80 0 2023-12-05T09:26:20.330 INFO:tasks.workunit.client.1.smithi134.stdout:3/522: symlink d4/d5/d45/d86/la6 0 2023-12-05T09:26:20.330 INFO:tasks.workunit.client.1.smithi134.stdout:3/523: fsync d4/d5/d6f/f71 0 2023-12-05T09:26:20.332 INFO:tasks.workunit.client.1.smithi134.stdout:8/552: creat da/de/d11/d8b/fbf x:0 0 0 2023-12-05T09:26:20.334 INFO:tasks.workunit.client.1.smithi134.stdout:6/447: link d4/f46 d4/d39/d42/d4f/d6d/d3a/d80/f81 0 2023-12-05T09:26:20.339 INFO:tasks.workunit.client.0.smithi067.stdout:1/343: dread d2/d5/d7/de/d1a/f4b [0,4194304] 0 2023-12-05T09:26:20.342 INFO:tasks.workunit.client.1.smithi134.stdout:0/447: dwrite d13/d14/f4f [0,4194304] 0 2023-12-05T09:26:20.342 INFO:tasks.workunit.client.1.smithi134.stdout:8/553: mknod da/de/d96/cc0 0 2023-12-05T09:26:20.345 INFO:tasks.workunit.client.0.smithi067.stdout:1/344: creat d2/d5/d7/de/d19/d49/d5f/d61/d78/f7b x:0 0 0 2023-12-05T09:26:20.345 INFO:tasks.workunit.client.0.smithi067.stdout:1/345: write d2/d5/d7/de/d19/d49/d5f/d61/f6e [278943,42268] 0 2023-12-05T09:26:20.346 INFO:tasks.workunit.client.1.smithi134.stdout:7/479: dwrite d2/d7/dc/d22/f4a [0,4194304] 0 2023-12-05T09:26:20.349 INFO:tasks.workunit.client.1.smithi134.stdout:6/448: creat d4/d39/d5c/f82 x:0 0 0 2023-12-05T09:26:20.350 INFO:tasks.workunit.client.0.smithi067.stdout:1/346: rename d2/d5/d7/de/d19/d49/d5f/d61/d78/f7b to d2/d5/d7/de/d1a/f7c 0 2023-12-05T09:26:20.351 INFO:tasks.workunit.client.1.smithi134.stdout:1/592: dread d2/d27/d9d/fa6 [0,4194304] 0 2023-12-05T09:26:20.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/449: mknod d4/d78/c83 0 2023-12-05T09:26:20.356 INFO:tasks.workunit.client.1.smithi134.stdout:8/554: dread f9 [0,4194304] 0 2023-12-05T09:26:20.357 INFO:tasks.workunit.client.1.smithi134.stdout:8/555: write da/f3e [3642797,56642] 0 2023-12-05T09:26:20.357 INFO:tasks.workunit.client.1.smithi134.stdout:1/593: symlink d2/d27/d71/d80/lda 0 2023-12-05T09:26:20.369 INFO:tasks.workunit.client.1.smithi134.stdout:1/594: truncate d2/d9/d10/fac 269226 0 2023-12-05T09:26:20.369 INFO:tasks.workunit.client.1.smithi134.stdout:4/506: dread d16/f41 [0,4194304] 0 2023-12-05T09:26:20.370 INFO:tasks.workunit.client.1.smithi134.stdout:9/459: sync 2023-12-05T09:26:20.372 INFO:tasks.workunit.client.1.smithi134.stdout:1/595: creat d2/d7e/fdb x:0 0 0 2023-12-05T09:26:20.374 INFO:tasks.workunit.client.1.smithi134.stdout:1/596: getdents d2/d9/d10/d5b 0 2023-12-05T09:26:20.374 INFO:tasks.workunit.client.1.smithi134.stdout:1/597: creat d2/d27/db4/fdc x:0 0 0 2023-12-05T09:26:20.374 INFO:tasks.workunit.client.1.smithi134.stdout:7/480: dread d2/d7/d2b/d2d/d67/d73/d26/f1c [0,4194304] 0 2023-12-05T09:26:20.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:20 smithi134 ceph-mon[116304]: pgmap v25: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 154 MiB/s rd, 183 MiB/s wr, 251 op/s 2023-12-05T09:26:20.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:20 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:20.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:20 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:20.381 INFO:tasks.workunit.client.1.smithi134.stdout:1/598: symlink d2/d27/ldd 0 2023-12-05T09:26:20.381 INFO:tasks.workunit.client.1.smithi134.stdout:1/599: write d2/d27/d71/d80/db8/fd3 [98178,23530] 0 2023-12-05T09:26:20.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/600: creat d2/d7e/fde x:0 0 0 2023-12-05T09:26:20.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/601: read d2/d9/d10/f5a [2004327,109342] 0 2023-12-05T09:26:20.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/602: chown d2/d9/d10/d30/d4a/lc3 29988145 1 2023-12-05T09:26:20.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/603: fsync d2/d27/d71/d80/f83 0 2023-12-05T09:26:20.387 INFO:tasks.workunit.client.0.smithi067.stdout:7/353: dwrite d0/d9/f58 [0,4194304] 0 2023-12-05T09:26:20.390 INFO:tasks.workunit.client.0.smithi067.stdout:9/478: dwrite d1b/d3e/f6e [0,4194304] 0 2023-12-05T09:26:20.391 INFO:tasks.workunit.client.1.smithi134.stdout:9/460: dread d7/d5b/d5e/f6c [0,4194304] 0 2023-12-05T09:26:20.391 INFO:tasks.workunit.client.1.smithi134.stdout:9/461: dread - d7/d8/d14/d26/d5a/f8d zero size 2023-12-05T09:26:20.394 INFO:tasks.workunit.client.0.smithi067.stdout:4/308: dwrite d0/f56 [0,4194304] 0 2023-12-05T09:26:20.394 INFO:tasks.workunit.client.0.smithi067.stdout:4/309: creat d0/d9/f6b x:0 0 0 2023-12-05T09:26:20.395 INFO:tasks.workunit.client.1.smithi134.stdout:5/446: dwrite d0/d1a/d1c/d3f/d81/d8a/f93 [0,4194304] 0 2023-12-05T09:26:20.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/447: creat d0/d1a/d3a/f99 x:0 0 0 2023-12-05T09:26:20.398 INFO:tasks.workunit.client.1.smithi134.stdout:8/556: write da/de/d16/d33/f81 [2763926,736] 0 2023-12-05T09:26:20.398 INFO:tasks.workunit.client.1.smithi134.stdout:8/557: chown da/f29 88090105 1 2023-12-05T09:26:20.399 INFO:tasks.workunit.client.1.smithi134.stdout:9/462: creat d7/d8/d16/d52/d74/d97/d99/f9a x:0 0 0 2023-12-05T09:26:20.403 INFO:tasks.workunit.client.0.smithi067.stdout:7/354: creat d0/d9/d10/d37/d38/f75 x:0 0 0 2023-12-05T09:26:20.412 INFO:tasks.workunit.client.0.smithi067.stdout:5/345: dwrite db/df/f53 [0,4194304] 0 2023-12-05T09:26:20.413 INFO:tasks.workunit.client.0.smithi067.stdout:5/346: write db/df/f16 [175093,66188] 0 2023-12-05T09:26:20.414 INFO:tasks.workunit.client.1.smithi134.stdout:7/481: dread d2/d7/dc/d2e/f8c [0,4194304] 0 2023-12-05T09:26:20.424 INFO:tasks.workunit.client.1.smithi134.stdout:8/558: creat da/de/d16/d98/fc1 x:0 0 0 2023-12-05T09:26:20.424 INFO:tasks.workunit.client.1.smithi134.stdout:8/559: write da/de/d11/f1a [531306,117732] 0 2023-12-05T09:26:20.424 INFO:tasks.workunit.client.1.smithi134.stdout:8/560: fsync da/de/d11/f30 0 2023-12-05T09:26:20.427 INFO:tasks.workunit.client.1.smithi134.stdout:9/463: mknod d7/d8/d14/d26/d7f/d92/d53/d7b/d8f/d8a/c9b 0 2023-12-05T09:26:20.428 INFO:tasks.workunit.client.1.smithi134.stdout:9/464: fdatasync d7/d8/d14/d26/f48 0 2023-12-05T09:26:20.431 INFO:tasks.workunit.client.1.smithi134.stdout:7/482: creat d2/df/f9d x:0 0 0 2023-12-05T09:26:20.434 INFO:tasks.workunit.client.1.smithi134.stdout:4/507: dwrite d16/d18/d1b/f9b [0,4194304] 0 2023-12-05T09:26:20.434 INFO:tasks.workunit.client.1.smithi134.stdout:6/450: dwrite d4/d39/f34 [0,4194304] 0 2023-12-05T09:26:20.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/347: dwrite d2/d4f/d15/f29 [0,4194304] 0 2023-12-05T09:26:20.440 INFO:tasks.workunit.client.1.smithi134.stdout:8/561: link da/de/d16/d33/f38 da/de/d16/d98/fc2 0 2023-12-05T09:26:20.443 INFO:tasks.workunit.client.1.smithi134.stdout:4/508: dread d16/d18/d1b/f7d [0,4194304] 0 2023-12-05T09:26:20.445 INFO:tasks.workunit.client.1.smithi134.stdout:9/465: mknod d7/d8/d14/d26/d7f/d92/d53/d7b/c9c 0 2023-12-05T09:26:20.448 INFO:tasks.workunit.client.1.smithi134.stdout:7/483: mkdir d2/d7/dc/d2e/d3a/d6d/d9e 0 2023-12-05T09:26:20.449 INFO:tasks.workunit.client.1.smithi134.stdout:5/448: dwrite d0/d66/f76 [0,4194304] 0 2023-12-05T09:26:20.455 INFO:tasks.workunit.client.1.smithi134.stdout:1/604: dwrite d2/d27/db4/fdc [0,4194304] 0 2023-12-05T09:26:20.458 INFO:tasks.workunit.client.0.smithi067.stdout:4/310: creat d0/d1d/d53/f6c x:0 0 0 2023-12-05T09:26:20.458 INFO:tasks.workunit.client.0.smithi067.stdout:4/311: write d0/d1d/d2b/d50/f59 [639416,54816] 0 2023-12-05T09:26:20.458 INFO:tasks.workunit.client.0.smithi067.stdout:4/312: write d0/d1d/f21 [5043663,108273] 0 2023-12-05T09:26:20.461 INFO:tasks.workunit.client.0.smithi067.stdout:7/355: rmdir d0/d9/d10/d37/d38/d64 39 2023-12-05T09:26:20.465 INFO:tasks.workunit.client.1.smithi134.stdout:5/449: dread d0/f33 [0,4194304] 0 2023-12-05T09:26:20.469 INFO:tasks.workunit.client.0.smithi067.stdout:5/347: rename db/df/d1a/f58 to db/df/d36/f7b 0 2023-12-05T09:26:20.470 INFO:tasks.workunit.client.0.smithi067.stdout:9/479: dwrite f14 [0,4194304] 0 2023-12-05T09:26:20.477 INFO:tasks.workunit.client.0.smithi067.stdout:7/356: creat d0/f76 x:0 0 0 2023-12-05T09:26:20.478 INFO:tasks.workunit.client.1.smithi134.stdout:5/450: dread d0/d1a/d3a/f4e [4194304,4194304] 0 2023-12-05T09:26:20.479 INFO:tasks.workunit.client.1.smithi134.stdout:6/451: creat d4/d32/f84 x:0 0 0 2023-12-05T09:26:20.486 INFO:tasks.workunit.client.0.smithi067.stdout:7/357: rename d0/d9/f2c to d0/d9/d40/f77 0 2023-12-05T09:26:20.487 INFO:tasks.workunit.client.1.smithi134.stdout:8/562: rename da/de/d4d/d68/f84 to da/de/d11/d1d/d5f/fc3 0 2023-12-05T09:26:20.487 INFO:tasks.workunit.client.1.smithi134.stdout:9/466: dread - d7/d8/d2e/f76 zero size 2023-12-05T09:26:20.488 INFO:tasks.workunit.client.0.smithi067.stdout:6/261: sync 2023-12-05T09:26:20.488 INFO:tasks.workunit.client.0.smithi067.stdout:3/251: sync 2023-12-05T09:26:20.488 INFO:tasks.workunit.client.0.smithi067.stdout:8/296: sync 2023-12-05T09:26:20.490 INFO:tasks.workunit.client.0.smithi067.stdout:7/358: unlink d0/d9/d10/d1d/l3b 0 2023-12-05T09:26:20.493 INFO:tasks.workunit.client.0.smithi067.stdout:5/348: dread db/f13 [0,4194304] 0 2023-12-05T09:26:20.494 INFO:tasks.workunit.client.0.smithi067.stdout:9/480: write d1b/f1c [1748953,47032] 0 2023-12-05T09:26:20.494 INFO:tasks.workunit.client.1.smithi134.stdout:4/509: dwrite d16/d21/d69/d6e/daa/d3b/fa0 [0,4194304] 0 2023-12-05T09:26:20.495 INFO:tasks.workunit.client.1.smithi134.stdout:4/510: readlink d16/d18/d5b/l9e 0 2023-12-05T09:26:20.495 INFO:tasks.workunit.client.0.smithi067.stdout:6/262: creat da/d10/d1e/d17/d2f/d2c/d34/f58 x:0 0 0 2023-12-05T09:26:20.498 INFO:tasks.workunit.client.0.smithi067.stdout:3/252: creat d9/f58 x:0 0 0 2023-12-05T09:26:20.499 INFO:tasks.workunit.client.0.smithi067.stdout:8/297: mknod d5/dc/d1a/d20/d3e/c51 0 2023-12-05T09:26:20.501 INFO:tasks.workunit.client.0.smithi067.stdout:7/359: mknod d0/d9/d10/d37/d38/d64/d34/d67/c78 0 2023-12-05T09:26:20.502 INFO:tasks.workunit.client.1.smithi134.stdout:7/484: dread d2/d7/dc/d2e/f4c [0,4194304] 0 2023-12-05T09:26:20.504 INFO:tasks.workunit.client.1.smithi134.stdout:1/605: truncate d2/d9/d10/d5b/f5c 2273008 0 2023-12-05T09:26:20.504 INFO:tasks.workunit.client.0.smithi067.stdout:9/481: mknod d1b/d25/d35/d56/ca7 0 2023-12-05T09:26:20.505 INFO:tasks.workunit.client.1.smithi134.stdout:1/606: read d2/d9/d10/fac [44187,83720] 0 2023-12-05T09:26:20.506 INFO:tasks.workunit.client.1.smithi134.stdout:5/451: creat d0/d1a/d1c/d25/d4d/d60/f9a x:0 0 0 2023-12-05T09:26:20.507 INFO:tasks.workunit.client.1.smithi134.stdout:2/521: sync 2023-12-05T09:26:20.508 INFO:tasks.workunit.client.1.smithi134.stdout:9/467: truncate d7/d8/d2e/f42 2987260 0 2023-12-05T09:26:20.509 INFO:tasks.workunit.client.0.smithi067.stdout:5/349: symlink db/df/d1a/d1d/d20/l7c 0 2023-12-05T09:26:20.510 INFO:tasks.workunit.client.0.smithi067.stdout:7/360: link d0/l3d d0/d9/d40/d48/l79 0 2023-12-05T09:26:20.510 INFO:tasks.workunit.client.0.smithi067.stdout:7/361: write d0/f4a [4034995,7861] 0 2023-12-05T09:26:20.511 INFO:tasks.workunit.client.0.smithi067.stdout:9/482: dread d1b/d25/f33 [0,4194304] 0 2023-12-05T09:26:20.511 INFO:tasks.workunit.client.0.smithi067.stdout:9/483: readlink l13 0 2023-12-05T09:26:20.513 INFO:tasks.workunit.client.1.smithi134.stdout:1/607: creat d2/d9/d10/d5b/fdf x:0 0 0 2023-12-05T09:26:20.513 INFO:tasks.workunit.client.0.smithi067.stdout:9/484: creat d1b/d25/d54/d5c/fa8 x:0 0 0 2023-12-05T09:26:20.513 INFO:tasks.workunit.client.0.smithi067.stdout:9/485: readlink d1b/d25/d35/l3d 0 2023-12-05T09:26:20.514 INFO:tasks.workunit.client.1.smithi134.stdout:5/452: mkdir d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/d9b 0 2023-12-05T09:26:20.514 INFO:tasks.workunit.client.1.smithi134.stdout:5/453: write d0/f46 [880980,11569] 0 2023-12-05T09:26:20.516 INFO:tasks.workunit.client.1.smithi134.stdout:9/468: rename d7/f40 to d7/d8/d14/d26/d7f/d92/f9d 0 2023-12-05T09:26:20.517 INFO:tasks.workunit.client.1.smithi134.stdout:7/485: write d2/d7/dc/d2e/d3a/f4e [4102351,6628] 0 2023-12-05T09:26:20.518 INFO:tasks.workunit.client.1.smithi134.stdout:9/469: mkdir d7/d8/d14/d26/d5a/d69/d9e 0 2023-12-05T09:26:20.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/470: unlink d7/d8/d16/d52/c43 0 2023-12-05T09:26:20.521 INFO:tasks.workunit.client.1.smithi134.stdout:9/471: rename d7/d8/d14/d26/d7f/d92/d53/d7b/d8f/f66 to d7/d10/d56/f9f 0 2023-12-05T09:26:20.521 INFO:tasks.workunit.client.1.smithi134.stdout:9/472: readlink d7/d8/d14/d26/d7f/d92/l98 0 2023-12-05T09:26:20.522 INFO:tasks.workunit.client.1.smithi134.stdout:9/473: fsync d7/d8/d14/d26/f48 0 2023-12-05T09:26:20.522 INFO:tasks.workunit.client.1.smithi134.stdout:9/474: write d7/d8/d14/d26/f3e [1158004,73148] 0 2023-12-05T09:26:20.550 INFO:tasks.workunit.client.1.smithi134.stdout:2/522: dread f6 [0,4194304] 0 2023-12-05T09:26:20.550 INFO:tasks.workunit.client.1.smithi134.stdout:4/511: dwrite ff [4194304,4194304] 0 2023-12-05T09:26:20.552 INFO:tasks.workunit.client.1.smithi134.stdout:2/523: creat d19/d28/d31/d38/fa2 x:0 0 0 2023-12-05T09:26:20.554 INFO:tasks.workunit.client.1.smithi134.stdout:9/475: dread d7/d7d/f82 [0,4194304] 0 2023-12-05T09:26:20.559 INFO:tasks.workunit.client.1.smithi134.stdout:5/454: dread d0/d45/f57 [4194304,4194304] 0 2023-12-05T09:26:20.562 INFO:tasks.workunit.client.1.smithi134.stdout:4/512: rename d16/d18/d5b to d16/d21/d48/d80/dae 0 2023-12-05T09:26:20.562 INFO:tasks.workunit.client.1.smithi134.stdout:5/455: link d0/d11/f1b d0/dd/d37/f9c 0 2023-12-05T09:26:20.564 INFO:tasks.workunit.client.1.smithi134.stdout:5/456: mkdir d0/dd/d37/d90/d9d 0 2023-12-05T09:26:20.577 INFO:tasks.workunit.client.0.smithi067.stdout:9/486: dwrite d1b/d25/d94/fa1 [0,4194304] 0 2023-12-05T09:26:20.580 INFO:tasks.workunit.client.1.smithi134.stdout:1/608: dwrite d2/d9/f2d [0,4194304] 0 2023-12-05T09:26:20.589 INFO:tasks.workunit.client.1.smithi134.stdout:9/476: dread d7/d8/f84 [0,4194304] 0 2023-12-05T09:26:20.592 INFO:tasks.workunit.client.1.smithi134.stdout:9/477: rename d7/d5b/d5e/f64 to d7/d8/d14/d26/d5a/d69/fa0 0 2023-12-05T09:26:20.594 INFO:tasks.workunit.client.1.smithi134.stdout:9/478: mkdir d7/d8/d14/d26/d5a/da1 0 2023-12-05T09:26:20.599 INFO:tasks.workunit.client.1.smithi134.stdout:6/452: dread d4/d39/f34 [0,4194304] 0 2023-12-05T09:26:20.601 INFO:tasks.workunit.client.1.smithi134.stdout:7/486: dwrite d2/d7/dc/d2e/d3a/f5e [0,4194304] 0 2023-12-05T09:26:20.605 INFO:tasks.workunit.client.1.smithi134.stdout:7/487: truncate d2/f8 3844730 0 2023-12-05T09:26:20.608 INFO:tasks.workunit.client.1.smithi134.stdout:7/488: link f1 d2/d7/dc/d22/f9f 0 2023-12-05T09:26:20.613 INFO:tasks.workunit.client.1.smithi134.stdout:7/489: rename d2/d7/d2b/d2d/d67/d87 to d2/d7/d6f/da0 0 2023-12-05T09:26:20.613 INFO:tasks.workunit.client.1.smithi134.stdout:7/490: write d2/d7/dc/d2e/d3a/f49 [1432519,14185] 0 2023-12-05T09:26:20.617 INFO:tasks.workunit.client.1.smithi134.stdout:0/448: sync 2023-12-05T09:26:20.617 INFO:tasks.workunit.client.1.smithi134.stdout:3/524: sync 2023-12-05T09:26:20.617 INFO:tasks.workunit.client.1.smithi134.stdout:0/449: truncate d13/d14/d59/d78/f97 907093 0 2023-12-05T09:26:20.618 INFO:tasks.workunit.client.0.smithi067.stdout:3/253: dread d9/da/d15/d17/d2b/f3e [4194304,4194304] 0 2023-12-05T09:26:20.618 INFO:tasks.workunit.client.1.smithi134.stdout:2/524: dwrite d19/d28/d31/d38/f59 [0,4194304] 0 2023-12-05T09:26:20.619 INFO:tasks.workunit.client.1.smithi134.stdout:3/525: creat d4/d5/d45/d60/fa7 x:0 0 0 2023-12-05T09:26:20.619 INFO:tasks.workunit.client.1.smithi134.stdout:3/526: chown d4/l81 2006 1 2023-12-05T09:26:20.622 INFO:tasks.workunit.client.1.smithi134.stdout:8/563: dwrite da/de/d43/fa3 [0,4194304] 0 2023-12-05T09:26:20.622 INFO:tasks.workunit.client.1.smithi134.stdout:8/564: fdatasync da/de/d16/d2d/f5e 0 2023-12-05T09:26:20.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/450: unlink d13/d14/f70 0 2023-12-05T09:26:20.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/451: chown d13 279 1 2023-12-05T09:26:20.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/452: chown d13/d14/d30/d2c 14 1 2023-12-05T09:26:20.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/453: creat d13/d14/d30/d4b/d23/d77/f9b x:0 0 0 2023-12-05T09:26:20.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/525: mkdir d19/d28/d2b/da3 0 2023-12-05T09:26:20.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/526: chown d19/d28/c75 95520554 1 2023-12-05T09:26:20.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/527: chown d19/d3a/d60/c66 5486948 1 2023-12-05T09:26:20.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/528: stat d19/f24 0 2023-12-05T09:26:20.626 INFO:tasks.workunit.client.1.smithi134.stdout:2/529: chown d19/f97 511423 1 2023-12-05T09:26:20.628 INFO:tasks.workunit.client.1.smithi134.stdout:4/513: dread d16/d21/d48/f34 [0,4194304] 0 2023-12-05T09:26:20.628 INFO:tasks.workunit.client.1.smithi134.stdout:4/514: fsync d16/d21/d69/d6e/daa/d3b/f5a 0 2023-12-05T09:26:20.629 INFO:tasks.workunit.client.1.smithi134.stdout:1/609: read d2/f43 [429235,93405] 0 2023-12-05T09:26:20.629 INFO:tasks.workunit.client.1.smithi134.stdout:1/610: write d2/d9/f2c [1447201,70192] 0 2023-12-05T09:26:20.629 INFO:tasks.workunit.client.1.smithi134.stdout:5/457: dwrite d0/dd/d37/f53 [0,4194304] 0 2023-12-05T09:26:20.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/527: symlink d4/d1f/d4e/d6a/la8 0 2023-12-05T09:26:20.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/528: fdatasync d4/d5/f1a 0 2023-12-05T09:26:20.637 INFO:tasks.workunit.client.1.smithi134.stdout:0/454: readlink d13/d14/l18 0 2023-12-05T09:26:20.637 INFO:tasks.workunit.client.1.smithi134.stdout:2/530: creat d19/d6d/fa4 x:0 0 0 2023-12-05T09:26:20.638 INFO:tasks.workunit.client.1.smithi134.stdout:8/565: dread da/de/d16/d2d/f5e [0,4194304] 0 2023-12-05T09:26:20.641 INFO:tasks.workunit.client.1.smithi134.stdout:1/611: link d2/d9/d10/d94/fd9 d2/d9/d10/d30/d66/da9/d74/d99/fe0 0 2023-12-05T09:26:20.645 INFO:tasks.workunit.client.1.smithi134.stdout:6/453: dread d4/d39/d42/f65 [0,4194304] 0 2023-12-05T09:26:20.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/515: dread d16/d18/f6d [0,4194304] 0 2023-12-05T09:26:20.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/458: mkdir d0/d1a/d1c/d25/d4d/d9e 0 2023-12-05T09:26:20.651 INFO:tasks.workunit.client.0.smithi067.stdout:5/350: read db/df/f15 [7937882,76141] 0 2023-12-05T09:26:20.653 INFO:tasks.workunit.client.0.smithi067.stdout:8/298: dwrite d5/f40 [0,4194304] 0 2023-12-05T09:26:20.653 INFO:tasks.workunit.client.0.smithi067.stdout:8/299: chown d5/da/f4b 1930575 1 2023-12-05T09:26:20.654 INFO:tasks.workunit.client.1.smithi134.stdout:9/479: dwrite d7/d8/f91 [0,4194304] 0 2023-12-05T09:26:20.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/529: symlink d4/d80/la9 0 2023-12-05T09:26:20.662 INFO:tasks.workunit.client.1.smithi134.stdout:0/455: symlink d13/d14/d30/d4b/d66/l9c 0 2023-12-05T09:26:20.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/530: creat d4/d5/d7c/faa x:0 0 0 2023-12-05T09:26:20.662 INFO:tasks.workunit.client.1.smithi134.stdout:2/531: rename d19/d28/d31/f43 to d19/d28/d63/fa5 0 2023-12-05T09:26:20.663 INFO:tasks.workunit.client.1.smithi134.stdout:0/456: truncate d13/d14/d30/f88 1009779 0 2023-12-05T09:26:20.663 INFO:tasks.workunit.client.1.smithi134.stdout:5/459: dread d0/d11/f1b [0,4194304] 0 2023-12-05T09:26:20.664 INFO:tasks.workunit.client.1.smithi134.stdout:5/460: write d0/d1a/d3a/f47 [5118948,51366] 0 2023-12-05T09:26:20.665 INFO:tasks.workunit.client.1.smithi134.stdout:8/566: symlink da/de/d16/d45/d3b/lc4 0 2023-12-05T09:26:20.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/351: getdents db/df/d35/d63/d75 0 2023-12-05T09:26:20.667 INFO:tasks.workunit.client.1.smithi134.stdout:5/461: write d0/d1a/d1c/d25/f84 [115787,46622] 0 2023-12-05T09:26:20.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/254: dwrite d9/da/d15/d17/d2b/f3e [0,4194304] 0 2023-12-05T09:26:20.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/612: mkdir d2/d27/d71/d80/db8/de1 0 2023-12-05T09:26:20.670 INFO:tasks.workunit.client.1.smithi134.stdout:0/457: dread d13/d14/d30/d4b/f41 [0,4194304] 0 2023-12-05T09:26:20.670 INFO:tasks.workunit.client.1.smithi134.stdout:0/458: chown d13/d14/d15/c5e 221 1 2023-12-05T09:26:20.670 INFO:tasks.workunit.client.1.smithi134.stdout:0/459: fsync d13/d14/d15/f21 0 2023-12-05T09:26:20.670 INFO:tasks.workunit.client.1.smithi134.stdout:0/460: stat d13/f17 0 2023-12-05T09:26:20.671 INFO:tasks.workunit.client.1.smithi134.stdout:4/516: getdents d16/d18/d1b 0 2023-12-05T09:26:20.671 INFO:tasks.workunit.client.1.smithi134.stdout:4/517: write d16/d21/d48/f58 [132304,80380] 0 2023-12-05T09:26:20.671 INFO:tasks.workunit.client.1.smithi134.stdout:4/518: fdatasync d16/d21/d69/d6e/daa/d3b/f5d 0 2023-12-05T09:26:20.677 INFO:tasks.workunit.client.1.smithi134.stdout:8/567: dread da/de/d16/d2d/f5e [0,4194304] 0 2023-12-05T09:26:20.679 INFO:tasks.workunit.client.1.smithi134.stdout:7/491: dwrite d2/d7/dc/d2e/d3a/f3b [0,4194304] 0 2023-12-05T09:26:20.679 INFO:tasks.workunit.client.0.smithi067.stdout:5/352: rmdir db/df/d35/d63/d75 39 2023-12-05T09:26:20.679 INFO:tasks.workunit.client.0.smithi067.stdout:5/353: truncate db/df/f16 1070429 0 2023-12-05T09:26:20.680 INFO:tasks.workunit.client.1.smithi134.stdout:6/454: dwrite d4/d39/d42/d4f/d6d/d3a/da/f77 [0,4194304] 0 2023-12-05T09:26:20.683 INFO:tasks.workunit.client.1.smithi134.stdout:9/480: link d7/d10/c3b d7/d10/d56/ca2 0 2023-12-05T09:26:20.684 INFO:tasks.workunit.client.1.smithi134.stdout:9/481: dread - d7/d8/d2e/f76 zero size 2023-12-05T09:26:20.684 INFO:tasks.workunit.client.0.smithi067.stdout:5/354: creat db/df/d35/d63/d75/f7d x:0 0 0 2023-12-05T09:26:20.688 INFO:tasks.workunit.client.1.smithi134.stdout:3/531: rename d4/d5/d45/d60/d8a/d8c to d4/d5/d45/d60/d85/dab 0 2023-12-05T09:26:20.692 INFO:tasks.workunit.client.0.smithi067.stdout:5/355: rename db/df/f3d to db/df/f7e 0 2023-12-05T09:26:20.694 INFO:tasks.workunit.client.0.smithi067.stdout:3/255: write d9/f43 [3182711,91187] 0 2023-12-05T09:26:20.697 INFO:tasks.workunit.client.1.smithi134.stdout:2/532: symlink d19/d49/la6 0 2023-12-05T09:26:20.698 INFO:tasks.workunit.client.1.smithi134.stdout:8/568: dread da/de/fb7 [0,4194304] 0 2023-12-05T09:26:20.698 INFO:tasks.workunit.client.0.smithi067.stdout:5/356: truncate db/df/d1a/d1d/d20/d46/f5c 2572014 0 2023-12-05T09:26:20.699 INFO:tasks.workunit.client.1.smithi134.stdout:1/613: mknod d2/d27/d9d/ce2 0 2023-12-05T09:26:20.699 INFO:tasks.workunit.client.1.smithi134.stdout:1/614: chown d2/d9/d10/d5b/d5e/l8b 5725291 1 2023-12-05T09:26:20.702 INFO:tasks.workunit.client.1.smithi134.stdout:0/461: truncate d13/d14/d30/d2c/f44 445735 0 2023-12-05T09:26:20.702 INFO:tasks.workunit.client.1.smithi134.stdout:0/462: read f7 [857115,38227] 0 2023-12-05T09:26:20.706 INFO:tasks.workunit.client.0.smithi067.stdout:5/357: mknod db/df/d38/c7f 0 2023-12-05T09:26:20.707 INFO:tasks.workunit.client.0.smithi067.stdout:2/250: sync 2023-12-05T09:26:20.707 INFO:tasks.workunit.client.0.smithi067.stdout:2/251: fdatasync d0/d15/d53/f1d 0 2023-12-05T09:26:20.710 INFO:tasks.workunit.client.1.smithi134.stdout:7/492: creat d2/d7/d2b/d94/fa1 x:0 0 0 2023-12-05T09:26:20.710 INFO:tasks.workunit.client.1.smithi134.stdout:7/493: chown d2/d7/dc/d2e/d3a/d6d/d9e 1250854 1 2023-12-05T09:26:20.712 INFO:tasks.workunit.client.0.smithi067.stdout:5/358: mknod db/df/d35/d63/d75/c80 0 2023-12-05T09:26:20.712 INFO:tasks.workunit.client.0.smithi067.stdout:5/359: chown db/df/d1a/d1d/f24 14034051 1 2023-12-05T09:26:20.714 INFO:tasks.workunit.client.0.smithi067.stdout:2/252: getdents d0/d25/d3a 0 2023-12-05T09:26:20.714 INFO:tasks.workunit.client.0.smithi067.stdout:2/253: fdatasync d0/d25/d34/f3d 0 2023-12-05T09:26:20.719 INFO:tasks.workunit.client.0.smithi067.stdout:5/360: mknod db/df/d35/d63/c81 0 2023-12-05T09:26:20.734 INFO:tasks.workunit.client.0.smithi067.stdout:2/254: mkdir d0/d25/d3f/d58 0 2023-12-05T09:26:20.735 INFO:tasks.workunit.client.1.smithi134.stdout:4/519: rename d16/d21/d69/d6e/daa/d3b/d8e/la7 to d16/d21/d48/laf 0 2023-12-05T09:26:20.735 INFO:tasks.workunit.client.1.smithi134.stdout:2/533: truncate d19/f20 926031 0 2023-12-05T09:26:20.736 INFO:tasks.workunit.client.1.smithi134.stdout:8/569: truncate da/de/f54 3526317 0 2023-12-05T09:26:20.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/615: mkdir d2/d9/d10/d30/d66/de3 0 2023-12-05T09:26:20.736 INFO:tasks.workunit.client.1.smithi134.stdout:3/532: symlink d4/d5/d45/d60/d85/dab/lac 0 2023-12-05T09:26:20.736 INFO:tasks.workunit.client.1.smithi134.stdout:3/533: truncate d4/d1f/d50/d52/f88 909348 0 2023-12-05T09:26:20.736 INFO:tasks.workunit.client.1.smithi134.stdout:3/534: chown d4/d1f/l44 1229702 1 2023-12-05T09:26:20.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/616: creat d2/d9/d10/d30/d4a/fe4 x:0 0 0 2023-12-05T09:26:20.736 INFO:tasks.workunit.client.1.smithi134.stdout:8/570: write da/de/d11/d8b/d8c/fa7 [852034,124401] 0 2023-12-05T09:26:20.736 INFO:tasks.workunit.client.1.smithi134.stdout:8/571: truncate da/de/d8a/d42/d99/fb6 546461 0 2023-12-05T09:26:20.738 INFO:tasks.workunit.client.1.smithi134.stdout:7/494: mknod d2/d8f/ca2 0 2023-12-05T09:26:20.739 INFO:tasks.workunit.client.0.smithi067.stdout:2/255: getdents d0 0 2023-12-05T09:26:20.739 INFO:tasks.workunit.client.0.smithi067.stdout:2/256: write d0/d15/d53/d1e/f2d [781116,97583] 0 2023-12-05T09:26:20.739 INFO:tasks.workunit.client.0.smithi067.stdout:2/257: creat d0/d25/f59 x:0 0 0 2023-12-05T09:26:20.741 INFO:tasks.workunit.client.1.smithi134.stdout:4/520: mkdir d16/d21/d48/d66/db0 0 2023-12-05T09:26:20.743 INFO:tasks.workunit.client.1.smithi134.stdout:2/534: mkdir d19/d76/da7 0 2023-12-05T09:26:20.744 INFO:tasks.workunit.client.1.smithi134.stdout:2/535: fsync f18 0 2023-12-05T09:26:20.748 INFO:tasks.workunit.client.0.smithi067.stdout:9/487: dwrite f10 [0,4194304] 0 2023-12-05T09:26:20.748 INFO:tasks.workunit.client.0.smithi067.stdout:2/258: truncate d0/fd 877922 0 2023-12-05T09:26:20.748 INFO:tasks.workunit.client.0.smithi067.stdout:2/259: chown d0/d25/d3a 94 1 2023-12-05T09:26:20.750 INFO:tasks.workunit.client.1.smithi134.stdout:3/535: symlink d4/d5/d45/lad 0 2023-12-05T09:26:20.752 INFO:tasks.workunit.client.1.smithi134.stdout:1/617: mkdir d2/d9/d10/d94/de5 0 2023-12-05T09:26:20.754 INFO:tasks.workunit.client.1.smithi134.stdout:5/462: dwrite d0/f29 [0,4194304] 0 2023-12-05T09:26:20.755 INFO:tasks.workunit.client.0.smithi067.stdout:2/260: unlink d0/d15/d53/c51 0 2023-12-05T09:26:20.755 INFO:tasks.workunit.client.1.smithi134.stdout:6/455: dwrite d4/d39/f3e [0,4194304] 0 2023-12-05T09:26:20.759 INFO:tasks.workunit.client.1.smithi134.stdout:8/572: getdents da/de/d16/d45/d3b 0 2023-12-05T09:26:20.761 INFO:tasks.workunit.client.1.smithi134.stdout:0/463: mkdir d13/d14/d30/d2c/d9d 0 2023-12-05T09:26:20.761 INFO:tasks.workunit.client.1.smithi134.stdout:7/495: mknod d2/d7/d2b/d2d/d67/ca3 0 2023-12-05T09:26:20.771 INFO:tasks.workunit.client.1.smithi134.stdout:3/536: mkdir d4/d5/d6f/d97/dae 0 2023-12-05T09:26:20.771 INFO:tasks.workunit.client.1.smithi134.stdout:1/618: mknod d2/ce6 0 2023-12-05T09:26:20.771 INFO:tasks.workunit.client.1.smithi134.stdout:1/619: readlink d2/d7e/ld0 0 2023-12-05T09:26:20.771 INFO:tasks.workunit.client.1.smithi134.stdout:4/521: creat d16/d18/d1c/fb1 x:0 0 0 2023-12-05T09:26:20.771 INFO:tasks.workunit.client.1.smithi134.stdout:1/620: fdatasync d2/d9/d10/d30/d66/da9/d74/d99/fbd 0 2023-12-05T09:26:20.771 INFO:tasks.workunit.client.1.smithi134.stdout:4/522: creat d16/d7b/d6f/fb2 x:0 0 0 2023-12-05T09:26:20.771 INFO:tasks.workunit.client.1.smithi134.stdout:4/523: read - d16/d21/d35/f9d zero size 2023-12-05T09:26:20.771 INFO:tasks.workunit.client.1.smithi134.stdout:4/524: fsync d16/d18/d1c/d63/f73 0 2023-12-05T09:26:20.772 INFO:tasks.workunit.client.0.smithi067.stdout:2/261: rename d0/d15/f2a to d0/f5a 0 2023-12-05T09:26:20.776 INFO:tasks.workunit.client.1.smithi134.stdout:5/463: creat d0/d11/d61/d75/f9f x:0 0 0 2023-12-05T09:26:20.778 INFO:tasks.workunit.client.1.smithi134.stdout:8/573: creat da/de/d11/d1d/fc5 x:0 0 0 2023-12-05T09:26:20.782 INFO:tasks.workunit.client.0.smithi067.stdout:2/262: link d0/d15/c22 d0/d25/d3a/c5b 0 2023-12-05T09:26:20.782 INFO:tasks.workunit.client.0.smithi067.stdout:2/263: readlink d0/d2f/l4c 0 2023-12-05T09:26:20.783 INFO:tasks.workunit.client.0.smithi067.stdout:2/264: truncate d0/f41 878378 0 2023-12-05T09:26:20.784 INFO:tasks.workunit.client.1.smithi134.stdout:0/464: truncate d13/d14/d30/d2c/f34 2789217 0 2023-12-05T09:26:20.791 INFO:tasks.workunit.client.0.smithi067.stdout:2/265: rmdir d0/d25/d3f/d58 0 2023-12-05T09:26:20.794 INFO:tasks.workunit.client.1.smithi134.stdout:9/482: dwrite d7/d8/d2e/f42 [0,4194304] 0 2023-12-05T09:26:20.795 INFO:tasks.workunit.client.1.smithi134.stdout:3/537: rename d4/d1f/f20 to d4/faf 0 2023-12-05T09:26:20.796 INFO:tasks.workunit.client.0.smithi067.stdout:2/266: mknod d0/d15/c5c 0 2023-12-05T09:26:20.798 INFO:tasks.workunit.client.1.smithi134.stdout:1/621: symlink d2/d27/d71/d80/le7 0 2023-12-05T09:26:20.799 INFO:tasks.workunit.client.1.smithi134.stdout:2/536: dwrite d19/d3f/f58 [0,4194304] 0 2023-12-05T09:26:20.800 INFO:tasks.workunit.client.0.smithi067.stdout:3/256: dwrite d9/da/d15/d17/d1a/f4b [0,4194304] 0 2023-12-05T09:26:20.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/525: rmdir d16/d7b 39 2023-12-05T09:26:20.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/526: readlink d16/d21/l70 0 2023-12-05T09:26:20.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/527: fsync d16/d21/d69/d6e/daa/f79 0 2023-12-05T09:26:20.806 INFO:tasks.workunit.client.0.smithi067.stdout:5/361: dwrite db/df/d1a/d1d/d20/d46/f62 [0,4194304] 0 2023-12-05T09:26:20.808 INFO:tasks.workunit.client.0.smithi067.stdout:9/488: dwrite d1b/d3e/f67 [0,4194304] 0 2023-12-05T09:26:20.813 INFO:tasks.workunit.client.1.smithi134.stdout:8/574: symlink da/de/d16/lc6 0 2023-12-05T09:26:20.813 INFO:tasks.workunit.client.1.smithi134.stdout:8/575: write da/de/d4d/f6c [1217581,61177] 0 2023-12-05T09:26:20.818 INFO:tasks.workunit.client.0.smithi067.stdout:3/257: symlink d9/da/d15/d28/d31/l59 0 2023-12-05T09:26:20.820 INFO:tasks.workunit.client.0.smithi067.stdout:2/267: dread d0/d15/f1b [0,4194304] 0 2023-12-05T09:26:20.821 INFO:tasks.workunit.client.1.smithi134.stdout:5/464: dwrite d0/f7 [4194304,4194304] 0 2023-12-05T09:26:20.822 INFO:tasks.workunit.client.1.smithi134.stdout:9/483: mknod d7/d8/d14/d26/d5a/d69/ca3 0 2023-12-05T09:26:20.822 INFO:tasks.workunit.client.1.smithi134.stdout:8/576: dread da/de/d16/d2d/f36 [0,4194304] 0 2023-12-05T09:26:20.823 INFO:tasks.workunit.client.1.smithi134.stdout:8/577: creat da/fc7 x:0 0 0 2023-12-05T09:26:20.828 INFO:tasks.workunit.client.0.smithi067.stdout:5/362: unlink db/df/d1a/d59/l6e 0 2023-12-05T09:26:20.829 INFO:tasks.workunit.client.1.smithi134.stdout:0/465: rename d13/d14/d30/d4b/d66/l75 to d13/d14/d30/d4b/d23/d77/l9e 0 2023-12-05T09:26:20.829 INFO:tasks.workunit.client.1.smithi134.stdout:0/466: readlink d13/d14/d15/l6a 0 2023-12-05T09:26:20.829 INFO:tasks.workunit.client.1.smithi134.stdout:0/467: readlink d13/d14/l18 0 2023-12-05T09:26:20.833 INFO:tasks.workunit.client.1.smithi134.stdout:3/538: truncate f0 3716479 0 2023-12-05T09:26:20.838 INFO:tasks.workunit.client.0.smithi067.stdout:9/489: symlink d1b/d25/d54/d5c/d6a/d82/la9 0 2023-12-05T09:26:20.838 INFO:tasks.workunit.client.0.smithi067.stdout:9/490: chown d1b/d25/d54/d5c/da6 286873 1 2023-12-05T09:26:20.844 INFO:tasks.workunit.client.0.smithi067.stdout:2/268: rename d0/c14 to d0/d2f/c5d 0 2023-12-05T09:26:20.855 INFO:tasks.workunit.client.0.smithi067.stdout:5/363: mkdir db/df/d82 0 2023-12-05T09:26:20.858 INFO:tasks.workunit.client.0.smithi067.stdout:2/269: rename d0/d15/d53/c36 to d0/d25/d34/d4d/d54/c5e 0 2023-12-05T09:26:20.866 INFO:tasks.workunit.client.1.smithi134.stdout:5/465: dwrite d0/d1a/d1c/d25/d4d/d60/f9a [0,4194304] 0 2023-12-05T09:26:20.868 INFO:tasks.workunit.client.0.smithi067.stdout:5/364: link db/df/d36/f7b db/df/d36/f83 0 2023-12-05T09:26:20.869 INFO:tasks.workunit.client.0.smithi067.stdout:2/270: dread d0/d15/d53/d1e/f2e [0,4194304] 0 2023-12-05T09:26:20.872 INFO:tasks.workunit.client.0.smithi067.stdout:2/271: unlink d0/d15/d53/d1e/f2e 0 2023-12-05T09:26:20.876 INFO:tasks.workunit.client.1.smithi134.stdout:2/537: mkdir d19/d28/d2b/da3/da8 0 2023-12-05T09:26:20.877 INFO:tasks.workunit.client.1.smithi134.stdout:4/528: mkdir d16/d21/d48/d66/db0/db3 0 2023-12-05T09:26:20.879 INFO:tasks.workunit.client.1.smithi134.stdout:5/466: write d0/d1a/d1c/f23 [7731233,72799] 0 2023-12-05T09:26:20.885 INFO:tasks.workunit.client.1.smithi134.stdout:9/484: link d7/d8/d14/c58 d7/d5b/ca4 0 2023-12-05T09:26:20.885 INFO:tasks.workunit.client.0.smithi067.stdout:3/258: dwrite d9/da/d15/d17/f30 [0,4194304] 0 2023-12-05T09:26:20.885 INFO:tasks.workunit.client.0.smithi067.stdout:3/259: readlink d9/d20/l56 0 2023-12-05T09:26:20.886 INFO:tasks.workunit.client.0.smithi067.stdout:3/260: creat d9/da/d15/d28/d29/f5a x:0 0 0 2023-12-05T09:26:20.886 INFO:tasks.workunit.client.0.smithi067.stdout:3/261: chown d9/da/d15/f1b 99675023 1 2023-12-05T09:26:20.889 INFO:tasks.workunit.client.1.smithi134.stdout:3/539: unlink f3 0 2023-12-05T09:26:20.892 INFO:tasks.workunit.client.0.smithi067.stdout:5/365: read db/df/d1a/d1d/f24 [159686,112028] 0 2023-12-05T09:26:20.893 INFO:tasks.workunit.client.0.smithi067.stdout:0/439: sync 2023-12-05T09:26:20.895 INFO:tasks.workunit.client.1.smithi134.stdout:8/578: dwrite da/de/d4d/f91 [0,4194304] 0 2023-12-05T09:26:20.896 INFO:tasks.workunit.client.1.smithi134.stdout:9/485: dread d7/d8/d14/d26/f4a [0,4194304] 0 2023-12-05T09:26:20.896 INFO:tasks.workunit.client.0.smithi067.stdout:3/262: link d9/d49/c52 d9/c5b 0 2023-12-05T09:26:20.897 INFO:tasks.workunit.client.0.smithi067.stdout:3/263: chown d9/da/d15/c2c 230 1 2023-12-05T09:26:20.897 INFO:tasks.workunit.client.0.smithi067.stdout:3/264: fdatasync d9/da/d15/d17/f30 0 2023-12-05T09:26:20.905 INFO:tasks.workunit.client.1.smithi134.stdout:1/622: rmdir d2/d9/d10 39 2023-12-05T09:26:20.905 INFO:tasks.workunit.client.1.smithi134.stdout:1/623: dread - d2/d27/d9d/fd6 zero size 2023-12-05T09:26:20.906 INFO:tasks.workunit.client.0.smithi067.stdout:5/366: write db/df/f7e [2673097,70347] 0 2023-12-05T09:26:20.906 INFO:tasks.workunit.client.0.smithi067.stdout:5/367: chown db/df/c10 1674 1 2023-12-05T09:26:20.906 INFO:tasks.workunit.client.0.smithi067.stdout:9/491: dwrite d1b/d3e/f67 [0,4194304] 0 2023-12-05T09:26:20.909 INFO:tasks.workunit.client.1.smithi134.stdout:2/538: unlink d19/l21 0 2023-12-05T09:26:20.909 INFO:tasks.workunit.client.1.smithi134.stdout:2/539: truncate d19/d28/d31/d38/d98/f9b 827031 0 2023-12-05T09:26:20.909 INFO:tasks.workunit.client.1.smithi134.stdout:2/540: write d19/d5f/f7a [2276,109543] 0 2023-12-05T09:26:20.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/529: mknod d16/d21/d69/cb4 0 2023-12-05T09:26:20.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/348: sync 2023-12-05T09:26:20.913 INFO:tasks.workunit.client.1.smithi134.stdout:5/467: creat d0/d1a/d1c/d25/d4d/d97/fa0 x:0 0 0 2023-12-05T09:26:20.915 INFO:tasks.workunit.client.0.smithi067.stdout:5/368: link db/df/d1a/d1d/d20/d46/c68 db/df/d35/d63/c84 0 2023-12-05T09:26:20.916 INFO:tasks.workunit.client.0.smithi067.stdout:5/369: stat db/df/f53 0 2023-12-05T09:26:20.916 INFO:tasks.workunit.client.0.smithi067.stdout:5/370: stat db/df/d1a/d1d/d20/f51 0 2023-12-05T09:26:20.916 INFO:tasks.workunit.client.0.smithi067.stdout:5/371: chown db/df/d1a/f4c 24671399 1 2023-12-05T09:26:20.916 INFO:tasks.workunit.client.1.smithi134.stdout:0/468: symlink d13/d14/d30/d2c/l9f 0 2023-12-05T09:26:20.917 INFO:tasks.workunit.client.1.smithi134.stdout:3/540: mkdir d4/d5/d45/d86/db0 0 2023-12-05T09:26:20.918 INFO:tasks.workunit.client.0.smithi067.stdout:5/372: rmdir db/df/d1a/d1d 39 2023-12-05T09:26:20.920 INFO:tasks.workunit.client.1.smithi134.stdout:7/496: sync 2023-12-05T09:26:20.920 INFO:tasks.workunit.client.1.smithi134.stdout:6/456: sync 2023-12-05T09:26:20.920 INFO:tasks.workunit.client.1.smithi134.stdout:8/579: rename da/de/d16/d45 to da/de/d8a/d42/d99/dc8 0 2023-12-05T09:26:20.921 INFO:tasks.workunit.client.1.smithi134.stdout:9/486: mknod d7/ca5 0 2023-12-05T09:26:20.921 INFO:tasks.workunit.client.1.smithi134.stdout:9/487: readlink d7/d5b/l79 0 2023-12-05T09:26:20.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/624: mknod d2/d9/d10/d30/d66/d9b/ce8 0 2023-12-05T09:26:20.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/625: truncate d2/d9/d8d/da2/db1/fc0 17527 0 2023-12-05T09:26:20.922 INFO:tasks.workunit.client.1.smithi134.stdout:2/541: mkdir d19/d76/da9 0 2023-12-05T09:26:20.924 INFO:tasks.workunit.client.1.smithi134.stdout:4/530: mknod d16/d21/d47/cb5 0 2023-12-05T09:26:20.924 INFO:tasks.workunit.client.1.smithi134.stdout:4/531: write d16/d21/d47/d4b/f77 [267591,97122] 0 2023-12-05T09:26:20.924 INFO:tasks.workunit.client.1.smithi134.stdout:4/532: readlink d16/d21/l33 0 2023-12-05T09:26:20.926 INFO:tasks.workunit.client.1.smithi134.stdout:0/469: mkdir d13/d14/d30/d4b/d66/da0 0 2023-12-05T09:26:20.926 INFO:tasks.workunit.client.1.smithi134.stdout:0/470: write d13/d14/d30/f88 [1700046,67713] 0 2023-12-05T09:26:20.928 INFO:tasks.workunit.client.1.smithi134.stdout:3/541: mkdir d4/d1f/d50/db1 0 2023-12-05T09:26:20.928 INFO:tasks.workunit.client.1.smithi134.stdout:3/542: readlink d4/l81 0 2023-12-05T09:26:20.928 INFO:tasks.workunit.client.1.smithi134.stdout:3/543: readlink d4/d1f/l57 0 2023-12-05T09:26:20.929 INFO:tasks.workunit.client.1.smithi134.stdout:7/497: mknod d2/dd/d1a/ca4 0 2023-12-05T09:26:20.930 INFO:tasks.workunit.client.1.smithi134.stdout:0/471: write d13/d14/d30/d4b/d23/f60 [226785,52758] 0 2023-12-05T09:26:20.935 INFO:tasks.workunit.client.1.smithi134.stdout:6/457: creat d4/d39/d42/d4f/f85 x:0 0 0 2023-12-05T09:26:20.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/580: mkdir da/de/d96/dc9 0 2023-12-05T09:26:20.935 INFO:tasks.workunit.client.1.smithi134.stdout:1/626: unlink d2/f6 0 2023-12-05T09:26:20.935 INFO:tasks.workunit.client.1.smithi134.stdout:6/458: fdatasync d4/d39/d42/d4f/d6d/d3a/d75/d59/f7f 0 2023-12-05T09:26:20.935 INFO:tasks.workunit.client.1.smithi134.stdout:1/627: dread - d2/d27/fa4 zero size 2023-12-05T09:26:20.936 INFO:tasks.workunit.client.1.smithi134.stdout:4/533: mkdir d16/d7b/db6 0 2023-12-05T09:26:20.939 INFO:tasks.workunit.client.1.smithi134.stdout:5/468: unlink d0/l2e 0 2023-12-05T09:26:20.939 INFO:tasks.workunit.client.1.smithi134.stdout:5/469: truncate d0/d1a/d3a/f49 334913 0 2023-12-05T09:26:20.942 INFO:tasks.workunit.client.1.smithi134.stdout:3/544: rmdir d4/d5/d45/d60/d85 39 2023-12-05T09:26:20.942 INFO:tasks.workunit.client.1.smithi134.stdout:0/472: creat d13/d14/d30/d4b/d66/da0/fa1 x:0 0 0 2023-12-05T09:26:20.942 INFO:tasks.workunit.client.1.smithi134.stdout:3/545: dread - d4/d5/d6f/f71 zero size 2023-12-05T09:26:20.945 INFO:tasks.workunit.client.1.smithi134.stdout:8/581: rename da/de/d8a/d42/l6f to da/de/d43/lca 0 2023-12-05T09:26:20.946 INFO:tasks.workunit.client.1.smithi134.stdout:6/459: mkdir d4/d39/d42/d4f/d6d/d3a/d75/d86 0 2023-12-05T09:26:20.947 INFO:tasks.workunit.client.1.smithi134.stdout:1/628: mknod d2/d9/d10/d30/d4a/d81/ce9 0 2023-12-05T09:26:20.951 INFO:tasks.workunit.client.1.smithi134.stdout:4/534: mknod d16/d21/d48/d80/dae/d65/cb7 0 2023-12-05T09:26:20.953 INFO:tasks.workunit.client.1.smithi134.stdout:5/470: mknod d0/d66/ca1 0 2023-12-05T09:26:20.954 INFO:tasks.workunit.client.1.smithi134.stdout:3/546: dread d4/f34 [0,4194304] 0 2023-12-05T09:26:20.954 INFO:tasks.workunit.client.1.smithi134.stdout:9/488: dwrite d7/d8/f4c [0,4194304] 0 2023-12-05T09:26:20.969 INFO:tasks.workunit.client.1.smithi134.stdout:8/582: mknod da/de/d11/d1d/d70/ccb 0 2023-12-05T09:26:20.969 INFO:tasks.workunit.client.1.smithi134.stdout:0/473: rmdir d13/d14/d59/d86 39 2023-12-05T09:26:20.970 INFO:tasks.workunit.client.1.smithi134.stdout:0/474: mkdir d13/d14/d30/d4b/d66/da0/da2 0 2023-12-05T09:26:20.970 INFO:tasks.workunit.client.0.smithi067.stdout:0/440: dread d3/f1d [0,4194304] 0 2023-12-05T09:26:20.974 INFO:tasks.workunit.client.1.smithi134.stdout:0/475: mkdir d13/d14/d30/d4b/d66/da0/da3 0 2023-12-05T09:26:20.975 INFO:tasks.workunit.client.0.smithi067.stdout:0/441: mkdir d3/d7/d3c/d6c/d76/da7 0 2023-12-05T09:26:20.975 INFO:tasks.workunit.client.0.smithi067.stdout:0/442: fsync d3/d7/d3c/d6c/d8a/f98 0 2023-12-05T09:26:20.975 INFO:tasks.workunit.client.0.smithi067.stdout:0/443: readlink d3/da2/l89 0 2023-12-05T09:26:20.975 INFO:tasks.workunit.client.0.smithi067.stdout:0/444: rmdir d3/d7/d3c/d67/d59/d5c 39 2023-12-05T09:26:20.977 INFO:tasks.workunit.client.0.smithi067.stdout:0/445: truncate d3/f3b 1800423 0 2023-12-05T09:26:20.986 INFO:tasks.workunit.client.0.smithi067.stdout:5/373: dwrite db/df/d1a/d1d/d20/f2a [0,4194304] 0 2023-12-05T09:26:20.991 INFO:tasks.workunit.client.0.smithi067.stdout:0/446: dread d3/d7/d3c/f48 [0,4194304] 0 2023-12-05T09:26:20.993 INFO:tasks.workunit.client.1.smithi134.stdout:0/476: dread d13/d14/d30/d4b/d23/f60 [0,4194304] 0 2023-12-05T09:26:20.995 INFO:tasks.workunit.client.1.smithi134.stdout:0/477: write d13/d14/d30/d4b/f8d [422742,15364] 0 2023-12-05T09:26:20.995 INFO:tasks.workunit.client.1.smithi134.stdout:0/478: chown d13/d14/d15/d67/c72 403904383 1 2023-12-05T09:26:20.995 INFO:tasks.workunit.client.1.smithi134.stdout:5/471: getdents d0/d66 0 2023-12-05T09:26:20.995 INFO:tasks.workunit.client.1.smithi134.stdout:5/472: readlink d0/d1a/d1c/d3f/d5b/l88 0 2023-12-05T09:26:20.995 INFO:tasks.workunit.client.1.smithi134.stdout:5/473: write d0/d1a/d1c/d3f/f41 [681792,53494] 0 2023-12-05T09:26:20.997 INFO:tasks.workunit.client.1.smithi134.stdout:0/479: link d13/d14/d30/d4b/l84 d13/d14/d59/d78/la4 0 2023-12-05T09:26:20.999 INFO:tasks.workunit.client.1.smithi134.stdout:2/542: dwrite d19/d76/f7b [0,4194304] 0 2023-12-05T09:26:21.000 INFO:tasks.workunit.client.1.smithi134.stdout:0/480: truncate f3 387399 0 2023-12-05T09:26:21.002 INFO:tasks.workunit.client.1.smithi134.stdout:9/489: write d7/d8/d14/d26/d7f/d92/f57 [1105492,74008] 0 2023-12-05T09:26:21.013 INFO:tasks.workunit.client.0.smithi067.stdout:0/447: dread d3/df/f36 [0,4194304] 0 2023-12-05T09:26:21.014 INFO:tasks.workunit.client.1.smithi134.stdout:4/535: write d16/d21/d69/d6e/daa/f20 [1626519,26641] 0 2023-12-05T09:26:21.016 INFO:tasks.workunit.client.0.smithi067.stdout:3/265: dwrite d9/da/d15/f1b [4194304,4194304] 0 2023-12-05T09:26:21.016 INFO:tasks.workunit.client.0.smithi067.stdout:3/266: creat d9/d20/f5c x:0 0 0 2023-12-05T09:26:21.016 INFO:tasks.workunit.client.0.smithi067.stdout:3/267: fdatasync d9/da/fd 0 2023-12-05T09:26:21.016 INFO:tasks.workunit.client.0.smithi067.stdout:3/268: dread - d9/f58 zero size 2023-12-05T09:26:21.017 INFO:tasks.workunit.client.1.smithi134.stdout:1/629: dwrite d2/d9/d10/d30/d66/da9/d74/f7b [0,4194304] 0 2023-12-05T09:26:21.025 INFO:tasks.workunit.client.1.smithi134.stdout:8/583: dwrite da/de/d11/d1d/d5f/fc3 [0,4194304] 0 2023-12-05T09:26:21.025 INFO:tasks.workunit.client.1.smithi134.stdout:8/584: stat da/de/fb7 0 2023-12-05T09:26:21.029 INFO:tasks.workunit.client.1.smithi134.stdout:6/460: dwrite d4/d39/d42/d4f/d6d/d3a/f3d [0,4194304] 0 2023-12-05T09:26:21.048 INFO:tasks.workunit.client.0.smithi067.stdout:1/349: dread d2/d5/d7/de/d1a/f1b [0,4194304] 0 2023-12-05T09:26:21.090 INFO:tasks.workunit.client.0.smithi067.stdout:9/492: dwrite d1b/d25/d94/fa1 [0,4194304] 0 2023-12-05T09:26:21.090 INFO:tasks.workunit.client.0.smithi067.stdout:9/493: chown d1b/d25/l45 179813 1 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:2/543: symlink d19/d6d/laa 0 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/481: rename d13/d14/d59/d86/d89 to d13/d14/d30/d2c/d9d/da5 0 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:2/544: write d19/d28/f33 [727731,4103] 0 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:4/536: dread d16/d21/f62 [0,4194304] 0 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:1/630: dwrite d2/d9/f86 [0,4194304] 0 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:5/474: dwrite d0/d1a/d1c/d25/d4d/d60/f9a [0,4194304] 0 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:5/475: chown d0/dd/d37/c6b 3892715 1 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:1/631: dread d2/d9/d10/d30/d66/da9/d74/f7b [0,4194304] 0 2023-12-05T09:26:21.091 INFO:tasks.workunit.client.1.smithi134.stdout:1/632: truncate d2/d27/d40/f87 1115295 0 2023-12-05T09:26:21.098 INFO:tasks.workunit.client.1.smithi134.stdout:8/585: dwrite da/de/d4d/f8d [0,4194304] 0 2023-12-05T09:26:21.098 INFO:tasks.workunit.client.1.smithi134.stdout:8/586: stat da/de/d16/dbe 0 2023-12-05T09:26:21.098 INFO:tasks.workunit.client.1.smithi134.stdout:0/482: dwrite d13/f38 [0,4194304] 0 2023-12-05T09:26:21.112 INFO:tasks.workunit.client.0.smithi067.stdout:0/448: unlink d3/df/l73 0 2023-12-05T09:26:21.112 INFO:tasks.workunit.client.0.smithi067.stdout:0/449: chown d3/d7/f71 2286 1 2023-12-05T09:26:21.120 INFO:tasks.workunit.client.1.smithi134.stdout:9/490: link d7/d7d/f82 d7/d10/fa6 0 2023-12-05T09:26:21.149 INFO:tasks.workunit.client.0.smithi067.stdout:1/350: symlink d2/d4f/d54/l7d 0 2023-12-05T09:26:21.149 INFO:tasks.workunit.client.0.smithi067.stdout:1/351: chown d2/d5/c2e 254 1 2023-12-05T09:26:21.149 INFO:tasks.workunit.client.0.smithi067.stdout:1/352: fsync d2/d5/d7/de/d19/d49/d5f/d61/f6e 0 2023-12-05T09:26:21.160 INFO:tasks.workunit.client.1.smithi134.stdout:8/587: dwrite da/de/d11/d8b/fbf [0,4194304] 0 2023-12-05T09:26:21.162 INFO:tasks.workunit.client.0.smithi067.stdout:0/450: dwrite d3/d6b/f6f [0,4194304] 0 2023-12-05T09:26:21.162 INFO:tasks.workunit.client.0.smithi067.stdout:0/451: dread - d3/d7/d30/f8c zero size 2023-12-05T09:26:21.163 INFO:tasks.workunit.client.1.smithi134.stdout:9/491: dwrite d7/d8/d16/f33 [0,4194304] 0 2023-12-05T09:26:21.165 INFO:tasks.workunit.client.0.smithi067.stdout:9/494: mkdir d1b/d25/d54/d5c/d6a/d6c/d78/daa 0 2023-12-05T09:26:21.165 INFO:tasks.workunit.client.0.smithi067.stdout:9/495: chown d1b/d25/l29 5820780 1 2023-12-05T09:26:21.165 INFO:tasks.workunit.client.0.smithi067.stdout:9/496: stat d1b/d25/c71 0 2023-12-05T09:26:21.169 INFO:tasks.workunit.client.0.smithi067.stdout:0/452: dread d3/f4d [0,4194304] 0 2023-12-05T09:26:21.171 INFO:tasks.workunit.client.0.smithi067.stdout:1/353: creat d2/f7e x:0 0 0 2023-12-05T09:26:21.175 INFO:tasks.workunit.client.0.smithi067.stdout:3/269: symlink d9/da/d15/d17/l5d 0 2023-12-05T09:26:21.190 INFO:tasks.workunit.client.0.smithi067.stdout:9/497: rename d1b/d25/d54/d5c/d81/l87 to d1b/d3e/d7f/lab 0 2023-12-05T09:26:21.190 INFO:tasks.workunit.client.0.smithi067.stdout:9/498: chown d1b/d25/c37 0 1 2023-12-05T09:26:21.190 INFO:tasks.workunit.client.0.smithi067.stdout:0/453: mkdir d3/d7/d3c/d67/d59/d5c/da8 0 2023-12-05T09:26:21.190 INFO:tasks.workunit.client.0.smithi067.stdout:1/354: link d2/d5/d7/de/d19/d49/d5f/f79 d2/d5/d50/f7f 0 2023-12-05T09:26:21.190 INFO:tasks.workunit.client.0.smithi067.stdout:1/355: stat d2/f5c 0 2023-12-05T09:26:21.191 INFO:tasks.workunit.client.1.smithi134.stdout:6/461: rmdir d4/d39/d42/d4f/d6d/d45 39 2023-12-05T09:26:21.195 INFO:tasks.workunit.client.0.smithi067.stdout:0/454: creat d3/d7/d3c/d66/fa9 x:0 0 0 2023-12-05T09:26:21.195 INFO:tasks.workunit.client.0.smithi067.stdout:0/455: write d3/df/f18 [796242,2931] 0 2023-12-05T09:26:21.200 INFO:tasks.workunit.client.0.smithi067.stdout:0/456: mknod d3/df/d10/caa 0 2023-12-05T09:26:21.209 INFO:tasks.workunit.client.0.smithi067.stdout:0/457: rmdir d3/d7/d3c/d67/d59/d5c/da8 0 2023-12-05T09:26:21.213 INFO:tasks.workunit.client.1.smithi134.stdout:2/545: creat d19/d49/fab x:0 0 0 2023-12-05T09:26:21.217 INFO:tasks.workunit.client.1.smithi134.stdout:4/537: mknod d16/d18/cb8 0 2023-12-05T09:26:21.218 INFO:tasks.workunit.client.1.smithi134.stdout:2/546: read d19/d28/d63/d70/f74 [71517,100413] 0 2023-12-05T09:26:21.227 INFO:tasks.workunit.client.1.smithi134.stdout:1/633: creat d2/d9/d8d/fea x:0 0 0 2023-12-05T09:26:21.232 INFO:tasks.workunit.client.1.smithi134.stdout:0/483: truncate d13/d14/d30/d2c/f8b 24468 0 2023-12-05T09:26:21.233 INFO:tasks.workunit.client.1.smithi134.stdout:8/588: creat da/de/d11/fcc x:0 0 0 2023-12-05T09:26:21.237 INFO:tasks.workunit.client.1.smithi134.stdout:9/492: truncate d7/d8/d14/d26/f3e 479057 0 2023-12-05T09:26:21.237 INFO:tasks.workunit.client.1.smithi134.stdout:1/634: creat d2/d9/d10/d30/d66/da9/feb x:0 0 0 2023-12-05T09:26:21.237 INFO:tasks.workunit.client.1.smithi134.stdout:0/484: rmdir d13/d14/d15 39 2023-12-05T09:26:21.245 INFO:tasks.workunit.client.1.smithi134.stdout:8/589: creat da/de/d16/d33/fcd x:0 0 0 2023-12-05T09:26:21.245 INFO:tasks.workunit.client.1.smithi134.stdout:9/493: link d7/d8/d14/d26/l51 d7/d8/la7 0 2023-12-05T09:26:21.246 INFO:tasks.workunit.client.1.smithi134.stdout:6/462: dwrite d4/d39/d42/f7e [0,4194304] 0 2023-12-05T09:26:21.246 INFO:tasks.workunit.client.1.smithi134.stdout:6/463: write d4/d39/d42/d4f/d6d/d3a/d75/d59/f6c [1112455,19641] 0 2023-12-05T09:26:21.246 INFO:tasks.workunit.client.1.smithi134.stdout:6/464: truncate d4/d39/d5c/f82 88647 0 2023-12-05T09:26:21.246 INFO:tasks.workunit.client.1.smithi134.stdout:6/465: chown d4/d39/d42/d4f/d6d/f60 0 1 2023-12-05T09:26:21.249 INFO:tasks.workunit.client.1.smithi134.stdout:1/635: write d2/d9/d10/d5b/d5e/fa8 [82701,116154] 0 2023-12-05T09:26:21.250 INFO:tasks.workunit.client.1.smithi134.stdout:6/466: rmdir d4/d78 39 2023-12-05T09:26:21.250 INFO:tasks.workunit.client.1.smithi134.stdout:6/467: getdents d4/d39/d42/d4f/d6d/d45 0 2023-12-05T09:26:21.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/485: dread d13/d14/d15/d2a/f74 [0,4194304] 0 2023-12-05T09:26:21.253 INFO:tasks.workunit.client.1.smithi134.stdout:1/636: unlink d2/d9/d8d/fea 0 2023-12-05T09:26:21.256 INFO:tasks.workunit.client.1.smithi134.stdout:6/468: creat d4/d39/d42/d4f/d6d/d3a/d80/f87 x:0 0 0 2023-12-05T09:26:21.258 INFO:tasks.workunit.client.1.smithi134.stdout:0/486: mknod d13/d14/d30/d4b/d23/d77/ca6 0 2023-12-05T09:26:21.259 INFO:tasks.workunit.client.1.smithi134.stdout:1/637: mknod d2/d27/d71/d80/db8/de1/cec 0 2023-12-05T09:26:21.259 INFO:tasks.workunit.client.1.smithi134.stdout:1/638: creat d2/d27/d9d/fed x:0 0 0 2023-12-05T09:26:21.261 INFO:tasks.workunit.client.1.smithi134.stdout:0/487: rename c11 to d13/d14/d15/d2a/d8c/ca7 0 2023-12-05T09:26:21.263 INFO:tasks.workunit.client.1.smithi134.stdout:8/590: dread da/de/d16/f23 [0,4194304] 0 2023-12-05T09:26:21.268 INFO:tasks.workunit.client.1.smithi134.stdout:0/488: creat d13/d14/d15/fa8 x:0 0 0 2023-12-05T09:26:21.269 INFO:tasks.workunit.client.1.smithi134.stdout:0/489: readlink d13/d14/d30/d4b/l84 0 2023-12-05T09:26:21.269 INFO:tasks.workunit.client.1.smithi134.stdout:8/591: mknod da/de/d8a/d42/cce 0 2023-12-05T09:26:21.271 INFO:tasks.workunit.client.1.smithi134.stdout:4/538: dwrite d16/d21/d48/d80/dae/d65/f72 [0,4194304] 0 2023-12-05T09:26:21.275 INFO:tasks.workunit.client.1.smithi134.stdout:8/592: mknod da/de/d8a/d42/d99/dc8/ccf 0 2023-12-05T09:26:21.276 INFO:tasks.workunit.client.1.smithi134.stdout:2/547: dwrite d19/d28/d31/f3c [0,4194304] 0 2023-12-05T09:26:21.276 INFO:tasks.workunit.client.1.smithi134.stdout:2/548: getdents d19/d28/d9e 0 2023-12-05T09:26:21.277 INFO:tasks.workunit.client.0.smithi067.stdout:7/362: sync 2023-12-05T09:26:21.277 INFO:tasks.workunit.client.0.smithi067.stdout:2/272: sync 2023-12-05T09:26:21.277 INFO:tasks.workunit.client.0.smithi067.stdout:6/263: sync 2023-12-05T09:26:21.277 INFO:tasks.workunit.client.0.smithi067.stdout:9/499: dwrite d1b/d25/f33 [0,4194304] 0 2023-12-05T09:26:21.278 INFO:tasks.workunit.client.0.smithi067.stdout:8/300: sync 2023-12-05T09:26:21.278 INFO:tasks.workunit.client.0.smithi067.stdout:4/313: sync 2023-12-05T09:26:21.282 INFO:tasks.workunit.client.0.smithi067.stdout:5/374: sync 2023-12-05T09:26:21.284 INFO:tasks.workunit.client.1.smithi134.stdout:8/593: getdents da/de/d4d/d68 0 2023-12-05T09:26:21.284 INFO:tasks.workunit.client.1.smithi134.stdout:8/594: truncate da/de/d16/d2d/f88 430374 0 2023-12-05T09:26:21.285 INFO:tasks.workunit.client.1.smithi134.stdout:0/490: read d13/d14/d30/d2c/f47 [173685,43814] 0 2023-12-05T09:26:21.289 INFO:tasks.workunit.client.0.smithi067.stdout:3/270: dwrite d9/da/d3b/f40 [0,4194304] 0 2023-12-05T09:26:21.289 INFO:tasks.workunit.client.0.smithi067.stdout:3/271: chown d9/da 1108894 1 2023-12-05T09:26:21.290 INFO:tasks.workunit.client.0.smithi067.stdout:7/363: mkdir d0/d9/d40/d7a 0 2023-12-05T09:26:21.290 INFO:tasks.workunit.client.0.smithi067.stdout:2/273: creat d0/d25/d3a/f5f x:0 0 0 2023-12-05T09:26:21.290 INFO:tasks.workunit.client.0.smithi067.stdout:1/356: dwrite d2/f39 [0,4194304] 0 2023-12-05T09:26:21.291 INFO:tasks.workunit.client.0.smithi067.stdout:2/274: write d0/d2f/d39/f40 [1271487,50208] 0 2023-12-05T09:26:21.291 INFO:tasks.workunit.client.0.smithi067.stdout:2/275: truncate d0/d15/d53/d1e/f3e 959833 0 2023-12-05T09:26:21.291 INFO:tasks.workunit.client.1.smithi134.stdout:9/494: dread d7/d8/d14/d26/f48 [0,4194304] 0 2023-12-05T09:26:21.292 INFO:tasks.workunit.client.1.smithi134.stdout:9/495: fsync d7/d8/f91 0 2023-12-05T09:26:21.293 INFO:tasks.workunit.client.0.smithi067.stdout:6/264: mkdir da/d10/d1e/d17/d2f/d59 0 2023-12-05T09:26:21.294 INFO:tasks.workunit.client.1.smithi134.stdout:8/595: rmdir da/de/d4d 39 2023-12-05T09:26:21.294 INFO:tasks.workunit.client.1.smithi134.stdout:8/596: creat da/de/d16/d98/fd0 x:0 0 0 2023-12-05T09:26:21.296 INFO:tasks.workunit.client.1.smithi134.stdout:8/597: write da/de/d4d/f6c [1123736,127148] 0 2023-12-05T09:26:21.296 INFO:tasks.workunit.client.1.smithi134.stdout:8/598: truncate da/de/d16/d2d/f80 159627 0 2023-12-05T09:26:21.296 INFO:tasks.workunit.client.1.smithi134.stdout:8/599: chown da/de/d8a/d42/d99/dc8 128040 1 2023-12-05T09:26:21.300 INFO:tasks.workunit.client.1.smithi134.stdout:5/476: creat d0/d1a/d1c/d25/fa2 x:0 0 0 2023-12-05T09:26:21.300 INFO:tasks.workunit.client.1.smithi134.stdout:5/477: creat d0/d1a/d1c/d25/d6a/fa3 x:0 0 0 2023-12-05T09:26:21.300 INFO:tasks.workunit.client.0.smithi067.stdout:8/301: rmdir d5/dc 39 2023-12-05T09:26:21.301 INFO:tasks.workunit.client.1.smithi134.stdout:5/478: write d0/d1a/d3a/f74 [1058747,106974] 0 2023-12-05T09:26:21.305 INFO:tasks.workunit.client.1.smithi134.stdout:9/496: dread d7/d8/f91 [0,4194304] 0 2023-12-05T09:26:21.305 INFO:tasks.workunit.client.0.smithi067.stdout:4/314: creat d0/d1d/d25/f6d x:0 0 0 2023-12-05T09:26:21.305 INFO:tasks.workunit.client.0.smithi067.stdout:4/315: fsync d0/d1d/d25/d2c/d34/f55 0 2023-12-05T09:26:21.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/302: dread d5/da/f1f [0,4194304] 0 2023-12-05T09:26:21.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/303: chown d5/dc/d1a/d20/f25 1152 1 2023-12-05T09:26:21.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/272: symlink d9/da/d15/d17/d2b/l5e 0 2023-12-05T09:26:21.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/273: creat d9/d24/f5f x:0 0 0 2023-12-05T09:26:21.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/274: write d9/da/d15/d28/f41 [1029233,55616] 0 2023-12-05T09:26:21.312 INFO:tasks.workunit.client.0.smithi067.stdout:5/375: dread db/df/f15 [0,4194304] 0 2023-12-05T09:26:21.319 INFO:tasks.workunit.client.0.smithi067.stdout:9/500: dwrite d1b/d25/d35/f79 [0,4194304] 0 2023-12-05T09:26:21.319 INFO:tasks.workunit.client.0.smithi067.stdout:4/316: dread d0/d1d/d25/d32/f3f [0,4194304] 0 2023-12-05T09:26:21.320 INFO:tasks.workunit.client.0.smithi067.stdout:7/364: symlink d0/l7b 0 2023-12-05T09:26:21.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/479: dread d0/f33 [0,4194304] 0 2023-12-05T09:26:21.322 INFO:tasks.workunit.client.1.smithi134.stdout:2/549: fsync d19/d49/fab 0 2023-12-05T09:26:21.323 INFO:tasks.workunit.client.1.smithi134.stdout:2/550: chown f17 1 1 2023-12-05T09:26:21.323 INFO:tasks.workunit.client.1.smithi134.stdout:2/551: fsync d19/d3f/f88 0 2023-12-05T09:26:21.327 INFO:tasks.workunit.client.0.smithi067.stdout:1/357: link d2/d5/d7/de/c33 d2/d5/d7/de/d19/c80 0 2023-12-05T09:26:21.328 INFO:tasks.workunit.client.1.smithi134.stdout:4/539: dwrite f5 [4194304,4194304] 0 2023-12-05T09:26:21.328 INFO:tasks.workunit.client.1.smithi134.stdout:4/540: stat d16/d21/d69/d6e/daa/d3b/f5a 0 2023-12-05T09:26:21.329 INFO:tasks.workunit.client.1.smithi134.stdout:0/491: mkdir d13/d14/d30/d2c/da9 0 2023-12-05T09:26:21.329 INFO:tasks.workunit.client.1.smithi134.stdout:7/498: sync 2023-12-05T09:26:21.329 INFO:tasks.workunit.client.1.smithi134.stdout:3/547: sync 2023-12-05T09:26:21.333 INFO:tasks.workunit.client.0.smithi067.stdout:2/276: unlink d0/d15/d53/d1e/c20 0 2023-12-05T09:26:21.336 INFO:tasks.workunit.client.1.smithi134.stdout:9/497: rename d7/d8/d14/d26/d7f/c81 to d7/d8/d16/d52/d74/ca8 0 2023-12-05T09:26:21.338 INFO:tasks.workunit.client.0.smithi067.stdout:6/265: symlink da/d10/d1e/l5a 0 2023-12-05T09:26:21.341 INFO:tasks.workunit.client.1.smithi134.stdout:9/498: dread d7/d7d/f82 [0,4194304] 0 2023-12-05T09:26:21.341 INFO:tasks.workunit.client.1.smithi134.stdout:9/499: readlink d7/d8/l34 0 2023-12-05T09:26:21.342 INFO:tasks.workunit.client.0.smithi067.stdout:8/304: symlink d5/dc/d1a/d20/d3e/l52 0 2023-12-05T09:26:21.344 INFO:tasks.workunit.client.0.smithi067.stdout:8/305: chown d5/d3b/f3d 6608123 1 2023-12-05T09:26:21.344 INFO:tasks.workunit.client.0.smithi067.stdout:8/306: write d5/f28 [4642954,110733] 0 2023-12-05T09:26:21.351 INFO:tasks.workunit.client.0.smithi067.stdout:1/358: dread d2/f5c [0,4194304] 0 2023-12-05T09:26:21.353 INFO:tasks.workunit.client.0.smithi067.stdout:5/376: rename db/df/d1a/d1d/f24 to db/df/d38/f85 0 2023-12-05T09:26:21.356 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:21 smithi067 ceph-mon[107174]: Reconfiguring grafana.smithi067 (dependencies changed)... 2023-12-05T09:26:21.356 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:21 smithi067 ceph-mon[107174]: Reconfiguring daemon grafana.smithi067 on smithi067 2023-12-05T09:26:21.356 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:21 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:26:21.360 INFO:tasks.workunit.client.0.smithi067.stdout:7/365: dread d0/f4a [4194304,4194304] 0 2023-12-05T09:26:21.362 INFO:tasks.workunit.client.0.smithi067.stdout:4/317: dwrite d0/d1d/d2b/d50/f14 [4194304,4194304] 0 2023-12-05T09:26:21.362 INFO:tasks.workunit.client.0.smithi067.stdout:2/277: link d0/d25/d34/l50 d0/d25/d34/d4d/l60 0 2023-12-05T09:26:21.374 INFO:tasks.workunit.client.0.smithi067.stdout:1/359: mknod d2/d5/c81 0 2023-12-05T09:26:21.375 INFO:tasks.workunit.client.0.smithi067.stdout:6/266: symlink da/d10/d1e/d17/d2f/d3f/l5b 0 2023-12-05T09:26:21.377 INFO:tasks.workunit.client.1.smithi134.stdout:5/480: creat d0/d50/fa4 x:0 0 0 2023-12-05T09:26:21.378 INFO:tasks.workunit.client.0.smithi067.stdout:7/366: creat d0/d9/d10/d37/d38/d64/d5a/f7c x:0 0 0 2023-12-05T09:26:21.378 INFO:tasks.workunit.client.1.smithi134.stdout:1/639: truncate d2/d27/d40/f87 393986 0 2023-12-05T09:26:21.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:21 smithi134 ceph-mon[116304]: Reconfiguring grafana.smithi067 (dependencies changed)... 2023-12-05T09:26:21.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:21 smithi134 ceph-mon[116304]: Reconfiguring daemon grafana.smithi067 on smithi067 2023-12-05T09:26:21.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:21 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:26:21.380 INFO:tasks.workunit.client.1.smithi134.stdout:2/552: truncate d19/d28/d2b/f4b 3452140 0 2023-12-05T09:26:21.381 INFO:tasks.workunit.client.1.smithi134.stdout:2/553: creat d19/fac x:0 0 0 2023-12-05T09:26:21.385 INFO:tasks.workunit.client.0.smithi067.stdout:4/318: link d0/d1d/d2b/d50/d15/f33 d0/d1d/d53/f6e 0 2023-12-05T09:26:21.385 INFO:tasks.workunit.client.1.smithi134.stdout:4/541: mkdir d16/d21/d69/d6e/db9 0 2023-12-05T09:26:21.388 INFO:tasks.workunit.client.0.smithi067.stdout:2/278: creat d0/d15/d53/d1e/f61 x:0 0 0 2023-12-05T09:26:21.393 INFO:tasks.workunit.client.1.smithi134.stdout:0/492: link d13/d14/d59/d78/la4 d13/d14/d30/laa 0 2023-12-05T09:26:21.394 INFO:tasks.workunit.client.0.smithi067.stdout:1/360: creat d2/d4f/d14/d5d/f82 x:0 0 0 2023-12-05T09:26:21.395 INFO:tasks.workunit.client.1.smithi134.stdout:3/548: stat d4/d1f/l51 0 2023-12-05T09:26:21.395 INFO:tasks.workunit.client.1.smithi134.stdout:3/549: chown d4/c8 127070142 1 2023-12-05T09:26:21.395 INFO:tasks.workunit.client.1.smithi134.stdout:3/550: write d4/d5/fa2 [643161,53421] 0 2023-12-05T09:26:21.395 INFO:tasks.workunit.client.1.smithi134.stdout:3/551: fsync d4/d1f/d50/d52/d42/f70 0 2023-12-05T09:26:21.397 INFO:tasks.workunit.client.0.smithi067.stdout:6/267: mknod da/d10/d1e/c5c 0 2023-12-05T09:26:21.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/501: dread d1b/d25/d54/d5c/d6a/d6c/f92 [0,4194304] 0 2023-12-05T09:26:21.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/502: stat d1b/d25/d35/l4c 0 2023-12-05T09:26:21.401 INFO:tasks.workunit.client.0.smithi067.stdout:5/377: dwrite db/df/d36/f7b [0,4194304] 0 2023-12-05T09:26:21.404 INFO:tasks.workunit.client.0.smithi067.stdout:8/307: dread d5/f36 [0,4194304] 0 2023-12-05T09:26:21.405 INFO:tasks.workunit.client.0.smithi067.stdout:3/275: dwrite d9/da/d15/d17/d2b/f3e [0,4194304] 0 2023-12-05T09:26:21.405 INFO:tasks.workunit.client.0.smithi067.stdout:3/276: chown d9/c1e 924 1 2023-12-05T09:26:21.405 INFO:tasks.workunit.client.0.smithi067.stdout:4/319: dread d0/f41 [0,4194304] 0 2023-12-05T09:26:21.405 INFO:tasks.workunit.client.0.smithi067.stdout:4/320: creat d0/d1d/d24/f6f x:0 0 0 2023-12-05T09:26:21.405 INFO:tasks.workunit.client.0.smithi067.stdout:4/321: dread - d0/d1d/d2b/f69 zero size 2023-12-05T09:26:21.406 INFO:tasks.workunit.client.0.smithi067.stdout:2/279: symlink d0/d25/d3f/l62 0 2023-12-05T09:26:21.406 INFO:tasks.workunit.client.0.smithi067.stdout:2/280: readlink d0/d25/d34/d4d/l4f 0 2023-12-05T09:26:21.407 INFO:tasks.workunit.client.1.smithi134.stdout:9/500: link d7/c39 d7/d5b/d5e/ca9 0 2023-12-05T09:26:21.410 INFO:tasks.workunit.client.1.smithi134.stdout:8/600: unlink da/de/d11/d1d/laa 0 2023-12-05T09:26:21.412 INFO:tasks.workunit.client.0.smithi067.stdout:6/268: mkdir da/d10/d1e/d17/d2f/d47/d5d 0 2023-12-05T09:26:21.413 INFO:tasks.workunit.client.1.smithi134.stdout:9/501: write d7/d8/d16/f1f [536952,3060] 0 2023-12-05T09:26:21.415 INFO:tasks.workunit.client.1.smithi134.stdout:2/554: dwrite d19/f35 [0,4194304] 0 2023-12-05T09:26:21.415 INFO:tasks.workunit.client.1.smithi134.stdout:2/555: getdents d19/d28/d9e 0 2023-12-05T09:26:21.415 INFO:tasks.workunit.client.1.smithi134.stdout:1/640: rename d2/d9/d10/l4c to d2/d27/d40/lee 0 2023-12-05T09:26:21.415 INFO:tasks.workunit.client.1.smithi134.stdout:1/641: write d2/d7e/fdb [740306,54486] 0 2023-12-05T09:26:21.420 INFO:tasks.workunit.client.1.smithi134.stdout:4/542: symlink d16/d21/d48/d80/dae/d65/lba 0 2023-12-05T09:26:21.421 INFO:tasks.workunit.client.1.smithi134.stdout:4/543: chown d16/d21/d48/laf 414894733 1 2023-12-05T09:26:21.423 INFO:tasks.workunit.client.1.smithi134.stdout:0/493: mknod d13/cab 0 2023-12-05T09:26:21.423 INFO:tasks.workunit.client.1.smithi134.stdout:0/494: write d13/d14/d30/d4b/d23/f60 [172399,30794] 0 2023-12-05T09:26:21.424 INFO:tasks.workunit.client.0.smithi067.stdout:8/308: creat d5/dc/d1a/d20/f53 x:0 0 0 2023-12-05T09:26:21.425 INFO:tasks.workunit.client.1.smithi134.stdout:3/552: mknod d4/d5/d45/d60/d85/d96/cb2 0 2023-12-05T09:26:21.425 INFO:tasks.workunit.client.1.smithi134.stdout:3/553: chown d4/d5/d45/d86 184751 1 2023-12-05T09:26:21.425 INFO:tasks.workunit.client.0.smithi067.stdout:3/277: mknod d9/da/d15/d28/d29/c60 0 2023-12-05T09:26:21.427 INFO:tasks.workunit.client.1.smithi134.stdout:7/499: getdents d2/d70 0 2023-12-05T09:26:21.427 INFO:tasks.workunit.client.1.smithi134.stdout:7/500: stat d2/d7/d2b 0 2023-12-05T09:26:21.427 INFO:tasks.workunit.client.1.smithi134.stdout:7/501: chown d2/d7/dc/d2e/f8c 10 1 2023-12-05T09:26:21.428 INFO:tasks.workunit.client.1.smithi134.stdout:8/601: truncate da/de/d4d/f8d 2715086 0 2023-12-05T09:26:21.430 INFO:tasks.workunit.client.0.smithi067.stdout:4/322: creat d0/d1d/d2b/d50/f70 x:0 0 0 2023-12-05T09:26:21.431 INFO:tasks.workunit.client.1.smithi134.stdout:5/481: symlink d0/d11/d5c/la5 0 2023-12-05T09:26:21.432 INFO:tasks.workunit.client.1.smithi134.stdout:5/482: write d0/f43 [486499,79104] 0 2023-12-05T09:26:21.432 INFO:tasks.workunit.client.1.smithi134.stdout:5/483: chown d0/dd/d37/f53 55 1 2023-12-05T09:26:21.432 INFO:tasks.workunit.client.1.smithi134.stdout:5/484: fdatasync d0/f29 0 2023-12-05T09:26:21.432 INFO:tasks.workunit.client.1.smithi134.stdout:5/485: fsync d0/d1a/d1c/d3f/d5b/d5d/d78/f91 0 2023-12-05T09:26:21.433 INFO:tasks.workunit.client.0.smithi067.stdout:2/281: unlink d0/c5 0 2023-12-05T09:26:21.435 INFO:tasks.workunit.client.1.smithi134.stdout:9/502: mkdir d7/d5b/d5e/daa 0 2023-12-05T09:26:21.440 INFO:tasks.workunit.client.0.smithi067.stdout:1/361: rename d2/d5/d7/de/d19/d49/d5f/d61 to d2/d4f/d14/d20/d83 0 2023-12-05T09:26:21.442 INFO:tasks.workunit.client.0.smithi067.stdout:6/269: getdents da/d10/d1e/d17/d2f/d1f/d27 0 2023-12-05T09:26:21.445 INFO:tasks.workunit.client.0.smithi067.stdout:8/309: mknod d5/dc/d1a/d20/c54 0 2023-12-05T09:26:21.445 INFO:tasks.workunit.client.0.smithi067.stdout:8/310: fdatasync d5/dc/d1a/d20/f53 0 2023-12-05T09:26:21.448 INFO:tasks.workunit.client.0.smithi067.stdout:3/278: link l2 d9/da/d15/d17/d2b/l61 0 2023-12-05T09:26:21.448 INFO:tasks.workunit.client.0.smithi067.stdout:3/279: chown d9/da/d15/d17/l23 1 1 2023-12-05T09:26:21.448 INFO:tasks.workunit.client.0.smithi067.stdout:3/280: dread - d9/f58 zero size 2023-12-05T09:26:21.452 INFO:tasks.workunit.client.0.smithi067.stdout:4/323: symlink d0/d1d/d25/d2c/d34/d4e/d5a/l71 0 2023-12-05T09:26:21.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/378: rename db/df/d52/c54 to db/df/d38/c86 0 2023-12-05T09:26:21.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/379: fdatasync db/df/f7e 0 2023-12-05T09:26:21.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/380: chown db/df/d36/d6c 11 1 2023-12-05T09:26:21.457 INFO:tasks.workunit.client.1.smithi134.stdout:2/556: link d19/d3f/f78 d19/d28/d31/d6f/fad 0 2023-12-05T09:26:21.460 INFO:tasks.workunit.client.0.smithi067.stdout:1/362: truncate d2/d4f/d15/f29 3109338 0 2023-12-05T09:26:21.460 INFO:tasks.workunit.client.0.smithi067.stdout:1/363: write d2/d4f/d15/d60/d68/f75 [330702,75987] 0 2023-12-05T09:26:21.460 INFO:tasks.workunit.client.0.smithi067.stdout:1/364: chown d2/d4f/d54/f58 0 1 2023-12-05T09:26:21.460 INFO:tasks.workunit.client.0.smithi067.stdout:1/365: write d2/d4f/d15/d60/d68/f75 [683242,115677] 0 2023-12-05T09:26:21.461 INFO:tasks.workunit.client.0.smithi067.stdout:9/503: dwrite d1b/d25/d54/d5c/d81/d96/f9c [0,4194304] 0 2023-12-05T09:26:21.461 INFO:tasks.workunit.client.0.smithi067.stdout:9/504: dread - d1b/fa2 zero size 2023-12-05T09:26:21.465 INFO:tasks.workunit.client.0.smithi067.stdout:4/324: unlink d0/f56 0 2023-12-05T09:26:21.465 INFO:tasks.workunit.client.0.smithi067.stdout:4/325: stat d0/d1d/d25/d32/f16 0 2023-12-05T09:26:21.466 INFO:tasks.workunit.client.1.smithi134.stdout:0/495: mknod d13/d14/d30/d4b/d66/cac 0 2023-12-05T09:26:21.469 INFO:tasks.workunit.client.0.smithi067.stdout:5/381: mknod db/df/c87 0 2023-12-05T09:26:21.469 INFO:tasks.workunit.client.0.smithi067.stdout:5/382: chown db/df/d1a/d1d/l40 29032 1 2023-12-05T09:26:21.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/554: creat d4/d5/d45/fb3 x:0 0 0 2023-12-05T09:26:21.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/555: truncate d4/d5/d6f/f5e 496654 0 2023-12-05T09:26:21.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/556: stat d4/d1f/d4e/d6a 0 2023-12-05T09:26:21.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/557: stat d4/d1f/f7a 0 2023-12-05T09:26:21.475 INFO:tasks.workunit.client.1.smithi134.stdout:0/496: dread d13/d14/d15/d2a/f74 [0,4194304] 0 2023-12-05T09:26:21.476 INFO:tasks.workunit.client.1.smithi134.stdout:0/497: creat d13/d14/d15/fad x:0 0 0 2023-12-05T09:26:21.476 INFO:tasks.workunit.client.1.smithi134.stdout:0/498: creat d13/d14/d30/d4b/d23/d77/fae x:0 0 0 2023-12-05T09:26:21.479 INFO:tasks.workunit.client.0.smithi067.stdout:8/311: rename d5/l24 to d5/dc/l55 0 2023-12-05T09:26:21.479 INFO:tasks.workunit.client.0.smithi067.stdout:8/312: stat d5/dc/d1a/d20/f53 0 2023-12-05T09:26:21.479 INFO:tasks.workunit.client.0.smithi067.stdout:8/313: readlink d5/dc/d1a/d20/d3e/l52 0 2023-12-05T09:26:21.479 INFO:tasks.workunit.client.0.smithi067.stdout:8/314: readlink d5/dc/l13 0 2023-12-05T09:26:21.484 INFO:tasks.workunit.client.1.smithi134.stdout:7/502: unlink d2/l52 0 2023-12-05T09:26:21.487 INFO:tasks.workunit.client.0.smithi067.stdout:1/366: creat d2/d4f/d14/d20/d83/f84 x:0 0 0 2023-12-05T09:26:21.487 INFO:tasks.workunit.client.0.smithi067.stdout:1/367: chown d2/d4f/d14/d5d 269737 1 2023-12-05T09:26:21.489 INFO:tasks.workunit.client.1.smithi134.stdout:5/486: creat d0/d11/d5c/fa6 x:0 0 0 2023-12-05T09:26:21.494 INFO:tasks.workunit.client.0.smithi067.stdout:3/281: dwrite d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:21.494 INFO:tasks.workunit.client.0.smithi067.stdout:3/282: truncate d9/d24/f33 1215853 0 2023-12-05T09:26:21.494 INFO:tasks.workunit.client.0.smithi067.stdout:3/283: readlink d9/da/d3b/l3c 0 2023-12-05T09:26:21.494 INFO:tasks.workunit.client.0.smithi067.stdout:3/284: dread - d9/da/d15/f50 zero size 2023-12-05T09:26:21.494 INFO:tasks.workunit.client.0.smithi067.stdout:3/285: chown f6 1262645759 1 2023-12-05T09:26:21.495 INFO:tasks.workunit.client.1.smithi134.stdout:9/503: mkdir d7/d8/d14/d26/d7f/dab 0 2023-12-05T09:26:21.495 INFO:tasks.workunit.client.1.smithi134.stdout:9/504: creat d7/d5b/d5e/fac x:0 0 0 2023-12-05T09:26:21.495 INFO:tasks.workunit.client.1.smithi134.stdout:9/505: write d7/d10/d56/f9f [569721,10364] 0 2023-12-05T09:26:21.497 INFO:tasks.workunit.client.1.smithi134.stdout:2/557: mkdir d19/d28/d2b/dae 0 2023-12-05T09:26:21.502 INFO:tasks.workunit.client.1.smithi134.stdout:3/558: mkdir d4/d1f/d50/db4 0 2023-12-05T09:26:21.503 INFO:tasks.workunit.client.0.smithi067.stdout:4/326: rmdir d0/d1d/d25/d2c/d34/d4e/d5a 39 2023-12-05T09:26:21.504 INFO:tasks.workunit.client.0.smithi067.stdout:8/315: write d5/f18 [849063,57280] 0 2023-12-05T09:26:21.509 INFO:tasks.workunit.client.1.smithi134.stdout:5/487: dread d0/d45/f64 [0,4194304] 0 2023-12-05T09:26:21.519 INFO:tasks.workunit.client.1.smithi134.stdout:7/503: creat d2/d7/dc/d2e/d3a/fa5 x:0 0 0 2023-12-05T09:26:21.519 INFO:tasks.workunit.client.1.smithi134.stdout:7/504: chown d2/d7/dc/d22/f27 193 1 2023-12-05T09:26:21.519 INFO:tasks.workunit.client.1.smithi134.stdout:7/505: fdatasync d2/f8 0 2023-12-05T09:26:21.520 INFO:tasks.workunit.client.0.smithi067.stdout:9/505: dwrite d1b/d25/d54/d5c/d6a/d6c/d76/f7b [0,4194304] 0 2023-12-05T09:26:21.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/316: dread d5/dc/f3f [0,4194304] 0 2023-12-05T09:26:21.528 INFO:tasks.workunit.client.0.smithi067.stdout:5/383: rename db/df/d1a/d1d/d20/d46 to db/df/d3f/d88 0 2023-12-05T09:26:21.530 INFO:tasks.workunit.client.1.smithi134.stdout:9/506: creat d7/d8/d14/fad x:0 0 0 2023-12-05T09:26:21.532 INFO:tasks.workunit.client.1.smithi134.stdout:6/469: sync 2023-12-05T09:26:21.537 INFO:tasks.workunit.client.1.smithi134.stdout:2/558: creat d19/d28/d2b/da3/faf x:0 0 0 2023-12-05T09:26:21.542 INFO:tasks.workunit.client.1.smithi134.stdout:5/488: mknod d0/d45/ca7 0 2023-12-05T09:26:21.542 INFO:tasks.workunit.client.1.smithi134.stdout:5/489: stat d0/d1a/d1c/d3f/l4a 0 2023-12-05T09:26:21.545 INFO:tasks.workunit.client.0.smithi067.stdout:8/317: creat d5/da/f56 x:0 0 0 2023-12-05T09:26:21.547 INFO:tasks.workunit.client.1.smithi134.stdout:6/470: read d4/d39/d42/d4f/d6d/f43 [2571332,18467] 0 2023-12-05T09:26:21.547 INFO:tasks.workunit.client.1.smithi134.stdout:2/559: read d19/d28/d63/f7c [208539,17899] 0 2023-12-05T09:26:21.549 INFO:tasks.workunit.client.0.smithi067.stdout:5/384: unlink db/df/d1a/f77 0 2023-12-05T09:26:21.549 INFO:tasks.workunit.client.0.smithi067.stdout:5/385: truncate db/df/f31 555066 0 2023-12-05T09:26:21.553 INFO:tasks.workunit.client.0.smithi067.stdout:5/386: write f9 [4183625,106650] 0 2023-12-05T09:26:21.557 INFO:tasks.workunit.client.1.smithi134.stdout:5/490: symlink d0/d1a/d1c/d3f/d5b/d5d/la8 0 2023-12-05T09:26:21.558 INFO:tasks.workunit.client.1.smithi134.stdout:5/491: fsync d0/f33 0 2023-12-05T09:26:21.558 INFO:tasks.workunit.client.1.smithi134.stdout:3/559: dwrite d4/d1f/f25 [0,4194304] 0 2023-12-05T09:26:21.560 INFO:tasks.workunit.client.1.smithi134.stdout:6/471: symlink d4/d32/l88 0 2023-12-05T09:26:21.562 INFO:tasks.workunit.client.1.smithi134.stdout:2/560: link d19/d28/f4e d19/d76/da7/fb0 0 2023-12-05T09:26:21.564 INFO:tasks.workunit.client.1.smithi134.stdout:5/492: readlink d0/l3e 0 2023-12-05T09:26:21.564 INFO:tasks.workunit.client.1.smithi134.stdout:5/493: stat d0/d1a/d1c/d3f/d81/d8e 0 2023-12-05T09:26:21.564 INFO:tasks.workunit.client.1.smithi134.stdout:5/494: write d0/d1a/d1c/d25/f84 [786170,13175] 0 2023-12-05T09:26:21.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/560: mkdir d4/d5/d45/d86/db5 0 2023-12-05T09:26:21.569 INFO:tasks.workunit.client.0.smithi067.stdout:2/282: dwrite d0/d15/f1b [0,4194304] 0 2023-12-05T09:26:21.571 INFO:tasks.workunit.client.1.smithi134.stdout:3/561: dread d4/d1f/d50/d52/f88 [0,4194304] 0 2023-12-05T09:26:21.573 INFO:tasks.workunit.client.0.smithi067.stdout:5/387: write db/df/f50 [2633592,101917] 0 2023-12-05T09:26:21.573 INFO:tasks.workunit.client.0.smithi067.stdout:5/388: dread - db/df/d35/f76 zero size 2023-12-05T09:26:21.574 INFO:tasks.workunit.client.1.smithi134.stdout:2/561: mkdir d19/d28/db1 0 2023-12-05T09:26:21.574 INFO:tasks.workunit.client.1.smithi134.stdout:2/562: chown d19/d28/d2b/l72 9213 1 2023-12-05T09:26:21.575 INFO:tasks.workunit.client.1.smithi134.stdout:3/562: write d4/d5/d45/d60/f82 [1061209,7462] 0 2023-12-05T09:26:21.575 INFO:tasks.workunit.client.0.smithi067.stdout:4/327: dwrite d0/f4 [0,4194304] 0 2023-12-05T09:26:21.575 INFO:tasks.workunit.client.1.smithi134.stdout:7/506: dwrite d2/d7/dc/d2e/d3a/d6d/f96 [0,4194304] 0 2023-12-05T09:26:21.578 INFO:tasks.workunit.client.1.smithi134.stdout:5/495: rename d0/dd/l4c to d0/d1a/d1c/d3f/la9 0 2023-12-05T09:26:21.581 INFO:tasks.workunit.client.0.smithi067.stdout:5/389: mknod db/df/d1a/d1d/c89 0 2023-12-05T09:26:21.583 INFO:tasks.workunit.client.0.smithi067.stdout:4/328: mkdir d0/d1d/d2a/d72 0 2023-12-05T09:26:21.584 INFO:tasks.workunit.client.0.smithi067.stdout:4/329: creat d0/d1d/d24/f73 x:0 0 0 2023-12-05T09:26:21.601 INFO:tasks.workunit.client.1.smithi134.stdout:7/507: rmdir d2/df/d81 39 2023-12-05T09:26:21.611 INFO:tasks.workunit.client.1.smithi134.stdout:7/508: rmdir d2/df/d2a/d63 39 2023-12-05T09:26:21.612 INFO:tasks.workunit.client.1.smithi134.stdout:7/509: symlink d2/d7/d65/la6 0 2023-12-05T09:26:21.620 INFO:tasks.workunit.client.0.smithi067.stdout:3/286: dwrite d9/f43 [0,4194304] 0 2023-12-05T09:26:21.643 INFO:tasks.workunit.client.1.smithi134.stdout:3/563: dwrite d4/d1f/d50/d52/d42/f30 [0,4194304] 0 2023-12-05T09:26:21.643 INFO:tasks.workunit.client.1.smithi134.stdout:3/564: fsync d4/d1f/d4e/f65 0 2023-12-05T09:26:21.643 INFO:tasks.workunit.client.1.smithi134.stdout:3/565: chown d4/d1f/d50/d52/l49 1758 1 2023-12-05T09:26:21.650 INFO:tasks.workunit.client.1.smithi134.stdout:1/642: sync 2023-12-05T09:26:21.650 INFO:tasks.workunit.client.1.smithi134.stdout:1/643: dread - d2/d27/d71/fa3 zero size 2023-12-05T09:26:21.652 INFO:tasks.workunit.client.0.smithi067.stdout:5/390: rmdir db/df/d1a 39 2023-12-05T09:26:21.652 INFO:tasks.workunit.client.0.smithi067.stdout:5/391: write db/df/d3f/d88/f62 [5066702,29949] 0 2023-12-05T09:26:21.657 INFO:tasks.workunit.client.0.smithi067.stdout:2/283: dwrite d0/d15/d53/f1d [0,4194304] 0 2023-12-05T09:26:21.662 INFO:tasks.workunit.client.1.smithi134.stdout:1/644: dread d2/d9/d10/f3f [0,4194304] 0 2023-12-05T09:26:21.663 INFO:tasks.workunit.client.0.smithi067.stdout:3/287: rename d9/da/d15/d28/d31 to d9/d62 0 2023-12-05T09:26:21.669 INFO:tasks.workunit.client.0.smithi067.stdout:5/392: truncate db/df/d1a/f4c 965216 0 2023-12-05T09:26:21.669 INFO:tasks.workunit.client.0.smithi067.stdout:5/393: read db/df/d1a/f6a [939093,109751] 0 2023-12-05T09:26:21.671 INFO:tasks.workunit.client.0.smithi067.stdout:5/394: creat db/df/d36/f8a x:0 0 0 2023-12-05T09:26:21.672 INFO:tasks.workunit.client.0.smithi067.stdout:5/395: fdatasync db/df/d3f/f4a 0 2023-12-05T09:26:21.677 INFO:tasks.workunit.client.0.smithi067.stdout:3/288: getdents d9/da/d15/d28 0 2023-12-05T09:26:21.677 INFO:tasks.workunit.client.0.smithi067.stdout:3/289: fsync d9/d20/f5c 0 2023-12-05T09:26:21.677 INFO:tasks.workunit.client.1.smithi134.stdout:3/566: link d4/d80/la9 d4/d5/d45/lb6 0 2023-12-05T09:26:21.679 INFO:tasks.workunit.client.1.smithi134.stdout:2/563: rename fc to d19/d28/db1/fb2 0 2023-12-05T09:26:21.680 INFO:tasks.workunit.client.0.smithi067.stdout:0/458: sync 2023-12-05T09:26:21.681 INFO:tasks.workunit.client.0.smithi067.stdout:3/290: mknod d9/da/d15/d17/d1a/c63 0 2023-12-05T09:26:21.682 INFO:tasks.workunit.client.0.smithi067.stdout:3/291: read - d9/f58 zero size 2023-12-05T09:26:21.683 INFO:tasks.workunit.client.1.smithi134.stdout:3/567: symlink d4/d1f/d4e/d6a/lb7 0 2023-12-05T09:26:21.688 INFO:tasks.workunit.client.1.smithi134.stdout:5/496: rename d0/d1a/d1c/d25/d6a/fa3 to d0/dd/faa 0 2023-12-05T09:26:21.689 INFO:tasks.workunit.client.0.smithi067.stdout:3/292: mkdir d9/da/d15/d28/d29/d47/d64 0 2023-12-05T09:26:21.691 INFO:tasks.workunit.client.0.smithi067.stdout:0/459: unlink d3/df/d10/c56 0 2023-12-05T09:26:21.691 INFO:tasks.workunit.client.1.smithi134.stdout:3/568: dread d4/d1f/d50/d52/f88 [0,4194304] 0 2023-12-05T09:26:21.691 INFO:tasks.workunit.client.1.smithi134.stdout:3/569: stat d4/f13 0 2023-12-05T09:26:21.693 INFO:tasks.workunit.client.1.smithi134.stdout:2/564: rename d19/d28/d2b/dae to d19/d28/d31/db3 0 2023-12-05T09:26:21.696 INFO:tasks.workunit.client.0.smithi067.stdout:3/293: truncate d9/da/d15/d17/d1a/f35 3344455 0 2023-12-05T09:26:21.696 INFO:tasks.workunit.client.0.smithi067.stdout:3/294: dread - d9/da/d15/d17/d2b/f4d zero size 2023-12-05T09:26:21.699 INFO:tasks.workunit.client.1.smithi134.stdout:3/570: creat d4/d5/d45/d86/fb8 x:0 0 0 2023-12-05T09:26:21.699 INFO:tasks.workunit.client.1.smithi134.stdout:3/571: chown d4/d1f/d50/d52/d42/f30 196810 1 2023-12-05T09:26:21.699 INFO:tasks.workunit.client.0.smithi067.stdout:3/295: mkdir d9/da/d15/d28/d29/d65 0 2023-12-05T09:26:21.701 INFO:tasks.workunit.client.1.smithi134.stdout:5/497: mkdir d0/d11/d5c/dab 0 2023-12-05T09:26:21.703 INFO:tasks.workunit.client.1.smithi134.stdout:3/572: link d4/d5/d45/c4c d4/d5/d45/d86/cb9 0 2023-12-05T09:26:21.704 INFO:tasks.workunit.client.0.smithi067.stdout:3/296: mkdir d9/da/d15/d17/d1a/d51/d66 0 2023-12-05T09:26:21.706 INFO:tasks.workunit.client.1.smithi134.stdout:1/645: dwrite d2/d9/d10/d5b/d5e/fa8 [0,4194304] 0 2023-12-05T09:26:21.708 INFO:tasks.workunit.client.1.smithi134.stdout:5/498: creat d0/d1a/d1c/d25/d4d/d9e/fac x:0 0 0 2023-12-05T09:26:21.708 INFO:tasks.workunit.client.1.smithi134.stdout:5/499: write d0/d11/d61/d75/f79 [18553,44693] 0 2023-12-05T09:26:21.709 INFO:tasks.workunit.client.1.smithi134.stdout:3/573: mkdir d4/d5/d45/d60/d85/dba 0 2023-12-05T09:26:21.709 INFO:tasks.workunit.client.1.smithi134.stdout:3/574: chown d4/d5/d45/d60/d85/d96 14952 1 2023-12-05T09:26:21.709 INFO:tasks.workunit.client.1.smithi134.stdout:4/544: sync 2023-12-05T09:26:21.709 INFO:tasks.workunit.client.1.smithi134.stdout:0/499: sync 2023-12-05T09:26:21.709 INFO:tasks.workunit.client.1.smithi134.stdout:8/602: sync 2023-12-05T09:26:21.709 INFO:tasks.workunit.client.1.smithi134.stdout:6/472: sync 2023-12-05T09:26:21.709 INFO:tasks.workunit.client.1.smithi134.stdout:9/507: sync 2023-12-05T09:26:21.710 INFO:tasks.workunit.client.0.smithi067.stdout:3/297: rmdir d9/da/d3b 39 2023-12-05T09:26:21.712 INFO:tasks.workunit.client.0.smithi067.stdout:3/298: creat d9/f67 x:0 0 0 2023-12-05T09:26:21.712 INFO:tasks.workunit.client.0.smithi067.stdout:3/299: stat d9/da/d15/d17/d2b/f4d 0 2023-12-05T09:26:21.712 INFO:tasks.workunit.client.1.smithi134.stdout:0/500: write d13/d14/d30/f88 [1160506,11352] 0 2023-12-05T09:26:21.717 INFO:tasks.workunit.client.1.smithi134.stdout:1/646: symlink d2/d9/d10/d30/d4a/d81/lef 0 2023-12-05T09:26:21.720 INFO:tasks.workunit.client.0.smithi067.stdout:8/318: dwrite d5/dc/d1a/d20/f22 [4194304,4194304] 0 2023-12-05T09:26:21.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/506: dwrite d1b/d25/d54/d5c/f72 [0,4194304] 0 2023-12-05T09:26:21.721 INFO:tasks.workunit.client.1.smithi134.stdout:3/575: symlink d4/d1f/d4e/lbb 0 2023-12-05T09:26:21.721 INFO:tasks.workunit.client.0.smithi067.stdout:9/507: creat d1b/d25/d35/d56/fac x:0 0 0 2023-12-05T09:26:21.722 INFO:tasks.workunit.client.0.smithi067.stdout:9/508: creat d1b/d25/d5b/d62/fad x:0 0 0 2023-12-05T09:26:21.722 INFO:tasks.workunit.client.0.smithi067.stdout:9/509: chown d1b/d3e/f53 1858 1 2023-12-05T09:26:21.724 INFO:tasks.workunit.client.1.smithi134.stdout:8/603: creat da/de/d8a/fd1 x:0 0 0 2023-12-05T09:26:21.725 INFO:tasks.workunit.client.1.smithi134.stdout:4/545: creat d16/d21/d69/d6e/daa/d3b/d8e/fbb x:0 0 0 2023-12-05T09:26:21.726 INFO:tasks.workunit.client.1.smithi134.stdout:9/508: unlink d7/d8/l67 0 2023-12-05T09:26:21.732 INFO:tasks.workunit.client.1.smithi134.stdout:9/509: creat d7/d8/d14/d26/d5a/fae x:0 0 0 2023-12-05T09:26:21.732 INFO:tasks.workunit.client.1.smithi134.stdout:6/473: dread d4/d39/d42/d4f/d6d/d3a/d75/f30 [0,4194304] 0 2023-12-05T09:26:21.732 INFO:tasks.workunit.client.1.smithi134.stdout:0/501: mkdir d13/d14/d30/d4b/d66/da0/daf 0 2023-12-05T09:26:21.734 INFO:tasks.workunit.client.1.smithi134.stdout:1/647: mknod d2/d9/d10/d30/d4a/cf0 0 2023-12-05T09:26:21.734 INFO:tasks.workunit.client.1.smithi134.stdout:1/648: chown d2/d9/fb3 79107 1 2023-12-05T09:26:21.738 INFO:tasks.workunit.client.1.smithi134.stdout:8/604: creat da/de/d11/d1d/d70/db0/fd2 x:0 0 0 2023-12-05T09:26:21.739 INFO:tasks.workunit.client.1.smithi134.stdout:8/605: write da/de/d16/d2d/f88 [424213,54893] 0 2023-12-05T09:26:21.739 INFO:tasks.workunit.client.1.smithi134.stdout:8/606: chown da/de/d11/d1d/d5f/d9b 97499892 1 2023-12-05T09:26:21.739 INFO:tasks.workunit.client.1.smithi134.stdout:8/607: fsync f2 0 2023-12-05T09:26:21.742 INFO:tasks.workunit.client.1.smithi134.stdout:4/546: mkdir d16/d7b/db6/dbc 0 2023-12-05T09:26:21.742 INFO:tasks.workunit.client.1.smithi134.stdout:4/547: fdatasync f13 0 2023-12-05T09:26:21.742 INFO:tasks.workunit.client.1.smithi134.stdout:4/548: readlink d16/d21/d48/d80/dae/l75 0 2023-12-05T09:26:21.745 INFO:tasks.workunit.client.0.smithi067.stdout:9/510: symlink d1b/d25/d54/d5c/d81/d96/lae 0 2023-12-05T09:26:21.745 INFO:tasks.workunit.client.1.smithi134.stdout:7/510: sync 2023-12-05T09:26:21.747 INFO:tasks.workunit.client.1.smithi134.stdout:9/510: dread d7/d8/d14/d26/d5a/d69/fa0 [0,4194304] 0 2023-12-05T09:26:21.750 INFO:tasks.workunit.client.0.smithi067.stdout:8/319: getdents d5/dc/d1a/d20/d2d/d41 0 2023-12-05T09:26:21.753 INFO:tasks.workunit.client.1.smithi134.stdout:6/474: mknod d4/d32/c89 0 2023-12-05T09:26:21.756 INFO:tasks.workunit.client.1.smithi134.stdout:0/502: rename d13/c1c to d13/d14/d30/d4b/d66/cb0 0 2023-12-05T09:26:21.756 INFO:tasks.workunit.client.1.smithi134.stdout:3/576: dread d4/d5/f10 [0,4194304] 0 2023-12-05T09:26:21.756 INFO:tasks.workunit.client.0.smithi067.stdout:9/511: symlink d1b/d25/d94/laf 0 2023-12-05T09:26:21.756 INFO:tasks.workunit.client.0.smithi067.stdout:9/512: creat d1b/d25/d5b/d62/fb0 x:0 0 0 2023-12-05T09:26:21.757 INFO:tasks.workunit.client.1.smithi134.stdout:3/577: write d4/d5/d7c/d92/fa3 [239290,79706] 0 2023-12-05T09:26:21.757 INFO:tasks.workunit.client.1.smithi134.stdout:8/608: mknod da/de/d11/d1d/d5f/cd3 0 2023-12-05T09:26:21.758 INFO:tasks.workunit.client.1.smithi134.stdout:8/609: creat da/de/d16/d33/fd4 x:0 0 0 2023-12-05T09:26:21.759 INFO:tasks.workunit.client.1.smithi134.stdout:4/549: mkdir d16/d7b/dbd 0 2023-12-05T09:26:21.762 INFO:tasks.workunit.client.1.smithi134.stdout:7/511: mknod d2/d7/ca7 0 2023-12-05T09:26:21.762 INFO:tasks.workunit.client.1.smithi134.stdout:7/512: read - d2/df/d2a/d36/f5d zero size 2023-12-05T09:26:21.764 INFO:tasks.workunit.client.0.smithi067.stdout:9/513: rename d1b/d25/d5b/d62/la0 to d1b/d25/lb1 0 2023-12-05T09:26:21.766 INFO:tasks.workunit.client.1.smithi134.stdout:5/500: dwrite d0/d1a/d1c/d25/d4d/f68 [8388608,4194304] 0 2023-12-05T09:26:21.766 INFO:tasks.workunit.client.1.smithi134.stdout:9/511: symlink d7/d8/d14/d26/d7f/d92/laf 0 2023-12-05T09:26:21.770 INFO:tasks.workunit.client.1.smithi134.stdout:6/475: truncate d4/d39/d42/f65 3711094 0 2023-12-05T09:26:21.773 INFO:tasks.workunit.client.0.smithi067.stdout:5/396: dwrite db/df/d35/d63/f69 [4194304,4194304] 0 2023-12-05T09:26:21.774 INFO:tasks.workunit.client.1.smithi134.stdout:0/503: unlink d13/d14/d30/d2c/f34 0 2023-12-05T09:26:21.774 INFO:tasks.workunit.client.1.smithi134.stdout:0/504: getdents d13/d14/d30/d4b/d66/da0/da3 0 2023-12-05T09:26:21.775 INFO:tasks.workunit.client.0.smithi067.stdout:0/460: dwrite d3/d7/d30/f9b [0,4194304] 0 2023-12-05T09:26:21.776 INFO:tasks.workunit.client.0.smithi067.stdout:0/461: fdatasync d3/d7/d3c/d67/d59/f88 0 2023-12-05T09:26:21.776 INFO:tasks.workunit.client.0.smithi067.stdout:4/330: dwrite d0/d1d/d53/f6c [0,4194304] 0 2023-12-05T09:26:21.782 INFO:tasks.workunit.client.1.smithi134.stdout:8/610: truncate da/de/d8a/f1e 3865139 0 2023-12-05T09:26:21.782 INFO:tasks.workunit.client.1.smithi134.stdout:4/550: symlink d16/d21/d48/d66/lbe 0 2023-12-05T09:26:21.784 INFO:tasks.workunit.client.1.smithi134.stdout:7/513: mknod d2/ca8 0 2023-12-05T09:26:21.785 INFO:tasks.workunit.client.0.smithi067.stdout:9/514: rename d1b/d25/d5b/d62/fad to d1b/d25/d54/d5c/d6a/d82/fb2 0 2023-12-05T09:26:21.788 INFO:tasks.workunit.client.0.smithi067.stdout:4/331: mknod d0/d1d/d53/c74 0 2023-12-05T09:26:21.789 INFO:tasks.workunit.client.0.smithi067.stdout:4/332: write d0/d1d/d24/f66 [303954,29753] 0 2023-12-05T09:26:21.789 INFO:tasks.workunit.client.0.smithi067.stdout:4/333: write d0/d1d/d24/f66 [590206,104467] 0 2023-12-05T09:26:21.794 INFO:tasks.workunit.client.0.smithi067.stdout:8/320: dread d5/dc/d1a/d20/d3e/f42 [0,4194304] 0 2023-12-05T09:26:21.794 INFO:tasks.workunit.client.0.smithi067.stdout:5/397: dread db/df/f50 [0,4194304] 0 2023-12-05T09:26:21.795 INFO:tasks.workunit.client.1.smithi134.stdout:9/512: rmdir d7/d8/d14/d26/d7f/d92 39 2023-12-05T09:26:21.795 INFO:tasks.workunit.client.1.smithi134.stdout:9/513: write d7/d7d/f82 [501008,128897] 0 2023-12-05T09:26:21.798 INFO:tasks.workunit.client.1.smithi134.stdout:6/476: mkdir d4/d39/d42/d4f/d8a 0 2023-12-05T09:26:21.798 INFO:tasks.workunit.client.1.smithi134.stdout:6/477: creat d4/d39/d42/d4f/d6d/d3a/d80/f8b x:0 0 0 2023-12-05T09:26:21.799 INFO:tasks.workunit.client.1.smithi134.stdout:8/611: write da/de/d11/d8b/fbf [693054,63131] 0 2023-12-05T09:26:21.799 INFO:tasks.workunit.client.1.smithi134.stdout:8/612: fdatasync da/de/d8a/d42/d99/dc8/fa8 0 2023-12-05T09:26:21.801 INFO:tasks.workunit.client.1.smithi134.stdout:4/551: creat d16/d21/d48/d66/fbf x:0 0 0 2023-12-05T09:26:21.802 INFO:tasks.workunit.client.1.smithi134.stdout:5/501: dread d0/d1a/d3a/f4e [0,4194304] 0 2023-12-05T09:26:21.802 INFO:tasks.workunit.client.1.smithi134.stdout:7/514: creat d2/dd/fa9 x:0 0 0 2023-12-05T09:26:21.802 INFO:tasks.workunit.client.1.smithi134.stdout:7/515: rename d2/d7/d2b to d2/d7/d2b/d2d/d67/daa 22 2023-12-05T09:26:21.804 INFO:tasks.workunit.client.0.smithi067.stdout:0/462: dread d3/fa [0,4194304] 0 2023-12-05T09:26:21.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/649: dwrite d2/d9/d10/d30/d4a/d81/f8e [0,4194304] 0 2023-12-05T09:26:21.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/650: write d2/d9/fad [319179,95029] 0 2023-12-05T09:26:21.807 INFO:tasks.workunit.client.1.smithi134.stdout:0/505: write d13/f17 [1581555,25755] 0 2023-12-05T09:26:21.811 INFO:tasks.workunit.client.1.smithi134.stdout:5/502: rmdir d0/d1a/d1c/d3f 39 2023-12-05T09:26:21.814 INFO:tasks.workunit.client.1.smithi134.stdout:7/516: rename d2/dd/d71/l80 to d2/d7/d6f/lab 0 2023-12-05T09:26:21.815 INFO:tasks.workunit.client.0.smithi067.stdout:2/284: dwrite d0/d25/d34/f3d [0,4194304] 0 2023-12-05T09:26:21.815 INFO:tasks.workunit.client.0.smithi067.stdout:2/285: write d0/d25/d34/d4a/f52 [983761,43493] 0 2023-12-05T09:26:21.818 INFO:tasks.workunit.client.0.smithi067.stdout:3/300: dwrite f7 [0,4194304] 0 2023-12-05T09:26:21.818 INFO:tasks.workunit.client.0.smithi067.stdout:3/301: creat d9/d24/f68 x:0 0 0 2023-12-05T09:26:21.820 INFO:tasks.workunit.client.0.smithi067.stdout:2/286: mkdir d0/d15/d63 0 2023-12-05T09:26:21.821 INFO:tasks.workunit.client.1.smithi134.stdout:9/514: mknod d7/d8/d2e/cb0 0 2023-12-05T09:26:21.822 INFO:tasks.workunit.client.1.smithi134.stdout:9/515: write d7/d8/d14/fad [585696,114979] 0 2023-12-05T09:26:21.824 INFO:tasks.workunit.client.1.smithi134.stdout:1/651: symlink d2/d9/d10/d30/lf1 0 2023-12-05T09:26:21.831 INFO:tasks.workunit.client.1.smithi134.stdout:6/478: write d4/d39/d42/d4f/d6d/d3a/d80/f81 [11928845,25877] 0 2023-12-05T09:26:21.833 INFO:tasks.workunit.client.0.smithi067.stdout:3/302: symlink d9/l69 0 2023-12-05T09:26:21.834 INFO:tasks.workunit.client.0.smithi067.stdout:4/334: dread d0/d1d/d25/f5f [0,4194304] 0 2023-12-05T09:26:21.837 INFO:tasks.workunit.client.0.smithi067.stdout:2/287: symlink d0/d25/d34/d4d/l64 0 2023-12-05T09:26:21.837 INFO:tasks.workunit.client.1.smithi134.stdout:5/503: dread d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/f92 [0,4194304] 0 2023-12-05T09:26:21.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/506: truncate d13/d14/d15/f21 1596564 0 2023-12-05T09:26:21.840 INFO:tasks.workunit.client.1.smithi134.stdout:4/552: mknod d16/d18/d1b/d24/cc0 0 2023-12-05T09:26:21.848 INFO:tasks.workunit.client.0.smithi067.stdout:4/335: mknod d0/d9/c75 0 2023-12-05T09:26:21.848 INFO:tasks.workunit.client.1.smithi134.stdout:8/613: dwrite da/de/f27 [4194304,4194304] 0 2023-12-05T09:26:21.850 INFO:tasks.workunit.client.0.smithi067.stdout:5/398: dwrite db/df/d36/f7b [0,4194304] 0 2023-12-05T09:26:21.851 INFO:tasks.workunit.client.1.smithi134.stdout:2/565: sync 2023-12-05T09:26:21.852 INFO:tasks.workunit.client.0.smithi067.stdout:3/303: dread d9/da/d15/d17/d2b/f3e [4194304,4194304] 0 2023-12-05T09:26:21.853 INFO:tasks.workunit.client.1.smithi134.stdout:7/517: mkdir d2/d7/d2b/d2d/dac 0 2023-12-05T09:26:21.853 INFO:tasks.workunit.client.1.smithi134.stdout:7/518: stat d2/d7/dc/d2e/d3a/d6d 0 2023-12-05T09:26:21.855 INFO:tasks.workunit.client.1.smithi134.stdout:5/504: write d0/d1a/d1c/d3f/d5b/d5d/d78/f91 [3604959,14096] 0 2023-12-05T09:26:21.856 INFO:tasks.workunit.client.1.smithi134.stdout:5/505: truncate d0/dd/f20 1848201 0 2023-12-05T09:26:21.856 INFO:tasks.workunit.client.1.smithi134.stdout:5/506: creat d0/d50/fad x:0 0 0 2023-12-05T09:26:21.860 INFO:tasks.workunit.client.1.smithi134.stdout:9/516: creat d7/d5b/d5e/daa/fb1 x:0 0 0 2023-12-05T09:26:21.860 INFO:tasks.workunit.client.1.smithi134.stdout:9/517: fdatasync d7/d10/d56/f9f 0 2023-12-05T09:26:21.863 INFO:tasks.workunit.client.1.smithi134.stdout:1/652: symlink d2/d9/d10/d5b/d5e/lf2 0 2023-12-05T09:26:21.870 INFO:tasks.workunit.client.0.smithi067.stdout:8/321: write d5/da/f4b [3062552,91731] 0 2023-12-05T09:26:21.871 INFO:tasks.workunit.client.1.smithi134.stdout:6/479: mkdir d4/d39/d42/d4f/d6d/d45/d8c 0 2023-12-05T09:26:21.871 INFO:tasks.workunit.client.1.smithi134.stdout:6/480: dread - d4/d39/d42/d4f/f85 zero size 2023-12-05T09:26:21.873 INFO:tasks.workunit.client.0.smithi067.stdout:2/288: dread d0/fe [0,4194304] 0 2023-12-05T09:26:21.875 INFO:tasks.workunit.client.1.smithi134.stdout:0/507: unlink l12 0 2023-12-05T09:26:21.875 INFO:tasks.workunit.client.1.smithi134.stdout:0/508: fsync d13/d14/d15/d67/f7a 0 2023-12-05T09:26:21.876 INFO:tasks.workunit.client.1.smithi134.stdout:0/509: creat d13/fb1 x:0 0 0 2023-12-05T09:26:21.880 INFO:tasks.workunit.client.0.smithi067.stdout:0/463: dwrite d3/fb [0,4194304] 0 2023-12-05T09:26:21.880 INFO:tasks.workunit.client.0.smithi067.stdout:9/515: dwrite d1b/d25/d54/d5c/d6a/d6c/fa5 [0,4194304] 0 2023-12-05T09:26:21.880 INFO:tasks.workunit.client.0.smithi067.stdout:9/516: fdatasync d1b/d25/f70 0 2023-12-05T09:26:21.880 INFO:tasks.workunit.client.0.smithi067.stdout:9/517: chown d1b/d25/d5b/d62 5 1 2023-12-05T09:26:21.881 INFO:tasks.workunit.client.0.smithi067.stdout:9/518: chown d1b/c2e 611933015 1 2023-12-05T09:26:21.881 INFO:tasks.workunit.client.0.smithi067.stdout:9/519: fdatasync d1b/fa2 0 2023-12-05T09:26:21.886 INFO:tasks.workunit.client.1.smithi134.stdout:6/481: read d4/f26 [763050,16566] 0 2023-12-05T09:26:21.893 INFO:tasks.workunit.client.1.smithi134.stdout:2/566: creat d19/d3a/fb4 x:0 0 0 2023-12-05T09:26:21.896 INFO:tasks.workunit.client.0.smithi067.stdout:5/399: link db/c18 db/df/d1a/d1d/d20/c8b 0 2023-12-05T09:26:21.898 INFO:tasks.workunit.client.0.smithi067.stdout:3/304: symlink d9/da/d15/d17/d1a/l6a 0 2023-12-05T09:26:21.898 INFO:tasks.workunit.client.0.smithi067.stdout:9/520: dread f7 [0,4194304] 0 2023-12-05T09:26:21.902 INFO:tasks.workunit.client.1.smithi134.stdout:5/507: symlink d0/d1a/d1c/d3f/d81/d8e/lae 0 2023-12-05T09:26:21.902 INFO:tasks.workunit.client.1.smithi134.stdout:5/508: truncate d0/dd/f51 456967 0 2023-12-05T09:26:21.903 INFO:tasks.workunit.client.1.smithi134.stdout:7/519: dwrite d2/d7/f13 [0,4194304] 0 2023-12-05T09:26:21.904 INFO:tasks.workunit.client.0.smithi067.stdout:8/322: unlink d5/da/f2a 0 2023-12-05T09:26:21.905 INFO:tasks.workunit.client.1.smithi134.stdout:1/653: getdents d2/d27/d71 0 2023-12-05T09:26:21.907 INFO:tasks.workunit.client.1.smithi134.stdout:9/518: dwrite d7/d5b/d5e/daa/fb1 [0,4194304] 0 2023-12-05T09:26:21.907 INFO:tasks.workunit.client.0.smithi067.stdout:2/289: link d0/d25/d34/d4d/d54/d56/c57 d0/d25/d48/c65 0 2023-12-05T09:26:21.911 INFO:tasks.workunit.client.1.smithi134.stdout:0/510: mkdir d13/d14/d30/d4b/d66/da0/daf/db2 0 2023-12-05T09:26:21.914 INFO:tasks.workunit.client.1.smithi134.stdout:4/553: rename d16/d18/d1b/d24/l6b to d16/d18/d1b/d24/lc1 0 2023-12-05T09:26:21.915 INFO:tasks.workunit.client.0.smithi067.stdout:1/368: sync 2023-12-05T09:26:21.916 INFO:tasks.workunit.client.0.smithi067.stdout:6/270: sync 2023-12-05T09:26:21.916 INFO:tasks.workunit.client.1.smithi134.stdout:3/578: sync 2023-12-05T09:26:21.917 INFO:tasks.workunit.client.0.smithi067.stdout:4/336: getdents d0 0 2023-12-05T09:26:21.918 INFO:tasks.workunit.client.1.smithi134.stdout:3/579: creat d4/d5/d7c/d92/fbc x:0 0 0 2023-12-05T09:26:21.918 INFO:tasks.workunit.client.1.smithi134.stdout:6/482: write d4/d39/d42/d4f/d6d/d3a/da/f72 [535433,95862] 0 2023-12-05T09:26:21.920 INFO:tasks.workunit.client.0.smithi067.stdout:3/305: creat d9/da/d3b/f6b x:0 0 0 2023-12-05T09:26:21.921 INFO:tasks.workunit.client.0.smithi067.stdout:8/323: dread d5/dc/f19 [0,4194304] 0 2023-12-05T09:26:21.921 INFO:tasks.workunit.client.1.smithi134.stdout:2/567: rmdir d19/d28/d2b/da3/da8 0 2023-12-05T09:26:21.923 INFO:tasks.workunit.client.0.smithi067.stdout:9/521: link d1b/d25/d35/d56/c8e d1b/d25/d54/d5c/d6a/d6c/cb3 0 2023-12-05T09:26:21.923 INFO:tasks.workunit.client.0.smithi067.stdout:9/522: truncate d1b/d25/d35/f43 2018813 0 2023-12-05T09:26:21.924 INFO:tasks.workunit.client.0.smithi067.stdout:9/523: read - d1b/d25/d54/d5c/d6a/d82/f9a zero size 2023-12-05T09:26:21.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/367: sync 2023-12-05T09:26:21.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/368: dread - d0/f76 zero size 2023-12-05T09:26:21.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/369: chown d0/d9/d3f/f47 31607 1 2023-12-05T09:26:21.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/370: stat d0/d9/d10/d1d/l24 0 2023-12-05T09:26:21.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/371: fdatasync d0/d9/d10/d37/d38/d64/f55 0 2023-12-05T09:26:21.924 INFO:tasks.workunit.client.0.smithi067.stdout:7/372: chown d0/d9/d10/d37/d38 20233 1 2023-12-05T09:26:21.927 INFO:tasks.workunit.client.1.smithi134.stdout:5/509: mkdir d0/d45/daf 0 2023-12-05T09:26:21.937 INFO:tasks.workunit.client.1.smithi134.stdout:1/654: truncate d2/d27/d40/f5d 14829 0 2023-12-05T09:26:21.937 INFO:tasks.workunit.client.1.smithi134.stdout:1/655: readlink d2/d27/la5 0 2023-12-05T09:26:21.939 INFO:tasks.workunit.client.0.smithi067.stdout:2/290: creat d0/d15/f66 x:0 0 0 2023-12-05T09:26:21.942 INFO:tasks.workunit.client.1.smithi134.stdout:2/568: write d19/f2d [1858544,110363] 0 2023-12-05T09:26:21.952 INFO:tasks.workunit.client.0.smithi067.stdout:3/306: creat d9/da/f6c x:0 0 0 2023-12-05T09:26:21.952 INFO:tasks.workunit.client.0.smithi067.stdout:6/271: write da/d10/d1e/d17/d2f/d1f/f25 [2286521,83810] 0 2023-12-05T09:26:21.952 INFO:tasks.workunit.client.0.smithi067.stdout:6/272: chown da/d10/d1e/l46 17497 1 2023-12-05T09:26:21.954 INFO:tasks.workunit.client.1.smithi134.stdout:4/554: dread d16/d18/d1c/d63/fa4 [0,4194304] 0 2023-12-05T09:26:21.955 INFO:tasks.workunit.client.0.smithi067.stdout:1/369: creat d2/d4f/d15/d60/d68/f85 x:0 0 0 2023-12-05T09:26:21.956 INFO:tasks.workunit.client.0.smithi067.stdout:9/524: mknod d1b/d25/cb4 0 2023-12-05T09:26:21.956 INFO:tasks.workunit.client.0.smithi067.stdout:8/324: truncate d5/dc/d1a/d20/d3e/f42 2521406 0 2023-12-05T09:26:21.958 INFO:tasks.workunit.client.0.smithi067.stdout:2/291: write d0/d15/d53/d1e/f3e [581975,56085] 0 2023-12-05T09:26:21.958 INFO:tasks.workunit.client.0.smithi067.stdout:6/273: creat da/d10/f5e x:0 0 0 2023-12-05T09:26:21.958 INFO:tasks.workunit.client.0.smithi067.stdout:6/274: chown da/d10/d1e/d17/d2f/d1f/d27/d45 7 1 2023-12-05T09:26:21.959 INFO:tasks.workunit.client.0.smithi067.stdout:1/370: rmdir d2/d3/d63 0 2023-12-05T09:26:21.960 INFO:tasks.workunit.client.1.smithi134.stdout:2/569: mkdir d19/d28/d31/d38/d98/db5 0 2023-12-05T09:26:21.960 INFO:tasks.workunit.client.1.smithi134.stdout:6/483: creat d4/d39/d42/d4f/d6d/d3a/f8d x:0 0 0 2023-12-05T09:26:21.960 INFO:tasks.workunit.client.1.smithi134.stdout:2/570: read d19/f2c [999778,19759] 0 2023-12-05T09:26:21.960 INFO:tasks.workunit.client.1.smithi134.stdout:2/571: write d19/d3f/f5a [1418,107713] 0 2023-12-05T09:26:21.961 INFO:tasks.workunit.client.1.smithi134.stdout:5/510: dread d0/dd/f2c [0,4194304] 0 2023-12-05T09:26:21.962 INFO:tasks.workunit.client.0.smithi067.stdout:1/371: symlink d2/d5/d7/de/d19/d49/d5f/l86 0 2023-12-05T09:26:21.962 INFO:tasks.workunit.client.0.smithi067.stdout:8/325: truncate d5/f40 3305502 0 2023-12-05T09:26:21.965 INFO:tasks.workunit.client.0.smithi067.stdout:8/326: fsync d5/dc/d1a/d20/f31 0 2023-12-05T09:26:21.965 INFO:tasks.workunit.client.0.smithi067.stdout:1/372: mknod d2/d5/d7/c87 0 2023-12-05T09:26:21.966 INFO:tasks.workunit.client.0.smithi067.stdout:8/327: unlink d5/da/f33 0 2023-12-05T09:26:21.966 INFO:tasks.workunit.client.0.smithi067.stdout:1/373: symlink d2/d4f/d14/l88 0 2023-12-05T09:26:21.968 INFO:tasks.workunit.client.1.smithi134.stdout:9/519: dwrite d7/d8/d14/d26/d7f/d92/f57 [0,4194304] 0 2023-12-05T09:26:21.972 INFO:tasks.workunit.client.0.smithi067.stdout:8/328: mknod d5/dc/d1a/d20/d2d/d41/c57 0 2023-12-05T09:26:21.982 INFO:tasks.workunit.client.1.smithi134.stdout:6/484: rename d4/d39/d42/d4f/d6d/d3a/l1e to d4/d39/d5c/l8e 0 2023-12-05T09:26:21.983 INFO:tasks.workunit.client.1.smithi134.stdout:2/572: mknod d19/d28/d2b/cb6 0 2023-12-05T09:26:21.984 INFO:tasks.workunit.client.1.smithi134.stdout:2/573: chown d19/d28/d31/f3c 2045 1 2023-12-05T09:26:21.984 INFO:tasks.workunit.client.1.smithi134.stdout:2/574: chown f8 24 1 2023-12-05T09:26:21.984 INFO:tasks.workunit.client.1.smithi134.stdout:2/575: chown d19/d3f 724318728 1 2023-12-05T09:26:21.985 INFO:tasks.workunit.client.1.smithi134.stdout:5/511: mkdir d0/d1a/d1c/d3f/d81/db0 0 2023-12-05T09:26:21.985 INFO:tasks.workunit.client.0.smithi067.stdout:8/329: unlink d5/dc/d1a/d20/f31 0 2023-12-05T09:26:21.993 INFO:tasks.workunit.client.0.smithi067.stdout:7/373: dread d0/d9/d10/d37/d38/d64/d54/f65 [0,4194304] 0 2023-12-05T09:26:21.993 INFO:tasks.workunit.client.0.smithi067.stdout:7/374: fdatasync d0/d9/d10/d37/d38/d64/d54/f5e 0 2023-12-05T09:26:21.993 INFO:tasks.workunit.client.0.smithi067.stdout:7/375: chown d0/d9/d10/d1d/c59 24819 1 2023-12-05T09:26:21.993 INFO:tasks.workunit.client.0.smithi067.stdout:7/376: truncate d0/d9/d56/f5b 2129245 0 2023-12-05T09:26:21.993 INFO:tasks.workunit.client.0.smithi067.stdout:3/307: write d9/da/d3b/f40 [403518,98608] 0 2023-12-05T09:26:21.994 INFO:tasks.workunit.client.1.smithi134.stdout:9/520: getdents d7/d8/d2e 0 2023-12-05T09:26:21.994 INFO:tasks.workunit.client.1.smithi134.stdout:9/521: creat d7/d8/d14/d26/d5a/fb2 x:0 0 0 2023-12-05T09:26:21.996 INFO:tasks.workunit.client.0.smithi067.stdout:8/330: mkdir d5/dc/d1a/d20/d58 0 2023-12-05T09:26:21.996 INFO:tasks.workunit.client.0.smithi067.stdout:8/331: creat d5/dc/d1a/d20/f59 x:0 0 0 2023-12-05T09:26:22.001 INFO:tasks.workunit.client.1.smithi134.stdout:8/614: sync 2023-12-05T09:26:22.001 INFO:tasks.workunit.client.1.smithi134.stdout:6/485: mkdir d4/d39/d42/d4f/d6d/d3a/d75/d8f 0 2023-12-05T09:26:22.003 INFO:tasks.workunit.client.0.smithi067.stdout:3/308: symlink d9/da/d15/d17/d1a/l6d 0 2023-12-05T09:26:22.003 INFO:tasks.workunit.client.1.smithi134.stdout:3/580: dread d4/f16 [0,4194304] 0 2023-12-05T09:26:22.003 INFO:tasks.workunit.client.1.smithi134.stdout:3/581: creat d4/fbd x:0 0 0 2023-12-05T09:26:22.005 INFO:tasks.workunit.client.1.smithi134.stdout:2/576: mkdir d19/d28/d31/d38/db7 0 2023-12-05T09:26:22.005 INFO:tasks.workunit.client.1.smithi134.stdout:2/577: stat d19/d5f 0 2023-12-05T09:26:22.005 INFO:tasks.workunit.client.1.smithi134.stdout:7/520: dwrite d2/df/d81/f91 [0,4194304] 0 2023-12-05T09:26:22.009 INFO:tasks.workunit.client.0.smithi067.stdout:8/332: rename d5/dc/d1a/f21 to d5/dc/d1a/f5a 0 2023-12-05T09:26:22.010 INFO:tasks.workunit.client.0.smithi067.stdout:8/333: write d5/f18 [3833443,1427] 0 2023-12-05T09:26:22.010 INFO:tasks.workunit.client.1.smithi134.stdout:9/522: dread d7/d8/d14/d26/f3e [0,4194304] 0 2023-12-05T09:26:22.012 INFO:tasks.workunit.client.1.smithi134.stdout:8/615: stat da/de/d43/lca 0 2023-12-05T09:26:22.015 INFO:tasks.workunit.client.0.smithi067.stdout:1/374: dread d2/f24 [0,4194304] 0 2023-12-05T09:26:22.015 INFO:tasks.workunit.client.0.smithi067.stdout:1/375: write d2/d4f/d14/d48/f59 [433604,40650] 0 2023-12-05T09:26:22.015 INFO:tasks.workunit.client.0.smithi067.stdout:3/309: symlink d9/da/d15/d17/d1a/d51/d66/l6e 0 2023-12-05T09:26:22.015 INFO:tasks.workunit.client.0.smithi067.stdout:3/310: fsync d9/d20/f4f 0 2023-12-05T09:26:22.017 INFO:tasks.workunit.client.1.smithi134.stdout:6/486: symlink d4/d78/d7a/l90 0 2023-12-05T09:26:22.021 INFO:tasks.workunit.client.0.smithi067.stdout:8/334: creat d5/dc/d1a/d20/d2d/d41/f5b x:0 0 0 2023-12-05T09:26:22.022 INFO:tasks.workunit.client.1.smithi134.stdout:3/582: rename d4/d5/f11 to d4/d1f/d50/d52/fbe 0 2023-12-05T09:26:22.022 INFO:tasks.workunit.client.0.smithi067.stdout:1/376: mknod d2/d4f/d15/d60/d68/c89 0 2023-12-05T09:26:22.023 INFO:tasks.workunit.client.0.smithi067.stdout:1/377: truncate d2/d4f/d14/d20/d83/f84 113546 0 2023-12-05T09:26:22.023 INFO:tasks.workunit.client.0.smithi067.stdout:1/378: readlink d2/d4f/d14/d20/d83/l69 0 2023-12-05T09:26:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:9/525: dwrite d1b/d25/d54/d5c/d6a/d82/fb2 [0,4194304] 0 2023-12-05T09:26:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:9/526: readlink d1b/d25/d35/l7e 0 2023-12-05T09:26:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:9/527: fsync d1b/f75 0 2023-12-05T09:26:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:9/528: fdatasync d1b/d25/d35/f4a 0 2023-12-05T09:26:22.024 INFO:tasks.workunit.client.1.smithi134.stdout:2/578: mkdir d19/d76/db8 0 2023-12-05T09:26:22.025 INFO:tasks.workunit.client.0.smithi067.stdout:8/335: symlink d5/dc/d1a/d20/d3e/l5c 0 2023-12-05T09:26:22.025 INFO:tasks.workunit.client.0.smithi067.stdout:8/336: chown d5/dc/f19 3917 1 2023-12-05T09:26:22.028 INFO:tasks.workunit.client.1.smithi134.stdout:9/523: dread f1 [0,4194304] 0 2023-12-05T09:26:22.028 INFO:tasks.workunit.client.1.smithi134.stdout:9/524: chown d7/d8/d14/d26/d7f/d92/d53/f63 834 1 2023-12-05T09:26:22.029 INFO:tasks.workunit.client.0.smithi067.stdout:3/311: dread d9/da/d15/d28/d29/f36 [0,4194304] 0 2023-12-05T09:26:22.029 INFO:tasks.workunit.client.0.smithi067.stdout:3/312: write d9/da/d3b/f6b [131834,81964] 0 2023-12-05T09:26:22.030 INFO:tasks.workunit.client.1.smithi134.stdout:0/511: dwrite d13/d14/f4f [0,4194304] 0 2023-12-05T09:26:22.031 INFO:tasks.workunit.client.1.smithi134.stdout:0/512: dread - d13/d14/d59/f82 zero size 2023-12-05T09:26:22.031 INFO:tasks.workunit.client.0.smithi067.stdout:1/379: symlink d2/d5/d7/de/d19/d71/l8a 0 2023-12-05T09:26:22.031 INFO:tasks.workunit.client.0.smithi067.stdout:1/380: creat d2/f8b x:0 0 0 2023-12-05T09:26:22.032 INFO:tasks.workunit.client.1.smithi134.stdout:7/521: symlink d2/d7/d93/lad 0 2023-12-05T09:26:22.034 INFO:tasks.workunit.client.1.smithi134.stdout:1/656: dwrite d2/d27/d71/fa3 [0,4194304] 0 2023-12-05T09:26:22.034 INFO:tasks.workunit.client.0.smithi067.stdout:0/464: dwrite d3/df/f2b [0,4194304] 0 2023-12-05T09:26:22.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/616: mknod da/de/d11/d8b/cd5 0 2023-12-05T09:26:22.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/617: fsync da/de/d16/d98/fd0 0 2023-12-05T09:26:22.037 INFO:tasks.workunit.client.1.smithi134.stdout:5/512: dwrite d0/d11/f2f [0,4194304] 0 2023-12-05T09:26:22.037 INFO:tasks.workunit.client.1.smithi134.stdout:5/513: readlink d0/d1a/d3a/l85 0 2023-12-05T09:26:22.037 INFO:tasks.workunit.client.1.smithi134.stdout:5/514: chown d0/dd/d37/d7d 10319 1 2023-12-05T09:26:22.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/487: unlink d4/d32/c89 0 2023-12-05T09:26:22.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/488: readlink d4/d39/d42/d4f/d6d/l6f 0 2023-12-05T09:26:22.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/489: fsync d4/ff 0 2023-12-05T09:26:22.041 INFO:tasks.workunit.client.0.smithi067.stdout:9/529: creat d1b/d25/fb5 x:0 0 0 2023-12-05T09:26:22.046 INFO:tasks.workunit.client.0.smithi067.stdout:8/337: rmdir d5/dc/d1a 39 2023-12-05T09:26:22.051 INFO:tasks.workunit.client.0.smithi067.stdout:1/381: creat d2/d4f/d54/f8c x:0 0 0 2023-12-05T09:26:22.052 INFO:tasks.workunit.client.0.smithi067.stdout:1/382: chown d2/f39 535316349 1 2023-12-05T09:26:22.052 INFO:tasks.workunit.client.0.smithi067.stdout:5/400: dwrite db/df/d35/d63/f69 [4194304,4194304] 0 2023-12-05T09:26:22.052 INFO:tasks.workunit.client.1.smithi134.stdout:4/555: dwrite d16/d21/d48/d80/dae/f6c [0,4194304] 0 2023-12-05T09:26:22.052 INFO:tasks.workunit.client.1.smithi134.stdout:4/556: write d16/d21/d35/f60 [479849,101267] 0 2023-12-05T09:26:22.052 INFO:tasks.workunit.client.1.smithi134.stdout:4/557: write f5 [1987582,125794] 0 2023-12-05T09:26:22.055 INFO:tasks.workunit.client.1.smithi134.stdout:2/579: mkdir d19/d76/db9 0 2023-12-05T09:26:22.064 INFO:tasks.workunit.client.0.smithi067.stdout:8/338: rename d5/dc/d1a/d20/d2d/d41/l46 to d5/dc/d1a/d20/d2d/l5d 0 2023-12-05T09:26:22.072 INFO:tasks.workunit.client.0.smithi067.stdout:1/383: creat d2/d5/d7/de/d19/f8d x:0 0 0 2023-12-05T09:26:22.072 INFO:tasks.workunit.client.0.smithi067.stdout:5/401: write db/df/f53 [2884963,105038] 0 2023-12-05T09:26:22.076 INFO:tasks.workunit.client.1.smithi134.stdout:8/618: link da/de/d16/d33/l97 da/de/d11/d1d/ld6 0 2023-12-05T09:26:22.076 INFO:tasks.workunit.client.1.smithi134.stdout:8/619: chown da/de/c37 0 1 2023-12-05T09:26:22.078 INFO:tasks.workunit.client.0.smithi067.stdout:8/339: mknod d5/dc/d1a/d20/d2d/c5e 0 2023-12-05T09:26:22.078 INFO:tasks.workunit.client.0.smithi067.stdout:8/340: write d5/da/f1f [2135157,9979] 0 2023-12-05T09:26:22.080 INFO:tasks.workunit.client.0.smithi067.stdout:6/275: dwrite da/d10/d1e/f36 [0,4194304] 0 2023-12-05T09:26:22.083 INFO:tasks.workunit.client.0.smithi067.stdout:1/384: link d2/d5/d7/de/d19/c80 d2/d4f/d15/d74/d76/c8e 0 2023-12-05T09:26:22.083 INFO:tasks.workunit.client.0.smithi067.stdout:1/385: chown d2/d5/d7/de/d19/d49/f56 7572 1 2023-12-05T09:26:22.084 INFO:tasks.workunit.client.0.smithi067.stdout:6/276: write da/d10/d1e/d17/f40 [328919,123533] 0 2023-12-05T09:26:22.086 INFO:tasks.workunit.client.1.smithi134.stdout:5/515: creat d0/d66/fb1 x:0 0 0 2023-12-05T09:26:22.086 INFO:tasks.workunit.client.1.smithi134.stdout:5/516: creat d0/d1a/d1c/d25/fb2 x:0 0 0 2023-12-05T09:26:22.089 INFO:tasks.workunit.client.1.smithi134.stdout:5/517: read d0/d1a/d3a/f49 [229869,5572] 0 2023-12-05T09:26:22.090 INFO:tasks.workunit.client.0.smithi067.stdout:5/402: link db/df/f6b db/df/d82/f8c 0 2023-12-05T09:26:22.091 INFO:tasks.workunit.client.0.smithi067.stdout:9/530: write d1b/f20 [3044769,44909] 0 2023-12-05T09:26:22.091 INFO:tasks.workunit.client.0.smithi067.stdout:9/531: write d1b/d25/d5b/d62/fb0 [509354,126962] 0 2023-12-05T09:26:22.091 INFO:tasks.workunit.client.0.smithi067.stdout:0/465: dwrite d3/df/d10/f7b [0,4194304] 0 2023-12-05T09:26:22.091 INFO:tasks.workunit.client.1.smithi134.stdout:9/525: dwrite d7/d8/d2e/f31 [0,4194304] 0 2023-12-05T09:26:22.092 INFO:tasks.workunit.client.1.smithi134.stdout:6/490: mknod d4/d78/c91 0 2023-12-05T09:26:22.093 INFO:tasks.workunit.client.0.smithi067.stdout:8/341: creat d5/dc/d1a/d20/d2d/f5f x:0 0 0 2023-12-05T09:26:22.101 INFO:tasks.workunit.client.1.smithi134.stdout:4/558: mkdir d16/d21/d69/d6e/db9/dc2 0 2023-12-05T09:26:22.101 INFO:tasks.workunit.client.1.smithi134.stdout:4/559: readlink d16/d18/d1c/l38 0 2023-12-05T09:26:22.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/377: read d0/d9/d3f/f47 [3496583,72766] 0 2023-12-05T09:26:22.103 INFO:tasks.workunit.client.0.smithi067.stdout:1/386: truncate d2/d5/d7/de/d1a/f44 785253 0 2023-12-05T09:26:22.103 INFO:tasks.workunit.client.0.smithi067.stdout:1/387: dread - d2/d4f/d14/d5d/f82 zero size 2023-12-05T09:26:22.104 INFO:tasks.workunit.client.1.smithi134.stdout:2/580: mkdir d19/d76/dba 0 2023-12-05T09:26:22.107 INFO:tasks.workunit.client.0.smithi067.stdout:5/403: mkdir db/df/d3f/d88/d8d 0 2023-12-05T09:26:22.107 INFO:tasks.workunit.client.0.smithi067.stdout:5/404: write db/df/f7e [393693,78448] 0 2023-12-05T09:26:22.108 INFO:tasks.workunit.client.1.smithi134.stdout:1/657: getdents d2/d27/db4 0 2023-12-05T09:26:22.108 INFO:tasks.workunit.client.1.smithi134.stdout:1/658: write d2/d27/d9d/fa6 [2279893,93391] 0 2023-12-05T09:26:22.108 INFO:tasks.workunit.client.1.smithi134.stdout:1/659: creat d2/d27/d71/d80/db8/ff3 x:0 0 0 2023-12-05T09:26:22.108 INFO:tasks.workunit.client.1.smithi134.stdout:1/660: write d2/d27/f3a [878992,32224] 0 2023-12-05T09:26:22.108 INFO:tasks.workunit.client.1.smithi134.stdout:8/620: truncate da/de/d8a/d42/f63 2620538 0 2023-12-05T09:26:22.110 INFO:tasks.workunit.client.0.smithi067.stdout:6/277: write da/d10/d1e/d17/f29 [2025936,4674] 0 2023-12-05T09:26:22.110 INFO:tasks.workunit.client.0.smithi067.stdout:3/313: dwrite d9/da/d15/d17/d1a/f4b [0,4194304] 0 2023-12-05T09:26:22.110 INFO:tasks.workunit.client.0.smithi067.stdout:2/292: dwrite d0/d15/d53/d1e/f35 [0,4194304] 0 2023-12-05T09:26:22.111 INFO:tasks.workunit.client.1.smithi134.stdout:5/518: mkdir d0/d1a/d1c/d3f/d5b/d5d/d78/db3 0 2023-12-05T09:26:22.111 INFO:tasks.workunit.client.1.smithi134.stdout:0/513: dwrite d13/d14/d30/d2c/f68 [0,4194304] 0 2023-12-05T09:26:22.111 INFO:tasks.workunit.client.1.smithi134.stdout:0/514: fdatasync d13/d14/d30/d2c/f47 0 2023-12-05T09:26:22.112 INFO:tasks.workunit.client.1.smithi134.stdout:0/515: truncate d13/d14/d30/f32 958373 0 2023-12-05T09:26:22.112 INFO:tasks.workunit.client.1.smithi134.stdout:7/522: dwrite d2/d7/d2b/d2d/d67/d73/f5b [0,4194304] 0 2023-12-05T09:26:22.114 INFO:tasks.workunit.client.0.smithi067.stdout:0/466: link d3/df/d10/f37 d3/d7/d3c/d66/d90/fab 0 2023-12-05T09:26:22.115 INFO:tasks.workunit.client.1.smithi134.stdout:9/526: mkdir d7/d10/db3 0 2023-12-05T09:26:22.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/491: mknod d4/d78/c92 0 2023-12-05T09:26:22.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/492: truncate d4/d32/d57/f61 435941 0 2023-12-05T09:26:22.126 INFO:tasks.workunit.client.1.smithi134.stdout:0/516: dread d13/d14/d30/d4b/d23/f83 [4194304,4194304] 0 2023-12-05T09:26:22.126 INFO:tasks.workunit.client.0.smithi067.stdout:7/378: mknod d0/d9/d40/d7a/c7d 0 2023-12-05T09:26:22.126 INFO:tasks.workunit.client.0.smithi067.stdout:7/379: creat d0/d9/d3f/f7e x:0 0 0 2023-12-05T09:26:22.126 INFO:tasks.workunit.client.0.smithi067.stdout:7/380: creat d0/d9/d10/d37/d38/f7f x:0 0 0 2023-12-05T09:26:22.126 INFO:tasks.workunit.client.0.smithi067.stdout:7/381: write d0/d9/d10/d37/d38/d64/d5a/f7c [645054,33430] 0 2023-12-05T09:26:22.128 INFO:tasks.workunit.client.1.smithi134.stdout:3/583: rmdir d4/d5/d45/d60/d8a 0 2023-12-05T09:26:22.132 INFO:tasks.workunit.client.1.smithi134.stdout:6/493: dread d4/ff [0,4194304] 0 2023-12-05T09:26:22.132 INFO:tasks.workunit.client.1.smithi134.stdout:6/494: write d4/d39/d42/d4f/d6d/d3a/d75/f29 [5207610,77348] 0 2023-12-05T09:26:22.132 INFO:tasks.workunit.client.1.smithi134.stdout:6/495: truncate d4/d32/d57/f6e 512299 0 2023-12-05T09:26:22.133 INFO:tasks.workunit.client.1.smithi134.stdout:6/496: chown d4/d39/d42/d4f/d6d 89 1 2023-12-05T09:26:22.133 INFO:tasks.workunit.client.1.smithi134.stdout:6/497: chown d4/d39/d42/d4f/d6d/d3a/d75/d59/c67 1346321189 1 2023-12-05T09:26:22.133 INFO:tasks.workunit.client.0.smithi067.stdout:1/388: rename d2/d4f/d14/d5d to d2/d5/d7/de/d19/d8f 0 2023-12-05T09:26:22.133 INFO:tasks.workunit.client.0.smithi067.stdout:1/389: chown d2/d5/d7/d6a 998983 1 2023-12-05T09:26:22.134 INFO:tasks.workunit.client.1.smithi134.stdout:4/560: creat d16/d21/d48/d66/db0/db3/fc3 x:0 0 0 2023-12-05T09:26:22.135 INFO:tasks.workunit.client.1.smithi134.stdout:4/561: creat d16/d21/d69/fc4 x:0 0 0 2023-12-05T09:26:22.135 INFO:tasks.workunit.client.1.smithi134.stdout:4/562: stat d16/d21/d69/d6e/c8b 0 2023-12-05T09:26:22.135 INFO:tasks.workunit.client.0.smithi067.stdout:5/405: symlink db/df/d52/l8e 0 2023-12-05T09:26:22.141 INFO:tasks.workunit.client.1.smithi134.stdout:6/498: write d4/d39/d42/d4f/d6d/d3a/da/f19 [493173,34719] 0 2023-12-05T09:26:22.141 INFO:tasks.workunit.client.1.smithi134.stdout:6/499: readlink d4/d39/l5b 0 2023-12-05T09:26:22.143 INFO:tasks.workunit.client.0.smithi067.stdout:6/278: mkdir da/d10/d1e/d17/d2f/d5f 0 2023-12-05T09:26:22.146 INFO:tasks.workunit.client.1.smithi134.stdout:1/661: creat d2/d9/d10/ff4 x:0 0 0 2023-12-05T09:26:22.150 INFO:tasks.workunit.client.0.smithi067.stdout:7/382: write d0/d9/d10/d37/d38/d64/f55 [1699333,812] 0 2023-12-05T09:26:22.152 INFO:tasks.workunit.client.0.smithi067.stdout:7/383: creat d0/d45/f80 x:0 0 0 2023-12-05T09:26:22.153 INFO:tasks.workunit.client.0.smithi067.stdout:7/384: chown d0/d9/d10/c41 12484022 1 2023-12-05T09:26:22.153 INFO:tasks.workunit.client.0.smithi067.stdout:2/293: mkdir d0/d25/d67 0 2023-12-05T09:26:22.158 INFO:tasks.workunit.client.0.smithi067.stdout:8/342: dwrite d5/d3b/f3d [0,4194304] 0 2023-12-05T09:26:22.158 INFO:tasks.workunit.client.0.smithi067.stdout:8/343: chown d5/dc/c26 15120 1 2023-12-05T09:26:22.160 INFO:tasks.workunit.client.1.smithi134.stdout:8/621: dwrite da/de/f7a [0,4194304] 0 2023-12-05T09:26:22.166 INFO:tasks.workunit.client.1.smithi134.stdout:5/519: rename d0/d1a/d3a/c6d to d0/d1a/d1c/d3f/cb4 0 2023-12-05T09:26:22.166 INFO:tasks.workunit.client.1.smithi134.stdout:5/520: chown d0/d11/c67 203 1 2023-12-05T09:26:22.166 INFO:tasks.workunit.client.1.smithi134.stdout:5/521: chown d0/d1a/d1c/d3f/c4b 225 1 2023-12-05T09:26:22.173 INFO:tasks.workunit.client.1.smithi134.stdout:7/523: symlink d2/d7/lae 0 2023-12-05T09:26:22.175 INFO:tasks.workunit.client.1.smithi134.stdout:0/517: dwrite d13/d14/d30/d4b/d23/d77/fae [0,4194304] 0 2023-12-05T09:26:22.178 INFO:tasks.workunit.client.1.smithi134.stdout:9/527: symlink d7/d7d/lb4 0 2023-12-05T09:26:22.180 INFO:tasks.workunit.client.1.smithi134.stdout:3/584: creat d4/d1f/d4e/d6a/fbf x:0 0 0 2023-12-05T09:26:22.180 INFO:tasks.workunit.client.1.smithi134.stdout:3/585: chown d4/d1f/d4e/d6a/fbf 8577085 1 2023-12-05T09:26:22.189 INFO:tasks.workunit.client.1.smithi134.stdout:6/500: unlink d4/f46 0 2023-12-05T09:26:22.198 INFO:tasks.workunit.client.0.smithi067.stdout:9/532: rmdir d1b/d25/d54/d5c/d6a/d6c/d76 39 2023-12-05T09:26:22.205 INFO:tasks.workunit.client.1.smithi134.stdout:8/622: creat da/de/d43/fd7 x:0 0 0 2023-12-05T09:26:22.208 INFO:tasks.workunit.client.0.smithi067.stdout:3/314: rename d9/da/d15/d17/d1a/c63 to d9/da/d15/d17/d1a/d51/d66/c6f 0 2023-12-05T09:26:22.208 INFO:tasks.workunit.client.0.smithi067.stdout:3/315: fdatasync d9/da/d15/d28/f41 0 2023-12-05T09:26:22.220 INFO:tasks.workunit.client.0.smithi067.stdout:8/344: dread d5/dc/d1a/f2e [0,4194304] 0 2023-12-05T09:26:22.240 INFO:tasks.workunit.client.1.smithi134.stdout:6/501: dwrite d4/d39/d5c/f82 [0,4194304] 0 2023-12-05T09:26:22.240 INFO:tasks.workunit.client.1.smithi134.stdout:6/502: creat d4/d39/d42/d4f/d6d/d3a/d75/d59/f93 x:0 0 0 2023-12-05T09:26:22.242 INFO:tasks.workunit.client.0.smithi067.stdout:9/533: write d1b/d25/d54/d5c/f72 [1952739,7575] 0 2023-12-05T09:26:22.290 INFO:tasks.workunit.client.1.smithi134.stdout:5/522: symlink d0/d11/d61/lb5 0 2023-12-05T09:26:22.291 INFO:tasks.workunit.client.0.smithi067.stdout:1/390: symlink d2/d4f/d14/l90 0 2023-12-05T09:26:22.292 INFO:tasks.workunit.client.1.smithi134.stdout:2/581: write d19/d28/db1/fb2 [1198770,11466] 0 2023-12-05T09:26:22.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/406: creat db/df/d1a/d1d/d20/f8f x:0 0 0 2023-12-05T09:26:22.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/407: creat db/df/d1a/d1d/d20/f90 x:0 0 0 2023-12-05T09:26:22.294 INFO:tasks.workunit.client.1.smithi134.stdout:7/524: getdents d2/d8f 0 2023-12-05T09:26:22.300 INFO:tasks.workunit.client.0.smithi067.stdout:0/467: dwrite d3/df/f26 [0,4194304] 0 2023-12-05T09:26:22.300 INFO:tasks.workunit.client.0.smithi067.stdout:7/385: dwrite d0/d9/d10/f2f [0,4194304] 0 2023-12-05T09:26:22.305 INFO:tasks.workunit.client.1.smithi134.stdout:6/503: dread d4/d39/d42/d4f/d6d/d45/f5f [0,4194304] 0 2023-12-05T09:26:22.306 INFO:tasks.workunit.client.0.smithi067.stdout:1/391: write d2/d4f/d15/f29 [1571726,124564] 0 2023-12-05T09:26:22.306 INFO:tasks.workunit.client.0.smithi067.stdout:2/294: rename d0/c21 to d0/d25/d34/d4a/c68 0 2023-12-05T09:26:22.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/316: mkdir d9/da/d15/d17/d1a/d51/d70 0 2023-12-05T09:26:22.310 INFO:tasks.workunit.client.0.smithi067.stdout:8/345: mknod d5/dc/d1a/d20/d58/c60 0 2023-12-05T09:26:22.315 INFO:tasks.workunit.client.0.smithi067.stdout:9/534: creat d1b/d25/d54/d5c/fb6 x:0 0 0 2023-12-05T09:26:22.318 INFO:tasks.workunit.client.1.smithi134.stdout:9/528: link d7/d8/d14/d26/d7f/d92/d53/d7b/d8f/d8a/c9b d7/d8/d14/d26/d5a/d69/cb5 0 2023-12-05T09:26:22.318 INFO:tasks.workunit.client.1.smithi134.stdout:9/529: write d7/d8/d14/fad [1217315,31027] 0 2023-12-05T09:26:22.323 INFO:tasks.workunit.client.0.smithi067.stdout:5/408: symlink db/df/d3f/d88/d8d/l91 0 2023-12-05T09:26:22.324 INFO:tasks.workunit.client.1.smithi134.stdout:1/662: truncate d2/d27/d40/f5d 470870 0 2023-12-05T09:26:22.324 INFO:tasks.workunit.client.1.smithi134.stdout:1/663: chown d2/d9/d10/l12 441935 1 2023-12-05T09:26:22.330 INFO:tasks.workunit.client.0.smithi067.stdout:1/392: rename d2/d5/d7/c30 to d2/d4f/d14/d20/d4c/c91 0 2023-12-05T09:26:22.331 INFO:tasks.workunit.client.0.smithi067.stdout:4/337: sync 2023-12-05T09:26:22.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/623: mkdir da/de/d96/dc9/dd8 0 2023-12-05T09:26:22.334 INFO:tasks.workunit.client.0.smithi067.stdout:3/317: link d9/l69 d9/d49/l71 0 2023-12-05T09:26:22.334 INFO:tasks.workunit.client.1.smithi134.stdout:9/530: dread d7/d8/d2e/f42 [0,4194304] 0 2023-12-05T09:26:22.334 INFO:tasks.workunit.client.1.smithi134.stdout:9/531: creat d7/d8/fb6 x:0 0 0 2023-12-05T09:26:22.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/468: dread d3/f35 [0,4194304] 0 2023-12-05T09:26:22.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/469: truncate d3/d7/f8f 73625 0 2023-12-05T09:26:22.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/470: fdatasync d3/d7/d30/f93 0 2023-12-05T09:26:22.337 INFO:tasks.workunit.client.0.smithi067.stdout:9/535: truncate d1b/d25/d94/fa1 184492 0 2023-12-05T09:26:22.341 INFO:tasks.workunit.client.0.smithi067.stdout:5/409: unlink db/df/d38/f7a 0 2023-12-05T09:26:22.343 INFO:tasks.workunit.client.0.smithi067.stdout:1/393: creat d2/d4f/d54/d70/f92 x:0 0 0 2023-12-05T09:26:22.351 INFO:tasks.workunit.client.0.smithi067.stdout:4/338: link d0/d1d/d24/l67 d0/d1d/d2b/l76 0 2023-12-05T09:26:22.351 INFO:tasks.workunit.client.0.smithi067.stdout:3/318: symlink d9/d20/l72 0 2023-12-05T09:26:22.351 INFO:tasks.workunit.client.0.smithi067.stdout:3/319: readlink d9/d20/l56 0 2023-12-05T09:26:22.355 INFO:tasks.workunit.client.1.smithi134.stdout:2/582: mknod d19/d28/d31/db3/cbb 0 2023-12-05T09:26:22.357 INFO:tasks.workunit.client.0.smithi067.stdout:0/471: creat d3/da2/fac x:0 0 0 2023-12-05T09:26:22.357 INFO:tasks.workunit.client.0.smithi067.stdout:0/472: chown d3/d7/d3c/f48 1707 1 2023-12-05T09:26:22.361 INFO:tasks.workunit.client.0.smithi067.stdout:5/410: rename db/df/d3f/d88/l64 to db/df/l92 0 2023-12-05T09:26:22.363 INFO:tasks.workunit.client.1.smithi134.stdout:7/525: dwrite d2/d7/dc/d22/f85 [4194304,4194304] 0 2023-12-05T09:26:22.364 INFO:tasks.workunit.client.1.smithi134.stdout:2/583: dread d19/d28/f2a [0,4194304] 0 2023-12-05T09:26:22.364 INFO:tasks.workunit.client.1.smithi134.stdout:3/586: write d4/d5/d6f/f5e [217273,43374] 0 2023-12-05T09:26:22.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:22 smithi067 ceph-mon[107174]: pgmap v26: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 154 MiB/s rd, 183 MiB/s wr, 251 op/s 2023-12-05T09:26:22.372 INFO:tasks.workunit.client.0.smithi067.stdout:0/473: symlink d3/d7/d3c/d67/d59/d4e/d94/lad 0 2023-12-05T09:26:22.372 INFO:tasks.workunit.client.0.smithi067.stdout:0/474: stat d3/df/d10 0 2023-12-05T09:26:22.372 INFO:tasks.workunit.client.0.smithi067.stdout:0/475: write d3/d7/d3c/d6c/fa5 [888761,113573] 0 2023-12-05T09:26:22.373 INFO:tasks.workunit.client.1.smithi134.stdout:1/664: creat d2/d27/d71/d80/db8/de1/ff5 x:0 0 0 2023-12-05T09:26:22.373 INFO:tasks.workunit.client.1.smithi134.stdout:1/665: dread - d2/d9/d10/d30/d4a/fe4 zero size 2023-12-05T09:26:22.373 INFO:tasks.workunit.client.1.smithi134.stdout:1/666: truncate d2/d9/d10/d30/d4a/fe4 146209 0 2023-12-05T09:26:22.375 INFO:tasks.workunit.client.1.smithi134.stdout:5/523: dwrite d0/d66/fb1 [0,4194304] 0 2023-12-05T09:26:22.376 INFO:tasks.workunit.client.1.smithi134.stdout:8/624: truncate da/de/d16/f23 2856058 0 2023-12-05T09:26:22.379 INFO:tasks.workunit.client.1.smithi134.stdout:4/563: sync 2023-12-05T09:26:22.379 INFO:tasks.workunit.client.1.smithi134.stdout:4/564: write d16/d21/d35/fa5 [87996,43279] 0 2023-12-05T09:26:22.379 INFO:tasks.workunit.client.1.smithi134.stdout:7/526: mkdir d2/df/d81/daf 0 2023-12-05T09:26:22.382 INFO:tasks.workunit.client.1.smithi134.stdout:3/587: rename d4/d1f/l7b to d4/d1f/d4e/lc0 0 2023-12-05T09:26:22.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:22 smithi134 ceph-mon[116304]: pgmap v26: 65 pgs: 65 active+clean; 1.4 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 154 MiB/s rd, 183 MiB/s wr, 251 op/s 2023-12-05T09:26:22.383 INFO:tasks.workunit.client.0.smithi067.stdout:2/295: dwrite d0/d15/d53/d1e/f61 [0,4194304] 0 2023-12-05T09:26:22.384 INFO:tasks.workunit.client.0.smithi067.stdout:2/296: creat d0/d15/d53/d1e/f69 x:0 0 0 2023-12-05T09:26:22.384 INFO:tasks.workunit.client.0.smithi067.stdout:2/297: read d0/d25/d3a/f43 [3380050,57098] 0 2023-12-05T09:26:22.384 INFO:tasks.workunit.client.0.smithi067.stdout:2/298: dread - d0/d25/d3a/f5f zero size 2023-12-05T09:26:22.386 INFO:tasks.workunit.client.1.smithi134.stdout:5/524: link d0/d1a/c24 d0/d1a/d1c/d3f/d5b/d5d/d78/cb6 0 2023-12-05T09:26:22.387 INFO:tasks.workunit.client.1.smithi134.stdout:8/625: mkdir da/de/d4d/dd9 0 2023-12-05T09:26:22.394 INFO:tasks.workunit.client.1.smithi134.stdout:4/565: truncate d16/d18/d1b/f9b 884637 0 2023-12-05T09:26:22.394 INFO:tasks.workunit.client.1.smithi134.stdout:1/667: write d2/d9/f44 [1174909,67061] 0 2023-12-05T09:26:22.394 INFO:tasks.workunit.client.0.smithi067.stdout:8/346: dwrite d5/dc/d1a/d20/f25 [0,4194304] 0 2023-12-05T09:26:22.396 INFO:tasks.workunit.client.0.smithi067.stdout:0/476: dread d3/d7/f71 [0,4194304] 0 2023-12-05T09:26:22.398 INFO:tasks.workunit.client.1.smithi134.stdout:6/504: write d4/d39/d42/d4f/d6d/d3a/d80/f81 [12510532,57899] 0 2023-12-05T09:26:22.398 INFO:tasks.workunit.client.1.smithi134.stdout:6/505: read - d4/d39/d42/d4f/d6d/d3a/d75/d59/f7f zero size 2023-12-05T09:26:22.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/525: read d0/d11/f1f [355538,107750] 0 2023-12-05T09:26:22.399 INFO:tasks.workunit.client.1.smithi134.stdout:7/527: mknod d2/d7/d65/cb0 0 2023-12-05T09:26:22.404 INFO:tasks.workunit.client.0.smithi067.stdout:2/299: creat d0/d25/d34/f6a x:0 0 0 2023-12-05T09:26:22.405 INFO:tasks.workunit.client.1.smithi134.stdout:8/626: read da/de/d4d/f8d [772608,9273] 0 2023-12-05T09:26:22.411 INFO:tasks.workunit.client.1.smithi134.stdout:6/506: creat d4/d32/d57/f94 x:0 0 0 2023-12-05T09:26:22.411 INFO:tasks.workunit.client.1.smithi134.stdout:7/528: mknod d2/df/d81/cb1 0 2023-12-05T09:26:22.412 INFO:tasks.workunit.client.1.smithi134.stdout:8/627: mknod da/de/d8a/cda 0 2023-12-05T09:26:22.412 INFO:tasks.workunit.client.1.smithi134.stdout:8/628: fdatasync da/de/d11/d1d/fc5 0 2023-12-05T09:26:22.412 INFO:tasks.workunit.client.1.smithi134.stdout:5/526: truncate d0/f7 512803 0 2023-12-05T09:26:22.412 INFO:tasks.workunit.client.1.smithi134.stdout:5/527: chown d0/d1a/d3a/c5f 15369 1 2023-12-05T09:26:22.412 INFO:tasks.workunit.client.1.smithi134.stdout:5/528: write d0/d1a/d1c/d25/d6a/f95 [297617,19763] 0 2023-12-05T09:26:22.414 INFO:tasks.workunit.client.1.smithi134.stdout:6/507: link d4/d39/d42/f7e d4/d39/d42/d4f/d6d/d45/f95 0 2023-12-05T09:26:22.417 INFO:tasks.workunit.client.1.smithi134.stdout:7/529: rmdir d2/d7/d2b/d2d 39 2023-12-05T09:26:22.417 INFO:tasks.workunit.client.1.smithi134.stdout:7/530: creat d2/d7/d2b/d94/fb2 x:0 0 0 2023-12-05T09:26:22.424 INFO:tasks.workunit.client.1.smithi134.stdout:8/629: read da/de/d16/d2d/f80 [86443,129816] 0 2023-12-05T09:26:22.424 INFO:tasks.workunit.client.1.smithi134.stdout:6/508: mknod d4/d39/d42/d4f/d6d/c96 0 2023-12-05T09:26:22.424 INFO:tasks.workunit.client.1.smithi134.stdout:7/531: mkdir d2/d7/d2b/d2d/db3 0 2023-12-05T09:26:22.425 INFO:tasks.workunit.client.0.smithi067.stdout:9/536: dwrite d1b/d25/d35/d56/f68 [4194304,4194304] 0 2023-12-05T09:26:22.426 INFO:tasks.workunit.client.0.smithi067.stdout:1/394: dwrite d2/d5/d7/de/d19/f8d [0,4194304] 0 2023-12-05T09:26:22.426 INFO:tasks.workunit.client.0.smithi067.stdout:1/395: write d2/d5/d7/de/d1a/f57 [714462,33668] 0 2023-12-05T09:26:22.429 INFO:tasks.workunit.client.0.smithi067.stdout:9/537: unlink f19 0 2023-12-05T09:26:22.429 INFO:tasks.workunit.client.1.smithi134.stdout:0/518: dwrite d13/d14/d30/d2c/f44 [0,4194304] 0 2023-12-05T09:26:22.430 INFO:tasks.workunit.client.0.smithi067.stdout:5/411: dwrite db/df/f16 [0,4194304] 0 2023-12-05T09:26:22.432 INFO:tasks.workunit.client.1.smithi134.stdout:2/584: dwrite d19/d28/d63/f7c [0,4194304] 0 2023-12-05T09:26:22.432 INFO:tasks.workunit.client.1.smithi134.stdout:2/585: stat d19/d28/d31/d6f 0 2023-12-05T09:26:22.432 INFO:tasks.workunit.client.1.smithi134.stdout:2/586: getdents d19/d76/da9 0 2023-12-05T09:26:22.432 INFO:tasks.workunit.client.1.smithi134.stdout:7/532: mknod d2/d7/dc/d2e/cb4 0 2023-12-05T09:26:22.438 INFO:tasks.workunit.client.0.smithi067.stdout:1/396: rename d2/d5/d7/de/d19/d71/l8a to d2/d4f/l93 0 2023-12-05T09:26:22.440 INFO:tasks.workunit.client.1.smithi134.stdout:8/630: dread da/de/d11/d1d/f2e [0,4194304] 0 2023-12-05T09:26:22.442 INFO:tasks.workunit.client.0.smithi067.stdout:9/538: dread d1b/f31 [0,4194304] 0 2023-12-05T09:26:22.445 INFO:tasks.workunit.client.1.smithi134.stdout:9/532: dwrite d7/d8/d14/f25 [0,4194304] 0 2023-12-05T09:26:22.445 INFO:tasks.workunit.client.1.smithi134.stdout:1/668: dwrite d2/d9/f2d [0,4194304] 0 2023-12-05T09:26:22.445 INFO:tasks.workunit.client.1.smithi134.stdout:6/509: dread d4/d32/d57/f61 [0,4194304] 0 2023-12-05T09:26:22.445 INFO:tasks.workunit.client.1.smithi134.stdout:6/510: fsync d4/d39/f51 0 2023-12-05T09:26:22.446 INFO:tasks.workunit.client.1.smithi134.stdout:4/566: fdatasync d16/d21/d35/fa5 0 2023-12-05T09:26:22.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/588: dwrite d4/d1f/f5d [0,4194304] 0 2023-12-05T09:26:22.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/589: chown d4/d5/d6f 1768885 1 2023-12-05T09:26:22.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/590: write d4/f3b [4290183,79563] 0 2023-12-05T09:26:22.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/591: write d4/d1f/f33 [529529,50080] 0 2023-12-05T09:26:22.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/592: write d4/d5/d7c/d92/fbc [983351,66961] 0 2023-12-05T09:26:22.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/593: truncate d4/f13 832290 0 2023-12-05T09:26:22.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/594: write d4/d1f/f75 [1766989,85943] 0 2023-12-05T09:26:22.452 INFO:tasks.workunit.client.1.smithi134.stdout:3/595: chown d4/d1f/l43 3553 1 2023-12-05T09:26:22.455 INFO:tasks.workunit.client.1.smithi134.stdout:0/519: mknod d13/d14/d30/d4b/cb3 0 2023-12-05T09:26:22.455 INFO:tasks.workunit.client.1.smithi134.stdout:2/587: rename d19/d28/d2b/f82 to d19/d3a/fbc 0 2023-12-05T09:26:22.455 INFO:tasks.workunit.client.1.smithi134.stdout:2/588: chown d19/f5d 3516211 1 2023-12-05T09:26:22.458 INFO:tasks.workunit.client.0.smithi067.stdout:5/412: dread db/df/d1a/f1c [0,4194304] 0 2023-12-05T09:26:22.460 INFO:tasks.workunit.client.1.smithi134.stdout:1/669: creat d2/d9/d10/d30/d66/de3/ff6 x:0 0 0 2023-12-05T09:26:22.465 INFO:tasks.workunit.client.0.smithi067.stdout:5/413: unlink db/df/d38/c7f 0 2023-12-05T09:26:22.465 INFO:tasks.workunit.client.0.smithi067.stdout:5/414: chown db/df/d3f/d88/l72 966527 1 2023-12-05T09:26:22.465 INFO:tasks.workunit.client.0.smithi067.stdout:1/397: dread d2/d5/d7/de/f3a [0,4194304] 0 2023-12-05T09:26:22.469 INFO:tasks.workunit.client.1.smithi134.stdout:3/596: mkdir d4/d1f/d50/db4/dc1 0 2023-12-05T09:26:22.469 INFO:tasks.workunit.client.1.smithi134.stdout:6/511: write d4/d39/f53 [503677,120016] 0 2023-12-05T09:26:22.471 INFO:tasks.workunit.client.0.smithi067.stdout:5/415: getdents db/df/d35/d63 0 2023-12-05T09:26:22.475 INFO:tasks.workunit.client.1.smithi134.stdout:2/589: creat d19/d76/da9/fbd x:0 0 0 2023-12-05T09:26:22.480 INFO:tasks.workunit.client.0.smithi067.stdout:1/398: symlink d2/d5/d7/de/d19/d71/l94 0 2023-12-05T09:26:22.482 INFO:tasks.workunit.client.1.smithi134.stdout:1/670: symlink d2/d9/d10/d30/d66/de3/lf7 0 2023-12-05T09:26:22.483 INFO:tasks.workunit.client.1.smithi134.stdout:1/671: readlink d2/d9/d10/d5b/d5e/l8b 0 2023-12-05T09:26:22.483 INFO:tasks.workunit.client.1.smithi134.stdout:1/672: stat d2/d9/d10/d5b/c62 0 2023-12-05T09:26:22.483 INFO:tasks.workunit.client.1.smithi134.stdout:1/673: chown d2/d27/d71/d80/db8/de1 74 1 2023-12-05T09:26:22.483 INFO:tasks.workunit.client.1.smithi134.stdout:1/674: chown d2/d27/d71/d80/cbf 214 1 2023-12-05T09:26:22.483 INFO:tasks.workunit.client.1.smithi134.stdout:1/675: dread - d2/d9/d10/d30/d66/da9/feb zero size 2023-12-05T09:26:22.483 INFO:tasks.workunit.client.0.smithi067.stdout:1/399: fdatasync d2/d3/f21 0 2023-12-05T09:26:22.483 INFO:tasks.workunit.client.0.smithi067.stdout:5/416: mknod db/df/d1a/d59/c93 0 2023-12-05T09:26:22.484 INFO:tasks.workunit.client.1.smithi134.stdout:5/529: dwrite d0/d11/f89 [0,4194304] 0 2023-12-05T09:26:22.485 INFO:tasks.workunit.client.1.smithi134.stdout:9/533: write d7/d8/d2e/f31 [744009,33765] 0 2023-12-05T09:26:22.485 INFO:tasks.workunit.client.1.smithi134.stdout:9/534: truncate d7/d8/d2e/f76 484144 0 2023-12-05T09:26:22.492 INFO:tasks.workunit.client.1.smithi134.stdout:3/597: mkdir d4/d5/d6f/dc2 0 2023-12-05T09:26:22.493 INFO:tasks.workunit.client.1.smithi134.stdout:6/512: symlink d4/d39/d42/d4f/d6d/l97 0 2023-12-05T09:26:22.499 INFO:tasks.workunit.client.0.smithi067.stdout:1/400: dread d2/d3/f1d [0,4194304] 0 2023-12-05T09:26:22.501 INFO:tasks.workunit.client.1.smithi134.stdout:2/590: mknod d19/d76/db9/cbe 0 2023-12-05T09:26:22.502 INFO:tasks.workunit.client.1.smithi134.stdout:7/533: dwrite d2/d7/f13 [0,4194304] 0 2023-12-05T09:26:22.502 INFO:tasks.workunit.client.1.smithi134.stdout:7/534: stat d2/d7/d2b/d2d/d67/d73/d26/f1c 0 2023-12-05T09:26:22.502 INFO:tasks.workunit.client.1.smithi134.stdout:7/535: write f1 [2666559,116890] 0 2023-12-05T09:26:22.505 INFO:tasks.workunit.client.0.smithi067.stdout:1/401: symlink d2/d5/d7/de/d19/d49/l95 0 2023-12-05T09:26:22.508 INFO:tasks.workunit.client.0.smithi067.stdout:2/300: dwrite d0/f5a [0,4194304] 0 2023-12-05T09:26:22.509 INFO:tasks.workunit.client.0.smithi067.stdout:1/402: creat d2/d3/f96 x:0 0 0 2023-12-05T09:26:22.516 INFO:tasks.workunit.client.1.smithi134.stdout:9/535: mkdir d7/d5b/d5e/daa/db7 0 2023-12-05T09:26:22.516 INFO:tasks.workunit.client.0.smithi067.stdout:2/301: creat d0/d25/d48/f6b x:0 0 0 2023-12-05T09:26:22.518 INFO:tasks.workunit.client.0.smithi067.stdout:5/417: write db/df/d1a/d1d/d20/f2a [2401387,66658] 0 2023-12-05T09:26:22.518 INFO:tasks.workunit.client.0.smithi067.stdout:5/418: readlink db/df/d1a/d59/l5b 0 2023-12-05T09:26:22.519 INFO:tasks.workunit.client.0.smithi067.stdout:9/539: dwrite d1b/d3e/f67 [0,4194304] 0 2023-12-05T09:26:22.519 INFO:tasks.workunit.client.0.smithi067.stdout:2/302: creat d0/d15/d53/f6c x:0 0 0 2023-12-05T09:26:22.519 INFO:tasks.workunit.client.0.smithi067.stdout:2/303: fdatasync d0/d15/d53/d1e/f69 0 2023-12-05T09:26:22.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/591: getdents d19/d28/d31/db3 0 2023-12-05T09:26:22.525 INFO:tasks.workunit.client.1.smithi134.stdout:7/536: chown d2/d7/dc/d2e/l8d 5 1 2023-12-05T09:26:22.525 INFO:tasks.workunit.client.1.smithi134.stdout:7/537: readlink d2/d7/dc/d22/l76 0 2023-12-05T09:26:22.525 INFO:tasks.workunit.client.0.smithi067.stdout:5/419: rename db/df/d1a/c2e to db/df/d36/d57/c94 0 2023-12-05T09:26:22.527 INFO:tasks.workunit.client.0.smithi067.stdout:9/540: symlink d1b/d3e/lb7 0 2023-12-05T09:26:22.532 INFO:tasks.workunit.client.0.smithi067.stdout:5/420: unlink db/df/l19 0 2023-12-05T09:26:22.534 INFO:tasks.workunit.client.0.smithi067.stdout:9/541: symlink d1b/d25/d54/d5c/d6a/d6c/d78/daa/lb8 0 2023-12-05T09:26:22.534 INFO:tasks.workunit.client.0.smithi067.stdout:9/542: chown d1b/d3e/d7f/f95 71 1 2023-12-05T09:26:22.541 INFO:tasks.workunit.client.0.smithi067.stdout:5/421: mknod db/df/d35/d63/c95 0 2023-12-05T09:26:22.541 INFO:tasks.workunit.client.0.smithi067.stdout:5/422: write db/df/d36/d57/f73 [412296,108236] 0 2023-12-05T09:26:22.541 INFO:tasks.workunit.client.0.smithi067.stdout:5/423: chown db/df/d3f/f60 228 1 2023-12-05T09:26:22.541 INFO:tasks.workunit.client.0.smithi067.stdout:5/424: readlink db/df/d3f/d88/d8d/l91 0 2023-12-05T09:26:22.542 INFO:tasks.workunit.client.0.smithi067.stdout:2/304: write d0/d25/d34/f38 [1069684,52595] 0 2023-12-05T09:26:22.542 INFO:tasks.workunit.client.0.smithi067.stdout:2/305: truncate d0/d15/d53/d1e/f2d 2112959 0 2023-12-05T09:26:22.542 INFO:tasks.workunit.client.0.smithi067.stdout:2/306: creat d0/d15/d53/f6d x:0 0 0 2023-12-05T09:26:22.542 INFO:tasks.workunit.client.0.smithi067.stdout:2/307: readlink d0/d25/d34/d4d/l60 0 2023-12-05T09:26:22.542 INFO:tasks.workunit.client.0.smithi067.stdout:2/308: dread - d0/d25/d34/f6a zero size 2023-12-05T09:26:22.546 INFO:tasks.workunit.client.1.smithi134.stdout:8/631: dwrite da/de/d43/f5d [0,4194304] 0 2023-12-05T09:26:22.546 INFO:tasks.workunit.client.1.smithi134.stdout:6/513: dwrite d4/d32/f84 [0,4194304] 0 2023-12-05T09:26:22.547 INFO:tasks.workunit.client.0.smithi067.stdout:9/543: rename d1b/d25/d54/d5c/f61 to d1b/d25/d54/d5c/d6a/d6c/d78/daa/fb9 0 2023-12-05T09:26:22.547 INFO:tasks.workunit.client.1.smithi134.stdout:3/598: dwrite d4/d1f/f25 [0,4194304] 0 2023-12-05T09:26:22.547 INFO:tasks.workunit.client.1.smithi134.stdout:3/599: stat d4/f34 0 2023-12-05T09:26:22.548 INFO:tasks.workunit.client.0.smithi067.stdout:5/425: mknod db/df/d36/d57/c96 0 2023-12-05T09:26:22.549 INFO:tasks.workunit.client.0.smithi067.stdout:0/477: dwrite d3/d7/d3c/f50 [0,4194304] 0 2023-12-05T09:26:22.549 INFO:tasks.workunit.client.0.smithi067.stdout:0/478: fdatasync d3/d7/d3c/f9d 0 2023-12-05T09:26:22.549 INFO:tasks.workunit.client.0.smithi067.stdout:0/479: write d3/d7/d3c/f9d [505059,107654] 0 2023-12-05T09:26:22.550 INFO:tasks.workunit.client.1.smithi134.stdout:1/676: write d2/d27/d40/f87 [1358670,9702] 0 2023-12-05T09:26:22.550 INFO:tasks.workunit.client.1.smithi134.stdout:1/677: chown d2/d9/d10/f47 34654 1 2023-12-05T09:26:22.554 INFO:tasks.workunit.client.0.smithi067.stdout:2/309: creat d0/d15/d63/f6e x:0 0 0 2023-12-05T09:26:22.561 INFO:tasks.workunit.client.1.smithi134.stdout:6/514: write d4/d39/d42/f65 [3041563,22054] 0 2023-12-05T09:26:22.561 INFO:tasks.workunit.client.1.smithi134.stdout:6/515: write d4/d39/d5c/f82 [4413589,51349] 0 2023-12-05T09:26:22.563 INFO:tasks.workunit.client.1.smithi134.stdout:7/538: dread d2/d7/dc/d22/f9f [4194304,4194304] 0 2023-12-05T09:26:22.564 INFO:tasks.workunit.client.1.smithi134.stdout:2/592: mkdir d19/d3f/dbf 0 2023-12-05T09:26:22.564 INFO:tasks.workunit.client.1.smithi134.stdout:2/593: getdents d19/d28/d31/db3 0 2023-12-05T09:26:22.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/600: dread d4/d5/f10 [0,4194304] 0 2023-12-05T09:26:22.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/601: fdatasync d4/d5/f32 0 2023-12-05T09:26:22.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/602: truncate d4/d5/d6f/f71 705701 0 2023-12-05T09:26:22.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/603: readlink d4/d1f/d4e/lc0 0 2023-12-05T09:26:22.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/604: stat d4/d5/d7c 0 2023-12-05T09:26:22.567 INFO:tasks.workunit.client.1.smithi134.stdout:8/632: mknod da/de/d16/d98/cdb 0 2023-12-05T09:26:22.570 INFO:tasks.workunit.client.1.smithi134.stdout:6/516: symlink d4/d39/d42/d4f/d8a/l98 0 2023-12-05T09:26:22.570 INFO:tasks.workunit.client.1.smithi134.stdout:6/517: truncate d4/d39/d42/d4f/d6d/d3a/f8d 256098 0 2023-12-05T09:26:22.574 INFO:tasks.workunit.client.1.smithi134.stdout:2/594: truncate fd 432411 0 2023-12-05T09:26:22.577 INFO:tasks.workunit.client.1.smithi134.stdout:8/633: truncate da/f29 46148 0 2023-12-05T09:26:22.577 INFO:tasks.workunit.client.1.smithi134.stdout:8/634: chown da/de/d16/d2d/c86 160 1 2023-12-05T09:26:22.578 INFO:tasks.workunit.client.1.smithi134.stdout:8/635: stat da/de/d11/d1d/d70/ccb 0 2023-12-05T09:26:22.584 INFO:tasks.workunit.client.1.smithi134.stdout:2/595: mknod d19/d76/db8/cc0 0 2023-12-05T09:26:22.584 INFO:tasks.workunit.client.1.smithi134.stdout:2/596: chown d19/fac 1 1 2023-12-05T09:26:22.584 INFO:tasks.workunit.client.1.smithi134.stdout:2/597: chown d19/f2d 0 1 2023-12-05T09:26:22.587 INFO:tasks.workunit.client.1.smithi134.stdout:6/518: rmdir d4/d39 39 2023-12-05T09:26:22.587 INFO:tasks.workunit.client.1.smithi134.stdout:6/519: stat d4/d39/d5c/f82 0 2023-12-05T09:26:22.591 INFO:tasks.workunit.client.0.smithi067.stdout:0/480: mkdir d3/d6b/dae 0 2023-12-05T09:26:22.600 INFO:tasks.workunit.client.1.smithi134.stdout:2/598: mknod d19/d28/d2b/cc1 0 2023-12-05T09:26:22.600 INFO:tasks.workunit.client.1.smithi134.stdout:2/599: dread - d19/d28/d2b/da3/faf zero size 2023-12-05T09:26:22.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/426: rmdir db/df/d52 39 2023-12-05T09:26:22.602 INFO:tasks.workunit.client.0.smithi067.stdout:0/481: mkdir d3/d7/d3c/d6c/d8a/daf 0 2023-12-05T09:26:22.604 INFO:tasks.workunit.client.1.smithi134.stdout:8/636: getdents da 0 2023-12-05T09:26:22.611 INFO:tasks.workunit.client.0.smithi067.stdout:5/427: mknod db/df/d3f/d88/c97 0 2023-12-05T09:26:22.616 INFO:tasks.workunit.client.1.smithi134.stdout:7/539: dwrite d2/d7/dc/d2e/f8c [0,4194304] 0 2023-12-05T09:26:22.616 INFO:tasks.workunit.client.1.smithi134.stdout:7/540: chown d2/d7/d93/lad 1363201 1 2023-12-05T09:26:22.620 INFO:tasks.workunit.client.1.smithi134.stdout:7/541: rmdir d2/df/d81 39 2023-12-05T09:26:22.620 INFO:tasks.workunit.client.1.smithi134.stdout:7/542: write d2/d7/d2b/d2d/d67/d73/d26/f58 [947950,126458] 0 2023-12-05T09:26:22.624 INFO:tasks.workunit.client.0.smithi067.stdout:9/544: truncate d1b/d3e/f67 575516 0 2023-12-05T09:26:22.624 INFO:tasks.workunit.client.0.smithi067.stdout:9/545: chown d1b/fa2 1852 1 2023-12-05T09:26:22.626 INFO:tasks.workunit.client.0.smithi067.stdout:9/546: rmdir d1b/d25/d54/d5c/d8f 39 2023-12-05T09:26:22.626 INFO:tasks.workunit.client.0.smithi067.stdout:9/547: write d1b/d25/d54/d5c/d6a/f80 [1454263,57019] 0 2023-12-05T09:26:22.628 INFO:tasks.workunit.client.0.smithi067.stdout:9/548: creat d1b/d25/d5b/d62/fba x:0 0 0 2023-12-05T09:26:22.644 INFO:tasks.workunit.client.0.smithi067.stdout:2/310: dwrite d0/d25/d3a/f43 [0,4194304] 0 2023-12-05T09:26:22.644 INFO:tasks.workunit.client.0.smithi067.stdout:2/311: readlink d0/d25/d3f/l62 0 2023-12-05T09:26:22.644 INFO:tasks.workunit.client.1.smithi134.stdout:6/520: truncate d4/d39/d42/f65 311684 0 2023-12-05T09:26:22.647 INFO:tasks.workunit.client.1.smithi134.stdout:6/521: creat d4/d39/d42/d4f/d8a/f99 x:0 0 0 2023-12-05T09:26:22.649 INFO:tasks.workunit.client.1.smithi134.stdout:3/605: dwrite d4/d5/d7c/d92/fa3 [0,4194304] 0 2023-12-05T09:26:22.654 INFO:tasks.workunit.client.0.smithi067.stdout:6/279: sync 2023-12-05T09:26:22.656 INFO:tasks.workunit.client.0.smithi067.stdout:9/549: dread d1b/d25/d54/d5c/d81/d96/f9c [0,4194304] 0 2023-12-05T09:26:22.657 INFO:tasks.workunit.client.0.smithi067.stdout:9/550: write d1b/fa2 [70006,13134] 0 2023-12-05T09:26:22.657 INFO:tasks.workunit.client.0.smithi067.stdout:9/551: creat d1b/d25/d94/fbb x:0 0 0 2023-12-05T09:26:22.667 INFO:tasks.workunit.client.1.smithi134.stdout:2/600: dwrite d19/d28/d63/f67 [0,4194304] 0 2023-12-05T09:26:22.667 INFO:tasks.workunit.client.0.smithi067.stdout:5/428: dwrite db/df/f53 [4194304,4194304] 0 2023-12-05T09:26:22.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/678: dwrite d2/d9/f2c [0,4194304] 0 2023-12-05T09:26:22.671 INFO:tasks.workunit.client.1.smithi134.stdout:6/522: write d4/d39/d42/d4f/d6d/d45/f95 [901284,100733] 0 2023-12-05T09:26:22.686 INFO:tasks.workunit.client.1.smithi134.stdout:2/601: creat d19/d28/d31/d38/db7/fc2 x:0 0 0 2023-12-05T09:26:22.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/429: mknod db/df/d35/c98 0 2023-12-05T09:26:22.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/543: dwrite d2/d7/dc/d2e/f8c [4194304,4194304] 0 2023-12-05T09:26:22.704 INFO:tasks.workunit.client.1.smithi134.stdout:8/637: dwrite da/de/d16/d33/f56 [0,4194304] 0 2023-12-05T09:26:22.725 INFO:tasks.workunit.client.1.smithi134.stdout:6/523: mknod d4/d39/d42/d4f/d6d/d3a/d75/d8f/c9a 0 2023-12-05T09:26:22.726 INFO:tasks.workunit.client.1.smithi134.stdout:2/602: symlink d19/d3f/dbf/lc3 0 2023-12-05T09:26:22.730 INFO:tasks.workunit.client.1.smithi134.stdout:7/544: creat d2/d7/d2b/d2d/fb5 x:0 0 0 2023-12-05T09:26:22.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/679: dwrite d2/f4d [0,4194304] 0 2023-12-05T09:26:22.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/680: write d2/d27/d71/d80/db8/de1/ff5 [460760,11273] 0 2023-12-05T09:26:22.731 INFO:tasks.workunit.client.1.smithi134.stdout:7/545: write d2/dd/fa9 [719270,79896] 0 2023-12-05T09:26:22.731 INFO:tasks.workunit.client.1.smithi134.stdout:7/546: fsync d2/df/d2a/d36/f64 0 2023-12-05T09:26:22.731 INFO:tasks.workunit.client.1.smithi134.stdout:7/547: truncate d2/d7/d2b/d94/fa1 177738 0 2023-12-05T09:26:22.731 INFO:tasks.workunit.client.0.smithi067.stdout:0/482: dwrite d3/df/f52 [0,4194304] 0 2023-12-05T09:26:22.732 INFO:tasks.workunit.client.1.smithi134.stdout:8/638: link da/de/d43/fa3 da/de/d16/d98/fdc 0 2023-12-05T09:26:22.732 INFO:tasks.workunit.client.1.smithi134.stdout:8/639: write da/de/d8a/fb3 [629323,125781] 0 2023-12-05T09:26:22.732 INFO:tasks.workunit.client.0.smithi067.stdout:2/312: dwrite d0/d15/d53/f6c [0,4194304] 0 2023-12-05T09:26:22.744 INFO:tasks.workunit.client.1.smithi134.stdout:6/524: creat d4/d78/d7a/f9b x:0 0 0 2023-12-05T09:26:22.744 INFO:tasks.workunit.client.1.smithi134.stdout:8/640: mknod da/de/d11/d1d/d70/cdd 0 2023-12-05T09:26:22.744 INFO:tasks.workunit.client.1.smithi134.stdout:7/548: unlink d2/d7/d2b/d2d/d67/d73/d26/f1c 0 2023-12-05T09:26:22.744 INFO:tasks.workunit.client.1.smithi134.stdout:6/525: stat d4/d32/d57/f5d 0 2023-12-05T09:26:22.745 INFO:tasks.workunit.client.0.smithi067.stdout:9/552: dwrite d1b/d25/d54/d5c/f98 [0,4194304] 0 2023-12-05T09:26:22.756 INFO:tasks.workunit.client.1.smithi134.stdout:3/606: dwrite d4/d1f/f33 [0,4194304] 0 2023-12-05T09:26:22.760 INFO:tasks.workunit.client.1.smithi134.stdout:7/549: rename d2/df/d2a/d36/f64 to d2/dd/fb6 0 2023-12-05T09:26:22.764 INFO:tasks.workunit.client.1.smithi134.stdout:8/641: dread da/de/d16/d2d/f88 [0,4194304] 0 2023-12-05T09:26:22.766 INFO:tasks.workunit.client.0.smithi067.stdout:0/483: rmdir d3/d7/d3c/d66 39 2023-12-05T09:26:22.767 INFO:tasks.workunit.client.0.smithi067.stdout:0/484: write d3/f35 [1184242,19216] 0 2023-12-05T09:26:22.771 INFO:tasks.workunit.client.1.smithi134.stdout:8/642: mknod da/de/d8a/d42/d99/cde 0 2023-12-05T09:26:22.773 INFO:tasks.workunit.client.1.smithi134.stdout:5/530: sync 2023-12-05T09:26:22.773 INFO:tasks.workunit.client.1.smithi134.stdout:9/536: sync 2023-12-05T09:26:22.775 INFO:tasks.workunit.client.0.smithi067.stdout:0/485: rename d3/df/f36 to d3/da2/fb0 0 2023-12-05T09:26:22.777 INFO:tasks.workunit.client.1.smithi134.stdout:4/567: sync 2023-12-05T09:26:22.777 INFO:tasks.workunit.client.1.smithi134.stdout:0/520: sync 2023-12-05T09:26:22.777 INFO:tasks.workunit.client.1.smithi134.stdout:0/521: write d13/d14/d30/d4b/d23/f60 [602794,70344] 0 2023-12-05T09:26:22.777 INFO:tasks.workunit.client.1.smithi134.stdout:0/522: chown d13/d14/d30/d2c/d9d 0 1 2023-12-05T09:26:22.777 INFO:tasks.workunit.client.1.smithi134.stdout:0/523: readlink d13/l2b 0 2023-12-05T09:26:22.778 INFO:tasks.workunit.client.1.smithi134.stdout:7/550: rename d2/d7/dc/d2e/c59 to d2/d8f/cb7 0 2023-12-05T09:26:22.778 INFO:tasks.workunit.client.1.smithi134.stdout:8/643: mkdir da/de/d11/d1d/db8/ddf 0 2023-12-05T09:26:22.780 INFO:tasks.workunit.client.0.smithi067.stdout:0/486: write d3/df/f3f [913427,127006] 0 2023-12-05T09:26:22.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/531: creat d0/d1a/d1c/d3f/fb7 x:0 0 0 2023-12-05T09:26:22.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/532: stat d0/d1a/d1c/d3f/d5b/d5d/d78/d7b 0 2023-12-05T09:26:22.784 INFO:tasks.workunit.client.0.smithi067.stdout:5/430: dwrite db/f14 [0,4194304] 0 2023-12-05T09:26:22.785 INFO:tasks.workunit.client.1.smithi134.stdout:4/568: rename d16/d21/d69/d6e/db9 to d16/d18/dc5 0 2023-12-05T09:26:22.787 INFO:tasks.workunit.client.1.smithi134.stdout:3/607: dread d4/d5/f1e [0,4194304] 0 2023-12-05T09:26:22.787 INFO:tasks.workunit.client.1.smithi134.stdout:3/608: chown d4/d5/d45/d60/d85/dab/lac 1 1 2023-12-05T09:26:22.787 INFO:tasks.workunit.client.1.smithi134.stdout:7/551: mknod d2/d7/d2b/d2d/cb8 0 2023-12-05T09:26:22.787 INFO:tasks.workunit.client.1.smithi134.stdout:7/552: write d2/d7/dc/d2e/d3a/f4e [3275917,48190] 0 2023-12-05T09:26:22.791 INFO:tasks.workunit.client.0.smithi067.stdout:5/431: rmdir db/df/d36/d57 39 2023-12-05T09:26:22.794 INFO:tasks.workunit.client.0.smithi067.stdout:0/487: getdents d3/d6b 0 2023-12-05T09:26:22.794 INFO:tasks.workunit.client.0.smithi067.stdout:0/488: stat d3/df/d10/f37 0 2023-12-05T09:26:22.796 INFO:tasks.workunit.client.1.smithi134.stdout:3/609: mkdir d4/d5/d45/d86/db5/dc3 0 2023-12-05T09:26:22.796 INFO:tasks.workunit.client.1.smithi134.stdout:3/610: write d4/d1f/d50/d52/f58 [3948427,63521] 0 2023-12-05T09:26:22.796 INFO:tasks.workunit.client.1.smithi134.stdout:3/611: write d4/d5/d45/d60/f66 [1723563,113523] 0 2023-12-05T09:26:22.796 INFO:tasks.workunit.client.1.smithi134.stdout:2/603: dwrite d19/f5d [0,4194304] 0 2023-12-05T09:26:22.797 INFO:tasks.workunit.client.0.smithi067.stdout:5/432: mknod db/df/d3f/c99 0 2023-12-05T09:26:22.797 INFO:tasks.workunit.client.1.smithi134.stdout:0/524: read d13/d14/d30/d4b/d23/f65 [6672148,4297] 0 2023-12-05T09:26:22.797 INFO:tasks.workunit.client.1.smithi134.stdout:7/553: getdents d2/d7/d2b 0 2023-12-05T09:26:22.798 INFO:tasks.workunit.client.1.smithi134.stdout:7/554: chown d2/d7/d2b/d2d/d67/d73/c86 467180218 1 2023-12-05T09:26:22.799 INFO:tasks.workunit.client.1.smithi134.stdout:9/537: dread f3 [4194304,4194304] 0 2023-12-05T09:26:22.799 INFO:tasks.workunit.client.0.smithi067.stdout:0/489: mknod d3/d7/d3c/d6c/d76/da7/cb1 0 2023-12-05T09:26:22.799 INFO:tasks.workunit.client.0.smithi067.stdout:0/490: stat d3/d7/f8f 0 2023-12-05T09:26:22.802 INFO:tasks.workunit.client.1.smithi134.stdout:4/569: getdents d16/d21/d69/d6e/daa/d3b/d8e 0 2023-12-05T09:26:22.806 INFO:tasks.workunit.client.0.smithi067.stdout:0/491: chown d3/df/f21 1884674 1 2023-12-05T09:26:22.806 INFO:tasks.workunit.client.0.smithi067.stdout:0/492: truncate d3/d7/d3c/d66/fa9 260025 0 2023-12-05T09:26:22.806 INFO:tasks.workunit.client.0.smithi067.stdout:6/280: dwrite da/d10/d1e/d17/d2f/f2b [4194304,4194304] 0 2023-12-05T09:26:22.808 INFO:tasks.workunit.client.1.smithi134.stdout:0/525: link d13/d14/d30/d4b/c54 d13/cb4 0 2023-12-05T09:26:22.808 INFO:tasks.workunit.client.1.smithi134.stdout:6/526: dread d4/d39/d42/f7e [0,4194304] 0 2023-12-05T09:26:22.808 INFO:tasks.workunit.client.1.smithi134.stdout:9/538: creat d7/d8/d14/d26/d5a/d69/fb8 x:0 0 0 2023-12-05T09:26:22.809 INFO:tasks.workunit.client.0.smithi067.stdout:6/281: rename da/d10/d1e/d17/d2f/l20 to da/d10/d1e/d17/d2f/l60 0 2023-12-05T09:26:22.809 INFO:tasks.workunit.client.0.smithi067.stdout:6/282: fdatasync da/d10/d1e/d17/f23 0 2023-12-05T09:26:22.810 INFO:tasks.workunit.client.1.smithi134.stdout:9/539: creat d7/d5b/d5e/daa/db7/fb9 x:0 0 0 2023-12-05T09:26:22.810 INFO:tasks.workunit.client.1.smithi134.stdout:9/540: stat d7/d5b/d5e/daa/fb1 0 2023-12-05T09:26:22.818 INFO:tasks.workunit.client.0.smithi067.stdout:6/283: mknod da/d10/d1e/d17/d2f/d2c/d34/d3b/c61 0 2023-12-05T09:26:22.818 INFO:tasks.workunit.client.1.smithi134.stdout:5/533: dread d0/f46 [0,4194304] 0 2023-12-05T09:26:22.818 INFO:tasks.workunit.client.1.smithi134.stdout:1/681: dwrite d2/d27/d40/f84 [0,4194304] 0 2023-12-05T09:26:22.819 INFO:tasks.workunit.client.1.smithi134.stdout:9/541: mknod d7/d8/d14/d26/d7f/d92/d53/d7b/d8f/d8a/cba 0 2023-12-05T09:26:22.827 INFO:tasks.workunit.client.1.smithi134.stdout:5/534: rename d0/d1a/d1c/d25/c96 to d0/d1a/d1c/cb8 0 2023-12-05T09:26:22.827 INFO:tasks.workunit.client.1.smithi134.stdout:5/535: chown d0/dd/f32 1 1 2023-12-05T09:26:22.835 INFO:tasks.workunit.client.1.smithi134.stdout:7/555: dread d2/d7/dc/d22/f85 [0,4194304] 0 2023-12-05T09:26:22.836 INFO:tasks.workunit.client.1.smithi134.stdout:5/536: mknod d0/d1a/d1c/cb9 0 2023-12-05T09:26:22.839 INFO:tasks.workunit.client.0.smithi067.stdout:6/284: mknod da/d10/d1e/d17/d2f/d1f/d27/c62 0 2023-12-05T09:26:22.840 INFO:tasks.workunit.client.1.smithi134.stdout:9/542: rename d7/d8/d16/c21 to d7/d10/cbb 0 2023-12-05T09:26:22.841 INFO:tasks.workunit.client.1.smithi134.stdout:9/543: creat d7/d8/fbc x:0 0 0 2023-12-05T09:26:22.846 INFO:tasks.workunit.client.0.smithi067.stdout:2/313: dwrite d0/d15/d53/d1e/f2d [0,4194304] 0 2023-12-05T09:26:22.847 INFO:tasks.workunit.client.0.smithi067.stdout:2/314: readlink d0/lb 0 2023-12-05T09:26:22.849 INFO:tasks.workunit.client.1.smithi134.stdout:5/537: creat d0/d1a/d1c/d3f/d5b/fba x:0 0 0 2023-12-05T09:26:22.851 INFO:tasks.workunit.client.1.smithi134.stdout:8/644: dread da/de/f4c [0,4194304] 0 2023-12-05T09:26:22.851 INFO:tasks.workunit.client.1.smithi134.stdout:8/645: write da/de/d16/d98/fb4 [580810,11019] 0 2023-12-05T09:26:22.853 INFO:tasks.workunit.client.1.smithi134.stdout:1/682: write d2/d9/f1b [9439186,53117] 0 2023-12-05T09:26:22.853 INFO:tasks.workunit.client.1.smithi134.stdout:1/683: creat d2/d27/d40/ff8 x:0 0 0 2023-12-05T09:26:22.854 INFO:tasks.workunit.client.1.smithi134.stdout:1/684: read - d2/fd1 zero size 2023-12-05T09:26:22.856 INFO:tasks.workunit.client.1.smithi134.stdout:9/544: creat d7/d8/d14/d26/fbd x:0 0 0 2023-12-05T09:26:22.860 INFO:tasks.workunit.client.1.smithi134.stdout:5/538: symlink d0/d1a/d1c/d25/d4d/d97/lbb 0 2023-12-05T09:26:22.860 INFO:tasks.workunit.client.1.smithi134.stdout:5/539: fsync d0/d1a/d1c/f23 0 2023-12-05T09:26:22.860 INFO:tasks.workunit.client.1.smithi134.stdout:5/540: read - d0/d1a/d1c/d3f/d5b/d5d/f69 zero size 2023-12-05T09:26:22.860 INFO:tasks.workunit.client.1.smithi134.stdout:1/685: unlink d2/d27/d9d/ce2 0 2023-12-05T09:26:22.863 INFO:tasks.workunit.client.0.smithi067.stdout:2/315: creat d0/d2f/d39/f6f x:0 0 0 2023-12-05T09:26:22.863 INFO:tasks.workunit.client.0.smithi067.stdout:2/316: truncate d0/d25/f4e 941248 0 2023-12-05T09:26:22.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/317: symlink d0/d2f/d39/l70 0 2023-12-05T09:26:22.865 INFO:tasks.workunit.client.1.smithi134.stdout:9/545: dread d7/d8/d14/d26/f3e [0,4194304] 0 2023-12-05T09:26:22.869 INFO:tasks.workunit.client.1.smithi134.stdout:0/526: dwrite d13/d14/d59/f82 [0,4194304] 0 2023-12-05T09:26:22.871 INFO:tasks.workunit.client.0.smithi067.stdout:2/318: rename d0/d2f/l4c to d0/d15/d53/l71 0 2023-12-05T09:26:22.871 INFO:tasks.workunit.client.0.smithi067.stdout:2/319: stat d0/d2f 0 2023-12-05T09:26:22.871 INFO:tasks.workunit.client.0.smithi067.stdout:2/320: chown d0/d15/d53 1 1 2023-12-05T09:26:22.871 INFO:tasks.workunit.client.0.smithi067.stdout:2/321: read - d0/d15/d53/f6d zero size 2023-12-05T09:26:22.872 INFO:tasks.workunit.client.1.smithi134.stdout:9/546: getdents d7 0 2023-12-05T09:26:22.872 INFO:tasks.workunit.client.1.smithi134.stdout:9/547: write d7/d8/d16/d52/f8b [983840,22671] 0 2023-12-05T09:26:22.874 INFO:tasks.workunit.client.0.smithi067.stdout:2/322: unlink d0/d25/d34/d4d/l64 0 2023-12-05T09:26:22.877 INFO:tasks.workunit.client.0.smithi067.stdout:6/285: dread da/d10/d1e/d17/f29 [4194304,4194304] 0 2023-12-05T09:26:22.877 INFO:tasks.workunit.client.0.smithi067.stdout:6/286: dread - da/d10/f5e zero size 2023-12-05T09:26:22.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/527: mknod d13/d14/d30/d4b/d66/da0/daf/cb5 0 2023-12-05T09:26:22.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/528: fdatasync d13/d14/f4f 0 2023-12-05T09:26:22.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/529: getdents d13/d14/d30/d2c/d9d/da5 0 2023-12-05T09:26:22.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/530: chown d13/d14/d30/d4b/d23/d77/f90 399568 1 2023-12-05T09:26:22.878 INFO:tasks.workunit.client.1.smithi134.stdout:9/548: symlink d7/d10/lbe 0 2023-12-05T09:26:22.880 INFO:tasks.workunit.client.1.smithi134.stdout:3/612: dwrite d4/d1f/f3a [0,4194304] 0 2023-12-05T09:26:22.881 INFO:tasks.workunit.client.0.smithi067.stdout:5/433: dwrite db/f14 [8388608,4194304] 0 2023-12-05T09:26:22.881 INFO:tasks.workunit.client.0.smithi067.stdout:5/434: creat db/df/d38/f9a x:0 0 0 2023-12-05T09:26:22.881 INFO:tasks.workunit.client.1.smithi134.stdout:2/604: dwrite d19/d28/f41 [0,4194304] 0 2023-12-05T09:26:22.882 INFO:tasks.workunit.client.1.smithi134.stdout:2/605: chown d19/d3f/c83 1650713962 1 2023-12-05T09:26:22.882 INFO:tasks.workunit.client.0.smithi067.stdout:0/493: dwrite d3/df/f3f [0,4194304] 0 2023-12-05T09:26:22.884 INFO:tasks.workunit.client.0.smithi067.stdout:6/287: mkdir da/d10/d1e/d17/d2f/d1f/d27/d63 0 2023-12-05T09:26:22.884 INFO:tasks.workunit.client.1.smithi134.stdout:9/549: rename d7/d10/c44 to d7/d8/d16/d52/d74/d97/d99/cbf 0 2023-12-05T09:26:22.884 INFO:tasks.workunit.client.0.smithi067.stdout:6/288: chown da/d10/d1e/d51 7631322 1 2023-12-05T09:26:22.885 INFO:tasks.workunit.client.1.smithi134.stdout:8/646: write da/de/d11/d1d/d5f/fc3 [382376,104373] 0 2023-12-05T09:26:22.886 INFO:tasks.workunit.client.1.smithi134.stdout:4/570: dwrite d16/d18/f92 [0,4194304] 0 2023-12-05T09:26:22.888 INFO:tasks.workunit.client.1.smithi134.stdout:3/613: dread d4/d1f/d50/d52/f88 [0,4194304] 0 2023-12-05T09:26:22.889 INFO:tasks.workunit.client.1.smithi134.stdout:3/614: chown d4/d1f/d50/db1 739261244 1 2023-12-05T09:26:22.890 INFO:tasks.workunit.client.1.smithi134.stdout:5/541: dread d0/d1a/d1c/d3f/d81/d8a/f93 [0,4194304] 0 2023-12-05T09:26:22.892 INFO:tasks.workunit.client.0.smithi067.stdout:0/494: rmdir d3/d7/d3c/d67/d59/d5c 39 2023-12-05T09:26:22.895 INFO:tasks.workunit.client.0.smithi067.stdout:6/289: creat da/d10/d1e/d17/d2f/d3f/f64 x:0 0 0 2023-12-05T09:26:22.896 INFO:tasks.workunit.client.1.smithi134.stdout:2/606: mknod d19/d28/d31/cc4 0 2023-12-05T09:26:22.897 INFO:tasks.workunit.client.1.smithi134.stdout:2/607: chown d19/d3f/c8b 89 1 2023-12-05T09:26:22.897 INFO:tasks.workunit.client.1.smithi134.stdout:2/608: creat d19/d49/fc5 x:0 0 0 2023-12-05T09:26:22.897 INFO:tasks.workunit.client.0.smithi067.stdout:6/290: creat da/d10/d1e/d51/f65 x:0 0 0 2023-12-05T09:26:22.897 INFO:tasks.workunit.client.0.smithi067.stdout:6/291: dread - da/d10/d1e/d17/d2f/d47/f4d zero size 2023-12-05T09:26:22.901 INFO:tasks.workunit.client.0.smithi067.stdout:2/323: write d0/d15/d53/f6c [3781121,115770] 0 2023-12-05T09:26:22.901 INFO:tasks.workunit.client.1.smithi134.stdout:9/550: symlink d7/d8/d2e/lc0 0 2023-12-05T09:26:22.901 INFO:tasks.workunit.client.1.smithi134.stdout:9/551: chown f3 326 1 2023-12-05T09:26:22.902 INFO:tasks.workunit.client.1.smithi134.stdout:7/556: dwrite d2/d7/dc/d22/f4a [0,4194304] 0 2023-12-05T09:26:22.902 INFO:tasks.workunit.client.1.smithi134.stdout:7/557: dread - d2/d7/d2b/d2d/fb5 zero size 2023-12-05T09:26:22.903 INFO:tasks.workunit.client.0.smithi067.stdout:6/292: creat da/d10/d1e/d17/d2f/d2c/d34/d3b/d56/f66 x:0 0 0 2023-12-05T09:26:22.904 INFO:tasks.workunit.client.0.smithi067.stdout:0/495: dread d3/d7/d3c/d6c/d76/f82 [0,4194304] 0 2023-12-05T09:26:22.907 INFO:tasks.workunit.client.1.smithi134.stdout:8/647: creat da/de/d11/d8b/d8c/fe0 x:0 0 0 2023-12-05T09:26:22.907 INFO:tasks.workunit.client.1.smithi134.stdout:8/648: truncate da/de/d8a/d42/d99/fb6 1310149 0 2023-12-05T09:26:22.907 INFO:tasks.workunit.client.1.smithi134.stdout:1/686: dwrite d2/d9/f2d [0,4194304] 0 2023-12-05T09:26:22.908 INFO:tasks.workunit.client.0.smithi067.stdout:5/435: dread db/df/f15 [0,4194304] 0 2023-12-05T09:26:22.908 INFO:tasks.workunit.client.0.smithi067.stdout:2/324: mkdir d0/d25/d34/d4d/d72 0 2023-12-05T09:26:22.910 INFO:tasks.workunit.client.1.smithi134.stdout:4/571: mknod d16/d18/dc5/cc6 0 2023-12-05T09:26:22.913 INFO:tasks.workunit.client.0.smithi067.stdout:6/293: rename da/d10/d1e/d17/d2f/d1f/d27/d63 to da/d10/d1e/d67 0 2023-12-05T09:26:22.916 INFO:tasks.workunit.client.1.smithi134.stdout:1/687: dread d2/d9/d10/d30/f64 [0,4194304] 0 2023-12-05T09:26:22.925 INFO:tasks.workunit.client.0.smithi067.stdout:0/496: write d3/d7/d3c/d67/d59/d4e/f83 [794642,42728] 0 2023-12-05T09:26:22.930 INFO:tasks.workunit.client.0.smithi067.stdout:5/436: symlink db/df/d3f/l9b 0 2023-12-05T09:26:22.932 INFO:tasks.workunit.client.1.smithi134.stdout:0/531: rmdir d13 39 2023-12-05T09:26:22.935 INFO:tasks.workunit.client.0.smithi067.stdout:0/497: mkdir d3/d7/d3c/d67/d59/d4e/db2 0 2023-12-05T09:26:22.935 INFO:tasks.workunit.client.0.smithi067.stdout:0/498: truncate d3/d7/fc 5171418 0 2023-12-05T09:26:22.937 INFO:tasks.workunit.client.1.smithi134.stdout:8/649: write da/de/d43/fa3 [642769,61422] 0 2023-12-05T09:26:22.937 INFO:tasks.workunit.client.0.smithi067.stdout:5/437: creat db/df/d36/d57/f9c x:0 0 0 2023-12-05T09:26:22.940 INFO:tasks.workunit.client.0.smithi067.stdout:0/499: symlink d3/d7/d3c/d6c/d8a/lb3 0 2023-12-05T09:26:22.946 INFO:tasks.workunit.client.1.smithi134.stdout:3/615: dwrite d4/d5/f95 [0,4194304] 0 2023-12-05T09:26:22.946 INFO:tasks.workunit.client.1.smithi134.stdout:3/616: dread - d4/d1f/d50/f69 zero size 2023-12-05T09:26:22.946 INFO:tasks.workunit.client.1.smithi134.stdout:3/617: write d4/d1f/d4e/f61 [5224902,55508] 0 2023-12-05T09:26:22.948 INFO:tasks.workunit.client.0.smithi067.stdout:4/339: sync 2023-12-05T09:26:22.948 INFO:tasks.workunit.client.0.smithi067.stdout:8/347: sync 2023-12-05T09:26:22.948 INFO:tasks.workunit.client.0.smithi067.stdout:8/348: readlink d5/dc/d1a/d20/d3e/l5c 0 2023-12-05T09:26:22.948 INFO:tasks.workunit.client.0.smithi067.stdout:8/349: readlink d5/da/d30/l38 0 2023-12-05T09:26:22.950 INFO:tasks.workunit.client.0.smithi067.stdout:3/320: sync 2023-12-05T09:26:22.950 INFO:tasks.workunit.client.0.smithi067.stdout:3/321: write d9/d20/f5c [661235,127985] 0 2023-12-05T09:26:22.950 INFO:tasks.workunit.client.0.smithi067.stdout:3/322: dread - d9/da/f6c zero size 2023-12-05T09:26:22.950 INFO:tasks.workunit.client.0.smithi067.stdout:7/386: sync 2023-12-05T09:26:22.950 INFO:tasks.workunit.client.0.smithi067.stdout:7/387: readlink d0/d9/d10/d37/l33 0 2023-12-05T09:26:22.950 INFO:tasks.workunit.client.0.smithi067.stdout:1/403: sync 2023-12-05T09:26:22.958 INFO:tasks.workunit.client.1.smithi134.stdout:0/532: dread d13/d14/d30/d4b/f4e [0,4194304] 0 2023-12-05T09:26:22.960 INFO:tasks.workunit.client.1.smithi134.stdout:5/542: mknod d0/d1a/d1c/d25/d6a/cbc 0 2023-12-05T09:26:22.960 INFO:tasks.workunit.client.1.smithi134.stdout:5/543: read d0/d11/d61/d75/f79 [61812,86486] 0 2023-12-05T09:26:22.962 INFO:tasks.workunit.client.0.smithi067.stdout:8/350: mkdir d5/da/d30/d61 0 2023-12-05T09:26:22.962 INFO:tasks.workunit.client.0.smithi067.stdout:8/351: write d5/dc/d1a/d20/f4e [173897,45522] 0 2023-12-05T09:26:22.962 INFO:tasks.workunit.client.0.smithi067.stdout:3/323: rmdir d9/da/d15/d17/d1a/d51/d66 39 2023-12-05T09:26:22.963 INFO:tasks.workunit.client.1.smithi134.stdout:8/650: dread da/de/d8a/d42/d99/dc8/d3b/f65 [0,4194304] 0 2023-12-05T09:26:22.966 INFO:tasks.workunit.client.0.smithi067.stdout:7/388: link d0/d9/l3c d0/d9/d10/d37/d38/d64/d54/l81 0 2023-12-05T09:26:22.967 INFO:tasks.workunit.client.1.smithi134.stdout:2/609: link f18 d19/fc6 0 2023-12-05T09:26:22.967 INFO:tasks.workunit.client.1.smithi134.stdout:9/552: rmdir d7/d8/d14/d26/d7f 39 2023-12-05T09:26:22.969 INFO:tasks.workunit.client.1.smithi134.stdout:1/688: getdents d2/d27/d71/d80 0 2023-12-05T09:26:22.970 INFO:tasks.workunit.client.1.smithi134.stdout:1/689: chown d2/d27/f54 416312 1 2023-12-05T09:26:22.970 INFO:tasks.workunit.client.1.smithi134.stdout:1/690: chown d2/d27/db4/fdc 15 1 2023-12-05T09:26:22.974 INFO:tasks.workunit.client.0.smithi067.stdout:6/294: dwrite da/d10/d1e/f4b [0,4194304] 0 2023-12-05T09:26:22.975 INFO:tasks.workunit.client.1.smithi134.stdout:3/618: symlink d4/d1f/d50/db4/lc4 0 2023-12-05T09:26:22.975 INFO:tasks.workunit.client.1.smithi134.stdout:0/533: mkdir d13/d14/d15/d2a/d8c/db6 0 2023-12-05T09:26:22.975 INFO:tasks.workunit.client.1.smithi134.stdout:9/553: link d7/d8/l34 d7/d8/d16/d52/d74/d97/d99/lc1 0 2023-12-05T09:26:22.976 INFO:tasks.workunit.client.1.smithi134.stdout:1/691: mkdir d2/d27/db4/df9 0 2023-12-05T09:26:22.981 INFO:tasks.workunit.client.1.smithi134.stdout:3/619: getdents d4/d1f/d50 0 2023-12-05T09:26:22.983 INFO:tasks.workunit.client.1.smithi134.stdout:0/534: rename d13/d14/d15/l6a to d13/d14/d30/d2c/da9/lb7 0 2023-12-05T09:26:22.986 INFO:tasks.workunit.client.1.smithi134.stdout:9/554: symlink d7/d8/d16/d52/lc2 0 2023-12-05T09:26:22.988 INFO:tasks.workunit.client.1.smithi134.stdout:5/544: write d0/d66/fb1 [3155420,90398] 0 2023-12-05T09:26:22.989 INFO:tasks.workunit.client.1.smithi134.stdout:8/651: dread da/de/d43/fae [0,4194304] 0 2023-12-05T09:26:22.989 INFO:tasks.workunit.client.1.smithi134.stdout:8/652: chown da/de/f7a 4893 1 2023-12-05T09:26:22.989 INFO:tasks.workunit.client.1.smithi134.stdout:7/558: dwrite d2/df/f79 [0,4194304] 0 2023-12-05T09:26:22.990 INFO:tasks.workunit.client.1.smithi134.stdout:1/692: rmdir d2/d9/d10/d30/d4a/d81 39 2023-12-05T09:26:22.991 INFO:tasks.workunit.client.1.smithi134.stdout:1/693: write d2/d27/d71/d80/db8/fd3 [1090939,98320] 0 2023-12-05T09:26:22.991 INFO:tasks.workunit.client.1.smithi134.stdout:1/694: chown d2/d9/c23 1 1 2023-12-05T09:26:22.993 INFO:tasks.workunit.client.0.smithi067.stdout:6/295: link da/d10/d1e/d17/d2f/d2c/d34/d3b/d56/l57 da/d10/d1e/d17/d2f/d59/l68 0 2023-12-05T09:26:22.994 INFO:tasks.workunit.client.1.smithi134.stdout:4/572: dwrite d16/d21/d69/d6e/daa/f79 [0,4194304] 0 2023-12-05T09:26:22.994 INFO:tasks.workunit.client.1.smithi134.stdout:9/555: truncate d7/d5b/d5e/f8c 606642 0 2023-12-05T09:26:23.003 INFO:tasks.workunit.client.1.smithi134.stdout:5/545: link d0/d1a/d3a/c59 d0/dd/d37/d7d/cbd 0 2023-12-05T09:26:23.003 INFO:tasks.workunit.client.1.smithi134.stdout:5/546: chown d0/d1a/d1c/d3f/d5b/l88 14 1 2023-12-05T09:26:23.004 INFO:tasks.workunit.client.0.smithi067.stdout:6/296: mkdir da/d10/d1e/d69 0 2023-12-05T09:26:23.004 INFO:tasks.workunit.client.0.smithi067.stdout:6/297: stat da/d10/d1e/d17/d2f/d2c/d34 0 2023-12-05T09:26:23.008 INFO:tasks.workunit.client.0.smithi067.stdout:7/389: dread d0/d9/d10/f32 [4194304,4194304] 0 2023-12-05T09:26:23.008 INFO:tasks.workunit.client.1.smithi134.stdout:8/653: creat da/de/d11/d1d/d5f/d9b/fe1 x:0 0 0 2023-12-05T09:26:23.011 INFO:tasks.workunit.client.0.smithi067.stdout:6/298: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a x:0 0 0 2023-12-05T09:26:23.012 INFO:tasks.workunit.client.1.smithi134.stdout:7/559: mkdir d2/d7/d6f/db9 0 2023-12-05T09:26:23.015 INFO:tasks.workunit.client.0.smithi067.stdout:6/299: mknod da/d10/d1e/d17/d2f/d2c/d34/c6b 0 2023-12-05T09:26:23.015 INFO:tasks.workunit.client.0.smithi067.stdout:6/300: fsync da/d10/d1e/f36 0 2023-12-05T09:26:23.018 INFO:tasks.workunit.client.0.smithi067.stdout:6/301: truncate da/d10/d1e/d17/d2f/f2b 459992 0 2023-12-05T09:26:23.023 INFO:tasks.workunit.client.0.smithi067.stdout:6/302: mkdir da/d10/d1e/d17/d2f/d59/d6c 0 2023-12-05T09:26:23.026 INFO:tasks.workunit.client.1.smithi134.stdout:5/547: write d0/d45/f57 [490341,124241] 0 2023-12-05T09:26:23.027 INFO:tasks.workunit.client.1.smithi134.stdout:5/548: dread - d0/d1a/d1c/d3f/fb7 zero size 2023-12-05T09:26:23.027 INFO:tasks.workunit.client.1.smithi134.stdout:5/549: truncate d0/dd/faa 451519 0 2023-12-05T09:26:23.027 INFO:tasks.workunit.client.0.smithi067.stdout:6/303: rmdir da/d10/d1e/d67 0 2023-12-05T09:26:23.029 INFO:tasks.workunit.client.0.smithi067.stdout:1/404: dwrite d2/d4f/d14/f42 [0,4194304] 0 2023-12-05T09:26:23.029 INFO:tasks.workunit.client.1.smithi134.stdout:8/654: write da/de/d4d/f91 [1357415,37546] 0 2023-12-05T09:26:23.030 INFO:tasks.workunit.client.1.smithi134.stdout:3/620: dwrite d4/d5/d45/d60/d85/d96/fa4 [0,4194304] 0 2023-12-05T09:26:23.030 INFO:tasks.workunit.client.1.smithi134.stdout:3/621: write d4/d1f/d4e/d6a/fbf [384392,15123] 0 2023-12-05T09:26:23.032 INFO:tasks.workunit.client.0.smithi067.stdout:6/304: mkdir da/d6d 0 2023-12-05T09:26:23.032 INFO:tasks.workunit.client.0.smithi067.stdout:6/305: dread - da/d10/d1e/d17/d2f/d47/f4d zero size 2023-12-05T09:26:23.032 INFO:tasks.workunit.client.0.smithi067.stdout:5/438: dwrite db/df/d38/f85 [0,4194304] 0 2023-12-05T09:26:23.032 INFO:tasks.workunit.client.0.smithi067.stdout:2/325: dwrite d0/d15/d53/f19 [0,4194304] 0 2023-12-05T09:26:23.032 INFO:tasks.workunit.client.0.smithi067.stdout:2/326: dread - d0/d15/d63/f6e zero size 2023-12-05T09:26:23.032 INFO:tasks.workunit.client.0.smithi067.stdout:2/327: fsync d0/d25/f59 0 2023-12-05T09:26:23.037 INFO:tasks.workunit.client.1.smithi134.stdout:4/573: symlink d16/d18/dc5/lc7 0 2023-12-05T09:26:23.038 INFO:tasks.workunit.client.1.smithi134.stdout:4/574: chown d16/d21/d69/d6e/daa/d3b/d8e/fbb 37450323 1 2023-12-05T09:26:23.041 INFO:tasks.workunit.client.1.smithi134.stdout:9/556: symlink d7/d5b/d5e/lc3 0 2023-12-05T09:26:23.045 INFO:tasks.workunit.client.1.smithi134.stdout:7/560: mknod d2/d7/d6f/da0/cba 0 2023-12-05T09:26:23.047 INFO:tasks.workunit.client.1.smithi134.stdout:5/550: getdents d0/d11/d61 0 2023-12-05T09:26:23.054 INFO:tasks.workunit.client.1.smithi134.stdout:8/655: symlink da/de/d96/d9d/le2 0 2023-12-05T09:26:23.054 INFO:tasks.workunit.client.1.smithi134.stdout:8/656: chown da/de/d16/d2d/f88 26160 1 2023-12-05T09:26:23.054 INFO:tasks.workunit.client.1.smithi134.stdout:8/657: truncate da/de/d16/d2d/f5e 2328071 0 2023-12-05T09:26:23.057 INFO:tasks.workunit.client.0.smithi067.stdout:6/306: creat da/d10/d1e/d17/d2f/d2c/f6e x:0 0 0 2023-12-05T09:26:23.057 INFO:tasks.workunit.client.0.smithi067.stdout:6/307: rename da/d10/d1e/d17 to da/d10/d1e/d17/d6f 22 2023-12-05T09:26:23.064 INFO:tasks.workunit.client.0.smithi067.stdout:1/405: dread d2/d4f/d14/d20/f26 [0,4194304] 0 2023-12-05T09:26:23.065 INFO:tasks.workunit.client.1.smithi134.stdout:6/527: sync 2023-12-05T09:26:23.065 INFO:tasks.workunit.client.1.smithi134.stdout:7/561: mkdir d2/d7/d2b/d2d/d67/dbb 0 2023-12-05T09:26:23.065 INFO:tasks.workunit.client.1.smithi134.stdout:7/562: chown d2/d7/d6f/lab 1 1 2023-12-05T09:26:23.072 INFO:tasks.workunit.client.1.smithi134.stdout:8/658: creat da/de/d11/d1d/db8/fe3 x:0 0 0 2023-12-05T09:26:23.073 INFO:tasks.workunit.client.1.smithi134.stdout:3/622: getdents d4/d5/d7c/d92 0 2023-12-05T09:26:23.073 INFO:tasks.workunit.client.1.smithi134.stdout:3/623: readlink d4/l29 0 2023-12-05T09:26:23.073 INFO:tasks.workunit.client.1.smithi134.stdout:3/624: fsync d4/d1f/d50/d52/fbe 0 2023-12-05T09:26:23.073 INFO:tasks.workunit.client.1.smithi134.stdout:8/659: truncate da/de/d43/faf 412064 0 2023-12-05T09:26:23.073 INFO:tasks.workunit.client.1.smithi134.stdout:8/660: creat da/de/d11/fe4 x:0 0 0 2023-12-05T09:26:23.073 INFO:tasks.workunit.client.1.smithi134.stdout:8/661: stat da/f2a 0 2023-12-05T09:26:23.082 INFO:tasks.workunit.client.1.smithi134.stdout:7/563: truncate d2/d7/dc/d22/f27 1876007 0 2023-12-05T09:26:23.082 INFO:tasks.workunit.client.1.smithi134.stdout:4/575: rmdir d16/d7b/d6f 39 2023-12-05T09:26:23.083 INFO:tasks.workunit.client.1.smithi134.stdout:5/551: rmdir d0/d1a/d3a 39 2023-12-05T09:26:23.084 INFO:tasks.workunit.client.0.smithi067.stdout:9/553: sync 2023-12-05T09:26:23.087 INFO:tasks.workunit.client.0.smithi067.stdout:2/328: dwrite d0/d15/d53/f6d [0,4194304] 0 2023-12-05T09:26:23.094 INFO:tasks.workunit.client.1.smithi134.stdout:8/662: symlink da/de/d43/le5 0 2023-12-05T09:26:23.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/535: sync 2023-12-05T09:26:23.094 INFO:tasks.workunit.client.1.smithi134.stdout:2/610: sync 2023-12-05T09:26:23.094 INFO:tasks.workunit.client.1.smithi134.stdout:2/611: truncate d19/d49/fc5 346131 0 2023-12-05T09:26:23.095 INFO:tasks.workunit.client.1.smithi134.stdout:7/564: getdents d2/df 0 2023-12-05T09:26:23.098 INFO:tasks.workunit.client.1.smithi134.stdout:4/576: symlink d16/d21/d47/lc8 0 2023-12-05T09:26:23.104 INFO:tasks.workunit.client.1.smithi134.stdout:8/663: rename da/de/f27 to da/de/d16/d2d/fe6 0 2023-12-05T09:26:23.114 INFO:tasks.workunit.client.0.smithi067.stdout:8/352: dwrite d5/da/f56 [0,4194304] 0 2023-12-05T09:26:23.114 INFO:tasks.workunit.client.0.smithi067.stdout:3/324: dread d9/da/f22 [0,4194304] 0 2023-12-05T09:26:23.114 INFO:tasks.workunit.client.0.smithi067.stdout:3/325: dread - d9/da/d15/f50 zero size 2023-12-05T09:26:23.114 INFO:tasks.workunit.client.0.smithi067.stdout:3/326: fdatasync d9/da/f22 0 2023-12-05T09:26:23.114 INFO:tasks.workunit.client.0.smithi067.stdout:2/329: truncate d0/d25/d34/f38 3009954 0 2023-12-05T09:26:23.114 INFO:tasks.workunit.client.0.smithi067.stdout:2/330: truncate d0/d15/d53/d1e/f35 4697528 0 2023-12-05T09:26:23.115 INFO:tasks.workunit.client.1.smithi134.stdout:9/557: dwrite d7/d5b/d5e/f8c [0,4194304] 0 2023-12-05T09:26:23.120 INFO:tasks.workunit.client.1.smithi134.stdout:2/612: rename f15 to d19/d76/da7/fc7 0 2023-12-05T09:26:23.121 INFO:tasks.workunit.client.1.smithi134.stdout:1/695: dwrite d2/d27/d40/f5d [0,4194304] 0 2023-12-05T09:26:23.121 INFO:tasks.workunit.client.1.smithi134.stdout:2/613: truncate d19/f35 4980414 0 2023-12-05T09:26:23.121 INFO:tasks.workunit.client.1.smithi134.stdout:2/614: creat d19/d28/d31/d38/fc8 x:0 0 0 2023-12-05T09:26:23.124 INFO:tasks.workunit.client.0.smithi067.stdout:8/353: write d5/d3b/f3d [37634,98919] 0 2023-12-05T09:26:23.128 INFO:tasks.workunit.client.1.smithi134.stdout:1/696: truncate d2/d9/f57 3279582 0 2023-12-05T09:26:23.129 INFO:tasks.workunit.client.1.smithi134.stdout:0/536: write d13/d14/d59/f7f [4145143,93664] 0 2023-12-05T09:26:23.136 INFO:tasks.workunit.client.1.smithi134.stdout:7/565: write d2/d7/d2b/d2d/f66 [181071,60102] 0 2023-12-05T09:26:23.139 INFO:tasks.workunit.client.0.smithi067.stdout:1/406: dread d2/d4f/d14/d48/f6b [0,4194304] 0 2023-12-05T09:26:23.139 INFO:tasks.workunit.client.0.smithi067.stdout:1/407: readlink d2/d4f/d14/l90 0 2023-12-05T09:26:23.221 INFO:tasks.workunit.client.1.smithi134.stdout:2/615: creat d19/d28/fc9 x:0 0 0 2023-12-05T09:26:23.223 INFO:tasks.workunit.client.1.smithi134.stdout:6/528: dwrite d4/d39/d42/d4f/d6d/d3a/f54 [0,4194304] 0 2023-12-05T09:26:23.223 INFO:tasks.workunit.client.1.smithi134.stdout:6/529: fdatasync d4/d39/d42/d4f/d6d/d3a/d75/d59/f7c 0 2023-12-05T09:26:23.226 INFO:tasks.workunit.client.1.smithi134.stdout:1/697: rename d2/d27/la5 to d2/d9/d10/d30/lfa 0 2023-12-05T09:26:23.227 INFO:tasks.workunit.client.0.smithi067.stdout:8/354: mkdir d5/dc/d1a/d62 0 2023-12-05T09:26:23.231 INFO:tasks.workunit.client.1.smithi134.stdout:8/664: write da/de/fb7 [885689,60993] 0 2023-12-05T09:26:23.231 INFO:tasks.workunit.client.1.smithi134.stdout:0/537: creat d13/d14/d30/d2c/fb8 x:0 0 0 2023-12-05T09:26:23.237 INFO:tasks.workunit.client.1.smithi134.stdout:2/616: symlink d19/d3a/lca 0 2023-12-05T09:26:23.237 INFO:tasks.workunit.client.1.smithi134.stdout:6/530: dread d4/d39/d42/d4f/d6d/f48 [0,4194304] 0 2023-12-05T09:26:23.239 INFO:tasks.workunit.client.0.smithi067.stdout:8/355: symlink d5/dc/d1a/d20/l63 0 2023-12-05T09:26:23.241 INFO:tasks.workunit.client.1.smithi134.stdout:7/566: dread d2/df/f79 [0,4194304] 0 2023-12-05T09:26:23.244 INFO:tasks.workunit.client.0.smithi067.stdout:2/331: rename d0/d25/d34/f38 to d0/d15/f73 0 2023-12-05T09:26:23.246 INFO:tasks.workunit.client.0.smithi067.stdout:8/356: creat d5/dc/d1a/f64 x:0 0 0 2023-12-05T09:26:23.247 INFO:tasks.workunit.client.1.smithi134.stdout:1/698: mkdir d2/d9/d10/d30/dd4/dfb 0 2023-12-05T09:26:23.248 INFO:tasks.workunit.client.0.smithi067.stdout:2/332: rename d0/d15/d53/d1e/f69 to d0/d15/d53/d1e/f74 0 2023-12-05T09:26:23.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/333: read - d0/d25/f59 zero size 2023-12-05T09:26:23.249 INFO:tasks.workunit.client.1.smithi134.stdout:9/558: dread d7/d10/f37 [4194304,4194304] 0 2023-12-05T09:26:23.251 INFO:tasks.workunit.client.1.smithi134.stdout:0/538: getdents d13/d14/d30 0 2023-12-05T09:26:23.252 INFO:tasks.workunit.client.1.smithi134.stdout:0/539: readlink d13/d14/d30/d4b/l6b 0 2023-12-05T09:26:23.252 INFO:tasks.workunit.client.0.smithi067.stdout:8/357: rename d5/dc/d1a/d20/d2d/d41/c57 to d5/dc/d1a/d20/d58/c65 0 2023-12-05T09:26:23.254 INFO:tasks.workunit.client.1.smithi134.stdout:6/531: creat d4/d39/d42/d4f/d6d/d45/f9c x:0 0 0 2023-12-05T09:26:23.254 INFO:tasks.workunit.client.1.smithi134.stdout:6/532: dread - d4/d39/d42/d4f/f85 zero size 2023-12-05T09:26:23.255 INFO:tasks.workunit.client.1.smithi134.stdout:7/567: symlink d2/df/d81/daf/lbc 0 2023-12-05T09:26:23.256 INFO:tasks.workunit.client.1.smithi134.stdout:9/559: creat d7/d8/d14/d26/d5a/da1/fc4 x:0 0 0 2023-12-05T09:26:23.257 INFO:tasks.workunit.client.1.smithi134.stdout:9/560: write d7/d8/d2e/f76 [504378,54970] 0 2023-12-05T09:26:23.257 INFO:tasks.workunit.client.1.smithi134.stdout:7/568: mkdir d2/dbd 0 2023-12-05T09:26:23.259 INFO:tasks.workunit.client.0.smithi067.stdout:5/439: dwrite db/df/d1a/d1d/d20/f90 [0,4194304] 0 2023-12-05T09:26:23.259 INFO:tasks.workunit.client.0.smithi067.stdout:5/440: chown db/df/d3f/c61 893 1 2023-12-05T09:26:23.259 INFO:tasks.workunit.client.0.smithi067.stdout:5/441: chown db/f13 56180548 1 2023-12-05T09:26:23.260 INFO:tasks.workunit.client.1.smithi134.stdout:9/561: truncate d7/d8/d16/f33 2544399 0 2023-12-05T09:26:23.262 INFO:tasks.workunit.client.1.smithi134.stdout:7/569: symlink d2/d7/d65/lbe 0 2023-12-05T09:26:23.265 INFO:tasks.workunit.client.0.smithi067.stdout:5/442: rmdir db/df/d38 39 2023-12-05T09:26:23.265 INFO:tasks.workunit.client.0.smithi067.stdout:5/443: write db/df/d1a/d1d/d20/f2d [558585,89465] 0 2023-12-05T09:26:23.266 INFO:tasks.workunit.client.1.smithi134.stdout:8/665: dread da/f3e [0,4194304] 0 2023-12-05T09:26:23.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/570: unlink d2/dd/fa9 0 2023-12-05T09:26:23.271 INFO:tasks.workunit.client.1.smithi134.stdout:8/666: creat da/de/d8a/d42/d99/dc8/fe7 x:0 0 0 2023-12-05T09:26:23.271 INFO:tasks.workunit.client.1.smithi134.stdout:8/667: truncate da/de/d8a/fd1 554814 0 2023-12-05T09:26:23.273 INFO:tasks.workunit.client.1.smithi134.stdout:8/668: creat da/fe8 x:0 0 0 2023-12-05T09:26:23.274 INFO:tasks.workunit.client.1.smithi134.stdout:8/669: symlink da/de/d96/dc9/le9 0 2023-12-05T09:26:23.275 INFO:tasks.workunit.client.1.smithi134.stdout:8/670: readlink da/de/d96/dc9/le9 0 2023-12-05T09:26:23.275 INFO:tasks.workunit.client.1.smithi134.stdout:8/671: write da/de/d8a/d42/d99/dc8/d3b/f65 [797609,106702] 0 2023-12-05T09:26:23.278 INFO:tasks.workunit.client.1.smithi134.stdout:8/672: mkdir da/de/d11/d1d/d5f/dea 0 2023-12-05T09:26:23.278 INFO:tasks.workunit.client.1.smithi134.stdout:8/673: readlink da/de/d8a/d42/l60 0 2023-12-05T09:26:23.279 INFO:tasks.workunit.client.0.smithi067.stdout:2/334: dread d0/fe [0,4194304] 0 2023-12-05T09:26:23.279 INFO:tasks.workunit.client.1.smithi134.stdout:0/540: write d13/d14/d30/d2c/f44 [2485849,10499] 0 2023-12-05T09:26:23.280 INFO:tasks.workunit.client.1.smithi134.stdout:8/674: mknod da/de/d11/ceb 0 2023-12-05T09:26:23.280 INFO:tasks.workunit.client.1.smithi134.stdout:3/625: dwrite d4/d5/d45/d60/f72 [0,4194304] 0 2023-12-05T09:26:23.281 INFO:tasks.workunit.client.1.smithi134.stdout:4/577: dwrite d16/d18/d1c/d63/fab [0,4194304] 0 2023-12-05T09:26:23.282 INFO:tasks.workunit.client.0.smithi067.stdout:1/408: dwrite d2/d3/f3d [0,4194304] 0 2023-12-05T09:26:23.282 INFO:tasks.workunit.client.0.smithi067.stdout:3/327: dwrite d9/f67 [0,4194304] 0 2023-12-05T09:26:23.284 INFO:tasks.workunit.client.1.smithi134.stdout:5/552: dwrite d0/dd/f20 [0,4194304] 0 2023-12-05T09:26:23.289 INFO:tasks.workunit.client.0.smithi067.stdout:9/554: dwrite d1b/d25/d54/d5c/fb6 [0,4194304] 0 2023-12-05T09:26:23.289 INFO:tasks.workunit.client.0.smithi067.stdout:9/555: write d1b/d25/d35/d56/f8c [52066,80890] 0 2023-12-05T09:26:23.290 INFO:tasks.workunit.client.1.smithi134.stdout:0/541: creat d13/d14/d59/fb9 x:0 0 0 2023-12-05T09:26:23.290 INFO:tasks.workunit.client.1.smithi134.stdout:0/542: stat d13/d14/d30/d4b/f41 0 2023-12-05T09:26:23.290 INFO:tasks.workunit.client.1.smithi134.stdout:0/543: readlink d13/d14/d59/d78/la4 0 2023-12-05T09:26:23.292 INFO:tasks.workunit.client.1.smithi134.stdout:8/675: creat da/de/d11/d1d/fec x:0 0 0 2023-12-05T09:26:23.292 INFO:tasks.workunit.client.1.smithi134.stdout:8/676: chown da/de/d11/d1d/db8 1889 1 2023-12-05T09:26:23.292 INFO:tasks.workunit.client.1.smithi134.stdout:8/677: dread - da/de/d16/d33/fd4 zero size 2023-12-05T09:26:23.292 INFO:tasks.workunit.client.1.smithi134.stdout:8/678: truncate da/fc7 1030891 0 2023-12-05T09:26:23.292 INFO:tasks.workunit.client.1.smithi134.stdout:8/679: chown da/de/f7a 13 1 2023-12-05T09:26:23.295 INFO:tasks.workunit.client.0.smithi067.stdout:9/556: read d1b/d3e/f67 [375213,103477] 0 2023-12-05T09:26:23.299 INFO:tasks.workunit.client.0.smithi067.stdout:6/308: dwrite da/d10/f5e [0,4194304] 0 2023-12-05T09:26:23.301 INFO:tasks.workunit.client.0.smithi067.stdout:1/409: unlink d2/d5/d7/de/d19/d71/l94 0 2023-12-05T09:26:23.301 INFO:tasks.workunit.client.0.smithi067.stdout:1/410: fsync d2/d5/d7/de/f37 0 2023-12-05T09:26:23.302 INFO:tasks.workunit.client.0.smithi067.stdout:9/557: write d1b/d25/f50 [5750,113791] 0 2023-12-05T09:26:23.303 INFO:tasks.workunit.client.0.smithi067.stdout:9/558: creat d1b/d25/d35/d56/fbc x:0 0 0 2023-12-05T09:26:23.304 INFO:tasks.workunit.client.1.smithi134.stdout:2/617: dwrite f5 [0,4194304] 0 2023-12-05T09:26:23.304 INFO:tasks.workunit.client.1.smithi134.stdout:2/618: chown d19/d28/f4e 437 1 2023-12-05T09:26:23.306 INFO:tasks.workunit.client.1.smithi134.stdout:3/626: rename d4/d1f/f26 to d4/d5/d45/d60/d85/d96/fc5 0 2023-12-05T09:26:23.307 INFO:tasks.workunit.client.1.smithi134.stdout:3/627: write d4/d5/d45/d60/d85/d96/fc5 [1260551,27484] 0 2023-12-05T09:26:23.309 INFO:tasks.workunit.client.0.smithi067.stdout:3/328: symlink d9/d20/l73 0 2023-12-05T09:26:23.311 INFO:tasks.workunit.client.1.smithi134.stdout:4/578: read d16/d21/f57 [1700314,53870] 0 2023-12-05T09:26:23.311 INFO:tasks.workunit.client.1.smithi134.stdout:4/579: truncate d16/d21/d69/d6e/daa/f20 3863159 0 2023-12-05T09:26:23.317 INFO:tasks.workunit.client.1.smithi134.stdout:0/544: read f8 [1938169,90894] 0 2023-12-05T09:26:23.324 INFO:tasks.workunit.client.1.smithi134.stdout:5/553: mkdir d0/d1a/d1c/d3f/d81/db0/dbe 0 2023-12-05T09:26:23.324 INFO:tasks.workunit.client.1.smithi134.stdout:5/554: fdatasync d0/d1a/d3a/f74 0 2023-12-05T09:26:23.324 INFO:tasks.workunit.client.1.smithi134.stdout:5/555: stat d0/d1a/d1c/d3f/d5b/fba 0 2023-12-05T09:26:23.326 INFO:tasks.workunit.client.1.smithi134.stdout:7/571: write d2/d7/dc/d2e/f8c [4434716,78110] 0 2023-12-05T09:26:23.326 INFO:tasks.workunit.client.1.smithi134.stdout:8/680: creat da/de/d96/d9d/fed x:0 0 0 2023-12-05T09:26:23.326 INFO:tasks.workunit.client.1.smithi134.stdout:1/699: dwrite d2/d9/d10/f5a [0,4194304] 0 2023-12-05T09:26:23.327 INFO:tasks.workunit.client.1.smithi134.stdout:6/533: dwrite d4/d39/d42/d4f/d6d/d45/f9c [0,4194304] 0 2023-12-05T09:26:23.334 INFO:tasks.workunit.client.1.smithi134.stdout:2/619: truncate f16 1234672 0 2023-12-05T09:26:23.336 INFO:tasks.workunit.client.1.smithi134.stdout:4/580: mknod d16/d21/d48/d80/dae/cc9 0 2023-12-05T09:26:23.336 INFO:tasks.workunit.client.1.smithi134.stdout:4/581: stat d16/d21/d48/d80/f85 0 2023-12-05T09:26:23.336 INFO:tasks.workunit.client.1.smithi134.stdout:4/582: readlink d16/d21/d69/d6e/daa/d3b/l56 0 2023-12-05T09:26:23.337 INFO:tasks.workunit.client.0.smithi067.stdout:1/411: read d2/d3/f3d [3541762,49222] 0 2023-12-05T09:26:23.339 INFO:tasks.workunit.client.0.smithi067.stdout:8/358: dwrite d5/dc/d1a/f2f [0,4194304] 0 2023-12-05T09:26:23.342 INFO:tasks.workunit.client.1.smithi134.stdout:0/545: getdents d13/d14/d59/d78 0 2023-12-05T09:26:23.343 INFO:tasks.workunit.client.1.smithi134.stdout:5/556: symlink d0/d11/lbf 0 2023-12-05T09:26:23.343 INFO:tasks.workunit.client.1.smithi134.stdout:5/557: read - d0/d1a/d1c/d25/d6a/f6c zero size 2023-12-05T09:26:23.344 INFO:tasks.workunit.client.0.smithi067.stdout:6/309: symlink da/d10/d1e/d17/d2f/d1f/l70 0 2023-12-05T09:26:23.347 INFO:tasks.workunit.client.0.smithi067.stdout:9/559: getdents d1b/d3e 0 2023-12-05T09:26:23.349 INFO:tasks.workunit.client.1.smithi134.stdout:9/562: dwrite d7/d8/d14/f25 [0,4194304] 0 2023-12-05T09:26:23.349 INFO:tasks.workunit.client.0.smithi067.stdout:3/329: truncate d9/da/d15/d17/d1a/f4b 777381 0 2023-12-05T09:26:23.352 INFO:tasks.workunit.client.1.smithi134.stdout:8/681: creat da/de/d96/dc9/dd8/fee x:0 0 0 2023-12-05T09:26:23.352 INFO:tasks.workunit.client.1.smithi134.stdout:8/682: fsync da/de/d16/d98/fb4 0 2023-12-05T09:26:23.352 INFO:tasks.workunit.client.1.smithi134.stdout:8/683: chown da/de/d8a/d42 69 1 2023-12-05T09:26:23.352 INFO:tasks.workunit.client.0.smithi067.stdout:2/335: dwrite d0/d2f/d39/f40 [0,4194304] 0 2023-12-05T09:26:23.352 INFO:tasks.workunit.client.0.smithi067.stdout:2/336: chown d0/d15/d53/d1e/c31 0 1 2023-12-05T09:26:23.356 INFO:tasks.workunit.client.0.smithi067.stdout:1/412: mknod d2/d5/d7/de/d19/d49/d6d/c97 0 2023-12-05T09:26:23.356 INFO:tasks.workunit.client.0.smithi067.stdout:1/413: dread - d2/d3/f96 zero size 2023-12-05T09:26:23.359 INFO:tasks.workunit.client.0.smithi067.stdout:8/359: dread d5/dc/d1a/f5a [0,4194304] 0 2023-12-05T09:26:23.359 INFO:tasks.workunit.client.0.smithi067.stdout:8/360: dread - d5/dc/d1a/d20/f53 zero size 2023-12-05T09:26:23.362 INFO:tasks.workunit.client.0.smithi067.stdout:6/310: mknod da/d10/d1e/d17/d2f/d2c/c71 0 2023-12-05T09:26:23.362 INFO:tasks.workunit.client.0.smithi067.stdout:6/311: fsync da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a 0 2023-12-05T09:26:23.363 INFO:tasks.workunit.client.0.smithi067.stdout:5/444: dwrite db/df/d82/f8c [0,4194304] 0 2023-12-05T09:26:23.367 INFO:tasks.workunit.client.1.smithi134.stdout:5/558: dread d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/f92 [0,4194304] 0 2023-12-05T09:26:23.367 INFO:tasks.workunit.client.1.smithi134.stdout:5/559: fsync d0/dd/f14 0 2023-12-05T09:26:23.368 INFO:tasks.workunit.client.1.smithi134.stdout:2/620: mkdir d19/d28/d31/d38/d98/dcb 0 2023-12-05T09:26:23.368 INFO:tasks.workunit.client.0.smithi067.stdout:9/560: unlink d1b/d25/d54/d5c/d6a/d82/la9 0 2023-12-05T09:26:23.369 INFO:tasks.workunit.client.0.smithi067.stdout:9/561: fsync d1b/d25/d35/d56/f5a 0 2023-12-05T09:26:23.375 INFO:tasks.workunit.client.1.smithi134.stdout:4/583: getdents d16/d18/d1c 0 2023-12-05T09:26:23.381 INFO:tasks.workunit.client.0.smithi067.stdout:7/390: sync 2023-12-05T09:26:23.381 INFO:tasks.workunit.client.0.smithi067.stdout:0/500: sync 2023-12-05T09:26:23.381 INFO:tasks.workunit.client.0.smithi067.stdout:4/340: sync 2023-12-05T09:26:23.382 INFO:tasks.workunit.client.0.smithi067.stdout:3/330: dread f6 [0,4194304] 0 2023-12-05T09:26:23.382 INFO:tasks.workunit.client.0.smithi067.stdout:3/331: chown d9/da/f22 17013981 1 2023-12-05T09:26:23.383 INFO:tasks.workunit.client.0.smithi067.stdout:1/414: rename d2/d4f/d15/d74/d7a to d2/d5/d7/de/d19/d8f/d98 0 2023-12-05T09:26:23.383 INFO:tasks.workunit.client.1.smithi134.stdout:2/621: dread d19/d28/f4e [0,4194304] 0 2023-12-05T09:26:23.383 INFO:tasks.workunit.client.1.smithi134.stdout:2/622: truncate fd 459677 0 2023-12-05T09:26:23.383 INFO:tasks.workunit.client.1.smithi134.stdout:6/534: dwrite d4/d39/d42/f4d [0,4194304] 0 2023-12-05T09:26:23.383 INFO:tasks.workunit.client.0.smithi067.stdout:1/415: creat d2/d5/d7/de/d1a/f99 x:0 0 0 2023-12-05T09:26:23.385 INFO:tasks.workunit.client.1.smithi134.stdout:0/546: mknod d13/d14/d15/d2a/d8c/db6/cba 0 2023-12-05T09:26:23.385 INFO:tasks.workunit.client.1.smithi134.stdout:1/700: dwrite d2/d27/db4/fdc [0,4194304] 0 2023-12-05T09:26:23.386 INFO:tasks.workunit.client.0.smithi067.stdout:8/361: write d5/dc/d1a/d20/f25 [2425113,112720] 0 2023-12-05T09:26:23.386 INFO:tasks.workunit.client.0.smithi067.stdout:6/312: mkdir da/d10/d1e/d17/d2f/d72 0 2023-12-05T09:26:23.387 INFO:tasks.workunit.client.1.smithi134.stdout:7/572: dwrite d2/df/f79 [0,4194304] 0 2023-12-05T09:26:23.387 INFO:tasks.workunit.client.1.smithi134.stdout:7/573: readlink d2/d7/dc/d2e/d3a/l3f 0 2023-12-05T09:26:23.390 INFO:tasks.workunit.client.1.smithi134.stdout:9/563: mkdir d7/d8/d14/d26/d5a/d69/dc5 0 2023-12-05T09:26:23.395 INFO:tasks.workunit.client.0.smithi067.stdout:7/391: dread d0/d9/d10/f32 [4194304,4194304] 0 2023-12-05T09:26:23.402 INFO:tasks.workunit.client.0.smithi067.stdout:9/562: creat d1b/d25/d54/d5c/d6a/d6c/fbd x:0 0 0 2023-12-05T09:26:23.408 INFO:tasks.workunit.client.0.smithi067.stdout:0/501: mkdir d3/d7/d3c/d66/d90/d99/db4 0 2023-12-05T09:26:23.410 INFO:tasks.workunit.client.1.smithi134.stdout:4/584: dread d16/d21/d48/d80/dae/f6c [0,4194304] 0 2023-12-05T09:26:23.412 INFO:tasks.workunit.client.0.smithi067.stdout:4/341: mknod d0/d1d/d25/d5c/c77 0 2023-12-05T09:26:23.412 INFO:tasks.workunit.client.0.smithi067.stdout:6/313: write da/d10/f5e [251570,100936] 0 2023-12-05T09:26:23.418 INFO:tasks.workunit.client.1.smithi134.stdout:1/701: dread d2/d9/f57 [0,4194304] 0 2023-12-05T09:26:23.418 INFO:tasks.workunit.client.0.smithi067.stdout:0/502: dread d3/d7/d3c/d66/f7c [0,4194304] 0 2023-12-05T09:26:23.419 INFO:tasks.workunit.client.0.smithi067.stdout:0/503: truncate d3/d7/d3c/d6c/f86 151868 0 2023-12-05T09:26:23.421 INFO:tasks.workunit.client.0.smithi067.stdout:5/445: rename db/df/d1a/f1c to db/df/d52/f9d 0 2023-12-05T09:26:23.431 INFO:tasks.workunit.client.0.smithi067.stdout:1/416: creat d2/d4f/d14/d20/f9a x:0 0 0 2023-12-05T09:26:23.431 INFO:tasks.workunit.client.0.smithi067.stdout:1/417: stat d2/d3/f1d 0 2023-12-05T09:26:23.431 INFO:tasks.workunit.client.0.smithi067.stdout:1/418: creat d2/d4f/d54/d70/f9b x:0 0 0 2023-12-05T09:26:23.431 INFO:tasks.workunit.client.1.smithi134.stdout:6/535: dwrite d4/d39/d42/d4f/d6d/d3a/d75/f29 [0,4194304] 0 2023-12-05T09:26:23.436 INFO:tasks.workunit.client.0.smithi067.stdout:8/362: mkdir d5/da/d30/d61/d66 0 2023-12-05T09:26:23.438 INFO:tasks.workunit.client.1.smithi134.stdout:1/702: dread d2/d9/d10/d30/d4a/d81/f8e [0,4194304] 0 2023-12-05T09:26:23.438 INFO:tasks.workunit.client.1.smithi134.stdout:1/703: fdatasync d2/d7e/fdb 0 2023-12-05T09:26:23.442 INFO:tasks.workunit.client.0.smithi067.stdout:9/563: mknod d1b/d25/d35/cbe 0 2023-12-05T09:26:23.445 INFO:tasks.workunit.client.1.smithi134.stdout:7/574: dwrite d2/d7/dc/d2e/d3a/f49 [0,4194304] 0 2023-12-05T09:26:23.445 INFO:tasks.workunit.client.1.smithi134.stdout:7/575: creat d2/d7/dc/d2e/d3a/fbf x:0 0 0 2023-12-05T09:26:23.445 INFO:tasks.workunit.client.1.smithi134.stdout:7/576: getdents d2/df/d2a/d63 0 2023-12-05T09:26:23.445 INFO:tasks.workunit.client.0.smithi067.stdout:3/332: dwrite d9/da/d15/d17/f3a [0,4194304] 0 2023-12-05T09:26:23.447 INFO:tasks.workunit.client.1.smithi134.stdout:5/560: symlink d0/d1a/d1c/d25/d4d/d9e/lc0 0 2023-12-05T09:26:23.449 INFO:tasks.workunit.client.0.smithi067.stdout:6/314: link da/d10/c33 da/d10/d1e/d69/c73 0 2023-12-05T09:26:23.454 INFO:tasks.workunit.client.0.smithi067.stdout:0/504: link d3/d7/d3c/d67/f5b d3/da2/fb5 0 2023-12-05T09:26:23.462 INFO:tasks.workunit.client.0.smithi067.stdout:7/392: rename d0/d9/d3f/d4e to d0/d9/d10/d37/d82 0 2023-12-05T09:26:23.464 INFO:tasks.workunit.client.1.smithi134.stdout:2/623: link d19/d3a/c61 d19/d28/d31/d6f/ccc 0 2023-12-05T09:26:23.467 INFO:tasks.workunit.client.1.smithi134.stdout:0/547: link d13/d14/d30/d2c/f47 d13/d14/d15/d2a/d8c/fbb 0 2023-12-05T09:26:23.472 INFO:tasks.workunit.client.1.smithi134.stdout:9/564: truncate d7/d8/f91 2243065 0 2023-12-05T09:26:23.472 INFO:tasks.workunit.client.1.smithi134.stdout:9/565: fdatasync d7/d8/d2e/f31 0 2023-12-05T09:26:23.473 INFO:tasks.workunit.client.0.smithi067.stdout:1/419: dwrite d2/d5/d50/f7f [0,4194304] 0 2023-12-05T09:26:23.474 INFO:tasks.workunit.client.0.smithi067.stdout:9/564: dread f14 [0,4194304] 0 2023-12-05T09:26:23.474 INFO:tasks.workunit.client.0.smithi067.stdout:9/565: truncate d1b/d3e/d7f/f95 68812 0 2023-12-05T09:26:23.474 INFO:tasks.workunit.client.0.smithi067.stdout:9/566: truncate d1b/d25/f4b 963024 0 2023-12-05T09:26:23.474 INFO:tasks.workunit.client.1.smithi134.stdout:9/566: write d7/d8/d14/d26/fbd [891885,54612] 0 2023-12-05T09:26:23.474 INFO:tasks.workunit.client.1.smithi134.stdout:9/567: read d7/d8/d16/f1f [548331,86065] 0 2023-12-05T09:26:23.476 INFO:tasks.workunit.client.0.smithi067.stdout:8/363: mknod d5/c67 0 2023-12-05T09:26:23.480 INFO:tasks.workunit.client.1.smithi134.stdout:4/585: rename l8 to d16/d7b/lca 0 2023-12-05T09:26:23.485 INFO:tasks.workunit.client.0.smithi067.stdout:6/315: rmdir da/d10/d1e/d17/d2f/d59 39 2023-12-05T09:26:23.487 INFO:tasks.workunit.client.0.smithi067.stdout:0/505: symlink d3/d7/d3c/d6c/lb6 0 2023-12-05T09:26:23.488 INFO:tasks.workunit.client.0.smithi067.stdout:9/567: write f14 [1042335,83457] 0 2023-12-05T09:26:23.488 INFO:tasks.workunit.client.0.smithi067.stdout:9/568: chown d1b/c2e 1038040 1 2023-12-05T09:26:23.488 INFO:tasks.workunit.client.0.smithi067.stdout:9/569: stat d1b/d25/d54/d5c/d6a/d6c/d78 0 2023-12-05T09:26:23.488 INFO:tasks.workunit.client.1.smithi134.stdout:1/704: mknod d2/d9/d8d/da2/cfc 0 2023-12-05T09:26:23.489 INFO:tasks.workunit.client.1.smithi134.stdout:1/705: chown d2/d9 536124157 1 2023-12-05T09:26:23.493 INFO:tasks.workunit.client.0.smithi067.stdout:4/342: rename d0/d1d/d2b/d50/f59 to d0/d9/f78 0 2023-12-05T09:26:23.494 INFO:tasks.workunit.client.0.smithi067.stdout:4/343: readlink d0/d1d/d2b/d50/d15/l3d 0 2023-12-05T09:26:23.497 INFO:tasks.workunit.client.0.smithi067.stdout:5/446: rmdir db/df/d1a/d1d/d20 39 2023-12-05T09:26:23.497 INFO:tasks.workunit.client.0.smithi067.stdout:5/447: write db/df/f7e [884400,125370] 0 2023-12-05T09:26:23.497 INFO:tasks.workunit.client.0.smithi067.stdout:5/448: creat db/df/d36/d57/f9e x:0 0 0 2023-12-05T09:26:23.500 INFO:tasks.workunit.client.0.smithi067.stdout:1/420: mknod d2/d4f/c9c 0 2023-12-05T09:26:23.501 INFO:tasks.workunit.client.0.smithi067.stdout:6/316: dread da/d10/d1e/d17/f23 [0,4194304] 0 2023-12-05T09:26:23.501 INFO:tasks.workunit.client.1.smithi134.stdout:0/548: creat d13/d14/d30/d4b/d66/da0/daf/fbc x:0 0 0 2023-12-05T09:26:23.501 INFO:tasks.workunit.client.1.smithi134.stdout:0/549: fsync d13/d14/d15/fad 0 2023-12-05T09:26:23.501 INFO:tasks.workunit.client.1.smithi134.stdout:0/550: chown d13/d14/d15/d2a/f4a 15 1 2023-12-05T09:26:23.503 INFO:tasks.workunit.client.1.smithi134.stdout:6/536: rename d4/d39/d5c/l8e to d4/d39/d42/l9d 0 2023-12-05T09:26:23.504 INFO:tasks.workunit.client.0.smithi067.stdout:0/506: mknod d3/d7/cb7 0 2023-12-05T09:26:23.506 INFO:tasks.workunit.client.1.smithi134.stdout:4/586: creat d16/d18/d1b/d24/fcb x:0 0 0 2023-12-05T09:26:23.507 INFO:tasks.workunit.client.0.smithi067.stdout:9/570: symlink d1b/lbf 0 2023-12-05T09:26:23.507 INFO:tasks.workunit.client.0.smithi067.stdout:1/421: dread d2/d4f/d14/d20/d83/f84 [0,4194304] 0 2023-12-05T09:26:23.509 INFO:tasks.workunit.client.1.smithi134.stdout:1/706: write d2/d9/d10/f3f [1337662,62034] 0 2023-12-05T09:26:23.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/577: dwrite d2/d7/dc/d2e/d3a/f4e [0,4194304] 0 2023-12-05T09:26:23.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/578: write d2/d7/dc/d2e/d3a/f5e [4229710,5796] 0 2023-12-05T09:26:23.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/551: unlink d13/d14/d30/d2c/f68 0 2023-12-05T09:26:23.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/552: chown d13/d14/d30/d4b/d66/da0/fa1 0 1 2023-12-05T09:26:23.511 INFO:tasks.workunit.client.0.smithi067.stdout:3/333: dwrite d9/f58 [0,4194304] 0 2023-12-05T09:26:23.511 INFO:tasks.workunit.client.0.smithi067.stdout:3/334: fdatasync d9/da/d15/d28/f41 0 2023-12-05T09:26:23.511 INFO:tasks.workunit.client.0.smithi067.stdout:3/335: write d9/da/d3b/f6b [383228,3510] 0 2023-12-05T09:26:23.511 INFO:tasks.workunit.client.0.smithi067.stdout:3/336: getdents d9/da/d15/d28/d29/d47/d64 0 2023-12-05T09:26:23.511 INFO:tasks.workunit.client.0.smithi067.stdout:3/337: readlink d9/d20/l73 0 2023-12-05T09:26:23.512 INFO:tasks.workunit.client.1.smithi134.stdout:2/624: dwrite d19/d3f/f78 [0,4194304] 0 2023-12-05T09:26:23.512 INFO:tasks.workunit.client.1.smithi134.stdout:2/625: truncate d19/d49/fab 542805 0 2023-12-05T09:26:23.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/393: rename d0/d9/l3a to d0/d9/d10/d37/l83 0 2023-12-05T09:26:23.522 INFO:tasks.workunit.client.1.smithi134.stdout:5/561: rename d0/d1a/d1c/d25/d4d/f68 to d0/d11/d61/d75/fc1 0 2023-12-05T09:26:23.523 INFO:tasks.workunit.client.1.smithi134.stdout:5/562: chown d0/d11/d5c/dab 223 1 2023-12-05T09:26:23.523 INFO:tasks.workunit.client.1.smithi134.stdout:8/684: unlink da/de/d11/f19 0 2023-12-05T09:26:23.523 INFO:tasks.workunit.client.1.smithi134.stdout:1/707: creat d2/d9/d10/d5b/ffd x:0 0 0 2023-12-05T09:26:23.523 INFO:tasks.workunit.client.1.smithi134.stdout:5/563: creat d0/d50/fc2 x:0 0 0 2023-12-05T09:26:23.524 INFO:tasks.workunit.client.0.smithi067.stdout:5/449: truncate db/df/d3f/d88/f62 4862444 0 2023-12-05T09:26:23.524 INFO:tasks.workunit.client.1.smithi134.stdout:0/553: creat d13/d14/d59/d7d/fbd x:0 0 0 2023-12-05T09:26:23.524 INFO:tasks.workunit.client.1.smithi134.stdout:0/554: write d13/d14/d15/d2a/d8c/fbb [4375062,91383] 0 2023-12-05T09:26:23.524 INFO:tasks.workunit.client.1.smithi134.stdout:0/555: fdatasync d13/d14/d15/d67/d73/f80 0 2023-12-05T09:26:23.524 INFO:tasks.workunit.client.1.smithi134.stdout:0/556: read - d13/d14/d59/fb9 zero size 2023-12-05T09:26:23.525 INFO:tasks.workunit.client.1.smithi134.stdout:0/557: chown d13/d14/d15 7 1 2023-12-05T09:26:23.525 INFO:tasks.workunit.client.1.smithi134.stdout:0/558: write d13/d14/d30/d4b/d23/f60 [1656847,29614] 0 2023-12-05T09:26:23.525 INFO:tasks.workunit.client.1.smithi134.stdout:0/559: stat d13/d14/d30/d4b/f8d 0 2023-12-05T09:26:23.527 INFO:tasks.workunit.client.0.smithi067.stdout:8/364: getdents d5/dc/d1a/d20/d2d/d41 0 2023-12-05T09:26:23.528 INFO:tasks.workunit.client.0.smithi067.stdout:8/365: dread - d5/dc/d1a/d20/d2d/d41/f5b zero size 2023-12-05T09:26:23.528 INFO:tasks.workunit.client.0.smithi067.stdout:8/366: fsync d5/dc/d1a/f2e 0 2023-12-05T09:26:23.528 INFO:tasks.workunit.client.0.smithi067.stdout:8/367: chown d5/dc/d1a/d20/d2d/d41/f5b 29 1 2023-12-05T09:26:23.528 INFO:tasks.workunit.client.0.smithi067.stdout:8/368: truncate d5/dc/d1a/d20/f25 4709689 0 2023-12-05T09:26:23.530 INFO:tasks.workunit.client.0.smithi067.stdout:0/507: write d3/d7/d3c/f47 [1739146,35221] 0 2023-12-05T09:26:23.535 INFO:tasks.workunit.client.0.smithi067.stdout:9/571: unlink f14 0 2023-12-05T09:26:23.537 INFO:tasks.workunit.client.0.smithi067.stdout:1/422: mknod d2/d4f/d15/d60/c9d 0 2023-12-05T09:26:23.538 INFO:tasks.workunit.client.1.smithi134.stdout:6/537: dwrite d4/d39/d42/d4f/d6d/d3a/da/f77 [0,4194304] 0 2023-12-05T09:26:23.540 INFO:tasks.workunit.client.1.smithi134.stdout:2/626: mkdir d19/d28/d9e/dcd 0 2023-12-05T09:26:23.540 INFO:tasks.workunit.client.1.smithi134.stdout:3/628: sync 2023-12-05T09:26:23.542 INFO:tasks.workunit.client.1.smithi134.stdout:7/579: getdents d2 0 2023-12-05T09:26:23.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/338: rename l2 to d9/d62/l74 0 2023-12-05T09:26:23.548 INFO:tasks.workunit.client.1.smithi134.stdout:1/708: mkdir d2/d9/d10/d30/dfe 0 2023-12-05T09:26:23.549 INFO:tasks.workunit.client.0.smithi067.stdout:7/394: symlink d0/d9/d56/l84 0 2023-12-05T09:26:23.551 INFO:tasks.workunit.client.0.smithi067.stdout:4/344: rmdir d0/d1d/d25/d2c/d34 39 2023-12-05T09:26:23.553 INFO:tasks.workunit.client.1.smithi134.stdout:4/587: rename d16/d7b/d6f/ca9 to d16/d18/d1c/ccc 0 2023-12-05T09:26:23.553 INFO:tasks.workunit.client.0.smithi067.stdout:5/450: getdents db/df/d3f 0 2023-12-05T09:26:23.553 INFO:tasks.workunit.client.0.smithi067.stdout:5/451: readlink db/df/d36/l4b 0 2023-12-05T09:26:23.556 INFO:tasks.workunit.client.0.smithi067.stdout:6/317: rmdir da/d10/d1e/d17/d2f/d47/d19 39 2023-12-05T09:26:23.556 INFO:tasks.workunit.client.0.smithi067.stdout:6/318: getdents da/d10/d1e/d17/d2f/d1f/d27/d45 0 2023-12-05T09:26:23.557 INFO:tasks.workunit.client.0.smithi067.stdout:6/319: write da/d10/d1e/d17/f3a [991112,31676] 0 2023-12-05T09:26:23.557 INFO:tasks.workunit.client.0.smithi067.stdout:6/320: creat da/d10/d1e/d17/d2f/d2c/d34/f74 x:0 0 0 2023-12-05T09:26:23.557 INFO:tasks.workunit.client.1.smithi134.stdout:0/560: link d13/d14/d30/d2c/l9f d13/d14/d30/d4b/d66/da0/daf/lbe 0 2023-12-05T09:26:23.559 INFO:tasks.workunit.client.0.smithi067.stdout:8/369: truncate d5/da/f56 572527 0 2023-12-05T09:26:23.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/572: truncate d1b/d25/f46 73781 0 2023-12-05T09:26:23.569 INFO:tasks.workunit.client.0.smithi067.stdout:1/423: unlink d2/f8b 0 2023-12-05T09:26:23.572 INFO:tasks.workunit.client.0.smithi067.stdout:3/339: creat d9/da/d15/d17/d1a/d51/f75 x:0 0 0 2023-12-05T09:26:23.574 INFO:tasks.workunit.client.1.smithi134.stdout:2/627: truncate d19/d3a/f45 1184563 0 2023-12-05T09:26:23.574 INFO:tasks.workunit.client.1.smithi134.stdout:2/628: write d19/d76/f9a [512785,55548] 0 2023-12-05T09:26:23.575 INFO:tasks.workunit.client.0.smithi067.stdout:7/395: symlink d0/d9/d10/d37/d38/l85 0 2023-12-05T09:26:23.578 INFO:tasks.workunit.client.1.smithi134.stdout:1/709: unlink d2/d9/d10/f3c 0 2023-12-05T09:26:23.579 INFO:tasks.workunit.client.0.smithi067.stdout:5/452: link db/df/d35/d63/l6d db/df/d82/l9f 0 2023-12-05T09:26:23.583 INFO:tasks.workunit.client.0.smithi067.stdout:9/573: dread d1b/d25/f33 [0,4194304] 0 2023-12-05T09:26:23.583 INFO:tasks.workunit.client.0.smithi067.stdout:9/574: creat d1b/d25/d35/d56/fc0 x:0 0 0 2023-12-05T09:26:23.584 INFO:tasks.workunit.client.1.smithi134.stdout:8/685: rename da/de/d4d/dd9 to da/de/d11/d1d/d5f/def 0 2023-12-05T09:26:23.587 INFO:tasks.workunit.client.0.smithi067.stdout:6/321: unlink da/d10/d1e/d17/f3a 0 2023-12-05T09:26:23.591 INFO:tasks.workunit.client.1.smithi134.stdout:4/588: dread d16/d21/d69/d6e/daa/f43 [0,4194304] 0 2023-12-05T09:26:23.591 INFO:tasks.workunit.client.1.smithi134.stdout:9/568: sync 2023-12-05T09:26:23.593 INFO:tasks.workunit.client.0.smithi067.stdout:8/370: rename d5/dc/d1a/d20/d3e/l5c to d5/dc/d1a/d20/d2d/l68 0 2023-12-05T09:26:23.594 INFO:tasks.workunit.client.0.smithi067.stdout:8/371: fdatasync d5/f40 0 2023-12-05T09:26:23.594 INFO:tasks.workunit.client.0.smithi067.stdout:8/372: creat d5/da/f69 x:0 0 0 2023-12-05T09:26:23.595 INFO:tasks.workunit.client.1.smithi134.stdout:1/710: creat d2/d9/fff x:0 0 0 2023-12-05T09:26:23.596 INFO:tasks.workunit.client.1.smithi134.stdout:2/629: dread d19/f25 [0,4194304] 0 2023-12-05T09:26:23.596 INFO:tasks.workunit.client.1.smithi134.stdout:1/711: truncate d2/d9/d10/fac 648506 0 2023-12-05T09:26:23.596 INFO:tasks.workunit.client.1.smithi134.stdout:2/630: creat d19/d28/d31/d38/fce x:0 0 0 2023-12-05T09:26:23.597 INFO:tasks.workunit.client.0.smithi067.stdout:0/508: symlink d3/lb8 0 2023-12-05T09:26:23.597 INFO:tasks.workunit.client.0.smithi067.stdout:0/509: dread - d3/d7/d3c/d67/d59/d4e/fa0 zero size 2023-12-05T09:26:23.597 INFO:tasks.workunit.client.0.smithi067.stdout:0/510: fsync d3/d7/d3c/d66/fa9 0 2023-12-05T09:26:23.597 INFO:tasks.workunit.client.1.smithi134.stdout:5/564: link d0/d11/d5c/l5e d0/d11/d5c/lc3 0 2023-12-05T09:26:23.600 INFO:tasks.workunit.client.0.smithi067.stdout:3/340: symlink d9/da/l76 0 2023-12-05T09:26:23.601 INFO:tasks.workunit.client.1.smithi134.stdout:8/686: symlink da/de/d16/d33/lf0 0 2023-12-05T09:26:23.601 INFO:tasks.workunit.client.1.smithi134.stdout:8/687: chown da/de/d11 1 1 2023-12-05T09:26:23.601 INFO:tasks.workunit.client.1.smithi134.stdout:8/688: readlink da/de/d16/lc6 0 2023-12-05T09:26:23.602 INFO:tasks.workunit.client.1.smithi134.stdout:3/629: dwrite d4/f34 [0,4194304] 0 2023-12-05T09:26:23.602 INFO:tasks.workunit.client.1.smithi134.stdout:3/630: fdatasync d4/d5/d7c/f83 0 2023-12-05T09:26:23.602 INFO:tasks.workunit.client.1.smithi134.stdout:4/589: rename d16/d18/d1c/fb1 to d16/d7b/db6/fcd 0 2023-12-05T09:26:23.603 INFO:tasks.workunit.client.1.smithi134.stdout:8/689: write da/de/d16/f26 [4144049,88800] 0 2023-12-05T09:26:23.606 INFO:tasks.workunit.client.0.smithi067.stdout:7/396: mknod d0/d9/d40/d7a/c86 0 2023-12-05T09:26:23.607 INFO:tasks.workunit.client.1.smithi134.stdout:9/569: symlink d7/d8/d14/d26/d5a/d69/dc5/lc6 0 2023-12-05T09:26:23.612 INFO:tasks.workunit.client.0.smithi067.stdout:5/453: symlink db/df/la0 0 2023-12-05T09:26:23.617 INFO:tasks.workunit.client.1.smithi134.stdout:1/712: creat d2/d9/d10/d30/dfe/f100 x:0 0 0 2023-12-05T09:26:23.617 INFO:tasks.workunit.client.1.smithi134.stdout:1/713: dread - d2/d9/d10/d5b/d5e/f93 zero size 2023-12-05T09:26:23.617 INFO:tasks.workunit.client.1.smithi134.stdout:1/714: fdatasync d2/d9/d10/d30/d66/de3/ff6 0 2023-12-05T09:26:23.617 INFO:tasks.workunit.client.1.smithi134.stdout:1/715: chown d2/d9/d8d/da2/db1 15887003 1 2023-12-05T09:26:23.619 INFO:tasks.workunit.client.0.smithi067.stdout:6/322: symlink da/d10/d1e/d17/d2f/d47/d19/l75 0 2023-12-05T09:26:23.619 INFO:tasks.workunit.client.0.smithi067.stdout:6/323: fdatasync da/d10/d1e/d51/f65 0 2023-12-05T09:26:23.622 INFO:tasks.workunit.client.1.smithi134.stdout:7/580: dwrite d2/dd/f19 [0,4194304] 0 2023-12-05T09:26:23.623 INFO:tasks.workunit.client.1.smithi134.stdout:2/631: unlink d19/d3f/c8b 0 2023-12-05T09:26:23.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/561: dwrite d13/fb1 [0,4194304] 0 2023-12-05T09:26:23.627 INFO:tasks.workunit.client.0.smithi067.stdout:4/345: dwrite d0/d1d/d2b/d50/d15/f33 [0,4194304] 0 2023-12-05T09:26:23.627 INFO:tasks.workunit.client.0.smithi067.stdout:9/575: rename d1b/d25/f46 to d1b/d25/d35/d56/fc1 0 2023-12-05T09:26:23.627 INFO:tasks.workunit.client.0.smithi067.stdout:1/424: dread d2/d5/d7/de/f37 [0,4194304] 0 2023-12-05T09:26:23.627 INFO:tasks.workunit.client.0.smithi067.stdout:9/576: getdents d1b/d25/d35/d56/d90 0 2023-12-05T09:26:23.628 INFO:tasks.workunit.client.1.smithi134.stdout:5/565: truncate d0/d1a/d1c/d3f/d5b/d5d/d78/f91 2040213 0 2023-12-05T09:26:23.632 INFO:tasks.workunit.client.0.smithi067.stdout:3/341: unlink d9/da/fd 0 2023-12-05T09:26:23.637 INFO:tasks.workunit.client.0.smithi067.stdout:5/454: unlink db/df/d35/d63/l6d 0 2023-12-05T09:26:23.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/631: mknod d4/d1f/d50/d52/d42/cc6 0 2023-12-05T09:26:23.645 INFO:tasks.workunit.client.0.smithi067.stdout:4/346: mkdir d0/d1d/d2a/d79 0 2023-12-05T09:26:23.646 INFO:tasks.workunit.client.1.smithi134.stdout:8/690: mkdir da/de/d8a/d42/df1 0 2023-12-05T09:26:23.647 INFO:tasks.workunit.client.1.smithi134.stdout:8/691: write da/de/d11/d1d/d70/db0/fd2 [955919,129851] 0 2023-12-05T09:26:23.647 INFO:tasks.workunit.client.1.smithi134.stdout:8/692: dread - da/de/d8a/d42/d99/dc8/d72/fa6 zero size 2023-12-05T09:26:23.647 INFO:tasks.workunit.client.1.smithi134.stdout:8/693: write da/de/d16/d2d/f88 [1248223,124316] 0 2023-12-05T09:26:23.648 INFO:tasks.workunit.client.0.smithi067.stdout:9/577: mkdir d1b/dc2 0 2023-12-05T09:26:23.651 INFO:tasks.workunit.client.0.smithi067.stdout:1/425: truncate d2/f5c 3674822 0 2023-12-05T09:26:23.651 INFO:tasks.workunit.client.1.smithi134.stdout:9/570: dwrite d7/d8/d14/d26/fbd [0,4194304] 0 2023-12-05T09:26:23.655 INFO:tasks.workunit.client.1.smithi134.stdout:1/716: symlink d2/d9/d10/d30/d66/da9/d74/l101 0 2023-12-05T09:26:23.655 INFO:tasks.workunit.client.0.smithi067.stdout:6/324: rename da/d10/d1e/d17/d2f/d2c/d34/d3b/c61 to da/d10/d1e/d17/d2f/d5f/c76 0 2023-12-05T09:26:23.663 INFO:tasks.workunit.client.1.smithi134.stdout:2/632: link d19/c4f d19/ccf 0 2023-12-05T09:26:23.663 INFO:tasks.workunit.client.1.smithi134.stdout:2/633: fdatasync d19/d28/d2b/f5b 0 2023-12-05T09:26:23.664 INFO:tasks.workunit.client.1.smithi134.stdout:9/571: write d7/d8/f4c [2375985,9422] 0 2023-12-05T09:26:23.672 INFO:tasks.workunit.client.1.smithi134.stdout:9/572: dread d7/d8/d14/fad [0,4194304] 0 2023-12-05T09:26:23.672 INFO:tasks.workunit.client.1.smithi134.stdout:9/573: write d7/d8/d14/d26/d5a/d69/fb8 [204160,119231] 0 2023-12-05T09:26:23.675 INFO:tasks.workunit.client.0.smithi067.stdout:7/397: dwrite d0/f11 [0,4194304] 0 2023-12-05T09:26:23.680 INFO:tasks.workunit.client.0.smithi067.stdout:8/373: dwrite d5/dc/d1a/f2f [0,4194304] 0 2023-12-05T09:26:23.683 INFO:tasks.workunit.client.1.smithi134.stdout:0/562: link d13/d14/d15/d67/l5f d13/d14/d59/lbf 0 2023-12-05T09:26:23.684 INFO:tasks.workunit.client.0.smithi067.stdout:4/347: mknod d0/d1d/d3c/d51/c7a 0 2023-12-05T09:26:23.686 INFO:tasks.workunit.client.0.smithi067.stdout:9/578: rmdir d1b/d25/d54/d5c/da6 0 2023-12-05T09:26:23.687 INFO:tasks.workunit.client.0.smithi067.stdout:9/579: creat d1b/d25/d94/fc3 x:0 0 0 2023-12-05T09:26:23.687 INFO:tasks.workunit.client.0.smithi067.stdout:9/580: chown d1b/dc2 0 1 2023-12-05T09:26:23.688 INFO:tasks.workunit.client.1.smithi134.stdout:3/632: creat d4/d1f/fc7 x:0 0 0 2023-12-05T09:26:23.693 INFO:tasks.workunit.client.0.smithi067.stdout:1/426: creat d2/d4f/f9e x:0 0 0 2023-12-05T09:26:23.694 INFO:tasks.workunit.client.0.smithi067.stdout:6/325: creat da/d10/d1e/d17/d2f/f77 x:0 0 0 2023-12-05T09:26:23.697 INFO:tasks.workunit.client.0.smithi067.stdout:1/427: dread d2/d4f/d15/d60/f66 [0,4194304] 0 2023-12-05T09:26:23.697 INFO:tasks.workunit.client.0.smithi067.stdout:1/428: fsync d2/d5/d7/de/d1a/f1b 0 2023-12-05T09:26:23.698 INFO:tasks.workunit.client.0.smithi067.stdout:5/455: rename db/df/d35/d63/d75/c78 to db/df/d36/d57/ca1 0 2023-12-05T09:26:23.698 INFO:tasks.workunit.client.0.smithi067.stdout:5/456: chown db/df/d1a/d1d/d20/f2d 148 1 2023-12-05T09:26:23.699 INFO:tasks.workunit.client.1.smithi134.stdout:4/590: rmdir d16/d18 39 2023-12-05T09:26:23.699 INFO:tasks.workunit.client.1.smithi134.stdout:6/538: sync 2023-12-05T09:26:23.699 INFO:tasks.workunit.client.1.smithi134.stdout:4/591: read - d16/d21/d69/d6e/daa/d3b/d8e/fbb zero size 2023-12-05T09:26:23.699 INFO:tasks.workunit.client.1.smithi134.stdout:4/592: stat d16/d21/d48/d80/f85 0 2023-12-05T09:26:23.699 INFO:tasks.workunit.client.1.smithi134.stdout:4/593: write d16/d21/d69/d6e/daa/d3b/d8e/fbb [764922,76073] 0 2023-12-05T09:26:23.702 INFO:tasks.workunit.client.1.smithi134.stdout:8/694: symlink da/de/d4d/d68/lf2 0 2023-12-05T09:26:23.708 INFO:tasks.workunit.client.0.smithi067.stdout:0/511: dwrite d3/d7/d30/f8c [0,4194304] 0 2023-12-05T09:26:23.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/581: link d2/d7/d2b/d2d/d67/d73/f5b d2/d7/dc/fc0 0 2023-12-05T09:26:23.711 INFO:tasks.workunit.client.0.smithi067.stdout:0/512: chown d3/d7/d30/f55 347146 1 2023-12-05T09:26:23.711 INFO:tasks.workunit.client.0.smithi067.stdout:6/326: dread da/d10/d1e/d17/d2f/f2b [0,4194304] 0 2023-12-05T09:26:23.711 INFO:tasks.workunit.client.0.smithi067.stdout:6/327: fsync da/d10/d1e/d17/d2f/d3f/f64 0 2023-12-05T09:26:23.711 INFO:tasks.workunit.client.1.smithi134.stdout:2/634: creat d19/d76/dba/fd0 x:0 0 0 2023-12-05T09:26:23.711 INFO:tasks.workunit.client.1.smithi134.stdout:0/563: getdents d13/d14/d30/d4b/d66/da0 0 2023-12-05T09:26:23.712 INFO:tasks.workunit.client.1.smithi134.stdout:0/564: dread - d13/d14/d15/fad zero size 2023-12-05T09:26:23.713 INFO:tasks.workunit.client.1.smithi134.stdout:9/574: dwrite d7/d8/f91 [0,4194304] 0 2023-12-05T09:26:23.715 INFO:tasks.workunit.client.1.smithi134.stdout:5/566: getdents d0/d11/d61/d75 0 2023-12-05T09:26:23.716 INFO:tasks.workunit.client.1.smithi134.stdout:8/695: dread da/de/d4d/f79 [0,4194304] 0 2023-12-05T09:26:23.716 INFO:tasks.workunit.client.1.smithi134.stdout:5/567: write d0/d11/f22 [5207211,120350] 0 2023-12-05T09:26:23.717 INFO:tasks.workunit.client.1.smithi134.stdout:5/568: chown d0/d50/fc2 215 1 2023-12-05T09:26:23.717 INFO:tasks.workunit.client.1.smithi134.stdout:3/633: write d4/d5/f1a [1613848,73113] 0 2023-12-05T09:26:23.721 INFO:tasks.workunit.client.1.smithi134.stdout:6/539: symlink d4/d32/d57/l9e 0 2023-12-05T09:26:23.726 INFO:tasks.workunit.client.0.smithi067.stdout:3/342: rmdir d9 39 2023-12-05T09:26:23.728 INFO:tasks.workunit.client.0.smithi067.stdout:2/337: sync 2023-12-05T09:26:23.734 INFO:tasks.workunit.client.0.smithi067.stdout:4/348: rmdir d0/d1d/d2a/d79 0 2023-12-05T09:26:23.737 INFO:tasks.workunit.client.0.smithi067.stdout:1/429: creat d2/d5/d7/de/d19/d49/d5f/f9f x:0 0 0 2023-12-05T09:26:23.739 INFO:tasks.workunit.client.0.smithi067.stdout:5/457: creat db/df/d36/d6c/fa2 x:0 0 0 2023-12-05T09:26:23.739 INFO:tasks.workunit.client.0.smithi067.stdout:5/458: dread - db/df/d1a/d1d/d20/f8f zero size 2023-12-05T09:26:23.742 INFO:tasks.workunit.client.1.smithi134.stdout:1/717: rmdir d2/d9 39 2023-12-05T09:26:23.749 INFO:tasks.workunit.client.0.smithi067.stdout:6/328: creat da/d10/d1e/d17/d2f/d59/d6c/f78 x:0 0 0 2023-12-05T09:26:23.749 INFO:tasks.workunit.client.0.smithi067.stdout:6/329: fdatasync da/d10/d1e/d17/f41 0 2023-12-05T09:26:23.751 INFO:tasks.workunit.client.0.smithi067.stdout:9/581: dwrite d1b/d25/f2d [0,4194304] 0 2023-12-05T09:26:23.751 INFO:tasks.workunit.client.0.smithi067.stdout:9/582: write d1b/d25/f33 [5214332,49607] 0 2023-12-05T09:26:23.751 INFO:tasks.workunit.client.0.smithi067.stdout:9/583: fdatasync d1b/f75 0 2023-12-05T09:26:23.752 INFO:tasks.workunit.client.1.smithi134.stdout:9/575: link d7/d8/d14/d26/d7f/d92/f8e d7/d8/d14/fc7 0 2023-12-05T09:26:23.752 INFO:tasks.workunit.client.1.smithi134.stdout:9/576: write f1 [1418172,70761] 0 2023-12-05T09:26:23.752 INFO:tasks.workunit.client.1.smithi134.stdout:9/577: write d7/d8/d14/f25 [6615134,76592] 0 2023-12-05T09:26:23.753 INFO:tasks.workunit.client.0.smithi067.stdout:7/398: getdents d0/d9/d10/d37/d38 0 2023-12-05T09:26:23.755 INFO:tasks.workunit.client.1.smithi134.stdout:5/569: symlink d0/d45/daf/lc4 0 2023-12-05T09:26:23.760 INFO:tasks.workunit.client.1.smithi134.stdout:3/634: truncate d4/d1f/d4e/f61 1557870 0 2023-12-05T09:26:23.765 INFO:tasks.workunit.client.0.smithi067.stdout:0/513: dwrite d3/df/d10/f37 [0,4194304] 0 2023-12-05T09:26:23.770 INFO:tasks.workunit.client.0.smithi067.stdout:2/338: read d0/d15/d53/f19 [1439847,101101] 0 2023-12-05T09:26:23.770 INFO:tasks.workunit.client.0.smithi067.stdout:2/339: creat d0/d2f/d39/f75 x:0 0 0 2023-12-05T09:26:23.770 INFO:tasks.workunit.client.0.smithi067.stdout:2/340: creat d0/d15/f76 x:0 0 0 2023-12-05T09:26:23.777 INFO:tasks.workunit.client.1.smithi134.stdout:5/570: read d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/f92 [1064313,104757] 0 2023-12-05T09:26:23.779 INFO:tasks.workunit.client.1.smithi134.stdout:0/565: dwrite d13/d14/d30/d2c/f47 [0,4194304] 0 2023-12-05T09:26:23.780 INFO:tasks.workunit.client.1.smithi134.stdout:6/540: mkdir d4/d39/d42/d4f/d6d/d9f 0 2023-12-05T09:26:23.794 INFO:tasks.workunit.client.0.smithi067.stdout:2/341: dread d0/fe [0,4194304] 0 2023-12-05T09:26:23.795 INFO:tasks.workunit.client.1.smithi134.stdout:4/594: rmdir d16/d21/d69 39 2023-12-05T09:26:23.796 INFO:tasks.workunit.client.0.smithi067.stdout:8/374: rmdir d5 39 2023-12-05T09:26:23.796 INFO:tasks.workunit.client.0.smithi067.stdout:8/375: truncate d5/dc/d1a/d20/f4e 852398 0 2023-12-05T09:26:23.797 INFO:tasks.workunit.client.0.smithi067.stdout:8/376: write d5/da/f56 [1048669,104352] 0 2023-12-05T09:26:23.801 INFO:tasks.workunit.client.0.smithi067.stdout:1/430: mknod d2/d5/d7/de/d19/d71/ca0 0 2023-12-05T09:26:23.801 INFO:tasks.workunit.client.1.smithi134.stdout:0/566: dread d13/d14/d30/d4b/f4e [0,4194304] 0 2023-12-05T09:26:23.804 INFO:tasks.workunit.client.0.smithi067.stdout:5/459: rename db/df/d1a/d1d/d20/c8b to db/df/d36/d6c/ca3 0 2023-12-05T09:26:23.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/718: creat d2/d9/d10/d94/de5/f102 x:0 0 0 2023-12-05T09:26:23.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/719: fdatasync d2/d9/d10/d30/d66/da9/feb 0 2023-12-05T09:26:23.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/720: chown d2/d9/d10/d5b/d5e/l8b 43209209 1 2023-12-05T09:26:23.811 INFO:tasks.workunit.client.0.smithi067.stdout:9/584: symlink d1b/d25/d5b/d62/lc4 0 2023-12-05T09:26:23.811 INFO:tasks.workunit.client.0.smithi067.stdout:9/585: fsync d1b/d25/f70 0 2023-12-05T09:26:23.811 INFO:tasks.workunit.client.0.smithi067.stdout:9/586: truncate d1b/d25/d94/fa1 652796 0 2023-12-05T09:26:23.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/595: dread d16/d18/d1b/d24/f61 [0,4194304] 0 2023-12-05T09:26:23.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/596: write d16/d21/d69/d6e/daa/d3b/f5c [4363659,71578] 0 2023-12-05T09:26:23.814 INFO:tasks.workunit.client.0.smithi067.stdout:0/514: write d3/df/f18 [1790009,36349] 0 2023-12-05T09:26:23.814 INFO:tasks.workunit.client.1.smithi134.stdout:4/597: write d16/d7b/d6f/f87 [253750,94850] 0 2023-12-05T09:26:23.814 INFO:tasks.workunit.client.1.smithi134.stdout:4/598: chown d16/d21/d48/d80/dae/d65/f72 53564 1 2023-12-05T09:26:23.814 INFO:tasks.workunit.client.1.smithi134.stdout:2/635: rmdir d19/d76 39 2023-12-05T09:26:23.819 INFO:tasks.workunit.client.0.smithi067.stdout:6/330: dwrite da/d10/d1e/d17/d2f/f77 [0,4194304] 0 2023-12-05T09:26:23.819 INFO:tasks.workunit.client.0.smithi067.stdout:6/331: fsync da/d10/d1e/d17/f41 0 2023-12-05T09:26:23.820 INFO:tasks.workunit.client.0.smithi067.stdout:6/332: write da/d10/d1e/d17/d2f/d2c/d34/f74 [358514,122524] 0 2023-12-05T09:26:23.824 INFO:tasks.workunit.client.0.smithi067.stdout:9/587: dread d1b/f31 [0,4194304] 0 2023-12-05T09:26:23.828 INFO:tasks.workunit.client.0.smithi067.stdout:2/342: mkdir d0/d15/d63/d77 0 2023-12-05T09:26:23.828 INFO:tasks.workunit.client.0.smithi067.stdout:2/343: fdatasync d0/d25/f59 0 2023-12-05T09:26:23.828 INFO:tasks.workunit.client.1.smithi134.stdout:3/635: symlink d4/d5/d45/d60/d85/dab/lc8 0 2023-12-05T09:26:23.830 INFO:tasks.workunit.client.1.smithi134.stdout:5/571: truncate d0/dd/f2c 146899 0 2023-12-05T09:26:23.831 INFO:tasks.workunit.client.1.smithi134.stdout:5/572: creat d0/d1a/d1c/d25/d4d/d9e/fc5 x:0 0 0 2023-12-05T09:26:23.834 INFO:tasks.workunit.client.0.smithi067.stdout:4/349: getdents d0/d1d/d53 0 2023-12-05T09:26:23.835 INFO:tasks.workunit.client.0.smithi067.stdout:1/431: rename d2/d4f/d14/c31 to d2/d5/d7/ca1 0 2023-12-05T09:26:23.837 INFO:tasks.workunit.client.1.smithi134.stdout:6/541: unlink d4/d39/f3e 0 2023-12-05T09:26:23.838 INFO:tasks.workunit.client.0.smithi067.stdout:5/460: rmdir db/df/d3f/d88/d8d 39 2023-12-05T09:26:23.838 INFO:tasks.workunit.client.0.smithi067.stdout:5/461: fdatasync db/df/d3f/f60 0 2023-12-05T09:26:23.843 INFO:tasks.workunit.client.1.smithi134.stdout:4/599: dread d16/d21/f3f [0,4194304] 0 2023-12-05T09:26:23.846 INFO:tasks.workunit.client.0.smithi067.stdout:0/515: creat d3/d7/d3c/d66/d90/fb9 x:0 0 0 2023-12-05T09:26:23.852 INFO:tasks.workunit.client.0.smithi067.stdout:9/588: mkdir d1b/d25/d54/d5c/dc5 0 2023-12-05T09:26:23.853 INFO:tasks.workunit.client.0.smithi067.stdout:4/350: creat d0/d1d/f7b x:0 0 0 2023-12-05T09:26:23.853 INFO:tasks.workunit.client.0.smithi067.stdout:4/351: stat d0/d1d/d25/d32 0 2023-12-05T09:26:23.853 INFO:tasks.workunit.client.0.smithi067.stdout:4/352: write d0/d1d/d24/f73 [979110,94335] 0 2023-12-05T09:26:23.853 INFO:tasks.workunit.client.0.smithi067.stdout:4/353: write d0/d1d/d25/d2c/d34/f55 [866265,126494] 0 2023-12-05T09:26:23.855 INFO:tasks.workunit.client.0.smithi067.stdout:1/432: unlink d2/d5/l27 0 2023-12-05T09:26:23.855 INFO:tasks.workunit.client.0.smithi067.stdout:0/516: symlink d3/d7/d3c/d66/d90/d99/db4/lba 0 2023-12-05T09:26:23.855 INFO:tasks.workunit.client.0.smithi067.stdout:6/333: getdents da/d10/d1e/d17 0 2023-12-05T09:26:23.856 INFO:tasks.workunit.client.0.smithi067.stdout:9/589: truncate d1b/d25/d35/d56/f5a 1709188 0 2023-12-05T09:26:23.857 INFO:tasks.workunit.client.0.smithi067.stdout:4/354: rmdir d0/d1d/d53 39 2023-12-05T09:26:23.859 INFO:tasks.workunit.client.0.smithi067.stdout:1/433: mknod d2/d4f/ca2 0 2023-12-05T09:26:23.859 INFO:tasks.workunit.client.0.smithi067.stdout:1/434: fdatasync d2/d5/d7/de/f3a 0 2023-12-05T09:26:23.860 INFO:tasks.workunit.client.0.smithi067.stdout:9/590: creat d1b/d25/d35/d9b/fc6 x:0 0 0 2023-12-05T09:26:23.861 INFO:tasks.workunit.client.1.smithi134.stdout:2/636: creat d19/d28/d31/d38/d98/fd1 x:0 0 0 2023-12-05T09:26:23.862 INFO:tasks.workunit.client.0.smithi067.stdout:1/435: symlink d2/d4f/d15/la3 0 2023-12-05T09:26:23.862 INFO:tasks.workunit.client.0.smithi067.stdout:1/436: fdatasync d2/d4f/d14/d20/f26 0 2023-12-05T09:26:23.862 INFO:tasks.workunit.client.0.smithi067.stdout:1/437: write d2/d4f/d14/f3c [1637371,10934] 0 2023-12-05T09:26:23.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/343: dwrite d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:23.868 INFO:tasks.workunit.client.0.smithi067.stdout:1/438: write d2/d4f/d15/d60/d68/f75 [522245,94806] 0 2023-12-05T09:26:23.870 INFO:tasks.workunit.client.0.smithi067.stdout:9/591: mkdir d1b/d25/d35/d56/dc7 0 2023-12-05T09:26:23.870 INFO:tasks.workunit.client.0.smithi067.stdout:3/344: truncate d9/fe 2458831 0 2023-12-05T09:26:23.879 INFO:tasks.workunit.client.0.smithi067.stdout:9/592: rename d1b/d25/d54/d5c/d6a/d82/c9d to d1b/d25/d54/d5c/d81/cc8 0 2023-12-05T09:26:23.879 INFO:tasks.workunit.client.0.smithi067.stdout:9/593: getdents d1b/d3e 0 2023-12-05T09:26:23.879 INFO:tasks.workunit.client.0.smithi067.stdout:9/594: truncate d1b/d25/d54/d5c/f72 5037824 0 2023-12-05T09:26:23.881 INFO:tasks.workunit.client.0.smithi067.stdout:8/377: dwrite d5/f45 [0,4194304] 0 2023-12-05T09:26:23.882 INFO:tasks.workunit.client.0.smithi067.stdout:3/345: link f6 d9/da/d15/d17/d1a/f77 0 2023-12-05T09:26:23.882 INFO:tasks.workunit.client.0.smithi067.stdout:3/346: chown d9/da/d15/d17/d1a/d51/d66/c6f 148319 1 2023-12-05T09:26:23.886 INFO:tasks.workunit.client.0.smithi067.stdout:1/439: read d2/d5/d7/de/d19/d49/d5f/f79 [2585118,113594] 0 2023-12-05T09:26:23.886 INFO:tasks.workunit.client.0.smithi067.stdout:1/440: read - d2/d3/f96 zero size 2023-12-05T09:26:23.888 INFO:tasks.workunit.client.1.smithi134.stdout:1/721: dwrite d2/d9/d10/d30/dfe/f100 [0,4194304] 0 2023-12-05T09:26:23.888 INFO:tasks.workunit.client.1.smithi134.stdout:1/722: stat d2/d9/d10/f5a 0 2023-12-05T09:26:23.888 INFO:tasks.workunit.client.1.smithi134.stdout:4/600: rename d16/d21/d69 to d16/d7b/dce 0 2023-12-05T09:26:23.889 INFO:tasks.workunit.client.1.smithi134.stdout:6/542: mkdir d4/d39/d42/d4f/d6d/d3a/da/da0 0 2023-12-05T09:26:23.889 INFO:tasks.workunit.client.1.smithi134.stdout:2/637: creat d19/d76/fd2 x:0 0 0 2023-12-05T09:26:23.890 INFO:tasks.workunit.client.0.smithi067.stdout:0/517: dread d3/fb [0,4194304] 0 2023-12-05T09:26:23.890 INFO:tasks.workunit.client.0.smithi067.stdout:0/518: readlink d3/d7/d3c/d6c/lb6 0 2023-12-05T09:26:23.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/696: sync 2023-12-05T09:26:23.891 INFO:tasks.workunit.client.1.smithi134.stdout:7/582: sync 2023-12-05T09:26:23.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/697: truncate da/de/d8a/d42/f63 2943558 0 2023-12-05T09:26:23.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/698: truncate da/de/f54 4263665 0 2023-12-05T09:26:23.892 INFO:tasks.workunit.client.0.smithi067.stdout:7/399: dwrite d0/d9/d10/d37/f28 [4194304,4194304] 0 2023-12-05T09:26:23.893 INFO:tasks.workunit.client.0.smithi067.stdout:8/378: unlink d5/dc/d1a/d20/d3e/c51 0 2023-12-05T09:26:23.893 INFO:tasks.workunit.client.0.smithi067.stdout:3/347: unlink d9/da/l76 0 2023-12-05T09:26:23.893 INFO:tasks.workunit.client.0.smithi067.stdout:3/348: write f3 [1429930,40844] 0 2023-12-05T09:26:23.894 INFO:tasks.workunit.client.1.smithi134.stdout:1/723: dread d2/f43 [0,4194304] 0 2023-12-05T09:26:23.894 INFO:tasks.workunit.client.1.smithi134.stdout:1/724: creat d2/d27/d40/f103 x:0 0 0 2023-12-05T09:26:23.894 INFO:tasks.workunit.client.1.smithi134.stdout:1/725: chown d2/d9/d10/f47 206411 1 2023-12-05T09:26:23.897 INFO:tasks.workunit.client.1.smithi134.stdout:0/567: dwrite d13/d14/d15/d2a/d8c/fbb [4194304,4194304] 0 2023-12-05T09:26:23.897 INFO:tasks.workunit.client.1.smithi134.stdout:0/568: chown d13/d14/d30/d4b/d23/d77/ca6 4 1 2023-12-05T09:26:23.897 INFO:tasks.workunit.client.1.smithi134.stdout:4/601: stat d16/d21/l84 0 2023-12-05T09:26:23.897 INFO:tasks.workunit.client.1.smithi134.stdout:0/569: fdatasync d13/d14/d15/d2a/f4c 0 2023-12-05T09:26:23.898 INFO:tasks.workunit.client.0.smithi067.stdout:1/441: mknod d2/d4f/d14/d48/ca4 0 2023-12-05T09:26:23.898 INFO:tasks.workunit.client.0.smithi067.stdout:1/442: stat d2/d5/d7/de/d19/d49/f56 0 2023-12-05T09:26:23.898 INFO:tasks.workunit.client.0.smithi067.stdout:1/443: truncate d2/f24 5214659 0 2023-12-05T09:26:23.898 INFO:tasks.workunit.client.0.smithi067.stdout:2/344: dwrite d0/d15/f73 [0,4194304] 0 2023-12-05T09:26:23.899 INFO:tasks.workunit.client.0.smithi067.stdout:0/519: getdents d3/d7/d3c/d67 0 2023-12-05T09:26:23.899 INFO:tasks.workunit.client.0.smithi067.stdout:0/520: stat d3/da2 0 2023-12-05T09:26:23.900 INFO:tasks.workunit.client.1.smithi134.stdout:6/543: mknod d4/d39/d42/d4f/ca1 0 2023-12-05T09:26:23.904 INFO:tasks.workunit.client.0.smithi067.stdout:6/334: dread da/d10/d1e/d17/d2f/d2c/d34/f74 [0,4194304] 0 2023-12-05T09:26:23.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/638: unlink d19/d28/d2b/l2e 0 2023-12-05T09:26:23.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/639: dread - d19/d28/f47 zero size 2023-12-05T09:26:23.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/640: getdents d19/d28/d31/d38/d98/db5 0 2023-12-05T09:26:23.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/641: truncate f1 5125109 0 2023-12-05T09:26:23.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/642: fdatasync d19/d28/f4e 0 2023-12-05T09:26:23.916 INFO:tasks.workunit.client.1.smithi134.stdout:8/699: mkdir da/de/d11/d1d/db8/df3 0 2023-12-05T09:26:23.916 INFO:tasks.workunit.client.0.smithi067.stdout:1/444: dread d2/d5/d7/de/f37 [0,4194304] 0 2023-12-05T09:26:23.918 INFO:tasks.workunit.client.0.smithi067.stdout:7/400: dread d0/d9/f58 [0,4194304] 0 2023-12-05T09:26:23.925 INFO:tasks.workunit.client.0.smithi067.stdout:9/595: getdents d1b/d25/d35/d56 0 2023-12-05T09:26:23.926 INFO:tasks.workunit.client.1.smithi134.stdout:5/573: dwrite d0/d1a/d3a/f49 [0,4194304] 0 2023-12-05T09:26:23.926 INFO:tasks.workunit.client.1.smithi134.stdout:5/574: stat d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/f92 0 2023-12-05T09:26:23.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/636: dwrite d4/f2f [4194304,4194304] 0 2023-12-05T09:26:23.939 INFO:tasks.workunit.client.0.smithi067.stdout:3/349: rmdir d9/d24 39 2023-12-05T09:26:23.947 INFO:tasks.workunit.client.0.smithi067.stdout:2/345: mkdir d0/d25/d34/d4d/d78 0 2023-12-05T09:26:23.948 INFO:tasks.workunit.client.0.smithi067.stdout:2/346: chown d0/d25/d3a/f43 539 1 2023-12-05T09:26:23.948 INFO:tasks.workunit.client.0.smithi067.stdout:2/347: dread - d0/d15/f66 zero size 2023-12-05T09:26:23.950 INFO:tasks.workunit.client.0.smithi067.stdout:8/379: dwrite d5/f14 [0,4194304] 0 2023-12-05T09:26:23.950 INFO:tasks.workunit.client.0.smithi067.stdout:8/380: write d5/dc/d1a/f5a [2488279,45742] 0 2023-12-05T09:26:23.951 INFO:tasks.workunit.client.1.smithi134.stdout:7/583: dwrite d2/d7/dc/d22/f9f [0,4194304] 0 2023-12-05T09:26:23.951 INFO:tasks.workunit.client.1.smithi134.stdout:7/584: fdatasync d2/d7/dc/d22/f4a 0 2023-12-05T09:26:23.951 INFO:tasks.workunit.client.1.smithi134.stdout:3/637: dread d4/d1f/d50/d52/d42/f2a [0,4194304] 0 2023-12-05T09:26:23.958 INFO:tasks.workunit.client.0.smithi067.stdout:0/521: mknod d3/d6b/cbb 0 2023-12-05T09:26:23.959 INFO:tasks.workunit.client.0.smithi067.stdout:1/445: mkdir d2/d5/d7/d6a/da5 0 2023-12-05T09:26:23.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/596: rename d1b/d25/d5b/d62/f63 to d1b/d25/d54/fc9 0 2023-12-05T09:26:23.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/597: stat d1b/d25/l45 0 2023-12-05T09:26:23.964 INFO:tasks.workunit.client.0.smithi067.stdout:9/598: fsync d1b/f24 0 2023-12-05T09:26:23.966 INFO:tasks.workunit.client.1.smithi134.stdout:0/570: rename d13/d14/d30/d4b/c54 to d13/d14/d30/d4b/d23/cc0 0 2023-12-05T09:26:23.966 INFO:tasks.workunit.client.1.smithi134.stdout:0/571: truncate d13/f38 4893941 0 2023-12-05T09:26:23.966 INFO:tasks.workunit.client.1.smithi134.stdout:0/572: fsync f8 0 2023-12-05T09:26:23.967 INFO:tasks.workunit.client.0.smithi067.stdout:2/348: truncate d0/fd 1680893 0 2023-12-05T09:26:23.967 INFO:tasks.workunit.client.0.smithi067.stdout:2/349: readlink d0/l17 0 2023-12-05T09:26:23.968 INFO:tasks.workunit.client.0.smithi067.stdout:2/350: chown d0/d15/d53/c13 24421 1 2023-12-05T09:26:23.968 INFO:tasks.workunit.client.0.smithi067.stdout:2/351: write d0/f41 [902635,8541] 0 2023-12-05T09:26:23.970 INFO:tasks.workunit.client.1.smithi134.stdout:6/544: creat d4/d39/d42/d4f/d6d/d45/d8c/fa2 x:0 0 0 2023-12-05T09:26:23.973 INFO:tasks.workunit.client.0.smithi067.stdout:1/446: unlink d2/d4f/d14/l90 0 2023-12-05T09:26:23.974 INFO:tasks.workunit.client.1.smithi134.stdout:7/585: dread d2/d7/dc/d2e/d3a/f3b [0,4194304] 0 2023-12-05T09:26:23.974 INFO:tasks.workunit.client.1.smithi134.stdout:1/726: dwrite d2/d9/d10/f67 [0,4194304] 0 2023-12-05T09:26:23.974 INFO:tasks.workunit.client.1.smithi134.stdout:7/586: write d2/d7/d2b/d94/fb2 [905216,109988] 0 2023-12-05T09:26:23.975 INFO:tasks.workunit.client.1.smithi134.stdout:8/700: creat da/de/d16/d2d/ff4 x:0 0 0 2023-12-05T09:26:23.975 INFO:tasks.workunit.client.1.smithi134.stdout:8/701: write da/de/d11/d1d/db8/fe3 [292019,130354] 0 2023-12-05T09:26:23.975 INFO:tasks.workunit.client.1.smithi134.stdout:8/702: readlink da/de/d16/d33/lf0 0 2023-12-05T09:26:23.975 INFO:tasks.workunit.client.1.smithi134.stdout:8/703: chown da/de/d16/d33/f38 9 1 2023-12-05T09:26:23.976 INFO:tasks.workunit.client.0.smithi067.stdout:9/599: mkdir d1b/d25/d35/d9b/dca 0 2023-12-05T09:26:23.976 INFO:tasks.workunit.client.0.smithi067.stdout:9/600: dread - d1b/d25/d54/d5c/fa8 zero size 2023-12-05T09:26:23.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/601: creat d1b/fcb x:0 0 0 2023-12-05T09:26:23.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/602: readlink d1b/l58 0 2023-12-05T09:26:23.977 INFO:tasks.workunit.client.1.smithi134.stdout:3/638: dread d4/f1b [0,4194304] 0 2023-12-05T09:26:23.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/603: read d1b/d25/d35/d56/fc1 [51797,29975] 0 2023-12-05T09:26:23.977 INFO:tasks.workunit.client.0.smithi067.stdout:9/604: write d1b/d3e/f53 [887506,63147] 0 2023-12-05T09:26:23.979 INFO:tasks.workunit.client.0.smithi067.stdout:2/352: rmdir d0/d15/d63/d77 0 2023-12-05T09:26:23.982 INFO:tasks.workunit.client.1.smithi134.stdout:5/575: symlink d0/d66/lc6 0 2023-12-05T09:26:23.983 INFO:tasks.workunit.client.0.smithi067.stdout:1/447: getdents d2/d4f/d15/d74 0 2023-12-05T09:26:23.991 INFO:tasks.workunit.client.1.smithi134.stdout:4/602: rename d16/d7b/dbd to d16/d7b/dce/d6e/daa/d3b/dcf 0 2023-12-05T09:26:23.991 INFO:tasks.workunit.client.1.smithi134.stdout:4/603: dread - d16/d21/d48/d80/dae/f8a zero size 2023-12-05T09:26:23.993 INFO:tasks.workunit.client.0.smithi067.stdout:2/353: creat d0/d25/d3f/f79 x:0 0 0 2023-12-05T09:26:23.994 INFO:tasks.workunit.client.1.smithi134.stdout:9/578: sync 2023-12-05T09:26:23.994 INFO:tasks.workunit.client.1.smithi134.stdout:0/573: mkdir d13/d14/d30/d4b/dc1 0 2023-12-05T09:26:24.006 INFO:tasks.workunit.client.0.smithi067.stdout:6/335: dwrite da/d10/d1e/f36 [0,4194304] 0 2023-12-05T09:26:24.012 INFO:tasks.workunit.client.1.smithi134.stdout:1/727: creat d2/d9/f104 x:0 0 0 2023-12-05T09:26:24.012 INFO:tasks.workunit.client.1.smithi134.stdout:1/728: chown d2/d9/d10/d5b/ffd 5819079 1 2023-12-05T09:26:24.012 INFO:tasks.workunit.client.1.smithi134.stdout:1/729: chown d2/d27/d40/f84 1147 1 2023-12-05T09:26:24.012 INFO:tasks.workunit.client.1.smithi134.stdout:1/730: write d2/d9/d10/d5b/d5e/f6d [2511894,38485] 0 2023-12-05T09:26:24.016 INFO:tasks.workunit.client.1.smithi134.stdout:8/704: mkdir da/de/d8a/d42/d99/df5 0 2023-12-05T09:26:24.016 INFO:tasks.workunit.client.1.smithi134.stdout:8/705: dread - da/de/d8a/d42/d99/dc8/fe7 zero size 2023-12-05T09:26:24.018 INFO:tasks.workunit.client.1.smithi134.stdout:5/576: mknod d0/d1a/d1c/cc7 0 2023-12-05T09:26:24.018 INFO:tasks.workunit.client.1.smithi134.stdout:5/577: stat d0/d1a/d1c/d25/f56 0 2023-12-05T09:26:24.018 INFO:tasks.workunit.client.1.smithi134.stdout:5/578: chown d0/f46 0 1 2023-12-05T09:26:24.026 INFO:tasks.workunit.client.0.smithi067.stdout:9/605: rmdir d1b 39 2023-12-05T09:26:24.026 INFO:tasks.workunit.client.0.smithi067.stdout:9/606: chown d1b/d25/d54/d5c/d6a/d82/fb2 74 1 2023-12-05T09:26:24.028 INFO:tasks.workunit.client.1.smithi134.stdout:4/604: creat d16/d21/d47/d4b/fd0 x:0 0 0 2023-12-05T09:26:24.030 INFO:tasks.workunit.client.1.smithi134.stdout:9/579: rmdir d7/d8/d16/d52/d74/d97 39 2023-12-05T09:26:24.031 INFO:tasks.workunit.client.1.smithi134.stdout:2/643: sync 2023-12-05T09:26:24.032 INFO:tasks.workunit.client.1.smithi134.stdout:0/574: creat d13/d14/d15/d2a/fc2 x:0 0 0 2023-12-05T09:26:24.032 INFO:tasks.workunit.client.0.smithi067.stdout:6/336: mkdir da/d10/d1e/d17/d2f/d47/d79 0 2023-12-05T09:26:24.033 INFO:tasks.workunit.client.0.smithi067.stdout:6/337: creat da/d10/d1e/d51/f7a x:0 0 0 2023-12-05T09:26:24.034 INFO:tasks.workunit.client.1.smithi134.stdout:6/545: link d4/d39/d42/d4f/d6d/d3a/d75/f29 d4/d39/d42/d4f/d6d/d3a/d80/fa3 0 2023-12-05T09:26:24.035 INFO:tasks.workunit.client.0.smithi067.stdout:1/448: dwrite d2/d5/d7/de/d19/d49/d6d/f5b [0,4194304] 0 2023-12-05T09:26:24.035 INFO:tasks.workunit.client.0.smithi067.stdout:2/354: link d0/d25/d3f/f79 d0/f7a 0 2023-12-05T09:26:24.036 INFO:tasks.workunit.client.1.smithi134.stdout:1/731: creat d2/d9/d10/d30/d66/da9/d74/f105 x:0 0 0 2023-12-05T09:26:24.036 INFO:tasks.workunit.client.1.smithi134.stdout:1/732: chown d2/l34 80 1 2023-12-05T09:26:24.036 INFO:tasks.workunit.client.1.smithi134.stdout:1/733: stat d2/d9/d10/d5b/cd2 0 2023-12-05T09:26:24.036 INFO:tasks.workunit.client.1.smithi134.stdout:1/734: chown d2/d9/d10/d30/d66/de3/lf7 446 1 2023-12-05T09:26:24.037 INFO:tasks.workunit.client.1.smithi134.stdout:8/706: mknod da/de/d96/cf6 0 2023-12-05T09:26:24.038 INFO:tasks.workunit.client.1.smithi134.stdout:8/707: dread - da/de/f41 zero size 2023-12-05T09:26:24.040 INFO:tasks.workunit.client.0.smithi067.stdout:6/338: rmdir da/d6d 0 2023-12-05T09:26:24.041 INFO:tasks.workunit.client.1.smithi134.stdout:7/587: dwrite d2/d7/d6f/f90 [0,4194304] 0 2023-12-05T09:26:24.042 INFO:tasks.workunit.client.1.smithi134.stdout:5/579: symlink d0/d1a/d1c/d3f/d81/d8e/lc8 0 2023-12-05T09:26:24.045 INFO:tasks.workunit.client.0.smithi067.stdout:9/607: dread d1b/f5f [0,4194304] 0 2023-12-05T09:26:24.046 INFO:tasks.workunit.client.1.smithi134.stdout:4/605: rmdir d16/d21/d48 39 2023-12-05T09:26:24.050 INFO:tasks.workunit.client.0.smithi067.stdout:6/339: truncate da/d10/d1e/d17/f40 585878 0 2023-12-05T09:26:24.050 INFO:tasks.workunit.client.0.smithi067.stdout:6/340: write da/d10/f5e [1990946,121993] 0 2023-12-05T09:26:24.050 INFO:tasks.workunit.client.1.smithi134.stdout:0/575: dread d13/d14/d59/f82 [0,4194304] 0 2023-12-05T09:26:24.050 INFO:tasks.workunit.client.1.smithi134.stdout:0/576: write f7 [1673498,98472] 0 2023-12-05T09:26:24.053 INFO:tasks.workunit.client.1.smithi134.stdout:2/644: truncate d19/d28/d31/d6f/f84 1892991 0 2023-12-05T09:26:24.054 INFO:tasks.workunit.client.0.smithi067.stdout:9/608: rmdir d1b/d25/d35/d9b 39 2023-12-05T09:26:24.054 INFO:tasks.workunit.client.0.smithi067.stdout:9/609: fsync d1b/d25/d54/d5c/d6a/d6c/d76/f7b 0 2023-12-05T09:26:24.054 INFO:tasks.workunit.client.0.smithi067.stdout:1/449: mkdir d2/d3/da6 0 2023-12-05T09:26:24.054 INFO:tasks.workunit.client.0.smithi067.stdout:1/450: write d2/d3/f3d [3634339,93221] 0 2023-12-05T09:26:24.055 INFO:tasks.workunit.client.1.smithi134.stdout:8/708: creat da/de/d4d/ff7 x:0 0 0 2023-12-05T09:26:24.058 INFO:tasks.workunit.client.0.smithi067.stdout:9/610: rmdir d1b/d25/d54/d5c/d81/d96 39 2023-12-05T09:26:24.060 INFO:tasks.workunit.client.0.smithi067.stdout:7/401: dwrite d0/d9/d10/d37/d38/f75 [0,4194304] 0 2023-12-05T09:26:24.060 INFO:tasks.workunit.client.0.smithi067.stdout:7/402: dread - d0/d9/d40/d48/f63 zero size 2023-12-05T09:26:24.063 INFO:tasks.workunit.client.1.smithi134.stdout:7/588: truncate d2/df/f79 1512030 0 2023-12-05T09:26:24.063 INFO:tasks.workunit.client.1.smithi134.stdout:7/589: chown d2 1356 1 2023-12-05T09:26:24.063 INFO:tasks.workunit.client.1.smithi134.stdout:7/590: write d2/d7/d6f/f90 [6568899,34613] 0 2023-12-05T09:26:24.064 INFO:tasks.workunit.client.0.smithi067.stdout:1/451: rmdir d2/d5/d7 39 2023-12-05T09:26:24.064 INFO:tasks.workunit.client.0.smithi067.stdout:1/452: fsync d2/d5/f6f 0 2023-12-05T09:26:24.064 INFO:tasks.workunit.client.0.smithi067.stdout:1/453: creat d2/fa7 x:0 0 0 2023-12-05T09:26:24.069 INFO:tasks.workunit.client.1.smithi134.stdout:5/580: truncate d0/dd/f14 3529849 0 2023-12-05T09:26:24.069 INFO:tasks.workunit.client.1.smithi134.stdout:5/581: fsync d0/dd/f94 0 2023-12-05T09:26:24.070 INFO:tasks.workunit.client.0.smithi067.stdout:9/611: creat d1b/d25/d54/fcc x:0 0 0 2023-12-05T09:26:24.074 INFO:tasks.workunit.client.0.smithi067.stdout:6/341: dread da/d10/f11 [0,4194304] 0 2023-12-05T09:26:24.075 INFO:tasks.workunit.client.1.smithi134.stdout:3/639: rename d4/d1f/d50/d52/d42 to d4/d5/d6f/d97/dae/dc9 0 2023-12-05T09:26:24.075 INFO:tasks.workunit.client.1.smithi134.stdout:9/580: rename d7/d8/d16/d52/d74 to d7/d8/d16/d52/d74/dc8 22 2023-12-05T09:26:24.077 INFO:tasks.workunit.client.1.smithi134.stdout:4/606: symlink d16/d21/d48/ld1 0 2023-12-05T09:26:24.081 INFO:tasks.workunit.client.1.smithi134.stdout:0/577: mknod d13/d14/d30/d2c/d9d/da5/cc3 0 2023-12-05T09:26:24.081 INFO:tasks.workunit.client.0.smithi067.stdout:1/454: truncate d2/d5/d7/de/f37 1424707 0 2023-12-05T09:26:24.081 INFO:tasks.workunit.client.0.smithi067.stdout:1/455: write d2/d5/d7/de/d19/d49/d6d/f5b [5173779,39422] 0 2023-12-05T09:26:24.084 INFO:tasks.workunit.client.0.smithi067.stdout:7/403: write d0/d9/d10/d37/f2a [1366069,112911] 0 2023-12-05T09:26:24.089 INFO:tasks.workunit.client.1.smithi134.stdout:6/546: mkdir d4/d39/d42/d4f/d6d/d3a/da/da4 0 2023-12-05T09:26:24.090 INFO:tasks.workunit.client.0.smithi067.stdout:9/612: mkdir d1b/d25/d54/d5c/d6a/d6c/dcd 0 2023-12-05T09:26:24.095 INFO:tasks.workunit.client.1.smithi134.stdout:1/735: dwrite d2/d9/d10/d94/fd9 [0,4194304] 0 2023-12-05T09:26:24.096 INFO:tasks.workunit.client.1.smithi134.stdout:8/709: link da/de/d11/d1d/d5f/d9b/cbb da/de/d16/d2d/cf8 0 2023-12-05T09:26:24.096 INFO:tasks.workunit.client.1.smithi134.stdout:8/710: truncate da/de/d4d/f6c 2123954 0 2023-12-05T09:26:24.100 INFO:tasks.workunit.client.0.smithi067.stdout:6/342: rmdir da/d10/d1e/d17/d2f/d59 39 2023-12-05T09:26:24.101 INFO:tasks.workunit.client.1.smithi134.stdout:5/582: symlink d0/d1a/d3a/lc9 0 2023-12-05T09:26:24.105 INFO:tasks.workunit.client.0.smithi067.stdout:3/350: dwrite d9/da/f22 [0,4194304] 0 2023-12-05T09:26:24.106 INFO:tasks.workunit.client.1.smithi134.stdout:4/607: link f15 d16/d21/d48/d80/fd2 0 2023-12-05T09:26:24.108 INFO:tasks.workunit.client.0.smithi067.stdout:7/404: dread d0/d9/d10/f32 [0,4194304] 0 2023-12-05T09:26:24.110 INFO:tasks.workunit.client.1.smithi134.stdout:6/547: symlink d4/la5 0 2023-12-05T09:26:24.111 INFO:tasks.workunit.client.1.smithi134.stdout:6/548: fsync d4/d32/f84 0 2023-12-05T09:26:24.123 INFO:tasks.workunit.client.1.smithi134.stdout:8/711: dread da/de/d8a/f6e [0,4194304] 0 2023-12-05T09:26:24.125 INFO:tasks.workunit.client.0.smithi067.stdout:6/343: dread da/d10/d1e/d17/d2f/d2c/d34/f3e [0,4194304] 0 2023-12-05T09:26:24.128 INFO:tasks.workunit.client.1.smithi134.stdout:8/712: write da/de/d16/d2d/f88 [864950,2810] 0 2023-12-05T09:26:24.128 INFO:tasks.workunit.client.1.smithi134.stdout:8/713: fdatasync da/f89 0 2023-12-05T09:26:24.130 INFO:tasks.workunit.client.1.smithi134.stdout:2/645: dwrite d19/d28/d31/d6f/fad [4194304,4194304] 0 2023-12-05T09:26:24.130 INFO:tasks.workunit.client.1.smithi134.stdout:2/646: fdatasync d19/d28/db1/fb2 0 2023-12-05T09:26:24.130 INFO:tasks.workunit.client.1.smithi134.stdout:2/647: fsync f16 0 2023-12-05T09:26:24.140 INFO:tasks.workunit.client.0.smithi067.stdout:0/522: dread d3/df/d10/f20 [0,4194304] 0 2023-12-05T09:26:24.140 INFO:tasks.workunit.client.0.smithi067.stdout:0/523: stat d3/d7/d3c/d67/d59 0 2023-12-05T09:26:24.140 INFO:tasks.workunit.client.0.smithi067.stdout:0/524: chown d3/d7/d30/f93 3514760 1 2023-12-05T09:26:24.140 INFO:tasks.workunit.client.0.smithi067.stdout:0/525: write d3/df/d10/f91 [796674,38083] 0 2023-12-05T09:26:24.147 INFO:tasks.workunit.client.1.smithi134.stdout:3/640: dwrite d4/d1f/f28 [0,4194304] 0 2023-12-05T09:26:24.173 INFO:tasks.workunit.client.1.smithi134.stdout:7/591: dwrite d2/d7/d2b/d2d/d67/d73/f5b [0,4194304] 0 2023-12-05T09:26:24.179 INFO:tasks.workunit.client.1.smithi134.stdout:1/736: rename d2/d9/d10/d30/d66/da9/l78 to d2/d9/d10/l106 0 2023-12-05T09:26:24.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/613: symlink d1b/d25/d35/d56/lce 0 2023-12-05T09:26:24.188 INFO:tasks.workunit.client.1.smithi134.stdout:6/549: dread - d4/d39/d42/d4f/d6d/d3a/d80/f87 zero size 2023-12-05T09:26:24.191 INFO:tasks.workunit.client.1.smithi134.stdout:8/714: truncate da/de/d11/fcc 39455 0 2023-12-05T09:26:24.191 INFO:tasks.workunit.client.1.smithi134.stdout:8/715: fdatasync da/de/f4c 0 2023-12-05T09:26:24.199 INFO:tasks.workunit.client.1.smithi134.stdout:5/583: dread d0/d1a/d3a/f49 [0,4194304] 0 2023-12-05T09:26:24.201 INFO:tasks.workunit.client.1.smithi134.stdout:3/641: creat d4/d5/d6f/dc2/fca x:0 0 0 2023-12-05T09:26:24.205 INFO:tasks.workunit.client.1.smithi134.stdout:7/592: truncate d2/d7/dc/d22/f85 7905581 0 2023-12-05T09:26:24.206 INFO:tasks.workunit.client.1.smithi134.stdout:2/648: rmdir d19/d76 39 2023-12-05T09:26:24.206 INFO:tasks.workunit.client.1.smithi134.stdout:6/550: dread d4/d32/f84 [0,4194304] 0 2023-12-05T09:26:24.208 INFO:tasks.workunit.client.1.smithi134.stdout:5/584: mknod d0/d1a/d1c/d3f/d5b/cca 0 2023-12-05T09:26:24.208 INFO:tasks.workunit.client.1.smithi134.stdout:4/608: dwrite d16/d18/d1c/f2c [8388608,4194304] 0 2023-12-05T09:26:24.209 INFO:tasks.workunit.client.1.smithi134.stdout:3/642: mknod d4/d5/d6f/dc2/ccb 0 2023-12-05T09:26:24.209 INFO:tasks.workunit.client.1.smithi134.stdout:3/643: write d4/d1f/d4e/f9f [678194,49430] 0 2023-12-05T09:26:24.209 INFO:tasks.workunit.client.1.smithi134.stdout:3/644: stat d4/d5/d45/d86/l8e 0 2023-12-05T09:26:24.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/593: creat d2/d7/d2b/d2d/d67/fc1 x:0 0 0 2023-12-05T09:26:24.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/594: chown d2/d7/d2b/d2d/d67/d73/d26 47062 1 2023-12-05T09:26:24.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/595: truncate d2/d7/d2b/d94/fb2 1203902 0 2023-12-05T09:26:24.212 INFO:tasks.workunit.client.1.smithi134.stdout:8/716: rmdir da/de/d96/d9d 39 2023-12-05T09:26:24.213 INFO:tasks.workunit.client.1.smithi134.stdout:9/581: dwrite d7/d8/d14/d26/d7f/d92/d53/f63 [0,4194304] 0 2023-12-05T09:26:24.213 INFO:tasks.workunit.client.1.smithi134.stdout:9/582: dread - d7/d8/d14/d26/d5a/fb2 zero size 2023-12-05T09:26:24.213 INFO:tasks.workunit.client.1.smithi134.stdout:9/583: write d7/d8/d14/f59 [4615425,79158] 0 2023-12-05T09:26:24.213 INFO:tasks.workunit.client.0.smithi067.stdout:8/381: dwrite d5/da/f56 [0,4194304] 0 2023-12-05T09:26:24.213 INFO:tasks.workunit.client.0.smithi067.stdout:8/382: stat d5/f36 0 2023-12-05T09:26:24.214 INFO:tasks.workunit.client.1.smithi134.stdout:2/649: mkdir d19/d28/d31/dd3 0 2023-12-05T09:26:24.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/456: getdents d2/d4f/d54 0 2023-12-05T09:26:24.216 INFO:tasks.workunit.client.0.smithi067.stdout:1/457: write d2/d3/f96 [153075,81215] 0 2023-12-05T09:26:24.217 INFO:tasks.workunit.client.1.smithi134.stdout:6/551: dread d4/d39/d42/d4f/d6d/d3a/da/f72 [0,4194304] 0 2023-12-05T09:26:24.218 INFO:tasks.workunit.client.0.smithi067.stdout:6/344: mkdir da/d10/d1e/d51/d7b 0 2023-12-05T09:26:24.218 INFO:tasks.workunit.client.1.smithi134.stdout:0/578: dwrite d13/d14/d30/d4b/d23/f83 [4194304,4194304] 0 2023-12-05T09:26:24.219 INFO:tasks.workunit.client.0.smithi067.stdout:3/351: dwrite d9/da/d15/d17/f32 [0,4194304] 0 2023-12-05T09:26:24.219 INFO:tasks.workunit.client.1.smithi134.stdout:5/585: rename d0/fc to d0/d45/fcb 0 2023-12-05T09:26:24.220 INFO:tasks.workunit.client.0.smithi067.stdout:9/614: mknod d1b/d25/d5b/d62/ccf 0 2023-12-05T09:26:24.225 INFO:tasks.workunit.client.0.smithi067.stdout:1/458: stat d2/d5/d7/de/d19/c80 0 2023-12-05T09:26:24.228 INFO:tasks.workunit.client.0.smithi067.stdout:7/405: dwrite d0/f76 [0,4194304] 0 2023-12-05T09:26:24.229 INFO:tasks.workunit.client.0.smithi067.stdout:0/526: dwrite d3/f1d [4194304,4194304] 0 2023-12-05T09:26:24.229 INFO:tasks.workunit.client.0.smithi067.stdout:0/527: chown d3/d7/d3c/d66/d90/d99/f9f 2071014978 1 2023-12-05T09:26:24.229 INFO:tasks.workunit.client.0.smithi067.stdout:7/406: write d0/d9/d3f/f7e [44561,91422] 0 2023-12-05T09:26:24.231 INFO:tasks.workunit.client.0.smithi067.stdout:6/345: mknod da/d10/d1e/d17/d2f/d1f/c7c 0 2023-12-05T09:26:24.232 INFO:tasks.workunit.client.1.smithi134.stdout:4/609: symlink d16/d7b/dce/d6e/daa/ld3 0 2023-12-05T09:26:24.232 INFO:tasks.workunit.client.1.smithi134.stdout:3/645: rmdir d4/d5 39 2023-12-05T09:26:24.232 INFO:tasks.workunit.client.1.smithi134.stdout:7/596: truncate d2/dd/d1a/f23 1999679 0 2023-12-05T09:26:24.234 INFO:tasks.workunit.client.1.smithi134.stdout:8/717: symlink da/de/d8a/d42/lf9 0 2023-12-05T09:26:24.240 INFO:tasks.workunit.client.1.smithi134.stdout:9/584: creat d7/d8/d14/d26/d7f/dab/fc9 x:0 0 0 2023-12-05T09:26:24.241 INFO:tasks.workunit.client.1.smithi134.stdout:9/585: fdatasync d7/d8/d2e/f76 0 2023-12-05T09:26:24.241 INFO:tasks.workunit.client.1.smithi134.stdout:9/586: fsync d7/d8/d14/d26/f48 0 2023-12-05T09:26:24.241 INFO:tasks.workunit.client.1.smithi134.stdout:9/587: write d7/d8/d14/d26/d5a/da1/fc4 [772554,19748] 0 2023-12-05T09:26:24.241 INFO:tasks.workunit.client.1.smithi134.stdout:1/737: dwrite d2/f4d [0,4194304] 0 2023-12-05T09:26:24.242 INFO:tasks.workunit.client.1.smithi134.stdout:5/586: rmdir d0/d1a/d1c/d3f/d81 39 2023-12-05T09:26:24.242 INFO:tasks.workunit.client.1.smithi134.stdout:5/587: write d0/d50/fc2 [793162,79934] 0 2023-12-05T09:26:24.242 INFO:tasks.workunit.client.1.smithi134.stdout:5/588: fdatasync d0/d1a/f39 0 2023-12-05T09:26:24.243 INFO:tasks.workunit.client.0.smithi067.stdout:9/615: symlink d1b/d25/d54/d5c/d8f/ld0 0 2023-12-05T09:26:24.248 INFO:tasks.workunit.client.1.smithi134.stdout:7/597: chown d2/d7/dc/l29 58444304 1 2023-12-05T09:26:24.248 INFO:tasks.workunit.client.1.smithi134.stdout:7/598: fdatasync d2/d7/dc/d2e/d3a/f49 0 2023-12-05T09:26:24.249 INFO:tasks.workunit.client.1.smithi134.stdout:8/718: rename da/de/l3c to da/de/d8a/d42/d99/lfa 0 2023-12-05T09:26:24.250 INFO:tasks.workunit.client.1.smithi134.stdout:8/719: stat da/de/d8a/d42/d99/cb2 0 2023-12-05T09:26:24.250 INFO:tasks.workunit.client.1.smithi134.stdout:8/720: chown da/de/d16/d33 247 1 2023-12-05T09:26:24.250 INFO:tasks.workunit.client.1.smithi134.stdout:8/721: chown da/de/f1c 4875069 1 2023-12-05T09:26:24.254 INFO:tasks.workunit.client.1.smithi134.stdout:4/610: dread d16/d7b/dce/d6e/daa/d3b/f5d [0,4194304] 0 2023-12-05T09:26:24.259 INFO:tasks.workunit.client.1.smithi134.stdout:9/588: symlink d7/d5b/d5e/daa/lca 0 2023-12-05T09:26:24.260 INFO:tasks.workunit.client.1.smithi134.stdout:9/589: dread - d7/d8/d14/d26/d7f/d92/f8e zero size 2023-12-05T09:26:24.262 INFO:tasks.workunit.client.1.smithi134.stdout:1/738: dread d2/d9/d10/d30/d4a/d81/f8e [0,4194304] 0 2023-12-05T09:26:24.269 INFO:tasks.workunit.client.0.smithi067.stdout:0/528: write d3/fa [578313,125811] 0 2023-12-05T09:26:24.269 INFO:tasks.workunit.client.0.smithi067.stdout:0/529: fdatasync d3/d7/d3c/d66/d90/d99/f9f 0 2023-12-05T09:26:24.269 INFO:tasks.workunit.client.0.smithi067.stdout:0/530: creat d3/d7/d3c/d66/d90/fbc x:0 0 0 2023-12-05T09:26:24.273 INFO:tasks.workunit.client.1.smithi134.stdout:5/589: creat d0/fcc x:0 0 0 2023-12-05T09:26:24.276 INFO:tasks.workunit.client.1.smithi134.stdout:1/739: write d2/d9/f57 [3080960,67857] 0 2023-12-05T09:26:24.280 INFO:tasks.workunit.client.1.smithi134.stdout:7/599: symlink d2/dd/d1a/lc2 0 2023-12-05T09:26:24.285 INFO:tasks.workunit.client.0.smithi067.stdout:9/616: truncate d1b/d3e/f66 3076504 0 2023-12-05T09:26:24.286 INFO:tasks.workunit.client.1.smithi134.stdout:8/722: creat da/de/d16/dbe/ffb x:0 0 0 2023-12-05T09:26:24.286 INFO:tasks.workunit.client.1.smithi134.stdout:8/723: truncate da/de/d96/dc9/dd8/fee 833826 0 2023-12-05T09:26:24.288 INFO:tasks.workunit.client.1.smithi134.stdout:4/611: symlink d16/d18/d1b/ld4 0 2023-12-05T09:26:24.288 INFO:tasks.workunit.client.1.smithi134.stdout:4/612: dread - d16/d7b/dce/fc4 zero size 2023-12-05T09:26:24.291 INFO:tasks.workunit.client.1.smithi134.stdout:0/579: dwrite d13/d14/d30/f32 [0,4194304] 0 2023-12-05T09:26:24.295 INFO:tasks.workunit.client.1.smithi134.stdout:9/590: truncate d7/d8/d16/f1f 674690 0 2023-12-05T09:26:24.295 INFO:tasks.workunit.client.1.smithi134.stdout:9/591: chown d7/d8/d14/d26/d7f/dab 347363 1 2023-12-05T09:26:24.296 INFO:tasks.workunit.client.1.smithi134.stdout:9/592: creat d7/d5b/d5e/daa/fcb x:0 0 0 2023-12-05T09:26:24.296 INFO:tasks.workunit.client.1.smithi134.stdout:1/740: rmdir d2/d9/d8d 39 2023-12-05T09:26:24.300 INFO:tasks.workunit.client.0.smithi067.stdout:0/531: dread d3/d7/d3c/f50 [0,4194304] 0 2023-12-05T09:26:24.300 INFO:tasks.workunit.client.1.smithi134.stdout:7/600: unlink f1 0 2023-12-05T09:26:24.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/617: creat d1b/dc2/fd1 x:0 0 0 2023-12-05T09:26:24.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/618: fsync d1b/d3e/f67 0 2023-12-05T09:26:24.303 INFO:tasks.workunit.client.1.smithi134.stdout:8/724: rename da/de/d96/cc0 to da/de/d11/d1d/d5f/def/cfc 0 2023-12-05T09:26:24.303 INFO:tasks.workunit.client.1.smithi134.stdout:8/725: fdatasync da/de/d96/dc9/dd8/fee 0 2023-12-05T09:26:24.305 INFO:tasks.workunit.client.0.smithi067.stdout:0/532: symlink d3/d7/d3c/d67/d59/d5c/lbd 0 2023-12-05T09:26:24.306 INFO:tasks.workunit.client.1.smithi134.stdout:2/650: dwrite d19/d3a/fbc [0,4194304] 0 2023-12-05T09:26:24.307 INFO:tasks.workunit.client.0.smithi067.stdout:9/619: symlink d1b/d25/d54/d5c/d6a/d6c/d76/ld2 0 2023-12-05T09:26:24.310 INFO:tasks.workunit.client.1.smithi134.stdout:3/646: dwrite d4/d5/d45/fb3 [0,4194304] 0 2023-12-05T09:26:24.310 INFO:tasks.workunit.client.1.smithi134.stdout:3/647: write d4/f1b [1744797,32552] 0 2023-12-05T09:26:24.311 INFO:tasks.workunit.client.1.smithi134.stdout:9/593: rmdir d7/d8/d14/d26/d7f/d92/d53 39 2023-12-05T09:26:24.312 INFO:tasks.workunit.client.1.smithi134.stdout:7/601: symlink d2/d7/d6f/db9/lc3 0 2023-12-05T09:26:24.312 INFO:tasks.workunit.client.1.smithi134.stdout:2/651: dread d19/d28/f4e [0,4194304] 0 2023-12-05T09:26:24.313 INFO:tasks.workunit.client.1.smithi134.stdout:2/652: chown d19/d3a/c61 204 1 2023-12-05T09:26:24.313 INFO:tasks.workunit.client.1.smithi134.stdout:2/653: read - d19/d76/dba/fd0 zero size 2023-12-05T09:26:24.313 INFO:tasks.workunit.client.1.smithi134.stdout:4/613: rename l9 to d16/d7b/ld5 0 2023-12-05T09:26:24.315 INFO:tasks.workunit.client.1.smithi134.stdout:8/726: link da/de/d16/d33/f56 da/de/d8a/d42/d99/dc8/d3b/ffd 0 2023-12-05T09:26:24.315 INFO:tasks.workunit.client.1.smithi134.stdout:8/727: creat da/de/d11/d1d/d5f/d9b/ffe x:0 0 0 2023-12-05T09:26:24.315 INFO:tasks.workunit.client.1.smithi134.stdout:8/728: fsync da/fc7 0 2023-12-05T09:26:24.319 INFO:tasks.workunit.client.1.smithi134.stdout:3/648: link d4/d5/d6f/dc2/ccb d4/d5/d45/d60/ccc 0 2023-12-05T09:26:24.319 INFO:tasks.workunit.client.1.smithi134.stdout:3/649: truncate d4/d1f/f35 1565296 0 2023-12-05T09:26:24.320 INFO:tasks.workunit.client.1.smithi134.stdout:9/594: creat d7/d10/db3/fcc x:0 0 0 2023-12-05T09:26:24.321 INFO:tasks.workunit.client.1.smithi134.stdout:7/602: link d2/df/l7b d2/df/lc4 0 2023-12-05T09:26:24.321 INFO:tasks.workunit.client.1.smithi134.stdout:6/552: dwrite d4/d39/d5c/f82 [0,4194304] 0 2023-12-05T09:26:24.321 INFO:tasks.workunit.client.1.smithi134.stdout:7/603: readlink d2/d70/l98 0 2023-12-05T09:26:24.322 INFO:tasks.workunit.client.1.smithi134.stdout:7/604: stat d2/d7/d2b/d2d/fb5 0 2023-12-05T09:26:24.322 INFO:tasks.workunit.client.1.smithi134.stdout:6/553: write d4/d32/d57/f6e [1382646,12270] 0 2023-12-05T09:26:24.322 INFO:tasks.workunit.client.1.smithi134.stdout:2/654: unlink d19/c32 0 2023-12-05T09:26:24.324 INFO:tasks.workunit.client.1.smithi134.stdout:1/741: rename d2/d9/d10/d5b/l90 to d2/d9/d10/d30/d66/da9/l107 0 2023-12-05T09:26:24.324 INFO:tasks.workunit.client.1.smithi134.stdout:5/590: fdatasync d0/d50/fc2 0 2023-12-05T09:26:24.324 INFO:tasks.workunit.client.1.smithi134.stdout:4/614: mknod d16/d21/d48/d80/dae/cd6 0 2023-12-05T09:26:24.326 INFO:tasks.workunit.client.0.smithi067.stdout:7/407: dwrite d0/d9/d10/d1d/f6b [0,4194304] 0 2023-12-05T09:26:24.326 INFO:tasks.workunit.client.0.smithi067.stdout:8/383: dwrite d5/dc/f19 [0,4194304] 0 2023-12-05T09:26:24.327 INFO:tasks.workunit.client.0.smithi067.stdout:6/346: dwrite da/d10/d1e/d17/f23 [4194304,4194304] 0 2023-12-05T09:26:24.327 INFO:tasks.workunit.client.0.smithi067.stdout:6/347: write da/d10/d1e/d17/d2f/d47/f4c [375326,16191] 0 2023-12-05T09:26:24.327 INFO:tasks.workunit.client.0.smithi067.stdout:6/348: readlink da/d10/d1e/d17/d2f/d1f/l70 0 2023-12-05T09:26:24.327 INFO:tasks.workunit.client.0.smithi067.stdout:1/459: dwrite d2/d4f/d54/f8c [0,4194304] 0 2023-12-05T09:26:24.328 INFO:tasks.workunit.client.0.smithi067.stdout:3/352: dwrite f6 [0,4194304] 0 2023-12-05T09:26:24.328 INFO:tasks.workunit.client.0.smithi067.stdout:3/353: chown d9/d49/c54 69 1 2023-12-05T09:26:24.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/729: symlink da/de/d11/d1d/d5f/lff 0 2023-12-05T09:26:24.334 INFO:tasks.workunit.client.1.smithi134.stdout:0/580: rmdir d13/d14/d30/d4b/d66/da0/da3 0 2023-12-05T09:26:24.334 INFO:tasks.workunit.client.1.smithi134.stdout:0/581: fsync d13/fb1 0 2023-12-05T09:26:24.334 INFO:tasks.workunit.client.1.smithi134.stdout:7/605: dread d2/d7/d2b/f8e [0,4194304] 0 2023-12-05T09:26:24.336 INFO:tasks.workunit.client.0.smithi067.stdout:7/408: creat d0/d9/d40/d7a/f87 x:0 0 0 2023-12-05T09:26:24.336 INFO:tasks.workunit.client.0.smithi067.stdout:7/409: readlink d0/d9/l1c 0 2023-12-05T09:26:24.336 INFO:tasks.workunit.client.0.smithi067.stdout:7/410: fsync d0/d9/f5f 0 2023-12-05T09:26:24.337 INFO:tasks.workunit.client.1.smithi134.stdout:3/650: mknod d4/d5/d6f/d76/ccd 0 2023-12-05T09:26:24.337 INFO:tasks.workunit.client.1.smithi134.stdout:3/651: readlink d4/d5/d45/d86/l8e 0 2023-12-05T09:26:24.337 INFO:tasks.workunit.client.1.smithi134.stdout:3/652: chown d4/d5/d45/f78 428652632 1 2023-12-05T09:26:24.340 INFO:tasks.workunit.client.1.smithi134.stdout:9/595: mknod d7/d8/d16/d52/d74/d97/d99/ccd 0 2023-12-05T09:26:24.342 INFO:tasks.workunit.client.1.smithi134.stdout:2/655: symlink d19/d3a/d60/ld4 0 2023-12-05T09:26:24.344 INFO:tasks.workunit.client.0.smithi067.stdout:8/384: mkdir d5/d6a 0 2023-12-05T09:26:24.345 INFO:tasks.workunit.client.1.smithi134.stdout:5/591: creat d0/d11/d5c/dab/fcd x:0 0 0 2023-12-05T09:26:24.349 INFO:tasks.workunit.client.0.smithi067.stdout:0/533: dwrite d3/f32 [0,4194304] 0 2023-12-05T09:26:24.349 INFO:tasks.workunit.client.1.smithi134.stdout:8/730: mkdir da/de/d11/d1d/db8/df3/d100 0 2023-12-05T09:26:24.350 INFO:tasks.workunit.client.1.smithi134.stdout:8/731: write da/de/d8a/d42/d99/dc8/fe7 [741959,22783] 0 2023-12-05T09:26:24.350 INFO:tasks.workunit.client.1.smithi134.stdout:6/554: dread d4/d39/d42/d4f/d6d/d45/f95 [0,4194304] 0 2023-12-05T09:26:24.350 INFO:tasks.workunit.client.1.smithi134.stdout:6/555: creat d4/fa6 x:0 0 0 2023-12-05T09:26:24.351 INFO:tasks.workunit.client.0.smithi067.stdout:3/354: creat d9/f78 x:0 0 0 2023-12-05T09:26:24.352 INFO:tasks.workunit.client.1.smithi134.stdout:0/582: creat d13/d14/d15/d2a/d8c/db6/fc4 x:0 0 0 2023-12-05T09:26:24.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/556: dread d4/d39/d42/d4f/d6d/f48 [0,4194304] 0 2023-12-05T09:26:24.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/557: creat d4/d39/d42/fa7 x:0 0 0 2023-12-05T09:26:24.358 INFO:tasks.workunit.client.0.smithi067.stdout:6/349: getdents da/d10 0 2023-12-05T09:26:24.358 INFO:tasks.workunit.client.0.smithi067.stdout:6/350: dread - da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a zero size 2023-12-05T09:26:24.360 INFO:tasks.workunit.client.0.smithi067.stdout:9/620: rename d1b/d25/d54/d5c/d6a to d1b/dd3 0 2023-12-05T09:26:24.361 INFO:tasks.workunit.client.0.smithi067.stdout:0/534: dread - d3/df/fa6 zero size 2023-12-05T09:26:24.363 INFO:tasks.workunit.client.1.smithi134.stdout:2/656: dread d19/d28/f41 [0,4194304] 0 2023-12-05T09:26:24.365 INFO:tasks.workunit.client.0.smithi067.stdout:6/351: mkdir da/d7d 0 2023-12-05T09:26:24.366 INFO:tasks.workunit.client.1.smithi134.stdout:3/653: link d4/d5/d45/fb3 d4/d5/d7c/fce 0 2023-12-05T09:26:24.367 INFO:tasks.workunit.client.1.smithi134.stdout:3/654: truncate d4/fbd 549162 0 2023-12-05T09:26:24.369 INFO:tasks.workunit.client.0.smithi067.stdout:0/535: creat d3/d6b/fbe x:0 0 0 2023-12-05T09:26:24.373 INFO:tasks.workunit.client.0.smithi067.stdout:6/352: rename da/d10/d1e/d17/d2f/d1f/l70 to da/d10/d1e/d17/d2f/d59/l7e 0 2023-12-05T09:26:24.373 INFO:tasks.workunit.client.0.smithi067.stdout:6/353: write da/d10/d1e/d17/f29 [3152125,51241] 0 2023-12-05T09:26:24.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:24 smithi134 ceph-mon[116304]: pgmap v27: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 235 MiB/s rd, 284 MiB/s wr, 393 op/s 2023-12-05T09:26:24.380 INFO:tasks.workunit.client.0.smithi067.stdout:3/355: dread f4 [0,4194304] 0 2023-12-05T09:26:24.386 INFO:tasks.workunit.client.1.smithi134.stdout:5/592: symlink d0/d50/lce 0 2023-12-05T09:26:24.386 INFO:tasks.workunit.client.1.smithi134.stdout:5/593: dread - d0/d1a/d1c/d25/d6a/f6c zero size 2023-12-05T09:26:24.387 INFO:tasks.workunit.client.1.smithi134.stdout:5/594: fdatasync d0/d1a/d3a/f74 0 2023-12-05T09:26:24.388 INFO:tasks.workunit.client.0.smithi067.stdout:3/356: rmdir d9/da/d15/d17 39 2023-12-05T09:26:24.390 INFO:tasks.workunit.client.1.smithi134.stdout:8/732: symlink da/de/d8a/d42/da2/l101 0 2023-12-05T09:26:24.390 INFO:tasks.workunit.client.1.smithi134.stdout:8/733: readlink da/de/d96/d9d/le2 0 2023-12-05T09:26:24.394 INFO:tasks.workunit.client.0.smithi067.stdout:0/536: rename d3/df to d3/d7/d3c/d66/dbf 0 2023-12-05T09:26:24.398 INFO:tasks.workunit.client.0.smithi067.stdout:9/621: write f10 [1008102,130312] 0 2023-12-05T09:26:24.399 INFO:tasks.workunit.client.0.smithi067.stdout:9/622: chown d1b/d25/d54/d5c/d81 205 1 2023-12-05T09:26:24.400 INFO:tasks.workunit.client.0.smithi067.stdout:6/354: write da/d10/d1e/f36 [3515517,57875] 0 2023-12-05T09:26:24.400 INFO:tasks.workunit.client.0.smithi067.stdout:6/355: fdatasync da/d10/d1e/d51/f7a 0 2023-12-05T09:26:24.404 INFO:tasks.workunit.client.1.smithi134.stdout:4/615: dwrite d16/d21/d47/d4b/f77 [0,4194304] 0 2023-12-05T09:26:24.406 INFO:tasks.workunit.client.0.smithi067.stdout:3/357: rmdir d9/da/d15/d17/d1a/d51 39 2023-12-05T09:26:24.409 INFO:tasks.workunit.client.0.smithi067.stdout:0/537: mknod d3/d7/d3c/d8d/cc0 0 2023-12-05T09:26:24.409 INFO:tasks.workunit.client.0.smithi067.stdout:0/538: fdatasync d3/d7/fc 0 2023-12-05T09:26:24.418 INFO:tasks.workunit.client.1.smithi134.stdout:2/657: dwrite d19/d3a/fb4 [0,4194304] 0 2023-12-05T09:26:24.418 INFO:tasks.workunit.client.1.smithi134.stdout:7/606: dwrite d2/d7/dc/d2e/d3a/d6d/f7d [0,4194304] 0 2023-12-05T09:26:24.420 INFO:tasks.workunit.client.1.smithi134.stdout:0/583: dwrite d13/d14/d30/d4b/d23/d77/f90 [0,4194304] 0 2023-12-05T09:26:24.424 INFO:tasks.workunit.client.0.smithi067.stdout:9/623: symlink d1b/d25/d35/ld4 0 2023-12-05T09:26:24.424 INFO:tasks.workunit.client.1.smithi134.stdout:3/655: mkdir d4/d5/d45/d86/db5/dcf 0 2023-12-05T09:26:24.427 INFO:tasks.workunit.client.0.smithi067.stdout:8/385: dread d5/d3b/f3d [0,4194304] 0 2023-12-05T09:26:24.427 INFO:tasks.workunit.client.0.smithi067.stdout:3/358: link d9/d20/l56 d9/da/d15/d17/d2b/l79 0 2023-12-05T09:26:24.429 INFO:tasks.workunit.client.1.smithi134.stdout:9/596: getdents d7/d5b/d5e/daa 0 2023-12-05T09:26:24.438 INFO:tasks.workunit.client.1.smithi134.stdout:6/558: dwrite d4/d39/d42/d4f/d6d/d3a/da/f19 [0,4194304] 0 2023-12-05T09:26:24.439 INFO:tasks.workunit.client.1.smithi134.stdout:4/616: dwrite ff [8388608,4194304] 0 2023-12-05T09:26:24.439 INFO:tasks.workunit.client.1.smithi134.stdout:4/617: fdatasync d16/d21/d47/f96 0 2023-12-05T09:26:24.440 INFO:tasks.workunit.client.0.smithi067.stdout:7/411: dwrite d0/d9/f5f [0,4194304] 0 2023-12-05T09:26:24.440 INFO:tasks.workunit.client.1.smithi134.stdout:7/607: dread d2/d7/dc/d2e/d3a/f49 [0,4194304] 0 2023-12-05T09:26:24.446 INFO:tasks.workunit.client.0.smithi067.stdout:0/539: creat d3/d7/d3c/d67/da1/fc1 x:0 0 0 2023-12-05T09:26:24.448 INFO:tasks.workunit.client.0.smithi067.stdout:3/359: mknod d9/d20/c7a 0 2023-12-05T09:26:24.448 INFO:tasks.workunit.client.0.smithi067.stdout:3/360: stat d9/da/d15/d17/d2b/f4d 0 2023-12-05T09:26:24.448 INFO:tasks.workunit.client.0.smithi067.stdout:3/361: stat d9/d49 0 2023-12-05T09:26:24.452 INFO:tasks.workunit.client.1.smithi134.stdout:9/597: dread d7/d8/f84 [0,4194304] 0 2023-12-05T09:26:24.452 INFO:tasks.workunit.client.1.smithi134.stdout:9/598: readlink d7/d10/l45 0 2023-12-05T09:26:24.453 INFO:tasks.workunit.client.0.smithi067.stdout:8/386: dread d5/f36 [0,4194304] 0 2023-12-05T09:26:24.457 INFO:tasks.workunit.client.0.smithi067.stdout:7/412: rmdir d0/d9/d40 39 2023-12-05T09:26:24.465 INFO:tasks.workunit.client.0.smithi067.stdout:3/362: symlink d9/da/d15/d28/d29/d47/l7b 0 2023-12-05T09:26:24.469 INFO:tasks.workunit.client.0.smithi067.stdout:8/387: creat d5/f6b x:0 0 0 2023-12-05T09:26:24.471 INFO:tasks.workunit.client.0.smithi067.stdout:7/413: creat d0/d9/d10/d37/d38/d64/d54/f88 x:0 0 0 2023-12-05T09:26:24.472 INFO:tasks.workunit.client.1.smithi134.stdout:8/734: mknod da/de/d8a/d42/d99/dc8/c102 0 2023-12-05T09:26:24.472 INFO:tasks.workunit.client.1.smithi134.stdout:8/735: chown da/de/d8a/l6d 4 1 2023-12-05T09:26:24.474 INFO:tasks.workunit.client.0.smithi067.stdout:0/540: mkdir d3/d7/d3c/dc2 0 2023-12-05T09:26:24.474 INFO:tasks.workunit.client.0.smithi067.stdout:0/541: chown d3/d7/d3c/d66/dbf/d10/f7b 111950760 1 2023-12-05T09:26:24.474 INFO:tasks.workunit.client.1.smithi134.stdout:8/736: read da/de/d16/d2d/f7b [496247,127854] 0 2023-12-05T09:26:24.474 INFO:tasks.workunit.client.1.smithi134.stdout:8/737: chown da/de/d16/d2d/f80 105193 1 2023-12-05T09:26:24.474 INFO:tasks.workunit.client.1.smithi134.stdout:8/738: fsync da/de/d8a/d42/d99/fb6 0 2023-12-05T09:26:24.477 INFO:tasks.workunit.client.1.smithi134.stdout:4/618: dwrite d16/d18/d1c/d63/fab [0,4194304] 0 2023-12-05T09:26:24.478 INFO:tasks.workunit.client.0.smithi067.stdout:3/363: creat d9/da/d15/d28/d29/d65/f7c x:0 0 0 2023-12-05T09:26:24.478 INFO:tasks.workunit.client.0.smithi067.stdout:3/364: fsync d9/da/d15/d17/f16 0 2023-12-05T09:26:24.478 INFO:tasks.workunit.client.0.smithi067.stdout:5/462: sync 2023-12-05T09:26:24.478 INFO:tasks.workunit.client.0.smithi067.stdout:4/355: sync 2023-12-05T09:26:24.478 INFO:tasks.workunit.client.0.smithi067.stdout:2/355: sync 2023-12-05T09:26:24.479 INFO:tasks.workunit.client.0.smithi067.stdout:2/356: write d0/d25/d34/f6a [586636,62497] 0 2023-12-05T09:26:24.479 INFO:tasks.workunit.client.0.smithi067.stdout:2/357: truncate d0/d25/f59 542899 0 2023-12-05T09:26:24.481 INFO:tasks.workunit.client.0.smithi067.stdout:0/542: truncate d3/d7/d3c/f50 2007182 0 2023-12-05T09:26:24.482 INFO:tasks.workunit.client.0.smithi067.stdout:9/624: dwrite d1b/d25/f6d [0,4194304] 0 2023-12-05T09:26:24.484 INFO:tasks.workunit.client.0.smithi067.stdout:5/463: rename db/df/d1a/d1d/c34 to db/ca4 0 2023-12-05T09:26:24.488 INFO:tasks.workunit.client.0.smithi067.stdout:2/358: mknod d0/d15/d63/c7b 0 2023-12-05T09:26:24.498 INFO:tasks.workunit.client.1.smithi134.stdout:2/658: mknod d19/d28/db1/cd5 0 2023-12-05T09:26:24.498 INFO:tasks.workunit.client.1.smithi134.stdout:2/659: write d19/d28/f5c [543337,33185] 0 2023-12-05T09:26:24.498 INFO:tasks.workunit.client.1.smithi134.stdout:2/660: write d19/d28/f5c [1182308,51569] 0 2023-12-05T09:26:24.499 INFO:tasks.workunit.client.1.smithi134.stdout:2/661: fdatasync f18 0 2023-12-05T09:26:24.499 INFO:tasks.workunit.client.0.smithi067.stdout:0/543: rmdir d3/d7/d3c/d6c/d76/da7 39 2023-12-05T09:26:24.499 INFO:tasks.workunit.client.0.smithi067.stdout:0/544: fdatasync d3/d7/d3c/fa3 0 2023-12-05T09:26:24.502 INFO:tasks.workunit.client.0.smithi067.stdout:9/625: symlink d1b/dc2/ld5 0 2023-12-05T09:26:24.505 INFO:tasks.workunit.client.0.smithi067.stdout:5/464: creat db/df/d1a/d1d/d20/fa5 x:0 0 0 2023-12-05T09:26:24.506 INFO:tasks.workunit.client.1.smithi134.stdout:9/599: dwrite d7/d8/d14/d26/d5a/fae [0,4194304] 0 2023-12-05T09:26:24.506 INFO:tasks.workunit.client.1.smithi134.stdout:9/600: write d7/d8/d14/d26/f3e [336438,7514] 0 2023-12-05T09:26:24.506 INFO:tasks.workunit.client.1.smithi134.stdout:9/601: fdatasync d7/d8/f50 0 2023-12-05T09:26:24.508 INFO:tasks.workunit.client.0.smithi067.stdout:0/545: rename d3/d7/d3c/d66/d90/c5e to d3/d7/cc3 0 2023-12-05T09:26:24.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/584: truncate d13/d14/d30/d4b/d23/f27 2334614 0 2023-12-05T09:26:24.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/585: chown d13/d14/d15/c28 30771 1 2023-12-05T09:26:24.509 INFO:tasks.workunit.client.1.smithi134.stdout:3/656: creat d4/d5/d6f/fd0 x:0 0 0 2023-12-05T09:26:24.510 INFO:tasks.workunit.client.0.smithi067.stdout:3/365: dread d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:24.510 INFO:tasks.workunit.client.1.smithi134.stdout:4/619: dwrite d16/d18/d1c/d63/f73 [0,4194304] 0 2023-12-05T09:26:24.511 INFO:tasks.workunit.client.0.smithi067.stdout:5/465: truncate db/f13 3242757 0 2023-12-05T09:26:24.513 INFO:tasks.workunit.client.1.smithi134.stdout:6/559: link d4/d39/d42/d4f/d6d/d45/c47 d4/d78/d7a/ca8 0 2023-12-05T09:26:24.516 INFO:tasks.workunit.client.0.smithi067.stdout:9/626: rename d1b/d25/d35/ld4 to d1b/d25/d5b/ld6 0 2023-12-05T09:26:24.527 INFO:tasks.workunit.client.0.smithi067.stdout:5/466: link db/df/d1a/d1d/d20/f37 db/df/d35/d63/fa6 0 2023-12-05T09:26:24.532 INFO:tasks.workunit.client.0.smithi067.stdout:0/546: rename d3/d7/d3c/d66/dbf/f21 to d3/d7/d3c/d66/d90/d99/db4/fc4 0 2023-12-05T09:26:24.533 INFO:tasks.workunit.client.0.smithi067.stdout:0/547: stat d3/d7/d3c/d66/d90/fab 0 2023-12-05T09:26:24.533 INFO:tasks.workunit.client.1.smithi134.stdout:7/608: write d2/d7/dc/d22/f27 [1138276,118586] 0 2023-12-05T09:26:24.535 INFO:tasks.workunit.client.0.smithi067.stdout:9/627: creat d1b/d25/d54/d5c/fd7 x:0 0 0 2023-12-05T09:26:24.536 INFO:tasks.workunit.client.1.smithi134.stdout:5/595: getdents d0/d1a/d1c/d25 0 2023-12-05T09:26:24.537 INFO:tasks.workunit.client.0.smithi067.stdout:5/467: mknod db/df/d1a/d59/ca7 0 2023-12-05T09:26:24.538 INFO:tasks.workunit.client.0.smithi067.stdout:5/468: chown db/df/d1a/d1d/c45 539927844 1 2023-12-05T09:26:24.538 INFO:tasks.workunit.client.0.smithi067.stdout:5/469: fsync db/df/d35/d63/d75/f7d 0 2023-12-05T09:26:24.542 INFO:tasks.workunit.client.0.smithi067.stdout:0/548: creat d3/d7/d3c/d66/d90/d99/fc5 x:0 0 0 2023-12-05T09:26:24.544 INFO:tasks.workunit.client.1.smithi134.stdout:2/662: symlink d19/d76/dba/ld6 0 2023-12-05T09:26:24.544 INFO:tasks.workunit.client.0.smithi067.stdout:3/366: dread d9/da/d15/d17/d1a/f4b [0,4194304] 0 2023-12-05T09:26:24.544 INFO:tasks.workunit.client.0.smithi067.stdout:5/470: getdents db/df/d1a/d1d 0 2023-12-05T09:26:24.544 INFO:tasks.workunit.client.0.smithi067.stdout:5/471: chown db/df/d1a/d1d/c27 48629261 1 2023-12-05T09:26:24.545 INFO:tasks.workunit.client.0.smithi067.stdout:0/549: creat d3/d7/d3c/d67/fc6 x:0 0 0 2023-12-05T09:26:24.546 INFO:tasks.workunit.client.0.smithi067.stdout:3/367: mknod d9/d62/c7d 0 2023-12-05T09:26:24.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/368: getdents d9/da/d15/d28/d29/d47/d64 0 2023-12-05T09:26:24.557 INFO:tasks.workunit.client.1.smithi134.stdout:2/663: write d19/d28/d2b/f57 [492778,53655] 0 2023-12-05T09:26:24.557 INFO:tasks.workunit.client.1.smithi134.stdout:2/664: fdatasync d19/d28/f4e 0 2023-12-05T09:26:24.558 INFO:tasks.workunit.client.1.smithi134.stdout:2/665: readlink d19/l23 0 2023-12-05T09:26:24.561 INFO:tasks.workunit.client.0.smithi067.stdout:0/550: symlink d3/d7/d3c/d66/d90/d99/lc7 0 2023-12-05T09:26:24.562 INFO:tasks.workunit.client.1.smithi134.stdout:0/586: creat d13/d14/d30/d2c/d9d/da5/fc5 x:0 0 0 2023-12-05T09:26:24.563 INFO:tasks.workunit.client.0.smithi067.stdout:3/369: mkdir d9/da/d15/d28/d29/d7e 0 2023-12-05T09:26:24.564 INFO:tasks.workunit.client.0.smithi067.stdout:3/370: chown d9/da/l42 25 1 2023-12-05T09:26:24.564 INFO:tasks.workunit.client.0.smithi067.stdout:3/371: fsync d9/da/d15/d17/f3a 0 2023-12-05T09:26:24.564 INFO:tasks.workunit.client.0.smithi067.stdout:3/372: fsync d9/da/d15/d17/d2b/f4d 0 2023-12-05T09:26:24.564 INFO:tasks.workunit.client.0.smithi067.stdout:5/472: symlink db/df/d82/la8 0 2023-12-05T09:26:24.564 INFO:tasks.workunit.client.0.smithi067.stdout:5/473: dread - db/df/d35/d63/d75/f7d zero size 2023-12-05T09:26:24.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/628: write d1b/d25/f6d [242347,37030] 0 2023-12-05T09:26:24.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/629: stat d1b/f5f 0 2023-12-05T09:26:24.565 INFO:tasks.workunit.client.0.smithi067.stdout:9/630: chown d1b/d25/d35/f79 127232 1 2023-12-05T09:26:24.565 INFO:tasks.workunit.client.0.smithi067.stdout:4/356: dwrite d0/f8 [0,4194304] 0 2023-12-05T09:26:24.566 INFO:tasks.workunit.client.0.smithi067.stdout:2/359: dwrite d0/d2f/d39/f40 [0,4194304] 0 2023-12-05T09:26:24.566 INFO:tasks.workunit.client.0.smithi067.stdout:2/360: chown d0/d25/f59 33467 1 2023-12-05T09:26:24.567 INFO:tasks.workunit.client.0.smithi067.stdout:0/551: rename d3/d7/d3c/d66/dbf/d10/f91 to d3/d7/d3c/dc2/fc8 0 2023-12-05T09:26:24.568 INFO:tasks.workunit.client.1.smithi134.stdout:3/657: creat d4/d5/d7c/d92/fd1 x:0 0 0 2023-12-05T09:26:24.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/620: rename d16/d7b/ca3 to d16/d7b/cd7 0 2023-12-05T09:26:24.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/621: read d16/d7b/dce/d6e/daa/f20 [631097,42013] 0 2023-12-05T09:26:24.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/622: dread - d16/d21/d48/d66/f71 zero size 2023-12-05T09:26:24.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/623: creat d16/d21/d47/d4b/fd8 x:0 0 0 2023-12-05T09:26:24.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/624: chown d16/d21/d48/d66 1 1 2023-12-05T09:26:24.572 INFO:tasks.workunit.client.0.smithi067.stdout:0/552: write d3/d7/d3c/d67/d59/d5c/f65 [190984,82988] 0 2023-12-05T09:26:24.573 INFO:tasks.workunit.client.0.smithi067.stdout:0/553: write d3/d7/d3c/d67/d59/d4e/f83 [465124,68187] 0 2023-12-05T09:26:24.573 INFO:tasks.workunit.client.0.smithi067.stdout:4/357: symlink d0/d1d/d53/d62/l7c 0 2023-12-05T09:26:24.574 INFO:tasks.workunit.client.1.smithi134.stdout:7/609: creat d2/d7/d2b/d2d/dac/fc5 x:0 0 0 2023-12-05T09:26:24.574 INFO:tasks.workunit.client.1.smithi134.stdout:8/739: rmdir da/de/d4d 39 2023-12-05T09:26:24.575 INFO:tasks.workunit.client.1.smithi134.stdout:7/610: fdatasync d2/d7/d2b/d2d/d67/d73/f5b 0 2023-12-05T09:26:24.576 INFO:tasks.workunit.client.1.smithi134.stdout:0/587: mknod d13/d14/d15/d2a/d8c/cc6 0 2023-12-05T09:26:24.576 INFO:tasks.workunit.client.0.smithi067.stdout:5/474: mknod db/df/d82/ca9 0 2023-12-05T09:26:24.577 INFO:tasks.workunit.client.1.smithi134.stdout:3/658: truncate d4/d5/d6f/d97/dae/dc9/f30 1922841 0 2023-12-05T09:26:24.578 INFO:tasks.workunit.client.0.smithi067.stdout:0/554: mknod d3/d6b/d6e/cc9 0 2023-12-05T09:26:24.578 INFO:tasks.workunit.client.0.smithi067.stdout:2/361: mkdir d0/d7c 0 2023-12-05T09:26:24.578 INFO:tasks.workunit.client.0.smithi067.stdout:2/362: dread - d0/d25/d3f/f79 zero size 2023-12-05T09:26:24.584 INFO:tasks.workunit.client.1.smithi134.stdout:5/596: link d0/d1a/c6f d0/ccf 0 2023-12-05T09:26:24.584 INFO:tasks.workunit.client.1.smithi134.stdout:7/611: fdatasync d2/d7/dc/d22/f4a 0 2023-12-05T09:26:24.584 INFO:tasks.workunit.client.1.smithi134.stdout:8/740: creat da/de/d8a/d42/d99/df5/f103 x:0 0 0 2023-12-05T09:26:24.588 INFO:tasks.workunit.client.0.smithi067.stdout:4/358: symlink d0/d1d/d3c/d51/l7d 0 2023-12-05T09:26:24.596 INFO:tasks.workunit.client.0.smithi067.stdout:3/373: read d9/d24/f34 [2349445,115686] 0 2023-12-05T09:26:24.599 INFO:tasks.workunit.client.0.smithi067.stdout:8/388: dwrite d5/dc/d1a/d20/d2d/f5f [0,4194304] 0 2023-12-05T09:26:24.600 INFO:tasks.workunit.client.0.smithi067.stdout:0/555: mknod d3/d7/d3c/d67/d59/d4e/d94/cca 0 2023-12-05T09:26:24.601 INFO:tasks.workunit.client.0.smithi067.stdout:0/556: chown d3/d7/d3c/d66/fa9 4745 1 2023-12-05T09:26:24.602 INFO:tasks.workunit.client.0.smithi067.stdout:2/363: rename d0/d25/d34/d4a/c68 to d0/d25/c7d 0 2023-12-05T09:26:24.602 INFO:tasks.workunit.client.1.smithi134.stdout:1/742: sync 2023-12-05T09:26:24.606 INFO:tasks.workunit.client.0.smithi067.stdout:0/557: creat d3/d7/d3c/d67/fcb x:0 0 0 2023-12-05T09:26:24.609 INFO:tasks.workunit.client.1.smithi134.stdout:5/597: dread d0/d45/f57 [0,4194304] 0 2023-12-05T09:26:24.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/612: write d2/dd/f19 [3754914,74267] 0 2023-12-05T09:26:24.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/613: dread - d2/d7/d2b/d2d/d67/fc1 zero size 2023-12-05T09:26:24.611 INFO:tasks.workunit.client.1.smithi134.stdout:7/614: creat d2/d7/dc/d2e/d3a/fc6 x:0 0 0 2023-12-05T09:26:24.611 INFO:tasks.workunit.client.1.smithi134.stdout:7/615: fdatasync d2/dd/fb6 0 2023-12-05T09:26:24.611 INFO:tasks.workunit.client.1.smithi134.stdout:6/560: dwrite d4/d78/d7a/f9b [0,4194304] 0 2023-12-05T09:26:24.611 INFO:tasks.workunit.client.1.smithi134.stdout:7/616: chown d2/df/d81/f91 257785536 1 2023-12-05T09:26:24.618 INFO:tasks.workunit.client.0.smithi067.stdout:5/475: dread db/df/f7e [0,4194304] 0 2023-12-05T09:26:24.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:24 smithi067 ceph-mon[107174]: pgmap v27: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 235 MiB/s rd, 284 MiB/s wr, 393 op/s 2023-12-05T09:26:24.620 INFO:tasks.workunit.client.0.smithi067.stdout:3/374: dread f7 [0,4194304] 0 2023-12-05T09:26:24.621 INFO:tasks.workunit.client.1.smithi134.stdout:7/617: creat d2/d7/d6f/db9/fc7 x:0 0 0 2023-12-05T09:26:24.621 INFO:tasks.workunit.client.1.smithi134.stdout:9/602: dwrite d7/d8/d14/d26/d7f/d92/f8e [0,4194304] 0 2023-12-05T09:26:24.627 INFO:tasks.workunit.client.1.smithi134.stdout:2/666: dwrite fd [0,4194304] 0 2023-12-05T09:26:24.627 INFO:tasks.workunit.client.1.smithi134.stdout:2/667: creat d19/d28/d2b/da3/fd7 x:0 0 0 2023-12-05T09:26:24.628 INFO:tasks.workunit.client.1.smithi134.stdout:1/743: write d2/d9/d10/f53 [800467,93587] 0 2023-12-05T09:26:24.628 INFO:tasks.workunit.client.1.smithi134.stdout:4/625: rename d16/d7b/cd7 to d16/d21/d47/cd9 0 2023-12-05T09:26:24.628 INFO:tasks.workunit.client.1.smithi134.stdout:4/626: chown d16/d7b/dce/d6e/daa/d3b/f5c 523262289 1 2023-12-05T09:26:24.628 INFO:tasks.workunit.client.1.smithi134.stdout:4/627: truncate d16/d7b/dce/fc4 59054 0 2023-12-05T09:26:24.629 INFO:tasks.workunit.client.0.smithi067.stdout:3/375: unlink d9/d20/f5c 0 2023-12-05T09:26:24.634 INFO:tasks.workunit.client.1.smithi134.stdout:9/603: mknod d7/d10/d56/cce 0 2023-12-05T09:26:24.635 INFO:tasks.workunit.client.0.smithi067.stdout:0/558: dread d3/f39 [0,4194304] 0 2023-12-05T09:26:24.639 INFO:tasks.workunit.client.0.smithi067.stdout:4/359: dread d0/d1d/d53/f6c [0,4194304] 0 2023-12-05T09:26:24.643 INFO:tasks.workunit.client.0.smithi067.stdout:3/376: rename d9/d20/l56 to d9/da/d15/d17/l7f 0 2023-12-05T09:26:24.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/389: dread d5/da/f56 [0,4194304] 0 2023-12-05T09:26:24.644 INFO:tasks.workunit.client.0.smithi067.stdout:7/414: dwrite d0/d9/d10/d37/d38/d64/f55 [0,4194304] 0 2023-12-05T09:26:24.644 INFO:tasks.workunit.client.0.smithi067.stdout:7/415: chown d0/d9/l3e 23577 1 2023-12-05T09:26:24.644 INFO:tasks.workunit.client.0.smithi067.stdout:8/390: write d5/dc/d1a/d20/d2d/d41/f4d [387538,46306] 0 2023-12-05T09:26:24.644 INFO:tasks.workunit.client.0.smithi067.stdout:7/416: read - d0/d9/d10/f5d zero size 2023-12-05T09:26:24.644 INFO:tasks.workunit.client.0.smithi067.stdout:7/417: fsync d0/d9/f58 0 2023-12-05T09:26:24.644 INFO:tasks.workunit.client.0.smithi067.stdout:7/418: chown d0/d9/d40/d48/f66 10 1 2023-12-05T09:26:24.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/476: write db/df/d1a/d1d/d20/f51 [2546568,17045] 0 2023-12-05T09:26:24.646 INFO:tasks.workunit.client.0.smithi067.stdout:5/477: stat db/df/d1a/d59/c93 0 2023-12-05T09:26:24.647 INFO:tasks.workunit.client.1.smithi134.stdout:3/659: dwrite d4/faf [0,4194304] 0 2023-12-05T09:26:24.647 INFO:tasks.workunit.client.1.smithi134.stdout:3/660: chown d4/d5/d45/d60/d85/dab/lc8 760 1 2023-12-05T09:26:24.647 INFO:tasks.workunit.client.1.smithi134.stdout:7/618: dread d2/dd/fb6 [0,4194304] 0 2023-12-05T09:26:24.648 INFO:tasks.workunit.client.1.smithi134.stdout:0/588: dwrite d13/d14/f6c [0,4194304] 0 2023-12-05T09:26:24.649 INFO:tasks.workunit.client.0.smithi067.stdout:0/559: symlink d3/d7/d3c/d66/d90/d99/lcc 0 2023-12-05T09:26:24.649 INFO:tasks.workunit.client.0.smithi067.stdout:0/560: fdatasync d3/d6b/fbe 0 2023-12-05T09:26:24.651 INFO:tasks.workunit.client.1.smithi134.stdout:8/741: dwrite da/de/d4d/f79 [0,4194304] 0 2023-12-05T09:26:24.651 INFO:tasks.workunit.client.1.smithi134.stdout:8/742: chown da/de/d96/cf6 1910 1 2023-12-05T09:26:24.652 INFO:tasks.workunit.client.1.smithi134.stdout:9/604: dread d7/d7d/f82 [0,4194304] 0 2023-12-05T09:26:24.654 INFO:tasks.workunit.client.1.smithi134.stdout:8/743: write da/de/d8a/d42/d99/dc8/d3b/fac [1017946,63533] 0 2023-12-05T09:26:24.657 INFO:tasks.workunit.client.1.smithi134.stdout:7/619: write d2/df/d2a/d36/f5c [4319994,93903] 0 2023-12-05T09:26:24.658 INFO:tasks.workunit.client.0.smithi067.stdout:4/360: truncate d0/d1d/d25/d32/f16 2423112 0 2023-12-05T09:26:24.658 INFO:tasks.workunit.client.0.smithi067.stdout:4/361: fsync d0/d1d/d25/f5f 0 2023-12-05T09:26:24.659 INFO:tasks.workunit.client.0.smithi067.stdout:4/362: dread - d0/d1d/d25/d2c/d34/f5e zero size 2023-12-05T09:26:24.659 INFO:tasks.workunit.client.0.smithi067.stdout:4/363: write d0/d1d/d25/d32/f44 [4581954,82983] 0 2023-12-05T09:26:24.665 INFO:tasks.workunit.client.1.smithi134.stdout:2/668: unlink d19/d28/d31/d38/d98/f9b 0 2023-12-05T09:26:24.665 INFO:tasks.workunit.client.1.smithi134.stdout:2/669: write d19/d28/d2b/f57 [1335815,40172] 0 2023-12-05T09:26:24.668 INFO:tasks.workunit.client.1.smithi134.stdout:5/598: dwrite d0/d1a/d1c/f65 [0,4194304] 0 2023-12-05T09:26:24.668 INFO:tasks.workunit.client.0.smithi067.stdout:8/391: creat d5/dc/f6c x:0 0 0 2023-12-05T09:26:24.675 INFO:tasks.workunit.client.0.smithi067.stdout:7/419: mknod d0/d9/d10/d37/d38/d64/d34/d67/c89 0 2023-12-05T09:26:24.681 INFO:tasks.workunit.client.1.smithi134.stdout:1/744: symlink d2/d9/d10/d30/dd4/dfb/l108 0 2023-12-05T09:26:24.681 INFO:tasks.workunit.client.1.smithi134.stdout:1/745: chown d2/d9/d10/d30/d4a 267 1 2023-12-05T09:26:24.681 INFO:tasks.workunit.client.1.smithi134.stdout:4/628: symlink d16/d21/d35/lda 0 2023-12-05T09:26:24.681 INFO:tasks.workunit.client.1.smithi134.stdout:4/629: readlink d16/d18/d1b/l27 0 2023-12-05T09:26:24.681 INFO:tasks.workunit.client.1.smithi134.stdout:3/661: symlink d4/d5/d45/d86/ld2 0 2023-12-05T09:26:24.681 INFO:tasks.workunit.client.1.smithi134.stdout:3/662: write d4/d5/d45/d60/f82 [4450212,44829] 0 2023-12-05T09:26:24.681 INFO:tasks.workunit.client.1.smithi134.stdout:3/663: chown d4/d5/d6f/l90 1032 1 2023-12-05T09:26:24.690 INFO:tasks.workunit.client.1.smithi134.stdout:6/561: dwrite d4/d39/d42/d4f/d6d/d45/f9c [0,4194304] 0 2023-12-05T09:26:24.694 INFO:tasks.workunit.client.0.smithi067.stdout:9/631: dwrite d1b/d25/d35/f5e [0,4194304] 0 2023-12-05T09:26:24.694 INFO:tasks.workunit.client.0.smithi067.stdout:9/632: chown d1b/d3e/d7f/f95 170294107 1 2023-12-05T09:26:24.694 INFO:tasks.workunit.client.0.smithi067.stdout:9/633: write d1b/f31 [1786720,49806] 0 2023-12-05T09:26:24.694 INFO:tasks.workunit.client.0.smithi067.stdout:9/634: read - d1b/d25/d94/fbb zero size 2023-12-05T09:26:24.694 INFO:tasks.workunit.client.0.smithi067.stdout:9/635: chown d1b/d25/d54/d5c/f69 28 1 2023-12-05T09:26:24.700 INFO:tasks.workunit.client.0.smithi067.stdout:0/561: symlink d3/d7/d3c/d66/d90/lcd 0 2023-12-05T09:26:24.706 INFO:tasks.workunit.client.1.smithi134.stdout:4/630: read d16/d21/d47/d4b/f77 [3642259,121701] 0 2023-12-05T09:26:24.707 INFO:tasks.workunit.client.0.smithi067.stdout:4/364: creat d0/d1d/d2a/f7e x:0 0 0 2023-12-05T09:26:24.707 INFO:tasks.workunit.client.0.smithi067.stdout:4/365: creat d0/d1d/d24/f7f x:0 0 0 2023-12-05T09:26:24.709 INFO:tasks.workunit.client.0.smithi067.stdout:8/392: mknod d5/d3b/c6d 0 2023-12-05T09:26:24.709 INFO:tasks.workunit.client.0.smithi067.stdout:8/393: fsync d5/f45 0 2023-12-05T09:26:24.709 INFO:tasks.workunit.client.0.smithi067.stdout:8/394: read - d5/dc/d1a/f64 zero size 2023-12-05T09:26:24.713 INFO:tasks.workunit.client.1.smithi134.stdout:9/605: mknod d7/d7d/ccf 0 2023-12-05T09:26:24.713 INFO:tasks.workunit.client.1.smithi134.stdout:9/606: readlink d7/d8/d16/d52/d74/l83 0 2023-12-05T09:26:24.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/599: mknod d0/d1a/cd0 0 2023-12-05T09:26:24.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/600: dread - d0/d1a/d3a/f99 zero size 2023-12-05T09:26:24.717 INFO:tasks.workunit.client.0.smithi067.stdout:5/478: dwrite db/df/d36/f83 [0,4194304] 0 2023-12-05T09:26:24.718 INFO:tasks.workunit.client.1.smithi134.stdout:2/670: dwrite d19/d76/dba/fd0 [0,4194304] 0 2023-12-05T09:26:24.719 INFO:tasks.workunit.client.0.smithi067.stdout:2/364: dwrite d0/d2f/d39/f6f [0,4194304] 0 2023-12-05T09:26:24.719 INFO:tasks.workunit.client.0.smithi067.stdout:3/377: dwrite d9/da/d15/d17/f30 [0,4194304] 0 2023-12-05T09:26:24.719 INFO:tasks.workunit.client.0.smithi067.stdout:2/365: write d0/d25/f4e [1642037,116618] 0 2023-12-05T09:26:24.719 INFO:tasks.workunit.client.0.smithi067.stdout:2/366: chown d0/d25/d34/d4d/d78 921660 1 2023-12-05T09:26:24.719 INFO:tasks.workunit.client.1.smithi134.stdout:1/746: mkdir d2/d27/d40/d109 0 2023-12-05T09:26:24.720 INFO:tasks.workunit.client.0.smithi067.stdout:9/636: mknod d1b/dd3/d6c/d78/cd8 0 2023-12-05T09:26:24.722 INFO:tasks.workunit.client.0.smithi067.stdout:7/420: dread d0/d9/d10/d37/d38/d64/d34/f36 [0,4194304] 0 2023-12-05T09:26:24.722 INFO:tasks.workunit.client.1.smithi134.stdout:3/664: link d4/c8 d4/d5/d6f/cd3 0 2023-12-05T09:26:24.723 INFO:tasks.workunit.client.1.smithi134.stdout:3/665: write d4/d5/d45/d60/f66 [2141461,120622] 0 2023-12-05T09:26:24.723 INFO:tasks.workunit.client.1.smithi134.stdout:2/671: dread d19/d3f/f88 [0,4194304] 0 2023-12-05T09:26:24.724 INFO:tasks.workunit.client.1.smithi134.stdout:4/631: creat d16/d21/d48/d80/dae/d65/fdb x:0 0 0 2023-12-05T09:26:24.729 INFO:tasks.workunit.client.1.smithi134.stdout:9/607: unlink d7/d10/c49 0 2023-12-05T09:26:24.731 INFO:tasks.workunit.client.1.smithi134.stdout:0/589: write d13/d14/d30/d4b/d23/f27 [467579,69846] 0 2023-12-05T09:26:24.732 INFO:tasks.workunit.client.1.smithi134.stdout:8/744: mkdir da/de/d11/d104 0 2023-12-05T09:26:24.739 INFO:tasks.workunit.client.1.smithi134.stdout:5/601: mknod d0/d1a/d1c/d3f/cd1 0 2023-12-05T09:26:24.739 INFO:tasks.workunit.client.1.smithi134.stdout:5/602: creat d0/d1a/d1c/d3f/d5b/d5d/fd2 x:0 0 0 2023-12-05T09:26:24.744 INFO:tasks.workunit.client.1.smithi134.stdout:1/747: mkdir d2/d27/d40/d10a 0 2023-12-05T09:26:24.745 INFO:tasks.workunit.client.1.smithi134.stdout:4/632: dread d16/d18/d1b/f31 [0,4194304] 0 2023-12-05T09:26:24.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/378: symlink d9/da/d15/d17/l80 0 2023-12-05T09:26:24.747 INFO:tasks.workunit.client.0.smithi067.stdout:8/395: dread d5/da/f56 [0,4194304] 0 2023-12-05T09:26:24.749 INFO:tasks.workunit.client.1.smithi134.stdout:2/672: symlink d19/d28/d31/d6f/ld8 0 2023-12-05T09:26:24.749 INFO:tasks.workunit.client.1.smithi134.stdout:6/562: dwrite d4/d32/f35 [0,4194304] 0 2023-12-05T09:26:24.750 INFO:tasks.workunit.client.1.smithi134.stdout:9/608: mknod d7/d8/d2e/cd0 0 2023-12-05T09:26:24.752 INFO:tasks.workunit.client.0.smithi067.stdout:5/479: rename db/df/d38/c5e to db/caa 0 2023-12-05T09:26:24.753 INFO:tasks.workunit.client.1.smithi134.stdout:0/590: creat d13/d14/d30/d2c/d9d/fc7 x:0 0 0 2023-12-05T09:26:24.754 INFO:tasks.workunit.client.0.smithi067.stdout:2/367: getdents d0/d25/d34/d4d/d54 0 2023-12-05T09:26:24.756 INFO:tasks.workunit.client.1.smithi134.stdout:8/745: mknod da/c105 0 2023-12-05T09:26:24.757 INFO:tasks.workunit.client.0.smithi067.stdout:9/637: truncate d1b/d3e/d7f/f95 1064106 0 2023-12-05T09:26:24.760 INFO:tasks.workunit.client.1.smithi134.stdout:7/620: truncate d2/df/d2a/d36/f5c 2015845 0 2023-12-05T09:26:24.760 INFO:tasks.workunit.client.1.smithi134.stdout:7/621: chown d2/d7/d2b/d2d/d67/d73/c82 97293501 1 2023-12-05T09:26:24.760 INFO:tasks.workunit.client.1.smithi134.stdout:7/622: chown d2/d7/f13 3047 1 2023-12-05T09:26:24.761 INFO:tasks.workunit.client.1.smithi134.stdout:7/623: creat d2/dd/fc8 x:0 0 0 2023-12-05T09:26:24.761 INFO:tasks.workunit.client.0.smithi067.stdout:7/421: getdents d0/d9/d40 0 2023-12-05T09:26:24.761 INFO:tasks.workunit.client.0.smithi067.stdout:7/422: dread - d0/d45/f80 zero size 2023-12-05T09:26:24.761 INFO:tasks.workunit.client.0.smithi067.stdout:7/423: rename d0/d9 to d0/d9/d10/d37/d8a 22 2023-12-05T09:26:24.762 INFO:tasks.workunit.client.1.smithi134.stdout:1/748: rmdir d2/d9/d8d 39 2023-12-05T09:26:24.762 INFO:tasks.workunit.client.1.smithi134.stdout:1/749: dread - d2/fd1 zero size 2023-12-05T09:26:24.762 INFO:tasks.workunit.client.1.smithi134.stdout:1/750: write d2/d9/f44 [1814940,108649] 0 2023-12-05T09:26:24.764 INFO:tasks.workunit.client.0.smithi067.stdout:8/396: mkdir d5/dc/d6e 0 2023-12-05T09:26:24.764 INFO:tasks.workunit.client.0.smithi067.stdout:8/397: stat d5/f40 0 2023-12-05T09:26:24.764 INFO:tasks.workunit.client.0.smithi067.stdout:8/398: readlink d5/dc/d1a/d20/d2d/l68 0 2023-12-05T09:26:24.765 INFO:tasks.workunit.client.1.smithi134.stdout:4/633: mknod d16/d21/d48/d66/db0/db3/cdc 0 2023-12-05T09:26:24.766 INFO:tasks.workunit.client.0.smithi067.stdout:5/480: getdents db/df/d3f/d88 0 2023-12-05T09:26:24.766 INFO:tasks.workunit.client.0.smithi067.stdout:5/481: write db/df/d35/f76 [484718,27340] 0 2023-12-05T09:26:24.766 INFO:tasks.workunit.client.0.smithi067.stdout:5/482: chown db/df/d1a/d1d/d20/f2d 8 1 2023-12-05T09:26:24.767 INFO:tasks.workunit.client.1.smithi134.stdout:3/666: rmdir d4/d5/d6f/dc2 39 2023-12-05T09:26:24.767 INFO:tasks.workunit.client.1.smithi134.stdout:3/667: creat d4/d5/d45/d86/fd4 x:0 0 0 2023-12-05T09:26:24.767 INFO:tasks.workunit.client.1.smithi134.stdout:3/668: fdatasync d4/d5/d7c/d92/fd1 0 2023-12-05T09:26:24.767 INFO:tasks.workunit.client.1.smithi134.stdout:3/669: stat d4/d5/d45/d60/l7f 0 2023-12-05T09:26:24.770 INFO:tasks.workunit.client.0.smithi067.stdout:9/638: unlink d1b/d25/d35/d56/ca7 0 2023-12-05T09:26:24.770 INFO:tasks.workunit.client.0.smithi067.stdout:9/639: dread - d1b/d25/d54/d5c/fa8 zero size 2023-12-05T09:26:24.770 INFO:tasks.workunit.client.0.smithi067.stdout:1/460: sync 2023-12-05T09:26:24.772 INFO:tasks.workunit.client.1.smithi134.stdout:6/563: write d4/d39/d42/d4f/d6d/d3a/f3d [1523592,56643] 0 2023-12-05T09:26:24.772 INFO:tasks.workunit.client.1.smithi134.stdout:2/673: creat d19/d28/d63/fd9 x:0 0 0 2023-12-05T09:26:24.774 INFO:tasks.workunit.client.1.smithi134.stdout:7/624: dread d2/d7/d2b/d94/fb2 [0,4194304] 0 2023-12-05T09:26:24.774 INFO:tasks.workunit.client.1.smithi134.stdout:7/625: chown d2/dd/d1a/ca4 2 1 2023-12-05T09:26:24.774 INFO:tasks.workunit.client.0.smithi067.stdout:1/461: chown d2/d3/f1d 3 1 2023-12-05T09:26:24.774 INFO:tasks.workunit.client.0.smithi067.stdout:7/424: symlink d0/d45/l8b 0 2023-12-05T09:26:24.776 INFO:tasks.workunit.client.1.smithi134.stdout:0/591: rename d13/d14/d30/d4b/f8d to d13/d14/d15/fc8 0 2023-12-05T09:26:24.776 INFO:tasks.workunit.client.0.smithi067.stdout:6/356: sync 2023-12-05T09:26:24.777 INFO:tasks.workunit.client.0.smithi067.stdout:5/483: creat db/df/d82/fab x:0 0 0 2023-12-05T09:26:24.778 INFO:tasks.workunit.client.0.smithi067.stdout:5/484: creat db/df/d35/d63/d75/fac x:0 0 0 2023-12-05T09:26:24.780 INFO:tasks.workunit.client.0.smithi067.stdout:1/462: dread d2/d4f/d14/d20/d83/f84 [0,4194304] 0 2023-12-05T09:26:24.783 INFO:tasks.workunit.client.0.smithi067.stdout:7/425: getdents d0/d9/d56 0 2023-12-05T09:26:24.783 INFO:tasks.workunit.client.0.smithi067.stdout:7/426: getdents d0/d9/d10/d37/d38/d64/d34/d67/d72 0 2023-12-05T09:26:24.783 INFO:tasks.workunit.client.0.smithi067.stdout:7/427: getdents d0/d9/d40 0 2023-12-05T09:26:24.788 INFO:tasks.workunit.client.0.smithi067.stdout:6/357: mkdir da/d10/d1e/d7f 0 2023-12-05T09:26:24.788 INFO:tasks.workunit.client.0.smithi067.stdout:6/358: fdatasync da/d10/d1e/d17/d2f/d59/d6c/f78 0 2023-12-05T09:26:24.788 INFO:tasks.workunit.client.0.smithi067.stdout:4/366: dwrite d0/f8 [0,4194304] 0 2023-12-05T09:26:24.789 INFO:tasks.workunit.client.1.smithi134.stdout:1/751: mkdir d2/d9/d10/d30/d10b 0 2023-12-05T09:26:24.795 INFO:tasks.workunit.client.1.smithi134.stdout:2/674: dread f12 [0,4194304] 0 2023-12-05T09:26:24.799 INFO:tasks.workunit.client.0.smithi067.stdout:1/463: link d2/d4f/d15/la3 d2/d5/d7/de/d1a/la8 0 2023-12-05T09:26:24.800 INFO:tasks.workunit.client.0.smithi067.stdout:1/464: chown d2/d5/d7/de/d19/d8f/f82 48084 1 2023-12-05T09:26:24.803 INFO:tasks.workunit.client.1.smithi134.stdout:0/592: read d13/fb1 [4055367,91098] 0 2023-12-05T09:26:24.803 INFO:tasks.workunit.client.1.smithi134.stdout:4/634: mkdir d16/d18/d1c/ddd 0 2023-12-05T09:26:24.803 INFO:tasks.workunit.client.1.smithi134.stdout:0/593: read - d13/d14/d30/d4b/d23/d77/f9b zero size 2023-12-05T09:26:24.804 INFO:tasks.workunit.client.0.smithi067.stdout:6/359: mkdir da/d10/d1e/d17/d2f/d47/d80 0 2023-12-05T09:26:24.805 INFO:tasks.workunit.client.1.smithi134.stdout:3/670: creat d4/d1f/d50/db1/fd5 x:0 0 0 2023-12-05T09:26:24.812 INFO:tasks.workunit.client.0.smithi067.stdout:4/367: rmdir d0/d1d/d25/d38 39 2023-12-05T09:26:24.819 INFO:tasks.workunit.client.1.smithi134.stdout:9/609: dwrite d7/d5b/d5e/daa/db7/fb9 [0,4194304] 0 2023-12-05T09:26:24.820 INFO:tasks.workunit.client.1.smithi134.stdout:6/564: truncate d4/d39/d42/f4d 205799 0 2023-12-05T09:26:24.822 INFO:tasks.workunit.client.1.smithi134.stdout:7/626: creat d2/df/d2a/d36/fc9 x:0 0 0 2023-12-05T09:26:24.822 INFO:tasks.workunit.client.1.smithi134.stdout:7/627: write d2/d7/dc/d2e/f4c [2169341,30350] 0 2023-12-05T09:26:24.822 INFO:tasks.workunit.client.1.smithi134.stdout:8/746: write da/de/d16/d2d/f80 [617298,77586] 0 2023-12-05T09:26:24.823 INFO:tasks.workunit.client.0.smithi067.stdout:1/465: write d2/d4f/d14/d48/f6b [6475881,96402] 0 2023-12-05T09:26:24.823 INFO:tasks.workunit.client.0.smithi067.stdout:1/466: fsync d2/f39 0 2023-12-05T09:26:24.823 INFO:tasks.workunit.client.0.smithi067.stdout:6/360: unlink da/d10/d1e/d17/d2f/d59/d6c/f78 0 2023-12-05T09:26:24.824 INFO:tasks.workunit.client.1.smithi134.stdout:5/603: dwrite d0/d1a/d1c/f31 [0,4194304] 0 2023-12-05T09:26:24.825 INFO:tasks.workunit.client.0.smithi067.stdout:4/368: creat d0/f80 x:0 0 0 2023-12-05T09:26:24.825 INFO:tasks.workunit.client.1.smithi134.stdout:5/604: write d0/d1a/d1c/d25/d4d/d9e/fc5 [758531,73661] 0 2023-12-05T09:26:24.828 INFO:tasks.workunit.client.0.smithi067.stdout:6/361: creat da/d10/d1e/d17/f81 x:0 0 0 2023-12-05T09:26:24.829 INFO:tasks.workunit.client.1.smithi134.stdout:1/752: rmdir d2/d9/d10 39 2023-12-05T09:26:24.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/635: dread d16/d21/d48/f34 [0,4194304] 0 2023-12-05T09:26:24.830 INFO:tasks.workunit.client.1.smithi134.stdout:1/753: creat d2/d27/d40/f10c x:0 0 0 2023-12-05T09:26:24.830 INFO:tasks.workunit.client.0.smithi067.stdout:5/485: dwrite db/df/d3f/f4a [4194304,4194304] 0 2023-12-05T09:26:24.830 INFO:tasks.workunit.client.0.smithi067.stdout:5/486: write db/df/d36/f83 [4953954,57285] 0 2023-12-05T09:26:24.832 INFO:tasks.workunit.client.1.smithi134.stdout:2/675: symlink d19/d3a/d60/lda 0 2023-12-05T09:26:24.832 INFO:tasks.workunit.client.1.smithi134.stdout:2/676: fsync d19/fac 0 2023-12-05T09:26:24.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/368: read d0/f5a [2067383,41259] 0 2023-12-05T09:26:24.835 INFO:tasks.workunit.client.0.smithi067.stdout:4/369: symlink d0/d1d/d4d/l81 0 2023-12-05T09:26:24.838 INFO:tasks.workunit.client.0.smithi067.stdout:2/369: creat d0/d15/d53/f7e x:0 0 0 2023-12-05T09:26:24.839 INFO:tasks.workunit.client.1.smithi134.stdout:0/594: rename d13/d14/d30/d4b/d23/d77/l7c to d13/d14/d15/d2a/d8c/lc9 0 2023-12-05T09:26:24.841 INFO:tasks.workunit.client.0.smithi067.stdout:6/362: link da/d10/d1e/f4b da/d10/d1e/d17/d2f/d72/f82 0 2023-12-05T09:26:24.843 INFO:tasks.workunit.client.1.smithi134.stdout:3/671: symlink d4/d5/d6f/ld6 0 2023-12-05T09:26:24.857 INFO:tasks.workunit.client.0.smithi067.stdout:8/399: dwrite d5/dc/d1a/f64 [0,4194304] 0 2023-12-05T09:26:24.862 INFO:tasks.workunit.client.1.smithi134.stdout:9/610: link d7/d8/d16/c41 d7/d5b/d5e/daa/cd1 0 2023-12-05T09:26:24.862 INFO:tasks.workunit.client.1.smithi134.stdout:9/611: chown d7/d10/lbe 23373 1 2023-12-05T09:26:24.862 INFO:tasks.workunit.client.1.smithi134.stdout:9/612: dread - d7/d8/d14/d26/d7f/dab/fc9 zero size 2023-12-05T09:26:24.864 INFO:tasks.workunit.client.0.smithi067.stdout:4/370: mkdir d0/d1d/d53/d82 0 2023-12-05T09:26:24.865 INFO:tasks.workunit.client.1.smithi134.stdout:6/565: mknod d4/d39/d42/d4f/d6d/d3a/ca9 0 2023-12-05T09:26:24.867 INFO:tasks.workunit.client.0.smithi067.stdout:2/370: mkdir d0/d15/d53/d1e/d7f 0 2023-12-05T09:26:24.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/363: dread da/d10/d1e/d17/d2f/d1f/f25 [0,4194304] 0 2023-12-05T09:26:24.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/364: rename da to da/d10/d1e/d17/d2f/d83 22 2023-12-05T09:26:24.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/365: chown da/d10/d1e/d17/d2f/d47/l1a 1 1 2023-12-05T09:26:24.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/366: fsync da/d10/d1e/d17/d2f/d3f/f64 0 2023-12-05T09:26:24.868 INFO:tasks.workunit.client.1.smithi134.stdout:7/628: mknod d2/dd/d71/cca 0 2023-12-05T09:26:24.868 INFO:tasks.workunit.client.1.smithi134.stdout:7/629: dread - d2/df/f9d zero size 2023-12-05T09:26:24.869 INFO:tasks.workunit.client.1.smithi134.stdout:7/630: chown d2/d7/d2b/d2d/f66 84866278 1 2023-12-05T09:26:24.869 INFO:tasks.workunit.client.1.smithi134.stdout:8/747: chown da/de/d11/d8b/cd5 135 1 2023-12-05T09:26:24.877 INFO:tasks.workunit.client.0.smithi067.stdout:7/428: dwrite d0/d9/d10/f44 [4194304,4194304] 0 2023-12-05T09:26:24.877 INFO:tasks.workunit.client.0.smithi067.stdout:7/429: stat d0/d9/d10/d37/d38/d64/d5a/f7c 0 2023-12-05T09:26:24.877 INFO:tasks.workunit.client.0.smithi067.stdout:4/371: creat d0/d1d/d53/d62/f83 x:0 0 0 2023-12-05T09:26:24.878 INFO:tasks.workunit.client.0.smithi067.stdout:8/400: truncate d5/dc/f19 3228596 0 2023-12-05T09:26:24.878 INFO:tasks.workunit.client.0.smithi067.stdout:8/401: readlink d5/dc/d1a/l4a 0 2023-12-05T09:26:24.878 INFO:tasks.workunit.client.1.smithi134.stdout:4/636: rename d16/d7b/dce/d6e/daa/f43 to d16/d7b/dce/d6e/daa/d3b/fde 0 2023-12-05T09:26:24.879 INFO:tasks.workunit.client.1.smithi134.stdout:4/637: creat d16/d21/d48/d66/fdf x:0 0 0 2023-12-05T09:26:24.879 INFO:tasks.workunit.client.0.smithi067.stdout:2/371: creat d0/d25/d34/d4d/d54/d56/f80 x:0 0 0 2023-12-05T09:26:24.880 INFO:tasks.workunit.client.1.smithi134.stdout:0/595: mknod d13/d14/d15/d93/cca 0 2023-12-05T09:26:24.882 INFO:tasks.workunit.client.1.smithi134.stdout:5/605: dwrite d0/d1a/d1c/d3f/d5b/d5d/f86 [0,4194304] 0 2023-12-05T09:26:24.883 INFO:tasks.workunit.client.0.smithi067.stdout:1/467: dwrite d2/d4f/d54/d70/f9b [0,4194304] 0 2023-12-05T09:26:24.887 INFO:tasks.workunit.client.0.smithi067.stdout:6/367: symlink da/d10/d1e/d17/d2f/d47/d79/l84 0 2023-12-05T09:26:24.888 INFO:tasks.workunit.client.0.smithi067.stdout:8/402: rmdir d5/da/d30 39 2023-12-05T09:26:24.888 INFO:tasks.workunit.client.0.smithi067.stdout:8/403: stat d5/dc/d1a/d20/d58/c60 0 2023-12-05T09:26:24.888 INFO:tasks.workunit.client.0.smithi067.stdout:8/404: chown d5/dc/d1a/d20/d2d/c5e 1 1 2023-12-05T09:26:24.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/748: dread da/de/d16/d98/fb4 [0,4194304] 0 2023-12-05T09:26:24.901 INFO:tasks.workunit.client.1.smithi134.stdout:9/613: symlink d7/d8/d16/d52/d74/d97/ld2 0 2023-12-05T09:26:24.901 INFO:tasks.workunit.client.1.smithi134.stdout:9/614: chown d7/d8/d16/d52/d74/d97/d99/ccd 3 1 2023-12-05T09:26:24.901 INFO:tasks.workunit.client.1.smithi134.stdout:9/615: creat d7/d10/db3/fd3 x:0 0 0 2023-12-05T09:26:24.905 INFO:tasks.workunit.client.1.smithi134.stdout:7/631: fdatasync d2/d7/dc/d22/f3d 0 2023-12-05T09:26:24.906 INFO:tasks.workunit.client.1.smithi134.stdout:6/566: mkdir d4/d78/d7a/daa 0 2023-12-05T09:26:24.909 INFO:tasks.workunit.client.1.smithi134.stdout:2/677: dwrite d19/d28/f2a [0,4194304] 0 2023-12-05T09:26:24.909 INFO:tasks.workunit.client.1.smithi134.stdout:2/678: write d19/d76/fd2 [1013671,80823] 0 2023-12-05T09:26:24.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/754: dwrite d2/d9/f24 [0,4194304] 0 2023-12-05T09:26:24.917 INFO:tasks.workunit.client.0.smithi067.stdout:8/405: dread d5/dc/d1a/d20/f22 [0,4194304] 0 2023-12-05T09:26:24.917 INFO:tasks.workunit.client.0.smithi067.stdout:8/406: chown d5/dc/d1a/d20/c54 8304 1 2023-12-05T09:26:24.919 INFO:tasks.workunit.client.1.smithi134.stdout:9/616: dread d7/d5b/d5e/f8c [0,4194304] 0 2023-12-05T09:26:24.922 INFO:tasks.workunit.client.0.smithi067.stdout:6/368: link da/d10/d1e/d17/d2f/d47/f4d da/d10/d1e/d17/d2f/d72/f85 0 2023-12-05T09:26:24.926 INFO:tasks.workunit.client.0.smithi067.stdout:5/487: dwrite db/df/d35/d63/d75/f7d [0,4194304] 0 2023-12-05T09:26:24.926 INFO:tasks.workunit.client.0.smithi067.stdout:5/488: creat db/df/fad x:0 0 0 2023-12-05T09:26:24.927 INFO:tasks.workunit.client.1.smithi134.stdout:4/638: creat d16/d7b/dce/d6e/daa/d3b/fe0 x:0 0 0 2023-12-05T09:26:24.927 INFO:tasks.workunit.client.1.smithi134.stdout:4/639: dread - d16/d21/d48/d80/dae/f8a zero size 2023-12-05T09:26:24.933 INFO:tasks.workunit.client.0.smithi067.stdout:2/372: rmdir d0/d15/d63 39 2023-12-05T09:26:24.933 INFO:tasks.workunit.client.0.smithi067.stdout:2/373: stat d0/d15/d53/d1e/f61 0 2023-12-05T09:26:24.934 INFO:tasks.workunit.client.0.smithi067.stdout:4/372: dwrite d0/d1d/d25/d32/f3f [0,4194304] 0 2023-12-05T09:26:24.935 INFO:tasks.workunit.client.0.smithi067.stdout:1/468: dwrite d2/d5/d7/de/d19/f38 [0,4194304] 0 2023-12-05T09:26:24.936 INFO:tasks.workunit.client.1.smithi134.stdout:0/596: creat d13/d14/d15/d67/fcb x:0 0 0 2023-12-05T09:26:24.939 INFO:tasks.workunit.client.0.smithi067.stdout:8/407: mknod d5/dc/d6e/c6f 0 2023-12-05T09:26:24.947 INFO:tasks.workunit.client.0.smithi067.stdout:6/369: truncate da/d10/d1e/d17/d2f/d2c/d34/f3e 168699 0 2023-12-05T09:26:24.948 INFO:tasks.workunit.client.0.smithi067.stdout:7/430: dwrite d0/f4c [0,4194304] 0 2023-12-05T09:26:24.950 INFO:tasks.workunit.client.1.smithi134.stdout:5/606: symlink d0/d11/d61/ld3 0 2023-12-05T09:26:24.950 INFO:tasks.workunit.client.1.smithi134.stdout:5/607: chown d0/d11/c67 89479478 1 2023-12-05T09:26:24.952 INFO:tasks.workunit.client.1.smithi134.stdout:3/672: getdents d4/d5/d45/d86 0 2023-12-05T09:26:24.952 INFO:tasks.workunit.client.1.smithi134.stdout:3/673: chown d4/d1f/d4e/l98 1759607 1 2023-12-05T09:26:24.953 INFO:tasks.workunit.client.1.smithi134.stdout:3/674: read d4/d1f/d4e/f9f [368961,98076] 0 2023-12-05T09:26:24.953 INFO:tasks.workunit.client.1.smithi134.stdout:3/675: readlink d4/d5/d6f/l90 0 2023-12-05T09:26:24.954 INFO:tasks.workunit.client.1.smithi134.stdout:3/676: chown d4/fbd 242131 1 2023-12-05T09:26:24.956 INFO:tasks.workunit.client.1.smithi134.stdout:8/749: mkdir da/de/d8a/d42/d99/d106 0 2023-12-05T09:26:24.959 INFO:tasks.workunit.client.1.smithi134.stdout:3/677: dread d4/d1f/d4e/d6a/fbf [0,4194304] 0 2023-12-05T09:26:24.968 INFO:tasks.workunit.client.1.smithi134.stdout:7/632: unlink d2/df/d81/cb1 0 2023-12-05T09:26:24.968 INFO:tasks.workunit.client.1.smithi134.stdout:7/633: stat d2/dd/d1a/l4b 0 2023-12-05T09:26:24.970 INFO:tasks.workunit.client.0.smithi067.stdout:5/489: mkdir db/df/d1a/d59/dae 0 2023-12-05T09:26:24.972 INFO:tasks.workunit.client.0.smithi067.stdout:2/374: creat d0/d25/d34/d4d/f81 x:0 0 0 2023-12-05T09:26:24.972 INFO:tasks.workunit.client.0.smithi067.stdout:2/375: write d0/d2f/d39/f75 [593580,17684] 0 2023-12-05T09:26:24.974 INFO:tasks.workunit.client.1.smithi134.stdout:6/567: mknod d4/d39/d42/d4f/d6d/cab 0 2023-12-05T09:26:24.981 INFO:tasks.workunit.client.0.smithi067.stdout:4/373: mknod d0/d1d/d53/c84 0 2023-12-05T09:26:24.984 INFO:tasks.workunit.client.1.smithi134.stdout:2/679: mknod d19/d76/da9/cdb 0 2023-12-05T09:26:24.984 INFO:tasks.workunit.client.1.smithi134.stdout:2/680: readlink d19/d3a/l42 0 2023-12-05T09:26:24.985 INFO:tasks.workunit.client.1.smithi134.stdout:1/755: mkdir d2/d9/d10/d30/d66/d10d 0 2023-12-05T09:26:24.985 INFO:tasks.workunit.client.0.smithi067.stdout:8/408: dwrite d5/dc/d1a/d20/f22 [0,4194304] 0 2023-12-05T09:26:24.986 INFO:tasks.workunit.client.0.smithi067.stdout:1/469: rename d2/d3/f2a to d2/d4f/d54/d70/fa9 0 2023-12-05T09:26:24.986 INFO:tasks.workunit.client.0.smithi067.stdout:1/470: read - d2/d5/d7/de/d19/d49/d5f/f9f zero size 2023-12-05T09:26:24.994 INFO:tasks.workunit.client.1.smithi134.stdout:1/756: dread d2/d27/db4/fbe [0,4194304] 0 2023-12-05T09:26:24.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/370: mknod da/d10/d1e/d17/d2f/d1f/c86 0 2023-12-05T09:26:25.000 INFO:tasks.workunit.client.1.smithi134.stdout:0/597: unlink d13/d14/d15/d67/c72 0 2023-12-05T09:26:25.000 INFO:tasks.workunit.client.0.smithi067.stdout:8/409: dread d5/f36 [0,4194304] 0 2023-12-05T09:26:25.001 INFO:tasks.workunit.client.0.smithi067.stdout:2/376: symlink d0/d25/d34/d4a/l82 0 2023-12-05T09:26:25.003 INFO:tasks.workunit.client.0.smithi067.stdout:1/471: mknod d2/d4f/d54/d70/caa 0 2023-12-05T09:26:25.006 INFO:tasks.workunit.client.0.smithi067.stdout:4/374: dread d0/d1d/f58 [0,4194304] 0 2023-12-05T09:26:25.008 INFO:tasks.workunit.client.0.smithi067.stdout:1/472: write d2/d5/d7/de/d1a/f4b [336572,52649] 0 2023-12-05T09:26:25.008 INFO:tasks.workunit.client.0.smithi067.stdout:8/410: creat d5/dc/d1a/d20/d3e/f70 x:0 0 0 2023-12-05T09:26:25.010 INFO:tasks.workunit.client.0.smithi067.stdout:2/377: mkdir d0/d25/d3f/d83 0 2023-12-05T09:26:25.015 INFO:tasks.workunit.client.0.smithi067.stdout:4/375: rmdir d0/d1d/d3c 39 2023-12-05T09:26:25.017 INFO:tasks.workunit.client.1.smithi134.stdout:0/598: dread d13/d14/d59/f82 [0,4194304] 0 2023-12-05T09:26:25.017 INFO:tasks.workunit.client.1.smithi134.stdout:0/599: stat d13/d14/d15/d2a/f3e 0 2023-12-05T09:26:25.019 INFO:tasks.workunit.client.0.smithi067.stdout:7/431: dwrite d0/d9/d10/d37/d38/d64/d34/f36 [0,4194304] 0 2023-12-05T09:26:25.019 INFO:tasks.workunit.client.0.smithi067.stdout:7/432: write d0/d9/d40/d48/f63 [982311,55014] 0 2023-12-05T09:26:25.021 INFO:tasks.workunit.client.0.smithi067.stdout:1/473: mknod d2/d5/d7/cab 0 2023-12-05T09:26:25.021 INFO:tasks.workunit.client.0.smithi067.stdout:1/474: write d2/d4f/d14/d20/d83/f6e [4849577,51476] 0 2023-12-05T09:26:25.021 INFO:tasks.workunit.client.0.smithi067.stdout:1/475: chown d2/d5/d7/de 21 1 2023-12-05T09:26:25.021 INFO:tasks.workunit.client.0.smithi067.stdout:1/476: truncate d2/d4f/d14/d20/d4c/f65 1005221 0 2023-12-05T09:26:25.022 INFO:tasks.workunit.client.0.smithi067.stdout:8/411: truncate d5/dc/d1a/d20/f25 4220360 0 2023-12-05T09:26:25.025 INFO:tasks.workunit.client.0.smithi067.stdout:1/477: read d2/d4f/d14/d20/d4c/f65 [616885,18055] 0 2023-12-05T09:26:25.025 INFO:tasks.workunit.client.0.smithi067.stdout:1/478: chown d2/d4f/d14/d48/ca4 135 1 2023-12-05T09:26:25.027 INFO:tasks.workunit.client.0.smithi067.stdout:6/371: rename da/d10/d1e/d17/d2f/d2c/d34/d3b/d56 to da/d10/d1e/d17/d2f/d1f/d27/d4f/d87 0 2023-12-05T09:26:25.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/757: dwrite d2/f43 [0,4194304] 0 2023-12-05T09:26:25.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/758: write d2/f63 [1348147,4206] 0 2023-12-05T09:26:25.033 INFO:tasks.workunit.client.1.smithi134.stdout:8/750: rename da/de/d11/d1d/ld6 to da/de/d8a/d42/d99/dc8/l107 0 2023-12-05T09:26:25.033 INFO:tasks.workunit.client.1.smithi134.stdout:8/751: chown da/de/d11/d1d/d5f/d9b/cbb 95 1 2023-12-05T09:26:25.039 INFO:tasks.workunit.client.1.smithi134.stdout:2/681: symlink d19/d76/ldc 0 2023-12-05T09:26:25.039 INFO:tasks.workunit.client.1.smithi134.stdout:2/682: fdatasync f18 0 2023-12-05T09:26:25.041 INFO:tasks.workunit.client.0.smithi067.stdout:7/433: mkdir d0/d9/d10/d37/d38/d64/d34/d8c 0 2023-12-05T09:26:25.041 INFO:tasks.workunit.client.0.smithi067.stdout:7/434: read d0/d9/d3f/f7e [55029,15185] 0 2023-12-05T09:26:25.046 INFO:tasks.workunit.client.0.smithi067.stdout:8/412: mknod d5/dc/d1a/d20/d3e/c71 0 2023-12-05T09:26:25.046 INFO:tasks.workunit.client.0.smithi067.stdout:8/413: truncate d5/f6b 538031 0 2023-12-05T09:26:25.046 INFO:tasks.workunit.client.0.smithi067.stdout:8/414: write d5/dc/d1a/d20/f53 [520764,16162] 0 2023-12-05T09:26:25.049 INFO:tasks.workunit.client.0.smithi067.stdout:1/479: mkdir d2/d4f/d14/d20/d83/d78/dac 0 2023-12-05T09:26:25.049 INFO:tasks.workunit.client.0.smithi067.stdout:1/480: creat d2/d5/fad x:0 0 0 2023-12-05T09:26:25.050 INFO:tasks.workunit.client.0.smithi067.stdout:2/378: mkdir d0/d2f/d84 0 2023-12-05T09:26:25.051 INFO:tasks.workunit.client.1.smithi134.stdout:5/608: rmdir d0/d1a/d1c/d25/d4d/d60 39 2023-12-05T09:26:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/372: truncate da/d10/d1e/d17/d2f/d72/f82 3790038 0 2023-12-05T09:26:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/373: chown da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/l57 122 1 2023-12-05T09:26:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/374: fdatasync da/d10/d1e/d17/d2f/d2c/d34/f74 0 2023-12-05T09:26:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/375: fdatasync da/d10/d1e/d17/f41 0 2023-12-05T09:26:25.053 INFO:tasks.workunit.client.0.smithi067.stdout:6/376: write da/d10/d1e/d51/f65 [793907,11261] 0 2023-12-05T09:26:25.056 INFO:tasks.workunit.client.0.smithi067.stdout:0/562: sync 2023-12-05T09:26:25.056 INFO:tasks.workunit.client.0.smithi067.stdout:3/379: sync 2023-12-05T09:26:25.056 INFO:tasks.workunit.client.0.smithi067.stdout:0/563: creat d3/d7/d3c/d6c/d8a/fce x:0 0 0 2023-12-05T09:26:25.057 INFO:tasks.workunit.client.1.smithi134.stdout:8/752: creat da/de/f108 x:0 0 0 2023-12-05T09:26:25.057 INFO:tasks.workunit.client.1.smithi134.stdout:9/617: sync 2023-12-05T09:26:25.057 INFO:tasks.workunit.client.1.smithi134.stdout:4/640: sync 2023-12-05T09:26:25.058 INFO:tasks.workunit.client.1.smithi134.stdout:4/641: readlink d16/d21/l44 0 2023-12-05T09:26:25.058 INFO:tasks.workunit.client.0.smithi067.stdout:7/435: creat d0/d9/d40/f8d x:0 0 0 2023-12-05T09:26:25.059 INFO:tasks.workunit.client.1.smithi134.stdout:8/753: read da/de/d96/fa1 [370056,128238] 0 2023-12-05T09:26:25.059 INFO:tasks.workunit.client.1.smithi134.stdout:8/754: readlink da/la0 0 2023-12-05T09:26:25.060 INFO:tasks.workunit.client.1.smithi134.stdout:3/678: getdents d4/d1f 0 2023-12-05T09:26:25.062 INFO:tasks.workunit.client.0.smithi067.stdout:6/377: dread da/d10/d1e/d17/d2f/d47/f4c [0,4194304] 0 2023-12-05T09:26:25.063 INFO:tasks.workunit.client.1.smithi134.stdout:2/683: rmdir d19/d76/da7 39 2023-12-05T09:26:25.066 INFO:tasks.workunit.client.0.smithi067.stdout:3/380: rename d9/da/d15/d17/l7f to d9/da/d15/d28/d29/d47/d64/l81 0 2023-12-05T09:26:25.067 INFO:tasks.workunit.client.1.smithi134.stdout:5/609: rmdir d0/dd 39 2023-12-05T09:26:25.068 INFO:tasks.workunit.client.1.smithi134.stdout:5/610: write d0/d1a/d1c/f23 [4849860,62012] 0 2023-12-05T09:26:25.072 INFO:tasks.workunit.client.1.smithi134.stdout:7/634: rename d2/d7/dc/d2e/d3a/d6d/f7d to d2/d7/dc/d22/fcb 0 2023-12-05T09:26:25.078 INFO:tasks.workunit.client.0.smithi067.stdout:0/564: unlink d3/d7/d3c/d66/dbf/d10/l85 0 2023-12-05T09:26:25.078 INFO:tasks.workunit.client.0.smithi067.stdout:0/565: truncate d3/d7/d3c/d67/f5b 1099906 0 2023-12-05T09:26:25.078 INFO:tasks.workunit.client.0.smithi067.stdout:0/566: readlink d3/l8b 0 2023-12-05T09:26:25.078 INFO:tasks.workunit.client.0.smithi067.stdout:0/567: fsync d3/d7/d3c/d67/da1/fc1 0 2023-12-05T09:26:25.078 INFO:tasks.workunit.client.0.smithi067.stdout:0/568: chown d3/d7/d3c/d67/d59/d4e/d94 19342364 1 2023-12-05T09:26:25.080 INFO:tasks.workunit.client.1.smithi134.stdout:9/618: unlink d7/d10/d56/c5f 0 2023-12-05T09:26:25.081 INFO:tasks.workunit.client.1.smithi134.stdout:4/642: read d16/d7b/dce/f83 [2242217,67509] 0 2023-12-05T09:26:25.082 INFO:tasks.workunit.client.1.smithi134.stdout:4/643: write d16/d18/d1b/f7d [2356913,93772] 0 2023-12-05T09:26:25.082 INFO:tasks.workunit.client.1.smithi134.stdout:4/644: readlink d16/d21/d48/d66/lbe 0 2023-12-05T09:26:25.084 INFO:tasks.workunit.client.0.smithi067.stdout:7/436: mkdir d0/d9/d56/d8e 0 2023-12-05T09:26:25.084 INFO:tasks.workunit.client.0.smithi067.stdout:7/437: chown d0/d9/d40/d48/f66 7193 1 2023-12-05T09:26:25.084 INFO:tasks.workunit.client.0.smithi067.stdout:7/438: stat d0/d9/d10/d1d/l24 0 2023-12-05T09:26:25.086 INFO:tasks.workunit.client.1.smithi134.stdout:8/755: dread da/de/d16/d33/f81 [0,4194304] 0 2023-12-05T09:26:25.086 INFO:tasks.workunit.client.1.smithi134.stdout:8/756: stat da/de/d16/f26 0 2023-12-05T09:26:25.086 INFO:tasks.workunit.client.1.smithi134.stdout:3/679: unlink d4/d1f/d50/db1/fd5 0 2023-12-05T09:26:25.087 INFO:tasks.workunit.client.1.smithi134.stdout:3/680: getdents d4/d1f 0 2023-12-05T09:26:25.091 INFO:tasks.workunit.client.1.smithi134.stdout:2/684: link d19/d76/f7b d19/d3f/fdd 0 2023-12-05T09:26:25.091 INFO:tasks.workunit.client.0.smithi067.stdout:1/481: rmdir d2/d4f/d14/d20 39 2023-12-05T09:26:25.093 INFO:tasks.workunit.client.0.smithi067.stdout:1/482: creat d2/d4f/d15/d60/fae x:0 0 0 2023-12-05T09:26:25.093 INFO:tasks.workunit.client.0.smithi067.stdout:1/483: creat d2/d5/d7/de/d1a/faf x:0 0 0 2023-12-05T09:26:25.094 INFO:tasks.workunit.client.1.smithi134.stdout:6/568: dwrite d4/d39/d42/d4f/d6d/d3a/d80/f8b [0,4194304] 0 2023-12-05T09:26:25.099 INFO:tasks.workunit.client.1.smithi134.stdout:0/600: rename d13/d14/d15/d67/d73/f80 to d13/d14/d30/d4b/d66/da0/daf/db2/fcc 0 2023-12-05T09:26:25.099 INFO:tasks.workunit.client.1.smithi134.stdout:0/601: truncate d13/d14/d30/d2c/f44 4250328 0 2023-12-05T09:26:25.099 INFO:tasks.workunit.client.1.smithi134.stdout:0/602: creat d13/d14/d59/fcd x:0 0 0 2023-12-05T09:26:25.100 INFO:tasks.workunit.client.0.smithi067.stdout:3/381: mkdir d9/da/d15/d17/d1a/d51/d66/d82 0 2023-12-05T09:26:25.100 INFO:tasks.workunit.client.0.smithi067.stdout:3/382: chown d9/da/d15/d17/f55 24458498 1 2023-12-05T09:26:25.102 INFO:tasks.workunit.client.1.smithi134.stdout:7/635: mknod d2/d7/d2b/d2d/dac/ccc 0 2023-12-05T09:26:25.103 INFO:tasks.workunit.client.0.smithi067.stdout:6/378: dwrite da/d10/d1e/d17/d2f/d2c/f6e [0,4194304] 0 2023-12-05T09:26:25.105 INFO:tasks.workunit.client.0.smithi067.stdout:0/569: mkdir d3/d7/d3c/d66/d90/dcf 0 2023-12-05T09:26:25.107 INFO:tasks.workunit.client.1.smithi134.stdout:8/757: unlink da/de/d16/d98/fc1 0 2023-12-05T09:26:25.107 INFO:tasks.workunit.client.1.smithi134.stdout:8/758: truncate da/de/d16/d2d/ff4 23192 0 2023-12-05T09:26:25.107 INFO:tasks.workunit.client.1.smithi134.stdout:8/759: fdatasync da/de/d43/fd7 0 2023-12-05T09:26:25.110 INFO:tasks.workunit.client.1.smithi134.stdout:2/685: creat d19/d76/fde x:0 0 0 2023-12-05T09:26:25.110 INFO:tasks.workunit.client.1.smithi134.stdout:2/686: truncate d19/d28/d63/d70/f87 898860 0 2023-12-05T09:26:25.111 INFO:tasks.workunit.client.0.smithi067.stdout:1/484: symlink d2/d5/d7/de/d19/d8f/d98/lb0 0 2023-12-05T09:26:25.111 INFO:tasks.workunit.client.0.smithi067.stdout:3/383: mknod d9/da/d15/d17/d1a/c83 0 2023-12-05T09:26:25.114 INFO:tasks.workunit.client.1.smithi134.stdout:6/569: mknod d4/d39/d42/d4f/d6d/cac 0 2023-12-05T09:26:25.114 INFO:tasks.workunit.client.1.smithi134.stdout:6/570: fdatasync d4/d39/d42/d4f/d6d/d3a/d75/d59/f93 0 2023-12-05T09:26:25.114 INFO:tasks.workunit.client.1.smithi134.stdout:6/571: chown d4/d39/d42/d4f/d6d/d3a/d75/d59/f7c 2969 1 2023-12-05T09:26:25.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/379: rmdir da/d10/d1e/d17/d2f/d72 39 2023-12-05T09:26:25.115 INFO:tasks.workunit.client.1.smithi134.stdout:1/759: rename d2/d9/d10/ff4 to d2/d9/d10/d5b/dc4/f10e 0 2023-12-05T09:26:25.117 INFO:tasks.workunit.client.1.smithi134.stdout:9/619: dread d7/d8/f91 [0,4194304] 0 2023-12-05T09:26:25.118 INFO:tasks.workunit.client.1.smithi134.stdout:7/636: mknod d2/dbd/ccd 0 2023-12-05T09:26:25.118 INFO:tasks.workunit.client.1.smithi134.stdout:7/637: chown d2/d7/dc 543870909 1 2023-12-05T09:26:25.118 INFO:tasks.workunit.client.0.smithi067.stdout:6/380: getdents da/d10/d1e/d17/d2f/d1f/d27/d45 0 2023-12-05T09:26:25.118 INFO:tasks.workunit.client.0.smithi067.stdout:0/570: symlink d3/d6b/dae/ld0 0 2023-12-05T09:26:25.119 INFO:tasks.workunit.client.1.smithi134.stdout:5/611: dwrite d0/d1a/d1c/d25/d4d/d97/fa0 [0,4194304] 0 2023-12-05T09:26:25.120 INFO:tasks.workunit.client.0.smithi067.stdout:1/485: link d2/d4f/d14/d20/d83/f84 d2/d3/da6/fb1 0 2023-12-05T09:26:25.121 INFO:tasks.workunit.client.1.smithi134.stdout:8/760: unlink da/de/f2b 0 2023-12-05T09:26:25.123 INFO:tasks.workunit.client.0.smithi067.stdout:3/384: truncate d9/f43 3090142 0 2023-12-05T09:26:25.123 INFO:tasks.workunit.client.0.smithi067.stdout:3/385: write f3 [1447380,32774] 0 2023-12-05T09:26:25.125 INFO:tasks.workunit.client.1.smithi134.stdout:2/687: mknod d19/d49/cdf 0 2023-12-05T09:26:25.125 INFO:tasks.workunit.client.0.smithi067.stdout:2/379: dread d0/d15/f73 [0,4194304] 0 2023-12-05T09:26:25.127 INFO:tasks.workunit.client.0.smithi067.stdout:6/381: symlink da/d10/d1e/d17/d2f/d1f/d27/d4f/l88 0 2023-12-05T09:26:25.127 INFO:tasks.workunit.client.0.smithi067.stdout:8/415: dwrite d5/dc/d1a/d20/d2d/f5f [0,4194304] 0 2023-12-05T09:26:25.128 INFO:tasks.workunit.client.0.smithi067.stdout:0/571: mkdir d3/d7/d3c/d67/dd1 0 2023-12-05T09:26:25.130 INFO:tasks.workunit.client.1.smithi134.stdout:4/645: rename d16/d7b/dce/d6e/f82 to d16/d18/d1c/d63/fe1 0 2023-12-05T09:26:25.134 INFO:tasks.workunit.client.1.smithi134.stdout:3/681: dwrite d4/d5/d6f/d97/dae/dc9/f2a [0,4194304] 0 2023-12-05T09:26:25.135 INFO:tasks.workunit.client.1.smithi134.stdout:1/760: creat d2/d7e/f10f x:0 0 0 2023-12-05T09:26:25.138 INFO:tasks.workunit.client.0.smithi067.stdout:6/382: dread da/d10/d1e/d17/d2f/f2b [0,4194304] 0 2023-12-05T09:26:25.138 INFO:tasks.workunit.client.0.smithi067.stdout:6/383: chown da/d10/d1e/d17/d2f/d2c/d34/l52 24943257 1 2023-12-05T09:26:25.138 INFO:tasks.workunit.client.1.smithi134.stdout:8/761: read da/de/d43/fae [1486134,44738] 0 2023-12-05T09:26:25.141 INFO:tasks.workunit.client.0.smithi067.stdout:1/486: symlink d2/d4f/d14/d20/d83/d78/dac/lb2 0 2023-12-05T09:26:25.141 INFO:tasks.workunit.client.0.smithi067.stdout:1/487: chown d2/d5/d7/de/d19/d71 0 1 2023-12-05T09:26:25.144 INFO:tasks.workunit.client.1.smithi134.stdout:9/620: mkdir d7/d8/d14/d26/d7f/d92/d53/dd4 0 2023-12-05T09:26:25.145 INFO:tasks.workunit.client.1.smithi134.stdout:9/621: truncate d7/d8/fb6 233680 0 2023-12-05T09:26:25.145 INFO:tasks.workunit.client.1.smithi134.stdout:9/622: write d7/d8/d14/f46 [557387,107234] 0 2023-12-05T09:26:25.155 INFO:tasks.workunit.client.0.smithi067.stdout:3/386: symlink d9/da/d15/d17/d1a/d51/d66/d82/l84 0 2023-12-05T09:26:25.157 INFO:tasks.workunit.client.1.smithi134.stdout:7/638: mkdir d2/d8f/dce 0 2023-12-05T09:26:25.159 INFO:tasks.workunit.client.1.smithi134.stdout:6/572: rmdir d4/d39/d42/d4f/d6d 39 2023-12-05T09:26:25.163 INFO:tasks.workunit.client.0.smithi067.stdout:2/380: rename d0/d25/d3a/c55 to d0/d15/d53/d1e/d7f/c85 0 2023-12-05T09:26:25.163 INFO:tasks.workunit.client.0.smithi067.stdout:2/381: write d0/d25/d34/f3d [4467681,80751] 0 2023-12-05T09:26:25.163 INFO:tasks.workunit.client.0.smithi067.stdout:2/382: creat d0/d2f/d39/f86 x:0 0 0 2023-12-05T09:26:25.177 INFO:tasks.workunit.client.1.smithi134.stdout:5/612: truncate d0/d45/fcb 2183329 0 2023-12-05T09:26:25.186 INFO:tasks.workunit.client.0.smithi067.stdout:6/384: dwrite da/d10/f11 [0,4194304] 0 2023-12-05T09:26:25.197 INFO:tasks.workunit.client.1.smithi134.stdout:2/688: dwrite d19/d28/d63/d70/f9f [0,4194304] 0 2023-12-05T09:26:25.197 INFO:tasks.workunit.client.1.smithi134.stdout:2/689: readlink d19/d28/d2b/l8a 0 2023-12-05T09:26:25.197 INFO:tasks.workunit.client.1.smithi134.stdout:2/690: fsync d19/d76/da7/fb0 0 2023-12-05T09:26:25.197 INFO:tasks.workunit.client.1.smithi134.stdout:3/682: creat d4/d5/d6f/d97/fd7 x:0 0 0 2023-12-05T09:26:25.197 INFO:tasks.workunit.client.1.smithi134.stdout:3/683: fsync d4/d5/d45/f46 0 2023-12-05T09:26:25.199 INFO:tasks.workunit.client.1.smithi134.stdout:1/761: getdents d2/d9/d10/d30/d66/d9b 0 2023-12-05T09:26:25.203 INFO:tasks.workunit.client.1.smithi134.stdout:8/762: mkdir da/de/d96/d9d/d109 0 2023-12-05T09:26:25.204 INFO:tasks.workunit.client.0.smithi067.stdout:8/416: creat d5/dc/d1a/d20/f72 x:0 0 0 2023-12-05T09:26:25.205 INFO:tasks.workunit.client.0.smithi067.stdout:1/488: dwrite d2/d5/d7/de/d1a/f57 [0,4194304] 0 2023-12-05T09:26:25.205 INFO:tasks.workunit.client.0.smithi067.stdout:1/489: stat d2/d3/f3d 0 2023-12-05T09:26:25.206 INFO:tasks.workunit.client.1.smithi134.stdout:9/623: mkdir d7/d10/d56/dd5 0 2023-12-05T09:26:25.208 INFO:tasks.workunit.client.1.smithi134.stdout:7/639: mkdir d2/d7/d93/dcf 0 2023-12-05T09:26:25.210 INFO:tasks.workunit.client.0.smithi067.stdout:2/383: symlink d0/d7c/l87 0 2023-12-05T09:26:25.215 INFO:tasks.workunit.client.0.smithi067.stdout:9/640: sync 2023-12-05T09:26:25.216 INFO:tasks.workunit.client.1.smithi134.stdout:6/573: dwrite d4/d32/d57/f64 [0,4194304] 0 2023-12-05T09:26:25.217 INFO:tasks.workunit.client.1.smithi134.stdout:6/574: chown d4/d39/d42/d4f/d6d/d3a/da/f77 249190 1 2023-12-05T09:26:25.217 INFO:tasks.workunit.client.1.smithi134.stdout:6/575: fdatasync d4/d39/d42/d4f/d8a/f99 0 2023-12-05T09:26:25.226 INFO:tasks.workunit.client.0.smithi067.stdout:0/572: dwrite d3/d7/d30/f9b [0,4194304] 0 2023-12-05T09:26:25.227 INFO:tasks.workunit.client.0.smithi067.stdout:3/387: dwrite d9/d24/f68 [0,4194304] 0 2023-12-05T09:26:25.227 INFO:tasks.workunit.client.0.smithi067.stdout:3/388: chown d9/d62 4 1 2023-12-05T09:26:25.230 INFO:tasks.workunit.client.1.smithi134.stdout:9/624: dread d7/d8/d14/d26/f48 [0,4194304] 0 2023-12-05T09:26:25.241 INFO:tasks.workunit.client.0.smithi067.stdout:8/417: dwrite d5/f6b [0,4194304] 0 2023-12-05T09:26:25.260 INFO:tasks.workunit.client.1.smithi134.stdout:2/691: mkdir d19/d3a/de0 0 2023-12-05T09:26:25.260 INFO:tasks.workunit.client.1.smithi134.stdout:2/692: creat d19/d28/d31/d6f/fe1 x:0 0 0 2023-12-05T09:26:25.262 INFO:tasks.workunit.client.1.smithi134.stdout:1/762: mkdir d2/d27/d40/d10a/d110 0 2023-12-05T09:26:25.263 INFO:tasks.workunit.client.0.smithi067.stdout:2/384: mkdir d0/d15/d63/d88 0 2023-12-05T09:26:25.264 INFO:tasks.workunit.client.1.smithi134.stdout:8/763: mknod da/de/d8a/d42/d99/c10a 0 2023-12-05T09:26:25.267 INFO:tasks.workunit.client.0.smithi067.stdout:8/418: write d5/dc/f3f [2270413,74915] 0 2023-12-05T09:26:25.267 INFO:tasks.workunit.client.0.smithi067.stdout:6/385: dwrite da/d10/d1e/d17/d2f/f2b [0,4194304] 0 2023-12-05T09:26:25.271 INFO:tasks.workunit.client.0.smithi067.stdout:3/389: truncate d9/da/d15/d17/f16 725650 0 2023-12-05T09:26:25.278 INFO:tasks.workunit.client.0.smithi067.stdout:2/385: read d0/d25/d3a/f43 [3648018,92748] 0 2023-12-05T09:26:25.278 INFO:tasks.workunit.client.0.smithi067.stdout:2/386: creat d0/d2f/d39/f89 x:0 0 0 2023-12-05T09:26:25.282 INFO:tasks.workunit.client.1.smithi134.stdout:0/603: rename d13/d14/d59 to d13/d14/d30/d4b/d66/da0/daf/dce 0 2023-12-05T09:26:25.289 INFO:tasks.workunit.client.1.smithi134.stdout:9/625: mknod d7/d8/d14/d26/d7f/dab/cd6 0 2023-12-05T09:26:25.289 INFO:tasks.workunit.client.1.smithi134.stdout:9/626: read - d7/d10/db3/fcc zero size 2023-12-05T09:26:25.291 INFO:tasks.workunit.client.0.smithi067.stdout:8/419: unlink d5/dc/d1a/d20/d2d/l37 0 2023-12-05T09:26:25.291 INFO:tasks.workunit.client.0.smithi067.stdout:8/420: fdatasync d5/dc/f19 0 2023-12-05T09:26:25.296 INFO:tasks.workunit.client.0.smithi067.stdout:6/386: link da/d10/d1e/l46 da/d10/d1e/d17/d2f/d5f/l89 0 2023-12-05T09:26:25.296 INFO:tasks.workunit.client.0.smithi067.stdout:6/387: chown da/d10/d1e/d17/d2f/d1f 6241 1 2023-12-05T09:26:25.296 INFO:tasks.workunit.client.0.smithi067.stdout:6/388: write da/d10/d1e/d17/f23 [9585268,115758] 0 2023-12-05T09:26:25.297 INFO:tasks.workunit.client.0.smithi067.stdout:6/389: truncate da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/f66 215157 0 2023-12-05T09:26:25.298 INFO:tasks.workunit.client.1.smithi134.stdout:2/693: symlink d19/d28/d31/d38/d98/dcb/le2 0 2023-12-05T09:26:25.298 INFO:tasks.workunit.client.1.smithi134.stdout:2/694: write d19/d28/d31/d38/d98/fd1 [95681,94472] 0 2023-12-05T09:26:25.301 INFO:tasks.workunit.client.0.smithi067.stdout:2/387: unlink d0/d15/d53/f6d 0 2023-12-05T09:26:25.306 INFO:tasks.workunit.client.1.smithi134.stdout:1/763: mkdir d2/d9/d10/d5b/d111 0 2023-12-05T09:26:25.306 INFO:tasks.workunit.client.1.smithi134.stdout:1/764: chown d2/d9/d10/d30/d66/d9b/fba 6977 1 2023-12-05T09:26:25.308 INFO:tasks.workunit.client.0.smithi067.stdout:0/573: rename d3/d7/d3c/d66/d90 to d3/d7/d3c/d66/dbf/d10/dd2 0 2023-12-05T09:26:25.308 INFO:tasks.workunit.client.1.smithi134.stdout:5/613: sync 2023-12-05T09:26:25.309 INFO:tasks.workunit.client.0.smithi067.stdout:8/421: read d5/f45 [2002812,16865] 0 2023-12-05T09:26:25.309 INFO:tasks.workunit.client.0.smithi067.stdout:8/422: chown d5/dc/d1a/d20/d2d/f5f 807245 1 2023-12-05T09:26:25.312 INFO:tasks.workunit.client.1.smithi134.stdout:4/646: rename d16/d21/d35/f9d to d16/d18/d1c/ddd/fe2 0 2023-12-05T09:26:25.312 INFO:tasks.workunit.client.1.smithi134.stdout:4/647: creat d16/d21/d47/d4b/fe3 x:0 0 0 2023-12-05T09:26:25.313 INFO:tasks.workunit.client.0.smithi067.stdout:2/388: rmdir d0/d25 39 2023-12-05T09:26:25.314 INFO:tasks.workunit.client.1.smithi134.stdout:0/604: mknod d13/ccf 0 2023-12-05T09:26:25.315 INFO:tasks.workunit.client.0.smithi067.stdout:0/574: mknod d3/d6b/cd3 0 2023-12-05T09:26:25.317 INFO:tasks.workunit.client.1.smithi134.stdout:9/627: mknod d7/d8/d14/d26/d5a/d69/dc5/cd7 0 2023-12-05T09:26:25.317 INFO:tasks.workunit.client.1.smithi134.stdout:9/628: chown d7/d8/d16/d52/lc2 1 1 2023-12-05T09:26:25.318 INFO:tasks.workunit.client.0.smithi067.stdout:8/423: rmdir d5/da/d30/d61 39 2023-12-05T09:26:25.319 INFO:tasks.workunit.client.0.smithi067.stdout:8/424: truncate d5/dc/d1a/d20/d2d/d41/f4d 786737 0 2023-12-05T09:26:25.320 INFO:tasks.workunit.client.1.smithi134.stdout:2/695: stat d19/d3a/f45 0 2023-12-05T09:26:25.321 INFO:tasks.workunit.client.0.smithi067.stdout:2/389: unlink d0/d15/d63/f6e 0 2023-12-05T09:26:25.321 INFO:tasks.workunit.client.0.smithi067.stdout:2/390: stat d0/c3c 0 2023-12-05T09:26:25.321 INFO:tasks.workunit.client.0.smithi067.stdout:2/391: write d0/d15/d53/f19 [4119316,50487] 0 2023-12-05T09:26:25.322 INFO:tasks.workunit.client.1.smithi134.stdout:7/640: dwrite d2/d7/dc/f2c [0,4194304] 0 2023-12-05T09:26:25.323 INFO:tasks.workunit.client.1.smithi134.stdout:7/641: chown d2/dd/d1a/l4b 378033212 1 2023-12-05T09:26:25.325 INFO:tasks.workunit.client.0.smithi067.stdout:0/575: creat d3/d7/d3c/d67/d59/d4e/db2/fd4 x:0 0 0 2023-12-05T09:26:25.325 INFO:tasks.workunit.client.0.smithi067.stdout:8/425: creat d5/dc/d1a/d62/f73 x:0 0 0 2023-12-05T09:26:25.327 INFO:tasks.workunit.client.1.smithi134.stdout:3/684: rename d4/d5/d45/fb3 to d4/d5/d45/d60/d85/dab/fd8 0 2023-12-05T09:26:25.330 INFO:tasks.workunit.client.0.smithi067.stdout:0/576: unlink d3/d7/d3c/d66/dbf/f18 0 2023-12-05T09:26:25.334 INFO:tasks.workunit.client.1.smithi134.stdout:6/576: rename d4/d78/c92 to d4/d78/d7a/daa/cad 0 2023-12-05T09:26:25.335 INFO:tasks.workunit.client.1.smithi134.stdout:6/577: write d4/d39/d42/d4f/d6d/d3a/d75/f29 [6237143,32334] 0 2023-12-05T09:26:25.335 INFO:tasks.workunit.client.0.smithi067.stdout:3/390: dwrite f3 [4194304,4194304] 0 2023-12-05T09:26:25.335 INFO:tasks.workunit.client.1.smithi134.stdout:9/629: dread d7/d8/d14/d26/d5a/fae [0,4194304] 0 2023-12-05T09:26:25.336 INFO:tasks.workunit.client.1.smithi134.stdout:3/685: unlink d4/d5/d45/f4d 0 2023-12-05T09:26:25.338 INFO:tasks.workunit.client.0.smithi067.stdout:0/577: rename d3/d6b/l81 to d3/ld5 0 2023-12-05T09:26:25.340 INFO:tasks.workunit.client.1.smithi134.stdout:5/614: dwrite d0/d1a/d1c/d3f/d5b/d5d/f86 [4194304,4194304] 0 2023-12-05T09:26:25.340 INFO:tasks.workunit.client.1.smithi134.stdout:5/615: write d0/d1a/d1c/d3f/fb7 [75157,114792] 0 2023-12-05T09:26:25.340 INFO:tasks.workunit.client.1.smithi134.stdout:0/605: symlink d13/d14/d30/d2c/ld0 0 2023-12-05T09:26:25.344 INFO:tasks.workunit.client.0.smithi067.stdout:0/578: creat d3/fd6 x:0 0 0 2023-12-05T09:26:25.345 INFO:tasks.workunit.client.0.smithi067.stdout:5/490: sync 2023-12-05T09:26:25.349 INFO:tasks.workunit.client.1.smithi134.stdout:3/686: unlink d4/d5/c53 0 2023-12-05T09:26:25.354 INFO:tasks.workunit.client.1.smithi134.stdout:5/616: symlink d0/dd/ld4 0 2023-12-05T09:26:25.355 INFO:tasks.workunit.client.0.smithi067.stdout:0/579: mkdir d3/d7/dd7 0 2023-12-05T09:26:25.355 INFO:tasks.workunit.client.0.smithi067.stdout:0/580: chown d3/d7/d3c/d66/dbf/d10/dd2/l70 30372828 1 2023-12-05T09:26:25.357 INFO:tasks.workunit.client.1.smithi134.stdout:0/606: symlink d13/d14/d30/d2c/d9d/da5/ld1 0 2023-12-05T09:26:25.357 INFO:tasks.workunit.client.1.smithi134.stdout:0/607: read d13/d14/d30/d4b/f41 [157517,88215] 0 2023-12-05T09:26:25.363 INFO:tasks.workunit.client.1.smithi134.stdout:3/687: link d4/d1f/l57 d4/d5/d45/ld9 0 2023-12-05T09:26:25.364 INFO:tasks.workunit.client.1.smithi134.stdout:3/688: write d4/d1f/d50/d52/f58 [2868634,86106] 0 2023-12-05T09:26:25.364 INFO:tasks.workunit.client.0.smithi067.stdout:5/491: write db/df/d35/d63/d75/f7d [2088112,27662] 0 2023-12-05T09:26:25.371 INFO:tasks.workunit.client.1.smithi134.stdout:8/764: rename da/de/d96/dc9/dd8 to da/de/d11/d8b/d8c/d10b 0 2023-12-05T09:26:25.371 INFO:tasks.workunit.client.1.smithi134.stdout:8/765: chown da/de/d43/f5d 14 1 2023-12-05T09:26:25.371 INFO:tasks.workunit.client.1.smithi134.stdout:8/766: write da/de/f48 [1357479,45081] 0 2023-12-05T09:26:25.371 INFO:tasks.workunit.client.0.smithi067.stdout:0/581: dread d3/d7/d3c/f47 [0,4194304] 0 2023-12-05T09:26:25.376 INFO:tasks.workunit.client.1.smithi134.stdout:3/689: unlink d4/d1f/f75 0 2023-12-05T09:26:25.377 INFO:tasks.workunit.client.1.smithi134.stdout:5/617: getdents d0/d1a/d1c/d25/d6a 0 2023-12-05T09:26:25.380 INFO:tasks.workunit.client.0.smithi067.stdout:5/492: creat db/df/d35/d63/faf x:0 0 0 2023-12-05T09:26:25.384 INFO:tasks.workunit.client.0.smithi067.stdout:5/493: symlink db/df/d35/d63/d75/lb0 0 2023-12-05T09:26:25.384 INFO:tasks.workunit.client.0.smithi067.stdout:5/494: creat db/df/d35/fb1 x:0 0 0 2023-12-05T09:26:25.384 INFO:tasks.workunit.client.0.smithi067.stdout:5/495: creat db/df/d35/d63/d75/fb2 x:0 0 0 2023-12-05T09:26:25.387 INFO:tasks.workunit.client.1.smithi134.stdout:5/618: link d0/d45/daf/lc4 d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/ld5 0 2023-12-05T09:26:25.392 INFO:tasks.workunit.client.0.smithi067.stdout:3/391: dwrite d9/f78 [0,4194304] 0 2023-12-05T09:26:25.393 INFO:tasks.workunit.client.0.smithi067.stdout:3/392: stat d9/d62/l59 0 2023-12-05T09:26:25.401 INFO:tasks.workunit.client.0.smithi067.stdout:3/393: mknod d9/da/c85 0 2023-12-05T09:26:25.403 INFO:tasks.workunit.client.1.smithi134.stdout:8/767: dread da/de/d11/f30 [0,4194304] 0 2023-12-05T09:26:25.404 INFO:tasks.workunit.client.1.smithi134.stdout:8/768: readlink da/de/d4d/d68/lf2 0 2023-12-05T09:26:25.404 INFO:tasks.workunit.client.1.smithi134.stdout:8/769: chown da/de/d8a/d42/da2 1 1 2023-12-05T09:26:25.404 INFO:tasks.workunit.client.1.smithi134.stdout:8/770: truncate da/de/d16/d98/fb5 881633 0 2023-12-05T09:26:25.407 INFO:tasks.workunit.client.0.smithi067.stdout:3/394: unlink d9/da/d15/f1b 0 2023-12-05T09:26:25.407 INFO:tasks.workunit.client.0.smithi067.stdout:3/395: readlink d9/da/d15/d17/l23 0 2023-12-05T09:26:25.407 INFO:tasks.workunit.client.1.smithi134.stdout:1/765: rename d2/d27/d71/d80/db8 to d2/d9/d10/d94/de5/d112 0 2023-12-05T09:26:25.409 INFO:tasks.workunit.client.1.smithi134.stdout:6/578: rename d4/d78/d7a/l7b to d4/d39/d42/d4f/d8a/lae 0 2023-12-05T09:26:25.409 INFO:tasks.workunit.client.1.smithi134.stdout:6/579: chown d4/d39/d42/d4f/d6d/d3a/ca9 15632710 1 2023-12-05T09:26:25.409 INFO:tasks.workunit.client.1.smithi134.stdout:6/580: write d4/d39/d42/d4f/d6d/d3a/d75/d59/f7f [832531,67079] 0 2023-12-05T09:26:25.410 INFO:tasks.workunit.client.1.smithi134.stdout:1/766: mkdir d2/d9/d10/d94/de5/d113 0 2023-12-05T09:26:25.411 INFO:tasks.workunit.client.1.smithi134.stdout:8/771: getdents da/de/d11/d1d/db8 0 2023-12-05T09:26:25.417 INFO:tasks.workunit.client.1.smithi134.stdout:0/608: dwrite d13/d14/d15/f21 [0,4194304] 0 2023-12-05T09:26:25.417 INFO:tasks.workunit.client.0.smithi067.stdout:2/392: write d0/d15/f73 [3423477,110679] 0 2023-12-05T09:26:25.420 INFO:tasks.workunit.client.0.smithi067.stdout:6/390: dwrite da/d10/d1e/d17/f41 [0,4194304] 0 2023-12-05T09:26:25.420 INFO:tasks.workunit.client.0.smithi067.stdout:6/391: fsync da/d10/d1e/d17/d2f/d3f/f64 0 2023-12-05T09:26:25.420 INFO:tasks.workunit.client.0.smithi067.stdout:6/392: chown da/d10/d1e/l1d 189743 1 2023-12-05T09:26:25.420 INFO:tasks.workunit.client.0.smithi067.stdout:6/393: chown da/d10/d1e/d7f 28 1 2023-12-05T09:26:25.424 INFO:tasks.workunit.client.1.smithi134.stdout:9/630: rename d7/d5b/d5e/daa/fb1 to d7/fd8 0 2023-12-05T09:26:25.424 INFO:tasks.workunit.client.1.smithi134.stdout:6/581: readlink d4/d39/d42/d4f/d6d/d3a/da/l70 0 2023-12-05T09:26:25.424 INFO:tasks.workunit.client.1.smithi134.stdout:9/631: readlink d7/d8/d14/d26/d5a/d69/dc5/lc6 0 2023-12-05T09:26:25.424 INFO:tasks.workunit.client.1.smithi134.stdout:6/582: write d4/d39/d42/d4f/d6d/f43 [2904727,60544] 0 2023-12-05T09:26:25.424 INFO:tasks.workunit.client.1.smithi134.stdout:6/583: write d4/d39/d42/d4f/d6d/d45/f95 [537840,26739] 0 2023-12-05T09:26:25.425 INFO:tasks.workunit.client.1.smithi134.stdout:1/767: mknod d2/d27/db4/c114 0 2023-12-05T09:26:25.425 INFO:tasks.workunit.client.1.smithi134.stdout:0/609: dread d13/d14/d15/fc8 [0,4194304] 0 2023-12-05T09:26:25.425 INFO:tasks.workunit.client.1.smithi134.stdout:0/610: chown d13/d14/d15/d67/f7a 76088 1 2023-12-05T09:26:25.430 INFO:tasks.workunit.client.0.smithi067.stdout:6/394: symlink da/d10/d1e/d17/d2f/d2c/l8a 0 2023-12-05T09:26:25.436 INFO:tasks.workunit.client.1.smithi134.stdout:8/772: rename da/de/d16/d2d/f7b to da/de/d11/d8b/f10c 0 2023-12-05T09:26:25.436 INFO:tasks.workunit.client.1.smithi134.stdout:8/773: readlink da/de/d43/lca 0 2023-12-05T09:26:25.436 INFO:tasks.workunit.client.1.smithi134.stdout:8/774: fdatasync da/de/d8a/d42/f63 0 2023-12-05T09:26:25.436 INFO:tasks.workunit.client.1.smithi134.stdout:8/775: fdatasync da/f3e 0 2023-12-05T09:26:25.437 INFO:tasks.workunit.client.0.smithi067.stdout:8/426: dwrite d5/dc/d1a/f64 [0,4194304] 0 2023-12-05T09:26:25.439 INFO:tasks.workunit.client.0.smithi067.stdout:6/395: symlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/l8b 0 2023-12-05T09:26:25.445 INFO:tasks.workunit.client.0.smithi067.stdout:8/427: creat d5/d6a/f74 x:0 0 0 2023-12-05T09:26:25.448 INFO:tasks.workunit.client.1.smithi134.stdout:1/768: rename d2/d9/d8d/da2/db1/fc0 to d2/d9/d10/d30/d66/d10d/f115 0 2023-12-05T09:26:25.448 INFO:tasks.workunit.client.1.smithi134.stdout:1/769: dread - d2/d9/d10/d30/d66/da9/feb zero size 2023-12-05T09:26:25.448 INFO:tasks.workunit.client.1.smithi134.stdout:1/770: truncate d2/d9/d10/d94/de5/d112/de1/ff5 1144106 0 2023-12-05T09:26:25.450 INFO:tasks.workunit.client.0.smithi067.stdout:5/496: dwrite db/df/d1a/d1d/d20/f2a [4194304,4194304] 0 2023-12-05T09:26:25.450 INFO:tasks.workunit.client.0.smithi067.stdout:5/497: read - db/df/d35/d63/faf zero size 2023-12-05T09:26:25.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/396: rename c7 to da/d10/d1e/d51/c8c 0 2023-12-05T09:26:25.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/611: rename d13/d14/d15/d93/l9a to d13/d14/d30/d4b/d66/da0/daf/dce/ld2 0 2023-12-05T09:26:25.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/612: chown d13/d14/d15/d2a 4466 1 2023-12-05T09:26:25.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/613: read d13/d14/d30/d4b/f41 [370171,51853] 0 2023-12-05T09:26:25.457 INFO:tasks.workunit.client.0.smithi067.stdout:8/428: link d5/dc/d1a/d20/d2d/l5d d5/l75 0 2023-12-05T09:26:25.458 INFO:tasks.workunit.client.1.smithi134.stdout:4/648: sync 2023-12-05T09:26:25.459 INFO:tasks.workunit.client.1.smithi134.stdout:0/614: truncate d13/d14/f6c 3492548 0 2023-12-05T09:26:25.465 INFO:tasks.workunit.client.0.smithi067.stdout:8/429: creat d5/dc/d6e/f76 x:0 0 0 2023-12-05T09:26:25.469 INFO:tasks.workunit.client.1.smithi134.stdout:9/632: dwrite d7/d8/d16/f33 [0,4194304] 0 2023-12-05T09:26:25.470 INFO:tasks.workunit.client.0.smithi067.stdout:8/430: truncate d5/dc/d1a/f2f 695276 0 2023-12-05T09:26:25.470 INFO:tasks.workunit.client.0.smithi067.stdout:5/498: dread db/df/d36/d57/f73 [0,4194304] 0 2023-12-05T09:26:25.470 INFO:tasks.workunit.client.0.smithi067.stdout:3/396: dwrite d9/f27 [0,4194304] 0 2023-12-05T09:26:25.471 INFO:tasks.workunit.client.0.smithi067.stdout:5/499: creat db/df/d82/fb3 x:0 0 0 2023-12-05T09:26:25.471 INFO:tasks.workunit.client.0.smithi067.stdout:5/500: dread - db/df/d36/f8a zero size 2023-12-05T09:26:25.472 INFO:tasks.workunit.client.1.smithi134.stdout:9/633: link d7/d8/la d7/d5b/d5e/daa/ld9 0 2023-12-05T09:26:25.473 INFO:tasks.workunit.client.1.smithi134.stdout:1/771: write d2/d9/d10/d30/d4a/d81/f8e [2405544,898] 0 2023-12-05T09:26:25.474 INFO:tasks.workunit.client.0.smithi067.stdout:3/397: creat d9/da/d15/d28/d29/d7e/f86 x:0 0 0 2023-12-05T09:26:25.476 INFO:tasks.workunit.client.0.smithi067.stdout:5/501: symlink db/df/d36/lb4 0 2023-12-05T09:26:25.476 INFO:tasks.workunit.client.0.smithi067.stdout:5/502: stat db/f14 0 2023-12-05T09:26:25.478 INFO:tasks.workunit.client.1.smithi134.stdout:9/634: rmdir d7/d10/db3 39 2023-12-05T09:26:25.485 INFO:tasks.workunit.client.0.smithi067.stdout:2/393: dwrite d0/fe [0,4194304] 0 2023-12-05T09:26:25.485 INFO:tasks.workunit.client.0.smithi067.stdout:2/394: chown d0/d25/d34/d4d/d54/c4b 3 1 2023-12-05T09:26:25.491 INFO:tasks.workunit.client.0.smithi067.stdout:2/395: rename d0/d25/d3a/f43 to d0/f8a 0 2023-12-05T09:26:25.494 INFO:tasks.workunit.client.0.smithi067.stdout:2/396: creat d0/d25/f8b x:0 0 0 2023-12-05T09:26:25.496 INFO:tasks.workunit.client.0.smithi067.stdout:2/397: creat d0/d25/d34/d4d/d72/f8c x:0 0 0 2023-12-05T09:26:25.499 INFO:tasks.workunit.client.1.smithi134.stdout:5/619: dwrite d0/d1a/d1c/d3f/d5b/d5d/f86 [8388608,4194304] 0 2023-12-05T09:26:25.502 INFO:tasks.workunit.client.1.smithi134.stdout:9/635: dread d7/d8/d16/f1f [0,4194304] 0 2023-12-05T09:26:25.502 INFO:tasks.workunit.client.1.smithi134.stdout:9/636: fdatasync d7/fd8 0 2023-12-05T09:26:25.503 INFO:tasks.workunit.client.1.smithi134.stdout:5/620: getdents d0/d1a/d1c 0 2023-12-05T09:26:25.505 INFO:tasks.workunit.client.0.smithi067.stdout:6/397: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a [0,4194304] 0 2023-12-05T09:26:25.506 INFO:tasks.workunit.client.1.smithi134.stdout:9/637: link d7/d8/d14/d26/f4a d7/d8/d16/fda 0 2023-12-05T09:26:25.509 INFO:tasks.workunit.client.0.smithi067.stdout:4/376: sync 2023-12-05T09:26:25.513 INFO:tasks.workunit.client.1.smithi134.stdout:5/621: mknod d0/d1a/d1c/cd6 0 2023-12-05T09:26:25.513 INFO:tasks.workunit.client.0.smithi067.stdout:6/398: unlink da/d10/d1e/d17/d2f/d1f/l31 0 2023-12-05T09:26:25.516 INFO:tasks.workunit.client.1.smithi134.stdout:6/584: dwrite d4/d39/d42/d4f/d6d/d3a/d80/f81 [4194304,4194304] 0 2023-12-05T09:26:25.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/638: creat d7/d8/d16/d52/d74/d97/fdb x:0 0 0 2023-12-05T09:26:25.524 INFO:tasks.workunit.client.1.smithi134.stdout:5/622: dread - d0/d1a/d1c/d25/fa2 zero size 2023-12-05T09:26:25.524 INFO:tasks.workunit.client.1.smithi134.stdout:5/623: chown d0/d1a/d1c/d25/d4d/d9e/fc5 152150639 1 2023-12-05T09:26:25.531 INFO:tasks.workunit.client.0.smithi067.stdout:6/399: symlink da/d10/d1e/l8d 0 2023-12-05T09:26:25.531 INFO:tasks.workunit.client.0.smithi067.stdout:6/400: fdatasync da/d10/d1e/d17/d2f/d2c/f6e 0 2023-12-05T09:26:25.543 INFO:tasks.workunit.client.1.smithi134.stdout:9/639: rename d7/d8/d16/c41 to d7/d8/d14/d26/d5a/d69/d9e/cdc 0 2023-12-05T09:26:25.545 INFO:tasks.workunit.client.1.smithi134.stdout:1/772: dwrite d2/d9/f57 [0,4194304] 0 2023-12-05T09:26:25.546 INFO:tasks.workunit.client.1.smithi134.stdout:5/624: creat d0/d1a/d1c/d3f/d5b/d5d/d78/fd7 x:0 0 0 2023-12-05T09:26:25.553 INFO:tasks.workunit.client.1.smithi134.stdout:6/585: rmdir d4/d39/d42/d4f/d6d/d45/d8c 39 2023-12-05T09:26:25.553 INFO:tasks.workunit.client.1.smithi134.stdout:9/640: symlink d7/d8/d14/d26/d7f/d92/d53/d7b/ldd 0 2023-12-05T09:26:25.553 INFO:tasks.workunit.client.1.smithi134.stdout:1/773: creat d2/d9/d10/d30/d66/da9/d74/d99/f116 x:0 0 0 2023-12-05T09:26:25.556 INFO:tasks.workunit.client.1.smithi134.stdout:5/625: rename d0/d1a/d1c/d25/l2b to d0/d11/d61/ld8 0 2023-12-05T09:26:25.557 INFO:tasks.workunit.client.1.smithi134.stdout:6/586: creat d4/d39/d42/d4f/d6d/d3a/d75/d86/faf x:0 0 0 2023-12-05T09:26:25.559 INFO:tasks.workunit.client.1.smithi134.stdout:9/641: creat d7/d8/d14/d26/d7f/d92/fde x:0 0 0 2023-12-05T09:26:25.562 INFO:tasks.workunit.client.1.smithi134.stdout:1/774: truncate d2/d9/d10/d30/d66/da9/d74/d99/fe0 210043 0 2023-12-05T09:26:25.563 INFO:tasks.workunit.client.1.smithi134.stdout:6/587: mkdir d4/d39/d42/db0 0 2023-12-05T09:26:25.568 INFO:tasks.workunit.client.1.smithi134.stdout:6/588: getdents d4/d39/d42/d4f/d6d/d3a/da 0 2023-12-05T09:26:25.570 INFO:tasks.workunit.client.0.smithi067.stdout:6/401: dread da/d10/d1e/d17/d2f/d2c/f6e [0,4194304] 0 2023-12-05T09:26:25.574 INFO:tasks.workunit.client.0.smithi067.stdout:3/398: write d9/da/d15/d17/d1a/f35 [1029485,115019] 0 2023-12-05T09:26:25.577 INFO:tasks.workunit.client.0.smithi067.stdout:3/399: mkdir d9/da/d15/d28/d29/d7e/d87 0 2023-12-05T09:26:25.577 INFO:tasks.workunit.client.0.smithi067.stdout:3/400: dread - d9/d20/f4f zero size 2023-12-05T09:26:25.578 INFO:tasks.workunit.client.1.smithi134.stdout:6/589: dread d4/d39/d42/f4d [0,4194304] 0 2023-12-05T09:26:25.581 INFO:tasks.workunit.client.0.smithi067.stdout:3/401: creat d9/d62/f88 x:0 0 0 2023-12-05T09:26:25.581 INFO:tasks.workunit.client.0.smithi067.stdout:3/402: dread - d9/da/d15/d28/d29/d7e/f86 zero size 2023-12-05T09:26:25.582 INFO:tasks.workunit.client.1.smithi134.stdout:4/649: dwrite d16/d21/d47/d4b/fd0 [0,4194304] 0 2023-12-05T09:26:25.582 INFO:tasks.workunit.client.1.smithi134.stdout:4/650: chown d16/d21/d48/d66/lbe 227794 1 2023-12-05T09:26:25.584 INFO:tasks.workunit.client.1.smithi134.stdout:4/651: rmdir d16/d21/d48/d66/db0 39 2023-12-05T09:26:25.585 INFO:tasks.workunit.client.0.smithi067.stdout:4/377: dwrite d0/d1d/d25/f5f [0,4194304] 0 2023-12-05T09:26:25.585 INFO:tasks.workunit.client.0.smithi067.stdout:4/378: creat d0/d9/f85 x:0 0 0 2023-12-05T09:26:25.591 INFO:tasks.workunit.client.1.smithi134.stdout:4/652: creat d16/d18/dc5/fe4 x:0 0 0 2023-12-05T09:26:25.592 INFO:tasks.workunit.client.0.smithi067.stdout:8/431: dwrite d5/f18 [0,4194304] 0 2023-12-05T09:26:25.592 INFO:tasks.workunit.client.0.smithi067.stdout:8/432: chown d5/dc/d1a/d20/d58/c65 16 1 2023-12-05T09:26:25.593 INFO:tasks.workunit.client.1.smithi134.stdout:4/653: mkdir d16/d21/de5 0 2023-12-05T09:26:25.595 INFO:tasks.workunit.client.1.smithi134.stdout:0/615: dwrite d13/d14/d30/d4b/f4e [4194304,4194304] 0 2023-12-05T09:26:25.595 INFO:tasks.workunit.client.1.smithi134.stdout:0/616: chown d13/d14/d30/d4b/d66/da0/daf/dce/d7d/f96 1796743 1 2023-12-05T09:26:25.596 INFO:tasks.workunit.client.0.smithi067.stdout:8/433: unlink d5/l35 0 2023-12-05T09:26:25.596 INFO:tasks.workunit.client.0.smithi067.stdout:8/434: fsync d5/f6b 0 2023-12-05T09:26:25.597 INFO:tasks.workunit.client.1.smithi134.stdout:9/642: write d7/f47 [308185,64262] 0 2023-12-05T09:26:25.601 INFO:tasks.workunit.client.1.smithi134.stdout:0/617: creat d13/d14/d30/d4b/d66/da0/daf/dce/d86/fd3 x:0 0 0 2023-12-05T09:26:25.602 INFO:tasks.workunit.client.1.smithi134.stdout:0/618: dread - d13/d14/d15/d2a/d8c/db6/fc4 zero size 2023-12-05T09:26:25.602 INFO:tasks.workunit.client.1.smithi134.stdout:0/619: write d13/f17 [1760513,96532] 0 2023-12-05T09:26:25.602 INFO:tasks.workunit.client.1.smithi134.stdout:0/620: write d13/d14/d30/d4b/d66/da0/daf/db2/fcc [704,89661] 0 2023-12-05T09:26:25.602 INFO:tasks.workunit.client.1.smithi134.stdout:6/590: dread d4/d39/d42/d4f/d6d/d45/f9c [0,4194304] 0 2023-12-05T09:26:25.602 INFO:tasks.workunit.client.1.smithi134.stdout:9/643: symlink d7/d8/d14/d26/d5a/da1/ldf 0 2023-12-05T09:26:25.602 INFO:tasks.workunit.client.1.smithi134.stdout:2/696: sync 2023-12-05T09:26:25.608 INFO:tasks.workunit.client.1.smithi134.stdout:6/591: getdents d4/d39/d42/d4f/d6d/d3a 0 2023-12-05T09:26:25.610 INFO:tasks.workunit.client.0.smithi067.stdout:5/503: dwrite db/df/d36/f7b [4194304,4194304] 0 2023-12-05T09:26:25.610 INFO:tasks.workunit.client.0.smithi067.stdout:3/403: dread d9/f43 [0,4194304] 0 2023-12-05T09:26:25.610 INFO:tasks.workunit.client.0.smithi067.stdout:3/404: truncate d9/da/d15/d28/d29/f36 1480758 0 2023-12-05T09:26:25.612 INFO:tasks.workunit.client.0.smithi067.stdout:4/379: dread d0/d1d/d2b/d50/d15/f33 [0,4194304] 0 2023-12-05T09:26:25.617 INFO:tasks.workunit.client.1.smithi134.stdout:6/592: dread d4/d39/d42/d4f/d6d/d3a/d80/fa3 [4194304,4194304] 0 2023-12-05T09:26:25.617 INFO:tasks.workunit.client.1.smithi134.stdout:6/593: write d4/d39/d42/d4f/d6d/d3a/d75/f30 [3270504,94156] 0 2023-12-05T09:26:25.617 INFO:tasks.workunit.client.0.smithi067.stdout:2/398: dwrite d0/d15/d53/d1e/f74 [0,4194304] 0 2023-12-05T09:26:25.617 INFO:tasks.workunit.client.0.smithi067.stdout:2/399: dread - d0/d2f/d39/f89 zero size 2023-12-05T09:26:25.618 INFO:tasks.workunit.client.1.smithi134.stdout:1/775: dwrite d2/d9/f2d [0,4194304] 0 2023-12-05T09:26:25.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:25 smithi067 ceph-mon[107174]: pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 149 MiB/s rd, 183 MiB/s wr, 256 op/s 2023-12-05T09:26:25.620 INFO:tasks.workunit.client.1.smithi134.stdout:2/697: dread d19/d28/d63/d70/f7d [0,4194304] 0 2023-12-05T09:26:25.620 INFO:tasks.workunit.client.1.smithi134.stdout:2/698: creat d19/d49/fe3 x:0 0 0 2023-12-05T09:26:25.620 INFO:tasks.workunit.client.1.smithi134.stdout:2/699: write d19/d28/d2b/f64 [86815,83515] 0 2023-12-05T09:26:25.620 INFO:tasks.workunit.client.1.smithi134.stdout:2/700: fsync d19/fac 0 2023-12-05T09:26:25.623 INFO:tasks.workunit.client.0.smithi067.stdout:2/400: read d0/d25/d34/d4a/f52 [759425,14600] 0 2023-12-05T09:26:25.623 INFO:tasks.workunit.client.0.smithi067.stdout:2/401: creat d0/d25/d34/d4a/f8d x:0 0 0 2023-12-05T09:26:25.624 INFO:tasks.workunit.client.0.smithi067.stdout:5/504: mkdir db/df/db5 0 2023-12-05T09:26:25.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:25 smithi134 ceph-mon[116304]: pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 149 MiB/s rd, 183 MiB/s wr, 256 op/s 2023-12-05T09:26:25.632 INFO:tasks.workunit.client.1.smithi134.stdout:5/626: getdents d0/d1a/d1c/d3f/d5b/d5d/d78 0 2023-12-05T09:26:25.637 INFO:tasks.workunit.client.1.smithi134.stdout:9/644: write d7/d10/f37 [6409798,60217] 0 2023-12-05T09:26:25.640 INFO:tasks.workunit.client.1.smithi134.stdout:2/701: write d19/d5f/f93 [1868500,82988] 0 2023-12-05T09:26:25.641 INFO:tasks.workunit.client.0.smithi067.stdout:6/402: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a [0,4194304] 0 2023-12-05T09:26:25.641 INFO:tasks.workunit.client.0.smithi067.stdout:6/403: chown da/d10/d1e/d17/d2f/d1f/c55 7 1 2023-12-05T09:26:25.641 INFO:tasks.workunit.client.0.smithi067.stdout:6/404: fdatasync da/d10/d1e/d51/f65 0 2023-12-05T09:26:25.645 INFO:tasks.workunit.client.1.smithi134.stdout:7/642: sync 2023-12-05T09:26:25.645 INFO:tasks.workunit.client.1.smithi134.stdout:3/690: sync 2023-12-05T09:26:25.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/654: dwrite d16/d21/d35/f60 [0,4194304] 0 2023-12-05T09:26:25.651 INFO:tasks.workunit.client.1.smithi134.stdout:1/776: creat d2/d9/d10/d30/d66/d9b/f117 x:0 0 0 2023-12-05T09:26:25.651 INFO:tasks.workunit.client.1.smithi134.stdout:1/777: write d2/d27/d40/f10c [111899,79629] 0 2023-12-05T09:26:25.651 INFO:tasks.workunit.client.1.smithi134.stdout:1/778: write d2/d9/d10/d30/d66/da9/f7f [143936,102726] 0 2023-12-05T09:26:25.651 INFO:tasks.workunit.client.1.smithi134.stdout:1/779: readlink d2/d9/d10/d30/d4a/lc3 0 2023-12-05T09:26:25.653 INFO:tasks.workunit.client.0.smithi067.stdout:7/439: sync 2023-12-05T09:26:25.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/627: creat d0/d1a/d1c/d3f/d81/d8e/fd9 x:0 0 0 2023-12-05T09:26:25.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/628: fdatasync d0/d1a/d3a/f4e 0 2023-12-05T09:26:25.661 INFO:tasks.workunit.client.1.smithi134.stdout:2/702: creat d19/d28/d9e/fe4 x:0 0 0 2023-12-05T09:26:25.662 INFO:tasks.workunit.client.1.smithi134.stdout:0/621: dwrite d13/f17 [0,4194304] 0 2023-12-05T09:26:25.663 INFO:tasks.workunit.client.0.smithi067.stdout:2/402: mkdir d0/d15/d53/d1e/d8e 0 2023-12-05T09:26:25.666 INFO:tasks.workunit.client.1.smithi134.stdout:7/643: mkdir d2/d7/d93/dcf/dd0 0 2023-12-05T09:26:25.666 INFO:tasks.workunit.client.1.smithi134.stdout:7/644: fdatasync d2/f8 0 2023-12-05T09:26:25.668 INFO:tasks.workunit.client.0.smithi067.stdout:5/505: rename db/df/d52/l8e to db/df/d3f/d88/lb6 0 2023-12-05T09:26:25.669 INFO:tasks.workunit.client.1.smithi134.stdout:9/645: dread d7/d8/d16/d52/f8b [0,4194304] 0 2023-12-05T09:26:25.670 INFO:tasks.workunit.client.1.smithi134.stdout:9/646: creat d7/d8/d14/d26/d5a/d69/fe0 x:0 0 0 2023-12-05T09:26:25.672 INFO:tasks.workunit.client.0.smithi067.stdout:4/380: getdents d0/d1d/d25 0 2023-12-05T09:26:25.672 INFO:tasks.workunit.client.0.smithi067.stdout:4/381: chown d0/d1d/d25/d32 856965 1 2023-12-05T09:26:25.672 INFO:tasks.workunit.client.0.smithi067.stdout:1/490: sync 2023-12-05T09:26:25.677 INFO:tasks.workunit.client.0.smithi067.stdout:6/405: creat da/d10/d1e/d17/d2f/d47/d80/f8e x:0 0 0 2023-12-05T09:26:25.678 INFO:tasks.workunit.client.0.smithi067.stdout:9/641: sync 2023-12-05T09:26:25.678 INFO:tasks.workunit.client.0.smithi067.stdout:0/582: sync 2023-12-05T09:26:25.680 INFO:tasks.workunit.client.1.smithi134.stdout:4/655: mknod d16/d7b/d6f/ce6 0 2023-12-05T09:26:25.681 INFO:tasks.workunit.client.1.smithi134.stdout:3/691: link d4/d1f/l3e d4/d5/d6f/d76/lda 0 2023-12-05T09:26:25.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/776: sync 2023-12-05T09:26:25.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/777: write da/de/d11/fcc [250561,86650] 0 2023-12-05T09:26:25.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/778: write da/de/f66 [425295,85645] 0 2023-12-05T09:26:25.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/779: write da/de/d11/d1d/d5f/fc3 [4001453,35667] 0 2023-12-05T09:26:25.682 INFO:tasks.workunit.client.0.smithi067.stdout:2/403: link d0/d2f/d39/l70 d0/d25/d34/d4d/d72/l8f 0 2023-12-05T09:26:25.700 INFO:tasks.workunit.client.1.smithi134.stdout:9/647: dread d7/d8/d14/d26/d5a/fae [0,4194304] 0 2023-12-05T09:26:25.700 INFO:tasks.workunit.client.1.smithi134.stdout:9/648: fsync d7/d5b/d5e/f8c 0 2023-12-05T09:26:25.700 INFO:tasks.workunit.client.1.smithi134.stdout:9/649: truncate d7/d8/d2e/f68 1484229 0 2023-12-05T09:26:25.701 INFO:tasks.workunit.client.1.smithi134.stdout:9/650: write d7/d10/fa6 [231245,109774] 0 2023-12-05T09:26:25.702 INFO:tasks.workunit.client.0.smithi067.stdout:7/440: dread d0/d9/d3f/f47 [0,4194304] 0 2023-12-05T09:26:25.723 INFO:tasks.workunit.client.0.smithi067.stdout:5/506: rename db/df/d38/f9a to db/df/d36/d57/fb7 0 2023-12-05T09:26:25.727 INFO:tasks.workunit.client.1.smithi134.stdout:6/594: dwrite d4/d32/d57/f94 [0,4194304] 0 2023-12-05T09:26:25.730 INFO:tasks.workunit.client.0.smithi067.stdout:4/382: creat d0/d1d/d25/d2c/d34/f86 x:0 0 0 2023-12-05T09:26:25.730 INFO:tasks.workunit.client.0.smithi067.stdout:4/383: fdatasync d0/d1d/d25/d38/f39 0 2023-12-05T09:26:25.731 INFO:tasks.workunit.client.0.smithi067.stdout:4/384: chown d0/d1d/d25/d32/c18 108433549 1 2023-12-05T09:26:25.731 INFO:tasks.workunit.client.0.smithi067.stdout:4/385: fsync d0/f4 0 2023-12-05T09:26:25.731 INFO:tasks.workunit.client.1.smithi134.stdout:5/629: chown d0/d1a/d1c/l48 16958 1 2023-12-05T09:26:25.731 INFO:tasks.workunit.client.1.smithi134.stdout:5/630: truncate d0/d1a/d1c/d3f/fb7 1114206 0 2023-12-05T09:26:25.731 INFO:tasks.workunit.client.1.smithi134.stdout:5/631: write d0/dd/f2c [810427,109279] 0 2023-12-05T09:26:25.732 INFO:tasks.workunit.client.0.smithi067.stdout:9/642: write d1b/d25/d35/f4a [1996476,120946] 0 2023-12-05T09:26:25.732 INFO:tasks.workunit.client.0.smithi067.stdout:9/643: fdatasync d1b/d25/d35/d56/f68 0 2023-12-05T09:26:25.734 INFO:tasks.workunit.client.0.smithi067.stdout:3/405: dwrite d9/da/d15/d17/d1a/f35 [0,4194304] 0 2023-12-05T09:26:25.737 INFO:tasks.workunit.client.0.smithi067.stdout:6/406: symlink da/d10/d1e/l8f 0 2023-12-05T09:26:25.738 INFO:tasks.workunit.client.1.smithi134.stdout:4/656: creat d16/d7b/dce/d6e/daa/d3b/dcf/fe7 x:0 0 0 2023-12-05T09:26:25.740 INFO:tasks.workunit.client.0.smithi067.stdout:0/583: creat d3/d7/d3c/d6c/d76/da7/fd8 x:0 0 0 2023-12-05T09:26:25.740 INFO:tasks.workunit.client.0.smithi067.stdout:0/584: fdatasync d3/f1d 0 2023-12-05T09:26:25.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/692: mkdir d4/d5/d6f/dc2/ddb 0 2023-12-05T09:26:25.743 INFO:tasks.workunit.client.0.smithi067.stdout:2/404: mkdir d0/d25/d34/d4d/d54/d90 0 2023-12-05T09:26:25.746 INFO:tasks.workunit.client.0.smithi067.stdout:5/507: creat db/df/d1a/d59/dae/fb8 x:0 0 0 2023-12-05T09:26:25.748 INFO:tasks.workunit.client.1.smithi134.stdout:8/780: mknod da/de/d11/d1d/db8/df3/c10d 0 2023-12-05T09:26:25.749 INFO:tasks.workunit.client.1.smithi134.stdout:9/651: write d7/d8/d14/d26/d7f/d92/f8e [2402691,45661] 0 2023-12-05T09:26:25.749 INFO:tasks.workunit.client.1.smithi134.stdout:9/652: stat d7/d8/d14/d26/d7f/d92/f8e 0 2023-12-05T09:26:25.749 INFO:tasks.workunit.client.1.smithi134.stdout:9/653: chown d7/d8/d14/d26/d7f/d92 55 1 2023-12-05T09:26:25.750 INFO:tasks.workunit.client.0.smithi067.stdout:1/491: rename d2/d5/d7/de/c17 to d2/d4f/d14/d20/d83/d78/dac/cb3 0 2023-12-05T09:26:25.750 INFO:tasks.workunit.client.1.smithi134.stdout:7/645: dwrite d2/d7/dc/d22/f3d [0,4194304] 0 2023-12-05T09:26:25.752 INFO:tasks.workunit.client.1.smithi134.stdout:2/703: dwrite d19/d76/f7b [0,4194304] 0 2023-12-05T09:26:25.753 INFO:tasks.workunit.client.1.smithi134.stdout:0/622: dwrite d13/d14/d30/d4b/d23/d77/fae [0,4194304] 0 2023-12-05T09:26:25.753 INFO:tasks.workunit.client.1.smithi134.stdout:0/623: read - d13/d14/d15/fad zero size 2023-12-05T09:26:25.755 INFO:tasks.workunit.client.1.smithi134.stdout:1/780: rmdir d2/d9/d10/d30/d66/da9/d74 39 2023-12-05T09:26:25.755 INFO:tasks.workunit.client.1.smithi134.stdout:1/781: dread - d2/d9/d10/d5b/ffd zero size 2023-12-05T09:26:25.756 INFO:tasks.workunit.client.1.smithi134.stdout:1/782: chown d2/d27/d40 46088 1 2023-12-05T09:26:25.756 INFO:tasks.workunit.client.1.smithi134.stdout:1/783: fsync d2/d27/d71/f79 0 2023-12-05T09:26:25.757 INFO:tasks.workunit.client.0.smithi067.stdout:3/406: creat d9/da/d15/d17/d1a/d51/f89 x:0 0 0 2023-12-05T09:26:25.758 INFO:tasks.workunit.client.0.smithi067.stdout:3/407: creat d9/d62/f8a x:0 0 0 2023-12-05T09:26:25.762 INFO:tasks.workunit.client.0.smithi067.stdout:6/407: creat da/d10/d1e/d17/d2f/d72/f90 x:0 0 0 2023-12-05T09:26:25.764 INFO:tasks.workunit.client.1.smithi134.stdout:6/595: creat d4/d39/fb1 x:0 0 0 2023-12-05T09:26:25.764 INFO:tasks.workunit.client.0.smithi067.stdout:7/441: getdents d0/d9/d3f 0 2023-12-05T09:26:25.766 INFO:tasks.workunit.client.0.smithi067.stdout:7/442: write d0/d9/d10/d37/d38/d64/d54/f5e [5049740,77161] 0 2023-12-05T09:26:25.766 INFO:tasks.workunit.client.0.smithi067.stdout:7/443: truncate d0/d9/f58 4348528 0 2023-12-05T09:26:25.769 INFO:tasks.workunit.client.1.smithi134.stdout:3/693: mkdir d4/d5/d45/d60/d85/dab/ddc 0 2023-12-05T09:26:25.772 INFO:tasks.workunit.client.0.smithi067.stdout:5/508: mknod db/df/d1a/d59/dae/cb9 0 2023-12-05T09:26:25.774 INFO:tasks.workunit.client.1.smithi134.stdout:8/781: rename da/de/d11/d1d/d5f/fc3 to da/de/d8a/d42/d99/f10e 0 2023-12-05T09:26:25.774 INFO:tasks.workunit.client.1.smithi134.stdout:8/782: chown da/de/d16/l28 1346 1 2023-12-05T09:26:25.781 INFO:tasks.workunit.client.1.smithi134.stdout:7/646: mknod d2/d7/dc/d2e/d3a/d6d/cd1 0 2023-12-05T09:26:25.788 INFO:tasks.workunit.client.1.smithi134.stdout:1/784: link d2/d9/l42 d2/d9/d10/d5b/dc4/l118 0 2023-12-05T09:26:25.788 INFO:tasks.workunit.client.1.smithi134.stdout:2/704: creat d19/d28/d31/db3/fe5 x:0 0 0 2023-12-05T09:26:25.790 INFO:tasks.workunit.client.0.smithi067.stdout:3/408: creat d9/da/d15/d17/d1a/d51/d70/f8b x:0 0 0 2023-12-05T09:26:25.792 INFO:tasks.workunit.client.1.smithi134.stdout:6/596: truncate d4/d39/f53 412403 0 2023-12-05T09:26:25.792 INFO:tasks.workunit.client.1.smithi134.stdout:6/597: dread - d4/d39/d42/fa7 zero size 2023-12-05T09:26:25.792 INFO:tasks.workunit.client.1.smithi134.stdout:6/598: chown d4/d39/d42/f7e 359293995 1 2023-12-05T09:26:25.794 INFO:tasks.workunit.client.1.smithi134.stdout:3/694: creat d4/d1f/fdd x:0 0 0 2023-12-05T09:26:25.794 INFO:tasks.workunit.client.1.smithi134.stdout:3/695: chown d4/d5/d7c/f83 10243 1 2023-12-05T09:26:25.794 INFO:tasks.workunit.client.1.smithi134.stdout:3/696: write d4/d1f/d50/d52/f58 [3417288,82158] 0 2023-12-05T09:26:25.794 INFO:tasks.workunit.client.1.smithi134.stdout:3/697: getdents d4/d5/d45/d86/db5/dcf 0 2023-12-05T09:26:25.796 INFO:tasks.workunit.client.1.smithi134.stdout:8/783: creat da/de/d4d/f10f x:0 0 0 2023-12-05T09:26:25.799 INFO:tasks.workunit.client.0.smithi067.stdout:9/644: getdents d1b/d25/d35/d56 0 2023-12-05T09:26:25.799 INFO:tasks.workunit.client.0.smithi067.stdout:7/444: mknod d0/d9/d10/d37/d38/d64/d34/d8c/c8f 0 2023-12-05T09:26:25.799 INFO:tasks.workunit.client.0.smithi067.stdout:3/409: rename d9/da/d15/c39 to d9/da/d15/d28/d29/d47/c8c 0 2023-12-05T09:26:25.806 INFO:tasks.workunit.client.0.smithi067.stdout:6/408: link da/d10/d1e/d17/d2f/d2c/d34/l54 da/d10/d1e/l91 0 2023-12-05T09:26:25.806 INFO:tasks.workunit.client.0.smithi067.stdout:3/410: creat d9/da/d15/d28/d29/f8d x:0 0 0 2023-12-05T09:26:25.808 INFO:tasks.workunit.client.1.smithi134.stdout:7/647: creat d2/d7/dc/d2e/fd2 x:0 0 0 2023-12-05T09:26:25.813 INFO:tasks.workunit.client.1.smithi134.stdout:1/785: mknod d2/d27/d40/d109/c119 0 2023-12-05T09:26:25.813 INFO:tasks.workunit.client.1.smithi134.stdout:2/705: mkdir d19/d28/d2b/de6 0 2023-12-05T09:26:25.814 INFO:tasks.workunit.client.1.smithi134.stdout:6/599: rename d4/d39/d42/d4f/d6d/cac to d4/d39/d42/d4f/d6d/d3a/d75/cb2 0 2023-12-05T09:26:25.816 INFO:tasks.workunit.client.1.smithi134.stdout:3/698: unlink d4/l29 0 2023-12-05T09:26:25.816 INFO:tasks.workunit.client.1.smithi134.stdout:3/699: truncate d4/faf 5009942 0 2023-12-05T09:26:25.817 INFO:tasks.workunit.client.0.smithi067.stdout:4/386: dwrite d0/d1d/d24/f7f [0,4194304] 0 2023-12-05T09:26:25.817 INFO:tasks.workunit.client.0.smithi067.stdout:4/387: getdents d0/d1d/d53/d82 0 2023-12-05T09:26:25.819 INFO:tasks.workunit.client.1.smithi134.stdout:7/648: mkdir d2/d7/d6f/dd3 0 2023-12-05T09:26:25.820 INFO:tasks.workunit.client.1.smithi134.stdout:6/600: truncate d4/d39/d42/d4f/d6d/d3a/d80/f8b 2717655 0 2023-12-05T09:26:25.821 INFO:tasks.workunit.client.0.smithi067.stdout:3/411: symlink d9/d62/l8e 0 2023-12-05T09:26:25.824 INFO:tasks.workunit.client.1.smithi134.stdout:7/649: creat d2/d7/d6f/da0/fd4 x:0 0 0 2023-12-05T09:26:25.824 INFO:tasks.workunit.client.1.smithi134.stdout:7/650: write d2/dd/d1a/f8b [343479,9448] 0 2023-12-05T09:26:25.824 INFO:tasks.workunit.client.1.smithi134.stdout:7/651: truncate d2/d7/dc/d2e/fd2 663806 0 2023-12-05T09:26:25.824 INFO:tasks.workunit.client.0.smithi067.stdout:7/445: write d0/d9/d56/f5b [2799017,45397] 0 2023-12-05T09:26:25.825 INFO:tasks.workunit.client.1.smithi134.stdout:6/601: rename d4/d39/d42/d4f/d6d/d3a/d75/d8f/c9a to d4/d39/d42/cb3 0 2023-12-05T09:26:25.827 INFO:tasks.workunit.client.1.smithi134.stdout:7/652: creat d2/dd/d71/fd5 x:0 0 0 2023-12-05T09:26:25.832 INFO:tasks.workunit.client.1.smithi134.stdout:6/602: mknod d4/d32/d57/cb4 0 2023-12-05T09:26:25.832 INFO:tasks.workunit.client.1.smithi134.stdout:7/653: mkdir d2/d7/d93/dcf/dd6 0 2023-12-05T09:26:25.832 INFO:tasks.workunit.client.1.smithi134.stdout:7/654: stat d2/ca8 0 2023-12-05T09:26:25.834 INFO:tasks.workunit.client.1.smithi134.stdout:0/624: dwrite d13/d14/d15/f40 [0,4194304] 0 2023-12-05T09:26:25.838 INFO:tasks.workunit.client.0.smithi067.stdout:4/388: symlink d0/l87 0 2023-12-05T09:26:25.838 INFO:tasks.workunit.client.0.smithi067.stdout:4/389: write d0/d1d/d53/d62/f83 [823011,97063] 0 2023-12-05T09:26:25.840 INFO:tasks.workunit.client.0.smithi067.stdout:9/645: write d1b/dd3/d6c/fa5 [2091692,28286] 0 2023-12-05T09:26:25.843 INFO:tasks.workunit.client.0.smithi067.stdout:7/446: mknod d0/d9/d40/d48/c90 0 2023-12-05T09:26:25.845 INFO:tasks.workunit.client.1.smithi134.stdout:5/632: dwrite d0/d1a/d1c/d3f/d5b/d5d/fd2 [0,4194304] 0 2023-12-05T09:26:25.845 INFO:tasks.workunit.client.1.smithi134.stdout:5/633: chown d0/d1a/d1c/d3f/d5b/d5d/f86 2012138 1 2023-12-05T09:26:25.845 INFO:tasks.workunit.client.0.smithi067.stdout:6/409: dread da/d10/f11 [0,4194304] 0 2023-12-05T09:26:25.848 INFO:tasks.workunit.client.0.smithi067.stdout:1/492: dwrite d2/d4f/d54/d70/fa9 [0,4194304] 0 2023-12-05T09:26:25.849 INFO:tasks.workunit.client.1.smithi134.stdout:0/625: link d13/d14/d30/d4b/d23/c5b d13/d14/d30/d4b/d66/da0/daf/dce/d7d/cd4 0 2023-12-05T09:26:25.850 INFO:tasks.workunit.client.1.smithi134.stdout:1/786: write d2/d27/d40/f84 [3554616,50421] 0 2023-12-05T09:26:25.850 INFO:tasks.workunit.client.1.smithi134.stdout:1/787: chown d2/d27/lb0 27818512 1 2023-12-05T09:26:25.850 INFO:tasks.workunit.client.1.smithi134.stdout:1/788: fdatasync d2/d27/d71/d80/f83 0 2023-12-05T09:26:25.855 INFO:tasks.workunit.client.0.smithi067.stdout:2/405: dwrite d0/d15/d53/d1e/f74 [0,4194304] 0 2023-12-05T09:26:25.856 INFO:tasks.workunit.client.1.smithi134.stdout:0/626: write d13/d14/d15/fc8 [134309,105049] 0 2023-12-05T09:26:25.857 INFO:tasks.workunit.client.1.smithi134.stdout:8/784: dwrite da/de/d8a/fb3 [0,4194304] 0 2023-12-05T09:26:25.857 INFO:tasks.workunit.client.1.smithi134.stdout:8/785: fsync da/de/d16/d98/fb5 0 2023-12-05T09:26:25.858 INFO:tasks.workunit.client.1.smithi134.stdout:8/786: write da/de/d11/fcc [1194784,46593] 0 2023-12-05T09:26:25.858 INFO:tasks.workunit.client.1.smithi134.stdout:8/787: fsync da/de/fb7 0 2023-12-05T09:26:25.858 INFO:tasks.workunit.client.1.smithi134.stdout:3/700: dread d4/d1f/d50/d52/f58 [0,4194304] 0 2023-12-05T09:26:25.861 INFO:tasks.workunit.client.0.smithi067.stdout:9/646: link d1b/dd3/d82/f9a d1b/d25/fd9 0 2023-12-05T09:26:25.862 INFO:tasks.workunit.client.1.smithi134.stdout:9/654: dwrite d7/d5b/d5e/daa/fcb [0,4194304] 0 2023-12-05T09:26:25.863 INFO:tasks.workunit.client.1.smithi134.stdout:0/627: dread d13/d14/d30/d4b/d66/da0/daf/dce/d78/f97 [0,4194304] 0 2023-12-05T09:26:25.867 INFO:tasks.workunit.client.0.smithi067.stdout:6/410: mkdir da/d10/d1e/d17/d2f/d3f/d92 0 2023-12-05T09:26:25.868 INFO:tasks.workunit.client.0.smithi067.stdout:4/390: dread d0/d1d/d25/d32/f16 [0,4194304] 0 2023-12-05T09:26:25.876 INFO:tasks.workunit.client.0.smithi067.stdout:2/406: creat d0/d15/d53/d1e/d7f/f91 x:0 0 0 2023-12-05T09:26:25.876 INFO:tasks.workunit.client.0.smithi067.stdout:3/412: dread d9/fe [0,4194304] 0 2023-12-05T09:26:25.876 INFO:tasks.workunit.client.0.smithi067.stdout:5/509: dwrite db/df/d36/d57/fb7 [0,4194304] 0 2023-12-05T09:26:25.876 INFO:tasks.workunit.client.0.smithi067.stdout:3/413: write d9/da/d15/f50 [224392,119166] 0 2023-12-05T09:26:25.876 INFO:tasks.workunit.client.0.smithi067.stdout:3/414: creat d9/d62/f8f x:0 0 0 2023-12-05T09:26:25.879 INFO:tasks.workunit.client.1.smithi134.stdout:7/655: dwrite d2/dd/f6b [0,4194304] 0 2023-12-05T09:26:25.879 INFO:tasks.workunit.client.1.smithi134.stdout:7/656: chown d2/d7/lae 627680794 1 2023-12-05T09:26:25.880 INFO:tasks.workunit.client.1.smithi134.stdout:7/657: write d2/d7/d6f/da0/fd4 [140189,70736] 0 2023-12-05T09:26:25.883 INFO:tasks.workunit.client.0.smithi067.stdout:9/647: symlink d1b/dd3/d6c/d76/lda 0 2023-12-05T09:26:25.898 INFO:tasks.workunit.client.0.smithi067.stdout:4/391: mkdir d0/d1d/d25/d2c/d34/d4e/d5a/d88 0 2023-12-05T09:26:25.898 INFO:tasks.workunit.client.0.smithi067.stdout:6/411: rename da/d10/d1e/d17/d2f/d2c/f6e to da/d10/d1e/d69/f93 0 2023-12-05T09:26:25.898 INFO:tasks.workunit.client.0.smithi067.stdout:4/392: chown d0/d1d/d2b 225 1 2023-12-05T09:26:25.898 INFO:tasks.workunit.client.0.smithi067.stdout:4/393: readlink d0/d1d/d25/d32/l19 0 2023-12-05T09:26:25.898 INFO:tasks.workunit.client.0.smithi067.stdout:6/412: write da/d10/d1e/d17/f81 [259204,44157] 0 2023-12-05T09:26:25.898 INFO:tasks.workunit.client.0.smithi067.stdout:4/394: creat d0/d1d/d25/d32/f89 x:0 0 0 2023-12-05T09:26:25.908 INFO:tasks.workunit.client.0.smithi067.stdout:1/493: rmdir d2/d5/d7/de/d19/d49/d5f 39 2023-12-05T09:26:25.908 INFO:tasks.workunit.client.0.smithi067.stdout:1/494: truncate d2/f39 5011674 0 2023-12-05T09:26:25.911 INFO:tasks.workunit.client.0.smithi067.stdout:7/447: dwrite d0/d9/d10/d37/d38/d64/d54/f65 [0,4194304] 0 2023-12-05T09:26:25.913 INFO:tasks.workunit.client.1.smithi134.stdout:5/634: symlink d0/d50/lda 0 2023-12-05T09:26:25.914 INFO:tasks.workunit.client.1.smithi134.stdout:0/628: dwrite d13/fb1 [4194304,4194304] 0 2023-12-05T09:26:25.914 INFO:tasks.workunit.client.1.smithi134.stdout:0/629: write d13/d14/d30/d4b/d66/da0/daf/dce/d86/fd3 [278370,70891] 0 2023-12-05T09:26:25.922 INFO:tasks.workunit.client.1.smithi134.stdout:1/789: rename d2/d9/d10/f3f to d2/d27/db4/df9/f11a 0 2023-12-05T09:26:25.922 INFO:tasks.workunit.client.1.smithi134.stdout:1/790: write d2/d9/f44 [3058395,74305] 0 2023-12-05T09:26:25.923 INFO:tasks.workunit.client.1.smithi134.stdout:8/788: dwrite f2 [0,4194304] 0 2023-12-05T09:26:25.923 INFO:tasks.workunit.client.1.smithi134.stdout:8/789: truncate da/de/d11/f30 4769270 0 2023-12-05T09:26:25.927 INFO:tasks.workunit.client.0.smithi067.stdout:4/395: write d0/d1d/d25/d32/f3f [4191248,5700] 0 2023-12-05T09:26:25.927 INFO:tasks.workunit.client.1.smithi134.stdout:5/635: dread d0/dd/f14 [0,4194304] 0 2023-12-05T09:26:25.927 INFO:tasks.workunit.client.1.smithi134.stdout:5/636: write d0/fcc [707745,117313] 0 2023-12-05T09:26:25.930 INFO:tasks.workunit.client.0.smithi067.stdout:4/396: dread d0/d9/f2f [0,4194304] 0 2023-12-05T09:26:25.932 INFO:tasks.workunit.client.0.smithi067.stdout:7/448: dread d0/d9/d10/f32 [4194304,4194304] 0 2023-12-05T09:26:25.938 INFO:tasks.workunit.client.0.smithi067.stdout:2/407: mkdir d0/d15/d53/d92 0 2023-12-05T09:26:25.938 INFO:tasks.workunit.client.0.smithi067.stdout:2/408: fdatasync d0/d15/f73 0 2023-12-05T09:26:25.939 INFO:tasks.workunit.client.1.smithi134.stdout:3/701: rmdir d4/d5/d45/d86 39 2023-12-05T09:26:25.945 INFO:tasks.workunit.client.1.smithi134.stdout:1/791: dread d2/d9/d10/f67 [0,4194304] 0 2023-12-05T09:26:25.945 INFO:tasks.workunit.client.0.smithi067.stdout:3/415: mknod d9/da/d15/d28/d29/c90 0 2023-12-05T09:26:25.949 INFO:tasks.workunit.client.0.smithi067.stdout:6/413: symlink da/d10/d1e/l94 0 2023-12-05T09:26:25.949 INFO:tasks.workunit.client.0.smithi067.stdout:6/414: dread - da/d10/d1e/d17/d2f/d3f/f64 zero size 2023-12-05T09:26:25.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/603: dwrite d4/d32/d57/f61 [0,4194304] 0 2023-12-05T09:26:25.951 INFO:tasks.workunit.client.0.smithi067.stdout:5/510: rename db/df/d36/c67 to db/df/d1a/d59/cba 0 2023-12-05T09:26:25.953 INFO:tasks.workunit.client.0.smithi067.stdout:1/495: mkdir d2/d4f/d54/d70/db4 0 2023-12-05T09:26:25.959 INFO:tasks.workunit.client.0.smithi067.stdout:4/397: symlink d0/d1d/d25/d2c/d34/d4e/d5a/d88/l8a 0 2023-12-05T09:26:25.959 INFO:tasks.workunit.client.0.smithi067.stdout:4/398: truncate d0/d1d/d25/d2c/d34/f86 157441 0 2023-12-05T09:26:25.960 INFO:tasks.workunit.client.0.smithi067.stdout:4/399: chown d0/d1d/d25/d32/f16 0 1 2023-12-05T09:26:25.960 INFO:tasks.workunit.client.0.smithi067.stdout:4/400: stat d0/d1d/d25/d32 0 2023-12-05T09:26:25.961 INFO:tasks.workunit.client.0.smithi067.stdout:6/415: mknod da/d10/d1e/d17/c95 0 2023-12-05T09:26:25.963 INFO:tasks.workunit.client.1.smithi134.stdout:0/630: mknod d13/d14/d30/d4b/d23/d77/cd5 0 2023-12-05T09:26:25.963 INFO:tasks.workunit.client.1.smithi134.stdout:0/631: fsync f8 0 2023-12-05T09:26:25.963 INFO:tasks.workunit.client.1.smithi134.stdout:0/632: dread - d13/d14/d15/d67/fcb zero size 2023-12-05T09:26:25.966 INFO:tasks.workunit.client.0.smithi067.stdout:3/416: rename d9/da/l42 to d9/l91 0 2023-12-05T09:26:25.971 INFO:tasks.workunit.client.0.smithi067.stdout:9/648: dwrite d1b/d25/d54/fcc [0,4194304] 0 2023-12-05T09:26:25.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/511: mknod db/df/d35/d63/d75/cbb 0 2023-12-05T09:26:25.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/512: fsync db/df/d3f/d88/f5c 0 2023-12-05T09:26:25.976 INFO:tasks.workunit.client.0.smithi067.stdout:2/409: rmdir d0/d25/d34/d4d/d54/d56 39 2023-12-05T09:26:25.979 INFO:tasks.workunit.client.0.smithi067.stdout:6/416: truncate da/d10/d1e/d17/d2f/d47/f4c 249551 0 2023-12-05T09:26:25.979 INFO:tasks.workunit.client.0.smithi067.stdout:6/417: dread - da/d10/d1e/d17/d2f/d3f/f64 zero size 2023-12-05T09:26:25.979 INFO:tasks.workunit.client.0.smithi067.stdout:6/418: chown da/d10/d1e/d17/d2f/d47/d80/f8e 3 1 2023-12-05T09:26:25.984 INFO:tasks.workunit.client.0.smithi067.stdout:4/401: dread d0/d1d/f21 [0,4194304] 0 2023-12-05T09:26:25.984 INFO:tasks.workunit.client.1.smithi134.stdout:3/702: dwrite d4/d5/d6f/dc2/fca [0,4194304] 0 2023-12-05T09:26:25.985 INFO:tasks.workunit.client.1.smithi134.stdout:3/703: stat d4/d1f/d4e/f61 0 2023-12-05T09:26:25.992 INFO:tasks.workunit.client.0.smithi067.stdout:8/435: sync 2023-12-05T09:26:25.992 INFO:tasks.workunit.client.0.smithi067.stdout:8/436: write d5/dc/f19 [4120812,113371] 0 2023-12-05T09:26:25.992 INFO:tasks.workunit.client.0.smithi067.stdout:1/496: dread d2/d3/f1d [0,4194304] 0 2023-12-05T09:26:25.993 INFO:tasks.workunit.client.1.smithi134.stdout:9/655: rename d7/d8/d16/d52/lc2 to d7/d10/d56/le1 0 2023-12-05T09:26:25.993 INFO:tasks.workunit.client.1.smithi134.stdout:9/656: creat d7/d8/fe2 x:0 0 0 2023-12-05T09:26:25.994 INFO:tasks.workunit.client.1.smithi134.stdout:8/790: creat da/de/d96/d9d/d109/f110 x:0 0 0 2023-12-05T09:26:25.997 INFO:tasks.workunit.client.1.smithi134.stdout:5/637: mkdir d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/d9b/ddb 0 2023-12-05T09:26:25.997 INFO:tasks.workunit.client.0.smithi067.stdout:7/449: dwrite d0/d9/d10/d1d/f6b [0,4194304] 0 2023-12-05T09:26:25.998 INFO:tasks.workunit.client.0.smithi067.stdout:7/450: write d0/d9/d10/d37/d38/d64/d54/f88 [431353,11924] 0 2023-12-05T09:26:25.999 INFO:tasks.workunit.client.1.smithi134.stdout:1/792: creat d2/d7e/f11b x:0 0 0 2023-12-05T09:26:26.001 INFO:tasks.workunit.client.1.smithi134.stdout:2/706: sync 2023-12-05T09:26:26.001 INFO:tasks.workunit.client.1.smithi134.stdout:2/707: dread - d19/f97 zero size 2023-12-05T09:26:26.038 INFO:tasks.workunit.client.0.smithi067.stdout:2/410: dwrite d0/d2f/d39/f6f [0,4194304] 0 2023-12-05T09:26:26.052 INFO:tasks.workunit.client.0.smithi067.stdout:9/649: mknod d1b/d25/d94/cdb 0 2023-12-05T09:26:26.052 INFO:tasks.workunit.client.0.smithi067.stdout:9/650: write d1b/f7a [611414,22202] 0 2023-12-05T09:26:26.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/419: symlink da/d10/d1e/d69/l96 0 2023-12-05T09:26:26.056 INFO:tasks.workunit.client.1.smithi134.stdout:6/604: truncate d4/ff 2546942 0 2023-12-05T09:26:26.056 INFO:tasks.workunit.client.1.smithi134.stdout:8/791: dwrite da/de/d16/d2d/f36 [4194304,4194304] 0 2023-12-05T09:26:26.057 INFO:tasks.workunit.client.0.smithi067.stdout:4/402: symlink d0/d1d/l8b 0 2023-12-05T09:26:26.065 INFO:tasks.workunit.client.0.smithi067.stdout:1/497: creat d2/d5/d7/de/d19/d71/fb5 x:0 0 0 2023-12-05T09:26:26.065 INFO:tasks.workunit.client.1.smithi134.stdout:4/657: sync 2023-12-05T09:26:26.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/704: truncate d4/d80/f84 18193 0 2023-12-05T09:26:26.074 INFO:tasks.workunit.client.1.smithi134.stdout:9/657: creat d7/fe3 x:0 0 0 2023-12-05T09:26:26.077 INFO:tasks.workunit.client.0.smithi067.stdout:0/585: sync 2023-12-05T09:26:26.077 INFO:tasks.workunit.client.0.smithi067.stdout:0/586: write d3/d7/d3c/d67/da1/fc1 [67899,25331] 0 2023-12-05T09:26:26.077 INFO:tasks.workunit.client.0.smithi067.stdout:0/587: creat d3/d7/d30/fd9 x:0 0 0 2023-12-05T09:26:26.086 INFO:tasks.workunit.client.0.smithi067.stdout:1/498: dread d2/f39 [0,4194304] 0 2023-12-05T09:26:26.138 INFO:tasks.workunit.client.1.smithi134.stdout:9/658: dwrite d7/d10/f37 [0,4194304] 0 2023-12-05T09:26:26.188 INFO:tasks.workunit.client.1.smithi134.stdout:9/659: write d7/d8/f50 [92314,47855] 0 2023-12-05T09:26:26.199 INFO:tasks.workunit.client.1.smithi134.stdout:6/605: mkdir d4/d39/d42/d4f/d6d/d45/d8c/db5 0 2023-12-05T09:26:26.202 INFO:tasks.workunit.client.1.smithi134.stdout:9/660: read d7/d8/d14/f25 [1360564,128291] 0 2023-12-05T09:26:26.204 INFO:tasks.workunit.client.1.smithi134.stdout:4/658: unlink d16/c19 0 2023-12-05T09:26:26.215 INFO:tasks.workunit.client.1.smithi134.stdout:7/658: rename d2/df/d2a/d36/c57 to d2/d7/dc/cd7 0 2023-12-05T09:26:26.215 INFO:tasks.workunit.client.1.smithi134.stdout:9/661: mkdir d7/d8/d14/d26/d5a/da1/de4 0 2023-12-05T09:26:26.215 INFO:tasks.workunit.client.1.smithi134.stdout:9/662: chown d7/d8/d2e/f68 0 1 2023-12-05T09:26:26.215 INFO:tasks.workunit.client.1.smithi134.stdout:6/606: write d4/d39/d42/d4f/d6d/d3a/f3c [5282457,47971] 0 2023-12-05T09:26:26.215 INFO:tasks.workunit.client.1.smithi134.stdout:4/659: mknod d16/d18/dad/ce8 0 2023-12-05T09:26:26.215 INFO:tasks.workunit.client.1.smithi134.stdout:7/659: write d2/df/d2a/d36/f5d [288335,66688] 0 2023-12-05T09:26:26.216 INFO:tasks.workunit.client.1.smithi134.stdout:9/663: write d7/d8/fb6 [48409,49137] 0 2023-12-05T09:26:26.216 INFO:tasks.workunit.client.1.smithi134.stdout:9/664: chown d7/d8/f4c 213604785 1 2023-12-05T09:26:26.222 INFO:tasks.workunit.client.1.smithi134.stdout:0/633: rename d13/d14/d30/d4b/d23/c5b to d13/d14/d30/d2c/d9d/cd6 0 2023-12-05T09:26:26.231 INFO:tasks.workunit.client.1.smithi134.stdout:9/665: mknod d7/d10/ce5 0 2023-12-05T09:26:26.234 INFO:tasks.workunit.client.1.smithi134.stdout:6/607: dread d4/d32/d57/f61 [0,4194304] 0 2023-12-05T09:26:26.235 INFO:tasks.workunit.client.1.smithi134.stdout:6/608: dread - d4/d39/d42/d4f/d8a/f99 zero size 2023-12-05T09:26:26.235 INFO:tasks.workunit.client.1.smithi134.stdout:6/609: fsync d4/d39/d42/d4f/d6d/d3a/f36 0 2023-12-05T09:26:26.238 INFO:tasks.workunit.client.1.smithi134.stdout:1/793: rename d2/l6f to d2/d9/d10/d94/de5/d112/l11c 0 2023-12-05T09:26:26.238 INFO:tasks.workunit.client.1.smithi134.stdout:1/794: write d2/d27/d71/fa1 [1713307,114063] 0 2023-12-05T09:26:26.242 INFO:tasks.workunit.client.1.smithi134.stdout:7/660: truncate d2/d7/dc/d22/f85 6880096 0 2023-12-05T09:26:26.242 INFO:tasks.workunit.client.1.smithi134.stdout:7/661: write d2/df/d2a/d36/f5c [2359471,21700] 0 2023-12-05T09:26:26.242 INFO:tasks.workunit.client.1.smithi134.stdout:0/634: dread d13/d14/f6c [0,4194304] 0 2023-12-05T09:26:26.247 INFO:tasks.workunit.client.1.smithi134.stdout:9/666: creat d7/d10/d56/fe6 x:0 0 0 2023-12-05T09:26:26.247 INFO:tasks.workunit.client.1.smithi134.stdout:9/667: chown d7/d10/d56/le1 1 1 2023-12-05T09:26:26.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/411: mknod d0/d2f/d84/c93 0 2023-12-05T09:26:26.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/412: chown d0/fe 17582 1 2023-12-05T09:26:26.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/413: readlink d0/d25/d34/d4a/l82 0 2023-12-05T09:26:26.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/414: read - d0/d25/f8b zero size 2023-12-05T09:26:26.256 INFO:tasks.workunit.client.1.smithi134.stdout:1/795: mkdir d2/d9/d10/d30/d66/d10d/d11d 0 2023-12-05T09:26:26.269 INFO:tasks.workunit.client.0.smithi067.stdout:2/415: dread d0/fe [0,4194304] 0 2023-12-05T09:26:26.269 INFO:tasks.workunit.client.0.smithi067.stdout:2/416: write d0/d15/d53/d1e/f35 [1864061,37580] 0 2023-12-05T09:26:26.274 INFO:tasks.workunit.client.0.smithi067.stdout:9/651: truncate d1b/f20 2440059 0 2023-12-05T09:26:26.276 INFO:tasks.workunit.client.0.smithi067.stdout:6/420: truncate da/d10/d1e/d17/f29 5619118 0 2023-12-05T09:26:26.281 INFO:tasks.workunit.client.0.smithi067.stdout:4/403: symlink d0/d1d/l8c 0 2023-12-05T09:26:26.282 INFO:tasks.workunit.client.0.smithi067.stdout:4/404: readlink d0/d1d/d2b/l76 0 2023-12-05T09:26:26.282 INFO:tasks.workunit.client.0.smithi067.stdout:4/405: write d0/d9/f78 [1376499,66470] 0 2023-12-05T09:26:26.282 INFO:tasks.workunit.client.0.smithi067.stdout:4/406: write d0/d9/f6b [87476,41253] 0 2023-12-05T09:26:26.286 INFO:tasks.workunit.client.1.smithi134.stdout:5/638: link d0/d1a/d1c/d3f/d81/d8e/fd9 d0/d50/fdc 0 2023-12-05T09:26:26.289 INFO:tasks.workunit.client.0.smithi067.stdout:0/588: rmdir d3/d7/d3c/d66/dbf/d10/dd2 39 2023-12-05T09:26:26.293 INFO:tasks.workunit.client.1.smithi134.stdout:1/796: creat d2/d9/d10/d30/dd4/dfb/f11e x:0 0 0 2023-12-05T09:26:26.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/639: creat d0/d1a/d1c/fdd x:0 0 0 2023-12-05T09:26:26.300 INFO:tasks.workunit.client.1.smithi134.stdout:1/797: creat d2/d9/d10/d30/d66/da9/d74/f11f x:0 0 0 2023-12-05T09:26:26.301 INFO:tasks.workunit.client.0.smithi067.stdout:9/652: creat d1b/d25/d5b/d62/fdc x:0 0 0 2023-12-05T09:26:26.303 INFO:tasks.workunit.client.0.smithi067.stdout:4/407: mkdir d0/d1d/d4d/d8d 0 2023-12-05T09:26:26.308 INFO:tasks.workunit.client.1.smithi134.stdout:9/668: dwrite d7/d8/d16/fda [0,4194304] 0 2023-12-05T09:26:26.308 INFO:tasks.workunit.client.1.smithi134.stdout:0/635: dwrite d13/d14/d30/d2c/fb8 [0,4194304] 0 2023-12-05T09:26:26.309 INFO:tasks.workunit.client.0.smithi067.stdout:9/653: creat d1b/d3e/fdd x:0 0 0 2023-12-05T09:26:26.309 INFO:tasks.workunit.client.0.smithi067.stdout:9/654: read - d1b/dd3/d6c/fbd zero size 2023-12-05T09:26:26.310 INFO:tasks.workunit.client.1.smithi134.stdout:9/669: read d7/d8/d2e/f76 [415165,34436] 0 2023-12-05T09:26:26.310 INFO:tasks.workunit.client.1.smithi134.stdout:9/670: chown d7/d10/lbe 1478733 1 2023-12-05T09:26:26.310 INFO:tasks.workunit.client.1.smithi134.stdout:9/671: stat d7/d8/d14/d26/d5a/fb2 0 2023-12-05T09:26:26.311 INFO:tasks.workunit.client.1.smithi134.stdout:5/640: mkdir d0/d1a/d1c/dde 0 2023-12-05T09:26:26.315 INFO:tasks.workunit.client.1.smithi134.stdout:0/636: mkdir d13/d14/d30/d4b/d66/da0/daf/dce/d78/dd7 0 2023-12-05T09:26:26.319 INFO:tasks.workunit.client.1.smithi134.stdout:0/637: write d13/d14/d30/d4b/d66/da0/daf/dce/fb9 [523937,19158] 0 2023-12-05T09:26:26.322 INFO:tasks.workunit.client.1.smithi134.stdout:8/792: creat da/de/d8a/d42/f111 x:0 0 0 2023-12-05T09:26:26.322 INFO:tasks.workunit.client.1.smithi134.stdout:8/793: truncate da/de/d11/d1d/d5f/d9b/f9f 5271988 0 2023-12-05T09:26:26.324 INFO:tasks.workunit.client.1.smithi134.stdout:2/708: rename d19/d5f/f7a to d19/d28/d2b/fe7 0 2023-12-05T09:26:26.330 INFO:tasks.workunit.client.1.smithi134.stdout:6/610: rename d4/d32/d57/f64 to d4/d39/d5c/fb6 0 2023-12-05T09:26:26.330 INFO:tasks.workunit.client.0.smithi067.stdout:4/408: read d0/d1d/d25/d38/f49 [44235,79069] 0 2023-12-05T09:26:26.331 INFO:tasks.workunit.client.0.smithi067.stdout:2/417: dwrite d0/d15/d53/f1d [0,4194304] 0 2023-12-05T09:26:26.333 INFO:tasks.workunit.client.1.smithi134.stdout:2/709: creat d19/d28/d31/d38/d98/db5/fe8 x:0 0 0 2023-12-05T09:26:26.337 INFO:tasks.workunit.client.1.smithi134.stdout:6/611: unlink d4/d39/d42/d4f/d6d/l49 0 2023-12-05T09:26:26.337 INFO:tasks.workunit.client.1.smithi134.stdout:6/612: chown d4/d39/d42/d4f/d6d/d3a/da/l14 12 1 2023-12-05T09:26:26.337 INFO:tasks.workunit.client.1.smithi134.stdout:6/613: fsync d4/f26 0 2023-12-05T09:26:26.337 INFO:tasks.workunit.client.1.smithi134.stdout:6/614: dread - d4/f6b zero size 2023-12-05T09:26:26.339 INFO:tasks.workunit.client.1.smithi134.stdout:2/710: symlink d19/d3a/le9 0 2023-12-05T09:26:26.342 INFO:tasks.workunit.client.1.smithi134.stdout:6/615: creat d4/d39/d42/d4f/d6d/d3a/da/da4/fb7 x:0 0 0 2023-12-05T09:26:26.342 INFO:tasks.workunit.client.1.smithi134.stdout:6/616: readlink d4/d39/d42/l9d 0 2023-12-05T09:26:26.344 INFO:tasks.workunit.client.1.smithi134.stdout:6/617: symlink d4/d32/d57/lb8 0 2023-12-05T09:26:26.345 INFO:tasks.workunit.client.1.smithi134.stdout:6/618: write d4/d39/d42/d4f/d6d/d45/f95 [3241609,96592] 0 2023-12-05T09:26:26.345 INFO:tasks.workunit.client.1.smithi134.stdout:6/619: dread - d4/d39/d42/d4f/d8a/f99 zero size 2023-12-05T09:26:26.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/672: write d7/f1a [2321721,97034] 0 2023-12-05T09:26:26.346 INFO:tasks.workunit.client.1.smithi134.stdout:1/798: dwrite d2/d9/f104 [0,4194304] 0 2023-12-05T09:26:26.346 INFO:tasks.workunit.client.1.smithi134.stdout:1/799: chown d2/d27/d9d/fed 10071 1 2023-12-05T09:26:26.347 INFO:tasks.workunit.client.1.smithi134.stdout:2/711: dread d19/d76/da7/fb0 [0,4194304] 0 2023-12-05T09:26:26.348 INFO:tasks.workunit.client.1.smithi134.stdout:2/712: fsync d19/d76/f7b 0 2023-12-05T09:26:26.348 INFO:tasks.workunit.client.1.smithi134.stdout:2/713: creat d19/d6d/fea x:0 0 0 2023-12-05T09:26:26.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/589: rmdir d3/d6b/dae 39 2023-12-05T09:26:26.352 INFO:tasks.workunit.client.1.smithi134.stdout:6/620: mknod d4/d32/d74/cb9 0 2023-12-05T09:26:26.352 INFO:tasks.workunit.client.1.smithi134.stdout:9/673: symlink d7/d8/d16/d52/d74/d97/d99/le7 0 2023-12-05T09:26:26.353 INFO:tasks.workunit.client.1.smithi134.stdout:1/800: truncate d2/d9/d10/d30/f37 2839335 0 2023-12-05T09:26:26.353 INFO:tasks.workunit.client.1.smithi134.stdout:1/801: stat d2/d9/d10/d30/d66/da9/d74/d99/f116 0 2023-12-05T09:26:26.355 INFO:tasks.workunit.client.0.smithi067.stdout:0/590: symlink d3/d7/d3c/d67/dd1/lda 0 2023-12-05T09:26:26.360 INFO:tasks.workunit.client.1.smithi134.stdout:2/714: rename d19/d28/d31/d38/d98/dcb/le2 to d19/d28/db1/leb 0 2023-12-05T09:26:26.365 INFO:tasks.workunit.client.0.smithi067.stdout:0/591: mkdir d3/d7/d3c/ddb 0 2023-12-05T09:26:26.367 INFO:tasks.workunit.client.1.smithi134.stdout:0/638: dread d13/d14/d30/d4b/d23/f60 [0,4194304] 0 2023-12-05T09:26:26.367 INFO:tasks.workunit.client.1.smithi134.stdout:9/674: truncate d7/f1c 1480430 0 2023-12-05T09:26:26.368 INFO:tasks.workunit.client.0.smithi067.stdout:0/592: truncate d3/d7/d3c/f48 863548 0 2023-12-05T09:26:26.369 INFO:tasks.workunit.client.0.smithi067.stdout:4/409: creat d0/d1d/d25/d2c/f8e x:0 0 0 2023-12-05T09:26:26.369 INFO:tasks.workunit.client.0.smithi067.stdout:4/410: creat d0/d1d/d25/d32/f8f x:0 0 0 2023-12-05T09:26:26.373 INFO:tasks.workunit.client.1.smithi134.stdout:2/715: creat d19/d76/da7/fec x:0 0 0 2023-12-05T09:26:26.374 INFO:tasks.workunit.client.1.smithi134.stdout:6/621: dread d4/d39/d42/d4f/d6d/d45/f5f [0,4194304] 0 2023-12-05T09:26:26.376 INFO:tasks.workunit.client.0.smithi067.stdout:9/655: dwrite d1b/dd3/d6c/d76/fa4 [0,4194304] 0 2023-12-05T09:26:26.376 INFO:tasks.workunit.client.0.smithi067.stdout:9/656: fdatasync d1b/d25/d35/d9b/fc6 0 2023-12-05T09:26:26.377 INFO:tasks.workunit.client.1.smithi134.stdout:0/639: mkdir d13/d14/d30/d4b/d66/da0/daf/dce/d86/dd8 0 2023-12-05T09:26:26.378 INFO:tasks.workunit.client.1.smithi134.stdout:0/640: fdatasync d13/d14/d30/d2c/fb8 0 2023-12-05T09:26:26.378 INFO:tasks.workunit.client.1.smithi134.stdout:0/641: write d13/d14/d15/d2a/f74 [1688606,56728] 0 2023-12-05T09:26:26.384 INFO:tasks.workunit.client.1.smithi134.stdout:9/675: link d7/d10/ce5 d7/d8/d14/d26/ce8 0 2023-12-05T09:26:26.384 INFO:tasks.workunit.client.1.smithi134.stdout:9/676: truncate d7/d5b/d5e/f6c 4580048 0 2023-12-05T09:26:26.384 INFO:tasks.workunit.client.1.smithi134.stdout:5/641: dwrite d0/d1a/d1c/d25/d4d/f70 [0,4194304] 0 2023-12-05T09:26:26.384 INFO:tasks.workunit.client.1.smithi134.stdout:6/622: write d4/d32/d57/f61 [1264568,19522] 0 2023-12-05T09:26:26.390 INFO:tasks.workunit.client.0.smithi067.stdout:2/418: dwrite d0/d25/d34/d4d/d72/f8c [0,4194304] 0 2023-12-05T09:26:26.392 INFO:tasks.workunit.client.1.smithi134.stdout:9/677: dread d7/d10/d56/f9f [0,4194304] 0 2023-12-05T09:26:26.392 INFO:tasks.workunit.client.0.smithi067.stdout:9/657: dread d1b/d25/d35/d56/f68 [0,4194304] 0 2023-12-05T09:26:26.393 INFO:tasks.workunit.client.0.smithi067.stdout:9/658: stat d1b/d25/f6d 0 2023-12-05T09:26:26.396 INFO:tasks.workunit.client.0.smithi067.stdout:9/659: symlink d1b/d25/d54/lde 0 2023-12-05T09:26:26.396 INFO:tasks.workunit.client.0.smithi067.stdout:9/660: read d1b/d25/d54/d5c/f72 [57824,33154] 0 2023-12-05T09:26:26.396 INFO:tasks.workunit.client.0.smithi067.stdout:9/661: write d1b/d25/d94/fbb [507065,65932] 0 2023-12-05T09:26:26.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/642: mknod d0/d11/cdf 0 2023-12-05T09:26:26.401 INFO:tasks.workunit.client.1.smithi134.stdout:6/623: mkdir d4/d78/d7a/daa/dba 0 2023-12-05T09:26:26.409 INFO:tasks.workunit.client.0.smithi067.stdout:9/662: mknod d1b/d25/d35/cdf 0 2023-12-05T09:26:26.414 INFO:tasks.workunit.client.1.smithi134.stdout:5/643: mkdir d0/dd/d37/d90/d9d/de0 0 2023-12-05T09:26:26.414 INFO:tasks.workunit.client.1.smithi134.stdout:2/716: dwrite d19/d49/fab [0,4194304] 0 2023-12-05T09:26:26.414 INFO:tasks.workunit.client.1.smithi134.stdout:2/717: chown d19/d28/d2b/c3b 8 1 2023-12-05T09:26:26.416 INFO:tasks.workunit.client.1.smithi134.stdout:2/718: unlink d19/d3f/fdd 0 2023-12-05T09:26:26.424 INFO:tasks.workunit.client.0.smithi067.stdout:8/437: mknod d5/dc/c77 0 2023-12-05T09:26:26.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/438: creat d5/dc/d6e/f78 x:0 0 0 2023-12-05T09:26:26.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/439: write d5/dc/d1a/d20/d2d/d41/f4d [1518937,98559] 0 2023-12-05T09:26:26.427 INFO:tasks.workunit.client.1.smithi134.stdout:2/719: mkdir d19/d76/dba/ded 0 2023-12-05T09:26:26.427 INFO:tasks.workunit.client.1.smithi134.stdout:1/802: fsync d2/d9/d10/d30/dd4/dfb/f11e 0 2023-12-05T09:26:26.427 INFO:tasks.workunit.client.1.smithi134.stdout:1/803: dread - d2/d27/d40/f103 zero size 2023-12-05T09:26:26.427 INFO:tasks.workunit.client.1.smithi134.stdout:1/804: truncate d2/d27/db4/fbe 2323341 0 2023-12-05T09:26:26.429 INFO:tasks.workunit.client.1.smithi134.stdout:1/805: mkdir d2/d9/d10/d30/d66/da9/d74/d120 0 2023-12-05T09:26:26.436 INFO:tasks.workunit.client.1.smithi134.stdout:3/705: unlink d4/d5/d6f/c77 0 2023-12-05T09:26:26.438 INFO:tasks.workunit.client.1.smithi134.stdout:3/706: mkdir d4/d5/d45/d60/d85/d96/dde 0 2023-12-05T09:26:26.440 INFO:tasks.workunit.client.1.smithi134.stdout:0/642: dwrite d13/d14/d30/f7e [0,4194304] 0 2023-12-05T09:26:26.444 INFO:tasks.workunit.client.1.smithi134.stdout:3/707: creat d4/d5/d45/d60/d85/dba/fdf x:0 0 0 2023-12-05T09:26:26.444 INFO:tasks.workunit.client.1.smithi134.stdout:3/708: fsync d4/d5/d6f/d97/dae/dc9/f70 0 2023-12-05T09:26:26.444 INFO:tasks.workunit.client.1.smithi134.stdout:3/709: chown d4/d1f/l57 53921540 1 2023-12-05T09:26:26.444 INFO:tasks.workunit.client.1.smithi134.stdout:3/710: readlink d4/l67 0 2023-12-05T09:26:26.450 INFO:tasks.workunit.client.1.smithi134.stdout:0/643: mknod d13/d14/d30/d4b/d23/cd9 0 2023-12-05T09:26:26.452 INFO:tasks.workunit.client.1.smithi134.stdout:0/644: mkdir d13/d14/d30/d4b/dc1/dda 0 2023-12-05T09:26:26.454 INFO:tasks.workunit.client.0.smithi067.stdout:1/499: unlink d2/d4f/f9e 0 2023-12-05T09:26:26.455 INFO:tasks.workunit.client.1.smithi134.stdout:2/720: write d19/d3f/f78 [5751556,91776] 0 2023-12-05T09:26:26.456 INFO:tasks.workunit.client.0.smithi067.stdout:0/593: dwrite d3/d7/d3c/d66/dbf/f40 [0,4194304] 0 2023-12-05T09:26:26.456 INFO:tasks.workunit.client.0.smithi067.stdout:0/594: write d3/d7/d3c/fa3 [749948,115476] 0 2023-12-05T09:26:26.458 INFO:tasks.workunit.client.1.smithi134.stdout:5/644: dread d0/d1a/d1c/d3f/d5b/d5d/d78/f91 [0,4194304] 0 2023-12-05T09:26:26.458 INFO:tasks.workunit.client.1.smithi134.stdout:0/645: link d13/d14/d30/d4b/l33 d13/d14/d30/d4b/d66/ldb 0 2023-12-05T09:26:26.459 INFO:tasks.workunit.client.1.smithi134.stdout:6/624: dwrite d4/d39/d42/d4f/d6d/d3a/d80/f8b [0,4194304] 0 2023-12-05T09:26:26.459 INFO:tasks.workunit.client.0.smithi067.stdout:1/500: mknod d2/d4f/d14/d20/d83/cb6 0 2023-12-05T09:26:26.460 INFO:tasks.workunit.client.1.smithi134.stdout:9/678: dwrite d7/d8/fb6 [0,4194304] 0 2023-12-05T09:26:26.460 INFO:tasks.workunit.client.1.smithi134.stdout:9/679: chown d7/d8/d2e/l93 49 1 2023-12-05T09:26:26.460 INFO:tasks.workunit.client.1.smithi134.stdout:6/625: write d4/d32/d57/f6e [407866,104836] 0 2023-12-05T09:26:26.467 INFO:tasks.workunit.client.1.smithi134.stdout:7/662: dwrite d2/dd/d1a/f23 [0,4194304] 0 2023-12-05T09:26:26.467 INFO:tasks.workunit.client.1.smithi134.stdout:7/663: fsync d2/df/d2a/f40 0 2023-12-05T09:26:26.475 INFO:tasks.workunit.client.0.smithi067.stdout:2/419: dwrite d0/fd [0,4194304] 0 2023-12-05T09:26:26.476 INFO:tasks.workunit.client.0.smithi067.stdout:2/420: chown d0/d15/d63/c7b 48767 1 2023-12-05T09:26:26.476 INFO:tasks.workunit.client.1.smithi134.stdout:5/645: creat d0/dd/fe1 x:0 0 0 2023-12-05T09:26:26.479 INFO:tasks.workunit.client.1.smithi134.stdout:0/646: creat d13/d14/fdc x:0 0 0 2023-12-05T09:26:26.480 INFO:tasks.workunit.client.0.smithi067.stdout:1/501: mkdir d2/d5/d7/d6a/db7 0 2023-12-05T09:26:26.481 INFO:tasks.workunit.client.0.smithi067.stdout:1/502: readlink d2/d4f/d15/l52 0 2023-12-05T09:26:26.481 INFO:tasks.workunit.client.0.smithi067.stdout:1/503: chown d2/d5/d7/de/d19/d49/d6d/c97 0 1 2023-12-05T09:26:26.487 INFO:tasks.workunit.client.0.smithi067.stdout:2/421: unlink d0/d25/c7d 0 2023-12-05T09:26:26.487 INFO:tasks.workunit.client.0.smithi067.stdout:2/422: chown d0/d15/d53/d1e/d7f/c85 127 1 2023-12-05T09:26:26.488 INFO:tasks.workunit.client.0.smithi067.stdout:8/440: dwrite d5/dc/d6e/f78 [0,4194304] 0 2023-12-05T09:26:26.489 INFO:tasks.workunit.client.1.smithi134.stdout:3/711: dwrite d4/d1f/d4e/f65 [0,4194304] 0 2023-12-05T09:26:26.489 INFO:tasks.workunit.client.0.smithi067.stdout:1/504: mknod d2/d5/d7/de/d19/d8f/d98/cb8 0 2023-12-05T09:26:26.492 INFO:tasks.workunit.client.1.smithi134.stdout:9/680: rename d7/d5b/d5e/c77 to d7/d8/d14/d26/d7f/d92/d53/ce9 0 2023-12-05T09:26:26.498 INFO:tasks.workunit.client.0.smithi067.stdout:8/441: unlink d5/dc/d1a/d20/d2d/l68 0 2023-12-05T09:26:26.498 INFO:tasks.workunit.client.0.smithi067.stdout:8/442: chown d5/dc/d1a/d20/d3e/c71 104 1 2023-12-05T09:26:26.502 INFO:tasks.workunit.client.0.smithi067.stdout:1/505: creat d2/d4f/d15/d74/d76/fb9 x:0 0 0 2023-12-05T09:26:26.503 INFO:tasks.workunit.client.1.smithi134.stdout:7/664: creat d2/d7/d6f/da0/fd8 x:0 0 0 2023-12-05T09:26:26.505 INFO:tasks.workunit.client.0.smithi067.stdout:8/443: mkdir d5/dc/d1a/d20/d3e/d79 0 2023-12-05T09:26:26.505 INFO:tasks.workunit.client.0.smithi067.stdout:8/444: creat d5/dc/d1a/d20/d3e/f7a x:0 0 0 2023-12-05T09:26:26.507 INFO:tasks.workunit.client.1.smithi134.stdout:5/646: truncate d0/d1a/d3a/f4e 6882291 0 2023-12-05T09:26:26.507 INFO:tasks.workunit.client.1.smithi134.stdout:5/647: readlink d0/d1a/d1c/d3f/d5b/l88 0 2023-12-05T09:26:26.507 INFO:tasks.workunit.client.1.smithi134.stdout:5/648: chown d0/d1a/d1c/d3f/d81/db0 596 1 2023-12-05T09:26:26.508 INFO:tasks.workunit.client.0.smithi067.stdout:1/506: creat d2/d5/d7/d6a/fba x:0 0 0 2023-12-05T09:26:26.509 INFO:tasks.workunit.client.0.smithi067.stdout:0/595: dwrite d3/da2/fac [0,4194304] 0 2023-12-05T09:26:26.511 INFO:tasks.workunit.client.1.smithi134.stdout:0/647: mknod d13/d14/d15/d67/d73/cdd 0 2023-12-05T09:26:26.514 INFO:tasks.workunit.client.1.smithi134.stdout:7/665: dread d2/d7/dc/d22/f27 [0,4194304] 0 2023-12-05T09:26:26.514 INFO:tasks.workunit.client.1.smithi134.stdout:7/666: read - d2/df/f68 zero size 2023-12-05T09:26:26.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/445: link d5/dc/d1a/d20/d2d/d41/f5b d5/da/d30/d61/f7b 0 2023-12-05T09:26:26.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/446: write d5/d3b/f3d [1193840,76632] 0 2023-12-05T09:26:26.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/447: stat d5/dc/f6c 0 2023-12-05T09:26:26.522 INFO:tasks.workunit.client.0.smithi067.stdout:8/448: write d5/dc/d1a/d20/f53 [1088031,78554] 0 2023-12-05T09:26:26.528 INFO:tasks.workunit.client.0.smithi067.stdout:0/596: creat d3/d7/dd7/fdc x:0 0 0 2023-12-05T09:26:26.528 INFO:tasks.workunit.client.0.smithi067.stdout:0/597: chown d3/d7/d3c/d67/fc6 0 1 2023-12-05T09:26:26.530 INFO:tasks.workunit.client.1.smithi134.stdout:3/712: rmdir d4/d5/d6f/d76 39 2023-12-05T09:26:26.531 INFO:tasks.workunit.client.0.smithi067.stdout:8/449: rmdir d5/dc/d1a 39 2023-12-05T09:26:26.531 INFO:tasks.workunit.client.0.smithi067.stdout:8/450: chown d5/dc/d1a/d20/d58/c60 80817375 1 2023-12-05T09:26:26.535 INFO:tasks.workunit.client.1.smithi134.stdout:6/626: getdents d4/d39/d42/d4f 0 2023-12-05T09:26:26.537 INFO:tasks.workunit.client.0.smithi067.stdout:2/423: dwrite d0/d25/d48/f6b [0,4194304] 0 2023-12-05T09:26:26.539 INFO:tasks.workunit.client.1.smithi134.stdout:7/667: mkdir d2/d7/d2b/dd9 0 2023-12-05T09:26:26.539 INFO:tasks.workunit.client.1.smithi134.stdout:7/668: write d2/d7/d65/f92 [2701912,77217] 0 2023-12-05T09:26:26.545 INFO:tasks.workunit.client.1.smithi134.stdout:3/713: link d4/d5/c9 d4/d5/d6f/d76/ce0 0 2023-12-05T09:26:26.551 INFO:tasks.workunit.client.1.smithi134.stdout:6/627: mknod d4/d78/d7a/cbb 0 2023-12-05T09:26:26.559 INFO:tasks.workunit.client.1.smithi134.stdout:0/648: rename d13/d14/d30/d2c to d13/d14/d30/d4b/d66/da0/daf/dde 0 2023-12-05T09:26:26.559 INFO:tasks.workunit.client.1.smithi134.stdout:0/649: readlink d13/d14/l18 0 2023-12-05T09:26:26.561 INFO:tasks.workunit.client.0.smithi067.stdout:9/663: write d1b/d25/d35/f43 [1563951,81880] 0 2023-12-05T09:26:26.561 INFO:tasks.workunit.client.0.smithi067.stdout:2/424: dread d0/d15/d53/d1e/f2d [0,4194304] 0 2023-12-05T09:26:26.565 INFO:tasks.workunit.client.0.smithi067.stdout:2/425: symlink d0/d25/d34/d4d/d78/l94 0 2023-12-05T09:26:26.566 INFO:tasks.workunit.client.0.smithi067.stdout:1/507: dwrite d2/d5/d7/de/d19/d71/fb5 [0,4194304] 0 2023-12-05T09:26:26.567 INFO:tasks.workunit.client.1.smithi134.stdout:4/660: sync 2023-12-05T09:26:26.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/661: creat d16/d21/d47/fe9 x:0 0 0 2023-12-05T09:26:26.571 INFO:tasks.workunit.client.1.smithi134.stdout:0/650: dread f7 [0,4194304] 0 2023-12-05T09:26:26.575 INFO:tasks.workunit.client.1.smithi134.stdout:6/628: dread d4/d39/d42/d4f/d6d/d3a/d75/f30 [0,4194304] 0 2023-12-05T09:26:26.575 INFO:tasks.workunit.client.0.smithi067.stdout:1/508: rename d2/d4f/d14/d20/d83/d78/dac to d2/d3/da6/dbb 0 2023-12-05T09:26:26.576 INFO:tasks.workunit.client.0.smithi067.stdout:1/509: write d2/d4f/d14/d20/d83/f84 [708043,123961] 0 2023-12-05T09:26:26.577 INFO:tasks.workunit.client.1.smithi134.stdout:8/794: sync 2023-12-05T09:26:26.577 INFO:tasks.workunit.client.1.smithi134.stdout:8/795: write da/f2a [16319,39392] 0 2023-12-05T09:26:26.577 INFO:tasks.workunit.client.1.smithi134.stdout:8/796: readlink da/l35 0 2023-12-05T09:26:26.577 INFO:tasks.workunit.client.1.smithi134.stdout:8/797: creat da/de/d16/d98/f112 x:0 0 0 2023-12-05T09:26:26.578 INFO:tasks.workunit.client.1.smithi134.stdout:4/662: mkdir d16/d21/d48/d66/db0/dea 0 2023-12-05T09:26:26.578 INFO:tasks.workunit.client.1.smithi134.stdout:4/663: chown d16/d21/d48/d66/fbf 2551539 1 2023-12-05T09:26:26.578 INFO:tasks.workunit.client.1.smithi134.stdout:4/664: chown d16/d18/d1c/d63/l94 830 1 2023-12-05T09:26:26.582 INFO:tasks.workunit.client.1.smithi134.stdout:6/629: mkdir d4/d39/d42/d4f/d6d/d3a/d75/dbc 0 2023-12-05T09:26:26.588 INFO:tasks.workunit.client.1.smithi134.stdout:8/798: mknod da/de/d8a/d42/d99/dc8/d72/c113 0 2023-12-05T09:26:26.591 INFO:tasks.workunit.client.1.smithi134.stdout:6/630: dread d4/d39/d42/f4d [0,4194304] 0 2023-12-05T09:26:26.591 INFO:tasks.workunit.client.1.smithi134.stdout:8/799: rmdir da/de/d11/d1d/db8/df3/d100 0 2023-12-05T09:26:26.593 INFO:tasks.workunit.client.1.smithi134.stdout:7/669: dwrite d2/d7/d2b/d2d/f66 [4194304,4194304] 0 2023-12-05T09:26:26.593 INFO:tasks.workunit.client.1.smithi134.stdout:7/670: stat d2/d7/dc/d2e/d3a/f49 0 2023-12-05T09:26:26.611 INFO:tasks.workunit.client.1.smithi134.stdout:3/714: dwrite d4/d1f/d50/d52/f88 [0,4194304] 0 2023-12-05T09:26:26.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/426: dwrite d0/f41 [0,4194304] 0 2023-12-05T09:26:26.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/427: fdatasync d0/f8a 0 2023-12-05T09:26:26.625 INFO:tasks.workunit.client.0.smithi067.stdout:2/428: rename d0 to d0/d25/d34/d4d/d78/d95 22 2023-12-05T09:26:26.630 INFO:tasks.workunit.client.0.smithi067.stdout:3/417: sync 2023-12-05T09:26:26.632 INFO:tasks.workunit.client.1.smithi134.stdout:2/721: write d19/d28/d31/d6f/f84 [2617107,13374] 0 2023-12-05T09:26:26.632 INFO:tasks.workunit.client.1.smithi134.stdout:2/722: chown d19/d28/f5c 79419 1 2023-12-05T09:26:26.632 INFO:tasks.workunit.client.1.smithi134.stdout:2/723: chown d19/f34 4906 1 2023-12-05T09:26:26.639 INFO:tasks.workunit.client.1.smithi134.stdout:8/800: rmdir da/de/d96/dc9 39 2023-12-05T09:26:26.647 INFO:tasks.workunit.client.1.smithi134.stdout:4/665: dwrite d16/d7b/dce/d6e/daa/d3b/f5d [0,4194304] 0 2023-12-05T09:26:26.648 INFO:tasks.workunit.client.0.smithi067.stdout:2/429: link d0/d15/d53/c13 d0/d25/d34/d4d/d54/d90/c96 0 2023-12-05T09:26:26.648 INFO:tasks.workunit.client.0.smithi067.stdout:2/430: write d0/d15/d53/f6c [1378289,62099] 0 2023-12-05T09:26:26.648 INFO:tasks.workunit.client.0.smithi067.stdout:2/431: chown d0/d25/f8b 328 1 2023-12-05T09:26:26.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/681: getdents d7/d8/d14/d26/d7f/d92/d53 0 2023-12-05T09:26:26.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/682: stat d7/d10/lbe 0 2023-12-05T09:26:26.654 INFO:tasks.workunit.client.0.smithi067.stdout:9/664: dwrite d1b/d25/d54/d5c/fa8 [0,4194304] 0 2023-12-05T09:26:26.655 INFO:tasks.workunit.client.0.smithi067.stdout:3/418: mkdir d9/da/d15/d28/d29/d47/d92 0 2023-12-05T09:26:26.662 INFO:tasks.workunit.client.0.smithi067.stdout:2/432: mknod d0/d15/d53/d1e/c97 0 2023-12-05T09:26:26.663 INFO:tasks.workunit.client.0.smithi067.stdout:9/665: dread d1b/d3e/f53 [0,4194304] 0 2023-12-05T09:26:26.663 INFO:tasks.workunit.client.0.smithi067.stdout:0/598: dwrite d3/d6b/f6f [0,4194304] 0 2023-12-05T09:26:26.664 INFO:tasks.workunit.client.1.smithi134.stdout:6/631: rmdir d4/d32/d57 39 2023-12-05T09:26:26.667 INFO:tasks.workunit.client.1.smithi134.stdout:7/671: dwrite d2/df/d2a/d36/f5d [0,4194304] 0 2023-12-05T09:26:26.668 INFO:tasks.workunit.client.1.smithi134.stdout:9/683: mknod d7/d8/d14/d26/d7f/d92/d53/cea 0 2023-12-05T09:26:26.671 INFO:tasks.workunit.client.1.smithi134.stdout:1/806: sync 2023-12-05T09:26:26.671 INFO:tasks.workunit.client.1.smithi134.stdout:1/807: fsync d2/d9/d10/d30/d4a/f70 0 2023-12-05T09:26:26.674 INFO:tasks.workunit.client.0.smithi067.stdout:9/666: mknod d1b/dd3/d6c/ce0 0 2023-12-05T09:26:26.674 INFO:tasks.workunit.client.0.smithi067.stdout:9/667: fdatasync d1b/d3e/fdd 0 2023-12-05T09:26:26.674 INFO:tasks.workunit.client.0.smithi067.stdout:9/668: dread - d1b/d25/f70 zero size 2023-12-05T09:26:26.678 INFO:tasks.workunit.client.0.smithi067.stdout:0/599: rename d3/d7/d3c/d66/dbf/d10/l69 to d3/d7/d3c/d66/dbf/d10/dd2/d99/db4/ldd 0 2023-12-05T09:26:26.678 INFO:tasks.workunit.client.0.smithi067.stdout:0/600: truncate d3/d6b/d6e/f72 5120369 0 2023-12-05T09:26:26.679 INFO:tasks.workunit.client.1.smithi134.stdout:8/801: dwrite da/de/d8a/d42/f63 [0,4194304] 0 2023-12-05T09:26:26.679 INFO:tasks.workunit.client.1.smithi134.stdout:8/802: fdatasync da/de/d43/fa3 0 2023-12-05T09:26:26.686 INFO:tasks.workunit.client.0.smithi067.stdout:2/433: write d0/d25/d48/f6b [2437780,104523] 0 2023-12-05T09:26:26.687 INFO:tasks.workunit.client.0.smithi067.stdout:0/601: creat d3/d7/d3c/d67/d59/d4e/fde x:0 0 0 2023-12-05T09:26:26.689 INFO:tasks.workunit.client.1.smithi134.stdout:3/715: rmdir d4/d5 39 2023-12-05T09:26:26.690 INFO:tasks.workunit.client.1.smithi134.stdout:9/684: read d7/d8/d14/f59 [3961753,78513] 0 2023-12-05T09:26:26.691 INFO:tasks.workunit.client.1.smithi134.stdout:4/666: dwrite d16/d21/f57 [0,4194304] 0 2023-12-05T09:26:26.691 INFO:tasks.workunit.client.1.smithi134.stdout:1/808: dread d2/f65 [0,4194304] 0 2023-12-05T09:26:26.692 INFO:tasks.workunit.client.1.smithi134.stdout:6/632: symlink d4/d39/d42/d4f/d6d/d3a/d75/lbd 0 2023-12-05T09:26:26.698 INFO:tasks.workunit.client.1.smithi134.stdout:7/672: mknod d2/d7/cda 0 2023-12-05T09:26:26.698 INFO:tasks.workunit.client.1.smithi134.stdout:7/673: fsync d2/df/d2a/d63/f77 0 2023-12-05T09:26:26.701 INFO:tasks.workunit.client.1.smithi134.stdout:3/716: unlink d4/d1f/d4e/d6a/lb7 0 2023-12-05T09:26:26.701 INFO:tasks.workunit.client.1.smithi134.stdout:3/717: readlink d4/d1f/d50/db4/lc4 0 2023-12-05T09:26:26.701 INFO:tasks.workunit.client.1.smithi134.stdout:3/718: creat d4/d1f/fe1 x:0 0 0 2023-12-05T09:26:26.704 INFO:tasks.workunit.client.1.smithi134.stdout:9/685: getdents d7/d8/d14/d26/d7f/d92/d53/d7b/d8f/d8a 0 2023-12-05T09:26:26.704 INFO:tasks.workunit.client.1.smithi134.stdout:1/809: rmdir d2/d9/d10/d5b 39 2023-12-05T09:26:26.707 INFO:tasks.workunit.client.1.smithi134.stdout:6/633: creat d4/d39/d42/d4f/d6d/d3a/d75/fbe x:0 0 0 2023-12-05T09:26:26.707 INFO:tasks.workunit.client.1.smithi134.stdout:1/810: write d2/d27/d9d/fd6 [80688,87461] 0 2023-12-05T09:26:26.708 INFO:tasks.workunit.client.1.smithi134.stdout:9/686: truncate d7/d8/d16/fda 503068 0 2023-12-05T09:26:26.710 INFO:tasks.workunit.client.1.smithi134.stdout:5/649: sync 2023-12-05T09:26:26.710 INFO:tasks.workunit.client.1.smithi134.stdout:5/650: write d0/d11/d5c/fa6 [377242,58401] 0 2023-12-05T09:26:26.710 INFO:tasks.workunit.client.1.smithi134.stdout:5/651: stat d0/d1a/d1c/d3f/l4a 0 2023-12-05T09:26:26.710 INFO:tasks.workunit.client.1.smithi134.stdout:4/667: dread d16/d21/d47/d4b/f77 [0,4194304] 0 2023-12-05T09:26:26.710 INFO:tasks.workunit.client.1.smithi134.stdout:4/668: chown f4 0 1 2023-12-05T09:26:26.711 INFO:tasks.workunit.client.1.smithi134.stdout:1/811: mkdir d2/d9/d10/d30/d66/d121 0 2023-12-05T09:26:26.711 INFO:tasks.workunit.client.1.smithi134.stdout:9/687: mkdir d7/d8/d16/d52/d74/d97/deb 0 2023-12-05T09:26:26.711 INFO:tasks.workunit.client.1.smithi134.stdout:9/688: fsync d7/d8/fb6 0 2023-12-05T09:26:26.711 INFO:tasks.workunit.client.1.smithi134.stdout:9/689: write d7/d8/fe2 [657934,51725] 0 2023-12-05T09:26:26.711 INFO:tasks.workunit.client.1.smithi134.stdout:9/690: chown d7/d7d/c88 1114 1 2023-12-05T09:26:26.713 INFO:tasks.workunit.client.1.smithi134.stdout:9/691: creat d7/d8/d14/d26/d7f/d92/d53/d7b/d8f/fec x:0 0 0 2023-12-05T09:26:26.713 INFO:tasks.workunit.client.0.smithi067.stdout:7/451: sync 2023-12-05T09:26:26.713 INFO:tasks.workunit.client.0.smithi067.stdout:5/513: sync 2023-12-05T09:26:26.715 INFO:tasks.workunit.client.0.smithi067.stdout:7/452: creat d0/d9/d40/d48/f91 x:0 0 0 2023-12-05T09:26:26.715 INFO:tasks.workunit.client.0.smithi067.stdout:7/453: write d0/d9/d10/d37/d38/d64/d34/f36 [4340435,104283] 0 2023-12-05T09:26:26.715 INFO:tasks.workunit.client.1.smithi134.stdout:9/692: dread - d7/d8/d14/d26/d7f/d92/d53/d7b/d8f/fec zero size 2023-12-05T09:26:26.716 INFO:tasks.workunit.client.0.smithi067.stdout:5/514: mknod db/df/d36/cbc 0 2023-12-05T09:26:26.718 INFO:tasks.workunit.client.0.smithi067.stdout:7/454: symlink d0/d9/d10/d37/d82/l92 0 2023-12-05T09:26:26.718 INFO:tasks.workunit.client.0.smithi067.stdout:7/455: truncate d0/d9/d40/d7a/f87 851369 0 2023-12-05T09:26:26.719 INFO:tasks.workunit.client.0.smithi067.stdout:5/515: rmdir db/df/d3f 39 2023-12-05T09:26:26.722 INFO:tasks.workunit.client.0.smithi067.stdout:7/456: symlink d0/d9/d10/l93 0 2023-12-05T09:26:26.725 INFO:tasks.workunit.client.0.smithi067.stdout:9/669: write d1b/d25/d35/d56/fc1 [214490,27651] 0 2023-12-05T09:26:26.726 INFO:tasks.workunit.client.0.smithi067.stdout:5/516: mknod db/df/d1a/d1d/cbd 0 2023-12-05T09:26:26.729 INFO:tasks.workunit.client.0.smithi067.stdout:9/670: mknod d1b/d3e/d7f/ce1 0 2023-12-05T09:26:26.729 INFO:tasks.workunit.client.0.smithi067.stdout:9/671: dread - d1b/d25/d35/d56/fc0 zero size 2023-12-05T09:26:26.730 INFO:tasks.workunit.client.0.smithi067.stdout:5/517: truncate db/df/d36/d57/fb7 788935 0 2023-12-05T09:26:26.734 INFO:tasks.workunit.client.0.smithi067.stdout:9/672: mkdir d1b/d25/d54/d5c/de2 0 2023-12-05T09:26:26.734 INFO:tasks.workunit.client.0.smithi067.stdout:9/673: write d1b/d25/f70 [845708,70476] 0 2023-12-05T09:26:26.737 INFO:tasks.workunit.client.0.smithi067.stdout:9/674: creat d1b/d25/d35/d56/fe3 x:0 0 0 2023-12-05T09:26:26.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/675: symlink d1b/d25/d54/d5c/dc5/le4 0 2023-12-05T09:26:26.739 INFO:tasks.workunit.client.0.smithi067.stdout:2/434: read d0/f41 [113768,73617] 0 2023-12-05T09:26:26.740 INFO:tasks.workunit.client.1.smithi134.stdout:0/651: sync 2023-12-05T09:26:26.743 INFO:tasks.workunit.client.1.smithi134.stdout:0/652: creat d13/d14/d30/d4b/d66/da0/daf/dde/d9d/fdf x:0 0 0 2023-12-05T09:26:26.745 INFO:tasks.workunit.client.0.smithi067.stdout:7/457: write d0/d9/f58 [3880519,44461] 0 2023-12-05T09:26:26.745 INFO:tasks.workunit.client.0.smithi067.stdout:7/458: fdatasync d0/d9/d10/d37/d38/d64/f55 0 2023-12-05T09:26:26.745 INFO:tasks.workunit.client.0.smithi067.stdout:2/435: getdents d0/d25/d34/d4d/d54/d90 0 2023-12-05T09:26:26.748 INFO:tasks.workunit.client.1.smithi134.stdout:0/653: creat d13/d14/d15/d93/fe0 x:0 0 0 2023-12-05T09:26:26.752 INFO:tasks.workunit.client.1.smithi134.stdout:8/803: dwrite f9 [0,4194304] 0 2023-12-05T09:26:26.754 INFO:tasks.workunit.client.0.smithi067.stdout:2/436: truncate d0/f5a 857946 0 2023-12-05T09:26:26.755 INFO:tasks.workunit.client.1.smithi134.stdout:7/674: dwrite d2/d7/f13 [4194304,4194304] 0 2023-12-05T09:26:26.755 INFO:tasks.workunit.client.1.smithi134.stdout:7/675: fsync d2/d7/d2b/d2d/d67/d73/f7e 0 2023-12-05T09:26:26.756 INFO:tasks.workunit.client.0.smithi067.stdout:7/459: getdents d0/d9/d10/d37/d38/d64/d5a 0 2023-12-05T09:26:26.756 INFO:tasks.workunit.client.0.smithi067.stdout:7/460: fdatasync d0/d45/f80 0 2023-12-05T09:26:26.758 INFO:tasks.workunit.client.1.smithi134.stdout:1/812: write d2/d9/d10/d30/d66/da9/d74/d99/fbd [154493,16106] 0 2023-12-05T09:26:26.761 INFO:tasks.workunit.client.0.smithi067.stdout:5/518: read db/df/d3f/f60 [705428,49648] 0 2023-12-05T09:26:26.761 INFO:tasks.workunit.client.0.smithi067.stdout:5/519: fdatasync db/df/d1a/f21 0 2023-12-05T09:26:26.762 INFO:tasks.workunit.client.0.smithi067.stdout:2/437: write d0/d2f/d39/f75 [550792,54149] 0 2023-12-05T09:26:26.767 INFO:tasks.workunit.client.0.smithi067.stdout:7/461: symlink d0/d9/d10/d37/d38/d64/d34/d8c/l94 0 2023-12-05T09:26:26.767 INFO:tasks.workunit.client.0.smithi067.stdout:7/462: write d0/d9/f71 [684411,23235] 0 2023-12-05T09:26:26.767 INFO:tasks.workunit.client.0.smithi067.stdout:7/463: write d0/d9/d10/f2f [4956723,77214] 0 2023-12-05T09:26:26.768 INFO:tasks.workunit.client.1.smithi134.stdout:6/634: write d4/d32/d57/f5d [238045,39069] 0 2023-12-05T09:26:26.771 INFO:tasks.workunit.client.1.smithi134.stdout:8/804: link da/de/d16/dbe/ffb da/de/d11/d8b/d8c/d10b/f114 0 2023-12-05T09:26:26.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/602: dwrite d3/d7/d30/f4a [0,4194304] 0 2023-12-05T09:26:26.772 INFO:tasks.workunit.client.0.smithi067.stdout:0/603: truncate d3/fa 2532322 0 2023-12-05T09:26:26.773 INFO:tasks.workunit.client.0.smithi067.stdout:2/438: rename d0/d25/c28 to d0/d2f/d84/c98 0 2023-12-05T09:26:26.776 INFO:tasks.workunit.client.1.smithi134.stdout:1/813: rename d2/d9/l42 to d2/d27/d40/d10a/l122 0 2023-12-05T09:26:26.777 INFO:tasks.workunit.client.1.smithi134.stdout:3/719: dwrite d4/d1f/fc7 [0,4194304] 0 2023-12-05T09:26:26.780 INFO:tasks.workunit.client.1.smithi134.stdout:4/669: dwrite d16/d7b/db6/fcd [0,4194304] 0 2023-12-05T09:26:26.783 INFO:tasks.workunit.client.1.smithi134.stdout:6/635: creat d4/d32/fbf x:0 0 0 2023-12-05T09:26:26.783 INFO:tasks.workunit.client.0.smithi067.stdout:7/464: symlink d0/d9/l95 0 2023-12-05T09:26:26.786 INFO:tasks.workunit.client.0.smithi067.stdout:0/604: mknod d3/d7/d3c/d66/cdf 0 2023-12-05T09:26:26.786 INFO:tasks.workunit.client.0.smithi067.stdout:0/605: truncate d3/da2/fb0 5935970 0 2023-12-05T09:26:26.786 INFO:tasks.workunit.client.0.smithi067.stdout:0/606: readlink d3/ld5 0 2023-12-05T09:26:26.788 INFO:tasks.workunit.client.0.smithi067.stdout:2/439: mknod d0/d7c/c99 0 2023-12-05T09:26:26.792 INFO:tasks.workunit.client.1.smithi134.stdout:8/805: unlink da/de/d96/dc9/le9 0 2023-12-05T09:26:26.792 INFO:tasks.workunit.client.1.smithi134.stdout:9/693: dwrite d7/d8/d14/fc7 [0,4194304] 0 2023-12-05T09:26:26.792 INFO:tasks.workunit.client.1.smithi134.stdout:1/814: mknod d2/d9/d10/d94/c123 0 2023-12-05T09:26:26.792 INFO:tasks.workunit.client.1.smithi134.stdout:2/724: sync 2023-12-05T09:26:26.792 INFO:tasks.workunit.client.1.smithi134.stdout:2/725: write d19/f8f [239491,32571] 0 2023-12-05T09:26:26.794 INFO:tasks.workunit.client.1.smithi134.stdout:3/720: write d4/d5/d45/d60/d85/dab/fd8 [2698793,101515] 0 2023-12-05T09:26:26.794 INFO:tasks.workunit.client.1.smithi134.stdout:3/721: fdatasync d4/d5/d45/d60/f66 0 2023-12-05T09:26:26.803 INFO:tasks.workunit.client.1.smithi134.stdout:7/676: dwrite d2/d7/dc/fc0 [0,4194304] 0 2023-12-05T09:26:26.803 INFO:tasks.workunit.client.1.smithi134.stdout:7/677: dread - d2/d7/d2b/d2d/d67/fc1 zero size 2023-12-05T09:26:26.803 INFO:tasks.workunit.client.1.smithi134.stdout:7/678: dread - d2/d7/d2b/d2d/d67/d73/f7e zero size 2023-12-05T09:26:26.803 INFO:tasks.workunit.client.1.smithi134.stdout:4/670: link d16/d18/d1b/ld4 d16/d7b/dce/d6e/leb 0 2023-12-05T09:26:26.806 INFO:tasks.workunit.client.0.smithi067.stdout:7/465: unlink d0/d45/l5c 0 2023-12-05T09:26:26.807 INFO:tasks.workunit.client.0.smithi067.stdout:7/466: dread - d0/d9/d10/d37/d38/d64/d34/f46 zero size 2023-12-05T09:26:26.809 INFO:tasks.workunit.client.0.smithi067.stdout:0/607: symlink d3/d7/d3c/d6c/d76/da7/le0 0 2023-12-05T09:26:26.809 INFO:tasks.workunit.client.0.smithi067.stdout:0/608: fsync d3/d7/d3c/d67/d59/d4e/f5d 0 2023-12-05T09:26:26.809 INFO:tasks.workunit.client.0.smithi067.stdout:2/440: dread d0/d15/f73 [0,4194304] 0 2023-12-05T09:26:26.810 INFO:tasks.workunit.client.0.smithi067.stdout:2/441: creat d0/d25/d34/d4a/f9a x:0 0 0 2023-12-05T09:26:26.810 INFO:tasks.workunit.client.0.smithi067.stdout:2/442: creat d0/d25/d3f/f9b x:0 0 0 2023-12-05T09:26:26.811 INFO:tasks.workunit.client.1.smithi134.stdout:1/815: mkdir d2/d9/d10/d94/d124 0 2023-12-05T09:26:26.812 INFO:tasks.workunit.client.1.smithi134.stdout:6/636: rmdir d4/d39/d42/d4f/d6d/d3a/da 39 2023-12-05T09:26:26.813 INFO:tasks.workunit.client.0.smithi067.stdout:7/467: creat d0/d9/d10/d37/d38/d64/d34/d67/f96 x:0 0 0 2023-12-05T09:26:26.815 INFO:tasks.workunit.client.0.smithi067.stdout:0/609: unlink d3/ld5 0 2023-12-05T09:26:26.817 INFO:tasks.workunit.client.1.smithi134.stdout:2/726: symlink d19/d28/db1/lee 0 2023-12-05T09:26:26.817 INFO:tasks.workunit.client.1.smithi134.stdout:2/727: write d19/d28/d31/d6f/fe1 [102181,91194] 0 2023-12-05T09:26:26.817 INFO:tasks.workunit.client.1.smithi134.stdout:2/728: chown d19/d28/d31/d38/fc8 51896 1 2023-12-05T09:26:26.817 INFO:tasks.workunit.client.1.smithi134.stdout:2/729: chown d19/d76/dba/ld6 65693 1 2023-12-05T09:26:26.822 INFO:tasks.workunit.client.1.smithi134.stdout:3/722: symlink d4/d1f/d50/d52/le2 0 2023-12-05T09:26:26.824 INFO:tasks.workunit.client.0.smithi067.stdout:0/610: creat d3/d7/d3c/d67/d59/fe1 x:0 0 0 2023-12-05T09:26:26.824 INFO:tasks.workunit.client.0.smithi067.stdout:0/611: stat d3/d7/d3c/l7f 0 2023-12-05T09:26:26.828 INFO:tasks.workunit.client.0.smithi067.stdout:0/612: mknod d3/d7/d3c/d66/ce2 0 2023-12-05T09:26:26.834 INFO:tasks.workunit.client.1.smithi134.stdout:4/671: link f0 d16/d7b/dce/fec 0 2023-12-05T09:26:26.835 INFO:tasks.workunit.client.1.smithi134.stdout:6/637: write d4/d32/d57/f94 [301413,56388] 0 2023-12-05T09:26:26.835 INFO:tasks.workunit.client.1.smithi134.stdout:2/730: rename d19/d28/d31/d6f/fe1 to d19/d3f/dbf/fef 0 2023-12-05T09:26:26.835 INFO:tasks.workunit.client.1.smithi134.stdout:2/731: chown d19/d28/d2b/f57 30 1 2023-12-05T09:26:26.835 INFO:tasks.workunit.client.1.smithi134.stdout:2/732: truncate d19/d28/d31/d38/f6a 1636013 0 2023-12-05T09:26:26.837 INFO:tasks.workunit.client.1.smithi134.stdout:9/694: getdents d7/d10 0 2023-12-05T09:26:26.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/613: dread d3/d7/d3c/d66/dbf/d10/dd2/fab [8388608,4194304] 0 2023-12-05T09:26:26.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/614: write d3/f31 [728374,98390] 0 2023-12-05T09:26:26.838 INFO:tasks.workunit.client.0.smithi067.stdout:0/615: chown d3/d7/d3c/d6c/d76/da7/le0 112 1 2023-12-05T09:26:26.839 INFO:tasks.workunit.client.1.smithi134.stdout:7/679: getdents d2/df/d2a/d36 0 2023-12-05T09:26:26.842 INFO:tasks.workunit.client.0.smithi067.stdout:0/616: link d3/d7/cb7 d3/d7/d3c/d67/ce3 0 2023-12-05T09:26:26.842 INFO:tasks.workunit.client.0.smithi067.stdout:0/617: readlink d3/l8b 0 2023-12-05T09:26:26.843 INFO:tasks.workunit.client.1.smithi134.stdout:4/672: rmdir d16/d21/d48/d66 39 2023-12-05T09:26:26.844 INFO:tasks.workunit.client.0.smithi067.stdout:0/618: creat d3/d7/d3c/dc2/fe4 x:0 0 0 2023-12-05T09:26:26.846 INFO:tasks.workunit.client.1.smithi134.stdout:6/638: dread d4/d39/f53 [0,4194304] 0 2023-12-05T09:26:26.846 INFO:tasks.workunit.client.1.smithi134.stdout:2/733: link d19/d28/d2b/l72 d19/d28/d63/d70/lf0 0 2023-12-05T09:26:26.846 INFO:tasks.workunit.client.1.smithi134.stdout:2/734: chown d19/d28/d63/d70 1094 1 2023-12-05T09:26:26.847 INFO:tasks.workunit.client.1.smithi134.stdout:2/735: fdatasync d19/d28/d63/d70/f74 0 2023-12-05T09:26:26.847 INFO:tasks.workunit.client.1.smithi134.stdout:2/736: chown d19/d3a/fbc 242 1 2023-12-05T09:26:26.847 INFO:tasks.workunit.client.1.smithi134.stdout:2/737: creat d19/d28/d31/d38/d98/db5/ff1 x:0 0 0 2023-12-05T09:26:26.849 INFO:tasks.workunit.client.1.smithi134.stdout:9/695: mknod d7/d10/d56/dd5/ced 0 2023-12-05T09:26:26.850 INFO:tasks.workunit.client.1.smithi134.stdout:9/696: fdatasync d7/d8/d14/d26/f3e 0 2023-12-05T09:26:26.850 INFO:tasks.workunit.client.1.smithi134.stdout:9/697: dread - d7/d8/d16/d52/d74/d97/fdb zero size 2023-12-05T09:26:26.850 INFO:tasks.workunit.client.1.smithi134.stdout:7/680: read d2/d7/dc/d2e/f3e [67103,95136] 0 2023-12-05T09:26:26.853 INFO:tasks.workunit.client.1.smithi134.stdout:3/723: dread d4/f12 [0,4194304] 0 2023-12-05T09:26:26.853 INFO:tasks.workunit.client.1.smithi134.stdout:4/673: symlink d16/d21/led 0 2023-12-05T09:26:26.854 INFO:tasks.workunit.client.1.smithi134.stdout:6/639: symlink d4/d39/d42/d4f/d6d/d3a/da/da0/lc0 0 2023-12-05T09:26:26.855 INFO:tasks.workunit.client.1.smithi134.stdout:8/806: dwrite da/de/d43/fa3 [4194304,4194304] 0 2023-12-05T09:26:26.856 INFO:tasks.workunit.client.1.smithi134.stdout:8/807: chown da/de 3398816 1 2023-12-05T09:26:26.856 INFO:tasks.workunit.client.1.smithi134.stdout:8/808: chown da/de/d11/d1d/fc5 627160 1 2023-12-05T09:26:26.856 INFO:tasks.workunit.client.1.smithi134.stdout:8/809: stat da/de/d16/lc6 0 2023-12-05T09:26:26.860 INFO:tasks.workunit.client.1.smithi134.stdout:1/816: dwrite d2/f43 [0,4194304] 0 2023-12-05T09:26:26.860 INFO:tasks.workunit.client.1.smithi134.stdout:1/817: fsync d2/d9/d10/d94/de5/f102 0 2023-12-05T09:26:26.861 INFO:tasks.workunit.client.1.smithi134.stdout:7/681: mkdir d2/d7/d6f/da0/ddb 0 2023-12-05T09:26:26.864 INFO:tasks.workunit.client.1.smithi134.stdout:7/682: rename d2 to d2/d7/dc/d2e/d3a/d6d/d9e/ddc 22 2023-12-05T09:26:26.865 INFO:tasks.workunit.client.1.smithi134.stdout:1/818: rmdir d2/d27/d71 39 2023-12-05T09:26:26.865 INFO:tasks.workunit.client.1.smithi134.stdout:9/698: mkdir d7/dee 0 2023-12-05T09:26:26.865 INFO:tasks.workunit.client.1.smithi134.stdout:9/699: dread - d7/d8/d14/d26/d5a/fb2 zero size 2023-12-05T09:26:26.868 INFO:tasks.workunit.client.1.smithi134.stdout:4/674: dread d16/d21/d35/fa5 [0,4194304] 0 2023-12-05T09:26:26.868 INFO:tasks.workunit.client.1.smithi134.stdout:4/675: stat d16/d18/dc5 0 2023-12-05T09:26:26.875 INFO:tasks.workunit.client.0.smithi067.stdout:2/443: dwrite d0/d15/d53/d1e/d7f/f91 [0,4194304] 0 2023-12-05T09:26:26.876 INFO:tasks.workunit.client.1.smithi134.stdout:3/724: dread d4/f38 [0,4194304] 0 2023-12-05T09:26:26.876 INFO:tasks.workunit.client.1.smithi134.stdout:9/700: dread d7/d10/d56/f9f [0,4194304] 0 2023-12-05T09:26:26.876 INFO:tasks.workunit.client.1.smithi134.stdout:9/701: stat d7/d8/fb6 0 2023-12-05T09:26:26.877 INFO:tasks.workunit.client.0.smithi067.stdout:2/444: symlink d0/d25/d3f/d83/l9c 0 2023-12-05T09:26:26.877 INFO:tasks.workunit.client.0.smithi067.stdout:2/445: readlink d0/d15/d53/l1c 0 2023-12-05T09:26:26.880 INFO:tasks.workunit.client.1.smithi134.stdout:1/819: dread d2/d9/d10/d30/d66/da9/f7f [0,4194304] 0 2023-12-05T09:26:26.881 INFO:tasks.workunit.client.1.smithi134.stdout:2/738: dwrite d19/d28/d31/d6f/fad [0,4194304] 0 2023-12-05T09:26:26.889 INFO:tasks.workunit.client.1.smithi134.stdout:4/676: rename d16/d18/d1c/d63/fa4 to d16/d21/d48/d66/fee 0 2023-12-05T09:26:26.891 INFO:tasks.workunit.client.1.smithi134.stdout:3/725: creat d4/d5/d6f/dc2/ddb/fe3 x:0 0 0 2023-12-05T09:26:26.892 INFO:tasks.workunit.client.1.smithi134.stdout:6/640: read d4/d39/f34 [1034996,84892] 0 2023-12-05T09:26:26.893 INFO:tasks.workunit.client.0.smithi067.stdout:2/446: dread d0/f8a [0,4194304] 0 2023-12-05T09:26:26.893 INFO:tasks.workunit.client.0.smithi067.stdout:2/447: read - d0/d2f/d39/f89 zero size 2023-12-05T09:26:26.893 INFO:tasks.workunit.client.0.smithi067.stdout:2/448: write d0/d25/d48/f6b [4625528,5200] 0 2023-12-05T09:26:26.893 INFO:tasks.workunit.client.0.smithi067.stdout:2/449: dread - d0/d25/d34/d4a/f8d zero size 2023-12-05T09:26:26.893 INFO:tasks.workunit.client.0.smithi067.stdout:2/450: chown d0/d25/d34/d4d/d54/d56 6 1 2023-12-05T09:26:26.894 INFO:tasks.workunit.client.0.smithi067.stdout:0/619: dwrite d3/d7/d3c/fa3 [0,4194304] 0 2023-12-05T09:26:26.898 INFO:tasks.workunit.client.1.smithi134.stdout:0/654: sync 2023-12-05T09:26:26.898 INFO:tasks.workunit.client.1.smithi134.stdout:0/655: write d13/d14/d30/d4b/d23/d77/f9b [281104,107485] 0 2023-12-05T09:26:26.898 INFO:tasks.workunit.client.1.smithi134.stdout:0/656: dread - d13/d14/d30/d4b/d66/da0/fa1 zero size 2023-12-05T09:26:26.898 INFO:tasks.workunit.client.1.smithi134.stdout:0/657: read - d13/d14/d15/d67/d73/f81 zero size 2023-12-05T09:26:26.898 INFO:tasks.workunit.client.1.smithi134.stdout:5/652: sync 2023-12-05T09:26:26.898 INFO:tasks.workunit.client.1.smithi134.stdout:5/653: readlink d0/d1a/d1c/l48 0 2023-12-05T09:26:26.898 INFO:tasks.workunit.client.1.smithi134.stdout:5/654: getdents d0/d1a/d1c/d3f/d81/db0/dbe 0 2023-12-05T09:26:26.900 INFO:tasks.workunit.client.0.smithi067.stdout:0/620: mkdir d3/d7/d3c/ddb/de5 0 2023-12-05T09:26:26.900 INFO:tasks.workunit.client.0.smithi067.stdout:0/621: creat d3/d7/d3c/d67/d59/d4e/db2/fe6 x:0 0 0 2023-12-05T09:26:26.904 INFO:tasks.workunit.client.0.smithi067.stdout:2/451: rename d0/d15 to d0/d25/d9d 0 2023-12-05T09:26:26.904 INFO:tasks.workunit.client.0.smithi067.stdout:2/452: chown d0/f41 2875 1 2023-12-05T09:26:26.904 INFO:tasks.workunit.client.1.smithi134.stdout:2/739: creat d19/d28/d2b/ff2 x:0 0 0 2023-12-05T09:26:26.905 INFO:tasks.workunit.client.1.smithi134.stdout:6/641: link d4/d39/d42/d4f/d6d/d3a/c7d d4/d39/d5c/cc1 0 2023-12-05T09:26:26.906 INFO:tasks.workunit.client.1.smithi134.stdout:4/677: link d16/d18/d1c/l1e d16/d21/d47/d4b/lef 0 2023-12-05T09:26:26.908 INFO:tasks.workunit.client.0.smithi067.stdout:2/453: unlink d0/d2f/d39/c49 0 2023-12-05T09:26:26.910 INFO:tasks.workunit.client.1.smithi134.stdout:5/655: rename d0/d1a/d1c/l48 to d0/d1a/le2 0 2023-12-05T09:26:26.910 INFO:tasks.workunit.client.1.smithi134.stdout:5/656: fdatasync d0/dd/d37/f53 0 2023-12-05T09:26:26.911 INFO:tasks.workunit.client.1.smithi134.stdout:2/740: mknod d19/d76/dba/ded/cf3 0 2023-12-05T09:26:26.912 INFO:tasks.workunit.client.0.smithi067.stdout:2/454: creat d0/d25/d9d/d53/d1e/d8e/f9e x:0 0 0 2023-12-05T09:26:26.915 INFO:tasks.workunit.client.1.smithi134.stdout:6/642: truncate d4/ff 1045439 0 2023-12-05T09:26:26.915 INFO:tasks.workunit.client.1.smithi134.stdout:6/643: chown d4/d78/d7a/f9b 5563 1 2023-12-05T09:26:26.915 INFO:tasks.workunit.client.1.smithi134.stdout:4/678: creat d16/d9c/ff0 x:0 0 0 2023-12-05T09:26:26.916 INFO:tasks.workunit.client.1.smithi134.stdout:6/644: creat d4/d39/d5c/fc2 x:0 0 0 2023-12-05T09:26:26.920 INFO:tasks.workunit.client.1.smithi134.stdout:5/657: truncate d0/d45/f57 4253033 0 2023-12-05T09:26:26.924 INFO:tasks.workunit.client.1.smithi134.stdout:5/658: link d0/d1a/d1c/cb9 d0/d1a/ce3 0 2023-12-05T09:26:26.925 INFO:tasks.workunit.client.1.smithi134.stdout:3/726: dread d4/d1f/fc7 [0,4194304] 0 2023-12-05T09:26:26.925 INFO:tasks.workunit.client.1.smithi134.stdout:3/727: fsync d4/d5/d6f/d97/dae/dc9/f70 0 2023-12-05T09:26:26.925 INFO:tasks.workunit.client.1.smithi134.stdout:3/728: stat d4/d5/d45/d60/d85/ca1 0 2023-12-05T09:26:26.927 INFO:tasks.workunit.client.1.smithi134.stdout:7/683: dread d2/d7/dc/d22/f3d [0,4194304] 0 2023-12-05T09:26:26.929 INFO:tasks.workunit.client.1.smithi134.stdout:3/729: link d4/d5/d6f/l90 d4/d5/d45/d86/db5/le4 0 2023-12-05T09:26:26.929 INFO:tasks.workunit.client.1.smithi134.stdout:7/684: mkdir d2/d7/d93/dcf/ddd 0 2023-12-05T09:26:26.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/730: rmdir d4/d5/d45/d60/d85 39 2023-12-05T09:26:26.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/731: write d4/d5/d6f/d97/fd7 [980332,30407] 0 2023-12-05T09:26:26.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/702: dwrite d7/d8/d14/fc7 [4194304,4194304] 0 2023-12-05T09:26:26.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/732: chown d4/d5/c14 21940296 1 2023-12-05T09:26:26.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/703: write f3 [9679588,31056] 0 2023-12-05T09:26:26.932 INFO:tasks.workunit.client.1.smithi134.stdout:8/810: dwrite da/de/f108 [0,4194304] 0 2023-12-05T09:26:26.932 INFO:tasks.workunit.client.1.smithi134.stdout:8/811: fdatasync da/de/d96/fa1 0 2023-12-05T09:26:26.933 INFO:tasks.workunit.client.1.smithi134.stdout:7/685: write d2/df/d2a/d63/f77 [36513,43407] 0 2023-12-05T09:26:26.933 INFO:tasks.workunit.client.1.smithi134.stdout:7/686: dread - d2/df/d2a/d63/f7f zero size 2023-12-05T09:26:26.933 INFO:tasks.workunit.client.1.smithi134.stdout:7/687: fdatasync d2/df/f9d 0 2023-12-05T09:26:26.937 INFO:tasks.workunit.client.1.smithi134.stdout:8/812: mknod da/de/d8a/c115 0 2023-12-05T09:26:26.937 INFO:tasks.workunit.client.1.smithi134.stdout:3/733: creat d4/d5/d45/d60/d85/fe5 x:0 0 0 2023-12-05T09:26:26.940 INFO:tasks.workunit.client.1.smithi134.stdout:5/659: dread d0/d1a/d1c/d3f/f41 [0,4194304] 0 2023-12-05T09:26:26.940 INFO:tasks.workunit.client.1.smithi134.stdout:7/688: rename d2/d7/dc/d22/fcb to d2/dd/fde 0 2023-12-05T09:26:26.940 INFO:tasks.workunit.client.1.smithi134.stdout:5/660: write d0/d11/f1e [2164537,112725] 0 2023-12-05T09:26:26.945 INFO:tasks.workunit.client.1.smithi134.stdout:8/813: creat da/de/d96/dc9/f116 x:0 0 0 2023-12-05T09:26:26.945 INFO:tasks.workunit.client.1.smithi134.stdout:3/734: symlink d4/d5/d45/d60/d85/d96/dde/le6 0 2023-12-05T09:26:26.945 INFO:tasks.workunit.client.1.smithi134.stdout:7/689: creat d2/d7/dc/d2e/fdf x:0 0 0 2023-12-05T09:26:26.945 INFO:tasks.workunit.client.1.smithi134.stdout:7/690: write d2/df/d2a/d63/f77 [774406,29855] 0 2023-12-05T09:26:26.946 INFO:tasks.workunit.client.1.smithi134.stdout:7/691: fdatasync d2/d7/dc/fc0 0 2023-12-05T09:26:26.949 INFO:tasks.workunit.client.1.smithi134.stdout:3/735: creat d4/d5/d45/d60/d85/dab/ddc/fe7 x:0 0 0 2023-12-05T09:26:26.950 INFO:tasks.workunit.client.1.smithi134.stdout:5/661: rename d0/d1a/d1c/cb8 to d0/d1a/d1c/d3f/d81/db0/ce4 0 2023-12-05T09:26:26.963 INFO:tasks.workunit.client.1.smithi134.stdout:4/679: dread d16/d21/d48/f34 [0,4194304] 0 2023-12-05T09:26:26.965 INFO:tasks.workunit.client.1.smithi134.stdout:4/680: creat d16/d7b/db6/dbc/ff1 x:0 0 0 2023-12-05T09:26:26.966 INFO:tasks.workunit.client.1.smithi134.stdout:1/820: dwrite d2/d9/d10/f67 [0,4194304] 0 2023-12-05T09:26:26.966 INFO:tasks.workunit.client.1.smithi134.stdout:1/821: write d2/d27/d9d/fed [238374,49145] 0 2023-12-05T09:26:26.967 INFO:tasks.workunit.client.0.smithi067.stdout:0/622: dwrite d3/d7/d30/f4a [0,4194304] 0 2023-12-05T09:26:26.967 INFO:tasks.workunit.client.1.smithi134.stdout:2/741: dwrite fa [0,4194304] 0 2023-12-05T09:26:26.968 INFO:tasks.workunit.client.1.smithi134.stdout:4/681: creat d16/d18/d1b/ff2 x:0 0 0 2023-12-05T09:26:26.968 INFO:tasks.workunit.client.1.smithi134.stdout:0/658: dwrite d13/d14/f87 [0,4194304] 0 2023-12-05T09:26:26.970 INFO:tasks.workunit.client.1.smithi134.stdout:7/692: write d2/dd/d1a/f23 [618696,121009] 0 2023-12-05T09:26:26.970 INFO:tasks.workunit.client.1.smithi134.stdout:5/662: dread d0/dd/d37/f9c [0,4194304] 0 2023-12-05T09:26:26.972 INFO:tasks.workunit.client.0.smithi067.stdout:0/623: truncate d3/d7/d3c/fa3 1548444 0 2023-12-05T09:26:26.975 INFO:tasks.workunit.client.1.smithi134.stdout:4/682: creat d16/d7b/dce/d6e/ff3 x:0 0 0 2023-12-05T09:26:26.976 INFO:tasks.workunit.client.1.smithi134.stdout:4/683: chown d16/d21/d48/d80/dae/d65/f72 1381 1 2023-12-05T09:26:26.976 INFO:tasks.workunit.client.1.smithi134.stdout:4/684: creat d16/d9c/ff4 x:0 0 0 2023-12-05T09:26:26.976 INFO:tasks.workunit.client.1.smithi134.stdout:1/822: dread d2/d9/d10/d94/fd9 [0,4194304] 0 2023-12-05T09:26:26.977 INFO:tasks.workunit.client.0.smithi067.stdout:0/624: rename d3/d7/d3c/d66/dbf/f52 to d3/d7/d3c/d66/fe7 0 2023-12-05T09:26:26.977 INFO:tasks.workunit.client.0.smithi067.stdout:0/625: write d3/f4 [1878492,50220] 0 2023-12-05T09:26:26.981 INFO:tasks.workunit.client.1.smithi134.stdout:6/645: fsync d4/d39/d5c/fc2 0 2023-12-05T09:26:26.981 INFO:tasks.workunit.client.1.smithi134.stdout:0/659: mknod d13/d14/d30/d4b/d66/da0/daf/dde/da9/ce1 0 2023-12-05T09:26:26.986 INFO:tasks.workunit.client.0.smithi067.stdout:0/626: rmdir d3/d6b 39 2023-12-05T09:26:26.987 INFO:tasks.workunit.client.0.smithi067.stdout:0/627: creat d3/d7/d3c/d67/d59/d4e/db2/fe8 x:0 0 0 2023-12-05T09:26:26.987 INFO:tasks.workunit.client.0.smithi067.stdout:0/628: read - d3/d7/d3c/d67/fcb zero size 2023-12-05T09:26:26.987 INFO:tasks.workunit.client.0.smithi067.stdout:0/629: fsync d3/d7/d3c/d66/dbf/d10/dd2/fb9 0 2023-12-05T09:26:26.987 INFO:tasks.workunit.client.0.smithi067.stdout:0/630: fsync d3/f1d 0 2023-12-05T09:26:26.988 INFO:tasks.workunit.client.1.smithi134.stdout:7/693: link d2/df/f9d d2/d7/fe0 0 2023-12-05T09:26:26.990 INFO:tasks.workunit.client.1.smithi134.stdout:5/663: creat d0/d1a/d1c/d3f/d81/fe5 x:0 0 0 2023-12-05T09:26:26.993 INFO:tasks.workunit.client.0.smithi067.stdout:0/631: creat d3/d7/d3c/d66/dbf/d10/dd2/dcf/fe9 x:0 0 0 2023-12-05T09:26:26.995 INFO:tasks.workunit.client.1.smithi134.stdout:4/685: symlink d16/d21/de5/lf5 0 2023-12-05T09:26:26.995 INFO:tasks.workunit.client.1.smithi134.stdout:2/742: rename d19/d49 to d19/d3a/df4 0 2023-12-05T09:26:26.997 INFO:tasks.workunit.client.1.smithi134.stdout:6/646: truncate d4/d78/d7a/f9b 2009421 0 2023-12-05T09:26:27.001 INFO:tasks.workunit.client.1.smithi134.stdout:0/660: creat d13/d14/d30/d4b/fe2 x:0 0 0 2023-12-05T09:26:27.004 INFO:tasks.workunit.client.1.smithi134.stdout:9/704: dwrite d7/d8/d14/d26/d7f/d92/f9d [4194304,4194304] 0 2023-12-05T09:26:27.004 INFO:tasks.workunit.client.1.smithi134.stdout:1/823: rename d2/d9/d10/d5b/d111 to d2/d9/d10/d30/d66/da9/d74/d125 0 2023-12-05T09:26:27.004 INFO:tasks.workunit.client.1.smithi134.stdout:1/824: chown d2/d9/f1b 651403610 1 2023-12-05T09:26:27.004 INFO:tasks.workunit.client.1.smithi134.stdout:8/814: dwrite da/de/d16/d33/fcd [0,4194304] 0 2023-12-05T09:26:27.004 INFO:tasks.workunit.client.1.smithi134.stdout:8/815: chown da/de/d8a/d42/d99/fb6 106451300 1 2023-12-05T09:26:27.005 INFO:tasks.workunit.client.1.smithi134.stdout:2/743: mknod d19/d76/da9/cf5 0 2023-12-05T09:26:27.005 INFO:tasks.workunit.client.0.smithi067.stdout:2/455: dwrite d0/d25/d9d/d53/d1e/f3e [0,4194304] 0 2023-12-05T09:26:27.005 INFO:tasks.workunit.client.1.smithi134.stdout:6/647: creat d4/d39/fc3 x:0 0 0 2023-12-05T09:26:27.005 INFO:tasks.workunit.client.1.smithi134.stdout:3/736: dwrite d4/f16 [0,4194304] 0 2023-12-05T09:26:27.013 INFO:tasks.workunit.client.1.smithi134.stdout:7/694: rename d2/d7/d2b/d2d/db3 to d2/df/d81/daf/de1 0 2023-12-05T09:26:27.014 INFO:tasks.workunit.client.1.smithi134.stdout:8/816: creat da/de/d11/d8b/d8c/d10b/f117 x:0 0 0 2023-12-05T09:26:27.014 INFO:tasks.workunit.client.1.smithi134.stdout:8/817: fdatasync da/de/d4d/f8d 0 2023-12-05T09:26:27.015 INFO:tasks.workunit.client.1.smithi134.stdout:2/744: mknod d19/d3f/dbf/cf6 0 2023-12-05T09:26:27.018 INFO:tasks.workunit.client.1.smithi134.stdout:6/648: mkdir d4/d39/d42/d4f/d6d/d9f/dc4 0 2023-12-05T09:26:27.020 INFO:tasks.workunit.client.1.smithi134.stdout:3/737: mkdir d4/d5/d6f/d97/dae/de8 0 2023-12-05T09:26:27.024 INFO:tasks.workunit.client.0.smithi067.stdout:0/632: dread d3/fb [0,4194304] 0 2023-12-05T09:26:27.024 INFO:tasks.workunit.client.0.smithi067.stdout:0/633: truncate d3/fd6 114049 0 2023-12-05T09:26:27.025 INFO:tasks.workunit.client.1.smithi134.stdout:9/705: dread d7/d8/d14/d26/f48 [0,4194304] 0 2023-12-05T09:26:27.025 INFO:tasks.workunit.client.1.smithi134.stdout:6/649: truncate d4/d32/f84 3750833 0 2023-12-05T09:26:27.027 INFO:tasks.workunit.client.0.smithi067.stdout:0/634: symlink d3/d7/d3c/d67/d59/lea 0 2023-12-05T09:26:27.027 INFO:tasks.workunit.client.0.smithi067.stdout:0/635: dread - d3/d7/d3c/d66/dbf/d10/dd2/dcf/fe9 zero size 2023-12-05T09:26:27.031 INFO:tasks.workunit.client.0.smithi067.stdout:0/636: mkdir d3/d7/d3c/d67/d59/deb 0 2023-12-05T09:26:27.034 INFO:tasks.workunit.client.1.smithi134.stdout:9/706: mknod d7/cef 0 2023-12-05T09:26:27.034 INFO:tasks.workunit.client.1.smithi134.stdout:9/707: truncate d7/d8/d16/f1f 1374875 0 2023-12-05T09:26:27.040 INFO:tasks.workunit.client.1.smithi134.stdout:8/818: dread da/de/d16/d33/fcd [0,4194304] 0 2023-12-05T09:26:27.045 INFO:tasks.workunit.client.1.smithi134.stdout:2/745: read d19/d28/d63/d70/f7d [1131490,49027] 0 2023-12-05T09:26:27.046 INFO:tasks.workunit.client.1.smithi134.stdout:2/746: mknod d19/d6d/cf7 0 2023-12-05T09:26:27.048 INFO:tasks.workunit.client.1.smithi134.stdout:2/747: truncate d19/d28/d63/f67 4162469 0 2023-12-05T09:26:27.050 INFO:tasks.workunit.client.1.smithi134.stdout:5/664: dwrite d0/d45/f64 [0,4194304] 0 2023-12-05T09:26:27.050 INFO:tasks.workunit.client.1.smithi134.stdout:5/665: dread - d0/d1a/d1c/d3f/d81/d8e/fd9 zero size 2023-12-05T09:26:27.052 INFO:tasks.workunit.client.1.smithi134.stdout:6/650: dread d4/d39/d42/d4f/d6d/d3a/f3d [0,4194304] 0 2023-12-05T09:26:27.056 INFO:tasks.workunit.client.1.smithi134.stdout:4/686: write d16/d7b/dce/d6e/daa/f79 [3205124,35260] 0 2023-12-05T09:26:27.067 INFO:tasks.workunit.client.1.smithi134.stdout:4/687: dread d16/d21/d47/f67 [0,4194304] 0 2023-12-05T09:26:27.074 INFO:tasks.workunit.client.1.smithi134.stdout:4/688: rename d16/d18/d1c to d16/d18/dc5/dc2/df6 0 2023-12-05T09:26:27.087 INFO:tasks.workunit.client.1.smithi134.stdout:6/651: write d4/d39/d42/d4f/d6d/d45/f9c [730729,10735] 0 2023-12-05T09:26:27.090 INFO:tasks.workunit.client.1.smithi134.stdout:3/738: dread d4/d1f/f3a [0,4194304] 0 2023-12-05T09:26:27.091 INFO:tasks.workunit.client.1.smithi134.stdout:3/739: write d4/fbd [617817,58817] 0 2023-12-05T09:26:27.091 INFO:tasks.workunit.client.1.smithi134.stdout:3/740: read d4/d5/f1e [1851044,84663] 0 2023-12-05T09:26:27.097 INFO:tasks.workunit.client.1.smithi134.stdout:0/661: dwrite d13/d14/d15/d2a/f49 [0,4194304] 0 2023-12-05T09:26:27.097 INFO:tasks.workunit.client.1.smithi134.stdout:3/741: symlink d4/d1f/d4e/d6a/le9 0 2023-12-05T09:26:27.097 INFO:tasks.workunit.client.1.smithi134.stdout:3/742: symlink d4/d5/d45/d86/db5/dc3/lea 0 2023-12-05T09:26:27.097 INFO:tasks.workunit.client.1.smithi134.stdout:3/743: fsync d4/d5/d45/f5b 0 2023-12-05T09:26:27.098 INFO:tasks.workunit.client.1.smithi134.stdout:3/744: mknod d4/d1f/ceb 0 2023-12-05T09:26:27.099 INFO:tasks.workunit.client.1.smithi134.stdout:3/745: readlink d4/d1f/d4e/lc0 0 2023-12-05T09:26:27.101 INFO:tasks.workunit.client.1.smithi134.stdout:7/695: read d2/d7/dc/d2e/d3a/f5e [805023,73610] 0 2023-12-05T09:26:27.103 INFO:tasks.workunit.client.0.smithi067.stdout:2/456: dwrite d0/d25/d3a/f5f [0,4194304] 0 2023-12-05T09:26:27.106 INFO:tasks.workunit.client.0.smithi067.stdout:2/457: mknod d0/d25/d9d/d53/d1e/d7f/c9f 0 2023-12-05T09:26:27.106 INFO:tasks.workunit.client.0.smithi067.stdout:2/458: readlink d0/lb 0 2023-12-05T09:26:27.106 INFO:tasks.workunit.client.0.smithi067.stdout:2/459: chown d0/d25/d34/d4d/d54/c5e 1082958797 1 2023-12-05T09:26:27.110 INFO:tasks.workunit.client.1.smithi134.stdout:9/708: dwrite d7/d8/d14/f25 [4194304,4194304] 0 2023-12-05T09:26:27.112 INFO:tasks.workunit.client.1.smithi134.stdout:9/709: mkdir d7/d8/d16/d52/d74/d97/df0 0 2023-12-05T09:26:27.113 INFO:tasks.workunit.client.1.smithi134.stdout:8/819: dwrite da/de/d96/dc9/f116 [0,4194304] 0 2023-12-05T09:26:27.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/421: sync 2023-12-05T09:26:27.115 INFO:tasks.workunit.client.0.smithi067.stdout:8/451: sync 2023-12-05T09:26:27.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/422: creat da/d10/d1e/d17/d2f/d72/f97 x:0 0 0 2023-12-05T09:26:27.116 INFO:tasks.workunit.client.1.smithi134.stdout:8/820: link da/de/fb7 da/de/d4d/f118 0 2023-12-05T09:26:27.116 INFO:tasks.workunit.client.1.smithi134.stdout:1/825: dwrite d2/d9/d10/d30/d66/da9/feb [0,4194304] 0 2023-12-05T09:26:27.118 INFO:tasks.workunit.client.1.smithi134.stdout:9/710: mkdir d7/d8/d14/d26/d5a/df1 0 2023-12-05T09:26:27.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/411: sync 2023-12-05T09:26:27.122 INFO:tasks.workunit.client.0.smithi067.stdout:6/423: mknod da/d10/d1e/d17/d2f/d2c/d34/c98 0 2023-12-05T09:26:27.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/826: rename d2/d9/d10/d30/d4a/d81 to d2/d9/d10/d5b/d126 0 2023-12-05T09:26:27.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/827: readlink d2/d9/d10/d30/d66/da9/d74/l98 0 2023-12-05T09:26:27.129 INFO:tasks.workunit.client.1.smithi134.stdout:9/711: rmdir d7/d5b 39 2023-12-05T09:26:27.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/828: rmdir d2/d9/d10/d94/de5 39 2023-12-05T09:26:27.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/829: readlink d2/d9/d10/l12 0 2023-12-05T09:26:27.163 INFO:tasks.workunit.client.0.smithi067.stdout:4/412: write d0/f41 [1236923,86870] 0 2023-12-05T09:26:27.164 INFO:tasks.workunit.client.0.smithi067.stdout:0/637: dwrite d3/d7/d30/f8c [0,4194304] 0 2023-12-05T09:26:27.164 INFO:tasks.workunit.client.0.smithi067.stdout:0/638: chown d3/d6b/d6e/cc9 5197 1 2023-12-05T09:26:27.164 INFO:tasks.workunit.client.0.smithi067.stdout:8/452: read d5/dc/d6e/f78 [3414308,31850] 0 2023-12-05T09:26:27.165 INFO:tasks.workunit.client.0.smithi067.stdout:4/413: mknod d0/d1d/d53/d62/c90 0 2023-12-05T09:26:27.165 INFO:tasks.workunit.client.0.smithi067.stdout:4/414: chown d0/d1d/d2b/d50/d15/l3b 400429588 1 2023-12-05T09:26:27.165 INFO:tasks.workunit.client.0.smithi067.stdout:0/639: stat d3/d7/d3c/f75 0 2023-12-05T09:26:27.168 INFO:tasks.workunit.client.0.smithi067.stdout:0/640: read d3/d7/fc [4210795,31428] 0 2023-12-05T09:26:27.169 INFO:tasks.workunit.client.0.smithi067.stdout:4/415: creat d0/d9/f91 x:0 0 0 2023-12-05T09:26:27.169 INFO:tasks.workunit.client.0.smithi067.stdout:4/416: chown d0/d1d/d53 255729 1 2023-12-05T09:26:27.171 INFO:tasks.workunit.client.0.smithi067.stdout:6/424: dread da/d10/d1e/f36 [0,4194304] 0 2023-12-05T09:26:27.173 INFO:tasks.workunit.client.1.smithi134.stdout:2/748: dwrite d19/d28/d31/d38/d98/fd1 [0,4194304] 0 2023-12-05T09:26:27.173 INFO:tasks.workunit.client.1.smithi134.stdout:2/749: fdatasync d19/d28/f81 0 2023-12-05T09:26:27.174 INFO:tasks.workunit.client.1.smithi134.stdout:3/746: dread d4/d1f/f28 [0,4194304] 0 2023-12-05T09:26:27.174 INFO:tasks.workunit.client.1.smithi134.stdout:2/750: creat d19/d3a/ff8 x:0 0 0 2023-12-05T09:26:27.174 INFO:tasks.workunit.client.1.smithi134.stdout:2/751: write d19/f2c [2782883,88526] 0 2023-12-05T09:26:27.174 INFO:tasks.workunit.client.1.smithi134.stdout:2/752: creat d19/d5f/ff9 x:0 0 0 2023-12-05T09:26:27.174 INFO:tasks.workunit.client.1.smithi134.stdout:5/666: dwrite d0/d1a/d1c/d25/d4d/d97/fa0 [0,4194304] 0 2023-12-05T09:26:27.174 INFO:tasks.workunit.client.1.smithi134.stdout:6/652: dwrite d4/d39/f53 [0,4194304] 0 2023-12-05T09:26:27.174 INFO:tasks.workunit.client.1.smithi134.stdout:6/653: write d4/d39/d42/f4d [210201,19771] 0 2023-12-05T09:26:27.174 INFO:tasks.workunit.client.1.smithi134.stdout:5/667: write d0/d1a/d1c/d3f/d81/d8e/fd9 [165812,110462] 0 2023-12-05T09:26:27.175 INFO:tasks.workunit.client.0.smithi067.stdout:4/417: symlink d0/d1d/d2a/l92 0 2023-12-05T09:26:27.179 INFO:tasks.workunit.client.1.smithi134.stdout:4/689: dwrite d16/d21/f62 [0,4194304] 0 2023-12-05T09:26:27.181 INFO:tasks.workunit.client.0.smithi067.stdout:0/641: rename d3/d7/d3c/d66/dbf to d3/d7/d3c/d6c/d76/da7/dec 0 2023-12-05T09:26:27.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/642: mknod d3/d7/d3c/d67/d59/d4e/db2/ced 0 2023-12-05T09:26:27.186 INFO:tasks.workunit.client.0.smithi067.stdout:0/643: truncate d3/d7/d3c/d67/d59/fe1 241652 0 2023-12-05T09:26:27.187 INFO:tasks.workunit.client.1.smithi134.stdout:3/747: mkdir d4/dec 0 2023-12-05T09:26:27.194 INFO:tasks.workunit.client.1.smithi134.stdout:2/753: creat d19/d28/db1/ffa x:0 0 0 2023-12-05T09:26:27.194 INFO:tasks.workunit.client.1.smithi134.stdout:2/754: truncate d19/d28/d31/d38/fa2 27903 0 2023-12-05T09:26:27.194 INFO:tasks.workunit.client.1.smithi134.stdout:2/755: stat d19/d3a/df4/c51 0 2023-12-05T09:26:27.194 INFO:tasks.workunit.client.1.smithi134.stdout:2/756: chown d19/d3a/df4/f56 2973 1 2023-12-05T09:26:27.195 INFO:tasks.workunit.client.0.smithi067.stdout:8/453: dread d5/f28 [0,4194304] 0 2023-12-05T09:26:27.196 INFO:tasks.workunit.client.1.smithi134.stdout:7/696: dwrite d2/d7/d65/f92 [0,4194304] 0 2023-12-05T09:26:27.196 INFO:tasks.workunit.client.1.smithi134.stdout:0/662: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/f47 [0,4194304] 0 2023-12-05T09:26:27.196 INFO:tasks.workunit.client.1.smithi134.stdout:0/663: write d13/d14/d15/d2a/f58 [415796,129125] 0 2023-12-05T09:26:27.199 INFO:tasks.workunit.client.1.smithi134.stdout:8/821: dwrite da/de/d43/fa3 [4194304,4194304] 0 2023-12-05T09:26:27.205 INFO:tasks.workunit.client.1.smithi134.stdout:1/830: dread d2/d27/d9d/fed [0,4194304] 0 2023-12-05T09:26:27.205 INFO:tasks.workunit.client.1.smithi134.stdout:1/831: stat d2/d27/d40/f10c 0 2023-12-05T09:26:27.205 INFO:tasks.workunit.client.0.smithi067.stdout:8/454: mkdir d5/da/d30/d7c 0 2023-12-05T09:26:27.210 INFO:tasks.workunit.client.1.smithi134.stdout:6/654: rename d4/d32/l88 to d4/d39/d42/d4f/d6d/d3a/d75/d59/lc5 0 2023-12-05T09:26:27.212 INFO:tasks.workunit.client.1.smithi134.stdout:3/748: dread d4/f34 [0,4194304] 0 2023-12-05T09:26:27.215 INFO:tasks.workunit.client.1.smithi134.stdout:7/697: unlink d2/d8f/ca2 0 2023-12-05T09:26:27.215 INFO:tasks.workunit.client.1.smithi134.stdout:7/698: write d2/d7/d2b/d94/fb2 [1446905,36704] 0 2023-12-05T09:26:27.218 INFO:tasks.workunit.client.1.smithi134.stdout:0/664: getdents d13/d14/d30/d4b/d66/da0/daf/dce 0 2023-12-05T09:26:27.219 INFO:tasks.workunit.client.1.smithi134.stdout:5/668: link d0/d66/fb1 d0/d11/d5c/fe6 0 2023-12-05T09:26:27.219 INFO:tasks.workunit.client.1.smithi134.stdout:5/669: dread - d0/d1a/d1c/d3f/d5b/d5d/d78/fd7 zero size 2023-12-05T09:26:27.219 INFO:tasks.workunit.client.1.smithi134.stdout:5/670: read d0/d11/f15 [694573,46795] 0 2023-12-05T09:26:27.231 INFO:tasks.workunit.client.1.smithi134.stdout:0/665: dread f7 [0,4194304] 0 2023-12-05T09:26:27.254 INFO:tasks.workunit.client.1.smithi134.stdout:8/822: mkdir da/de/d11/d1d/d5f/dea/d119 0 2023-12-05T09:26:27.258 INFO:tasks.workunit.client.0.smithi067.stdout:6/425: dwrite da/d10/d1e/d17/f23 [4194304,4194304] 0 2023-12-05T09:26:27.259 INFO:tasks.workunit.client.0.smithi067.stdout:6/426: write da/d10/d1e/d17/d2f/d2c/d34/f3e [197022,7263] 0 2023-12-05T09:26:27.259 INFO:tasks.workunit.client.0.smithi067.stdout:8/455: dwrite d5/f40 [0,4194304] 0 2023-12-05T09:26:27.260 INFO:tasks.workunit.client.1.smithi134.stdout:1/832: unlink d2/d27/db4/fcf 0 2023-12-05T09:26:27.260 INFO:tasks.workunit.client.1.smithi134.stdout:4/690: dwrite d16/d21/d47/d4b/fe3 [0,4194304] 0 2023-12-05T09:26:27.261 INFO:tasks.workunit.client.1.smithi134.stdout:4/691: write d16/d21/d47/fe9 [457524,25343] 0 2023-12-05T09:26:27.261 INFO:tasks.workunit.client.1.smithi134.stdout:4/692: chown d16/d7b/dce/fc4 20 1 2023-12-05T09:26:27.261 INFO:tasks.workunit.client.1.smithi134.stdout:2/757: rename d19/d28/c89 to d19/d28/d2b/cfb 0 2023-12-05T09:26:27.261 INFO:tasks.workunit.client.1.smithi134.stdout:2/758: write d19/d5f/f93 [1295588,30686] 0 2023-12-05T09:26:27.261 INFO:tasks.workunit.client.1.smithi134.stdout:6/655: link d4/d39/d42/d4f/d6d/d3a/d80/f87 d4/d39/d42/d4f/d6d/d9f/fc6 0 2023-12-05T09:26:27.261 INFO:tasks.workunit.client.1.smithi134.stdout:3/749: mknod d4/d5/d6f/d97/ced 0 2023-12-05T09:26:27.261 INFO:tasks.workunit.client.1.smithi134.stdout:3/750: fsync d4/d1f/d4e/f59 0 2023-12-05T09:26:27.263 INFO:tasks.workunit.client.0.smithi067.stdout:4/418: dwrite d0/d1d/d24/f66 [0,4194304] 0 2023-12-05T09:26:27.263 INFO:tasks.workunit.client.0.smithi067.stdout:0/644: dwrite d3/d7/d3c/d6c/d8a/fce [0,4194304] 0 2023-12-05T09:26:27.266 INFO:tasks.workunit.client.0.smithi067.stdout:4/419: dread d0/d1d/d25/d2c/d34/f86 [0,4194304] 0 2023-12-05T09:26:27.266 INFO:tasks.workunit.client.0.smithi067.stdout:6/427: rename da/d10/d1e/d17/c95 to da/d10/d1e/d17/d2f/d5f/c99 0 2023-12-05T09:26:27.267 INFO:tasks.workunit.client.0.smithi067.stdout:6/428: fdatasync da/d10/d1e/d17/f23 0 2023-12-05T09:26:27.268 INFO:tasks.workunit.client.0.smithi067.stdout:6/429: chown da/d10/d1e/d17/d2f/d1f/d27/d4f/d87 1972259 1 2023-12-05T09:26:27.268 INFO:tasks.workunit.client.0.smithi067.stdout:4/420: truncate d0/d9/f2f 1960692 0 2023-12-05T09:26:27.268 INFO:tasks.workunit.client.0.smithi067.stdout:6/430: fsync da/d10/d1e/d17/d2f/d2c/d34/f58 0 2023-12-05T09:26:27.268 INFO:tasks.workunit.client.0.smithi067.stdout:4/421: fdatasync d0/d1d/f7b 0 2023-12-05T09:26:27.268 INFO:tasks.workunit.client.0.smithi067.stdout:6/431: fdatasync da/d10/d1e/d51/f65 0 2023-12-05T09:26:27.269 INFO:tasks.workunit.client.0.smithi067.stdout:4/422: write d0/d1d/d25/d2c/f3a [18783,68780] 0 2023-12-05T09:26:27.269 INFO:tasks.workunit.client.0.smithi067.stdout:6/432: fdatasync da/d10/d1e/d69/f93 0 2023-12-05T09:26:27.274 INFO:tasks.workunit.client.1.smithi134.stdout:8/823: creat da/de/d8a/d42/d99/f11a x:0 0 0 2023-12-05T09:26:27.274 INFO:tasks.workunit.client.1.smithi134.stdout:8/824: fdatasync da/de/d16/d33/f56 0 2023-12-05T09:26:27.281 INFO:tasks.workunit.client.1.smithi134.stdout:1/833: dread d2/d27/d40/f5d [0,4194304] 0 2023-12-05T09:26:27.286 INFO:tasks.workunit.client.1.smithi134.stdout:5/671: dwrite d0/d50/fad [0,4194304] 0 2023-12-05T09:26:27.287 INFO:tasks.workunit.client.1.smithi134.stdout:4/693: dread d16/d21/f57 [0,4194304] 0 2023-12-05T09:26:27.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/672: write d0/d1a/d1c/d25/d6a/f95 [518699,120421] 0 2023-12-05T09:26:27.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/673: chown d0/d1a/d1c/d3f/d5b/d5d/fd2 12 1 2023-12-05T09:26:27.287 INFO:tasks.workunit.client.1.smithi134.stdout:4/694: write d16/d21/d48/d66/fdf [420272,73893] 0 2023-12-05T09:26:27.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/674: write d0/f33 [5101656,68596] 0 2023-12-05T09:26:27.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/675: chown d0/d1a/d1c/d25/d4d/d97/lbb 23367490 1 2023-12-05T09:26:27.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/676: chown d0/d1a/d1c/d3f/d5b/l88 158035320 1 2023-12-05T09:26:27.294 INFO:tasks.workunit.client.1.smithi134.stdout:2/759: creat d19/d3a/df4/ffc x:0 0 0 2023-12-05T09:26:27.294 INFO:tasks.workunit.client.1.smithi134.stdout:2/760: chown d19/d3a/df4/fe3 301691 1 2023-12-05T09:26:27.298 INFO:tasks.workunit.client.1.smithi134.stdout:3/751: dwrite d4/d1f/d50/d52/fbe [0,4194304] 0 2023-12-05T09:26:27.300 INFO:tasks.workunit.client.1.smithi134.stdout:6/656: mkdir d4/d39/d42/d4f/d6d/d9f/dc4/dc7 0 2023-12-05T09:26:27.304 INFO:tasks.workunit.client.1.smithi134.stdout:0/666: dwrite f7 [0,4194304] 0 2023-12-05T09:26:27.312 INFO:tasks.workunit.client.1.smithi134.stdout:5/677: symlink d0/dd/d37/d90/d9d/de0/le7 0 2023-12-05T09:26:27.319 INFO:tasks.workunit.client.1.smithi134.stdout:3/752: symlink d4/d5/d45/d86/db5/dcf/lee 0 2023-12-05T09:26:27.320 INFO:tasks.workunit.client.0.smithi067.stdout:6/433: symlink da/d10/d1e/d17/d2f/d47/d19/l9a 0 2023-12-05T09:26:27.320 INFO:tasks.workunit.client.0.smithi067.stdout:4/423: mkdir d0/d1d/d2a/d93 0 2023-12-05T09:26:27.321 INFO:tasks.workunit.client.1.smithi134.stdout:0/667: symlink d13/d14/d30/d4b/d66/da0/daf/dde/da9/le3 0 2023-12-05T09:26:27.323 INFO:tasks.workunit.client.1.smithi134.stdout:6/657: symlink d4/d39/d42/d4f/d6d/d9f/dc4/dc7/lc8 0 2023-12-05T09:26:27.325 INFO:tasks.workunit.client.1.smithi134.stdout:5/678: symlink d0/dd/le8 0 2023-12-05T09:26:27.325 INFO:tasks.workunit.client.1.smithi134.stdout:0/668: getdents d13/d14/d30/d4b/d66/da0 0 2023-12-05T09:26:27.325 INFO:tasks.workunit.client.1.smithi134.stdout:0/669: getdents d13/d14/d30/d4b/d66/da0/da2 0 2023-12-05T09:26:27.330 INFO:tasks.workunit.client.1.smithi134.stdout:6/658: rename d4/d39/d42/d4f/d6d/f43 to d4/d39/d42/d4f/d6d/d3a/da/fc9 0 2023-12-05T09:26:27.330 INFO:tasks.workunit.client.1.smithi134.stdout:6/659: fdatasync d4/d39/d42/d4f/d8a/f99 0 2023-12-05T09:26:27.332 INFO:tasks.workunit.client.1.smithi134.stdout:6/660: read d4/d39/d42/d4f/d6d/d3a/d75/f29 [5439526,81071] 0 2023-12-05T09:26:27.334 INFO:tasks.workunit.client.1.smithi134.stdout:6/661: creat d4/d39/fca x:0 0 0 2023-12-05T09:26:27.334 INFO:tasks.workunit.client.1.smithi134.stdout:6/662: read d4/d39/d42/d4f/d6d/d45/f95 [570386,98492] 0 2023-12-05T09:26:27.336 INFO:tasks.workunit.client.1.smithi134.stdout:6/663: truncate d4/d39/d42/d4f/d6d/d3a/f54 2277856 0 2023-12-05T09:26:27.339 INFO:tasks.workunit.client.1.smithi134.stdout:1/834: dwrite d2/d9/d10/d5b/d126/f97 [0,4194304] 0 2023-12-05T09:26:27.339 INFO:tasks.workunit.client.1.smithi134.stdout:1/835: fsync d2/d9/f44 0 2023-12-05T09:26:27.341 INFO:tasks.workunit.client.1.smithi134.stdout:6/664: link d4/d39/d42/d4f/d6d/d3a/d75/d59/c5a d4/d78/d7a/daa/dba/ccb 0 2023-12-05T09:26:27.342 INFO:tasks.workunit.client.1.smithi134.stdout:3/753: write d4/d1f/f3a [592515,87231] 0 2023-12-05T09:26:27.345 INFO:tasks.workunit.client.0.smithi067.stdout:6/434: creat da/d10/d1e/d17/d2f/d3f/d92/f9b x:0 0 0 2023-12-05T09:26:27.347 INFO:tasks.workunit.client.0.smithi067.stdout:1/510: sync 2023-12-05T09:26:27.349 INFO:tasks.workunit.client.1.smithi134.stdout:1/836: rename d2/l34 to d2/d9/d8d/da2/db1/l127 0 2023-12-05T09:26:27.349 INFO:tasks.workunit.client.1.smithi134.stdout:1/837: fsync d2/d9/d10/d30/d4a/f9a 0 2023-12-05T09:26:27.350 INFO:tasks.workunit.client.1.smithi134.stdout:6/665: link d4/ff d4/d39/d42/d4f/d8a/fcc 0 2023-12-05T09:26:27.351 INFO:tasks.workunit.client.1.smithi134.stdout:0/670: write d13/f38 [912945,76902] 0 2023-12-05T09:26:27.353 INFO:tasks.workunit.client.0.smithi067.stdout:6/435: rename da/d10/d1e/d17/d2f/d47/d80/f8e to da/d10/d1e/d17/d2f/d47/d79/f9c 0 2023-12-05T09:26:27.353 INFO:tasks.workunit.client.0.smithi067.stdout:6/436: stat da/d10/d1e/d17/d2f/d47/d19/l9a 0 2023-12-05T09:26:27.354 INFO:tasks.workunit.client.1.smithi134.stdout:1/838: symlink d2/d27/d40/l128 0 2023-12-05T09:26:27.354 INFO:tasks.workunit.client.1.smithi134.stdout:0/671: mkdir d13/d14/d15/d93/de4 0 2023-12-05T09:26:27.355 INFO:tasks.workunit.client.1.smithi134.stdout:1/839: fdatasync d2/d9/d10/d30/d4a/fe4 0 2023-12-05T09:26:27.358 INFO:tasks.workunit.client.1.smithi134.stdout:0/672: rename d13/d14/d15/d93/cca to d13/d14/d15/d2a/ce5 0 2023-12-05T09:26:27.359 INFO:tasks.workunit.client.0.smithi067.stdout:1/511: creat d2/d3/da6/dbb/fbc x:0 0 0 2023-12-05T09:26:27.361 INFO:tasks.workunit.client.1.smithi134.stdout:1/840: rename d2/d9/d10/d30/d4a/lc3 to d2/d27/d40/d10a/l129 0 2023-12-05T09:26:27.361 INFO:tasks.workunit.client.1.smithi134.stdout:1/841: fdatasync d2/d9/d10/d30/d66/da9/d74/f11f 0 2023-12-05T09:26:27.361 INFO:tasks.workunit.client.1.smithi134.stdout:1/842: dread - d2/d9/d10/d30/d66/de3/ff6 zero size 2023-12-05T09:26:27.361 INFO:tasks.workunit.client.0.smithi067.stdout:8/456: dwrite d5/f6b [0,4194304] 0 2023-12-05T09:26:27.364 INFO:tasks.workunit.client.0.smithi067.stdout:8/457: write d5/dc/d6e/f76 [283089,12782] 0 2023-12-05T09:26:27.364 INFO:tasks.workunit.client.0.smithi067.stdout:8/458: fsync d5/f1c 0 2023-12-05T09:26:27.364 INFO:tasks.workunit.client.0.smithi067.stdout:8/459: write d5/dc/d6e/f78 [4840418,12951] 0 2023-12-05T09:26:27.364 INFO:tasks.workunit.client.0.smithi067.stdout:1/512: mkdir d2/d3/da6/dbd 0 2023-12-05T09:26:27.364 INFO:tasks.workunit.client.1.smithi134.stdout:0/673: write d13/d14/d30/d4b/d66/da0/daf/dce/fb9 [53443,108617] 0 2023-12-05T09:26:27.365 INFO:tasks.workunit.client.1.smithi134.stdout:0/674: fsync f3 0 2023-12-05T09:26:27.367 INFO:tasks.workunit.client.1.smithi134.stdout:8/825: dwrite da/de/f7a [0,4194304] 0 2023-12-05T09:26:27.369 INFO:tasks.workunit.client.1.smithi134.stdout:7/699: sync 2023-12-05T09:26:27.369 INFO:tasks.workunit.client.1.smithi134.stdout:9/712: sync 2023-12-05T09:26:27.369 INFO:tasks.workunit.client.1.smithi134.stdout:7/700: read - d2/d7/d6f/da0/fd8 zero size 2023-12-05T09:26:27.377 INFO:tasks.workunit.client.1.smithi134.stdout:0/675: symlink d13/d14/d30/d4b/d66/da0/daf/dde/d9d/da5/le6 0 2023-12-05T09:26:27.377 INFO:tasks.workunit.client.0.smithi067.stdout:0/645: dwrite d3/f1d [8388608,4194304] 0 2023-12-05T09:26:27.378 INFO:tasks.workunit.client.0.smithi067.stdout:0/646: chown d3/d7/d3c/d6c/d76/da7/dec/d10/caa 5108 1 2023-12-05T09:26:27.379 INFO:tasks.workunit.client.0.smithi067.stdout:0/647: fsync d3/d7/d3c/d6c/d76/da7/dec/d10/dd2/d99/fc5 0 2023-12-05T09:26:27.379 INFO:tasks.workunit.client.0.smithi067.stdout:0/648: fdatasync d3/d6b/d6e/f72 0 2023-12-05T09:26:27.379 INFO:tasks.workunit.client.0.smithi067.stdout:1/513: rename d2/d4f/ca2 to d2/d5/d7/de/cbe 0 2023-12-05T09:26:27.386 INFO:tasks.workunit.client.1.smithi134.stdout:9/713: mknod d7/d8/d16/d52/cf2 0 2023-12-05T09:26:27.387 INFO:tasks.workunit.client.1.smithi134.stdout:2/761: dwrite f18 [0,4194304] 0 2023-12-05T09:26:27.387 INFO:tasks.workunit.client.1.smithi134.stdout:2/762: chown d19/d5f/ff9 7 1 2023-12-05T09:26:27.387 INFO:tasks.workunit.client.1.smithi134.stdout:2/763: stat d19/d28/d9e/dcd 0 2023-12-05T09:26:27.388 INFO:tasks.workunit.client.1.smithi134.stdout:7/701: getdents d2/d7/d2b/d2d/d67 0 2023-12-05T09:26:27.390 INFO:tasks.workunit.client.1.smithi134.stdout:4/695: dwrite d16/d21/d47/d4b/fd0 [0,4194304] 0 2023-12-05T09:26:27.405 INFO:tasks.workunit.client.1.smithi134.stdout:1/843: dread d2/d9/d10/d5b/d126/f8e [0,4194304] 0 2023-12-05T09:26:27.405 INFO:tasks.workunit.client.1.smithi134.stdout:3/754: dwrite d4/d5/d45/d86/fb8 [0,4194304] 0 2023-12-05T09:26:27.405 INFO:tasks.workunit.client.1.smithi134.stdout:3/755: chown d4/d5/c87 4904488 1 2023-12-05T09:26:27.405 INFO:tasks.workunit.client.1.smithi134.stdout:3/756: creat d4/d5/d45/d60/d85/dab/ddc/fef x:0 0 0 2023-12-05T09:26:27.405 INFO:tasks.workunit.client.1.smithi134.stdout:9/714: creat d7/d8/d16/d52/ff3 x:0 0 0 2023-12-05T09:26:27.405 INFO:tasks.workunit.client.1.smithi134.stdout:9/715: fsync d7/f1c 0 2023-12-05T09:26:27.405 INFO:tasks.workunit.client.1.smithi134.stdout:7/702: readlink d2/d7/dc/d22/l99 0 2023-12-05T09:26:27.406 INFO:tasks.workunit.client.1.smithi134.stdout:4/696: symlink d16/d18/d1b/lf7 0 2023-12-05T09:26:27.407 INFO:tasks.workunit.client.0.smithi067.stdout:4/424: dwrite d0/d1d/f21 [0,4194304] 0 2023-12-05T09:26:27.407 INFO:tasks.workunit.client.0.smithi067.stdout:4/425: stat d0/d1d/d53/c74 0 2023-12-05T09:26:27.407 INFO:tasks.workunit.client.0.smithi067.stdout:4/426: readlink d0/d1d/d2b/d50/d15/l3b 0 2023-12-05T09:26:27.407 INFO:tasks.workunit.client.0.smithi067.stdout:4/427: fdatasync d0/d9/f85 0 2023-12-05T09:26:27.408 INFO:tasks.workunit.client.1.smithi134.stdout:6/666: dwrite d4/d39/d42/d4f/d6d/d3a/f54 [0,4194304] 0 2023-12-05T09:26:27.409 INFO:tasks.workunit.client.1.smithi134.stdout:0/676: dread d13/d14/d30/d4b/f42 [0,4194304] 0 2023-12-05T09:26:27.419 INFO:tasks.workunit.client.1.smithi134.stdout:8/826: dwrite da/de/d16/f26 [4194304,4194304] 0 2023-12-05T09:26:27.422 INFO:tasks.workunit.client.0.smithi067.stdout:4/428: rename d0/d9/c22 to d0/d1d/d2a/d93/c94 0 2023-12-05T09:26:27.422 INFO:tasks.workunit.client.0.smithi067.stdout:4/429: chown d0/d1d/c31 0 1 2023-12-05T09:26:27.423 INFO:tasks.workunit.client.1.smithi134.stdout:1/844: symlink d2/d9/d10/d30/dfe/l12a 0 2023-12-05T09:26:27.426 INFO:tasks.workunit.client.0.smithi067.stdout:0/649: mkdir d3/d7/d3c/d6c/d76/da7/dec/dee 0 2023-12-05T09:26:27.426 INFO:tasks.workunit.client.0.smithi067.stdout:0/650: fsync d3/f58 0 2023-12-05T09:26:27.430 INFO:tasks.workunit.client.0.smithi067.stdout:4/430: mknod d0/d1d/d53/c95 0 2023-12-05T09:26:27.431 INFO:tasks.workunit.client.0.smithi067.stdout:0/651: truncate d3/d7/d30/f8c 654862 0 2023-12-05T09:26:27.431 INFO:tasks.workunit.client.0.smithi067.stdout:0/652: chown d3/d7/c3a 1943442 1 2023-12-05T09:26:27.433 INFO:tasks.workunit.client.1.smithi134.stdout:9/716: rename d7/d8/d14/d26/c7e to d7/d8/d14/d26/d7f/d92/cf4 0 2023-12-05T09:26:27.433 INFO:tasks.workunit.client.1.smithi134.stdout:9/717: stat d7/d8/d14/d26/d5a/fb2 0 2023-12-05T09:26:27.433 INFO:tasks.workunit.client.1.smithi134.stdout:9/718: fsync d7/d8/d14/d26/d5a/d69/fa0 0 2023-12-05T09:26:27.433 INFO:tasks.workunit.client.1.smithi134.stdout:9/719: write d7/d8/d14/d26/d7f/dab/fc9 [265074,74115] 0 2023-12-05T09:26:27.434 INFO:tasks.workunit.client.1.smithi134.stdout:7/703: creat d2/d7/dc/d2e/d3a/fe2 x:0 0 0 2023-12-05T09:26:27.434 INFO:tasks.workunit.client.0.smithi067.stdout:8/460: dwrite d5/da/d30/d61/f7b [0,4194304] 0 2023-12-05T09:26:27.435 INFO:tasks.workunit.client.0.smithi067.stdout:5/520: sync 2023-12-05T09:26:27.435 INFO:tasks.workunit.client.0.smithi067.stdout:7/468: sync 2023-12-05T09:26:27.435 INFO:tasks.workunit.client.0.smithi067.stdout:2/460: sync 2023-12-05T09:26:27.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/514: dwrite d2/d4f/d15/d60/d68/f75 [0,4194304] 0 2023-12-05T09:26:27.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/515: creat d2/d5/d7/de/d1a/fbf x:0 0 0 2023-12-05T09:26:27.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/516: dread - d2/d5/d7/de/d1a/f7c zero size 2023-12-05T09:26:27.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/517: dread - d2/d4f/d15/d60/d68/f85 zero size 2023-12-05T09:26:27.437 INFO:tasks.workunit.client.0.smithi067.stdout:0/653: unlink d3/d6b/d6e/f72 0 2023-12-05T09:26:27.438 INFO:tasks.workunit.client.0.smithi067.stdout:3/419: sync 2023-12-05T09:26:27.438 INFO:tasks.workunit.client.0.smithi067.stdout:9/676: sync 2023-12-05T09:26:27.439 INFO:tasks.workunit.client.1.smithi134.stdout:2/764: dwrite d19/d3a/df4/fe3 [0,4194304] 0 2023-12-05T09:26:27.439 INFO:tasks.workunit.client.1.smithi134.stdout:2/765: truncate d19/d76/f9a 721302 0 2023-12-05T09:26:27.439 INFO:tasks.workunit.client.1.smithi134.stdout:4/697: mknod d16/d21/cf8 0 2023-12-05T09:26:27.439 INFO:tasks.workunit.client.1.smithi134.stdout:2/766: chown d19/d28/d2b/f57 4035221 1 2023-12-05T09:26:27.439 INFO:tasks.workunit.client.1.smithi134.stdout:4/698: chown d16/d21/d35/lda 1 1 2023-12-05T09:26:27.439 INFO:tasks.workunit.client.1.smithi134.stdout:4/699: readlink d16/d18/dc5/dc2/df6/l2f 0 2023-12-05T09:26:27.439 INFO:tasks.workunit.client.1.smithi134.stdout:4/700: stat d16/d18/dc5/lc7 0 2023-12-05T09:26:27.441 INFO:tasks.workunit.client.1.smithi134.stdout:0/677: truncate d13/d14/d30/d4b/f41 72852 0 2023-12-05T09:26:27.446 INFO:tasks.workunit.client.1.smithi134.stdout:8/827: creat da/de/d8a/d42/d99/db9/f11b x:0 0 0 2023-12-05T09:26:27.446 INFO:tasks.workunit.client.1.smithi134.stdout:8/828: fdatasync da/de/d11/d8b/d8c/d10b/f117 0 2023-12-05T09:26:27.449 INFO:tasks.workunit.client.0.smithi067.stdout:5/521: symlink db/df/d35/d63/d75/lbe 0 2023-12-05T09:26:27.449 INFO:tasks.workunit.client.0.smithi067.stdout:5/522: fdatasync db/df/d38/f85 0 2023-12-05T09:26:27.449 INFO:tasks.workunit.client.0.smithi067.stdout:5/523: dread - db/df/d35/d63/faf zero size 2023-12-05T09:26:27.449 INFO:tasks.workunit.client.1.smithi134.stdout:7/704: write d2/dd/f6b [3019379,121579] 0 2023-12-05T09:26:27.452 INFO:tasks.workunit.client.0.smithi067.stdout:2/461: creat d0/d25/d3f/d83/fa0 x:0 0 0 2023-12-05T09:26:27.452 INFO:tasks.workunit.client.1.smithi134.stdout:9/720: dread f1 [0,4194304] 0 2023-12-05T09:26:27.453 INFO:tasks.workunit.client.0.smithi067.stdout:8/461: dread d5/dc/d1a/d20/d3e/f42 [0,4194304] 0 2023-12-05T09:26:27.455 INFO:tasks.workunit.client.1.smithi134.stdout:1/845: rename d2/d9/d10/d30/d4a/l82 to d2/d9/d10/d94/de5/d113/l12b 0 2023-12-05T09:26:27.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/705: dread d2/d7/d6f/da0/fd4 [0,4194304] 0 2023-12-05T09:26:27.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/706: write d2/d7/dc/d2e/d3a/fa5 [992033,110690] 0 2023-12-05T09:26:27.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/518: unlink d2/d4f/d15/la3 0 2023-12-05T09:26:27.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/519: write d2/d5/d7/de/d19/d49/d5f/f9f [906044,42770] 0 2023-12-05T09:26:27.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/520: write d2/d5/d7/de/f3a [1495727,38130] 0 2023-12-05T09:26:27.475 INFO:tasks.workunit.client.0.smithi067.stdout:9/677: creat d1b/d25/d94/fe5 x:0 0 0 2023-12-05T09:26:27.485 INFO:tasks.workunit.client.1.smithi134.stdout:1/846: dread d2/d9/d10/d5b/f5c [0,4194304] 0 2023-12-05T09:26:27.489 INFO:tasks.workunit.client.0.smithi067.stdout:3/420: creat d9/da/d15/d17/d1a/d51/d66/f93 x:0 0 0 2023-12-05T09:26:27.489 INFO:tasks.workunit.client.1.smithi134.stdout:1/847: write d2/f63 [440041,47854] 0 2023-12-05T09:26:27.489 INFO:tasks.workunit.client.1.smithi134.stdout:1/848: dread - d2/d9/d10/d30/d66/da9/d74/f105 zero size 2023-12-05T09:26:27.492 INFO:tasks.workunit.client.0.smithi067.stdout:5/524: symlink db/df/d1a/d59/dae/lbf 0 2023-12-05T09:26:27.493 INFO:tasks.workunit.client.0.smithi067.stdout:8/462: mknod d5/dc/d1a/c7d 0 2023-12-05T09:26:27.494 INFO:tasks.workunit.client.0.smithi067.stdout:1/521: creat d2/d3/fc0 x:0 0 0 2023-12-05T09:26:27.498 INFO:tasks.workunit.client.1.smithi134.stdout:6/667: symlink d4/d32/d57/lcd 0 2023-12-05T09:26:27.500 INFO:tasks.workunit.client.1.smithi134.stdout:0/678: rmdir d13/d14/d30/d4b/d23/d77 39 2023-12-05T09:26:27.506 INFO:tasks.workunit.client.1.smithi134.stdout:3/757: dwrite d4/d1f/f35 [0,4194304] 0 2023-12-05T09:26:27.509 INFO:tasks.workunit.client.1.smithi134.stdout:8/829: mknod da/de/d16/d98/c11c 0 2023-12-05T09:26:27.510 INFO:tasks.workunit.client.0.smithi067.stdout:9/678: dread d1b/dd3/d6c/d76/f8a [0,4194304] 0 2023-12-05T09:26:27.510 INFO:tasks.workunit.client.0.smithi067.stdout:9/679: fdatasync d1b/dd3/f80 0 2023-12-05T09:26:27.516 INFO:tasks.workunit.client.0.smithi067.stdout:2/462: dwrite d0/d25/d9d/f73 [4194304,4194304] 0 2023-12-05T09:26:27.518 INFO:tasks.workunit.client.1.smithi134.stdout:7/707: mkdir d2/df/d81/daf/de3 0 2023-12-05T09:26:27.518 INFO:tasks.workunit.client.1.smithi134.stdout:7/708: stat d2/df/f9d 0 2023-12-05T09:26:27.518 INFO:tasks.workunit.client.1.smithi134.stdout:2/767: getdents d19/d28/d31/d38/d98 0 2023-12-05T09:26:27.518 INFO:tasks.workunit.client.1.smithi134.stdout:2/768: stat d19/f5d 0 2023-12-05T09:26:27.518 INFO:tasks.workunit.client.1.smithi134.stdout:5/679: sync 2023-12-05T09:26:27.518 INFO:tasks.workunit.client.1.smithi134.stdout:6/668: fsync d4/d39/fc3 0 2023-12-05T09:26:27.524 INFO:tasks.workunit.client.1.smithi134.stdout:3/758: mknod d4/d5/d45/cf0 0 2023-12-05T09:26:27.525 INFO:tasks.workunit.client.1.smithi134.stdout:8/830: link da/de/c37 da/de/d8a/d42/d99/dc8/c11d 0 2023-12-05T09:26:27.526 INFO:tasks.workunit.client.0.smithi067.stdout:3/421: dread d9/da/f19 [0,4194304] 0 2023-12-05T09:26:27.526 INFO:tasks.workunit.client.0.smithi067.stdout:3/422: chown d9/da/d15/d28 0 1 2023-12-05T09:26:27.528 INFO:tasks.workunit.client.1.smithi134.stdout:9/721: getdents d7/d8/d14/d26 0 2023-12-05T09:26:27.528 INFO:tasks.workunit.client.1.smithi134.stdout:9/722: write d7/d8/d16/d52/ff3 [593677,45267] 0 2023-12-05T09:26:27.529 INFO:tasks.workunit.client.1.smithi134.stdout:4/701: dwrite d16/d7b/d6f/f87 [0,4194304] 0 2023-12-05T09:26:27.529 INFO:tasks.workunit.client.1.smithi134.stdout:4/702: creat d16/d21/d48/d80/ff9 x:0 0 0 2023-12-05T09:26:27.530 INFO:tasks.workunit.client.1.smithi134.stdout:4/703: truncate d16/d18/dc5/dc2/df6/d63/fe1 554704 0 2023-12-05T09:26:27.530 INFO:tasks.workunit.client.1.smithi134.stdout:4/704: dread - d16/d21/d47/d4b/fd8 zero size 2023-12-05T09:26:27.530 INFO:tasks.workunit.client.1.smithi134.stdout:4/705: write f5 [403830,70719] 0 2023-12-05T09:26:27.534 INFO:tasks.workunit.client.1.smithi134.stdout:6/669: dread d4/d39/d42/f7e [0,4194304] 0 2023-12-05T09:26:27.535 INFO:tasks.workunit.client.0.smithi067.stdout:5/525: dread db/df/d36/f83 [0,4194304] 0 2023-12-05T09:26:27.535 INFO:tasks.workunit.client.0.smithi067.stdout:5/526: chown db/df/d1a/d1d/d20/c26 83 1 2023-12-05T09:26:27.535 INFO:tasks.workunit.client.0.smithi067.stdout:3/423: rename f0 to d9/da/d15/d17/d1a/d51/d70/f94 0 2023-12-05T09:26:27.539 INFO:tasks.workunit.client.1.smithi134.stdout:9/723: write d7/d8/f91 [1501519,79893] 0 2023-12-05T09:26:27.539 INFO:tasks.workunit.client.1.smithi134.stdout:9/724: chown d7/d8/d14/d26/d5a/d69/d9e/cdc 249137 1 2023-12-05T09:26:27.539 INFO:tasks.workunit.client.1.smithi134.stdout:9/725: creat d7/d5b/d5e/ff5 x:0 0 0 2023-12-05T09:26:27.540 INFO:tasks.workunit.client.0.smithi067.stdout:5/527: mknod db/df/d1a/d59/cc0 0 2023-12-05T09:26:27.542 INFO:tasks.workunit.client.1.smithi134.stdout:5/680: creat d0/d1a/d1c/d25/d6a/fe9 x:0 0 0 2023-12-05T09:26:27.542 INFO:tasks.workunit.client.1.smithi134.stdout:5/681: fsync d0/d1a/d3a/f3b 0 2023-12-05T09:26:27.545 INFO:tasks.workunit.client.0.smithi067.stdout:3/424: truncate f6 93769 0 2023-12-05T09:26:27.546 INFO:tasks.workunit.client.0.smithi067.stdout:2/463: dread d0/fd [0,4194304] 0 2023-12-05T09:26:27.548 INFO:tasks.workunit.client.0.smithi067.stdout:9/680: dread d1b/d3e/f67 [0,4194304] 0 2023-12-05T09:26:27.551 INFO:tasks.workunit.client.0.smithi067.stdout:5/528: mkdir db/df/d36/d6c/dc1 0 2023-12-05T09:26:27.553 INFO:tasks.workunit.client.1.smithi134.stdout:3/759: rename d4/f38 to d4/d5/d45/d86/db5/dcf/ff1 0 2023-12-05T09:26:27.554 INFO:tasks.workunit.client.0.smithi067.stdout:3/425: mkdir d9/da/d15/d17/d1a/d51/d70/d95 0 2023-12-05T09:26:27.554 INFO:tasks.workunit.client.0.smithi067.stdout:3/426: readlink d9/l91 0 2023-12-05T09:26:27.554 INFO:tasks.workunit.client.0.smithi067.stdout:3/427: chown d9/f14 57775577 1 2023-12-05T09:26:27.557 INFO:tasks.workunit.client.1.smithi134.stdout:1/849: dwrite d2/d27/d40/f51 [0,4194304] 0 2023-12-05T09:26:27.557 INFO:tasks.workunit.client.1.smithi134.stdout:1/850: creat d2/d9/f12c x:0 0 0 2023-12-05T09:26:27.558 INFO:tasks.workunit.client.0.smithi067.stdout:2/464: unlink d0/d2f/d39/l70 0 2023-12-05T09:26:27.560 INFO:tasks.workunit.client.1.smithi134.stdout:8/831: mknod da/de/d4d/d68/c11e 0 2023-12-05T09:26:27.560 INFO:tasks.workunit.client.1.smithi134.stdout:8/832: creat da/de/d16/dbe/f11f x:0 0 0 2023-12-05T09:26:27.563 INFO:tasks.workunit.client.0.smithi067.stdout:9/681: creat d1b/d25/d54/d5c/d81/d96/fe6 x:0 0 0 2023-12-05T09:26:27.565 INFO:tasks.workunit.client.0.smithi067.stdout:5/529: rmdir db/df/d1a/d59 39 2023-12-05T09:26:27.565 INFO:tasks.workunit.client.0.smithi067.stdout:5/530: truncate db/df/d1a/d1d/d20/f37 4806785 0 2023-12-05T09:26:27.570 INFO:tasks.workunit.client.0.smithi067.stdout:1/522: dwrite d2/d5/d7/de/d1a/f57 [0,4194304] 0 2023-12-05T09:26:27.570 INFO:tasks.workunit.client.0.smithi067.stdout:8/463: dwrite d5/dc/d1a/d20/d2d/d41/f4d [0,4194304] 0 2023-12-05T09:26:27.571 INFO:tasks.workunit.client.0.smithi067.stdout:3/428: dread f3 [4194304,4194304] 0 2023-12-05T09:26:27.571 INFO:tasks.workunit.client.0.smithi067.stdout:2/465: rename d0/d25/d9d/d53/d1e/d8e/f9e to d0/d25/d9d/d53/d1e/d7f/fa1 0 2023-12-05T09:26:27.576 INFO:tasks.workunit.client.0.smithi067.stdout:9/682: unlink f7 0 2023-12-05T09:26:27.577 INFO:tasks.workunit.client.0.smithi067.stdout:9/683: dread - d1b/d25/d35/d56/fc0 zero size 2023-12-05T09:26:27.577 INFO:tasks.workunit.client.0.smithi067.stdout:9/684: stat d1b/d25/d54/d5c/fa8 0 2023-12-05T09:26:27.582 INFO:tasks.workunit.client.1.smithi134.stdout:6/670: mknod d4/d39/d42/d4f/d6d/d3a/d75/cce 0 2023-12-05T09:26:27.582 INFO:tasks.workunit.client.1.smithi134.stdout:6/671: read - d4/d39/d42/d4f/d6d/d3a/d75/d86/faf zero size 2023-12-05T09:26:27.583 INFO:tasks.workunit.client.0.smithi067.stdout:1/523: dread d2/d4f/d14/f3c [0,4194304] 0 2023-12-05T09:26:27.591 INFO:tasks.workunit.client.0.smithi067.stdout:8/464: dread d5/f1c [4194304,4194304] 0 2023-12-05T09:26:27.593 INFO:tasks.workunit.client.1.smithi134.stdout:9/726: link d7/d8/d14/d26/d5a/f8d d7/d8/d14/d26/d7f/d92/d53/dd4/ff6 0 2023-12-05T09:26:27.593 INFO:tasks.workunit.client.1.smithi134.stdout:9/727: creat d7/d8/d16/d52/ff7 x:0 0 0 2023-12-05T09:26:27.596 INFO:tasks.workunit.client.1.smithi134.stdout:1/851: dwrite d2/d27/f8a [0,4194304] 0 2023-12-05T09:26:27.596 INFO:tasks.workunit.client.1.smithi134.stdout:1/852: write d2/d9/d10/d94/de5/d112/fd3 [1543951,106450] 0 2023-12-05T09:26:27.596 INFO:tasks.workunit.client.1.smithi134.stdout:1/853: chown d2/ld 26432 1 2023-12-05T09:26:27.597 INFO:tasks.workunit.client.0.smithi067.stdout:3/429: unlink d9/da/f22 0 2023-12-05T09:26:27.597 INFO:tasks.workunit.client.1.smithi134.stdout:5/682: mknod d0/d1a/cea 0 2023-12-05T09:26:27.601 INFO:tasks.workunit.client.0.smithi067.stdout:2/466: creat d0/d2f/d84/fa2 x:0 0 0 2023-12-05T09:26:27.605 INFO:tasks.workunit.client.0.smithi067.stdout:9/685: unlink d1b/d25/d94/fbb 0 2023-12-05T09:26:27.608 INFO:tasks.workunit.client.1.smithi134.stdout:4/706: rename d16/d21/d48/d80/dae/f5e to d16/d7b/db6/ffa 0 2023-12-05T09:26:27.613 INFO:tasks.workunit.client.1.smithi134.stdout:3/760: mkdir d4/d5/d45/df2 0 2023-12-05T09:26:27.613 INFO:tasks.workunit.client.1.smithi134.stdout:3/761: fsync d4/d1f/f28 0 2023-12-05T09:26:27.614 INFO:tasks.workunit.client.0.smithi067.stdout:5/531: symlink db/df/d82/lc2 0 2023-12-05T09:26:27.616 INFO:tasks.workunit.client.1.smithi134.stdout:1/854: dread d2/f4d [0,4194304] 0 2023-12-05T09:26:27.617 INFO:tasks.workunit.client.0.smithi067.stdout:8/465: dread d5/dc/d1a/d20/d2d/f5f [0,4194304] 0 2023-12-05T09:26:27.617 INFO:tasks.workunit.client.0.smithi067.stdout:8/466: fdatasync d5/dc/d1a/d20/f59 0 2023-12-05T09:26:27.618 INFO:tasks.workunit.client.0.smithi067.stdout:2/467: truncate d0/d25/d9d/d53/d1e/d7f/f91 2790936 0 2023-12-05T09:26:27.619 INFO:tasks.workunit.client.0.smithi067.stdout:1/524: creat d2/d4f/fc1 x:0 0 0 2023-12-05T09:26:27.621 INFO:tasks.workunit.client.1.smithi134.stdout:8/833: creat da/de/d11/d1d/d5f/dea/f120 x:0 0 0 2023-12-05T09:26:27.621 INFO:tasks.workunit.client.1.smithi134.stdout:8/834: dread - da/de/d16/d98/fd0 zero size 2023-12-05T09:26:27.622 INFO:tasks.workunit.client.0.smithi067.stdout:3/430: write d9/fe [95322,45989] 0 2023-12-05T09:26:27.627 INFO:tasks.workunit.client.1.smithi134.stdout:2/769: dwrite d19/d28/d63/d70/f87 [0,4194304] 0 2023-12-05T09:26:27.628 INFO:tasks.workunit.client.1.smithi134.stdout:2/770: chown d19/d28/c29 1632550699 1 2023-12-05T09:26:27.628 INFO:tasks.workunit.client.1.smithi134.stdout:2/771: rename d19/d76 to d19/d76/dfd 22 2023-12-05T09:26:27.628 INFO:tasks.workunit.client.1.smithi134.stdout:2/772: creat d19/d3a/ffe x:0 0 0 2023-12-05T09:26:27.628 INFO:tasks.workunit.client.1.smithi134.stdout:2/773: fsync d19/d28/d63/d70/f99 0 2023-12-05T09:26:27.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/672: mknod d4/d39/d42/d4f/d6d/d3a/d75/d86/ccf 0 2023-12-05T09:26:27.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/673: readlink d4/d32/d57/lcd 0 2023-12-05T09:26:27.628 INFO:tasks.workunit.client.0.smithi067.stdout:9/686: mknod d1b/d25/d54/d5c/d8f/ce7 0 2023-12-05T09:26:27.628 INFO:tasks.workunit.client.0.smithi067.stdout:9/687: readlink d1b/d3e/lb7 0 2023-12-05T09:26:27.630 INFO:tasks.workunit.client.0.smithi067.stdout:5/532: creat db/df/d3f/fc3 x:0 0 0 2023-12-05T09:26:27.639 INFO:tasks.workunit.client.1.smithi134.stdout:9/728: creat d7/d8/d16/d52/d74/ff8 x:0 0 0 2023-12-05T09:26:27.648 INFO:tasks.workunit.client.1.smithi134.stdout:4/707: dread f0 [0,4194304] 0 2023-12-05T09:26:27.648 INFO:tasks.workunit.client.1.smithi134.stdout:4/708: chown d16/d21/d48/d66/db0/db3/cdc 2 1 2023-12-05T09:26:27.649 INFO:tasks.workunit.client.0.smithi067.stdout:9/688: write d1b/dd3/d82/fb2 [245984,21635] 0 2023-12-05T09:26:27.649 INFO:tasks.workunit.client.0.smithi067.stdout:9/689: chown d1b/d25/f33 15018031 1 2023-12-05T09:26:27.650 INFO:tasks.workunit.client.0.smithi067.stdout:5/533: rename db/df/d36/d6c/fa2 to db/df/d3f/d88/d8d/fc4 0 2023-12-05T09:26:27.661 INFO:tasks.workunit.client.1.smithi134.stdout:5/683: mkdir d0/d1a/d1c/d25/d4d/d9e/deb 0 2023-12-05T09:26:27.661 INFO:tasks.workunit.client.1.smithi134.stdout:5/684: write d0/d1a/d1c/d25/d4d/d9e/fac [542659,4297] 0 2023-12-05T09:26:27.661 INFO:tasks.workunit.client.1.smithi134.stdout:5/685: write d0/dd/d37/f9c [71997,123642] 0 2023-12-05T09:26:27.672 INFO:tasks.workunit.client.0.smithi067.stdout:9/690: dread d1b/dd3/d6c/d76/f8a [0,4194304] 0 2023-12-05T09:26:27.673 INFO:tasks.workunit.client.0.smithi067.stdout:2/468: mkdir d0/d2f/da3 0 2023-12-05T09:26:27.673 INFO:tasks.workunit.client.0.smithi067.stdout:2/469: chown d0/d25/d9d/c30 0 1 2023-12-05T09:26:27.678 INFO:tasks.workunit.client.0.smithi067.stdout:5/534: creat db/df/d3f/d88/fc5 x:0 0 0 2023-12-05T09:26:27.682 INFO:tasks.workunit.client.0.smithi067.stdout:8/467: dwrite d5/dc/d6e/f76 [0,4194304] 0 2023-12-05T09:26:27.696 INFO:tasks.workunit.client.0.smithi067.stdout:9/691: rmdir d1b 39 2023-12-05T09:26:27.698 INFO:tasks.workunit.client.1.smithi134.stdout:8/835: dwrite da/de/d16/dbe/f11f [0,4194304] 0 2023-12-05T09:26:27.702 INFO:tasks.workunit.client.0.smithi067.stdout:2/470: creat d0/d25/d34/fa4 x:0 0 0 2023-12-05T09:26:27.705 INFO:tasks.workunit.client.0.smithi067.stdout:5/535: rename db/df/d36/d57/c94 to db/df/d1a/d59/dae/cc6 0 2023-12-05T09:26:27.705 INFO:tasks.workunit.client.0.smithi067.stdout:8/468: write d5/dc/f19 [1344496,71254] 0 2023-12-05T09:26:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:5/536: stat db/df/d1a/d1d/d20/c26 0 2023-12-05T09:26:27.715 INFO:tasks.workunit.client.0.smithi067.stdout:5/537: write f9 [3708102,56380] 0 2023-12-05T09:26:27.716 INFO:tasks.workunit.client.0.smithi067.stdout:3/431: dwrite d9/f67 [0,4194304] 0 2023-12-05T09:26:27.717 INFO:tasks.workunit.client.0.smithi067.stdout:8/469: mkdir d5/dc/d1a/d62/d7e 0 2023-12-05T09:26:27.719 INFO:tasks.workunit.client.1.smithi134.stdout:2/774: rename d19/d28/d63/d70/lf0 to d19/d76/db8/lff 0 2023-12-05T09:26:27.724 INFO:tasks.workunit.client.1.smithi134.stdout:6/674: creat d4/d39/d42/d4f/d6d/d3a/d80/fd0 x:0 0 0 2023-12-05T09:26:27.727 INFO:tasks.workunit.client.1.smithi134.stdout:4/709: rmdir d16/d18/dad 39 2023-12-05T09:26:27.727 INFO:tasks.workunit.client.0.smithi067.stdout:5/538: mknod db/df/d36/d6c/dc1/cc7 0 2023-12-05T09:26:27.728 INFO:tasks.workunit.client.0.smithi067.stdout:8/470: mkdir d5/dc/d1a/d20/d2d/d7f 0 2023-12-05T09:26:27.730 INFO:tasks.workunit.client.0.smithi067.stdout:3/432: creat d9/da/f96 x:0 0 0 2023-12-05T09:26:27.730 INFO:tasks.workunit.client.0.smithi067.stdout:3/433: chown d9/da/d15/d17/l80 2509 1 2023-12-05T09:26:27.730 INFO:tasks.workunit.client.1.smithi134.stdout:3/762: truncate d4/d80/f84 31287 0 2023-12-05T09:26:27.732 INFO:tasks.workunit.client.0.smithi067.stdout:8/471: creat d5/da/f80 x:0 0 0 2023-12-05T09:26:27.738 INFO:tasks.workunit.client.0.smithi067.stdout:3/434: readlink d9/d20/l48 0 2023-12-05T09:26:27.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/692: write d1b/dd3/d6c/d76/fa4 [1358722,44019] 0 2023-12-05T09:26:27.740 INFO:tasks.workunit.client.1.smithi134.stdout:2/775: dread d19/d28/d31/f3c [0,4194304] 0 2023-12-05T09:26:27.741 INFO:tasks.workunit.client.0.smithi067.stdout:8/472: rename d5/dc/d1a/d20/f53 to d5/da/d30/d61/d66/f81 0 2023-12-05T09:26:27.742 INFO:tasks.workunit.client.1.smithi134.stdout:8/836: mknod da/de/d8a/d42/d99/d106/c121 0 2023-12-05T09:26:27.745 INFO:tasks.workunit.client.1.smithi134.stdout:8/837: read da/de/d8a/d42/d99/dc8/d3b/f65 [84139,76459] 0 2023-12-05T09:26:27.745 INFO:tasks.workunit.client.1.smithi134.stdout:8/838: fdatasync da/de/d16/d2d/fe6 0 2023-12-05T09:26:27.745 INFO:tasks.workunit.client.1.smithi134.stdout:8/839: write da/fe8 [28047,64131] 0 2023-12-05T09:26:27.745 INFO:tasks.workunit.client.1.smithi134.stdout:9/729: rename d7/d10/d56/ca2 to d7/d8/d16/d52/d74/d97/d99/cf9 0 2023-12-05T09:26:27.749 INFO:tasks.workunit.client.1.smithi134.stdout:3/763: dread d4/d5/d7c/fce [0,4194304] 0 2023-12-05T09:26:27.751 INFO:tasks.workunit.client.1.smithi134.stdout:6/675: chown d4/f6b 27528988 1 2023-12-05T09:26:27.752 INFO:tasks.workunit.client.1.smithi134.stdout:0/679: sync 2023-12-05T09:26:27.752 INFO:tasks.workunit.client.1.smithi134.stdout:0/680: chown d13/d14/d30/d4b/d66/da0/daf/dce/c5a 67 1 2023-12-05T09:26:27.754 INFO:tasks.workunit.client.0.smithi067.stdout:9/693: mknod d1b/d25/d35/d56/d90/ce8 0 2023-12-05T09:26:27.754 INFO:tasks.workunit.client.0.smithi067.stdout:9/694: fdatasync d1b/d25/d54/fcc 0 2023-12-05T09:26:27.755 INFO:tasks.workunit.client.1.smithi134.stdout:1/855: dwrite d2/d27/f8a [4194304,4194304] 0 2023-12-05T09:26:27.755 INFO:tasks.workunit.client.1.smithi134.stdout:4/710: symlink d16/d7b/dce/d6e/lfb 0 2023-12-05T09:26:27.757 INFO:tasks.workunit.client.0.smithi067.stdout:1/525: dwrite d2/f39 [4194304,4194304] 0 2023-12-05T09:26:27.758 INFO:tasks.workunit.client.0.smithi067.stdout:8/473: unlink d5/f36 0 2023-12-05T09:26:27.758 INFO:tasks.workunit.client.0.smithi067.stdout:8/474: fdatasync d5/dc/d1a/d20/d3e/f42 0 2023-12-05T09:26:27.759 INFO:tasks.workunit.client.1.smithi134.stdout:5/686: rmdir d0/d1a/d1c/d25/d4d/d9e 39 2023-12-05T09:26:27.759 INFO:tasks.workunit.client.1.smithi134.stdout:5/687: chown d0/d11/d61/lb5 114 1 2023-12-05T09:26:27.764 INFO:tasks.workunit.client.0.smithi067.stdout:9/695: dread d1b/d3e/f67 [0,4194304] 0 2023-12-05T09:26:27.765 INFO:tasks.workunit.client.1.smithi134.stdout:9/730: mknod d7/d8/d14/d26/d5a/da1/cfa 0 2023-12-05T09:26:27.766 INFO:tasks.workunit.client.1.smithi134.stdout:7/709: sync 2023-12-05T09:26:27.766 INFO:tasks.workunit.client.1.smithi134.stdout:3/764: rename d4/d5/d45/d60/d85/fe5 to d4/d5/d6f/d76/ff3 0 2023-12-05T09:26:27.766 INFO:tasks.workunit.client.1.smithi134.stdout:2/776: dread d19/d28/d31/d38/f48 [0,4194304] 0 2023-12-05T09:26:27.767 INFO:tasks.workunit.client.1.smithi134.stdout:6/676: symlink d4/d39/d42/d4f/d6d/d3a/d75/dbc/ld1 0 2023-12-05T09:26:27.768 INFO:tasks.workunit.client.0.smithi067.stdout:3/435: dread d9/da/f19 [0,4194304] 0 2023-12-05T09:26:27.768 INFO:tasks.workunit.client.0.smithi067.stdout:3/436: creat d9/da/d15/d17/d1a/d51/d66/f97 x:0 0 0 2023-12-05T09:26:27.768 INFO:tasks.workunit.client.0.smithi067.stdout:3/437: creat d9/da/d15/d17/d1a/d51/d66/f98 x:0 0 0 2023-12-05T09:26:27.773 INFO:tasks.workunit.client.0.smithi067.stdout:8/475: symlink d5/dc/d1a/d62/l82 0 2023-12-05T09:26:27.773 INFO:tasks.workunit.client.0.smithi067.stdout:8/476: chown d5/dc/c26 16616 1 2023-12-05T09:26:27.778 INFO:tasks.workunit.client.0.smithi067.stdout:3/438: read d9/da/d15/d17/f16 [657272,77898] 0 2023-12-05T09:26:27.778 INFO:tasks.workunit.client.0.smithi067.stdout:3/439: chown d9/da/d15 0 1 2023-12-05T09:26:27.778 INFO:tasks.workunit.client.1.smithi134.stdout:0/681: read d13/d14/d15/f40 [1509490,120640] 0 2023-12-05T09:26:27.779 INFO:tasks.workunit.client.0.smithi067.stdout:8/477: creat d5/dc/d1a/d62/d7e/f83 x:0 0 0 2023-12-05T09:26:27.782 INFO:tasks.workunit.client.0.smithi067.stdout:3/440: link d9/da/d15/d17/d2b/l5e d9/d20/l99 0 2023-12-05T09:26:27.782 INFO:tasks.workunit.client.0.smithi067.stdout:3/441: dread - d9/da/f6c zero size 2023-12-05T09:26:27.782 INFO:tasks.workunit.client.0.smithi067.stdout:3/442: readlink d9/da/d15/l21 0 2023-12-05T09:26:27.786 INFO:tasks.workunit.client.1.smithi134.stdout:1/856: mkdir d2/d9/d10/d30/d66/d10d/d12d 0 2023-12-05T09:26:27.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/711: mknod d16/d21/d48/d66/cfc 0 2023-12-05T09:26:27.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/712: readlink d16/d21/d48/d66/l7f 0 2023-12-05T09:26:27.786 INFO:tasks.workunit.client.1.smithi134.stdout:2/777: creat d19/d76/db9/f100 x:0 0 0 2023-12-05T09:26:27.786 INFO:tasks.workunit.client.1.smithi134.stdout:2/778: readlink d19/d3f/l4c 0 2023-12-05T09:26:27.787 INFO:tasks.workunit.client.1.smithi134.stdout:3/765: mknod d4/d5/d45/d60/d85/dab/ddc/cf4 0 2023-12-05T09:26:27.787 INFO:tasks.workunit.client.1.smithi134.stdout:3/766: readlink d4/l81 0 2023-12-05T09:26:27.788 INFO:tasks.workunit.client.0.smithi067.stdout:3/443: symlink d9/da/d15/l9a 0 2023-12-05T09:26:27.788 INFO:tasks.workunit.client.0.smithi067.stdout:3/444: read - d9/da/d15/d28/d29/d65/f7c zero size 2023-12-05T09:26:27.788 INFO:tasks.workunit.client.0.smithi067.stdout:9/696: write d1b/d25/d35/f79 [3617180,39200] 0 2023-12-05T09:26:27.789 INFO:tasks.workunit.client.1.smithi134.stdout:0/682: truncate d13/d14/d15/d2a/f4c 1714810 0 2023-12-05T09:26:27.789 INFO:tasks.workunit.client.1.smithi134.stdout:0/683: fsync d13/d14/d30/d4b/d66/da0/daf/dce/fb9 0 2023-12-05T09:26:27.789 INFO:tasks.workunit.client.0.smithi067.stdout:5/539: dwrite db/df/f53 [4194304,4194304] 0 2023-12-05T09:26:27.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/445: write d9/d62/f8f [395509,42965] 0 2023-12-05T09:26:27.790 INFO:tasks.workunit.client.0.smithi067.stdout:5/540: readlink db/df/d38/l71 0 2023-12-05T09:26:27.790 INFO:tasks.workunit.client.0.smithi067.stdout:3/446: dread - d9/da/d15/d17/d1a/d51/d66/f93 zero size 2023-12-05T09:26:27.791 INFO:tasks.workunit.client.1.smithi134.stdout:1/857: write d2/d27/d71/fa1 [165607,84854] 0 2023-12-05T09:26:27.791 INFO:tasks.workunit.client.1.smithi134.stdout:1/858: creat d2/d9/d10/d30/d66/d9b/f12e x:0 0 0 2023-12-05T09:26:27.791 INFO:tasks.workunit.client.1.smithi134.stdout:1/859: write d2/d27/d9d/fa6 [3457608,44405] 0 2023-12-05T09:26:27.791 INFO:tasks.workunit.client.1.smithi134.stdout:1/860: fsync d2/d27/d40/f51 0 2023-12-05T09:26:27.791 INFO:tasks.workunit.client.1.smithi134.stdout:1/861: chown d2/d27/d40/d109/c119 1 1 2023-12-05T09:26:27.792 INFO:tasks.workunit.client.1.smithi134.stdout:1/862: write d2/d9/d10/d30/d66/da9/d74/fca [409913,77747] 0 2023-12-05T09:26:27.792 INFO:tasks.workunit.client.0.smithi067.stdout:9/697: mknod d1b/dd3/d6c/d78/ce9 0 2023-12-05T09:26:27.796 INFO:tasks.workunit.client.1.smithi134.stdout:5/688: mknod d0/d1a/d1c/cec 0 2023-12-05T09:26:27.796 INFO:tasks.workunit.client.1.smithi134.stdout:4/713: rename f0 to d16/d7b/dce/d6e/daa/ffd 0 2023-12-05T09:26:27.797 INFO:tasks.workunit.client.0.smithi067.stdout:8/478: dread d5/dc/d1a/f2f [0,4194304] 0 2023-12-05T09:26:27.797 INFO:tasks.workunit.client.0.smithi067.stdout:8/479: write d5/dc/d1a/f2f [1345845,85793] 0 2023-12-05T09:26:27.797 INFO:tasks.workunit.client.0.smithi067.stdout:8/480: dread - d5/dc/d1a/d20/d3e/f7a zero size 2023-12-05T09:26:27.801 INFO:tasks.workunit.client.1.smithi134.stdout:1/863: dread d2/d9/d10/d30/d4a/f9a [0,4194304] 0 2023-12-05T09:26:27.801 INFO:tasks.workunit.client.0.smithi067.stdout:5/541: mkdir db/df/d35/dc8 0 2023-12-05T09:26:27.807 INFO:tasks.workunit.client.0.smithi067.stdout:3/447: creat d9/da/d15/d28/d29/d47/d92/f9b x:0 0 0 2023-12-05T09:26:27.808 INFO:tasks.workunit.client.1.smithi134.stdout:0/684: dread f8 [0,4194304] 0 2023-12-05T09:26:27.809 INFO:tasks.workunit.client.0.smithi067.stdout:3/448: chown d9/da/d15/d17/f55 3 1 2023-12-05T09:26:27.810 INFO:tasks.workunit.client.1.smithi134.stdout:8/840: dwrite da/de/f4c [0,4194304] 0 2023-12-05T09:26:27.810 INFO:tasks.workunit.client.1.smithi134.stdout:5/689: read d0/f43 [1333567,66683] 0 2023-12-05T09:26:27.810 INFO:tasks.workunit.client.1.smithi134.stdout:5/690: readlink d0/d1a/d1c/d25/l44 0 2023-12-05T09:26:27.811 INFO:tasks.workunit.client.0.smithi067.stdout:2/471: dwrite d0/d2f/d39/f6f [0,4194304] 0 2023-12-05T09:26:27.813 INFO:tasks.workunit.client.1.smithi134.stdout:2/779: mkdir d19/d28/d31/d6f/d101 0 2023-12-05T09:26:27.813 INFO:tasks.workunit.client.1.smithi134.stdout:6/677: getdents d4/d78 0 2023-12-05T09:26:27.813 INFO:tasks.workunit.client.1.smithi134.stdout:6/678: chown d4/d39/d42/d4f/d6d/d3a/d75/cb2 6897071 1 2023-12-05T09:26:27.813 INFO:tasks.workunit.client.1.smithi134.stdout:6/679: write d4/d39/d42/d4f/d6d/d3a/d75/d59/f7c [2498606,13111] 0 2023-12-05T09:26:27.813 INFO:tasks.workunit.client.1.smithi134.stdout:7/710: dread d2/df/d81/f91 [0,4194304] 0 2023-12-05T09:26:27.814 INFO:tasks.workunit.client.1.smithi134.stdout:3/767: creat d4/d80/ff5 x:0 0 0 2023-12-05T09:26:27.814 INFO:tasks.workunit.client.0.smithi067.stdout:5/542: symlink db/df/d52/lc9 0 2023-12-05T09:26:27.817 INFO:tasks.workunit.client.0.smithi067.stdout:3/449: mknod d9/da/d15/d28/d29/d65/c9c 0 2023-12-05T09:26:27.819 INFO:tasks.workunit.client.1.smithi134.stdout:4/714: unlink d16/l26 0 2023-12-05T09:26:27.823 INFO:tasks.workunit.client.0.smithi067.stdout:6/437: sync 2023-12-05T09:26:27.823 INFO:tasks.workunit.client.0.smithi067.stdout:6/438: fsync da/d10/d1e/d51/f65 0 2023-12-05T09:26:27.824 INFO:tasks.workunit.client.1.smithi134.stdout:1/864: mkdir d2/d9/d10/d5b/d12f 0 2023-12-05T09:26:27.824 INFO:tasks.workunit.client.1.smithi134.stdout:1/865: write d2/f17 [3127472,84133] 0 2023-12-05T09:26:27.827 INFO:tasks.workunit.client.1.smithi134.stdout:9/731: dwrite d7/d8/f50 [0,4194304] 0 2023-12-05T09:26:27.827 INFO:tasks.workunit.client.1.smithi134.stdout:9/732: chown d7/d8/d16/d52/d74/d97/ld2 7279443 1 2023-12-05T09:26:27.829 INFO:tasks.workunit.client.1.smithi134.stdout:5/691: creat d0/d1a/d1c/d25/d4d/d9e/fed x:0 0 0 2023-12-05T09:26:27.830 INFO:tasks.workunit.client.1.smithi134.stdout:5/692: truncate d0/d1a/d3a/f58 4264225 0 2023-12-05T09:26:27.832 INFO:tasks.workunit.client.1.smithi134.stdout:7/711: symlink d2/df/d81/daf/de3/le4 0 2023-12-05T09:26:27.832 INFO:tasks.workunit.client.1.smithi134.stdout:7/712: write d2/d7/fe0 [692264,52535] 0 2023-12-05T09:26:27.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/543: read db/df/d36/d57/fb7 [765252,117467] 0 2023-12-05T09:26:27.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/544: write db/df/d52/f9d [4808953,7808] 0 2023-12-05T09:26:27.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/472: rmdir d0/d2f 39 2023-12-05T09:26:27.834 INFO:tasks.workunit.client.0.smithi067.stdout:2/473: chown d0/d25/d3f 124 1 2023-12-05T09:26:27.835 INFO:tasks.workunit.client.1.smithi134.stdout:1/866: symlink d2/d27/d9d/l130 0 2023-12-05T09:26:27.836 INFO:tasks.workunit.client.1.smithi134.stdout:4/715: truncate d16/d7b/dce/d6e/daa/d3b/f5c 321165 0 2023-12-05T09:26:27.836 INFO:tasks.workunit.client.1.smithi134.stdout:4/716: readlink d16/d18/dc5/lc7 0 2023-12-05T09:26:27.836 INFO:tasks.workunit.client.1.smithi134.stdout:4/717: fdatasync f15 0 2023-12-05T09:26:27.838 INFO:tasks.workunit.client.0.smithi067.stdout:9/698: rmdir d1b/d25/d54/d5c 39 2023-12-05T09:26:27.842 INFO:tasks.workunit.client.0.smithi067.stdout:6/439: write da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a [3176835,59298] 0 2023-12-05T09:26:27.842 INFO:tasks.workunit.client.0.smithi067.stdout:6/440: chown da/d10/d1e/d17/d2f/d47/d79/f9c 3 1 2023-12-05T09:26:27.842 INFO:tasks.workunit.client.0.smithi067.stdout:6/441: fdatasync da/d10/d1e/d17/d2f/d1f/f25 0 2023-12-05T09:26:27.842 INFO:tasks.workunit.client.0.smithi067.stdout:6/442: creat da/d10/d1e/d17/d2f/d3f/d92/f9d x:0 0 0 2023-12-05T09:26:27.842 INFO:tasks.workunit.client.0.smithi067.stdout:6/443: stat da/d10/d1e/d17/d2f 0 2023-12-05T09:26:27.843 INFO:tasks.workunit.client.1.smithi134.stdout:5/693: creat d0/d1a/d1c/d3f/d81/db0/dbe/fee x:0 0 0 2023-12-05T09:26:27.843 INFO:tasks.workunit.client.1.smithi134.stdout:5/694: chown d0/d1a/c24 6468 1 2023-12-05T09:26:27.843 INFO:tasks.workunit.client.1.smithi134.stdout:5/695: fsync d0/d1a/d1c/d3f/d5b/d5d/d78/fd7 0 2023-12-05T09:26:27.844 INFO:tasks.workunit.client.0.smithi067.stdout:8/481: dwrite d5/dc/d1a/d20/d2d/d41/f5b [4194304,4194304] 0 2023-12-05T09:26:27.846 INFO:tasks.workunit.client.0.smithi067.stdout:5/545: link db/df/d1a/c74 db/df/d1a/d1d/d20/cca 0 2023-12-05T09:26:27.847 INFO:tasks.workunit.client.1.smithi134.stdout:7/713: unlink d2/d7/d2b/f8e 0 2023-12-05T09:26:27.850 INFO:tasks.workunit.client.1.smithi134.stdout:7/714: write d2/dd/f19 [2719259,118498] 0 2023-12-05T09:26:27.851 INFO:tasks.workunit.client.0.smithi067.stdout:3/450: unlink d9/l91 0 2023-12-05T09:26:27.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/685: dread d13/d14/d30/d4b/d66/da0/daf/dde/f8b [0,4194304] 0 2023-12-05T09:26:27.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/686: write d13/d14/fdc [697081,116204] 0 2023-12-05T09:26:27.853 INFO:tasks.workunit.client.1.smithi134.stdout:2/780: dread d19/f8f [0,4194304] 0 2023-12-05T09:26:27.853 INFO:tasks.workunit.client.1.smithi134.stdout:2/781: fsync d19/d28/d31/d38/fc8 0 2023-12-05T09:26:27.853 INFO:tasks.workunit.client.1.smithi134.stdout:2/782: truncate d19/d3a/df4/fab 4931576 0 2023-12-05T09:26:27.853 INFO:tasks.workunit.client.1.smithi134.stdout:9/733: dread d7/d10/d56/f9f [0,4194304] 0 2023-12-05T09:26:27.853 INFO:tasks.workunit.client.1.smithi134.stdout:9/734: chown d7/d10/d56/le1 246902535 1 2023-12-05T09:26:27.853 INFO:tasks.workunit.client.1.smithi134.stdout:9/735: chown d7/d8/la 205 1 2023-12-05T09:26:27.857 INFO:tasks.workunit.client.1.smithi134.stdout:1/867: rename d2/l3e to d2/d9/d10/d94/d124/l131 0 2023-12-05T09:26:27.860 INFO:tasks.workunit.client.0.smithi067.stdout:9/699: creat d1b/d25/d35/d56/d90/fea x:0 0 0 2023-12-05T09:26:27.864 INFO:tasks.workunit.client.1.smithi134.stdout:1/868: write d2/d9/fad [167385,102740] 0 2023-12-05T09:26:27.866 INFO:tasks.workunit.client.1.smithi134.stdout:4/718: getdents d16/d21/de5 0 2023-12-05T09:26:27.866 INFO:tasks.workunit.client.1.smithi134.stdout:4/719: chown d16/d21/d48/d66/db0 799 1 2023-12-05T09:26:27.866 INFO:tasks.workunit.client.1.smithi134.stdout:4/720: chown d16/d21/d48/d66/db0 14 1 2023-12-05T09:26:27.867 INFO:tasks.workunit.client.0.smithi067.stdout:6/444: mkdir da/d10/d1e/d17/d2f/d1f/d9e 0 2023-12-05T09:26:27.868 INFO:tasks.workunit.client.1.smithi134.stdout:5/696: mknod d0/d50/cef 0 2023-12-05T09:26:27.868 INFO:tasks.workunit.client.1.smithi134.stdout:4/721: write d16/d21/d47/f4a [549746,98890] 0 2023-12-05T09:26:27.870 INFO:tasks.workunit.client.0.smithi067.stdout:8/482: dread d5/d3b/f3d [0,4194304] 0 2023-12-05T09:26:27.871 INFO:tasks.workunit.client.0.smithi067.stdout:8/483: creat d5/dc/d1a/d62/f84 x:0 0 0 2023-12-05T09:26:27.874 INFO:tasks.workunit.client.1.smithi134.stdout:0/687: creat d13/d14/d15/d2a/d8c/fe7 x:0 0 0 2023-12-05T09:26:27.880 INFO:tasks.workunit.client.0.smithi067.stdout:5/546: rename db/df/d1a/d1d/c45 to db/df/d36/d6c/dc1/ccb 0 2023-12-05T09:26:27.881 INFO:tasks.workunit.client.1.smithi134.stdout:7/715: dread d2/d7/d65/f92 [0,4194304] 0 2023-12-05T09:26:27.881 INFO:tasks.workunit.client.1.smithi134.stdout:7/716: creat d2/d7/d2b/d94/fe5 x:0 0 0 2023-12-05T09:26:27.883 INFO:tasks.workunit.client.1.smithi134.stdout:2/783: creat d19/d3a/d60/f102 x:0 0 0 2023-12-05T09:26:27.885 INFO:tasks.workunit.client.1.smithi134.stdout:8/841: dwrite da/de/fb7 [0,4194304] 0 2023-12-05T09:26:27.886 INFO:tasks.workunit.client.1.smithi134.stdout:6/680: dwrite d4/d39/d5c/fb6 [0,4194304] 0 2023-12-05T09:26:27.886 INFO:tasks.workunit.client.0.smithi067.stdout:9/700: link d1b/d25/d5b/l6b d1b/d25/d54/d5c/de2/leb 0 2023-12-05T09:26:27.890 INFO:tasks.workunit.client.0.smithi067.stdout:6/445: rename da/d10/d1e/l94 to da/d10/d1e/l9f 0 2023-12-05T09:26:27.890 INFO:tasks.workunit.client.0.smithi067.stdout:4/431: sync 2023-12-05T09:26:27.890 INFO:tasks.workunit.client.0.smithi067.stdout:4/432: truncate d0/d1d/d25/d2c/d34/f43 1324825 0 2023-12-05T09:26:27.890 INFO:tasks.workunit.client.0.smithi067.stdout:4/433: write d0/d9/f85 [112488,313] 0 2023-12-05T09:26:27.891 INFO:tasks.workunit.client.1.smithi134.stdout:3/768: dwrite d4/d5/d45/d60/d85/dba/fdf [0,4194304] 0 2023-12-05T09:26:27.891 INFO:tasks.workunit.client.1.smithi134.stdout:3/769: truncate d4/faf 5499204 0 2023-12-05T09:26:27.896 INFO:tasks.workunit.client.1.smithi134.stdout:4/722: dread d16/d21/d47/d4b/fd0 [0,4194304] 0 2023-12-05T09:26:27.896 INFO:tasks.workunit.client.1.smithi134.stdout:4/723: stat d16/d18/dc5/dc2/df6/f3a 0 2023-12-05T09:26:27.897 INFO:tasks.workunit.client.1.smithi134.stdout:4/724: write d16/d7b/dce/d6e/daa/d3b/fa0 [4449477,119910] 0 2023-12-05T09:26:27.899 INFO:tasks.workunit.client.0.smithi067.stdout:5/547: truncate db/df/f6b 3786809 0 2023-12-05T09:26:27.899 INFO:tasks.workunit.client.0.smithi067.stdout:5/548: stat db/df/d1a/f28 0 2023-12-05T09:26:27.899 INFO:tasks.workunit.client.0.smithi067.stdout:5/549: chown db/df/d1a/c74 0 1 2023-12-05T09:26:27.899 INFO:tasks.workunit.client.0.smithi067.stdout:2/474: dwrite d0/fd [4194304,4194304] 0 2023-12-05T09:26:27.902 INFO:tasks.workunit.client.0.smithi067.stdout:3/451: rename d9/da/d15/d28/d29/d65/c9c to d9/da/d15/d28/d29/d7e/d87/c9d 0 2023-12-05T09:26:27.902 INFO:tasks.workunit.client.0.smithi067.stdout:3/452: fsync d9/da/d15/d17/f55 0 2023-12-05T09:26:27.902 INFO:tasks.workunit.client.0.smithi067.stdout:3/453: chown d9/d20/c4a 94742 1 2023-12-05T09:26:27.903 INFO:tasks.workunit.client.1.smithi134.stdout:0/688: symlink d13/d14/d15/le8 0 2023-12-05T09:26:27.903 INFO:tasks.workunit.client.1.smithi134.stdout:6/681: dread d4/d39/d42/d4f/d6d/d3a/d80/f81 [8388608,4194304] 0 2023-12-05T09:26:27.903 INFO:tasks.workunit.client.1.smithi134.stdout:6/682: dread - d4/d39/d42/d4f/f85 zero size 2023-12-05T09:26:27.913 INFO:tasks.workunit.client.0.smithi067.stdout:6/446: symlink da/d10/d1e/d17/d2f/d1f/d9e/la0 0 2023-12-05T09:26:27.916 INFO:tasks.workunit.client.0.smithi067.stdout:8/484: rmdir d5/d6a 39 2023-12-05T09:26:27.921 INFO:tasks.workunit.client.1.smithi134.stdout:7/717: mknod d2/df/d2a/d63/ce6 0 2023-12-05T09:26:27.927 INFO:tasks.workunit.client.1.smithi134.stdout:2/784: link d19/d76/dba/ded/cf3 d19/d28/d31/d38/db7/c103 0 2023-12-05T09:26:27.927 INFO:tasks.workunit.client.1.smithi134.stdout:2/785: write d19/d28/d63/fa5 [5430142,3897] 0 2023-12-05T09:26:27.934 INFO:tasks.workunit.client.0.smithi067.stdout:6/447: dread f4 [0,4194304] 0 2023-12-05T09:26:27.936 INFO:tasks.workunit.client.1.smithi134.stdout:4/725: dwrite f5 [4194304,4194304] 0 2023-12-05T09:26:27.936 INFO:tasks.workunit.client.0.smithi067.stdout:8/485: dread d5/dc/d1a/d20/f25 [0,4194304] 0 2023-12-05T09:26:27.942 INFO:tasks.workunit.client.1.smithi134.stdout:8/842: unlink da/de/d8a/d42/d99/dc8/fa8 0 2023-12-05T09:26:27.947 INFO:tasks.workunit.client.0.smithi067.stdout:9/701: rename d1b/d25/d35/c64 to d1b/d25/d54/d5c/de2/cec 0 2023-12-05T09:26:27.949 INFO:tasks.workunit.client.0.smithi067.stdout:3/454: creat d9/f9e x:0 0 0 2023-12-05T09:26:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:8/486: unlink d5/c67 0 2023-12-05T09:26:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:8/487: chown d5/da/f56 43674 1 2023-12-05T09:26:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:8/488: readlink d5/dc/d1a/d20/d2d/d41/l47 0 2023-12-05T09:26:27.951 INFO:tasks.workunit.client.0.smithi067.stdout:8/489: read - d5/dc/d1a/d20/f59 zero size 2023-12-05T09:26:27.951 INFO:tasks.workunit.client.1.smithi134.stdout:3/770: mkdir d4/d1f/df6 0 2023-12-05T09:26:27.953 INFO:tasks.workunit.client.0.smithi067.stdout:4/434: rename d0/d1d/d3c/l47 to d0/l96 0 2023-12-05T09:26:27.955 INFO:tasks.workunit.client.0.smithi067.stdout:3/455: rmdir d9/da/d15/d17/d1a/d51/d70/d95 0 2023-12-05T09:26:27.956 INFO:tasks.workunit.client.0.smithi067.stdout:8/490: mknod d5/dc/d1a/d62/c85 0 2023-12-05T09:26:27.961 INFO:tasks.workunit.client.0.smithi067.stdout:8/491: creat d5/dc/d1a/d20/d2d/d41/f86 x:0 0 0 2023-12-05T09:26:27.961 INFO:tasks.workunit.client.0.smithi067.stdout:8/492: fdatasync d5/dc/d1a/d20/d3e/f7a 0 2023-12-05T09:26:27.961 INFO:tasks.workunit.client.0.smithi067.stdout:8/493: fdatasync d5/da/d30/d61/d66/f81 0 2023-12-05T09:26:27.962 INFO:tasks.workunit.client.0.smithi067.stdout:8/494: truncate d5/dc/f6c 67027 0 2023-12-05T09:26:27.962 INFO:tasks.workunit.client.0.smithi067.stdout:7/469: sync 2023-12-05T09:26:27.962 INFO:tasks.workunit.client.0.smithi067.stdout:0/654: sync 2023-12-05T09:26:27.962 INFO:tasks.workunit.client.0.smithi067.stdout:0/655: fdatasync d3/d7/d3c/d67/d59/fe1 0 2023-12-05T09:26:27.965 INFO:tasks.workunit.client.0.smithi067.stdout:7/470: getdents d0/d9/d10 0 2023-12-05T09:26:27.966 INFO:tasks.workunit.client.0.smithi067.stdout:7/471: creat d0/d9/d40/f97 x:0 0 0 2023-12-05T09:26:27.994 INFO:tasks.workunit.client.0.smithi067.stdout:8/495: write d5/dc/d1a/d20/f22 [142119,121657] 0 2023-12-05T09:26:27.994 INFO:tasks.workunit.client.0.smithi067.stdout:8/496: read d5/dc/d1a/f2f [1368595,119663] 0 2023-12-05T09:26:27.994 INFO:tasks.workunit.client.0.smithi067.stdout:8/497: fsync d5/f1c 0 2023-12-05T09:26:28.056 INFO:tasks.workunit.client.1.smithi134.stdout:8/843: dwrite da/de/d4d/f10f [0,4194304] 0 2023-12-05T09:26:28.056 INFO:tasks.workunit.client.1.smithi134.stdout:8/844: truncate da/f89 905620 0 2023-12-05T09:26:28.056 INFO:tasks.workunit.client.1.smithi134.stdout:0/689: creat d13/d14/d30/fe9 x:0 0 0 2023-12-05T09:26:28.056 INFO:tasks.workunit.client.1.smithi134.stdout:0/690: write d13/d14/d15/d67/d73/f81 [338489,48007] 0 2023-12-05T09:26:28.056 INFO:tasks.workunit.client.1.smithi134.stdout:0/691: fsync d13/d14/d30/d4b/d23/d77/fae 0 2023-12-05T09:26:28.063 INFO:tasks.workunit.client.1.smithi134.stdout:6/683: mknod d4/d78/cd2 0 2023-12-05T09:26:28.063 INFO:tasks.workunit.client.0.smithi067.stdout:7/472: rename d0/d9/l3e to d0/d9/d10/d37/d38/d64/d34/l98 0 2023-12-05T09:26:28.064 INFO:tasks.workunit.client.0.smithi067.stdout:0/656: getdents d3/d7/d3c/d6c/d8a 0 2023-12-05T09:26:28.070 INFO:tasks.workunit.client.1.smithi134.stdout:2/786: creat d19/d28/d31/d38/d98/f104 x:0 0 0 2023-12-05T09:26:28.072 INFO:tasks.workunit.client.0.smithi067.stdout:0/657: dread d3/d7/f8f [0,4194304] 0 2023-12-05T09:26:28.075 INFO:tasks.workunit.client.1.smithi134.stdout:4/726: creat d16/d18/dc5/dc2/ffe x:0 0 0 2023-12-05T09:26:28.075 INFO:tasks.workunit.client.1.smithi134.stdout:4/727: write d16/d21/f62 [4430508,103485] 0 2023-12-05T09:26:28.078 INFO:tasks.workunit.client.1.smithi134.stdout:3/771: unlink d4/d1f/l3e 0 2023-12-05T09:26:28.080 INFO:tasks.workunit.client.0.smithi067.stdout:8/498: dwrite d5/dc/f3f [0,4194304] 0 2023-12-05T09:26:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:5/550: dwrite db/df/d36/f8a [0,4194304] 0 2023-12-05T09:26:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:7/473: read d0/f76 [532873,127762] 0 2023-12-05T09:26:28.086 INFO:tasks.workunit.client.1.smithi134.stdout:8/845: symlink da/de/d11/d1d/d70/l122 0 2023-12-05T09:26:28.087 INFO:tasks.workunit.client.1.smithi134.stdout:7/718: link d2/df/l1e d2/d7/dc/d2e/le7 0 2023-12-05T09:26:28.087 INFO:tasks.workunit.client.1.smithi134.stdout:7/719: write d2/d7/d2b/d94/fa1 [781836,38671] 0 2023-12-05T09:26:28.088 INFO:tasks.workunit.client.1.smithi134.stdout:7/720: write d2/dd/d1a/f23 [28249,74662] 0 2023-12-05T09:26:28.088 INFO:tasks.workunit.client.1.smithi134.stdout:7/721: readlink d2/df/d81/daf/lbc 0 2023-12-05T09:26:28.088 INFO:tasks.workunit.client.0.smithi067.stdout:8/499: mknod d5/dc/d1a/d20/d2d/d7f/c87 0 2023-12-05T09:26:28.095 INFO:tasks.workunit.client.1.smithi134.stdout:2/787: rename d19/d76/da7/fc7 to d19/d28/d31/d38/f105 0 2023-12-05T09:26:28.095 INFO:tasks.workunit.client.1.smithi134.stdout:8/846: unlink da/de/d4d/f6c 0 2023-12-05T09:26:28.095 INFO:tasks.workunit.client.1.smithi134.stdout:2/788: write d19/d28/d31/d6f/fa1 [633899,71483] 0 2023-12-05T09:26:28.095 INFO:tasks.workunit.client.1.smithi134.stdout:2/789: dread - d19/d76/da7/fec zero size 2023-12-05T09:26:28.095 INFO:tasks.workunit.client.1.smithi134.stdout:4/728: dread d16/f41 [0,4194304] 0 2023-12-05T09:26:28.096 INFO:tasks.workunit.client.0.smithi067.stdout:5/551: creat db/df/d3f/d88/d8d/fcc x:0 0 0 2023-12-05T09:26:28.096 INFO:tasks.workunit.client.1.smithi134.stdout:7/722: link d2/df/c53 d2/d70/ce8 0 2023-12-05T09:26:28.098 INFO:tasks.workunit.client.0.smithi067.stdout:3/456: dwrite d9/f27 [0,4194304] 0 2023-12-05T09:26:28.098 INFO:tasks.workunit.client.0.smithi067.stdout:6/448: dwrite da/d10/d1e/d17/d2f/d2c/d34/f74 [0,4194304] 0 2023-12-05T09:26:28.098 INFO:tasks.workunit.client.0.smithi067.stdout:6/449: chown da/d10/d1e/d17/d2f/d5f/l89 27 1 2023-12-05T09:26:28.099 INFO:tasks.workunit.client.1.smithi134.stdout:3/772: rename d4/d80/la9 to d4/d5/d45/d60/d85/lf7 0 2023-12-05T09:26:28.100 INFO:tasks.workunit.client.0.smithi067.stdout:9/702: dwrite d1b/d25/d5b/d62/fdc [0,4194304] 0 2023-12-05T09:26:28.101 INFO:tasks.workunit.client.1.smithi134.stdout:0/692: dwrite d13/d14/d30/f88 [0,4194304] 0 2023-12-05T09:26:28.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/474: creat d0/d9/d10/d37/d38/d64/d5a/f99 x:0 0 0 2023-12-05T09:26:28.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/475: write d0/d9/d40/f8d [600452,8697] 0 2023-12-05T09:26:28.102 INFO:tasks.workunit.client.0.smithi067.stdout:4/435: dwrite d0/d1d/d25/d32/f8f [0,4194304] 0 2023-12-05T09:26:28.102 INFO:tasks.workunit.client.0.smithi067.stdout:8/500: mknod d5/dc/d1a/c88 0 2023-12-05T09:26:28.102 INFO:tasks.workunit.client.1.smithi134.stdout:8/847: mknod da/c123 0 2023-12-05T09:26:28.102 INFO:tasks.workunit.client.1.smithi134.stdout:6/684: dwrite d4/d39/d42/d4f/d6d/d3a/d80/f81 [4194304,4194304] 0 2023-12-05T09:26:28.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/685: dread - d4/d39/d42/d4f/d6d/d3a/d75/fbe zero size 2023-12-05T09:26:28.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/686: write d4/d32/d57/f61 [4600986,46234] 0 2023-12-05T09:26:28.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/687: dread - d4/d39/d42/d4f/d6d/d9f/fc6 zero size 2023-12-05T09:26:28.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/688: write d4/d39/d42/d4f/d6d/d3a/f54 [4983179,53341] 0 2023-12-05T09:26:28.103 INFO:tasks.workunit.client.0.smithi067.stdout:5/552: link db/df/d1a/d1d/d20/c26 db/df/d35/ccd 0 2023-12-05T09:26:28.105 INFO:tasks.workunit.client.1.smithi134.stdout:2/790: symlink d19/d28/d2b/l106 0 2023-12-05T09:26:28.107 INFO:tasks.workunit.client.1.smithi134.stdout:7/723: mknod d2/d7/d2b/d2d/d67/d73/d26/ce9 0 2023-12-05T09:26:28.109 INFO:tasks.workunit.client.1.smithi134.stdout:5/697: sync 2023-12-05T09:26:28.109 INFO:tasks.workunit.client.1.smithi134.stdout:1/869: sync 2023-12-05T09:26:28.109 INFO:tasks.workunit.client.1.smithi134.stdout:9/736: sync 2023-12-05T09:26:28.112 INFO:tasks.workunit.client.1.smithi134.stdout:2/791: dread d19/d3f/f5a [0,4194304] 0 2023-12-05T09:26:28.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/450: dread da/d10/d1e/f36 [0,4194304] 0 2023-12-05T09:26:28.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/451: getdents da/d10/d1e/d51/d7b 0 2023-12-05T09:26:28.115 INFO:tasks.workunit.client.0.smithi067.stdout:6/452: chown da/d10/d1e/d17/d2f/d1f/f25 5 1 2023-12-05T09:26:28.115 INFO:tasks.workunit.client.1.smithi134.stdout:3/773: dread d4/d5/f10 [0,4194304] 0 2023-12-05T09:26:28.122 INFO:tasks.workunit.client.1.smithi134.stdout:0/693: write d13/d14/d30/d4b/d66/da0/daf/dde/f92 [1039891,110879] 0 2023-12-05T09:26:28.123 INFO:tasks.workunit.client.1.smithi134.stdout:6/689: mknod d4/d39/d42/d4f/d6d/cd3 0 2023-12-05T09:26:28.125 INFO:tasks.workunit.client.0.smithi067.stdout:9/703: symlink d1b/d25/d54/d5c/de2/led 0 2023-12-05T09:26:28.125 INFO:tasks.workunit.client.0.smithi067.stdout:9/704: stat d1b/d3e/d7f 0 2023-12-05T09:26:28.125 INFO:tasks.workunit.client.0.smithi067.stdout:9/705: chown d1b/d25/d54/d5c/de2/cec 25876 1 2023-12-05T09:26:28.125 INFO:tasks.workunit.client.0.smithi067.stdout:9/706: readlink d1b/l42 0 2023-12-05T09:26:28.127 INFO:tasks.workunit.client.1.smithi134.stdout:5/698: mknod d0/d11/d61/cf0 0 2023-12-05T09:26:28.135 INFO:tasks.workunit.client.1.smithi134.stdout:1/870: getdents d2/d27 0 2023-12-05T09:26:28.135 INFO:tasks.workunit.client.1.smithi134.stdout:3/774: write d4/d5/f1a [4960419,11829] 0 2023-12-05T09:26:28.135 INFO:tasks.workunit.client.1.smithi134.stdout:1/871: fdatasync d2/d9/d10/d5b/ffd 0 2023-12-05T09:26:28.138 INFO:tasks.workunit.client.0.smithi067.stdout:6/453: dread da/d10/d1e/f4b [0,4194304] 0 2023-12-05T09:26:28.140 INFO:tasks.workunit.client.1.smithi134.stdout:0/694: dread d13/d14/f6c [0,4194304] 0 2023-12-05T09:26:28.140 INFO:tasks.workunit.client.1.smithi134.stdout:0/695: chown d13/d14/d30/d4b/d23/d77/cd5 28 1 2023-12-05T09:26:28.141 INFO:tasks.workunit.client.1.smithi134.stdout:1/872: chown d2/d27/d9d/l130 56037482 1 2023-12-05T09:26:28.142 INFO:tasks.workunit.client.0.smithi067.stdout:7/476: creat d0/d9/d10/d37/d38/d64/d34/f9a x:0 0 0 2023-12-05T09:26:28.143 INFO:tasks.workunit.client.0.smithi067.stdout:7/477: readlink d0/d9/d40/d48/l79 0 2023-12-05T09:26:28.143 INFO:tasks.workunit.client.0.smithi067.stdout:7/478: write d0/d9/d10/d37/f2a [2301161,119622] 0 2023-12-05T09:26:28.143 INFO:tasks.workunit.client.0.smithi067.stdout:7/479: readlink d0/d9/d10/d37/l33 0 2023-12-05T09:26:28.147 INFO:tasks.workunit.client.0.smithi067.stdout:4/436: mknod d0/d1d/d2a/d93/c97 0 2023-12-05T09:26:28.149 INFO:tasks.workunit.client.1.smithi134.stdout:1/873: dread d2/d9/d10/d30/d66/da9/d74/d99/fe0 [0,4194304] 0 2023-12-05T09:26:28.150 INFO:tasks.workunit.client.1.smithi134.stdout:9/737: symlink d7/d8/d16/d52/d74/d97/deb/lfb 0 2023-12-05T09:26:28.150 INFO:tasks.workunit.client.1.smithi134.stdout:4/729: rename d16/d18/dc5/dc2/df6/d63/fab to d16/d21/fff 0 2023-12-05T09:26:28.150 INFO:tasks.workunit.client.1.smithi134.stdout:9/738: truncate d7/d8/d14/d26/f4a 666429 0 2023-12-05T09:26:28.152 INFO:tasks.workunit.client.0.smithi067.stdout:8/501: link d5/dc/d1a/d20/d2d/c5e d5/da/c89 0 2023-12-05T09:26:28.152 INFO:tasks.workunit.client.0.smithi067.stdout:8/502: chown d5/dc/d1a/d20/d2d/l3c 628 1 2023-12-05T09:26:28.158 INFO:tasks.workunit.client.1.smithi134.stdout:8/848: link da/de/d11/f1a da/de/d11/d1d/db8/f124 0 2023-12-05T09:26:28.159 INFO:tasks.workunit.client.0.smithi067.stdout:5/553: dwrite db/df/d82/fb3 [0,4194304] 0 2023-12-05T09:26:28.161 INFO:tasks.workunit.client.0.smithi067.stdout:3/457: creat d9/d49/f9f x:0 0 0 2023-12-05T09:26:28.166 INFO:tasks.workunit.client.1.smithi134.stdout:0/696: symlink d13/d14/d30/d4b/d66/da0/daf/dce/d86/dd8/lea 0 2023-12-05T09:26:28.166 INFO:tasks.workunit.client.1.smithi134.stdout:0/697: truncate d13/d14/d15/fad 142634 0 2023-12-05T09:26:28.168 INFO:tasks.workunit.client.0.smithi067.stdout:6/454: getdents da/d10/d1e/d69 0 2023-12-05T09:26:28.169 INFO:tasks.workunit.client.1.smithi134.stdout:5/699: rename d0/dd/faa to d0/dd/d37/d7d/ff1 0 2023-12-05T09:26:28.169 INFO:tasks.workunit.client.1.smithi134.stdout:5/700: creat d0/d1a/d1c/d25/d4d/d97/ff2 x:0 0 0 2023-12-05T09:26:28.170 INFO:tasks.workunit.client.0.smithi067.stdout:7/480: creat d0/d9/d10/d37/d82/f9b x:0 0 0 2023-12-05T09:26:28.171 INFO:tasks.workunit.client.1.smithi134.stdout:4/730: mknod d16/d18/d1b/c100 0 2023-12-05T09:26:28.172 INFO:tasks.workunit.client.0.smithi067.stdout:4/437: mkdir d0/d1d/d4d/d8d/d98 0 2023-12-05T09:26:28.174 INFO:tasks.workunit.client.0.smithi067.stdout:4/438: write d0/d1d/d25/d38/f39 [4297404,67372] 0 2023-12-05T09:26:28.176 INFO:tasks.workunit.client.1.smithi134.stdout:6/690: dread d4/d39/d42/d4f/d8a/fcc [0,4194304] 0 2023-12-05T09:26:28.177 INFO:tasks.workunit.client.1.smithi134.stdout:8/849: truncate da/de/d4d/f8d 1323593 0 2023-12-05T09:26:28.180 INFO:tasks.workunit.client.1.smithi134.stdout:4/731: dread d16/d21/f57 [0,4194304] 0 2023-12-05T09:26:28.180 INFO:tasks.workunit.client.1.smithi134.stdout:4/732: chown d16/d7b/dce 1 1 2023-12-05T09:26:28.182 INFO:tasks.workunit.client.1.smithi134.stdout:2/792: dwrite d19/d76/f9a [0,4194304] 0 2023-12-05T09:26:28.183 INFO:tasks.workunit.client.1.smithi134.stdout:7/724: dwrite d2/d7/dc/d2e/f9a [0,4194304] 0 2023-12-05T09:26:28.183 INFO:tasks.workunit.client.0.smithi067.stdout:3/458: unlink d9/d20/l99 0 2023-12-05T09:26:28.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/707: dwrite d1b/f51 [0,4194304] 0 2023-12-05T09:26:28.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/708: truncate d1b/dc2/fd1 312003 0 2023-12-05T09:26:28.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/709: dread - d1b/d25/d35/d56/fe3 zero size 2023-12-05T09:26:28.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/710: write d1b/d25/d94/fa1 [1062218,27002] 0 2023-12-05T09:26:28.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/711: stat d1b/dc2 0 2023-12-05T09:26:28.186 INFO:tasks.workunit.client.0.smithi067.stdout:6/455: creat da/fa1 x:0 0 0 2023-12-05T09:26:28.186 INFO:tasks.workunit.client.0.smithi067.stdout:6/456: creat da/d10/d1e/d17/d2f/d3f/d92/fa2 x:0 0 0 2023-12-05T09:26:28.187 INFO:tasks.workunit.client.0.smithi067.stdout:7/481: mkdir d0/d9/d10/d37/d38/d64/d9c 0 2023-12-05T09:26:28.193 INFO:tasks.workunit.client.0.smithi067.stdout:4/439: write d0/f8 [3719744,35780] 0 2023-12-05T09:26:28.194 INFO:tasks.workunit.client.0.smithi067.stdout:4/440: write d0/d9/f6b [71039,77958] 0 2023-12-05T09:26:28.197 INFO:tasks.workunit.client.1.smithi134.stdout:9/739: rename d7/d8/d14/l2c to d7/d8/d16/d52/d74/lfc 0 2023-12-05T09:26:28.198 INFO:tasks.workunit.client.0.smithi067.stdout:3/459: symlink d9/da/d15/d17/d1a/la0 0 2023-12-05T09:26:28.198 INFO:tasks.workunit.client.0.smithi067.stdout:3/460: readlink d9/da/d15/d28/d29/d47/d64/l81 0 2023-12-05T09:26:28.206 INFO:tasks.workunit.client.1.smithi134.stdout:2/793: write d19/d28/f81 [1953387,91506] 0 2023-12-05T09:26:28.207 INFO:tasks.workunit.client.1.smithi134.stdout:6/691: mkdir d4/d39/d42/d4f/d6d/d3a/dd4 0 2023-12-05T09:26:28.207 INFO:tasks.workunit.client.1.smithi134.stdout:6/692: chown d4/d39/d42/d4f/d6d/d45 24763 1 2023-12-05T09:26:28.208 INFO:tasks.workunit.client.0.smithi067.stdout:9/712: write d1b/d25/d35/f5e [1956401,90244] 0 2023-12-05T09:26:28.208 INFO:tasks.workunit.client.0.smithi067.stdout:9/713: stat d1b/d25/l45 0 2023-12-05T09:26:28.208 INFO:tasks.workunit.client.0.smithi067.stdout:9/714: read - d1b/f75 zero size 2023-12-05T09:26:28.210 INFO:tasks.workunit.client.1.smithi134.stdout:8/850: mknod da/de/d16/d33/c125 0 2023-12-05T09:26:28.212 INFO:tasks.workunit.client.1.smithi134.stdout:4/733: mkdir d16/d21/d48/d101 0 2023-12-05T09:26:28.212 INFO:tasks.workunit.client.1.smithi134.stdout:4/734: chown d16/d21/d48/d80/dae/d65 13 1 2023-12-05T09:26:28.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/482: rename d0/d9/d40/f68 to d0/d9/f9d 0 2023-12-05T09:26:28.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/483: fdatasync d0/d9/d40/d48/f91 0 2023-12-05T09:26:28.227 INFO:tasks.workunit.client.1.smithi134.stdout:4/735: write d16/d7b/dce/d6e/daa/f3e [7410002,69063] 0 2023-12-05T09:26:28.227 INFO:tasks.workunit.client.1.smithi134.stdout:4/736: write d16/d21/d48/d66/fdf [1186551,52862] 0 2023-12-05T09:26:28.228 INFO:tasks.workunit.client.1.smithi134.stdout:4/737: chown d16/d21/d48/d80/dae/cc9 9069215 1 2023-12-05T09:26:28.230 INFO:tasks.workunit.client.0.smithi067.stdout:3/461: unlink d9/da/f57 0 2023-12-05T09:26:28.234 INFO:tasks.workunit.client.0.smithi067.stdout:9/715: mkdir d1b/d25/d35/d56/dee 0 2023-12-05T09:26:28.234 INFO:tasks.workunit.client.0.smithi067.stdout:9/716: chown d1b/d25/d54/d5c/d8f/ce7 11 1 2023-12-05T09:26:28.237 INFO:tasks.workunit.client.1.smithi134.stdout:7/725: mknod d2/d7/d2b/dd9/cea 0 2023-12-05T09:26:28.244 INFO:tasks.workunit.client.0.smithi067.stdout:7/484: rmdir d0/d9/d40/d7a 39 2023-12-05T09:26:28.245 INFO:tasks.workunit.client.0.smithi067.stdout:7/485: fdatasync d0/d9/d10/d37/d38/d64/d54/f65 0 2023-12-05T09:26:28.247 INFO:tasks.workunit.client.0.smithi067.stdout:1/526: sync 2023-12-05T09:26:28.247 INFO:tasks.workunit.client.0.smithi067.stdout:1/527: truncate d2/d4f/d14/d48/f59 552033 0 2023-12-05T09:26:28.248 INFO:tasks.workunit.client.0.smithi067.stdout:2/475: sync 2023-12-05T09:26:28.249 INFO:tasks.workunit.client.0.smithi067.stdout:3/462: rename d9/da/d15/d28 to d9/da/d15/d17/d1a/d51/d66/d82/da1 0 2023-12-05T09:26:28.250 INFO:tasks.workunit.client.0.smithi067.stdout:3/463: dread - d9/d49/f9f zero size 2023-12-05T09:26:28.253 INFO:tasks.workunit.client.0.smithi067.stdout:5/554: dwrite db/df/f7e [4194304,4194304] 0 2023-12-05T09:26:28.253 INFO:tasks.workunit.client.0.smithi067.stdout:5/555: fsync db/df/d52/f9d 0 2023-12-05T09:26:28.253 INFO:tasks.workunit.client.0.smithi067.stdout:1/528: creat d2/d4f/d14/d20/d83/fc2 x:0 0 0 2023-12-05T09:26:28.256 INFO:tasks.workunit.client.1.smithi134.stdout:0/698: rename d13/d14/d15/le8 to d13/d14/d30/d4b/d66/da0/daf/dce/leb 0 2023-12-05T09:26:28.256 INFO:tasks.workunit.client.0.smithi067.stdout:6/457: dwrite da/d10/d1e/d17/d2f/d1f/f25 [0,4194304] 0 2023-12-05T09:26:28.259 INFO:tasks.workunit.client.0.smithi067.stdout:9/717: rename d1b/d25/d35/d9b to d1b/d25/d5b/d62/def 0 2023-12-05T09:26:28.263 INFO:tasks.workunit.client.0.smithi067.stdout:3/464: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/fa2 x:0 0 0 2023-12-05T09:26:28.264 INFO:tasks.workunit.client.1.smithi134.stdout:9/740: dwrite d7/d8/fb6 [0,4194304] 0 2023-12-05T09:26:28.264 INFO:tasks.workunit.client.1.smithi134.stdout:9/741: truncate d7/d8/d14/d26/d7f/d92/d53/dd4/ff6 632790 0 2023-12-05T09:26:28.264 INFO:tasks.workunit.client.1.smithi134.stdout:9/742: chown d7/d8/d16/d52/d74/d97/d99/lc1 5605 1 2023-12-05T09:26:28.269 INFO:tasks.workunit.client.0.smithi067.stdout:5/556: creat db/df/d82/fce x:0 0 0 2023-12-05T09:26:28.269 INFO:tasks.workunit.client.0.smithi067.stdout:5/557: truncate db/df/d3f/d88/d8d/fcc 943703 0 2023-12-05T09:26:28.270 INFO:tasks.workunit.client.1.smithi134.stdout:6/693: mknod d4/d78/d7a/cd5 0 2023-12-05T09:26:28.270 INFO:tasks.workunit.client.1.smithi134.stdout:4/738: dread d16/d21/fff [0,4194304] 0 2023-12-05T09:26:28.270 INFO:tasks.workunit.client.1.smithi134.stdout:4/739: truncate f4 9434021 0 2023-12-05T09:26:28.270 INFO:tasks.workunit.client.1.smithi134.stdout:8/851: dwrite da/de/d43/f5d [0,4194304] 0 2023-12-05T09:26:28.270 INFO:tasks.workunit.client.1.smithi134.stdout:8/852: fsync da/de/d11/d8b/d8c/fe0 0 2023-12-05T09:26:28.270 INFO:tasks.workunit.client.1.smithi134.stdout:8/853: chown da/de/d43/fa3 15296633 1 2023-12-05T09:26:28.270 INFO:tasks.workunit.client.0.smithi067.stdout:1/529: write d2/d5/d7/de/d1a/fbf [781018,130375] 0 2023-12-05T09:26:28.270 INFO:tasks.workunit.client.0.smithi067.stdout:1/530: fsync d2/d3/f21 0 2023-12-05T09:26:28.271 INFO:tasks.workunit.client.0.smithi067.stdout:7/486: write d0/d9/f9d [2603111,104511] 0 2023-12-05T09:26:28.271 INFO:tasks.workunit.client.0.smithi067.stdout:7/487: fdatasync d0/d9/d3f/f47 0 2023-12-05T09:26:28.276 INFO:tasks.workunit.client.1.smithi134.stdout:0/699: truncate f8 3168203 0 2023-12-05T09:26:28.276 INFO:tasks.workunit.client.0.smithi067.stdout:6/458: symlink da/d10/d1e/d51/la3 0 2023-12-05T09:26:28.276 INFO:tasks.workunit.client.0.smithi067.stdout:9/718: mkdir d1b/d25/d54/d5c/d81/df0 0 2023-12-05T09:26:28.278 INFO:tasks.workunit.client.0.smithi067.stdout:3/465: unlink d9/da/d15/d17/d1a/l6d 0 2023-12-05T09:26:28.284 INFO:tasks.workunit.client.0.smithi067.stdout:4/441: dwrite d0/fc [4194304,4194304] 0 2023-12-05T09:26:28.284 INFO:tasks.workunit.client.0.smithi067.stdout:4/442: write d0/d1d/d25/d2c/f8e [1045455,40310] 0 2023-12-05T09:26:28.284 INFO:tasks.workunit.client.0.smithi067.stdout:4/443: truncate d0/d9/f91 709788 0 2023-12-05T09:26:28.285 INFO:tasks.workunit.client.1.smithi134.stdout:2/794: rmdir d19/d3a 39 2023-12-05T09:26:28.285 INFO:tasks.workunit.client.1.smithi134.stdout:2/795: creat d19/d28/d31/d6f/f107 x:0 0 0 2023-12-05T09:26:28.289 INFO:tasks.workunit.client.1.smithi134.stdout:6/694: mknod d4/d39/d42/db0/cd6 0 2023-12-05T09:26:28.289 INFO:tasks.workunit.client.1.smithi134.stdout:6/695: write d4/d39/fc3 [920833,110036] 0 2023-12-05T09:26:28.289 INFO:tasks.workunit.client.1.smithi134.stdout:6/696: stat d4/d39/d42/d4f/d6d/d45/f5f 0 2023-12-05T09:26:28.289 INFO:tasks.workunit.client.1.smithi134.stdout:6/697: write d4/d39/d42/d4f/d6d/d3a/d75/fbe [927136,29840] 0 2023-12-05T09:26:28.289 INFO:tasks.workunit.client.1.smithi134.stdout:6/698: chown d4/d39/d42/d4f/d6d/d3a/da/l70 325 1 2023-12-05T09:26:28.290 INFO:tasks.workunit.client.1.smithi134.stdout:4/740: creat d16/d21/de5/f102 x:0 0 0 2023-12-05T09:26:28.290 INFO:tasks.workunit.client.1.smithi134.stdout:4/741: dread - d16/d18/d1b/d24/fcb zero size 2023-12-05T09:26:28.291 INFO:tasks.workunit.client.1.smithi134.stdout:4/742: chown d16/d7b/dce/d6e/daa/f8c 3133 1 2023-12-05T09:26:28.293 INFO:tasks.workunit.client.1.smithi134.stdout:5/701: rename d0/d1a/d1c/cc7 to d0/d11/cf3 0 2023-12-05T09:26:28.293 INFO:tasks.workunit.client.1.smithi134.stdout:2/796: dread d19/d3f/f88 [0,4194304] 0 2023-12-05T09:26:28.294 INFO:tasks.workunit.client.0.smithi067.stdout:7/488: getdents d0/d9/d10/d37/d38/d64/d34/d8c 0 2023-12-05T09:26:28.294 INFO:tasks.workunit.client.0.smithi067.stdout:7/489: chown d0/d9/d40/d48/f91 31981 1 2023-12-05T09:26:28.294 INFO:tasks.workunit.client.1.smithi134.stdout:3/775: sync 2023-12-05T09:26:28.295 INFO:tasks.workunit.client.1.smithi134.stdout:1/874: sync 2023-12-05T09:26:28.295 INFO:tasks.workunit.client.1.smithi134.stdout:3/776: write d4/d1f/d4e/f9f [570653,84834] 0 2023-12-05T09:26:28.299 INFO:tasks.workunit.client.1.smithi134.stdout:6/699: read d4/f26 [2770171,107618] 0 2023-12-05T09:26:28.301 INFO:tasks.workunit.client.1.smithi134.stdout:0/700: rename d13/d14/l18 to d13/d14/d30/d4b/d66/da0/daf/dce/d78/lec 0 2023-12-05T09:26:28.301 INFO:tasks.workunit.client.1.smithi134.stdout:0/701: fdatasync d13/d14/d15/d67/d73/f81 0 2023-12-05T09:26:28.302 INFO:tasks.workunit.client.1.smithi134.stdout:6/700: mkdir d4/d39/d42/d4f/d6d/d3a/d75/dbc/dd7 0 2023-12-05T09:26:28.304 INFO:tasks.workunit.client.0.smithi067.stdout:9/719: unlink d1b/d25/d94/fa1 0 2023-12-05T09:26:28.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/702: rename d13/d14/d30/d4b/d23/c6f to d13/d14/d30/d4b/d66/da0/daf/dce/d78/ced 0 2023-12-05T09:26:28.308 INFO:tasks.workunit.client.1.smithi134.stdout:0/703: unlink d13/d14/d30/d4b/f41 0 2023-12-05T09:26:28.310 INFO:tasks.workunit.client.0.smithi067.stdout:5/558: rmdir db/df/d35/d63/d75 39 2023-12-05T09:26:28.310 INFO:tasks.workunit.client.0.smithi067.stdout:5/559: readlink db/df/d1a/d1d/l40 0 2023-12-05T09:26:28.310 INFO:tasks.workunit.client.0.smithi067.stdout:3/466: write d9/d24/f68 [4985667,62027] 0 2023-12-05T09:26:28.311 INFO:tasks.workunit.client.1.smithi134.stdout:5/702: rename d0/d1a/d1c/d25/d4d/d97/l7a to d0/d1a/d1c/d3f/lf4 0 2023-12-05T09:26:28.313 INFO:tasks.workunit.client.0.smithi067.stdout:4/444: link d0/d1d/d25/d2c/d34/l4c d0/d1d/d25/d38/l99 0 2023-12-05T09:26:28.315 INFO:tasks.workunit.client.1.smithi134.stdout:1/875: rename d2/d9/c23 to d2/d9/d10/d30/d66/d10d/d12d/c132 0 2023-12-05T09:26:28.317 INFO:tasks.workunit.client.0.smithi067.stdout:3/467: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/ca3 0 2023-12-05T09:26:28.319 INFO:tasks.workunit.client.0.smithi067.stdout:4/445: rename d0/d1d/d25/d38/f57 to d0/d1d/d25/f9a 0 2023-12-05T09:26:28.321 INFO:tasks.workunit.client.1.smithi134.stdout:1/876: creat d2/d9/d8d/da2/db1/f133 x:0 0 0 2023-12-05T09:26:28.323 INFO:tasks.workunit.client.0.smithi067.stdout:3/468: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/ca4 0 2023-12-05T09:26:28.324 INFO:tasks.workunit.client.1.smithi134.stdout:1/877: mkdir d2/d9/d10/d30/d66/da9/d74/d99/d134 0 2023-12-05T09:26:28.325 INFO:tasks.workunit.client.1.smithi134.stdout:1/878: rmdir d2/d9/d8d 39 2023-12-05T09:26:28.327 INFO:tasks.workunit.client.1.smithi134.stdout:1/879: link d2/d27/l49 d2/d9/d10/d30/dd4/l135 0 2023-12-05T09:26:28.328 INFO:tasks.workunit.client.0.smithi067.stdout:3/469: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/la5 0 2023-12-05T09:26:28.329 INFO:tasks.workunit.client.1.smithi134.stdout:1/880: symlink d2/d9/d10/d5b/d5e/l136 0 2023-12-05T09:26:28.336 INFO:tasks.workunit.client.1.smithi134.stdout:1/881: rename d2/d27/d71/d80/cbf to d2/d9/d10/d30/dd4/dfb/c137 0 2023-12-05T09:26:28.337 INFO:tasks.workunit.client.1.smithi134.stdout:0/704: dread d13/d14/d30/d4b/d66/da0/daf/dce/d7d/f96 [0,4194304] 0 2023-12-05T09:26:28.338 INFO:tasks.workunit.client.1.smithi134.stdout:1/882: symlink d2/d9/l138 0 2023-12-05T09:26:28.369 INFO:tasks.workunit.client.0.smithi067.stdout:7/490: dread d0/d9/d40/d48/f66 [0,4194304] 0 2023-12-05T09:26:28.372 INFO:tasks.workunit.client.0.smithi067.stdout:7/491: link d0/d9/d40/d48/l79 d0/d9/d40/d48/l9e 0 2023-12-05T09:26:28.372 INFO:tasks.workunit.client.0.smithi067.stdout:7/492: fdatasync d0/d9/d56/f5b 0 2023-12-05T09:26:28.376 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:28 smithi067 ceph-mon[107174]: pgmap v29: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 229 MiB/s rd, 287 MiB/s wr, 405 op/s 2023-12-05T09:26:28.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:28 smithi134 ceph-mon[116304]: pgmap v29: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 229 MiB/s rd, 287 MiB/s wr, 405 op/s 2023-12-05T09:26:28.379 INFO:tasks.workunit.client.1.smithi134.stdout:1/883: write d2/f65 [3016025,86593] 0 2023-12-05T09:26:28.383 INFO:tasks.workunit.client.1.smithi134.stdout:8/854: dwrite da/de/d16/d98/fb5 [0,4194304] 0 2023-12-05T09:26:28.383 INFO:tasks.workunit.client.1.smithi134.stdout:8/855: creat da/de/d11/d1d/d5f/dea/f126 x:0 0 0 2023-12-05T09:26:28.386 INFO:tasks.workunit.client.0.smithi067.stdout:5/560: dread db/df/d3f/d88/f62 [0,4194304] 0 2023-12-05T09:26:28.404 INFO:tasks.workunit.client.0.smithi067.stdout:7/493: dread d0/d9/d10/f44 [4194304,4194304] 0 2023-12-05T09:26:28.408 INFO:tasks.workunit.client.1.smithi134.stdout:4/743: dwrite d16/d21/de5/f102 [0,4194304] 0 2023-12-05T09:26:28.409 INFO:tasks.workunit.client.1.smithi134.stdout:4/744: fdatasync d16/d7b/dce/d6e/daa/d3b/fa0 0 2023-12-05T09:26:28.409 INFO:tasks.workunit.client.1.smithi134.stdout:4/745: chown d16/d7b/dce/d6e/daa/f8c 349 1 2023-12-05T09:26:28.409 INFO:tasks.workunit.client.1.smithi134.stdout:4/746: chown d16/d18/dc5/dc2/df6/ddd 20806762 1 2023-12-05T09:26:28.411 INFO:tasks.workunit.client.0.smithi067.stdout:9/720: dwrite d1b/d25/d35/f83 [0,4194304] 0 2023-12-05T09:26:28.412 INFO:tasks.workunit.client.0.smithi067.stdout:1/531: dwrite d2/d5/d7/de/d1a/f4b [0,4194304] 0 2023-12-05T09:26:28.412 INFO:tasks.workunit.client.0.smithi067.stdout:1/532: readlink d2/d4f/d54/l7d 0 2023-12-05T09:26:28.417 INFO:tasks.workunit.client.1.smithi134.stdout:2/797: dwrite d19/d28/d2b/f2f [0,4194304] 0 2023-12-05T09:26:28.418 INFO:tasks.workunit.client.1.smithi134.stdout:6/701: dread d4/d39/d42/d4f/d6d/d3a/d75/fbe [0,4194304] 0 2023-12-05T09:26:28.418 INFO:tasks.workunit.client.1.smithi134.stdout:6/702: truncate d4/d39/d42/d4f/d6d/d3a/d80/f87 936296 0 2023-12-05T09:26:28.419 INFO:tasks.workunit.client.0.smithi067.stdout:3/470: dread d9/da/d15/d17/f32 [0,4194304] 0 2023-12-05T09:26:28.420 INFO:tasks.workunit.client.0.smithi067.stdout:2/476: dwrite d0/d25/d9d/d53/d1e/f74 [0,4194304] 0 2023-12-05T09:26:28.420 INFO:tasks.workunit.client.0.smithi067.stdout:2/477: creat d0/d2f/d39/fa5 x:0 0 0 2023-12-05T09:26:28.421 INFO:tasks.workunit.client.0.smithi067.stdout:7/494: dread d0/d9/d40/f8d [0,4194304] 0 2023-12-05T09:26:28.422 INFO:tasks.workunit.client.1.smithi134.stdout:7/726: dwrite d2/d7/dc/d2e/d3a/f4e [0,4194304] 0 2023-12-05T09:26:28.423 INFO:tasks.workunit.client.1.smithi134.stdout:0/705: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/f92 [0,4194304] 0 2023-12-05T09:26:28.423 INFO:tasks.workunit.client.1.smithi134.stdout:0/706: truncate d13/d14/fdc 1323097 0 2023-12-05T09:26:28.424 INFO:tasks.workunit.client.0.smithi067.stdout:6/459: dwrite da/d10/d1e/d17/d2f/d47/f4c [0,4194304] 0 2023-12-05T09:26:28.435 INFO:tasks.workunit.client.0.smithi067.stdout:9/721: rename d1b/d25/f2d to d1b/d25/d54/d5c/ff1 0 2023-12-05T09:26:28.440 INFO:tasks.workunit.client.1.smithi134.stdout:6/703: creat d4/d39/d42/d4f/d6d/d3a/da/da0/fd8 x:0 0 0 2023-12-05T09:26:28.446 INFO:tasks.workunit.client.0.smithi067.stdout:1/533: creat d2/d4f/d54/d70/db4/fc3 x:0 0 0 2023-12-05T09:26:28.446 INFO:tasks.workunit.client.0.smithi067.stdout:1/534: write d2/d3/f1d [3501980,54904] 0 2023-12-05T09:26:28.448 INFO:tasks.workunit.client.0.smithi067.stdout:4/446: dwrite d0/d1d/d2a/f7e [0,4194304] 0 2023-12-05T09:26:28.448 INFO:tasks.workunit.client.1.smithi134.stdout:0/707: dread d13/d14/d30/f7e [0,4194304] 0 2023-12-05T09:26:28.449 INFO:tasks.workunit.client.0.smithi067.stdout:6/460: dread da/d10/d1e/d17/f81 [0,4194304] 0 2023-12-05T09:26:28.449 INFO:tasks.workunit.client.0.smithi067.stdout:6/461: chown da 1538 1 2023-12-05T09:26:28.449 INFO:tasks.workunit.client.1.smithi134.stdout:4/747: dwrite d16/d7b/db6/ffa [0,4194304] 0 2023-12-05T09:26:28.454 INFO:tasks.workunit.client.0.smithi067.stdout:3/471: creat d9/da/d15/d17/fa6 x:0 0 0 2023-12-05T09:26:28.456 INFO:tasks.workunit.client.1.smithi134.stdout:2/798: dread f17 [0,4194304] 0 2023-12-05T09:26:28.456 INFO:tasks.workunit.client.1.smithi134.stdout:2/799: chown d19/d3a/df4/c4a 4 1 2023-12-05T09:26:28.458 INFO:tasks.workunit.client.1.smithi134.stdout:1/884: dwrite d2/d27/f8a [4194304,4194304] 0 2023-12-05T09:26:28.459 INFO:tasks.workunit.client.1.smithi134.stdout:7/727: creat d2/d7/d6f/feb x:0 0 0 2023-12-05T09:26:28.460 INFO:tasks.workunit.client.1.smithi134.stdout:8/856: dwrite da/de/f4c [0,4194304] 0 2023-12-05T09:26:28.460 INFO:tasks.workunit.client.0.smithi067.stdout:7/495: creat d0/d9/d56/d8e/f9f x:0 0 0 2023-12-05T09:26:28.463 INFO:tasks.workunit.client.1.smithi134.stdout:6/704: link d4/d78/d7a/l90 d4/d39/d42/d4f/d6d/d9f/ld9 0 2023-12-05T09:26:28.466 INFO:tasks.workunit.client.0.smithi067.stdout:4/447: write d0/d1d/d2b/d50/d15/f20 [3213345,68857] 0 2023-12-05T09:26:28.468 INFO:tasks.workunit.client.1.smithi134.stdout:0/708: mkdir d13/d14/d15/dee 0 2023-12-05T09:26:28.469 INFO:tasks.workunit.client.0.smithi067.stdout:5/561: dwrite db/df/f16 [0,4194304] 0 2023-12-05T09:26:28.469 INFO:tasks.workunit.client.0.smithi067.stdout:5/562: stat db/df/d3f/d88/c97 0 2023-12-05T09:26:28.470 INFO:tasks.workunit.client.0.smithi067.stdout:2/478: dwrite d0/d2f/d39/f89 [0,4194304] 0 2023-12-05T09:26:28.472 INFO:tasks.workunit.client.1.smithi134.stdout:4/748: mkdir d16/d7b/dce/d103 0 2023-12-05T09:26:28.472 INFO:tasks.workunit.client.1.smithi134.stdout:4/749: write d16/d21/d35/fa5 [220558,40178] 0 2023-12-05T09:26:28.475 INFO:tasks.workunit.client.1.smithi134.stdout:2/800: symlink d19/d3a/d60/l108 0 2023-12-05T09:26:28.478 INFO:tasks.workunit.client.1.smithi134.stdout:1/885: mkdir d2/d9/d10/d30/d66/d10d/d11d/d139 0 2023-12-05T09:26:28.481 INFO:tasks.workunit.client.1.smithi134.stdout:7/728: creat d2/d7/d2b/d2d/d67/dbb/fec x:0 0 0 2023-12-05T09:26:28.481 INFO:tasks.workunit.client.1.smithi134.stdout:7/729: write d2/d7/d2b/d2d/d67/d73/f5b [4553397,43381] 0 2023-12-05T09:26:28.482 INFO:tasks.workunit.client.0.smithi067.stdout:9/722: creat d1b/dd3/d82/ff2 x:0 0 0 2023-12-05T09:26:28.485 INFO:tasks.workunit.client.1.smithi134.stdout:7/730: write d2/d7/fe0 [298813,74910] 0 2023-12-05T09:26:28.490 INFO:tasks.workunit.client.0.smithi067.stdout:1/535: unlink d2/d5/c81 0 2023-12-05T09:26:28.490 INFO:tasks.workunit.client.0.smithi067.stdout:1/536: read d2/d4f/d14/d20/d83/f6e [3979805,67036] 0 2023-12-05T09:26:28.499 INFO:tasks.workunit.client.0.smithi067.stdout:6/462: creat da/d10/d1e/d17/d2f/d47/d19/fa4 x:0 0 0 2023-12-05T09:26:28.509 INFO:tasks.workunit.client.0.smithi067.stdout:4/448: creat d0/d1d/d4d/f9b x:0 0 0 2023-12-05T09:26:28.509 INFO:tasks.workunit.client.0.smithi067.stdout:4/449: chown d0/d1d/l54 2 1 2023-12-05T09:26:28.514 INFO:tasks.workunit.client.1.smithi134.stdout:6/705: rename d4/d39/d42/db0 to d4/d39/d5c/dda 0 2023-12-05T09:26:28.515 INFO:tasks.workunit.client.0.smithi067.stdout:5/563: unlink db/df/d35/fb1 0 2023-12-05T09:26:28.515 INFO:tasks.workunit.client.1.smithi134.stdout:8/857: dwrite da/de/d8a/fd1 [0,4194304] 0 2023-12-05T09:26:28.520 INFO:tasks.workunit.client.1.smithi134.stdout:0/709: link d13/d14/d15/fad d13/d14/d30/fef 0 2023-12-05T09:26:28.520 INFO:tasks.workunit.client.1.smithi134.stdout:0/710: truncate d13/d14/d30/d4b/d66/da0/daf/dce/d7d/fbd 153711 0 2023-12-05T09:26:28.520 INFO:tasks.workunit.client.1.smithi134.stdout:0/711: write d13/d14/d15/d67/fcb [250716,24072] 0 2023-12-05T09:26:28.525 INFO:tasks.workunit.client.1.smithi134.stdout:4/750: link d16/d21/l84 d16/d9c/l104 0 2023-12-05T09:26:28.525 INFO:tasks.workunit.client.1.smithi134.stdout:4/751: chown d16/d18/d1b/d24/lc1 132917381 1 2023-12-05T09:26:28.534 INFO:tasks.workunit.client.1.smithi134.stdout:7/731: mkdir d2/df/d2a/d36/ded 0 2023-12-05T09:26:28.538 INFO:tasks.workunit.client.1.smithi134.stdout:2/801: rename d19/d3a/lca to d19/d28/d9e/l109 0 2023-12-05T09:26:28.538 INFO:tasks.workunit.client.1.smithi134.stdout:1/886: dwrite d2/d9/d10/d30/d66/da9/d74/d99/fe0 [0,4194304] 0 2023-12-05T09:26:28.541 INFO:tasks.workunit.client.0.smithi067.stdout:6/463: dread da/d10/d1e/d17/f23 [4194304,4194304] 0 2023-12-05T09:26:28.546 INFO:tasks.workunit.client.0.smithi067.stdout:2/479: dread d0/d25/d34/d4d/d72/f8c [0,4194304] 0 2023-12-05T09:26:28.546 INFO:tasks.workunit.client.0.smithi067.stdout:2/480: fdatasync d0/d25/d9d/d53/f7e 0 2023-12-05T09:26:28.547 INFO:tasks.workunit.client.1.smithi134.stdout:6/706: mkdir d4/d39/d42/d4f/d6d/d3a/da/da4/ddb 0 2023-12-05T09:26:28.555 INFO:tasks.workunit.client.1.smithi134.stdout:8/858: symlink da/de/d8a/d42/d99/dc8/d72/l127 0 2023-12-05T09:26:28.555 INFO:tasks.workunit.client.1.smithi134.stdout:8/859: chown da/de/d8a 3589 1 2023-12-05T09:26:28.556 INFO:tasks.workunit.client.0.smithi067.stdout:7/496: dwrite d0/d9/d10/d37/d38/f51 [0,4194304] 0 2023-12-05T09:26:28.556 INFO:tasks.workunit.client.0.smithi067.stdout:7/497: creat d0/d9/d40/fa0 x:0 0 0 2023-12-05T09:26:28.556 INFO:tasks.workunit.client.0.smithi067.stdout:7/498: creat d0/d9/d10/d37/d38/d64/d5a/fa1 x:0 0 0 2023-12-05T09:26:28.560 INFO:tasks.workunit.client.1.smithi134.stdout:9/743: sync 2023-12-05T09:26:28.560 INFO:tasks.workunit.client.1.smithi134.stdout:5/703: sync 2023-12-05T09:26:28.560 INFO:tasks.workunit.client.1.smithi134.stdout:3/777: sync 2023-12-05T09:26:28.562 INFO:tasks.workunit.client.0.smithi067.stdout:5/564: dwrite db/df/d1a/f21 [0,4194304] 0 2023-12-05T09:26:28.563 INFO:tasks.workunit.client.1.smithi134.stdout:7/732: rmdir d2/d7/d93/dcf 39 2023-12-05T09:26:28.563 INFO:tasks.workunit.client.1.smithi134.stdout:7/733: creat d2/d7/dc/d2e/d3a/fee x:0 0 0 2023-12-05T09:26:28.565 INFO:tasks.workunit.client.1.smithi134.stdout:5/704: write d0/dd/d37/d7d/ff1 [338969,76878] 0 2023-12-05T09:26:28.565 INFO:tasks.workunit.client.1.smithi134.stdout:5/705: stat d0/d50/fdc 0 2023-12-05T09:26:28.570 INFO:tasks.workunit.client.1.smithi134.stdout:1/887: link d2/d9/d10/d30/d66/cce d2/d9/d10/d5b/dc4/c13a 0 2023-12-05T09:26:28.570 INFO:tasks.workunit.client.1.smithi134.stdout:1/888: write d2/d9/d10/d30/d66/da9/f7f [1191257,105153] 0 2023-12-05T09:26:28.573 INFO:tasks.workunit.client.0.smithi067.stdout:7/499: dread d0/d9/d56/f5b [0,4194304] 0 2023-12-05T09:26:28.573 INFO:tasks.workunit.client.0.smithi067.stdout:7/500: creat d0/d9/d10/d37/d38/d64/d5a/fa2 x:0 0 0 2023-12-05T09:26:28.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/472: rmdir d9 39 2023-12-05T09:26:28.575 INFO:tasks.workunit.client.0.smithi067.stdout:3/473: fsync d9/d62/f8f 0 2023-12-05T09:26:28.575 INFO:tasks.workunit.client.0.smithi067.stdout:4/450: creat d0/d1d/d2b/d50/d15/f9c x:0 0 0 2023-12-05T09:26:28.576 INFO:tasks.workunit.client.1.smithi134.stdout:6/707: mknod d4/d39/d42/d4f/d6d/d3a/dd4/cdc 0 2023-12-05T09:26:28.576 INFO:tasks.workunit.client.1.smithi134.stdout:6/708: readlink d4/d39/d42/d4f/d6d/d3a/da/l70 0 2023-12-05T09:26:28.578 INFO:tasks.workunit.client.1.smithi134.stdout:9/744: mknod d7/d8/cfd 0 2023-12-05T09:26:28.579 INFO:tasks.workunit.client.0.smithi067.stdout:6/464: mknod da/d10/d1e/d17/d2f/d59/ca5 0 2023-12-05T09:26:28.579 INFO:tasks.workunit.client.0.smithi067.stdout:6/465: readlink da/d10/d1e/d17/d2f/d47/d19/l75 0 2023-12-05T09:26:28.581 INFO:tasks.workunit.client.0.smithi067.stdout:3/474: dread d9/d24/f33 [0,4194304] 0 2023-12-05T09:26:28.586 INFO:tasks.workunit.client.1.smithi134.stdout:5/706: symlink d0/d1a/d1c/d3f/d81/d8e/lf5 0 2023-12-05T09:26:28.587 INFO:tasks.workunit.client.1.smithi134.stdout:1/889: dread d2/d9/d10/d94/de5/d112/fd3 [0,4194304] 0 2023-12-05T09:26:28.588 INFO:tasks.workunit.client.1.smithi134.stdout:4/752: rename d16/d18/dc5/dc2/df6/d63/l91 to d16/d21/l105 0 2023-12-05T09:26:28.588 INFO:tasks.workunit.client.1.smithi134.stdout:4/753: chown d16/d7b/dce/d6e/ff3 3 1 2023-12-05T09:26:28.592 INFO:tasks.workunit.client.1.smithi134.stdout:5/707: creat d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/ff6 x:0 0 0 2023-12-05T09:26:28.592 INFO:tasks.workunit.client.1.smithi134.stdout:5/708: dread - d0/d50/fa4 zero size 2023-12-05T09:26:28.592 INFO:tasks.workunit.client.0.smithi067.stdout:4/451: dread d0/f4 [0,4194304] 0 2023-12-05T09:26:28.592 INFO:tasks.workunit.client.0.smithi067.stdout:4/452: write d0/d1d/d25/d2c/f3a [354589,119458] 0 2023-12-05T09:26:28.592 INFO:tasks.workunit.client.0.smithi067.stdout:4/453: chown d0/d9/c75 488563 1 2023-12-05T09:26:28.595 INFO:tasks.workunit.client.0.smithi067.stdout:1/537: dwrite d2/d5/f6f [0,4194304] 0 2023-12-05T09:26:28.596 INFO:tasks.workunit.client.0.smithi067.stdout:1/538: truncate d2/d3/da6/fb1 1091003 0 2023-12-05T09:26:28.596 INFO:tasks.workunit.client.1.smithi134.stdout:1/890: mknod d2/d9/d8d/da2/c13b 0 2023-12-05T09:26:28.596 INFO:tasks.workunit.client.1.smithi134.stdout:1/891: fsync d2/d9/d10/f92 0 2023-12-05T09:26:28.599 INFO:tasks.workunit.client.1.smithi134.stdout:2/802: rename d19/d5f/ff9 to d19/d76/db9/f10a 0 2023-12-05T09:26:28.603 INFO:tasks.workunit.client.1.smithi134.stdout:4/754: mknod d16/d21/d48/c106 0 2023-12-05T09:26:28.603 INFO:tasks.workunit.client.1.smithi134.stdout:4/755: creat d16/d18/dc5/f107 x:0 0 0 2023-12-05T09:26:28.603 INFO:tasks.workunit.client.0.smithi067.stdout:5/565: rename db/df/d36/cbc to db/df/d3f/ccf 0 2023-12-05T09:26:28.603 INFO:tasks.workunit.client.0.smithi067.stdout:5/566: truncate db/df/d3f/d88/d8d/fcc 1710885 0 2023-12-05T09:26:28.605 INFO:tasks.workunit.client.1.smithi134.stdout:1/892: mkdir d2/d9/d10/d30/d66/da9/d13c 0 2023-12-05T09:26:28.615 INFO:tasks.workunit.client.1.smithi134.stdout:6/709: rename d4/d39/d42/d4f/d6d/d45/f95 to d4/d78/fdd 0 2023-12-05T09:26:28.616 INFO:tasks.workunit.client.0.smithi067.stdout:7/501: creat d0/d9/d40/d7a/fa3 x:0 0 0 2023-12-05T09:26:28.617 INFO:tasks.workunit.client.1.smithi134.stdout:2/803: rmdir d19/d3a/d60 39 2023-12-05T09:26:28.617 INFO:tasks.workunit.client.1.smithi134.stdout:2/804: dread - d19/d28/d2b/ff2 zero size 2023-12-05T09:26:28.617 INFO:tasks.workunit.client.1.smithi134.stdout:2/805: chown d19/d28/d31/d38/d98/l9d 3356 1 2023-12-05T09:26:28.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/481: dwrite d0/d2f/d39/f6f [0,4194304] 0 2023-12-05T09:26:28.624 INFO:tasks.workunit.client.0.smithi067.stdout:2/482: fdatasync d0/d25/d9d/d53/d1e/f2d 0 2023-12-05T09:26:28.625 INFO:tasks.workunit.client.0.smithi067.stdout:2/483: truncate d0/d2f/d39/f86 793301 0 2023-12-05T09:26:28.627 INFO:tasks.workunit.client.1.smithi134.stdout:8/860: dwrite da/de/d11/d1d/d5f/dea/f126 [0,4194304] 0 2023-12-05T09:26:28.629 INFO:tasks.workunit.client.1.smithi134.stdout:8/861: write da/de/d8a/d42/d99/fb6 [2306261,49979] 0 2023-12-05T09:26:28.630 INFO:tasks.workunit.client.1.smithi134.stdout:8/862: write da/de/d96/dc9/f116 [5179393,117918] 0 2023-12-05T09:26:28.630 INFO:tasks.workunit.client.1.smithi134.stdout:8/863: write da/de/d43/faf [743505,26561] 0 2023-12-05T09:26:28.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/502: dread d0/d9/d10/d37/d38/f51 [0,4194304] 0 2023-12-05T09:26:28.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/503: chown d0/d9/d40/d48/l9e 8492614 1 2023-12-05T09:26:28.643 INFO:tasks.workunit.client.1.smithi134.stdout:7/734: dwrite d2/d7/d6f/f90 [8388608,4194304] 0 2023-12-05T09:26:28.643 INFO:tasks.workunit.client.1.smithi134.stdout:3/778: dwrite d4/d5/d6f/d97/dae/dc9/f30 [0,4194304] 0 2023-12-05T09:26:28.650 INFO:tasks.workunit.client.1.smithi134.stdout:8/864: write da/de/d16/d33/fcd [1169953,50435] 0 2023-12-05T09:26:28.663 INFO:tasks.workunit.client.1.smithi134.stdout:5/709: dwrite d0/d1a/d1c/d3f/d5b/d5d/fd2 [4194304,4194304] 0 2023-12-05T09:26:28.668 INFO:tasks.workunit.client.0.smithi067.stdout:1/539: dwrite d2/d4f/d15/f29 [0,4194304] 0 2023-12-05T09:26:28.668 INFO:tasks.workunit.client.0.smithi067.stdout:1/540: chown d2/d4f/d14/d20/d4c/f65 15 1 2023-12-05T09:26:28.668 INFO:tasks.workunit.client.0.smithi067.stdout:1/541: write d2/d3/fc0 [32354,40267] 0 2023-12-05T09:26:28.676 INFO:tasks.workunit.client.0.smithi067.stdout:3/475: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/la7 0 2023-12-05T09:26:28.676 INFO:tasks.workunit.client.0.smithi067.stdout:3/476: fdatasync d9/d62/f4c 0 2023-12-05T09:26:28.676 INFO:tasks.workunit.client.0.smithi067.stdout:3/477: chown d9/da/d15/d17/d1a/d51/d66/l6e 8490 1 2023-12-05T09:26:28.679 INFO:tasks.workunit.client.0.smithi067.stdout:4/454: creat d0/d1d/d25/d5c/f9d x:0 0 0 2023-12-05T09:26:28.680 INFO:tasks.workunit.client.0.smithi067.stdout:4/455: truncate d0/d1d/d25/d2c/d34/f5e 310507 0 2023-12-05T09:26:28.680 INFO:tasks.workunit.client.0.smithi067.stdout:4/456: fdatasync d0/d1d/d24/f6f 0 2023-12-05T09:26:28.680 INFO:tasks.workunit.client.0.smithi067.stdout:4/457: fdatasync d0/d9/f4a 0 2023-12-05T09:26:28.683 INFO:tasks.workunit.client.1.smithi134.stdout:6/710: rename d4/d32/l4c to d4/d39/d42/d4f/lde 0 2023-12-05T09:26:28.683 INFO:tasks.workunit.client.1.smithi134.stdout:6/711: write d4/d39/d42/d4f/d6d/d3a/d80/fd0 [380276,115803] 0 2023-12-05T09:26:28.688 INFO:tasks.workunit.client.1.smithi134.stdout:2/806: dwrite fd [4194304,4194304] 0 2023-12-05T09:26:28.692 INFO:tasks.workunit.client.0.smithi067.stdout:2/484: mknod d0/d2f/d39/ca6 0 2023-12-05T09:26:28.696 INFO:tasks.workunit.client.0.smithi067.stdout:7/504: mkdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da4 0 2023-12-05T09:26:28.702 INFO:tasks.workunit.client.1.smithi134.stdout:1/893: dread d2/d27/d9d/fa6 [0,4194304] 0 2023-12-05T09:26:28.702 INFO:tasks.workunit.client.1.smithi134.stdout:1/894: creat d2/d9/d8d/da2/db1/f13d x:0 0 0 2023-12-05T09:26:28.703 INFO:tasks.workunit.client.1.smithi134.stdout:1/895: chown d2/d27/f8a 69 1 2023-12-05T09:26:28.705 INFO:tasks.workunit.client.1.smithi134.stdout:2/807: dread d19/d28/d31/d38/f59 [0,4194304] 0 2023-12-05T09:26:28.710 INFO:tasks.workunit.client.1.smithi134.stdout:3/779: dwrite d4/d1f/f3a [0,4194304] 0 2023-12-05T09:26:28.711 INFO:tasks.workunit.client.1.smithi134.stdout:7/735: mkdir d2/df/d81/def 0 2023-12-05T09:26:28.712 INFO:tasks.workunit.client.0.smithi067.stdout:1/542: mknod d2/d5/d7/d6a/db7/cc4 0 2023-12-05T09:26:28.713 INFO:tasks.workunit.client.0.smithi067.stdout:0/658: sync 2023-12-05T09:26:28.713 INFO:tasks.workunit.client.0.smithi067.stdout:8/503: sync 2023-12-05T09:26:28.716 INFO:tasks.workunit.client.0.smithi067.stdout:3/478: rmdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64 39 2023-12-05T09:26:28.717 INFO:tasks.workunit.client.1.smithi134.stdout:8/865: link da/de/d11/d8b/f10c da/de/d96/d9d/d109/f128 0 2023-12-05T09:26:28.717 INFO:tasks.workunit.client.0.smithi067.stdout:2/485: dread d0/d2f/d39/f89 [0,4194304] 0 2023-12-05T09:26:28.718 INFO:tasks.workunit.client.0.smithi067.stdout:4/458: mknod d0/d1d/d4d/d8d/d98/c9e 0 2023-12-05T09:26:28.719 INFO:tasks.workunit.client.1.smithi134.stdout:5/710: stat d0/d45/l8d 0 2023-12-05T09:26:28.719 INFO:tasks.workunit.client.1.smithi134.stdout:5/711: readlink d0/dd/l28 0 2023-12-05T09:26:28.719 INFO:tasks.workunit.client.1.smithi134.stdout:5/712: fdatasync d0/d1a/d1c/d3f/d5b/d5d/d78/fd7 0 2023-12-05T09:26:28.722 INFO:tasks.workunit.client.1.smithi134.stdout:5/713: write d0/f46 [432851,39590] 0 2023-12-05T09:26:28.724 INFO:tasks.workunit.client.1.smithi134.stdout:9/745: rename d7/d8/d14/d26/d5a/d69/ca3 to d7/d10/cfe 0 2023-12-05T09:26:28.734 INFO:tasks.workunit.client.0.smithi067.stdout:6/466: rename da/d10/d1e/d17/d2f/d47 to da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6 0 2023-12-05T09:26:28.734 INFO:tasks.workunit.client.0.smithi067.stdout:6/467: creat da/d10/d1e/d17/d2f/d72/fa7 x:0 0 0 2023-12-05T09:26:28.738 INFO:tasks.workunit.client.0.smithi067.stdout:7/505: link d0/d9/d10/d1d/l6e d0/d9/d10/d37/d38/d64/d34/d67/d72/la5 0 2023-12-05T09:26:28.744 INFO:tasks.workunit.client.1.smithi134.stdout:7/736: link d2/dd/d1a/c9b d2/d7/d2b/dd9/cf0 0 2023-12-05T09:26:28.746 INFO:tasks.workunit.client.0.smithi067.stdout:8/504: mkdir d5/dc/d1a/d20/d2d/d8a 0 2023-12-05T09:26:28.746 INFO:tasks.workunit.client.1.smithi134.stdout:1/896: dwrite d2/d9/d10/d94/fd9 [0,4194304] 0 2023-12-05T09:26:28.748 INFO:tasks.workunit.client.0.smithi067.stdout:0/659: symlink d3/d7/d3c/d67/d59/lef 0 2023-12-05T09:26:28.750 INFO:tasks.workunit.client.1.smithi134.stdout:4/756: rename d16/d18/dc5/dc2/df6/l1e to d16/d18/d1b/l108 0 2023-12-05T09:26:28.750 INFO:tasks.workunit.client.1.smithi134.stdout:4/757: creat d16/d21/d48/d66/db0/db3/f109 x:0 0 0 2023-12-05T09:26:28.751 INFO:tasks.workunit.client.0.smithi067.stdout:3/479: symlink d9/d24/la8 0 2023-12-05T09:26:28.751 INFO:tasks.workunit.client.0.smithi067.stdout:3/480: chown d9/da/f6c 0 1 2023-12-05T09:26:28.753 INFO:tasks.workunit.client.0.smithi067.stdout:2/486: mknod d0/d25/ca7 0 2023-12-05T09:26:28.755 INFO:tasks.workunit.client.1.smithi134.stdout:3/780: dwrite d4/d5/f95 [0,4194304] 0 2023-12-05T09:26:28.757 INFO:tasks.workunit.client.1.smithi134.stdout:6/712: rename d4/d39/d42/d4f/d6d/d45/f9c to d4/d39/d42/d4f/d6d/d3a/da/da0/fdf 0 2023-12-05T09:26:28.757 INFO:tasks.workunit.client.1.smithi134.stdout:6/713: dread - d4/d39/d42/fa7 zero size 2023-12-05T09:26:28.757 INFO:tasks.workunit.client.1.smithi134.stdout:2/808: dwrite d19/d28/d31/d38/db7/fc2 [0,4194304] 0 2023-12-05T09:26:28.762 INFO:tasks.workunit.client.1.smithi134.stdout:7/737: read d2/d7/dc/d22/f85 [2233410,31712] 0 2023-12-05T09:26:28.762 INFO:tasks.workunit.client.1.smithi134.stdout:7/738: creat d2/d7/d2b/d2d/ff1 x:0 0 0 2023-12-05T09:26:28.763 INFO:tasks.workunit.client.0.smithi067.stdout:6/468: rename da/d10/d1e/d17/f41 to da/d10/d1e/d17/d2f/d1f/d27/fa8 0 2023-12-05T09:26:28.765 INFO:tasks.workunit.client.0.smithi067.stdout:8/505: symlink d5/da/d30/d61/l8b 0 2023-12-05T09:26:28.768 INFO:tasks.workunit.client.1.smithi134.stdout:8/866: rename da/de/d16/d98/fdc to da/de/d8a/d42/d99/df5/f129 0 2023-12-05T09:26:28.768 INFO:tasks.workunit.client.1.smithi134.stdout:1/897: rename d2/d9/d8d/da2 to d2/d9/d8d/da2/db1/d13e 22 2023-12-05T09:26:28.768 INFO:tasks.workunit.client.1.smithi134.stdout:8/867: stat da/de/d11/fcc 0 2023-12-05T09:26:28.769 INFO:tasks.workunit.client.1.smithi134.stdout:8/868: write da/de/d11/d1d/f92 [622081,107088] 0 2023-12-05T09:26:28.769 INFO:tasks.workunit.client.1.smithi134.stdout:8/869: creat da/de/d11/d1d/f12a x:0 0 0 2023-12-05T09:26:28.769 INFO:tasks.workunit.client.1.smithi134.stdout:0/712: sync 2023-12-05T09:26:28.769 INFO:tasks.workunit.client.1.smithi134.stdout:0/713: creat d13/d14/d15/d2a/d8c/ff0 x:0 0 0 2023-12-05T09:26:28.777 INFO:tasks.workunit.client.0.smithi067.stdout:0/660: mkdir d3/d7/df0 0 2023-12-05T09:26:28.779 INFO:tasks.workunit.client.0.smithi067.stdout:3/481: creat d9/da/d15/d17/d2b/fa9 x:0 0 0 2023-12-05T09:26:28.779 INFO:tasks.workunit.client.0.smithi067.stdout:3/482: fsync d9/da/d15/d17/d1a/d51/d70/f94 0 2023-12-05T09:26:28.780 INFO:tasks.workunit.client.1.smithi134.stdout:7/739: dread d2/d7/d2b/d2d/f66 [0,4194304] 0 2023-12-05T09:26:28.783 INFO:tasks.workunit.client.1.smithi134.stdout:6/714: dread d4/d39/d42/d4f/d6d/d3a/f54 [0,4194304] 0 2023-12-05T09:26:28.784 INFO:tasks.workunit.client.0.smithi067.stdout:2/487: symlink d0/d25/d9d/d53/la8 0 2023-12-05T09:26:28.790 INFO:tasks.workunit.client.0.smithi067.stdout:9/723: sync 2023-12-05T09:26:28.790 INFO:tasks.workunit.client.0.smithi067.stdout:9/724: chown d1b/d25/d54/d5c/d81/d96/lae 3220095 1 2023-12-05T09:26:28.791 INFO:tasks.workunit.client.1.smithi134.stdout:5/714: dwrite d0/f55 [0,4194304] 0 2023-12-05T09:26:28.793 INFO:tasks.workunit.client.1.smithi134.stdout:2/809: mknod d19/d28/d31/d38/d98/db5/c10b 0 2023-12-05T09:26:28.793 INFO:tasks.workunit.client.1.smithi134.stdout:2/810: chown f16 14 1 2023-12-05T09:26:28.800 INFO:tasks.workunit.client.0.smithi067.stdout:4/459: rename d0/d1d/d3c/c45 to d0/d1d/d25/d5c/c9f 0 2023-12-05T09:26:28.802 INFO:tasks.workunit.client.1.smithi134.stdout:3/781: getdents d4/d5/d6f/dc2/ddb 0 2023-12-05T09:26:28.802 INFO:tasks.workunit.client.1.smithi134.stdout:3/782: truncate d4/f1b 4945096 0 2023-12-05T09:26:28.803 INFO:tasks.workunit.client.1.smithi134.stdout:6/715: write d4/d39/d42/d4f/d6d/d45/f5f [2261050,126298] 0 2023-12-05T09:26:28.803 INFO:tasks.workunit.client.1.smithi134.stdout:6/716: chown d4/d39/d42/d4f/d6d/d3a/da/l14 2083 1 2023-12-05T09:26:28.803 INFO:tasks.workunit.client.0.smithi067.stdout:8/506: symlink d5/dc/d1a/d20/l8c 0 2023-12-05T09:26:28.804 INFO:tasks.workunit.client.0.smithi067.stdout:8/507: creat d5/da/f8d x:0 0 0 2023-12-05T09:26:28.804 INFO:tasks.workunit.client.0.smithi067.stdout:8/508: chown d5/dc/d1a/c4c 7457023 1 2023-12-05T09:26:28.804 INFO:tasks.workunit.client.0.smithi067.stdout:8/509: read d5/f45 [3662712,18889] 0 2023-12-05T09:26:28.814 INFO:tasks.workunit.client.0.smithi067.stdout:3/483: unlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/f36 0 2023-12-05T09:26:28.814 INFO:tasks.workunit.client.0.smithi067.stdout:3/484: write d9/da/d15/d17/d1a/d51/d66/f98 [664182,80006] 0 2023-12-05T09:26:28.817 INFO:tasks.workunit.client.0.smithi067.stdout:9/725: rmdir d1b/dd3/d6c/d78 39 2023-12-05T09:26:28.818 INFO:tasks.workunit.client.0.smithi067.stdout:9/726: write d1b/dd3/d6c/d76/f8a [4409495,69603] 0 2023-12-05T09:26:28.818 INFO:tasks.workunit.client.0.smithi067.stdout:9/727: write d1b/d25/f6d [2702912,86530] 0 2023-12-05T09:26:28.818 INFO:tasks.workunit.client.0.smithi067.stdout:9/728: chown ce 370 1 2023-12-05T09:26:28.818 INFO:tasks.workunit.client.0.smithi067.stdout:9/729: write d1b/f7a [1494785,87600] 0 2023-12-05T09:26:28.819 INFO:tasks.workunit.client.0.smithi067.stdout:0/661: dwrite d3/fd6 [0,4194304] 0 2023-12-05T09:26:28.822 INFO:tasks.workunit.client.0.smithi067.stdout:4/460: link d0/d1d/l8c d0/d1d/d2a/d72/la0 0 2023-12-05T09:26:28.822 INFO:tasks.workunit.client.0.smithi067.stdout:4/461: fsync d0/d1d/d24/f7f 0 2023-12-05T09:26:28.822 INFO:tasks.workunit.client.0.smithi067.stdout:4/462: fdatasync d0/f8 0 2023-12-05T09:26:28.824 INFO:tasks.workunit.client.1.smithi134.stdout:0/714: dwrite d13/d14/d15/d67/fcb [0,4194304] 0 2023-12-05T09:26:28.825 INFO:tasks.workunit.client.0.smithi067.stdout:7/506: rename d0/d9/d10/d37/d38/d64/f55 to d0/d9/d10/d37/d38/d64/d34/fa6 0 2023-12-05T09:26:28.827 INFO:tasks.workunit.client.0.smithi067.stdout:7/507: write d0/d9/d10/d1d/f1f [371029,104818] 0 2023-12-05T09:26:28.828 INFO:tasks.workunit.client.1.smithi134.stdout:4/758: rename d16/d21/de5/lf5 to d16/d18/dc5/dc2/l10a 0 2023-12-05T09:26:28.830 INFO:tasks.workunit.client.0.smithi067.stdout:6/469: dwrite da/d10/d1e/d17/d2f/d3f/d92/f9d [0,4194304] 0 2023-12-05T09:26:28.833 INFO:tasks.workunit.client.1.smithi134.stdout:1/898: symlink d2/d9/d10/d30/d66/da9/l13f 0 2023-12-05T09:26:28.836 INFO:tasks.workunit.client.0.smithi067.stdout:8/510: symlink d5/dc/d1a/d62/d7e/l8e 0 2023-12-05T09:26:28.837 INFO:tasks.workunit.client.0.smithi067.stdout:8/511: write d5/dc/d1a/d20/d2d/d41/f5b [8920771,1567] 0 2023-12-05T09:26:28.837 INFO:tasks.workunit.client.0.smithi067.stdout:8/512: fsync d5/dc/d1a/f64 0 2023-12-05T09:26:28.837 INFO:tasks.workunit.client.0.smithi067.stdout:8/513: write d5/dc/f3f [4903649,57210] 0 2023-12-05T09:26:28.839 INFO:tasks.workunit.client.0.smithi067.stdout:0/662: dread d3/d7/d3c/d6c/d76/da7/dec/f2b [0,4194304] 0 2023-12-05T09:26:28.847 INFO:tasks.workunit.client.1.smithi134.stdout:7/740: mknod d2/df/d81/daf/de1/cf2 0 2023-12-05T09:26:28.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/508: dread d0/d9/d10/d37/d38/f75 [0,4194304] 0 2023-12-05T09:26:28.856 INFO:tasks.workunit.client.1.smithi134.stdout:5/715: mknod d0/d1a/d1c/d3f/d81/db0/cf7 0 2023-12-05T09:26:28.856 INFO:tasks.workunit.client.1.smithi134.stdout:5/716: dread - d0/d1a/d1c/d25/d6a/f6c zero size 2023-12-05T09:26:28.856 INFO:tasks.workunit.client.1.smithi134.stdout:5/717: fdatasync d0/d11/f1f 0 2023-12-05T09:26:28.862 INFO:tasks.workunit.client.0.smithi067.stdout:3/485: dread f3 [0,4194304] 0 2023-12-05T09:26:28.865 INFO:tasks.workunit.client.1.smithi134.stdout:5/718: dread d0/d50/fdc [0,4194304] 0 2023-12-05T09:26:28.866 INFO:tasks.workunit.client.1.smithi134.stdout:2/811: mknod d19/d3a/c10c 0 2023-12-05T09:26:28.870 INFO:tasks.workunit.client.1.smithi134.stdout:3/783: creat d4/d1f/d50/ff8 x:0 0 0 2023-12-05T09:26:28.873 INFO:tasks.workunit.client.1.smithi134.stdout:6/717: unlink d4/d39/d42/d4f/d6d/d3a/d75/d59/c79 0 2023-12-05T09:26:28.875 INFO:tasks.workunit.client.0.smithi067.stdout:8/514: dread d5/f14 [0,4194304] 0 2023-12-05T09:26:28.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/515: write d5/da/f56 [4594025,31055] 0 2023-12-05T09:26:28.877 INFO:tasks.workunit.client.0.smithi067.stdout:0/663: rename d3/d7/d3c/d6c/d76/da7/dec/d10/dd2/d99/db4/fc4 to d3/d7/d3c/d67/d59/d5c/ff1 0 2023-12-05T09:26:28.877 INFO:tasks.workunit.client.0.smithi067.stdout:0/664: creat d3/d7/dd7/ff2 x:0 0 0 2023-12-05T09:26:28.879 INFO:tasks.workunit.client.0.smithi067.stdout:4/463: getdents d0/d1d/d2b/d50/d15 0 2023-12-05T09:26:28.880 INFO:tasks.workunit.client.0.smithi067.stdout:4/464: chown d0/d1d/d24 14 1 2023-12-05T09:26:28.880 INFO:tasks.workunit.client.0.smithi067.stdout:4/465: truncate d0/d9/f91 916343 0 2023-12-05T09:26:28.885 INFO:tasks.workunit.client.0.smithi067.stdout:3/486: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/faa x:0 0 0 2023-12-05T09:26:28.888 INFO:tasks.workunit.client.0.smithi067.stdout:9/730: dwrite d1b/dd3/d6c/d78/daa/fb9 [0,4194304] 0 2023-12-05T09:26:28.889 INFO:tasks.workunit.client.1.smithi134.stdout:0/715: truncate d13/d14/d30/d4b/d66/da0/daf/dde/f92 2131582 0 2023-12-05T09:26:28.889 INFO:tasks.workunit.client.1.smithi134.stdout:0/716: chown d13/d14/d30/d4b/d23/cd9 4889936 1 2023-12-05T09:26:28.890 INFO:tasks.workunit.client.1.smithi134.stdout:0/717: truncate d13/d14/d15/d2a/d8c/fe7 950896 0 2023-12-05T09:26:28.891 INFO:tasks.workunit.client.1.smithi134.stdout:4/759: mknod d16/d7b/d6f/c10b 0 2023-12-05T09:26:28.893 INFO:tasks.workunit.client.0.smithi067.stdout:0/665: rename d3/d7/le to d3/d7/d3c/d6c/d8a/lf3 0 2023-12-05T09:26:28.893 INFO:tasks.workunit.client.1.smithi134.stdout:1/899: link d2/d9/d10/d94/de5/f102 d2/f140 0 2023-12-05T09:26:28.895 INFO:tasks.workunit.client.1.smithi134.stdout:8/870: getdents da/de/d8a/d42/d99/dc8 0 2023-12-05T09:26:28.897 INFO:tasks.workunit.client.0.smithi067.stdout:3/487: creat d9/da/d15/d17/fab x:0 0 0 2023-12-05T09:26:28.897 INFO:tasks.workunit.client.0.smithi067.stdout:3/488: write d9/da/d15/d17/d1a/d51/d66/f93 [781731,125599] 0 2023-12-05T09:26:28.897 INFO:tasks.workunit.client.1.smithi134.stdout:7/741: rmdir d2/df 39 2023-12-05T09:26:28.898 INFO:tasks.workunit.client.0.smithi067.stdout:9/731: stat d1b/d25/d5b/c9e 0 2023-12-05T09:26:28.901 INFO:tasks.workunit.client.1.smithi134.stdout:5/719: dread d0/dd/f32 [0,4194304] 0 2023-12-05T09:26:28.902 INFO:tasks.workunit.client.0.smithi067.stdout:6/470: dwrite da/d10/d1e/d17/f23 [4194304,4194304] 0 2023-12-05T09:26:28.902 INFO:tasks.workunit.client.1.smithi134.stdout:5/720: fdatasync d0/dd/d37/f53 0 2023-12-05T09:26:28.905 INFO:tasks.workunit.client.0.smithi067.stdout:0/666: write d3/d7/d3c/d6c/fa5 [290157,32558] 0 2023-12-05T09:26:28.906 INFO:tasks.workunit.client.0.smithi067.stdout:0/667: creat d3/d7/d30/ff4 x:0 0 0 2023-12-05T09:26:28.910 INFO:tasks.workunit.client.0.smithi067.stdout:9/732: mknod d1b/d25/d54/cf3 0 2023-12-05T09:26:28.911 INFO:tasks.workunit.client.0.smithi067.stdout:9/733: readlink d1b/d25/d94/laf 0 2023-12-05T09:26:28.911 INFO:tasks.workunit.client.0.smithi067.stdout:9/734: chown d1b/dd3/d6c/d76/ld2 59 1 2023-12-05T09:26:28.914 INFO:tasks.workunit.client.0.smithi067.stdout:3/489: write d9/da/d15/d17/d1a/d51/d66/f93 [107220,34798] 0 2023-12-05T09:26:28.914 INFO:tasks.workunit.client.0.smithi067.stdout:3/490: write d9/da/d15/d17/f32 [4639248,80394] 0 2023-12-05T09:26:28.916 INFO:tasks.workunit.client.1.smithi134.stdout:2/812: creat d19/d3f/f10d x:0 0 0 2023-12-05T09:26:28.916 INFO:tasks.workunit.client.1.smithi134.stdout:2/813: dread - d19/d76/da7/fec zero size 2023-12-05T09:26:28.916 INFO:tasks.workunit.client.1.smithi134.stdout:2/814: chown d19/d3a/df4/ffc 282667246 1 2023-12-05T09:26:28.916 INFO:tasks.workunit.client.1.smithi134.stdout:1/900: chown d2/d27/db4/df9/f11a 151 1 2023-12-05T09:26:28.916 INFO:tasks.workunit.client.1.smithi134.stdout:1/901: chown d2/d9/d10/d30/d66/l76 1202116112 1 2023-12-05T09:26:28.916 INFO:tasks.workunit.client.1.smithi134.stdout:9/746: sync 2023-12-05T09:26:28.916 INFO:tasks.workunit.client.1.smithi134.stdout:1/902: fsync d2/d9/d10/d30/d66/da9/feb 0 2023-12-05T09:26:28.916 INFO:tasks.workunit.client.1.smithi134.stdout:0/718: mknod d13/d14/d30/d4b/dc1/dda/cf1 0 2023-12-05T09:26:28.920 INFO:tasks.workunit.client.1.smithi134.stdout:5/721: link d0/d11/d61/d75/l7e d0/d11/d5c/dab/lf8 0 2023-12-05T09:26:28.920 INFO:tasks.workunit.client.1.smithi134.stdout:5/722: fdatasync d0/d1a/d1c/d3f/d81/d8a/f93 0 2023-12-05T09:26:28.925 INFO:tasks.workunit.client.0.smithi067.stdout:0/668: creat d3/d7/d3c/d67/dd1/ff5 x:0 0 0 2023-12-05T09:26:28.927 INFO:tasks.workunit.client.1.smithi134.stdout:2/815: dread d19/d5f/f93 [0,4194304] 0 2023-12-05T09:26:28.927 INFO:tasks.workunit.client.1.smithi134.stdout:2/816: read - d19/d28/d63/fd9 zero size 2023-12-05T09:26:28.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/747: truncate d7/d8/d14/d26/f48 2482777 0 2023-12-05T09:26:28.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/748: fdatasync d7/d8/d16/d52/d74/d97/d99/f9a 0 2023-12-05T09:26:28.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/749: truncate d7/d8/d16/d52/d74/d97/d99/f9a 233923 0 2023-12-05T09:26:28.933 INFO:tasks.workunit.client.1.smithi134.stdout:3/784: dwrite d4/d5/d45/d60/d85/d96/f9d [0,4194304] 0 2023-12-05T09:26:28.934 INFO:tasks.workunit.client.1.smithi134.stdout:3/785: dread - d4/f6b zero size 2023-12-05T09:26:28.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/735: link d1b/c3f d1b/dd3/cf4 0 2023-12-05T09:26:28.935 INFO:tasks.workunit.client.0.smithi067.stdout:0/669: write d3/fa [1801202,110143] 0 2023-12-05T09:26:28.936 INFO:tasks.workunit.client.1.smithi134.stdout:1/903: mknod d2/d9/d10/d30/dd4/c141 0 2023-12-05T09:26:28.938 INFO:tasks.workunit.client.1.smithi134.stdout:6/718: dwrite d4/d39/d42/d4f/d6d/d3a/da/f77 [0,4194304] 0 2023-12-05T09:26:28.940 INFO:tasks.workunit.client.1.smithi134.stdout:5/723: mknod d0/d1a/d1c/d3f/d81/d8a/cf9 0 2023-12-05T09:26:28.942 INFO:tasks.workunit.client.0.smithi067.stdout:0/670: link d3/d7/d3c/d67/d59/d4e/d94/cca d3/d7/d3c/d67/d59/d5c/cf6 0 2023-12-05T09:26:28.942 INFO:tasks.workunit.client.0.smithi067.stdout:8/516: dwrite d5/dc/d1a/d20/d2d/d41/f5b [0,4194304] 0 2023-12-05T09:26:28.942 INFO:tasks.workunit.client.0.smithi067.stdout:8/517: truncate d5/dc/d1a/d62/d7e/f83 48894 0 2023-12-05T09:26:28.945 INFO:tasks.workunit.client.1.smithi134.stdout:3/786: truncate d4/d5/d45/f46 2031819 0 2023-12-05T09:26:28.947 INFO:tasks.workunit.client.1.smithi134.stdout:1/904: mknod d2/d27/d9d/c142 0 2023-12-05T09:26:28.947 INFO:tasks.workunit.client.1.smithi134.stdout:1/905: chown d2/d9/d10/d30/d66/d9b/fba 13 1 2023-12-05T09:26:28.948 INFO:tasks.workunit.client.0.smithi067.stdout:0/671: mkdir d3/d7/d3c/d8d/df7 0 2023-12-05T09:26:28.948 INFO:tasks.workunit.client.0.smithi067.stdout:8/518: creat d5/dc/d1a/d20/d58/f8f x:0 0 0 2023-12-05T09:26:28.950 INFO:tasks.workunit.client.0.smithi067.stdout:0/672: mkdir d3/d7/d3c/d66/df8 0 2023-12-05T09:26:28.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/719: mknod d4/d78/d7a/daa/dba/ce0 0 2023-12-05T09:26:28.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/720: fdatasync d4/f6b 0 2023-12-05T09:26:28.953 INFO:tasks.workunit.client.0.smithi067.stdout:8/519: mkdir d5/dc/d1a/d20/d58/d90 0 2023-12-05T09:26:28.953 INFO:tasks.workunit.client.0.smithi067.stdout:8/520: write d5/dc/d6e/f78 [146587,100442] 0 2023-12-05T09:26:28.954 INFO:tasks.workunit.client.1.smithi134.stdout:5/724: truncate d0/d1a/d1c/f23 9167067 0 2023-12-05T09:26:28.955 INFO:tasks.workunit.client.1.smithi134.stdout:3/787: getdents d4/d5/d6f 0 2023-12-05T09:26:28.956 INFO:tasks.workunit.client.1.smithi134.stdout:1/906: mknod d2/d9/d10/d30/d66/c143 0 2023-12-05T09:26:28.957 INFO:tasks.workunit.client.1.smithi134.stdout:1/907: stat d2/d9/d10/d30/d66/da9/d74/d99/fc5 0 2023-12-05T09:26:28.958 INFO:tasks.workunit.client.0.smithi067.stdout:4/466: dwrite d0/d1d/d2a/f7e [0,4194304] 0 2023-12-05T09:26:28.958 INFO:tasks.workunit.client.0.smithi067.stdout:4/467: truncate d0/d1d/d25/f6d 955321 0 2023-12-05T09:26:28.958 INFO:tasks.workunit.client.0.smithi067.stdout:4/468: fsync d0/d1d/d24/f73 0 2023-12-05T09:26:28.961 INFO:tasks.workunit.client.1.smithi134.stdout:5/725: creat d0/d1a/d1c/d3f/d5b/d5d/d78/db3/ffa x:0 0 0 2023-12-05T09:26:28.961 INFO:tasks.workunit.client.1.smithi134.stdout:3/788: creat d4/d5/d45/d60/ff9 x:0 0 0 2023-12-05T09:26:28.961 INFO:tasks.workunit.client.1.smithi134.stdout:3/789: dread - d4/d5/d7c/faa zero size 2023-12-05T09:26:28.966 INFO:tasks.workunit.client.1.smithi134.stdout:3/790: symlink d4/d5/d6f/d97/dae/de8/lfa 0 2023-12-05T09:26:28.966 INFO:tasks.workunit.client.1.smithi134.stdout:3/791: fdatasync d4/fbd 0 2023-12-05T09:26:28.967 INFO:tasks.workunit.client.0.smithi067.stdout:8/521: mkdir d5/da/d30/d61/d66/d91 0 2023-12-05T09:26:28.968 INFO:tasks.workunit.client.1.smithi134.stdout:5/726: unlink d0/d1a/d1c/c87 0 2023-12-05T09:26:28.971 INFO:tasks.workunit.client.0.smithi067.stdout:4/469: creat d0/d1d/d25/d2c/d34/d4e/fa1 x:0 0 0 2023-12-05T09:26:28.975 INFO:tasks.workunit.client.1.smithi134.stdout:7/742: dwrite d2/df/d2a/d36/f5d [0,4194304] 0 2023-12-05T09:26:28.975 INFO:tasks.workunit.client.1.smithi134.stdout:5/727: rename d0/dd/d37/d90/d9d/de0/le7 to d0/d45/daf/lfb 0 2023-12-05T09:26:28.977 INFO:tasks.workunit.client.0.smithi067.stdout:8/522: unlink d5/da/c89 0 2023-12-05T09:26:28.983 INFO:tasks.workunit.client.1.smithi134.stdout:7/743: write d2/d7/dc/d22/f85 [4244081,49018] 0 2023-12-05T09:26:28.983 INFO:tasks.workunit.client.1.smithi134.stdout:7/744: chown d2/d7/d6f/db9/lc3 49081248 1 2023-12-05T09:26:28.986 INFO:tasks.workunit.client.0.smithi067.stdout:8/523: mknod d5/dc/d1a/d20/d2d/c92 0 2023-12-05T09:26:28.990 INFO:tasks.workunit.client.1.smithi134.stdout:5/728: mknod d0/dd/d37/d7d/cfc 0 2023-12-05T09:26:28.990 INFO:tasks.workunit.client.0.smithi067.stdout:8/524: creat d5/dc/d1a/d20/d2d/d7f/f93 x:0 0 0 2023-12-05T09:26:28.991 INFO:tasks.workunit.client.0.smithi067.stdout:8/525: write d5/da/d30/d61/d66/f81 [1120412,59349] 0 2023-12-05T09:26:28.992 INFO:tasks.workunit.client.1.smithi134.stdout:6/721: dread d4/d39/f34 [0,4194304] 0 2023-12-05T09:26:28.995 INFO:tasks.workunit.client.1.smithi134.stdout:6/722: write d4/d39/d42/d4f/d6d/d9f/fc6 [130566,114842] 0 2023-12-05T09:26:28.995 INFO:tasks.workunit.client.1.smithi134.stdout:6/723: read - d4/d39/d42/d4f/d6d/f60 zero size 2023-12-05T09:26:28.995 INFO:tasks.workunit.client.1.smithi134.stdout:6/724: write d4/d39/d5c/fc2 [44715,9172] 0 2023-12-05T09:26:28.995 INFO:tasks.workunit.client.0.smithi067.stdout:4/470: dread d0/d1d/d25/d2c/d34/f86 [0,4194304] 0 2023-12-05T09:26:28.996 INFO:tasks.workunit.client.0.smithi067.stdout:4/471: write d0/d9/f78 [1777991,58920] 0 2023-12-05T09:26:28.996 INFO:tasks.workunit.client.1.smithi134.stdout:7/745: mknod d2/d7/d2b/dd9/cf3 0 2023-12-05T09:26:28.996 INFO:tasks.workunit.client.1.smithi134.stdout:7/746: truncate d2/d7/d2b/d94/fa1 1541876 0 2023-12-05T09:26:29.000 INFO:tasks.workunit.client.0.smithi067.stdout:4/472: creat d0/d1d/d53/fa2 x:0 0 0 2023-12-05T09:26:29.002 INFO:tasks.workunit.client.1.smithi134.stdout:2/817: dwrite d19/d28/f4e [0,4194304] 0 2023-12-05T09:26:29.002 INFO:tasks.workunit.client.1.smithi134.stdout:2/818: creat d19/d28/d31/d6f/f10e x:0 0 0 2023-12-05T09:26:29.004 INFO:tasks.workunit.client.0.smithi067.stdout:4/473: creat d0/d1d/d2b/d50/d15/fa3 x:0 0 0 2023-12-05T09:26:29.008 INFO:tasks.workunit.client.0.smithi067.stdout:4/474: mkdir d0/d1d/d2a/d93/da4 0 2023-12-05T09:26:29.012 INFO:tasks.workunit.client.0.smithi067.stdout:4/475: creat d0/d1d/d4d/d8d/fa5 x:0 0 0 2023-12-05T09:26:29.013 INFO:tasks.workunit.client.1.smithi134.stdout:5/729: dread d0/d50/fad [0,4194304] 0 2023-12-05T09:26:29.013 INFO:tasks.workunit.client.1.smithi134.stdout:5/730: chown d0/d1a/d1c/d3f/d5b/d5d/d78/d7b 27474 1 2023-12-05T09:26:29.013 INFO:tasks.workunit.client.1.smithi134.stdout:2/819: mkdir d19/d3f/dbf/d10f 0 2023-12-05T09:26:29.013 INFO:tasks.workunit.client.1.smithi134.stdout:2/820: write d19/d28/d63/d70/f74 [734851,49796] 0 2023-12-05T09:26:29.014 INFO:tasks.workunit.client.1.smithi134.stdout:2/821: dread - d19/d76/db9/f100 zero size 2023-12-05T09:26:29.016 INFO:tasks.workunit.client.1.smithi134.stdout:9/750: write d7/d5b/d5e/f6c [1277167,59272] 0 2023-12-05T09:26:29.016 INFO:tasks.workunit.client.1.smithi134.stdout:9/751: creat d7/d8/d14/d26/d5a/da1/fff x:0 0 0 2023-12-05T09:26:29.017 INFO:tasks.workunit.client.1.smithi134.stdout:9/752: write d7/d8/d14/d26/d7f/d92/d53/d7b/d8f/fec [279875,40892] 0 2023-12-05T09:26:29.020 INFO:tasks.workunit.client.0.smithi067.stdout:4/476: unlink d0/d1d/d25/d38/f39 0 2023-12-05T09:26:29.021 INFO:tasks.workunit.client.0.smithi067.stdout:4/477: fsync d0/d1d/d25/d2c/d34/d4e/f52 0 2023-12-05T09:26:29.023 INFO:tasks.workunit.client.1.smithi134.stdout:1/908: dwrite d2/d9/d10/d30/d66/d10d/f115 [0,4194304] 0 2023-12-05T09:26:29.023 INFO:tasks.workunit.client.1.smithi134.stdout:1/909: chown d2/d9/fff 0 1 2023-12-05T09:26:29.026 INFO:tasks.workunit.client.1.smithi134.stdout:5/731: creat d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/d9b/ffd x:0 0 0 2023-12-05T09:26:29.029 INFO:tasks.workunit.client.0.smithi067.stdout:0/673: dwrite d3/d7/d3c/f75 [0,4194304] 0 2023-12-05T09:26:29.030 INFO:tasks.workunit.client.1.smithi134.stdout:2/822: symlink d19/d3a/df4/l110 0 2023-12-05T09:26:29.031 INFO:tasks.workunit.client.0.smithi067.stdout:4/478: symlink d0/d1d/d53/d82/la6 0 2023-12-05T09:26:29.032 INFO:tasks.workunit.client.1.smithi134.stdout:0/719: dwrite d13/d14/f4f [0,4194304] 0 2023-12-05T09:26:29.032 INFO:tasks.workunit.client.0.smithi067.stdout:6/471: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a [0,4194304] 0 2023-12-05T09:26:29.035 INFO:tasks.workunit.client.0.smithi067.stdout:3/491: dwrite d9/d62/f8f [0,4194304] 0 2023-12-05T09:26:29.039 INFO:tasks.workunit.client.0.smithi067.stdout:0/674: creat d3/ff9 x:0 0 0 2023-12-05T09:26:29.039 INFO:tasks.workunit.client.0.smithi067.stdout:0/675: read - d3/d7/d3c/d6c/d76/da7/dec/d10/dd2/d99/fc5 zero size 2023-12-05T09:26:29.040 INFO:tasks.workunit.client.0.smithi067.stdout:0/676: write d3/f58 [2561402,26766] 0 2023-12-05T09:26:29.044 INFO:tasks.workunit.client.1.smithi134.stdout:1/910: write d2/d27/d71/d80/f83 [86126,89648] 0 2023-12-05T09:26:29.044 INFO:tasks.workunit.client.1.smithi134.stdout:1/911: truncate d2/d9/d10/d30/d66/d9b/f117 158197 0 2023-12-05T09:26:29.044 INFO:tasks.workunit.client.1.smithi134.stdout:1/912: stat d2/d9/lc 0 2023-12-05T09:26:29.047 INFO:tasks.workunit.client.1.smithi134.stdout:5/732: mkdir d0/dd/d37/d90/dfe 0 2023-12-05T09:26:29.048 INFO:tasks.workunit.client.0.smithi067.stdout:4/479: stat d0/l96 0 2023-12-05T09:26:29.048 INFO:tasks.workunit.client.0.smithi067.stdout:4/480: readlink d0/d1d/d3c/l5b 0 2023-12-05T09:26:29.053 INFO:tasks.workunit.client.1.smithi134.stdout:2/823: mkdir d19/d28/d31/d38/db7/d111 0 2023-12-05T09:26:29.054 INFO:tasks.workunit.client.0.smithi067.stdout:4/481: write d0/d1d/d53/d62/f83 [105273,56934] 0 2023-12-05T09:26:29.054 INFO:tasks.workunit.client.0.smithi067.stdout:4/482: fsync d0/d1d/d53/f6e 0 2023-12-05T09:26:29.060 INFO:tasks.workunit.client.0.smithi067.stdout:9/736: dwrite d1b/f31 [0,4194304] 0 2023-12-05T09:26:29.073 INFO:tasks.workunit.client.1.smithi134.stdout:7/747: dwrite d2/dd/fc8 [0,4194304] 0 2023-12-05T09:26:29.073 INFO:tasks.workunit.client.1.smithi134.stdout:7/748: chown d2/dd/d71/cca 464230 1 2023-12-05T09:26:29.074 INFO:tasks.workunit.client.1.smithi134.stdout:9/753: dwrite d7/d8/d2e/f76 [0,4194304] 0 2023-12-05T09:26:29.078 INFO:tasks.workunit.client.1.smithi134.stdout:1/913: link d2/d9/d10/d5b/d5e/c6c d2/c144 0 2023-12-05T09:26:29.078 INFO:tasks.workunit.client.1.smithi134.stdout:0/720: truncate f8 979453 0 2023-12-05T09:26:29.079 INFO:tasks.workunit.client.0.smithi067.stdout:0/677: dread d3/d7/d30/f4a [4194304,4194304] 0 2023-12-05T09:26:29.079 INFO:tasks.workunit.client.0.smithi067.stdout:0/678: fsync d3/f3d 0 2023-12-05T09:26:29.079 INFO:tasks.workunit.client.0.smithi067.stdout:8/526: dwrite d5/f45 [0,4194304] 0 2023-12-05T09:26:29.079 INFO:tasks.workunit.client.0.smithi067.stdout:8/527: dread - d5/dc/d1a/d62/f73 zero size 2023-12-05T09:26:29.079 INFO:tasks.workunit.client.0.smithi067.stdout:4/483: symlink d0/d1d/d2a/d72/la7 0 2023-12-05T09:26:29.081 INFO:tasks.workunit.client.1.smithi134.stdout:9/754: dread d7/d8/d14/d26/d5a/d69/fa0 [0,4194304] 0 2023-12-05T09:26:29.082 INFO:tasks.workunit.client.1.smithi134.stdout:5/733: unlink d0/d1a/d1c/d25/l44 0 2023-12-05T09:26:29.082 INFO:tasks.workunit.client.1.smithi134.stdout:5/734: dread - d0/d1a/d1c/d25/d6a/fe9 zero size 2023-12-05T09:26:29.082 INFO:tasks.workunit.client.1.smithi134.stdout:5/735: stat d0/d1a/d1c/d25/d4d/d9e/fc5 0 2023-12-05T09:26:29.086 INFO:tasks.workunit.client.0.smithi067.stdout:5/567: sync 2023-12-05T09:26:29.087 INFO:tasks.workunit.client.0.smithi067.stdout:9/737: rmdir d1b/dd3/d6c/d78/daa 39 2023-12-05T09:26:29.093 INFO:tasks.workunit.client.1.smithi134.stdout:1/914: dread d2/d9/f44 [0,4194304] 0 2023-12-05T09:26:29.093 INFO:tasks.workunit.client.1.smithi134.stdout:1/915: chown d2/d9/d10/d30/dd4/dfb 741 1 2023-12-05T09:26:29.099 INFO:tasks.workunit.client.0.smithi067.stdout:4/484: unlink d0/d1d/d2a/d93/c94 0 2023-12-05T09:26:29.104 INFO:tasks.workunit.client.0.smithi067.stdout:8/528: truncate d5/dc/d6e/f78 1463155 0 2023-12-05T09:26:29.104 INFO:tasks.workunit.client.1.smithi134.stdout:7/749: mknod d2/d70/cf4 0 2023-12-05T09:26:29.108 INFO:tasks.workunit.client.0.smithi067.stdout:4/485: mkdir d0/d1d/d53/da8 0 2023-12-05T09:26:29.112 INFO:tasks.workunit.client.1.smithi134.stdout:1/916: write d2/d7e/fdb [559169,55237] 0 2023-12-05T09:26:29.122 INFO:tasks.workunit.client.1.smithi134.stdout:0/721: getdents d13/d14/d15/d67 0 2023-12-05T09:26:29.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/750: dread d2/dd/fc8 [0,4194304] 0 2023-12-05T09:26:29.128 INFO:tasks.workunit.client.1.smithi134.stdout:9/755: unlink d7/d8/d14/d26/d7f/d92/d53/cea 0 2023-12-05T09:26:29.128 INFO:tasks.workunit.client.0.smithi067.stdout:8/529: write d5/f18 [1928480,110293] 0 2023-12-05T09:26:29.131 INFO:tasks.workunit.client.1.smithi134.stdout:4/760: sync 2023-12-05T09:26:29.131 INFO:tasks.workunit.client.1.smithi134.stdout:8/871: sync 2023-12-05T09:26:29.132 INFO:tasks.workunit.client.1.smithi134.stdout:2/824: getdents d19/d28/d31/d38/db7 0 2023-12-05T09:26:29.134 INFO:tasks.workunit.client.0.smithi067.stdout:4/486: rename d0/d1d/d2b/d50 to d0/d1d/d53/da8/da9 0 2023-12-05T09:26:29.134 INFO:tasks.workunit.client.0.smithi067.stdout:4/487: dread - d0/d1d/d4d/f9b zero size 2023-12-05T09:26:29.134 INFO:tasks.workunit.client.0.smithi067.stdout:4/488: stat d0/f41 0 2023-12-05T09:26:29.134 INFO:tasks.workunit.client.0.smithi067.stdout:4/489: stat d0/f4 0 2023-12-05T09:26:29.137 INFO:tasks.workunit.client.1.smithi134.stdout:1/917: symlink d2/d27/db4/l145 0 2023-12-05T09:26:29.137 INFO:tasks.workunit.client.0.smithi067.stdout:8/530: mkdir d5/dc/d1a/d20/d2d/d7f/d94 0 2023-12-05T09:26:29.144 INFO:tasks.workunit.client.1.smithi134.stdout:7/751: rename d2/d8f/dce to d2/d7/d93/dcf/dd6/df5 0 2023-12-05T09:26:29.144 INFO:tasks.workunit.client.1.smithi134.stdout:7/752: truncate d2/d7/d6f/feb 989498 0 2023-12-05T09:26:29.145 INFO:tasks.workunit.client.0.smithi067.stdout:1/543: sync 2023-12-05T09:26:29.146 INFO:tasks.workunit.client.1.smithi134.stdout:5/736: dwrite d0/d1a/d1c/d25/d4d/d60/f9a [0,4194304] 0 2023-12-05T09:26:29.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/531: mkdir d5/dc/d1a/d20/d3e/d95 0 2023-12-05T09:26:29.147 INFO:tasks.workunit.client.0.smithi067.stdout:8/532: stat d5/dc/f6c 0 2023-12-05T09:26:29.149 INFO:tasks.workunit.client.1.smithi134.stdout:9/756: unlink d7/d8/d14/d26/d5a/d69/fb8 0 2023-12-05T09:26:29.153 INFO:tasks.workunit.client.0.smithi067.stdout:4/490: dread d0/d1d/d25/d2c/d34/f43 [0,4194304] 0 2023-12-05T09:26:29.154 INFO:tasks.workunit.client.0.smithi067.stdout:9/738: dwrite d1b/d25/d35/f43 [0,4194304] 0 2023-12-05T09:26:29.154 INFO:tasks.workunit.client.1.smithi134.stdout:5/737: dread d0/d11/d5c/fa6 [0,4194304] 0 2023-12-05T09:26:29.155 INFO:tasks.workunit.client.1.smithi134.stdout:1/918: symlink d2/d9/d10/d30/d66/l146 0 2023-12-05T09:26:29.161 INFO:tasks.workunit.client.1.smithi134.stdout:0/722: getdents d13/d14/d15/d93 0 2023-12-05T09:26:29.165 INFO:tasks.workunit.client.1.smithi134.stdout:3/792: sync 2023-12-05T09:26:29.171 INFO:tasks.workunit.client.1.smithi134.stdout:6/725: sync 2023-12-05T09:26:29.171 INFO:tasks.workunit.client.0.smithi067.stdout:1/544: rmdir d2/d5 39 2023-12-05T09:26:29.171 INFO:tasks.workunit.client.0.smithi067.stdout:1/545: dread - d2/d4f/d54/d70/f92 zero size 2023-12-05T09:26:29.175 INFO:tasks.workunit.client.1.smithi134.stdout:7/753: link d2/dd/f19 d2/d7/d6f/dd3/ff6 0 2023-12-05T09:26:29.183 INFO:tasks.workunit.client.0.smithi067.stdout:0/679: dwrite d3/f3d [0,4194304] 0 2023-12-05T09:26:29.183 INFO:tasks.workunit.client.0.smithi067.stdout:0/680: readlink d3/d7/d3c/d6c/d76/da7/dec/d10/dd2/l70 0 2023-12-05T09:26:29.183 INFO:tasks.workunit.client.0.smithi067.stdout:0/681: read d3/d7/d3c/d6c/d76/da7/dec/d10/f1f [3911208,99249] 0 2023-12-05T09:26:29.183 INFO:tasks.workunit.client.0.smithi067.stdout:0/682: write d3/d7/d3c/d6c/f92 [520020,16107] 0 2023-12-05T09:26:29.183 INFO:tasks.workunit.client.0.smithi067.stdout:0/683: fdatasync d3/d7/d3c/d67/d59/f88 0 2023-12-05T09:26:29.187 INFO:tasks.workunit.client.1.smithi134.stdout:4/761: dwrite d16/d9c/ff0 [0,4194304] 0 2023-12-05T09:26:29.190 INFO:tasks.workunit.client.1.smithi134.stdout:9/757: getdents d7/d8/d14/d26/d5a/d69/dc5 0 2023-12-05T09:26:29.190 INFO:tasks.workunit.client.1.smithi134.stdout:9/758: readlink d7/d8/d16/d52/d74/d97/ld2 0 2023-12-05T09:26:29.191 INFO:tasks.workunit.client.0.smithi067.stdout:9/739: symlink d1b/d25/d54/d5c/d8f/lf5 0 2023-12-05T09:26:29.197 INFO:tasks.workunit.client.1.smithi134.stdout:8/872: rmdir da/de/d96/dc9 39 2023-12-05T09:26:29.197 INFO:tasks.workunit.client.1.smithi134.stdout:8/873: chown da/de/f41 0 1 2023-12-05T09:26:29.197 INFO:tasks.workunit.client.1.smithi134.stdout:8/874: write da/de/d11/d8b/f10c [1590048,45707] 0 2023-12-05T09:26:29.198 INFO:tasks.workunit.client.0.smithi067.stdout:8/533: getdents d5/da 0 2023-12-05T09:26:29.200 INFO:tasks.workunit.client.1.smithi134.stdout:5/738: truncate d0/d1a/d1c/d25/f56 1924974 0 2023-12-05T09:26:29.202 INFO:tasks.workunit.client.1.smithi134.stdout:2/825: dwrite d19/d76/db9/f100 [0,4194304] 0 2023-12-05T09:26:29.204 INFO:tasks.workunit.client.1.smithi134.stdout:2/826: fsync fa 0 2023-12-05T09:26:29.205 INFO:tasks.workunit.client.1.smithi134.stdout:2/827: creat d19/d28/f112 x:0 0 0 2023-12-05T09:26:29.205 INFO:tasks.workunit.client.1.smithi134.stdout:2/828: write d19/d3a/d60/f102 [110015,113702] 0 2023-12-05T09:26:29.205 INFO:tasks.workunit.client.1.smithi134.stdout:2/829: write d19/d28/f5c [1510525,29222] 0 2023-12-05T09:26:29.205 INFO:tasks.workunit.client.1.smithi134.stdout:2/830: dread - d19/d28/f47 zero size 2023-12-05T09:26:29.205 INFO:tasks.workunit.client.1.smithi134.stdout:2/831: creat d19/d28/d63/f113 x:0 0 0 2023-12-05T09:26:29.205 INFO:tasks.workunit.client.0.smithi067.stdout:1/546: symlink d2/d5/d7/de/d19/lc5 0 2023-12-05T09:26:29.216 INFO:tasks.workunit.client.1.smithi134.stdout:7/754: write d2/d7/d6f/f90 [851426,77013] 0 2023-12-05T09:26:29.216 INFO:tasks.workunit.client.1.smithi134.stdout:0/723: dwrite f8 [0,4194304] 0 2023-12-05T09:26:29.219 INFO:tasks.workunit.client.0.smithi067.stdout:0/684: rename d3/d7/d3c/d6c/d76/da7/dec/f40 to d3/d7/d3c/d67/d59/d5c/ffa 0 2023-12-05T09:26:29.221 INFO:tasks.workunit.client.1.smithi134.stdout:9/759: rename d7/d8/d2e/f68 to d7/d5b/d5e/daa/db7/f100 0 2023-12-05T09:26:29.223 INFO:tasks.workunit.client.0.smithi067.stdout:8/534: creat d5/dc/f96 x:0 0 0 2023-12-05T09:26:29.223 INFO:tasks.workunit.client.0.smithi067.stdout:8/535: chown d5/dc/d1a/d20/d2d/d41/c49 466457 1 2023-12-05T09:26:29.223 INFO:tasks.workunit.client.0.smithi067.stdout:8/536: chown d5/da/c12 94 1 2023-12-05T09:26:29.223 INFO:tasks.workunit.client.0.smithi067.stdout:8/537: write d5/dc/d1a/d20/d3e/f42 [1268037,27160] 0 2023-12-05T09:26:29.223 INFO:tasks.workunit.client.0.smithi067.stdout:8/538: creat d5/dc/d1a/d20/d2d/d7f/f97 x:0 0 0 2023-12-05T09:26:29.224 INFO:tasks.workunit.client.0.smithi067.stdout:8/539: write d5/da/f80 [996522,62511] 0 2023-12-05T09:26:29.225 INFO:tasks.workunit.client.0.smithi067.stdout:1/547: symlink d2/d4f/d14/d48/lc6 0 2023-12-05T09:26:29.225 INFO:tasks.workunit.client.0.smithi067.stdout:1/548: chown d2/d3/f1d 2 1 2023-12-05T09:26:29.225 INFO:tasks.workunit.client.0.smithi067.stdout:1/549: fsync d2/d4f/d14/f3c 0 2023-12-05T09:26:29.229 INFO:tasks.workunit.client.1.smithi134.stdout:1/919: dwrite d2/d9/d10/d30/d66/da9/d74/d99/fc5 [0,4194304] 0 2023-12-05T09:26:29.229 INFO:tasks.workunit.client.1.smithi134.stdout:1/920: truncate d2/d9/d10/d5b/dc4/f10e 186409 0 2023-12-05T09:26:29.230 INFO:tasks.workunit.client.1.smithi134.stdout:8/875: mknod da/de/d11/d8b/d8c/d10b/c12b 0 2023-12-05T09:26:29.231 INFO:tasks.workunit.client.1.smithi134.stdout:8/876: write da/de/d11/d1d/db8/fe3 [171094,13385] 0 2023-12-05T09:26:29.235 INFO:tasks.workunit.client.0.smithi067.stdout:0/685: creat d3/d7/d3c/d67/d59/d5c/ffb x:0 0 0 2023-12-05T09:26:29.235 INFO:tasks.workunit.client.0.smithi067.stdout:0/686: fdatasync d3/d7/d3c/d67/d59/d4e/f83 0 2023-12-05T09:26:29.240 INFO:tasks.workunit.client.0.smithi067.stdout:8/540: mknod d5/dc/d1a/d20/d3e/c98 0 2023-12-05T09:26:29.240 INFO:tasks.workunit.client.0.smithi067.stdout:0/687: dread d3/d7/d3c/d67/d59/fe1 [0,4194304] 0 2023-12-05T09:26:29.241 INFO:tasks.workunit.client.1.smithi134.stdout:2/832: dread fd [4194304,4194304] 0 2023-12-05T09:26:29.243 INFO:tasks.workunit.client.1.smithi134.stdout:3/793: dwrite d4/d5/d6f/d97/fd7 [0,4194304] 0 2023-12-05T09:26:29.243 INFO:tasks.workunit.client.1.smithi134.stdout:3/794: fdatasync d4/d1f/fdd 0 2023-12-05T09:26:29.243 INFO:tasks.workunit.client.1.smithi134.stdout:3/795: chown d4/f12 3586 1 2023-12-05T09:26:29.245 INFO:tasks.workunit.client.1.smithi134.stdout:4/762: dwrite d16/d18/dc5/dc2/ffe [0,4194304] 0 2023-12-05T09:26:29.245 INFO:tasks.workunit.client.1.smithi134.stdout:5/739: creat d0/d1a/d1c/d25/d4d/d9e/deb/fff x:0 0 0 2023-12-05T09:26:29.246 INFO:tasks.workunit.client.0.smithi067.stdout:4/491: dwrite d0/d9/f78 [0,4194304] 0 2023-12-05T09:26:29.246 INFO:tasks.workunit.client.0.smithi067.stdout:4/492: chown d0/d1d/d25/d2c/f3a 23639669 1 2023-12-05T09:26:29.246 INFO:tasks.workunit.client.0.smithi067.stdout:1/550: truncate d2/d4f/d54/f58 421622 0 2023-12-05T09:26:29.247 INFO:tasks.workunit.client.0.smithi067.stdout:7/509: sync 2023-12-05T09:26:29.252 INFO:tasks.workunit.client.0.smithi067.stdout:8/541: link d5/dc/d1a/d62/l82 d5/l99 0 2023-12-05T09:26:29.252 INFO:tasks.workunit.client.0.smithi067.stdout:8/542: write d5/dc/d1a/d62/f73 [814077,92328] 0 2023-12-05T09:26:29.265 INFO:tasks.workunit.client.1.smithi134.stdout:0/724: mkdir d13/d14/d30/d4b/d66/da0/da2/df2 0 2023-12-05T09:26:29.268 INFO:tasks.workunit.client.1.smithi134.stdout:7/755: rename d2/df/d81/f91 to d2/d7/d93/dcf/ff7 0 2023-12-05T09:26:29.270 INFO:tasks.workunit.client.0.smithi067.stdout:1/551: rmdir d2/d5/d7/de 39 2023-12-05T09:26:29.270 INFO:tasks.workunit.client.0.smithi067.stdout:1/552: dread - d2/d3/da6/dbb/fbc zero size 2023-12-05T09:26:29.270 INFO:tasks.workunit.client.1.smithi134.stdout:9/760: rmdir d7/d8/d14/d26/d7f/d92/d53/d7b 39 2023-12-05T09:26:29.272 INFO:tasks.workunit.client.0.smithi067.stdout:8/543: symlink d5/l9a 0 2023-12-05T09:26:29.272 INFO:tasks.workunit.client.0.smithi067.stdout:8/544: creat d5/dc/f9b x:0 0 0 2023-12-05T09:26:29.273 INFO:tasks.workunit.client.0.smithi067.stdout:7/510: dread d0/d9/d10/d37/d38/f51 [0,4194304] 0 2023-12-05T09:26:29.273 INFO:tasks.workunit.client.0.smithi067.stdout:7/511: fdatasync d0/d9/d10/f2f 0 2023-12-05T09:26:29.273 INFO:tasks.workunit.client.0.smithi067.stdout:7/512: creat d0/d9/d56/d8e/fa7 x:0 0 0 2023-12-05T09:26:29.273 INFO:tasks.workunit.client.0.smithi067.stdout:7/513: fsync d0/f4c 0 2023-12-05T09:26:29.277 INFO:tasks.workunit.client.0.smithi067.stdout:9/740: dwrite d1b/d25/d35/d56/f7d [0,4194304] 0 2023-12-05T09:26:29.285 INFO:tasks.workunit.client.1.smithi134.stdout:8/877: getdents da/de/d16 0 2023-12-05T09:26:29.285 INFO:tasks.workunit.client.0.smithi067.stdout:8/545: symlink d5/da/d30/d7c/l9c 0 2023-12-05T09:26:29.296 INFO:tasks.workunit.client.0.smithi067.stdout:8/546: dread d5/dc/d1a/d20/f4e [0,4194304] 0 2023-12-05T09:26:29.296 INFO:tasks.workunit.client.0.smithi067.stdout:8/547: chown d5/dc/d1a/d20/d3e/d79 104636811 1 2023-12-05T09:26:29.296 INFO:tasks.workunit.client.0.smithi067.stdout:8/548: fsync d5/d6a/f74 0 2023-12-05T09:26:29.297 INFO:tasks.workunit.client.0.smithi067.stdout:7/514: dread d0/d9/d10/d37/d38/d64/d54/f65 [8388608,4194304] 0 2023-12-05T09:26:29.297 INFO:tasks.workunit.client.0.smithi067.stdout:7/515: chown d0/d9/d10/d37/d38/f51 124812 1 2023-12-05T09:26:29.300 INFO:tasks.workunit.client.1.smithi134.stdout:9/761: write d7/fd8 [1420852,107457] 0 2023-12-05T09:26:29.304 INFO:tasks.workunit.client.1.smithi134.stdout:3/796: mkdir d4/d5/d45/d60/d85/dab/dfb 0 2023-12-05T09:26:29.304 INFO:tasks.workunit.client.1.smithi134.stdout:3/797: chown d4/d1f/f5d 84 1 2023-12-05T09:26:29.304 INFO:tasks.workunit.client.1.smithi134.stdout:3/798: chown d4/d1f/d4e/d6a/c74 14 1 2023-12-05T09:26:29.307 INFO:tasks.workunit.client.0.smithi067.stdout:4/493: rename d0/d1d/d25/d5c to d0/d1d/d25/d2c/d34/d4e/daa 0 2023-12-05T09:26:29.308 INFO:tasks.workunit.client.0.smithi067.stdout:9/741: dread d1b/f5f [0,4194304] 0 2023-12-05T09:26:29.309 INFO:tasks.workunit.client.0.smithi067.stdout:0/688: dwrite d3/f4 [0,4194304] 0 2023-12-05T09:26:29.310 INFO:tasks.workunit.client.1.smithi134.stdout:9/762: dread d7/d8/fe2 [0,4194304] 0 2023-12-05T09:26:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.318+0000 7f4b753ef700 1 -- 172.21.15.67:0/247440617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b700fcbf0 msgr2=0x7f4b700fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.318+0000 7f4b753ef700 1 --2- 172.21.15.67:0/247440617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b700fcbf0 0x7f4b700fd000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b60004880 tx=0x7f4b60009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.318+0000 7f4b753ef700 1 -- 172.21.15.67:0/247440617 shutdown_connections 2023-12-05T09:26:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.318+0000 7f4b753ef700 1 --2- 172.21.15.67:0/247440617 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b700fde00 0x7f4b700fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.318+0000 7f4b753ef700 1 --2- 172.21.15.67:0/247440617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b700fcbf0 0x7f4b700fd000 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b60004880 tx=0x7f4b60009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.318+0000 7f4b753ef700 1 -- 172.21.15.67:0/247440617 >> 172.21.15.67:0/247440617 conn(0x7f4b700f82d0 msgr2=0x7f4b700fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.318+0000 7f4b753ef700 1 -- 172.21.15.67:0/247440617 shutdown_connections 2023-12-05T09:26:29.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.319+0000 7f4b753ef700 1 -- 172.21.15.67:0/247440617 wait complete. 2023-12-05T09:26:29.320 INFO:tasks.workunit.client.0.smithi067.stdout:7/516: write d0/d9/d10/d37/d38/d64/d34/fa6 [3205160,119483] 0 2023-12-05T09:26:29.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.320+0000 7f4b753ef700 1 Processor -- start 2023-12-05T09:26:29.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.320+0000 7f4b753ef700 1 -- start start 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.320+0000 7f4b753ef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b700fde00 0x7f4b7010d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.320+0000 7f4b753ef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b7010db90 0x7f4b7010ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b753ef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7010e050 con 0x7f4b7010db90 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b753ef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7010e190 con 0x7f4b700fde00 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b6e7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b7010db90 0x7f4b7010ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b6e7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b7010db90 0x7f4b7010ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:39520/0 (socket says 172.21.15.67:39520) 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b6e7fc700 1 -- 172.21.15.67:0/2956693063 learned_addr learned my addr 172.21.15.67:0/2956693063 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b6effd700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b700fde00 0x7f4b7010d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b6e7fc700 1 -- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b700fde00 msgr2=0x7f4b7010d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:29.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b6e7fc700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b700fde00 0x7f4b7010d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:29.322 INFO:tasks.workunit.client.0.smithi067.stdout:4/494: symlink d0/d1d/d25/d2c/d34/d4e/d5a/lab 0 2023-12-05T09:26:29.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.321+0000 7f4b6e7fc700 1 -- 172.21.15.67:0/2956693063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60005040 con 0x7f4b7010db90 2023-12-05T09:26:29.322 INFO:tasks.workunit.client.0.smithi067.stdout:4/495: write d0/d1d/d4d/d8d/fa5 [7651,10407] 0 2023-12-05T09:26:29.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.322+0000 7f4b6e7fc700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b7010db90 0x7f4b7010ea30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b64002a50 tx=0x7f4b64004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:29.323 INFO:tasks.workunit.client.0.smithi067.stdout:4/496: chown d0/d1d/d2a/d93 0 1 2023-12-05T09:26:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.322+0000 7f4b577fe700 1 -- 172.21.15.67:0/2956693063 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b64007cc0 con 0x7f4b7010db90 2023-12-05T09:26:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.322+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7010f090 con 0x7f4b7010db90 2023-12-05T09:26:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.322+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7010f5a0 con 0x7f4b7010db90 2023-12-05T09:26:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.322+0000 7f4b577fe700 1 -- 172.21.15.67:0/2956693063 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b6400f040 con 0x7f4b7010db90 2023-12-05T09:26:29.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.323+0000 7f4b577fe700 1 -- 172.21.15.67:0/2956693063 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b6400d890 con 0x7f4b7010db90 2023-12-05T09:26:29.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.324+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c0052e0 con 0x7f4b7010db90 2023-12-05T09:26:29.326 INFO:tasks.workunit.client.0.smithi067.stdout:1/553: rename d2/d4f/d15/d60/f66 to d2/d5/d7/de/d19/d8f/d98/fc7 0 2023-12-05T09:26:29.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.326+0000 7f4b577fe700 1 -- 172.21.15.67:0/2956693063 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f4b6400da30 con 0x7f4b7010db90 2023-12-05T09:26:29.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.327+0000 7f4b577fe700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4b5806ae40 0x7f4b5806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:29.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.327+0000 7f4b577fe700 1 -- 172.21.15.67:0/2956693063 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4b64088fe0 con 0x7f4b7010db90 2023-12-05T09:26:29.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.328+0000 7f4b6effd700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4b5806ae40 0x7f4b5806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:29.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.329+0000 7f4b6effd700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4b5806ae40 0x7f4b5806d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4b60000c00 tx=0x7f4b60009e30 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:29.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/742: unlink d1b/d25/d94/fc3 0 2023-12-05T09:26:29.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/743: chown d1b/dd3/d6c/cb3 391 1 2023-12-05T09:26:29.329 INFO:tasks.workunit.client.0.smithi067.stdout:9/744: readlink d1b/d25/l29 0 2023-12-05T09:26:29.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.333+0000 7f4b577fe700 1 -- 172.21.15.67:0/2956693063 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4b64056dd0 con 0x7f4b7010db90 2023-12-05T09:26:29.332 INFO:tasks.workunit.client.0.smithi067.stdout:1/554: write d2/d3/da6/fb1 [324672,39890] 0 2023-12-05T09:26:29.334 INFO:tasks.workunit.client.1.smithi134.stdout:4/763: truncate d16/d21/d47/fe9 7759 0 2023-12-05T09:26:29.337 INFO:tasks.workunit.client.0.smithi067.stdout:0/689: symlink d3/d7/dd7/lfc 0 2023-12-05T09:26:29.338 INFO:tasks.workunit.client.1.smithi134.stdout:5/740: creat d0/dd/d37/f100 x:0 0 0 2023-12-05T09:26:29.339 INFO:tasks.workunit.client.0.smithi067.stdout:8/549: getdents d5/dc/d1a/d20/d2d/d7f 0 2023-12-05T09:26:29.339 INFO:tasks.workunit.client.0.smithi067.stdout:8/550: readlink d5/dc/d1a/d20/d2d/l5d 0 2023-12-05T09:26:29.340 INFO:tasks.workunit.client.1.smithi134.stdout:6/726: sync 2023-12-05T09:26:29.341 INFO:tasks.workunit.client.1.smithi134.stdout:0/725: mknod d13/d14/d30/d4b/d66/da0/daf/dce/d86/cf3 0 2023-12-05T09:26:29.343 INFO:tasks.workunit.client.0.smithi067.stdout:7/517: symlink d0/d9/d10/d37/d38/d64/d54/la8 0 2023-12-05T09:26:29.345 INFO:tasks.workunit.client.0.smithi067.stdout:4/497: symlink d0/d1d/d2a/d93/da4/lac 0 2023-12-05T09:26:29.346 INFO:tasks.workunit.client.0.smithi067.stdout:4/498: write d0/d1d/d53/da8/da9/d15/f20 [1604403,1340] 0 2023-12-05T09:26:29.346 INFO:tasks.workunit.client.0.smithi067.stdout:4/499: chown d0/d1d/d53/f6c 1070890877 1 2023-12-05T09:26:29.346 INFO:tasks.workunit.client.1.smithi134.stdout:4/764: dread d16/d7b/dce/d6e/daa/f32 [0,4194304] 0 2023-12-05T09:26:29.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/756: mkdir d2/d7/d2b/dd9/df8 0 2023-12-05T09:26:29.355 INFO:tasks.workunit.client.1.smithi134.stdout:1/921: truncate d2/d27/f3a 537374 0 2023-12-05T09:26:29.355 INFO:tasks.workunit.client.1.smithi134.stdout:8/878: creat da/de/d8a/d42/d99/dc8/f12c x:0 0 0 2023-12-05T09:26:29.357 INFO:tasks.workunit.client.1.smithi134.stdout:9/763: mknod d7/d10/d56/dd5/c101 0 2023-12-05T09:26:29.358 INFO:tasks.workunit.client.0.smithi067.stdout:0/690: write d3/d7/d3c/f75 [3503140,58289] 0 2023-12-05T09:26:29.359 INFO:tasks.workunit.client.0.smithi067.stdout:9/745: mkdir d1b/d25/df6 0 2023-12-05T09:26:29.359 INFO:tasks.workunit.client.0.smithi067.stdout:9/746: chown d1b/d25/d35/f79 3574 1 2023-12-05T09:26:29.364 INFO:tasks.workunit.client.1.smithi134.stdout:4/765: write d16/d7b/dce/d6e/daa/f3e [3182424,26180] 0 2023-12-05T09:26:29.366 INFO:tasks.workunit.client.1.smithi134.stdout:9/764: dread d7/d8/d14/fad [0,4194304] 0 2023-12-05T09:26:29.367 INFO:tasks.workunit.client.0.smithi067.stdout:1/555: mknod d2/d3/da6/dbd/cc8 0 2023-12-05T09:26:29.367 INFO:tasks.workunit.client.0.smithi067.stdout:8/551: mkdir d5/d9d 0 2023-12-05T09:26:29.368 INFO:tasks.workunit.client.0.smithi067.stdout:0/691: dread d3/d7/f8f [0,4194304] 0 2023-12-05T09:26:29.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/727: symlink d4/d39/d42/d4f/d6d/d3a/da/da0/le1 0 2023-12-05T09:26:29.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/728: fsync d4/d39/d42/fa7 0 2023-12-05T09:26:29.372 INFO:tasks.workunit.client.1.smithi134.stdout:5/741: write d0/d1a/d1c/f65 [2416274,130537] 0 2023-12-05T09:26:29.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/729: chown d4/d39/d42/d4f/d6d/d3a/f36 2033459 1 2023-12-05T09:26:29.372 INFO:tasks.workunit.client.1.smithi134.stdout:6/730: write d4/d39/d5c/fc2 [725069,18826] 0 2023-12-05T09:26:29.372 INFO:tasks.workunit.client.1.smithi134.stdout:5/742: creat d0/dd/d37/f101 x:0 0 0 2023-12-05T09:26:29.375 INFO:tasks.workunit.client.1.smithi134.stdout:0/726: rmdir d13/d14/d30/d4b/d66 39 2023-12-05T09:26:29.375 INFO:tasks.workunit.client.1.smithi134.stdout:7/757: link d2/d7/d2b/d2d/d67/d73/d26/ce9 d2/d7/d2b/dd9/cf9 0 2023-12-05T09:26:29.379 INFO:tasks.workunit.client.1.smithi134.stdout:2/833: sync 2023-12-05T09:26:29.379 INFO:tasks.workunit.client.1.smithi134.stdout:3/799: write d4/f13 [1203059,20947] 0 2023-12-05T09:26:29.382 INFO:tasks.workunit.client.0.smithi067.stdout:2/488: sync 2023-12-05T09:26:29.382 INFO:tasks.workunit.client.0.smithi067.stdout:7/518: mkdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da9 0 2023-12-05T09:26:29.382 INFO:tasks.workunit.client.0.smithi067.stdout:7/519: fdatasync d0/d9/d3f/f47 0 2023-12-05T09:26:29.382 INFO:tasks.workunit.client.0.smithi067.stdout:7/520: chown d0/d9/d10/d1d/f6d 170380597 1 2023-12-05T09:26:29.382 INFO:tasks.workunit.client.0.smithi067.stdout:1/556: dread d2/d5/d7/de/d1a/f4b [0,4194304] 0 2023-12-05T09:26:29.385 INFO:tasks.workunit.client.0.smithi067.stdout:9/747: write d1b/d25/d54/d5c/f98 [1481552,46503] 0 2023-12-05T09:26:29.393 INFO:tasks.workunit.client.0.smithi067.stdout:8/552: symlink d5/dc/d1a/l9e 0 2023-12-05T09:26:29.396 INFO:tasks.workunit.client.0.smithi067.stdout:2/489: rename d0/d25/d9d/c33 to d0/d25/d9d/d63/d88/ca9 0 2023-12-05T09:26:29.399 INFO:tasks.workunit.client.1.smithi134.stdout:3/800: creat d4/d5/d45/ffc x:0 0 0 2023-12-05T09:26:29.400 INFO:tasks.workunit.client.0.smithi067.stdout:7/521: mkdir d0/d9/d56/d8e/daa 0 2023-12-05T09:26:29.400 INFO:tasks.workunit.client.0.smithi067.stdout:7/522: truncate d0/d45/f80 958452 0 2023-12-05T09:26:29.400 INFO:tasks.workunit.client.0.smithi067.stdout:7/523: dread - d0/d9/d10/d37/d38/d64/d5a/f99 zero size 2023-12-05T09:26:29.402 INFO:tasks.workunit.client.0.smithi067.stdout:5/568: sync 2023-12-05T09:26:29.402 INFO:tasks.workunit.client.0.smithi067.stdout:6/472: sync 2023-12-05T09:26:29.402 INFO:tasks.workunit.client.0.smithi067.stdout:6/473: truncate da/d10/d1e/d17/d2f/d72/f97 115721 0 2023-12-05T09:26:29.402 INFO:tasks.workunit.client.0.smithi067.stdout:6/474: stat da/d10 0 2023-12-05T09:26:29.403 INFO:tasks.workunit.client.0.smithi067.stdout:3/492: sync 2023-12-05T09:26:29.409 INFO:tasks.workunit.client.0.smithi067.stdout:1/557: creat d2/d4f/d14/d20/fc9 x:0 0 0 2023-12-05T09:26:29.409 INFO:tasks.workunit.client.0.smithi067.stdout:1/558: truncate d2/d5/d50/f7f 4708768 0 2023-12-05T09:26:29.409 INFO:tasks.workunit.client.0.smithi067.stdout:1/559: readlink d2/d4f/d14/d48/lc6 0 2023-12-05T09:26:29.414 INFO:tasks.workunit.client.1.smithi134.stdout:5/743: write d0/d1a/d1c/d25/d4d/d9e/fac [210061,110112] 0 2023-12-05T09:26:29.416 INFO:tasks.workunit.client.1.smithi134.stdout:4/766: rename d16/d21/d47/d4b to d16/d7b/dce/d6e/daa/d3b/dcf/d10c 0 2023-12-05T09:26:29.416 INFO:tasks.workunit.client.1.smithi134.stdout:4/767: dread - d16/d7b/dce/d6e/daa/d3b/dcf/fe7 zero size 2023-12-05T09:26:29.418 INFO:tasks.workunit.client.1.smithi134.stdout:2/834: write d19/d76/da7/fb0 [92250,34421] 0 2023-12-05T09:26:29.418 INFO:tasks.workunit.client.1.smithi134.stdout:2/835: creat d19/f114 x:0 0 0 2023-12-05T09:26:29.418 INFO:tasks.workunit.client.1.smithi134.stdout:2/836: fdatasync d19/d28/fc9 0 2023-12-05T09:26:29.419 INFO:tasks.workunit.client.0.smithi067.stdout:9/748: rename d1b/d3e/lb7 to d1b/lf7 0 2023-12-05T09:26:29.423 INFO:tasks.workunit.client.1.smithi134.stdout:7/758: dwrite d2/d7/dc/d2e/d3a/fbf [0,4194304] 0 2023-12-05T09:26:29.423 INFO:tasks.workunit.client.1.smithi134.stdout:7/759: truncate d2/df/f68 927037 0 2023-12-05T09:26:29.424 INFO:tasks.workunit.client.0.smithi067.stdout:8/553: dread d5/da/f1f [0,4194304] 0 2023-12-05T09:26:29.424 INFO:tasks.workunit.client.0.smithi067.stdout:7/524: creat d0/d9/d10/d37/d38/fab x:0 0 0 2023-12-05T09:26:29.424 INFO:tasks.workunit.client.1.smithi134.stdout:8/879: dwrite da/de/d11/d8b/d8c/fa7 [0,4194304] 0 2023-12-05T09:26:29.425 INFO:tasks.workunit.client.1.smithi134.stdout:5/744: unlink d0/d1a/d1c/d3f/f41 0 2023-12-05T09:26:29.438 INFO:tasks.workunit.client.0.smithi067.stdout:5/569: write db/df/f16 [66288,30465] 0 2023-12-05T09:26:29.438 INFO:tasks.workunit.client.0.smithi067.stdout:5/570: chown db/df/d3f/fc3 6943 1 2023-12-05T09:26:29.442 INFO:tasks.workunit.client.0.smithi067.stdout:6/475: write da/d10/d1e/d17/d2f/f77 [2432558,22445] 0 2023-12-05T09:26:29.443 INFO:tasks.workunit.client.0.smithi067.stdout:6/476: write da/d10/d1e/d17/f40 [1066046,62456] 0 2023-12-05T09:26:29.444 INFO:tasks.workunit.client.1.smithi134.stdout:1/922: dwrite d2/d9/f104 [0,4194304] 0 2023-12-05T09:26:29.444 INFO:tasks.workunit.client.1.smithi134.stdout:1/923: readlink d2/d9/d10/d5b/dc4/l118 0 2023-12-05T09:26:29.444 INFO:tasks.workunit.client.1.smithi134.stdout:7/760: dread d2/d7/d65/f92 [0,4194304] 0 2023-12-05T09:26:29.444 INFO:tasks.workunit.client.1.smithi134.stdout:7/761: fdatasync d2/d7/d93/dcf/ff7 0 2023-12-05T09:26:29.445 INFO:tasks.workunit.client.1.smithi134.stdout:6/731: rename d4/d39/d42/d4f/d6d/f48 to d4/d78/d7a/daa/dba/fe2 0 2023-12-05T09:26:29.445 INFO:tasks.workunit.client.1.smithi134.stdout:4/768: mknod d16/d7b/dce/d6e/daa/d3b/dcf/d10c/c10d 0 2023-12-05T09:26:29.445 INFO:tasks.workunit.client.1.smithi134.stdout:4/769: fdatasync ff 0 2023-12-05T09:26:29.446 INFO:tasks.workunit.client.0.smithi067.stdout:9/749: symlink d1b/dd3/lf8 0 2023-12-05T09:26:29.446 INFO:tasks.workunit.client.0.smithi067.stdout:9/750: stat d1b/d25/d35/d56/dc7 0 2023-12-05T09:26:29.450 INFO:tasks.workunit.client.0.smithi067.stdout:8/554: symlink d5/da/d30/d61/d66/d91/l9f 0 2023-12-05T09:26:29.458 INFO:tasks.workunit.client.1.smithi134.stdout:2/837: symlink d19/d3a/df4/l115 0 2023-12-05T09:26:29.461 INFO:tasks.workunit.client.0.smithi067.stdout:7/525: rename d0/d9/d10/d37/d38/d64/d34/c6a to d0/d9/d10/d37/d38/d64/d34/d67/d72/da4/cac 0 2023-12-05T09:26:29.461 INFO:tasks.workunit.client.0.smithi067.stdout:5/571: read db/df/f53 [5818493,73883] 0 2023-12-05T09:26:29.461 INFO:tasks.workunit.client.0.smithi067.stdout:5/572: chown db/df/d36/l4b 11551425 1 2023-12-05T09:26:29.461 INFO:tasks.workunit.client.0.smithi067.stdout:5/573: creat db/df/d3f/d88/d8d/fd0 x:0 0 0 2023-12-05T09:26:29.461 INFO:tasks.workunit.client.0.smithi067.stdout:1/560: getdents d2/d4f/d14/d48 0 2023-12-05T09:26:29.466 INFO:tasks.workunit.client.1.smithi134.stdout:9/765: dwrite d7/d10/d56/fe6 [0,4194304] 0 2023-12-05T09:26:29.466 INFO:tasks.workunit.client.0.smithi067.stdout:2/490: dwrite d0/d25/d9d/f66 [0,4194304] 0 2023-12-05T09:26:29.466 INFO:tasks.workunit.client.0.smithi067.stdout:2/491: getdents d0/d25/d67 0 2023-12-05T09:26:29.466 INFO:tasks.workunit.client.0.smithi067.stdout:0/692: dwrite d3/fb [4194304,4194304] 0 2023-12-05T09:26:29.466 INFO:tasks.workunit.client.0.smithi067.stdout:0/693: chown d3/d7/c3a 115 1 2023-12-05T09:26:29.466 INFO:tasks.workunit.client.0.smithi067.stdout:0/694: chown d3/d7/f8f 36104 1 2023-12-05T09:26:29.466 INFO:tasks.workunit.client.0.smithi067.stdout:0/695: write d3/d7/d3c/d67/d59/d4e/db2/fe6 [776946,37704] 0 2023-12-05T09:26:29.467 INFO:tasks.workunit.client.1.smithi134.stdout:7/762: dread d2/df/f79 [0,4194304] 0 2023-12-05T09:26:29.467 INFO:tasks.workunit.client.1.smithi134.stdout:7/763: chown d2/d8f/cb7 7241351 1 2023-12-05T09:26:29.470 INFO:tasks.workunit.client.1.smithi134.stdout:0/727: dwrite d13/d14/d15/d2a/f4a [0,4194304] 0 2023-12-05T09:26:29.474 INFO:tasks.workunit.client.0.smithi067.stdout:3/493: dread d9/f14 [0,4194304] 0 2023-12-05T09:26:29.474 INFO:tasks.workunit.client.0.smithi067.stdout:3/494: write d9/da/d15/d17/d1a/d51/f75 [213558,64415] 0 2023-12-05T09:26:29.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/801: dwrite d4/d1f/f25 [0,4194304] 0 2023-12-05T09:26:29.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/802: write d4/d5/f32 [635421,2582] 0 2023-12-05T09:26:29.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/803: chown d4/d5/d45/f46 374808 1 2023-12-05T09:26:29.479 INFO:tasks.workunit.client.1.smithi134.stdout:9/766: read d7/d8/d14/d26/fbd [2154623,14456] 0 2023-12-05T09:26:29.479 INFO:tasks.workunit.client.1.smithi134.stdout:9/767: creat d7/d8/d16/d52/f102 x:0 0 0 2023-12-05T09:26:29.479 INFO:tasks.workunit.client.1.smithi134.stdout:9/768: creat d7/d8/d14/d26/d7f/dab/f103 x:0 0 0 2023-12-05T09:26:29.480 INFO:tasks.workunit.client.1.smithi134.stdout:9/769: dread - d7/d8/d14/d26/d7f/dab/f103 zero size 2023-12-05T09:26:29.486 INFO:tasks.workunit.client.0.smithi067.stdout:6/477: creat da/d10/d1e/fa9 x:0 0 0 2023-12-05T09:26:29.486 INFO:tasks.workunit.client.0.smithi067.stdout:6/478: truncate da/d10/d1e/d17/d2f/d72/fa7 650681 0 2023-12-05T09:26:29.490 INFO:tasks.workunit.client.0.smithi067.stdout:7/526: write d0/d9/d10/d1d/f6b [3384962,113301] 0 2023-12-05T09:26:29.490 INFO:tasks.workunit.client.1.smithi134.stdout:8/880: symlink da/de/d11/d8b/d8c/l12d 0 2023-12-05T09:26:29.494 INFO:tasks.workunit.client.1.smithi134.stdout:5/745: creat d0/d1a/d1c/d3f/d81/db0/f102 x:0 0 0 2023-12-05T09:26:29.495 INFO:tasks.workunit.client.1.smithi134.stdout:5/746: write d0/d45/f5a [1459140,11622] 0 2023-12-05T09:26:29.502 INFO:tasks.workunit.client.0.smithi067.stdout:5/574: rename db/df/d35/d63/f69 to db/df/d1a/d1d/d20/fd1 0 2023-12-05T09:26:29.503 INFO:tasks.workunit.client.0.smithi067.stdout:1/561: symlink d2/d5/d7/de/d19/lca 0 2023-12-05T09:26:29.518 INFO:tasks.workunit.client.1.smithi134.stdout:1/924: symlink d2/d9/d10/d30/d66/d9b/l147 0 2023-12-05T09:26:29.518 INFO:tasks.workunit.client.1.smithi134.stdout:1/925: stat d2/f140 0 2023-12-05T09:26:29.520 INFO:tasks.workunit.client.0.smithi067.stdout:2/492: getdents d0/d2f 0 2023-12-05T09:26:29.522 INFO:tasks.workunit.client.0.smithi067.stdout:2/493: fsync d0/d25/d9d/d53/d1e/f74 0 2023-12-05T09:26:29.522 INFO:tasks.workunit.client.0.smithi067.stdout:2/494: readlink d0/lb 0 2023-12-05T09:26:29.522 INFO:tasks.workunit.client.0.smithi067.stdout:2/495: write d0/d25/d34/f3d [5141642,119386] 0 2023-12-05T09:26:29.526 INFO:tasks.workunit.client.0.smithi067.stdout:6/479: mkdir da/d10/d1e/d17/d2f/d1f/d27/daa 0 2023-12-05T09:26:29.528 INFO:tasks.workunit.client.1.smithi134.stdout:9/770: dwrite d7/d8/d16/d52/d74/d97/d99/f9a [0,4194304] 0 2023-12-05T09:26:29.528 INFO:tasks.workunit.client.1.smithi134.stdout:9/771: readlink d7/d8/d16/l6e 0 2023-12-05T09:26:29.529 INFO:tasks.workunit.client.0.smithi067.stdout:9/751: dwrite d1b/d25/f6d [0,4194304] 0 2023-12-05T09:26:29.529 INFO:tasks.workunit.client.0.smithi067.stdout:9/752: creat d1b/d25/d54/ff9 x:0 0 0 2023-12-05T09:26:29.534 INFO:tasks.workunit.client.0.smithi067.stdout:5/575: mkdir db/df/d35/dc8/dd2 0 2023-12-05T09:26:29.537 INFO:tasks.workunit.client.0.smithi067.stdout:0/696: dread d3/fa [0,4194304] 0 2023-12-05T09:26:29.539 INFO:tasks.workunit.client.0.smithi067.stdout:8/555: dwrite d5/dc/d1a/d20/f25 [0,4194304] 0 2023-12-05T09:26:29.540 INFO:tasks.workunit.client.1.smithi134.stdout:7/764: symlink d2/d7/d93/dcf/dd6/lfa 0 2023-12-05T09:26:29.547 INFO:tasks.workunit.client.0.smithi067.stdout:3/495: rename d9/da/d3b/f40 to d9/d20/fac 0 2023-12-05T09:26:29.552 INFO:tasks.workunit.client.0.smithi067.stdout:1/562: fdatasync d2/d5/d7/de/d1a/f57 0 2023-12-05T09:26:29.552 INFO:tasks.workunit.client.0.smithi067.stdout:1/563: creat d2/d4f/d14/d20/fcb x:0 0 0 2023-12-05T09:26:29.560 INFO:tasks.workunit.client.0.smithi067.stdout:2/496: creat d0/d7c/faa x:0 0 0 2023-12-05T09:26:29.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/556: dread d5/da/f80 [0,4194304] 0 2023-12-05T09:26:29.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/557: getdents d5/dc/d1a/d20/d3e/d79 0 2023-12-05T09:26:29.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/558: read - d5/dc/d1a/d20/d3e/f70 zero size 2023-12-05T09:26:29.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/559: dread - d5/dc/d1a/d20/d2d/d7f/f93 zero size 2023-12-05T09:26:29.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/560: truncate d5/da/f8d 544417 0 2023-12-05T09:26:29.563 INFO:tasks.workunit.client.0.smithi067.stdout:8/561: read d5/dc/d1a/d62/d7e/f83 [44801,35134] 0 2023-12-05T09:26:29.565 INFO:tasks.workunit.client.1.smithi134.stdout:7/765: dread d2/d7/dc/d22/f3d [0,4194304] 0 2023-12-05T09:26:29.570 INFO:tasks.workunit.client.0.smithi067.stdout:6/480: link da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/c50 da/d10/d1e/d17/d2f/d1f/d27/d4f/cab 0 2023-12-05T09:26:29.571 INFO:tasks.workunit.client.0.smithi067.stdout:6/481: read - da/d10/d1e/d51/f7a zero size 2023-12-05T09:26:29.571 INFO:tasks.workunit.client.0.smithi067.stdout:8/562: dread d5/dc/d1a/d62/d7e/f83 [0,4194304] 0 2023-12-05T09:26:29.576 INFO:tasks.workunit.client.1.smithi134.stdout:3/804: rmdir d4/d5/d45/d60/d85/d96/dde 39 2023-12-05T09:26:29.580 INFO:tasks.workunit.client.1.smithi134.stdout:9/772: dwrite d7/d5b/d5e/f8c [0,4194304] 0 2023-12-05T09:26:29.580 INFO:tasks.workunit.client.1.smithi134.stdout:1/926: dwrite d2/d9/d10/d30/d66/da9/feb [0,4194304] 0 2023-12-05T09:26:29.581 INFO:tasks.workunit.client.1.smithi134.stdout:9/773: write d7/d8/d14/d26/d7f/dab/f103 [22542,98015] 0 2023-12-05T09:26:29.582 INFO:tasks.workunit.client.1.smithi134.stdout:7/766: read d2/dd/fc8 [2030580,69462] 0 2023-12-05T09:26:29.589 INFO:tasks.workunit.client.0.smithi067.stdout:8/563: dread d5/dc/d1a/d20/d3e/f42 [0,4194304] 0 2023-12-05T09:26:29.597 INFO:tasks.workunit.client.1.smithi134.stdout:8/881: unlink da/de/d11/d1d/d5f/d9b/f9f 0 2023-12-05T09:26:29.597 INFO:tasks.workunit.client.1.smithi134.stdout:5/747: creat d0/dd/d37/d90/f103 x:0 0 0 2023-12-05T09:26:29.599 INFO:tasks.workunit.client.0.smithi067.stdout:9/753: mkdir d1b/d25/d5b/d62/def/dfa 0 2023-12-05T09:26:29.600 INFO:tasks.workunit.client.0.smithi067.stdout:0/697: chown d3/d7/d3c/d6c/d76/da7/dec/l7a 302357446 1 2023-12-05T09:26:29.604 INFO:tasks.workunit.client.0.smithi067.stdout:3/496: mknod d9/da/d15/cad 0 2023-12-05T09:26:29.604 INFO:tasks.workunit.client.0.smithi067.stdout:3/497: write d9/d62/f8a [529431,69147] 0 2023-12-05T09:26:29.604 INFO:tasks.workunit.client.0.smithi067.stdout:8/564: read d5/dc/d1a/d20/d2d/f5f [2132258,49223] 0 2023-12-05T09:26:29.628 INFO:tasks.workunit.client.0.smithi067.stdout:6/482: creat da/d10/d1e/d17/d2f/d1f/d27/fac x:0 0 0 2023-12-05T09:26:29.629 INFO:tasks.workunit.client.0.smithi067.stdout:9/754: creat d1b/d25/d54/d5c/ffb x:0 0 0 2023-12-05T09:26:29.629 INFO:tasks.workunit.client.0.smithi067.stdout:9/755: truncate d1b/d25/f70 955558 0 2023-12-05T09:26:29.630 INFO:tasks.workunit.client.0.smithi067.stdout:9/756: write d1b/d25/d35/d56/fc1 [247317,78140] 0 2023-12-05T09:26:29.630 INFO:tasks.workunit.client.0.smithi067.stdout:9/757: readlink d1b/d25/d35/l3d 0 2023-12-05T09:26:29.632 INFO:tasks.workunit.client.0.smithi067.stdout:4/500: sync 2023-12-05T09:26:29.634 INFO:tasks.workunit.client.1.smithi134.stdout:9/774: dwrite d7/d8/d16/d52/d74/d97/fdb [0,4194304] 0 2023-12-05T09:26:29.637 INFO:tasks.workunit.client.0.smithi067.stdout:3/498: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/fae x:0 0 0 2023-12-05T09:26:29.641 INFO:tasks.workunit.client.0.smithi067.stdout:9/758: creat d1b/d25/d5b/ffc x:0 0 0 2023-12-05T09:26:29.641 INFO:tasks.workunit.client.0.smithi067.stdout:9/759: read d1b/dd3/d6c/f92 [1184042,63445] 0 2023-12-05T09:26:29.641 INFO:tasks.workunit.client.0.smithi067.stdout:9/760: stat d1b/d25/f6d 0 2023-12-05T09:26:29.642 INFO:tasks.workunit.client.0.smithi067.stdout:4/501: mknod d0/d1d/d2a/d93/cad 0 2023-12-05T09:26:29.642 INFO:tasks.workunit.client.0.smithi067.stdout:4/502: creat d0/d1d/d2a/fae x:0 0 0 2023-12-05T09:26:29.652 INFO:tasks.workunit.client.0.smithi067.stdout:0/698: rename d3/d7/d3c/l43 to d3/d7/d3c/d66/lfd 0 2023-12-05T09:26:29.652 INFO:tasks.workunit.client.0.smithi067.stdout:0/699: readlink d3/d7/d3c/d6c/d8a/l8e 0 2023-12-05T09:26:29.652 INFO:tasks.workunit.client.0.smithi067.stdout:7/527: dwrite d0/d9/d3f/f7e [0,4194304] 0 2023-12-05T09:26:29.656 INFO:tasks.workunit.client.0.smithi067.stdout:9/761: creat d1b/d25/df6/ffd x:0 0 0 2023-12-05T09:26:29.659 INFO:tasks.workunit.client.0.smithi067.stdout:4/503: mkdir d0/d1d/d25/d2c/d34/d4e/d5a/daf 0 2023-12-05T09:26:29.664 INFO:tasks.workunit.client.1.smithi134.stdout:5/748: dwrite d0/d1a/d1c/d3f/d81/fe5 [0,4194304] 0 2023-12-05T09:26:29.665 INFO:tasks.workunit.client.0.smithi067.stdout:6/483: rename da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/f4d to da/d10/d1e/d7f/fad 0 2023-12-05T09:26:29.665 INFO:tasks.workunit.client.0.smithi067.stdout:6/484: write da/d10/d1e/d17/d2f/d72/f97 [712114,15094] 0 2023-12-05T09:26:29.669 INFO:tasks.workunit.client.0.smithi067.stdout:8/565: dwrite d5/f6b [0,4194304] 0 2023-12-05T09:26:29.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/767: dwrite d2/d7/d2b/d2d/d67/d73/f7e [0,4194304] 0 2023-12-05T09:26:29.672 INFO:tasks.workunit.client.1.smithi134.stdout:7/768: chown d2/dd/fc8 40617 1 2023-12-05T09:26:29.673 INFO:tasks.workunit.client.1.smithi134.stdout:7/769: fsync d2/d7/dc/d2e/d3a/fa5 0 2023-12-05T09:26:29.678 INFO:tasks.workunit.client.0.smithi067.stdout:7/528: mkdir d0/d9/d40/d7a/dad 0 2023-12-05T09:26:29.683 INFO:tasks.workunit.client.0.smithi067.stdout:2/497: dwrite d0/d25/d9d/d53/f1d [4194304,4194304] 0 2023-12-05T09:26:29.683 INFO:tasks.workunit.client.0.smithi067.stdout:2/498: write d0/d2f/d39/f89 [4496247,59920] 0 2023-12-05T09:26:29.683 INFO:tasks.workunit.client.0.smithi067.stdout:2/499: write d0/d25/d34/d4d/f81 [562446,94725] 0 2023-12-05T09:26:29.684 INFO:tasks.workunit.client.0.smithi067.stdout:3/499: dread d9/d62/f4c [0,4194304] 0 2023-12-05T09:26:29.685 INFO:tasks.workunit.client.0.smithi067.stdout:3/500: truncate d9/d49/f9f 665417 0 2023-12-05T09:26:29.685 INFO:tasks.workunit.client.0.smithi067.stdout:2/500: fsync d0/f7a 0 2023-12-05T09:26:29.686 INFO:tasks.workunit.client.0.smithi067.stdout:9/762: mknod d1b/d25/d5b/d62/def/cfe 0 2023-12-05T09:26:29.686 INFO:tasks.workunit.client.0.smithi067.stdout:9/763: write d1b/d25/d35/d56/fc1 [185944,122610] 0 2023-12-05T09:26:29.687 INFO:tasks.workunit.client.1.smithi134.stdout:7/770: dread d2/f8 [0,4194304] 0 2023-12-05T09:26:29.688 INFO:tasks.workunit.client.1.smithi134.stdout:7/771: write d2/dd/fc8 [1020652,88211] 0 2023-12-05T09:26:29.698 INFO:tasks.workunit.client.1.smithi134.stdout:2/838: rmdir d19 39 2023-12-05T09:26:29.700 INFO:tasks.workunit.client.0.smithi067.stdout:6/485: link da/d10/d1e/d17/d2f/d1f/c86 da/d10/d1e/d17/d2f/d2c/d34/d3b/cae 0 2023-12-05T09:26:29.706 INFO:tasks.workunit.client.0.smithi067.stdout:8/566: unlink d5/dc/d1a/d20/f4e 0 2023-12-05T09:26:29.707 INFO:tasks.workunit.client.1.smithi134.stdout:3/805: link d4/d5/d45/d86/cb9 d4/d5/d45/d60/d85/dab/dfb/cfd 0 2023-12-05T09:26:29.708 INFO:tasks.workunit.client.1.smithi134.stdout:3/806: dread - d4/d1f/fe1 zero size 2023-12-05T09:26:29.714 INFO:tasks.workunit.client.0.smithi067.stdout:2/501: creat d0/d25/d34/d4d/d54/d90/fab x:0 0 0 2023-12-05T09:26:29.714 INFO:tasks.workunit.client.0.smithi067.stdout:2/502: chown d0/d2f 0 1 2023-12-05T09:26:29.715 INFO:tasks.workunit.client.0.smithi067.stdout:2/503: chown d0/d25/d34/d4d/d54/c5e 122011 1 2023-12-05T09:26:29.715 INFO:tasks.workunit.client.0.smithi067.stdout:0/700: dwrite d3/d7/d3c/d6c/d76/da7/dec/f2b [4194304,4194304] 0 2023-12-05T09:26:29.715 INFO:tasks.workunit.client.0.smithi067.stdout:0/701: chown d3/d7/d3c/d67/d59/d5c/f65 52 1 2023-12-05T09:26:29.715 INFO:tasks.workunit.client.0.smithi067.stdout:9/764: mknod d1b/d3e/d7f/cff 0 2023-12-05T09:26:29.715 INFO:tasks.workunit.client.0.smithi067.stdout:9/765: write d1b/d3e/f91 [1410288,12517] 0 2023-12-05T09:26:29.717 INFO:tasks.workunit.client.1.smithi134.stdout:6/732: rename d4/d39/d42/d4f/d6d/d45 to d4/d39/d42/d4f/d6d/d3a/da/de3 0 2023-12-05T09:26:29.722 INFO:tasks.workunit.client.0.smithi067.stdout:6/486: creat da/d10/d1e/d17/d2f/d1f/d27/daa/faf x:0 0 0 2023-12-05T09:26:29.722 INFO:tasks.workunit.client.1.smithi134.stdout:8/882: truncate da/de/d11/f1a 5829083 0 2023-12-05T09:26:29.730 INFO:tasks.workunit.client.1.smithi134.stdout:9/775: symlink d7/d8/d16/d52/l104 0 2023-12-05T09:26:29.730 INFO:tasks.workunit.client.1.smithi134.stdout:9/776: truncate d7/d10/fa6 702096 0 2023-12-05T09:26:29.730 INFO:tasks.workunit.client.1.smithi134.stdout:9/777: creat d7/d5b/d5e/f105 x:0 0 0 2023-12-05T09:26:29.731 INFO:tasks.workunit.client.0.smithi067.stdout:2/504: symlink d0/d25/d9d/d53/d1e/d7f/lac 0 2023-12-05T09:26:29.731 INFO:tasks.workunit.client.0.smithi067.stdout:2/505: write d0/d25/f59 [1345734,12506] 0 2023-12-05T09:26:29.731 INFO:tasks.workunit.client.0.smithi067.stdout:2/506: creat d0/d25/d3f/d83/fad x:0 0 0 2023-12-05T09:26:29.734 INFO:tasks.workunit.client.1.smithi134.stdout:8/883: write da/de/d8a/d42/d99/dc8/d3b/f65 [396167,111358] 0 2023-12-05T09:26:29.734 INFO:tasks.workunit.client.1.smithi134.stdout:5/749: creat d0/dd/d37/d90/d9d/f104 x:0 0 0 2023-12-05T09:26:29.734 INFO:tasks.workunit.client.1.smithi134.stdout:2/839: read - d19/d28/d63/f113 zero size 2023-12-05T09:26:29.739 INFO:tasks.workunit.client.0.smithi067.stdout:8/567: dread d5/dc/d1a/f2e [0,4194304] 0 2023-12-05T09:26:29.739 INFO:tasks.workunit.client.0.smithi067.stdout:9/766: creat d1b/dd3/d6c/dcd/f100 x:0 0 0 2023-12-05T09:26:29.739 INFO:tasks.workunit.client.0.smithi067.stdout:8/568: truncate d5/dc/f96 995074 0 2023-12-05T09:26:29.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/807: mkdir d4/d5/d6f/dc2/ddb/dfe 0 2023-12-05T09:26:29.740 INFO:tasks.workunit.client.1.smithi134.stdout:0/728: rename d13/d14/d30/f7e to d13/d14/d15/d93/ff4 0 2023-12-05T09:26:29.743 INFO:tasks.workunit.client.1.smithi134.stdout:8/884: rmdir da/de/d11/d1d/d5f 39 2023-12-05T09:26:29.746 INFO:tasks.workunit.client.1.smithi134.stdout:5/750: mkdir d0/d11/d61/d105 0 2023-12-05T09:26:29.747 INFO:tasks.workunit.client.1.smithi134.stdout:2/840: rmdir d19/d28/d31/d38 39 2023-12-05T09:26:29.749 INFO:tasks.workunit.client.0.smithi067.stdout:6/487: write da/d10/d1e/d17/f23 [6811496,130851] 0 2023-12-05T09:26:29.750 INFO:tasks.workunit.client.0.smithi067.stdout:6/488: write da/fa1 [759773,33553] 0 2023-12-05T09:26:29.750 INFO:tasks.workunit.client.0.smithi067.stdout:6/489: write da/d10/d1e/d17/d2f/d3f/d92/fa2 [157230,35496] 0 2023-12-05T09:26:29.750 INFO:tasks.workunit.client.1.smithi134.stdout:1/927: rename d2/d9/d10/d30/c8f to d2/d9/d10/d30/d66/da9/d74/d125/c148 0 2023-12-05T09:26:29.751 INFO:tasks.workunit.client.1.smithi134.stdout:1/928: dread - d2/d9/d10/d94/de5/d112/ff3 zero size 2023-12-05T09:26:29.751 INFO:tasks.workunit.client.0.smithi067.stdout:8/569: mknod d5/dc/d1a/d20/d3e/d95/ca0 0 2023-12-05T09:26:29.751 INFO:tasks.workunit.client.0.smithi067.stdout:9/767: mknod d1b/d25/d5b/d62/def/c101 0 2023-12-05T09:26:29.751 INFO:tasks.workunit.client.0.smithi067.stdout:9/768: truncate d1b/d25/fd9 57200 0 2023-12-05T09:26:29.751 INFO:tasks.workunit.client.0.smithi067.stdout:9/769: chown d1b/d25/d35/d56/f8c 1319 1 2023-12-05T09:26:29.752 INFO:tasks.workunit.client.1.smithi134.stdout:0/729: dread d13/d14/d30/d4b/f42 [0,4194304] 0 2023-12-05T09:26:29.752 INFO:tasks.workunit.client.1.smithi134.stdout:0/730: creat d13/d14/d30/d4b/d66/da0/daf/ff5 x:0 0 0 2023-12-05T09:26:29.753 INFO:tasks.workunit.client.1.smithi134.stdout:3/808: creat d4/d5/d6f/dc2/fff x:0 0 0 2023-12-05T09:26:29.753 INFO:tasks.workunit.client.1.smithi134.stdout:3/809: chown d4/d1f/d50/d52/c4a 211 1 2023-12-05T09:26:29.753 INFO:tasks.workunit.client.1.smithi134.stdout:3/810: chown d4/d1f/fc7 10585 1 2023-12-05T09:26:29.754 INFO:tasks.workunit.client.1.smithi134.stdout:8/885: mkdir da/de/d11/d1d/d5f/dea/d12e 0 2023-12-05T09:26:29.755 INFO:tasks.workunit.client.1.smithi134.stdout:8/886: fsync da/de/d4d/f8d 0 2023-12-05T09:26:29.755 INFO:tasks.workunit.client.1.smithi134.stdout:8/887: creat da/de/d43/f12f x:0 0 0 2023-12-05T09:26:29.755 INFO:tasks.workunit.client.1.smithi134.stdout:8/888: write da/de/d16/d33/f38 [1183882,105511] 0 2023-12-05T09:26:29.762 INFO:tasks.workunit.client.0.smithi067.stdout:8/570: rename d5/dc/d1a/d20/d2d/d41/f4d to d5/d3b/fa1 0 2023-12-05T09:26:29.767 INFO:tasks.workunit.client.0.smithi067.stdout:1/564: dwrite d2/d5/d7/de/d1a/f7c [0,4194304] 0 2023-12-05T09:26:29.767 INFO:tasks.workunit.client.0.smithi067.stdout:1/565: chown d2/d3/l1f 1835 1 2023-12-05T09:26:29.767 INFO:tasks.workunit.client.0.smithi067.stdout:8/571: unlink d5/dc/d1a/f2e 0 2023-12-05T09:26:29.767 INFO:tasks.workunit.client.1.smithi134.stdout:1/929: creat d2/d9/d8d/da2/f149 x:0 0 0 2023-12-05T09:26:29.768 INFO:tasks.workunit.client.0.smithi067.stdout:8/572: readlink d5/dc/l1b 0 2023-12-05T09:26:29.769 INFO:tasks.workunit.client.0.smithi067.stdout:4/504: dread d0/f41 [0,4194304] 0 2023-12-05T09:26:29.769 INFO:tasks.workunit.client.1.smithi134.stdout:5/751: dread d0/d1a/d1c/d3f/d5b/d5d/fd2 [0,4194304] 0 2023-12-05T09:26:29.773 INFO:tasks.workunit.client.1.smithi134.stdout:9/778: write d7/d8/f50 [1203062,115235] 0 2023-12-05T09:26:29.773 INFO:tasks.workunit.client.1.smithi134.stdout:9/779: creat d7/d7d/f106 x:0 0 0 2023-12-05T09:26:29.776 INFO:tasks.workunit.client.1.smithi134.stdout:3/811: dread d4/d5/d45/d60/d85/d96/f9d [0,4194304] 0 2023-12-05T09:26:29.776 INFO:tasks.workunit.client.1.smithi134.stdout:6/733: dread d4/d39/d42/d4f/d6d/d3a/d75/f30 [0,4194304] 0 2023-12-05T09:26:29.779 INFO:tasks.workunit.client.1.smithi134.stdout:8/889: mkdir da/de/d96/d130 0 2023-12-05T09:26:29.779 INFO:tasks.workunit.client.1.smithi134.stdout:1/930: rename d2/d9/d10/d94/laf to d2/d9/d8d/da2/l14a 0 2023-12-05T09:26:29.788 INFO:tasks.workunit.client.0.smithi067.stdout:1/566: mknod d2/d4f/d15/d60/d68/ccc 0 2023-12-05T09:26:29.788 INFO:tasks.workunit.client.0.smithi067.stdout:1/567: write d2/d5/d7/de/d19/d49/d6d/f5b [5787047,119781] 0 2023-12-05T09:26:29.788 INFO:tasks.workunit.client.0.smithi067.stdout:2/507: dread d0/fd [0,4194304] 0 2023-12-05T09:26:29.792 INFO:tasks.workunit.client.1.smithi134.stdout:5/752: mknod d0/dd/d37/c106 0 2023-12-05T09:26:29.794 INFO:tasks.workunit.client.0.smithi067.stdout:8/573: dread d5/dc/d1a/d62/d7e/f83 [0,4194304] 0 2023-12-05T09:26:29.794 INFO:tasks.workunit.client.0.smithi067.stdout:8/574: write d5/dc/d1a/d20/d58/f8f [274822,1096] 0 2023-12-05T09:26:29.795 INFO:tasks.workunit.client.0.smithi067.stdout:3/501: dwrite d9/d24/f33 [0,4194304] 0 2023-12-05T09:26:29.795 INFO:tasks.workunit.client.0.smithi067.stdout:3/502: read - d9/da/d15/d17/d2b/f4d zero size 2023-12-05T09:26:29.797 INFO:tasks.workunit.client.1.smithi134.stdout:8/890: write da/de/f4c [2554474,79876] 0 2023-12-05T09:26:29.797 INFO:tasks.workunit.client.1.smithi134.stdout:8/891: write da/de/d8a/d42/d99/f11a [677267,35924] 0 2023-12-05T09:26:29.802 INFO:tasks.workunit.client.1.smithi134.stdout:7/772: dwrite d2/dd/f19 [0,4194304] 0 2023-12-05T09:26:29.804 INFO:tasks.workunit.client.1.smithi134.stdout:9/780: symlink d7/d8/d14/d26/d5a/da1/de4/l107 0 2023-12-05T09:26:29.805 INFO:tasks.workunit.client.1.smithi134.stdout:9/781: chown d7/d8/la7 222523545 1 2023-12-05T09:26:29.805 INFO:tasks.workunit.client.1.smithi134.stdout:9/782: fdatasync d7/d7d/f106 0 2023-12-05T09:26:29.805 INFO:tasks.workunit.client.1.smithi134.stdout:9/783: write d7/d8/d14/f59 [3695794,59641] 0 2023-12-05T09:26:29.805 INFO:tasks.workunit.client.1.smithi134.stdout:9/784: truncate d7/d8/fbc 686221 0 2023-12-05T09:26:29.808 INFO:tasks.workunit.client.1.smithi134.stdout:4/770: sync 2023-12-05T09:26:29.808 INFO:tasks.workunit.client.1.smithi134.stdout:4/771: chown d16/d18 278223 1 2023-12-05T09:26:29.810 INFO:tasks.workunit.client.0.smithi067.stdout:8/575: rename d5/c2b to d5/dc/d1a/d20/d2d/ca2 0 2023-12-05T09:26:29.816 INFO:tasks.workunit.client.1.smithi134.stdout:3/812: unlink d4/d5/d45/d60/d85/d96/f9d 0 2023-12-05T09:26:29.817 INFO:tasks.workunit.client.0.smithi067.stdout:6/490: dread da/d10/d1e/d17/d2f/f77 [0,4194304] 0 2023-12-05T09:26:29.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.822+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b5c000bf0 con 0x7f4b5806ae40 2023-12-05T09:26:29.822 INFO:tasks.workunit.client.0.smithi067.stdout:2/508: write d0/fe [60777,84577] 0 2023-12-05T09:26:29.822 INFO:tasks.workunit.client.0.smithi067.stdout:2/509: creat d0/d25/d34/fae x:0 0 0 2023-12-05T09:26:29.823 INFO:tasks.workunit.client.0.smithi067.stdout:2/510: stat d0/c3c 0 2023-12-05T09:26:29.824 INFO:tasks.workunit.client.1.smithi134.stdout:6/734: unlink d4/d39/d42/d4f/d6d/d3a/d75/d59/f93 0 2023-12-05T09:26:29.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.825+0000 7f4b577fe700 1 -- 172.21.15.67:0/2956693063 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4b5c000bf0 con 0x7f4b5806ae40 2023-12-05T09:26:29.824 INFO:tasks.workunit.client.0.smithi067.stdout:9/770: dwrite d1b/d25/d35/d56/f5a [0,4194304] 0 2023-12-05T09:26:29.825 INFO:tasks.workunit.client.0.smithi067.stdout:3/503: stat d9/f43 0 2023-12-05T09:26:29.825 INFO:tasks.workunit.client.1.smithi134.stdout:9/785: dread d7/d8/f91 [0,4194304] 0 2023-12-05T09:26:29.825 INFO:tasks.workunit.client.1.smithi134.stdout:9/786: truncate d7/d7d/f82 1275742 0 2023-12-05T09:26:29.826 INFO:tasks.workunit.client.1.smithi134.stdout:0/731: mkdir d13/d14/d30/d4b/d66/da0/daf/dde/df6 0 2023-12-05T09:26:29.827 INFO:tasks.workunit.client.1.smithi134.stdout:4/772: read d16/d7b/db6/ffa [3313811,870] 0 2023-12-05T09:26:29.828 INFO:tasks.workunit.client.1.smithi134.stdout:2/841: dwrite d19/d28/d2b/f57 [0,4194304] 0 2023-12-05T09:26:29.828 INFO:tasks.workunit.client.1.smithi134.stdout:2/842: write d19/d28/d31/d38/f48 [4225939,119689] 0 2023-12-05T09:26:29.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4b5806ae40 msgr2=0x7f4b5806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:29.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4b5806ae40 0x7f4b5806d2f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4b60000c00 tx=0x7f4b60009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:29.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b7010db90 msgr2=0x7f4b7010ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:29.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b7010db90 0x7f4b7010ea30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b64002a50 tx=0x7f4b64004630 comp rx=0 tx=0).stop 2023-12-05T09:26:29.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 shutdown_connections 2023-12-05T09:26:29.831 INFO:tasks.workunit.client.1.smithi134.stdout:1/931: link d2/d9/d10/d94/de5/d112/ff3 d2/d9/d10/d5b/dc4/f14b 0 2023-12-05T09:26:29.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b700fde00 0x7f4b7010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4b5806ae40 0x7f4b5806d2f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 --2- 172.21.15.67:0/2956693063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b7010db90 0x7f4b7010ea30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.831+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 >> 172.21.15.67:0/2956693063 conn(0x7f4b700f82d0 msgr2=0x7f4b700fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.832+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 shutdown_connections 2023-12-05T09:26:29.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:29.832+0000 7f4b753ef700 1 -- 172.21.15.67:0/2956693063 wait complete. 2023-12-05T09:26:29.839 INFO:tasks.workunit.client.0.smithi067.stdout:8/576: unlink d5/dc/d1a/d20/c54 0 2023-12-05T09:26:29.840 INFO:tasks.workunit.client.1.smithi134.stdout:9/787: read d7/d8/d14/d26/f48 [631578,1822] 0 2023-12-05T09:26:29.844 INFO:tasks.workunit.client.1.smithi134.stdout:0/732: write d13/d14/d30/d4b/d66/da0/daf/dde/f47 [2679033,4812] 0 2023-12-05T09:26:29.844 INFO:tasks.workunit.client.0.smithi067.stdout:6/491: creat da/d10/d1e/d17/d2f/d1f/d27/d45/fb0 x:0 0 0 2023-12-05T09:26:29.845 INFO:tasks.workunit.client.0.smithi067.stdout:0/702: write d3/d7/d3c/d67/d59/d4e/f5d [3259915,122680] 0 2023-12-05T09:26:29.847 INFO:tasks.workunit.client.1.smithi134.stdout:5/753: mkdir d0/d11/d61/d107 0 2023-12-05T09:26:29.848 INFO:tasks.workunit.client.0.smithi067.stdout:7/529: dwrite d0/d9/d10/f32 [4194304,4194304] 0 2023-12-05T09:26:29.853 INFO:tasks.workunit.client.1.smithi134.stdout:8/892: link da/de/d96/d9d/fed da/de/d8a/d42/d99/d106/f131 0 2023-12-05T09:26:29.853 INFO:tasks.workunit.client.1.smithi134.stdout:0/733: dread d13/d14/f5c [0,4194304] 0 2023-12-05T09:26:29.854 INFO:tasks.workunit.client.1.smithi134.stdout:9/788: dread d7/d7d/f82 [0,4194304] 0 2023-12-05T09:26:29.854 INFO:tasks.workunit.client.1.smithi134.stdout:9/789: readlink d7/d8/d2e/l93 0 2023-12-05T09:26:29.859 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:26:29.877 INFO:tasks.workunit.client.0.smithi067.stdout:2/511: creat d0/d2f/faf x:0 0 0 2023-12-05T09:26:29.880 INFO:tasks.workunit.client.1.smithi134.stdout:9/790: dread d7/d8/d14/d26/d5a/fae [0,4194304] 0 2023-12-05T09:26:29.881 INFO:tasks.workunit.client.1.smithi134.stdout:7/773: creat d2/df/d81/daf/ffb x:0 0 0 2023-12-05T09:26:29.881 INFO:tasks.workunit.client.1.smithi134.stdout:3/813: creat d4/d5/d6f/d97/f100 x:0 0 0 2023-12-05T09:26:29.881 INFO:tasks.workunit.client.1.smithi134.stdout:3/814: chown d4/d5/d6f/d76 1034071 1 2023-12-05T09:26:29.881 INFO:tasks.workunit.client.1.smithi134.stdout:7/774: write d2/df/d81/daf/ffb [487351,85790] 0 2023-12-05T09:26:29.889 INFO:tasks.workunit.client.0.smithi067.stdout:9/771: link d1b/d25/f50 d1b/dd3/d6c/d78/f102 0 2023-12-05T09:26:29.898 INFO:tasks.workunit.client.1.smithi134.stdout:6/735: truncate d4/d39/d42/d4f/d6d/d3a/da/fc9 1742653 0 2023-12-05T09:26:29.898 INFO:tasks.workunit.client.1.smithi134.stdout:6/736: write d4/d39/d42/d4f/d6d/d3a/d80/f8b [4769265,43714] 0 2023-12-05T09:26:29.899 INFO:tasks.workunit.client.1.smithi134.stdout:6/737: chown d4/d78/d7a 1073459700 1 2023-12-05T09:26:29.900 INFO:tasks.workunit.client.0.smithi067.stdout:6/492: symlink da/d10/d1e/d17/d2f/d1f/d27/lb1 0 2023-12-05T09:26:29.903 INFO:tasks.workunit.client.0.smithi067.stdout:3/504: dwrite d9/d49/f9f [0,4194304] 0 2023-12-05T09:26:29.905 INFO:tasks.workunit.client.0.smithi067.stdout:4/505: dwrite d0/f41 [0,4194304] 0 2023-12-05T09:26:29.909 INFO:tasks.workunit.client.1.smithi134.stdout:2/843: dwrite d19/d28/d2b/f2f [0,4194304] 0 2023-12-05T09:26:29.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/773: rename d16/d7b/dce/d6e/daa/d3b/dcf/d10c to d16/d18/dad/d10e 0 2023-12-05T09:26:29.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/774: write d16/d7b/db6/ffa [2337820,2872] 0 2023-12-05T09:26:29.931 INFO:tasks.workunit.client.1.smithi134.stdout:1/932: mknod d2/d7e/c14c 0 2023-12-05T09:26:29.944 INFO:tasks.workunit.client.1.smithi134.stdout:3/815: dwrite d4/fb [0,4194304] 0 2023-12-05T09:26:29.944 INFO:tasks.workunit.client.1.smithi134.stdout:3/816: getdents d4/d5/d45/d86 0 2023-12-05T09:26:29.944 INFO:tasks.workunit.client.1.smithi134.stdout:3/817: chown d4/d5/d6f/f71 3755 1 2023-12-05T09:26:29.947 INFO:tasks.workunit.client.0.smithi067.stdout:8/577: dwrite d5/dc/d1a/f2f [0,4194304] 0 2023-12-05T09:26:29.950 INFO:tasks.workunit.client.1.smithi134.stdout:5/754: link d0/d1a/d1c/d3f/d81/db0/f102 d0/d1a/d1c/dde/f108 0 2023-12-05T09:26:29.950 INFO:tasks.workunit.client.1.smithi134.stdout:5/755: write d0/d1a/d1c/d3f/d5b/d5d/d78/fd7 [194412,54268] 0 2023-12-05T09:26:29.950 INFO:tasks.workunit.client.1.smithi134.stdout:5/756: creat d0/d1a/d1c/d25/d4d/d9e/f109 x:0 0 0 2023-12-05T09:26:29.954 INFO:tasks.workunit.client.1.smithi134.stdout:9/791: dwrite d7/d10/db3/fd3 [0,4194304] 0 2023-12-05T09:26:29.959 INFO:tasks.workunit.client.1.smithi134.stdout:3/818: dread d4/d5/f32 [0,4194304] 0 2023-12-05T09:26:29.960 INFO:tasks.workunit.client.1.smithi134.stdout:3/819: chown d4/f12 229 1 2023-12-05T09:26:29.973 INFO:tasks.workunit.client.1.smithi134.stdout:3/820: dread d4/d1f/f33 [0,4194304] 0 2023-12-05T09:26:29.975 INFO:tasks.workunit.client.0.smithi067.stdout:7/530: dwrite d0/f76 [4194304,4194304] 0 2023-12-05T09:26:29.977 INFO:tasks.workunit.client.1.smithi134.stdout:4/775: dwrite f13 [0,4194304] 0 2023-12-05T09:26:29.980 INFO:tasks.workunit.client.1.smithi134.stdout:7/775: mknod d2/d7/d93/dcf/ddd/cfc 0 2023-12-05T09:26:29.985 INFO:tasks.workunit.client.0.smithi067.stdout:1/568: dwrite d2/d5/d7/de/d19/d49/d5f/f79 [4194304,4194304] 0 2023-12-05T09:26:29.986 INFO:tasks.workunit.client.0.smithi067.stdout:1/569: chown d2/d5/d7/de/d19/f38 9 1 2023-12-05T09:26:29.987 INFO:tasks.workunit.client.1.smithi134.stdout:6/738: rmdir d4/d39/d42/d4f/d6d/d9f/dc4 39 2023-12-05T09:26:29.987 INFO:tasks.workunit.client.1.smithi134.stdout:6/739: truncate d4/d78/d7a/f9b 2817385 0 2023-12-05T09:26:29.991 INFO:tasks.workunit.client.1.smithi134.stdout:8/893: write da/f29 [243874,83029] 0 2023-12-05T09:26:29.992 INFO:tasks.workunit.client.0.smithi067.stdout:2/512: mkdir d0/d25/d34/d4d/db0 0 2023-12-05T09:26:29.992 INFO:tasks.workunit.client.0.smithi067.stdout:2/513: creat d0/d25/d3a/fb1 x:0 0 0 2023-12-05T09:26:29.997 INFO:tasks.workunit.client.1.smithi134.stdout:7/776: dread d2/dd/f19 [0,4194304] 0 2023-12-05T09:26:29.997 INFO:tasks.workunit.client.1.smithi134.stdout:7/777: chown d2/d7/dc/d2e/d3a 11 1 2023-12-05T09:26:29.997 INFO:tasks.workunit.client.1.smithi134.stdout:7/778: stat d2/d7/dc/d2e/d3a/d6d 0 2023-12-05T09:26:29.997 INFO:tasks.workunit.client.1.smithi134.stdout:2/844: creat d19/d28/d63/f116 x:0 0 0 2023-12-05T09:26:29.998 INFO:tasks.workunit.client.0.smithi067.stdout:9/772: unlink d1b/d25/d5b/d62/def/cfe 0 2023-12-05T09:26:29.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/493: mkdir da/d10/d1e/d17/d2f/db2 0 2023-12-05T09:26:30.001 INFO:tasks.workunit.client.1.smithi134.stdout:1/933: link d2/d9/d10/d5b/d126/f8e d2/d9/d10/d94/de5/d112/de1/f14d 0 2023-12-05T09:26:30.010 INFO:tasks.workunit.client.0.smithi067.stdout:3/505: truncate d9/da/d15/d17/d1a/f35 1106379 0 2023-12-05T09:26:30.010 INFO:tasks.workunit.client.0.smithi067.stdout:3/506: stat d9/da/d15/d17/d1a/d51/d66/d82/da1/f41 0 2023-12-05T09:26:30.013 INFO:tasks.workunit.client.0.smithi067.stdout:0/703: rename d3/d7/d3c/d66/fe7 to d3/ffe 0 2023-12-05T09:26:30.013 INFO:tasks.workunit.client.0.smithi067.stdout:4/506: creat d0/d1d/d25/d2c/d34/d4e/d5a/d88/fb0 x:0 0 0 2023-12-05T09:26:30.014 INFO:tasks.workunit.client.0.smithi067.stdout:8/578: mkdir d5/dc/d1a/d20/d2d/d7f/d94/da3 0 2023-12-05T09:26:30.014 INFO:tasks.workunit.client.0.smithi067.stdout:8/579: chown d5/dc/d1a/d20/d3e/l52 61 1 2023-12-05T09:26:30.020 INFO:tasks.workunit.client.0.smithi067.stdout:5/576: sync 2023-12-05T09:26:30.035 INFO:tasks.workunit.client.1.smithi134.stdout:5/757: unlink d0/d11/f1e 0 2023-12-05T09:26:30.037 INFO:tasks.workunit.client.1.smithi134.stdout:5/758: read d0/d50/fc2 [351627,68300] 0 2023-12-05T09:26:30.041 INFO:tasks.workunit.client.0.smithi067.stdout:7/531: truncate d0/d9/f5f 698779 0 2023-12-05T09:26:30.041 INFO:tasks.workunit.client.0.smithi067.stdout:7/532: stat d0/f76 0 2023-12-05T09:26:30.050 INFO:tasks.workunit.client.0.smithi067.stdout:1/570: creat d2/d5/d7/de/d19/d8f/d98/fcd x:0 0 0 2023-12-05T09:26:30.050 INFO:tasks.workunit.client.0.smithi067.stdout:1/571: write d2/d3/da6/fb1 [1246713,85293] 0 2023-12-05T09:26:30.050 INFO:tasks.workunit.client.0.smithi067.stdout:1/572: creat d2/d4f/d54/d70/db4/fce x:0 0 0 2023-12-05T09:26:30.051 INFO:tasks.workunit.client.1.smithi134.stdout:9/792: rename d7/d8/d16/c87 to d7/d8/d14/d26/c108 0 2023-12-05T09:26:30.053 INFO:tasks.workunit.client.0.smithi067.stdout:9/773: unlink d1b/d25/d35/f6f 0 2023-12-05T09:26:30.055 INFO:tasks.workunit.client.1.smithi134.stdout:3/821: dwrite d4/d5/f1e [0,4194304] 0 2023-12-05T09:26:30.057 INFO:tasks.workunit.client.0.smithi067.stdout:4/507: mknod d0/d1d/d2b/cb1 0 2023-12-05T09:26:30.057 INFO:tasks.workunit.client.0.smithi067.stdout:4/508: creat d0/d1d/d4d/fb2 x:0 0 0 2023-12-05T09:26:30.059 INFO:tasks.workunit.client.1.smithi134.stdout:8/894: symlink da/de/d11/d1d/d5f/dea/d12e/l132 0 2023-12-05T09:26:30.060 INFO:tasks.workunit.client.1.smithi134.stdout:7/779: mknod d2/d7/d2b/dd9/cfd 0 2023-12-05T09:26:30.064 INFO:tasks.workunit.client.1.smithi134.stdout:2/845: mknod d19/d3f/dbf/d10f/c117 0 2023-12-05T09:26:30.064 INFO:tasks.workunit.client.1.smithi134.stdout:2/846: readlink d19/d28/d63/d70/l95 0 2023-12-05T09:26:30.064 INFO:tasks.workunit.client.1.smithi134.stdout:2/847: write f8 [5192977,10921] 0 2023-12-05T09:26:30.064 INFO:tasks.workunit.client.1.smithi134.stdout:2/848: fsync d19/d28/d2b/fe7 0 2023-12-05T09:26:30.065 INFO:tasks.workunit.client.1.smithi134.stdout:2/849: dread - d19/d6d/fa4 zero size 2023-12-05T09:26:30.065 INFO:tasks.workunit.client.0.smithi067.stdout:2/514: dwrite d0/f8a [4194304,4194304] 0 2023-12-05T09:26:30.071 INFO:tasks.workunit.client.1.smithi134.stdout:5/759: truncate d0/d66/f76 2183640 0 2023-12-05T09:26:30.080 INFO:tasks.workunit.client.1.smithi134.stdout:4/776: dwrite d16/d21/d48/d66/db0/db3/fc3 [0,4194304] 0 2023-12-05T09:26:30.081 INFO:tasks.workunit.client.1.smithi134.stdout:6/740: getdents d4/d39/d5c 0 2023-12-05T09:26:30.085 INFO:tasks.workunit.client.0.smithi067.stdout:0/704: rename d3/d7/d3c/d66/lfd to d3/lff 0 2023-12-05T09:26:30.087 INFO:tasks.workunit.client.0.smithi067.stdout:8/580: dwrite d5/dc/d6e/f76 [0,4194304] 0 2023-12-05T09:26:30.087 INFO:tasks.workunit.client.0.smithi067.stdout:8/581: read d5/dc/d1a/d20/d2d/f5f [3014947,14273] 0 2023-12-05T09:26:30.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/734: sync 2023-12-05T09:26:30.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/735: chown d13/d14/d15/c28 25791102 1 2023-12-05T09:26:30.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/736: rename d13/d14/d30/d4b/d66/da0/daf/dce/d7d to d13/d14/d30/d4b/d66/da0/daf/dce/d7d/df7 22 2023-12-05T09:26:30.094 INFO:tasks.workunit.client.1.smithi134.stdout:0/737: chown d13/d14/d30/d4b/d23 1622 1 2023-12-05T09:26:30.096 INFO:tasks.workunit.client.1.smithi134.stdout:8/895: write da/de/d16/f23 [3756934,114843] 0 2023-12-05T09:26:30.097 INFO:tasks.workunit.client.0.smithi067.stdout:4/509: getdents d0/d1d/d25/d2c/d34/d4e/d5a 0 2023-12-05T09:26:30.097 INFO:tasks.workunit.client.0.smithi067.stdout:4/510: fsync d0/d1d/d53/da8/da9/d15/fa3 0 2023-12-05T09:26:30.097 INFO:tasks.workunit.client.0.smithi067.stdout:4/511: dread - d0/d1d/d53/fa2 zero size 2023-12-05T09:26:30.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.103+0000 7fd062cc2700 1 -- 172.21.15.67:0/570245528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 msgr2=0x7fd05c0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:30.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.103+0000 7fd062cc2700 1 --2- 172.21.15.67:0/570245528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 0x7fd05c0709c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd04c004940 tx=0x7fd04c009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:30.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.103+0000 7fd062cc2700 1 -- 172.21.15.67:0/570245528 shutdown_connections 2023-12-05T09:26:30.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.103+0000 7fd062cc2700 1 --2- 172.21.15.67:0/570245528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 0x7fd05c0709c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.103+0000 7fd062cc2700 1 --2- 172.21.15.67:0/570245528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd05c071bc0 0x7fd05c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.103+0000 7fd062cc2700 1 -- 172.21.15.67:0/570245528 >> 172.21.15.67:0/570245528 conn(0x7fd05c0f82d0 msgr2=0x7fd05c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:30.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.104+0000 7fd062cc2700 1 -- 172.21.15.67:0/570245528 shutdown_connections 2023-12-05T09:26:30.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.104+0000 7fd062cc2700 1 -- 172.21.15.67:0/570245528 wait complete. 2023-12-05T09:26:30.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.105+0000 7fd062cc2700 1 Processor -- start 2023-12-05T09:26:30.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.105+0000 7fd062cc2700 1 -- start start 2023-12-05T09:26:30.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.105+0000 7fd062cc2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 0x7fd05c113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:30.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.106+0000 7fd062cc2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd05c071bc0 0x7fd05c114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:30.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.106+0000 7fd062cc2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c114600 con 0x7fd05c070570 2023-12-05T09:26:30.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.106+0000 7fd062cc2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05c114ea0 con 0x7fd05c071bc0 2023-12-05T09:26:30.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.106+0000 7fd05bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd05c071bc0 0x7fd05c114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:30.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.106+0000 7fd05bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd05c071bc0 0x7fd05c114000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:48054/0 (socket says 172.21.15.67:48054) 2023-12-05T09:26:30.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.106+0000 7fd05bfff700 1 -- 172.21.15.67:0/866522974 learned_addr learned my addr 172.21.15.67:0/866522974 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:26:30.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.106+0000 7fd060a5e700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 0x7fd05c113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:30.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.107+0000 7fd060a5e700 1 -- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd05c071bc0 msgr2=0x7fd05c114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:30.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.107+0000 7fd060a5e700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd05c071bc0 0x7fd05c114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.107+0000 7fd060a5e700 1 -- 172.21.15.67:0/866522974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd050005040 con 0x7fd05c070570 2023-12-05T09:26:30.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.107+0000 7fd060a5e700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 0x7fd05c113ac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd0500094a0 tx=0x7fd050009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:30.108 INFO:tasks.workunit.client.1.smithi134.stdout:4/777: dread d16/d21/f62 [0,4194304] 0 2023-12-05T09:26:30.108 INFO:tasks.workunit.client.1.smithi134.stdout:4/778: write d16/d7b/dce/d6e/daa/f3e [3179692,18644] 0 2023-12-05T09:26:30.108 INFO:tasks.workunit.client.1.smithi134.stdout:4/779: write d16/d7b/dce/f83 [3941113,39401] 0 2023-12-05T09:26:30.108 INFO:tasks.workunit.client.1.smithi134.stdout:4/780: chown d16/d18/l90 250407 1 2023-12-05T09:26:30.109 INFO:tasks.workunit.client.1.smithi134.stdout:7/780: link d2/df/l62 d2/d7/d93/dcf/lfe 0 2023-12-05T09:26:30.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.109+0000 7fd0597fa700 1 -- 172.21.15.67:0/866522974 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd050009a40 con 0x7fd05c070570 2023-12-05T09:26:30.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.109+0000 7fd0597fa700 1 -- 172.21.15.67:0/866522974 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd05000f040 con 0x7fd05c070570 2023-12-05T09:26:30.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.109+0000 7fd0597fa700 1 -- 172.21.15.67:0/866522974 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd050013c40 con 0x7fd05c070570 2023-12-05T09:26:30.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.109+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c005040 con 0x7fd05c070570 2023-12-05T09:26:30.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.109+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05c115390 con 0x7fd05c070570 2023-12-05T09:26:30.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.112+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05c04bb80 con 0x7fd05c070570 2023-12-05T09:26:30.115 INFO:tasks.workunit.client.0.smithi067.stdout:5/577: mknod db/df/d82/cd3 0 2023-12-05T09:26:30.121 INFO:tasks.workunit.client.1.smithi134.stdout:9/793: dwrite d7/d8/d14/d26/d7f/d92/f8e [4194304,4194304] 0 2023-12-05T09:26:30.121 INFO:tasks.workunit.client.1.smithi134.stdout:9/794: readlink d7/d8/d16/d52/l104 0 2023-12-05T09:26:30.121 INFO:tasks.workunit.client.1.smithi134.stdout:9/795: truncate d7/d8/d14/d26/d5a/d69/fe0 115549 0 2023-12-05T09:26:30.121 INFO:tasks.workunit.client.1.smithi134.stdout:9/796: chown d7/d8/d14/d26/d7f/dab/f103 6166739 1 2023-12-05T09:26:30.122 INFO:tasks.workunit.client.1.smithi134.stdout:9/797: creat d7/d8/d14/d26/d5a/d69/f109 x:0 0 0 2023-12-05T09:26:30.122 INFO:tasks.workunit.client.1.smithi134.stdout:9/798: dread - d7/d8/d14/d26/d7f/d92/fde zero size 2023-12-05T09:26:30.122 INFO:tasks.workunit.client.1.smithi134.stdout:9/799: write d7/d8/f4c [2966640,118068] 0 2023-12-05T09:26:30.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.122+0000 7fd0597fa700 1 -- 172.21.15.67:0/866522974 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fd05000e7e0 con 0x7fd05c070570 2023-12-05T09:26:30.122 INFO:tasks.workunit.client.1.smithi134.stdout:8/896: dread da/de/d11/d1d/db8/f124 [0,4194304] 0 2023-12-05T09:26:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.125+0000 7fd0597fa700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fd04406af10 0x7fd04406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:30.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.125+0000 7fd0597fa700 1 -- 172.21.15.67:0/866522974 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd05008a290 con 0x7fd05c070570 2023-12-05T09:26:30.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.125+0000 7fd05bfff700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fd04406af10 0x7fd04406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:30.125 INFO:tasks.workunit.client.1.smithi134.stdout:5/760: link d0/d1a/d1c/d3f/l4a d0/d11/d61/d75/l10a 0 2023-12-05T09:26:30.125 INFO:tasks.workunit.client.1.smithi134.stdout:5/761: dread - d0/d1a/d1c/d25/fa2 zero size 2023-12-05T09:26:30.125 INFO:tasks.workunit.client.1.smithi134.stdout:5/762: dread - d0/d1a/d3a/f99 zero size 2023-12-05T09:26:30.126 INFO:tasks.workunit.client.0.smithi067.stdout:7/533: rmdir d0/d45 39 2023-12-05T09:26:30.126 INFO:tasks.workunit.client.0.smithi067.stdout:7/534: chown d0/d9/d40/d48/l57 180364 1 2023-12-05T09:26:30.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.127+0000 7fd05bfff700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fd04406af10 0x7fd04406d3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd04c013600 tx=0x7fd04c009e30 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:30.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.129+0000 7fd0597fa700 1 -- 172.21.15.67:0/866522974 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd050058040 con 0x7fd05c070570 2023-12-05T09:26:30.151 INFO:tasks.workunit.client.1.smithi134.stdout:6/741: creat d4/d39/d42/d4f/d6d/d3a/da/fe4 x:0 0 0 2023-12-05T09:26:30.151 INFO:tasks.workunit.client.0.smithi067.stdout:1/573: rmdir d2/d4f/d14/d20 39 2023-12-05T09:26:30.156 INFO:tasks.workunit.client.1.smithi134.stdout:0/738: truncate d13/d14/d15/d2a/f3e 3759774 0 2023-12-05T09:26:30.157 INFO:tasks.workunit.client.1.smithi134.stdout:2/850: dwrite d19/d76/f9a [0,4194304] 0 2023-12-05T09:26:30.158 INFO:tasks.workunit.client.0.smithi067.stdout:6/494: rename da/d10/d1e/d17/d2f/d1f/d27/fa8 to da/d7d/fb3 0 2023-12-05T09:26:30.161 INFO:tasks.workunit.client.1.smithi134.stdout:1/934: dwrite d2/d27/d40/f51 [4194304,4194304] 0 2023-12-05T09:26:30.162 INFO:tasks.workunit.client.0.smithi067.stdout:0/705: mknod d3/da2/c100 0 2023-12-05T09:26:30.165 INFO:tasks.workunit.client.1.smithi134.stdout:4/781: mkdir d16/d7b/d10f 0 2023-12-05T09:26:30.167 INFO:tasks.workunit.client.1.smithi134.stdout:8/897: dwrite da/de/d16/d98/fd0 [0,4194304] 0 2023-12-05T09:26:30.167 INFO:tasks.workunit.client.1.smithi134.stdout:8/898: write da/de/d8a/d42/f111 [819725,127602] 0 2023-12-05T09:26:30.167 INFO:tasks.workunit.client.1.smithi134.stdout:7/781: creat d2/d7/dc/d22/fff x:0 0 0 2023-12-05T09:26:30.170 INFO:tasks.workunit.client.1.smithi134.stdout:2/851: dread d19/d3f/f5a [0,4194304] 0 2023-12-05T09:26:30.170 INFO:tasks.workunit.client.1.smithi134.stdout:3/822: truncate d4/d5/f32 3337032 0 2023-12-05T09:26:30.171 INFO:tasks.workunit.client.1.smithi134.stdout:0/739: dread d13/d14/d30/d4b/f4e [0,4194304] 0 2023-12-05T09:26:30.172 INFO:tasks.workunit.client.0.smithi067.stdout:8/582: creat d5/dc/d1a/d20/d2d/d7f/d94/da3/fa4 x:0 0 0 2023-12-05T09:26:30.176 INFO:tasks.workunit.client.0.smithi067.stdout:1/574: dread d2/d5/d7/de/d19/d49/d5f/f79 [0,4194304] 0 2023-12-05T09:26:30.188 INFO:tasks.workunit.client.1.smithi134.stdout:9/800: rename d7/d8/f91 to d7/d8/d14/d26/d7f/d92/f10a 0 2023-12-05T09:26:30.190 INFO:tasks.workunit.client.1.smithi134.stdout:5/763: mkdir d0/d1a/d1c/d3f/d5b/d5d/d10b 0 2023-12-05T09:26:30.194 INFO:tasks.workunit.client.1.smithi134.stdout:1/935: creat d2/d9/d10/d30/dd4/f14e x:0 0 0 2023-12-05T09:26:30.194 INFO:tasks.workunit.client.1.smithi134.stdout:1/936: write d2/d9/d10/d30/dd4/dfb/f11e [365310,43579] 0 2023-12-05T09:26:30.194 INFO:tasks.workunit.client.1.smithi134.stdout:1/937: readlink d2/d27/d40/l41 0 2023-12-05T09:26:30.194 INFO:tasks.workunit.client.1.smithi134.stdout:1/938: getdents d2/d9/d10/d30/d66/d121 0 2023-12-05T09:26:30.197 INFO:tasks.workunit.client.0.smithi067.stdout:2/515: dwrite d0/d25/d34/d4d/f81 [0,4194304] 0 2023-12-05T09:26:30.199 INFO:tasks.workunit.client.0.smithi067.stdout:7/535: dwrite d0/d9/d40/d7a/f87 [0,4194304] 0 2023-12-05T09:26:30.202 INFO:tasks.workunit.client.0.smithi067.stdout:7/536: readlink d0/d9/d10/d37/d38/d64/d34/l60 0 2023-12-05T09:26:30.203 INFO:tasks.workunit.client.1.smithi134.stdout:4/782: link d16/d7b/db6/dbc/ff1 d16/d7b/dce/d6e/daa/f110 0 2023-12-05T09:26:30.203 INFO:tasks.workunit.client.0.smithi067.stdout:4/512: creat d0/d1d/d25/d2c/d34/d4e/d5a/fb3 x:0 0 0 2023-12-05T09:26:30.220 INFO:tasks.workunit.client.0.smithi067.stdout:8/583: dwrite d5/dc/d1a/d62/d7e/f83 [0,4194304] 0 2023-12-05T09:26:30.226 INFO:tasks.workunit.client.0.smithi067.stdout:5/578: mkdir db/df/d3f/d88/d8d/dd4 0 2023-12-05T09:26:30.228 INFO:tasks.workunit.client.0.smithi067.stdout:7/537: write d0/d9/d10/d37/d38/d64/d54/f65 [283162,19103] 0 2023-12-05T09:26:30.237 INFO:tasks.workunit.client.1.smithi134.stdout:8/899: creat da/de/d11/d8b/f133 x:0 0 0 2023-12-05T09:26:30.239 INFO:tasks.workunit.client.0.smithi067.stdout:9/774: rename d1b/f5f to d1b/d25/d35/d56/f103 0 2023-12-05T09:26:30.242 INFO:tasks.workunit.client.1.smithi134.stdout:7/782: symlink d2/l100 0 2023-12-05T09:26:30.244 INFO:tasks.workunit.client.1.smithi134.stdout:2/852: creat d19/d5f/f118 x:0 0 0 2023-12-05T09:26:30.244 INFO:tasks.workunit.client.1.smithi134.stdout:2/853: dread - d19/d28/d31/d38/d98/db5/ff1 zero size 2023-12-05T09:26:30.248 INFO:tasks.workunit.client.0.smithi067.stdout:8/584: dread d5/f45 [0,4194304] 0 2023-12-05T09:26:30.248 INFO:tasks.workunit.client.0.smithi067.stdout:8/585: truncate d5/f1c 8532898 0 2023-12-05T09:26:30.259 INFO:tasks.workunit.client.1.smithi134.stdout:0/740: mkdir d13/d14/d30/d4b/dc1/df8 0 2023-12-05T09:26:30.262 INFO:tasks.workunit.client.0.smithi067.stdout:0/706: dwrite d3/d7/d3c/dc2/fc8 [0,4194304] 0 2023-12-05T09:26:30.262 INFO:tasks.workunit.client.0.smithi067.stdout:0/707: creat d3/d7/d3c/d67/d59/d4e/f101 x:0 0 0 2023-12-05T09:26:30.263 INFO:tasks.workunit.client.0.smithi067.stdout:2/516: creat d0/d25/d67/fb2 x:0 0 0 2023-12-05T09:26:30.272 INFO:tasks.workunit.client.0.smithi067.stdout:4/513: dwrite d0/d1d/d25/d2c/d34/d4e/daa/f9d [0,4194304] 0 2023-12-05T09:26:30.272 INFO:tasks.workunit.client.0.smithi067.stdout:4/514: write d0/d1d/d25/f9a [4634232,21651] 0 2023-12-05T09:26:30.272 INFO:tasks.workunit.client.0.smithi067.stdout:4/515: chown d0/d1d/d25/d32/f44 3807579 1 2023-12-05T09:26:30.274 INFO:tasks.workunit.client.1.smithi134.stdout:9/801: mkdir d7/d8/d16/d52/d74/d97/d99/d10b 0 2023-12-05T09:26:30.277 INFO:tasks.workunit.client.1.smithi134.stdout:0/741: dread d13/d14/d30/d4b/d66/da0/daf/dce/fb9 [0,4194304] 0 2023-12-05T09:26:30.277 INFO:tasks.workunit.client.1.smithi134.stdout:0/742: write d13/d14/d30/d4b/fe2 [91344,86394] 0 2023-12-05T09:26:30.278 INFO:tasks.workunit.client.1.smithi134.stdout:0/743: stat d13/d14/d30/d4b/d23/d77/fae 0 2023-12-05T09:26:30.289 INFO:tasks.workunit.client.1.smithi134.stdout:4/783: link d16/d21/l22 d16/d7b/dce/d6e/daa/d3b/l111 0 2023-12-05T09:26:30.289 INFO:tasks.workunit.client.1.smithi134.stdout:4/784: fdatasync d16/d21/d48/d80/ff9 0 2023-12-05T09:26:30.293 INFO:tasks.workunit.client.0.smithi067.stdout:5/579: link db/df/d36/d57/f73 db/df/d1a/d1d/d20/fd5 0 2023-12-05T09:26:30.297 INFO:tasks.workunit.client.0.smithi067.stdout:9/775: dwrite d1b/dd3/d82/fb2 [0,4194304] 0 2023-12-05T09:26:30.297 INFO:tasks.workunit.client.0.smithi067.stdout:7/538: mknod d0/d9/d3f/cae 0 2023-12-05T09:26:30.303 INFO:tasks.workunit.client.1.smithi134.stdout:6/742: rename d4/d39/d42/f65 to d4/d78/fe5 0 2023-12-05T09:26:30.303 INFO:tasks.workunit.client.0.smithi067.stdout:1/575: rename d2/d5/d7/de/d19/d49/d5f/l86 to d2/d5/d7/de/lcf 0 2023-12-05T09:26:30.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/586: mkdir d5/dc/d1a/d20/d2d/d7f/da5 0 2023-12-05T09:26:30.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/587: dread - d5/dc/f9b zero size 2023-12-05T09:26:30.306 INFO:tasks.workunit.client.0.smithi067.stdout:8/588: chown d5/dc/d1a/d20/d2d/d7f/f93 112 1 2023-12-05T09:26:30.320 INFO:tasks.workunit.client.0.smithi067.stdout:4/516: getdents d0/d1d/d53/da8 0 2023-12-05T09:26:30.324 INFO:tasks.workunit.client.0.smithi067.stdout:5/580: mknod db/df/d1a/d1d/d20/cd6 0 2023-12-05T09:26:30.331 INFO:tasks.workunit.client.1.smithi134.stdout:7/783: mknod d2/d7/d6f/da0/ddb/c101 0 2023-12-05T09:26:30.331 INFO:tasks.workunit.client.1.smithi134.stdout:7/784: chown d2/df/l1e 6642348 1 2023-12-05T09:26:30.333 INFO:tasks.workunit.client.0.smithi067.stdout:9/776: creat d1b/f104 x:0 0 0 2023-12-05T09:26:30.336 INFO:tasks.workunit.client.1.smithi134.stdout:2/854: symlink d19/d28/db1/l119 0 2023-12-05T09:26:30.337 INFO:tasks.workunit.client.0.smithi067.stdout:9/777: write d1b/d25/d35/d56/fc1 [1079901,82537] 0 2023-12-05T09:26:30.337 INFO:tasks.workunit.client.0.smithi067.stdout:7/539: mknod d0/d9/d56/d8e/caf 0 2023-12-05T09:26:30.339 INFO:tasks.workunit.client.0.smithi067.stdout:1/576: mkdir d2/d4f/d54/dd0 0 2023-12-05T09:26:30.340 INFO:tasks.workunit.client.0.smithi067.stdout:1/577: write d2/d4f/d14/d20/f9a [889971,72845] 0 2023-12-05T09:26:30.340 INFO:tasks.workunit.client.0.smithi067.stdout:1/578: write d2/d5/d7/de/d19/d49/d5f/f9f [1151984,8753] 0 2023-12-05T09:26:30.341 INFO:tasks.workunit.client.1.smithi134.stdout:0/744: mknod d13/d14/d30/d4b/d23/d77/cf9 0 2023-12-05T09:26:30.343 INFO:tasks.workunit.client.0.smithi067.stdout:8/589: mknod d5/dc/d1a/d62/d7e/ca6 0 2023-12-05T09:26:30.343 INFO:tasks.workunit.client.0.smithi067.stdout:8/590: fdatasync d5/f1c 0 2023-12-05T09:26:30.344 INFO:tasks.workunit.client.0.smithi067.stdout:8/591: write d5/dc/d1a/d20/f59 [243649,83513] 0 2023-12-05T09:26:30.347 INFO:tasks.workunit.client.1.smithi134.stdout:0/745: dread f3 [0,4194304] 0 2023-12-05T09:26:30.347 INFO:tasks.workunit.client.1.smithi134.stdout:0/746: chown d13/d14/d30/d4b/fe2 17836215 1 2023-12-05T09:26:30.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/708: rmdir d3/d7/d3c/d6c/d76/da7 39 2023-12-05T09:26:30.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/709: dread - d3/d7/dd7/fdc zero size 2023-12-05T09:26:30.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/710: chown d3/d6b 0 1 2023-12-05T09:26:30.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/711: stat d3/d7/d3c/d6c/d76/da7/dec/l7a 0 2023-12-05T09:26:30.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/712: truncate d3/d7/d30/f93 673021 0 2023-12-05T09:26:30.355 INFO:tasks.workunit.client.1.smithi134.stdout:5/764: symlink d0/d1a/d1c/l10c 0 2023-12-05T09:26:30.355 INFO:tasks.workunit.client.1.smithi134.stdout:4/785: mknod d16/d18/c112 0 2023-12-05T09:26:30.356 INFO:tasks.workunit.client.1.smithi134.stdout:4/786: dread - d16/d18/d1b/ff2 zero size 2023-12-05T09:26:30.356 INFO:tasks.workunit.client.0.smithi067.stdout:4/517: symlink d0/d1d/d4d/d8d/lb4 0 2023-12-05T09:26:30.356 INFO:tasks.workunit.client.0.smithi067.stdout:4/518: chown d0/l87 531 1 2023-12-05T09:26:30.359 INFO:tasks.workunit.client.0.smithi067.stdout:5/581: link db/df/d3f/c61 db/df/d36/d57/cd7 0 2023-12-05T09:26:30.360 INFO:tasks.workunit.client.1.smithi134.stdout:3/823: sync 2023-12-05T09:26:30.360 INFO:tasks.workunit.client.1.smithi134.stdout:3/824: write d4/d1f/d50/f69 [376305,94955] 0 2023-12-05T09:26:30.360 INFO:tasks.workunit.client.1.smithi134.stdout:3/825: write d4/d5/d6f/d97/dae/dc9/f70 [1194301,54757] 0 2023-12-05T09:26:30.360 INFO:tasks.workunit.client.1.smithi134.stdout:3/826: write d4/d5/d6f/f5e [479788,78054] 0 2023-12-05T09:26:30.362 INFO:tasks.workunit.client.1.smithi134.stdout:6/743: mknod d4/d39/d42/d4f/d6d/d3a/d75/dbc/dd7/ce6 0 2023-12-05T09:26:30.366 INFO:tasks.workunit.client.1.smithi134.stdout:8/900: getdents da/de/d4d 0 2023-12-05T09:26:30.366 INFO:tasks.workunit.client.1.smithi134.stdout:8/901: creat da/de/d43/f134 x:0 0 0 2023-12-05T09:26:30.371 INFO:tasks.workunit.client.1.smithi134.stdout:7/785: link d2/d7/f13 d2/d7/d2b/d94/f102 0 2023-12-05T09:26:30.371 INFO:tasks.workunit.client.1.smithi134.stdout:4/787: mkdir d16/d21/d35/d113 0 2023-12-05T09:26:30.373 INFO:tasks.workunit.client.0.smithi067.stdout:7/540: rename d0/d9/l3c to d0/d9/d10/d37/d38/d64/d34/d67/d72/lb0 0 2023-12-05T09:26:30.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:30 smithi134 ceph-mon[116304]: pgmap v30: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 161 MiB/s rd, 206 MiB/s wr, 291 op/s 2023-12-05T09:26:30.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:30 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:30.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:30 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:30.378 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:30 smithi067 ceph-mon[107174]: pgmap v30: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 161 MiB/s rd, 206 MiB/s wr, 291 op/s 2023-12-05T09:26:30.378 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:30 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:30.378 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:30 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:30.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/592: dread d5/dc/d1a/f2f [0,4194304] 0 2023-12-05T09:26:30.379 INFO:tasks.workunit.client.0.smithi067.stdout:8/593: rename d5 to d5/dc/d1a/d20/d58/da7 22 2023-12-05T09:26:30.379 INFO:tasks.workunit.client.0.smithi067.stdout:8/594: chown d5/dc/d1a/d20/f72 2 1 2023-12-05T09:26:30.379 INFO:tasks.workunit.client.1.smithi134.stdout:1/939: rename d2/d27/c29 to d2/d27/d40/d10a/c14f 0 2023-12-05T09:26:30.385 INFO:tasks.workunit.client.0.smithi067.stdout:5/582: mkdir db/df/d35/d63/d75/dd8 0 2023-12-05T09:26:30.387 INFO:tasks.workunit.client.1.smithi134.stdout:8/902: truncate da/de/d11/fe4 935836 0 2023-12-05T09:26:30.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/765: rmdir d0/d1a/d1c/d3f/d81 39 2023-12-05T09:26:30.399 INFO:tasks.workunit.client.1.smithi134.stdout:5/766: read - d0/d1a/d1c/d25/fb2 zero size 2023-12-05T09:26:30.410 INFO:tasks.workunit.client.1.smithi134.stdout:9/802: rename d7/d8/d14/fc7 to d7/d8/d16/d52/d74/d97/df0/f10c 0 2023-12-05T09:26:30.410 INFO:tasks.workunit.client.1.smithi134.stdout:2/855: rename d19/d3f/dbf/d10f to d19/d3f/dbf/d10f/d11a 22 2023-12-05T09:26:30.417 INFO:tasks.workunit.client.1.smithi134.stdout:4/788: write d16/d21/d35/f60 [922781,90048] 0 2023-12-05T09:26:30.417 INFO:tasks.workunit.client.1.smithi134.stdout:4/789: chown d16/f7a 14185726 1 2023-12-05T09:26:30.422 INFO:tasks.workunit.client.1.smithi134.stdout:3/827: mknod d4/d5/d6f/d76/c101 0 2023-12-05T09:26:30.423 INFO:tasks.workunit.client.0.smithi067.stdout:3/507: sync 2023-12-05T09:26:30.423 INFO:tasks.workunit.client.0.smithi067.stdout:3/508: creat d9/da/d15/d17/faf x:0 0 0 2023-12-05T09:26:30.427 INFO:tasks.workunit.client.0.smithi067.stdout:1/579: rmdir d2/d4f 39 2023-12-05T09:26:30.431 INFO:tasks.workunit.client.0.smithi067.stdout:7/541: dread d0/f4c [0,4194304] 0 2023-12-05T09:26:30.431 INFO:tasks.workunit.client.1.smithi134.stdout:8/903: mkdir da/de/d11/d1d/d135 0 2023-12-05T09:26:30.435 INFO:tasks.workunit.client.1.smithi134.stdout:5/767: mkdir d0/d1a/d1c/dde/d10d 0 2023-12-05T09:26:30.436 INFO:tasks.workunit.client.0.smithi067.stdout:3/509: dread d9/da/d15/d17/d1a/d51/d66/f98 [0,4194304] 0 2023-12-05T09:26:30.438 INFO:tasks.workunit.client.1.smithi134.stdout:9/803: dread d7/d8/d2e/f31 [0,4194304] 0 2023-12-05T09:26:30.439 INFO:tasks.workunit.client.0.smithi067.stdout:5/583: truncate db/df/d3f/d88/d8d/fcc 1367255 0 2023-12-05T09:26:30.439 INFO:tasks.workunit.client.0.smithi067.stdout:5/584: chown db/df/la0 6 1 2023-12-05T09:26:30.447 INFO:tasks.workunit.client.1.smithi134.stdout:7/786: unlink d2/d7/dc/d22/l33 0 2023-12-05T09:26:30.448 INFO:tasks.workunit.client.1.smithi134.stdout:7/787: write d2/d7/dc/d2e/fdf [607372,50988] 0 2023-12-05T09:26:30.451 INFO:tasks.workunit.client.0.smithi067.stdout:9/778: dwrite d1b/d25/d54/d5c/f72 [0,4194304] 0 2023-12-05T09:26:30.452 INFO:tasks.workunit.client.0.smithi067.stdout:9/779: readlink d1b/l42 0 2023-12-05T09:26:30.452 INFO:tasks.workunit.client.0.smithi067.stdout:9/780: read - d1b/d25/d54/d5c/f69 zero size 2023-12-05T09:26:30.452 INFO:tasks.workunit.client.1.smithi134.stdout:2/856: dread d19/d28/d63/f67 [0,4194304] 0 2023-12-05T09:26:30.465 INFO:tasks.workunit.client.1.smithi134.stdout:3/828: dwrite d4/d5/d6f/d97/dae/dc9/f2a [0,4194304] 0 2023-12-05T09:26:30.474 INFO:tasks.workunit.client.0.smithi067.stdout:4/519: dwrite d0/d1d/d24/f66 [0,4194304] 0 2023-12-05T09:26:30.474 INFO:tasks.workunit.client.0.smithi067.stdout:4/520: chown d0/d1d/d53/d82/la6 3 1 2023-12-05T09:26:30.476 INFO:tasks.workunit.client.0.smithi067.stdout:8/595: getdents d5/dc/d1a/d62 0 2023-12-05T09:26:30.483 INFO:tasks.workunit.client.1.smithi134.stdout:6/744: rename d4/d39/d42/d4f/d8a/fcc to d4/d39/d42/d4f/fe7 0 2023-12-05T09:26:30.487 INFO:tasks.workunit.client.1.smithi134.stdout:0/747: dwrite d13/d14/d30/d4b/d66/da0/daf/dce/fb9 [0,4194304] 0 2023-12-05T09:26:30.487 INFO:tasks.workunit.client.1.smithi134.stdout:0/748: read d13/d14/d30/d4b/d66/da0/daf/dce/f7f [2595411,87176] 0 2023-12-05T09:26:30.491 INFO:tasks.workunit.client.0.smithi067.stdout:0/713: dwrite d3/d7/d3c/d6c/d8a/fce [4194304,4194304] 0 2023-12-05T09:26:30.505 INFO:tasks.workunit.client.1.smithi134.stdout:1/940: link d2/d27/fa4 d2/d9/d8d/da2/db1/f150 0 2023-12-05T09:26:30.509 INFO:tasks.workunit.client.1.smithi134.stdout:6/745: dread d4/d39/d42/d4f/d6d/d3a/da/de3/f5f [0,4194304] 0 2023-12-05T09:26:30.509 INFO:tasks.workunit.client.1.smithi134.stdout:6/746: readlink d4/d39/d42/d4f/d6d/d3a/d75/l4a 0 2023-12-05T09:26:30.510 INFO:tasks.workunit.client.0.smithi067.stdout:4/521: read d0/f41 [336282,18906] 0 2023-12-05T09:26:30.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/542: link d0/d9/d10/d1d/l24 d0/d9/d10/d37/d38/d64/d34/d67/lb1 0 2023-12-05T09:26:30.522 INFO:tasks.workunit.client.0.smithi067.stdout:5/585: mkdir db/df/d3f/dd9 0 2023-12-05T09:26:30.523 INFO:tasks.workunit.client.0.smithi067.stdout:5/586: chown db/df/d35/dc8 0 1 2023-12-05T09:26:30.523 INFO:tasks.workunit.client.0.smithi067.stdout:5/587: chown db/df/d35/d63/d75/lb0 0 1 2023-12-05T09:26:30.523 INFO:tasks.workunit.client.0.smithi067.stdout:5/588: chown db/df/d35/d63 122651 1 2023-12-05T09:26:30.523 INFO:tasks.workunit.client.0.smithi067.stdout:5/589: fsync db/df/d36/d57/f73 0 2023-12-05T09:26:30.524 INFO:tasks.workunit.client.1.smithi134.stdout:7/788: mkdir d2/d7/d2b/dd9/df8/d103 0 2023-12-05T09:26:30.524 INFO:tasks.workunit.client.1.smithi134.stdout:7/789: chown d2/d7/dc/d2e/d3a/d6d/f96 90131348 1 2023-12-05T09:26:30.527 INFO:tasks.workunit.client.0.smithi067.stdout:9/781: mknod d1b/dd3/d6c/d78/c105 0 2023-12-05T09:26:30.531 INFO:tasks.workunit.client.0.smithi067.stdout:3/510: dwrite d9/da/d15/d17/f32 [0,4194304] 0 2023-12-05T09:26:30.536 INFO:tasks.workunit.client.1.smithi134.stdout:0/749: dwrite d13/d14/d15/d67/fcb [0,4194304] 0 2023-12-05T09:26:30.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/522: mkdir d0/d1d/d25/d2c/db5 0 2023-12-05T09:26:30.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/523: fsync d0/d1d/d53/da8/da9/f70 0 2023-12-05T09:26:30.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/524: truncate d0/d1d/d25/d2c/d34/d4e/d5a/fb3 655078 0 2023-12-05T09:26:30.539 INFO:tasks.workunit.client.1.smithi134.stdout:9/804: dwrite d7/d8/d14/d26/d5a/fb2 [0,4194304] 0 2023-12-05T09:26:30.540 INFO:tasks.workunit.client.0.smithi067.stdout:1/580: dwrite d2/d4f/d14/d48/f6b [4194304,4194304] 0 2023-12-05T09:26:30.541 INFO:tasks.workunit.client.0.smithi067.stdout:9/782: creat d1b/dd3/d6c/d78/daa/f106 x:0 0 0 2023-12-05T09:26:30.541 INFO:tasks.workunit.client.0.smithi067.stdout:9/783: fdatasync d1b/fcb 0 2023-12-05T09:26:30.547 INFO:tasks.workunit.client.1.smithi134.stdout:4/790: mknod d16/d18/dc5/dc2/df6/d63/c114 0 2023-12-05T09:26:30.548 INFO:tasks.workunit.client.1.smithi134.stdout:4/791: chown d16/d21/d48/d66/db0/db3/cdc 2 1 2023-12-05T09:26:30.548 INFO:tasks.workunit.client.1.smithi134.stdout:4/792: chown d16/d21/f62 73575692 1 2023-12-05T09:26:30.548 INFO:tasks.workunit.client.1.smithi134.stdout:4/793: fdatasync d16/d21/d48/d66/fbf 0 2023-12-05T09:26:30.548 INFO:tasks.workunit.client.1.smithi134.stdout:4/794: chown d16/d21/d48/d66/l99 444 1 2023-12-05T09:26:30.550 INFO:tasks.workunit.client.0.smithi067.stdout:3/511: mknod d9/da/d3b/cb0 0 2023-12-05T09:26:30.551 INFO:tasks.workunit.client.1.smithi134.stdout:1/941: mknod d2/d27/d40/d109/c151 0 2023-12-05T09:26:30.551 INFO:tasks.workunit.client.1.smithi134.stdout:1/942: readlink d2/d9/d10/d30/l95 0 2023-12-05T09:26:30.552 INFO:tasks.workunit.client.0.smithi067.stdout:4/525: getdents d0 0 2023-12-05T09:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.553+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd05c115b90 con 0x7fd04406af10 2023-12-05T09:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.555+0000 7fd0597fa700 1 -- 172.21.15.67:0/866522974 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fd05c115b90 con 0x7fd04406af10 2023-12-05T09:26:30.555 INFO:tasks.workunit.client.0.smithi067.stdout:7/543: dread d0/d9/f58 [0,4194304] 0 2023-12-05T09:26:30.555 INFO:tasks.workunit.client.0.smithi067.stdout:0/714: dwrite d3/d7/d3c/d6c/d76/da7/dec/d10/dd2/fb9 [0,4194304] 0 2023-12-05T09:26:30.556 INFO:tasks.workunit.client.0.smithi067.stdout:0/715: chown d3/d7/d3c/f47 100705 1 2023-12-05T09:26:30.556 INFO:tasks.workunit.client.1.smithi134.stdout:5/768: mkdir d0/d10e 0 2023-12-05T09:26:30.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fd04406af10 msgr2=0x7fd04406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fd04406af10 0x7fd04406d3c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd04c013600 tx=0x7fd04c009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 msgr2=0x7fd05c113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 0x7fd05c113ac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd0500094a0 tx=0x7fd050009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 shutdown_connections 2023-12-05T09:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7fd04406af10 0x7fd04406d3c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd05c070570 0x7fd05c113ac0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 --2- 172.21.15.67:0/866522974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd05c071bc0 0x7fd05c114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.559+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 >> 172.21.15.67:0/866522974 conn(0x7fd05c0f82d0 msgr2=0x7fd05c0fa640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:30.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.561+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 shutdown_connections 2023-12-05T09:26:30.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.561+0000 7fd062cc2700 1 -- 172.21.15.67:0/866522974 wait complete. 2023-12-05T09:26:30.561 INFO:tasks.workunit.client.1.smithi134.stdout:6/747: mkdir d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8 0 2023-12-05T09:26:30.562 INFO:tasks.workunit.client.0.smithi067.stdout:1/581: mkdir d2/d3/da6/dbb/dd1 0 2023-12-05T09:26:30.563 INFO:tasks.workunit.client.0.smithi067.stdout:2/517: sync 2023-12-05T09:26:30.564 INFO:tasks.workunit.client.0.smithi067.stdout:6/495: sync 2023-12-05T09:26:30.564 INFO:tasks.workunit.client.0.smithi067.stdout:6/496: fsync da/d10/d1e/fa9 0 2023-12-05T09:26:30.564 INFO:tasks.workunit.client.0.smithi067.stdout:6/497: write da/d10/f5e [5051927,100304] 0 2023-12-05T09:26:30.566 INFO:tasks.workunit.client.0.smithi067.stdout:9/784: link d1b/d25/d35/cbe d1b/d25/d35/d56/dee/c107 0 2023-12-05T09:26:30.566 INFO:tasks.workunit.client.1.smithi134.stdout:7/790: dwrite d2/f8 [0,4194304] 0 2023-12-05T09:26:30.570 INFO:tasks.workunit.client.0.smithi067.stdout:3/512: creat d9/d20/fb1 x:0 0 0 2023-12-05T09:26:30.577 INFO:tasks.workunit.client.1.smithi134.stdout:4/795: write d16/d21/f3f [3485914,38765] 0 2023-12-05T09:26:30.578 INFO:tasks.workunit.client.1.smithi134.stdout:4/796: creat d16/d7b/db6/dbc/f115 x:0 0 0 2023-12-05T09:26:30.578 INFO:tasks.workunit.client.1.smithi134.stdout:4/797: stat d16/d21/d48/d80 0 2023-12-05T09:26:30.582 INFO:tasks.workunit.client.0.smithi067.stdout:1/582: creat d2/d4f/d14/d20/d83/d78/fd2 x:0 0 0 2023-12-05T09:26:30.587 INFO:tasks.workunit.client.0.smithi067.stdout:1/583: creat d2/d4f/d14/d20/d83/d78/fd3 x:0 0 0 2023-12-05T09:26:30.587 INFO:tasks.workunit.client.0.smithi067.stdout:1/584: fdatasync d2/d3/f96 0 2023-12-05T09:26:30.587 INFO:tasks.workunit.client.0.smithi067.stdout:1/585: chown d2/d4f/d54/f8c 88 1 2023-12-05T09:26:30.587 INFO:tasks.workunit.client.0.smithi067.stdout:3/513: chown d9/f58 25 1 2023-12-05T09:26:30.587 INFO:tasks.workunit.client.0.smithi067.stdout:1/586: dread - d2/d4f/d54/d70/db4/fc3 zero size 2023-12-05T09:26:30.587 INFO:tasks.workunit.client.0.smithi067.stdout:9/785: symlink d1b/d25/l108 0 2023-12-05T09:26:30.587 INFO:tasks.workunit.client.0.smithi067.stdout:7/544: truncate d0/d9/d40/d48/f66 5115758 0 2023-12-05T09:26:30.587 INFO:tasks.workunit.client.0.smithi067.stdout:7/545: dread - d0/d45/f49 zero size 2023-12-05T09:26:30.588 INFO:tasks.workunit.client.0.smithi067.stdout:3/514: mkdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2 0 2023-12-05T09:26:30.592 INFO:tasks.workunit.client.0.smithi067.stdout:3/515: symlink d9/da/d15/d17/d1a/lb3 0 2023-12-05T09:26:30.592 INFO:tasks.workunit.client.0.smithi067.stdout:3/516: read - d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/f9b zero size 2023-12-05T09:26:30.593 INFO:tasks.workunit.client.1.smithi134.stdout:6/748: dread d4/d39/d42/d4f/d6d/d3a/d75/f29 [0,4194304] 0 2023-12-05T09:26:30.595 INFO:tasks.workunit.client.1.smithi134.stdout:7/791: creat d2/df/d2a/d36/f104 x:0 0 0 2023-12-05T09:26:30.601 INFO:tasks.workunit.client.1.smithi134.stdout:3/829: rename d4/d5/d45/d60/d85 to d4/d1f/d50/db4/d102 0 2023-12-05T09:26:30.608 INFO:tasks.workunit.client.1.smithi134.stdout:6/749: symlink d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/le9 0 2023-12-05T09:26:30.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/792: mkdir d2/d7/d2b/d94/d105 0 2023-12-05T09:26:30.620 INFO:tasks.workunit.client.0.smithi067.stdout:1/587: dread d2/d4f/d14/d20/d83/f84 [0,4194304] 0 2023-12-05T09:26:30.624 INFO:tasks.workunit.client.0.smithi067.stdout:4/526: dwrite d0/d1d/d53/da8/da9/f70 [0,4194304] 0 2023-12-05T09:26:30.627 INFO:tasks.workunit.client.0.smithi067.stdout:3/517: dread d9/da/d3b/f6b [0,4194304] 0 2023-12-05T09:26:30.627 INFO:tasks.workunit.client.0.smithi067.stdout:3/518: chown d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/la7 45348 1 2023-12-05T09:26:30.627 INFO:tasks.workunit.client.0.smithi067.stdout:3/519: chown d9/d49/f9f 116971178 1 2023-12-05T09:26:30.635 INFO:tasks.workunit.client.0.smithi067.stdout:1/588: rename d2/d4f/c2c to d2/d5/d7/de/d19/d49/d6d/cd4 0 2023-12-05T09:26:30.635 INFO:tasks.workunit.client.0.smithi067.stdout:1/589: chown d2/d5/d7/de/d19/d49/d6d/c97 391870 1 2023-12-05T09:26:30.635 INFO:tasks.workunit.client.0.smithi067.stdout:1/590: chown d2/d4f/d14/d20/d83/d78/fd3 38 1 2023-12-05T09:26:30.636 INFO:tasks.workunit.client.0.smithi067.stdout:3/520: link d9/f27 d9/da/d15/d17/d1a/d51/d66/d82/fb4 0 2023-12-05T09:26:30.636 INFO:tasks.workunit.client.0.smithi067.stdout:3/521: chown d9/da/d15/d17/d1a/f4b 1 1 2023-12-05T09:26:30.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/830: mkdir d4/d5/d103 0 2023-12-05T09:26:30.637 INFO:tasks.workunit.client.1.smithi134.stdout:0/750: rename d13/d14/d30/d4b/d23/d77/cd5 to d13/d14/d15/d67/cfa 0 2023-12-05T09:26:30.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/831: readlink d4/d1f/d50/db4/d102/lf7 0 2023-12-05T09:26:30.637 INFO:tasks.workunit.client.1.smithi134.stdout:0/751: fdatasync d13/f17 0 2023-12-05T09:26:30.637 INFO:tasks.workunit.client.1.smithi134.stdout:7/793: write d2/d7/dc/d2e/d3a/f3b [3155988,83498] 0 2023-12-05T09:26:30.641 INFO:tasks.workunit.client.1.smithi134.stdout:1/943: dwrite d2/d27/db4/fdc [0,4194304] 0 2023-12-05T09:26:30.642 INFO:tasks.workunit.client.1.smithi134.stdout:3/832: mkdir d4/d5/d45/d86/db5/dc3/d104 0 2023-12-05T09:26:30.646 INFO:tasks.workunit.client.1.smithi134.stdout:6/750: dread d4/d39/f37 [0,4194304] 0 2023-12-05T09:26:30.649 INFO:tasks.workunit.client.1.smithi134.stdout:2/857: dwrite d19/d28/d31/d38/f6a [0,4194304] 0 2023-12-05T09:26:30.650 INFO:tasks.workunit.client.0.smithi067.stdout:4/527: write d0/d1d/d24/f66 [3609116,96023] 0 2023-12-05T09:26:30.650 INFO:tasks.workunit.client.0.smithi067.stdout:4/528: read d0/d1d/d25/d38/f49 [1654264,23789] 0 2023-12-05T09:26:30.651 INFO:tasks.workunit.client.0.smithi067.stdout:0/716: dwrite d3/da2/f79 [0,4194304] 0 2023-12-05T09:26:30.651 INFO:tasks.workunit.client.0.smithi067.stdout:3/522: dread d9/d62/f8a [0,4194304] 0 2023-12-05T09:26:30.656 INFO:tasks.workunit.client.1.smithi134.stdout:3/833: read d4/f12 [684601,105411] 0 2023-12-05T09:26:30.656 INFO:tasks.workunit.client.1.smithi134.stdout:0/752: rename d13/d14/d30/d4b/d66/da0/daf/dce/d7d/fbd to d13/d14/d15/dee/ffb 0 2023-12-05T09:26:30.656 INFO:tasks.workunit.client.1.smithi134.stdout:7/794: creat d2/d7/d93/dcf/ddd/f106 x:0 0 0 2023-12-05T09:26:30.660 INFO:tasks.workunit.client.1.smithi134.stdout:5/769: dwrite d0/dd/f32 [0,4194304] 0 2023-12-05T09:26:30.666 INFO:tasks.workunit.client.1.smithi134.stdout:4/798: dwrite d16/d21/d48/d80/dae/f6c [0,4194304] 0 2023-12-05T09:26:30.668 INFO:tasks.workunit.client.0.smithi067.stdout:1/591: dread d2/d4f/d14/d48/f4d [0,4194304] 0 2023-12-05T09:26:30.670 INFO:tasks.workunit.client.1.smithi134.stdout:1/944: creat d2/d9/d10/d30/dfe/f152 x:0 0 0 2023-12-05T09:26:30.670 INFO:tasks.workunit.client.1.smithi134.stdout:1/945: truncate d2/d9/fad 833827 0 2023-12-05T09:26:30.670 INFO:tasks.workunit.client.1.smithi134.stdout:2/858: write d19/f25 [2360892,114921] 0 2023-12-05T09:26:30.673 INFO:tasks.workunit.client.0.smithi067.stdout:3/523: truncate d9/da/d15/d17/d1a/f35 388432 0 2023-12-05T09:26:30.674 INFO:tasks.workunit.client.0.smithi067.stdout:4/529: read d0/d1d/d25/d32/f16 [1874938,115188] 0 2023-12-05T09:26:30.681 INFO:tasks.workunit.client.0.smithi067.stdout:0/717: dread d3/d7/d3c/d66/f7c [0,4194304] 0 2023-12-05T09:26:30.681 INFO:tasks.workunit.client.0.smithi067.stdout:0/718: fsync d3/d7/d3c/d67/dd1/ff5 0 2023-12-05T09:26:30.688 INFO:tasks.workunit.client.0.smithi067.stdout:4/530: rename d0/d1d/d2a/d93/c97 to d0/d1d/d2a/cb6 0 2023-12-05T09:26:30.688 INFO:tasks.workunit.client.0.smithi067.stdout:4/531: creat d0/d9/fb7 x:0 0 0 2023-12-05T09:26:30.688 INFO:tasks.workunit.client.0.smithi067.stdout:1/592: dread d2/d5/d7/de/d19/d49/f56 [0,4194304] 0 2023-12-05T09:26:30.688 INFO:tasks.workunit.client.0.smithi067.stdout:1/593: chown d2/d4f/d14/d20/fc9 24448 1 2023-12-05T09:26:30.689 INFO:tasks.workunit.client.0.smithi067.stdout:1/594: chown d2/l6 17 1 2023-12-05T09:26:30.691 INFO:tasks.workunit.client.1.smithi134.stdout:5/770: dread d0/d1a/d3a/f4e [0,4194304] 0 2023-12-05T09:26:30.691 INFO:tasks.workunit.client.1.smithi134.stdout:5/771: write d0/d11/d5c/fe6 [5116506,71116] 0 2023-12-05T09:26:30.692 INFO:tasks.workunit.client.0.smithi067.stdout:0/719: chown d3/d7/d3c/d6c/d76/da7/dec/f63 960718 1 2023-12-05T09:26:30.694 INFO:tasks.workunit.client.0.smithi067.stdout:0/720: write d3/d7/d3c/d67/d59/d4e/fa0 [462766,128690] 0 2023-12-05T09:26:30.694 INFO:tasks.workunit.client.0.smithi067.stdout:0/721: chown d3/d7/d3c/f50 23795744 1 2023-12-05T09:26:30.702 INFO:tasks.workunit.client.0.smithi067.stdout:4/532: creat d0/d1d/d25/d2c/d34/d4e/d5a/d88/fb8 x:0 0 0 2023-12-05T09:26:30.704 INFO:tasks.workunit.client.0.smithi067.stdout:2/518: dwrite d0/d25/d9d/d53/f7e [0,4194304] 0 2023-12-05T09:26:30.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/834: creat d4/d5/d6f/d97/dae/f105 x:0 0 0 2023-12-05T09:26:30.706 INFO:tasks.workunit.client.0.smithi067.stdout:6/498: dwrite da/d10/d1e/d17/f81 [0,4194304] 0 2023-12-05T09:26:30.715 INFO:tasks.workunit.client.1.smithi134.stdout:0/753: symlink d13/d14/d15/d2a/lfc 0 2023-12-05T09:26:30.727 INFO:tasks.workunit.client.1.smithi134.stdout:7/795: creat d2/d7/d2b/d2d/d67/d73/f107 x:0 0 0 2023-12-05T09:26:30.729 INFO:tasks.workunit.client.0.smithi067.stdout:0/722: unlink d3/d7/d3c/d67/d59/f88 0 2023-12-05T09:26:30.732 INFO:tasks.workunit.client.1.smithi134.stdout:6/751: dwrite d4/d39/d42/d4f/d8a/f99 [0,4194304] 0 2023-12-05T09:26:30.736 INFO:tasks.workunit.client.1.smithi134.stdout:4/799: symlink d16/d21/d48/d80/dae/d65/l116 0 2023-12-05T09:26:30.744 INFO:tasks.workunit.client.0.smithi067.stdout:4/533: mknod d0/d1d/d3c/d51/cb9 0 2023-12-05T09:26:30.746 INFO:tasks.workunit.client.1.smithi134.stdout:1/946: rmdir d2/d27/d40/d10a/d110 0 2023-12-05T09:26:30.792 INFO:tasks.workunit.client.1.smithi134.stdout:5/772: link d0/d1a/d1c/d25/d6a/cbc d0/d1a/d1c/d25/d4d/d60/c10f 0 2023-12-05T09:26:30.800 INFO:tasks.workunit.client.0.smithi067.stdout:1/595: symlink d2/d5/d7/de/d1a/ld5 0 2023-12-05T09:26:30.801 INFO:tasks.workunit.client.0.smithi067.stdout:1/596: write d2/d4f/d15/d60/d68/f85 [784619,125666] 0 2023-12-05T09:26:30.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/800: truncate d16/d21/de5/f102 3064729 0 2023-12-05T09:26:30.806 INFO:tasks.workunit.client.1.smithi134.stdout:2/859: write d19/d76/f7b [189344,14248] 0 2023-12-05T09:26:30.810 INFO:tasks.workunit.client.1.smithi134.stdout:5/773: write d0/d50/fad [2982154,119933] 0 2023-12-05T09:26:30.812 INFO:tasks.workunit.client.1.smithi134.stdout:0/754: dwrite d13/fb1 [0,4194304] 0 2023-12-05T09:26:30.815 INFO:tasks.workunit.client.0.smithi067.stdout:0/723: symlink d3/d7/d3c/d67/d59/deb/l102 0 2023-12-05T09:26:30.815 INFO:tasks.workunit.client.0.smithi067.stdout:4/534: mkdir d0/d1d/d2a/dba 0 2023-12-05T09:26:30.817 INFO:tasks.workunit.client.0.smithi067.stdout:9/786: dwrite d1b/d25/d54/d5c/f69 [0,4194304] 0 2023-12-05T09:26:30.818 INFO:tasks.workunit.client.1.smithi134.stdout:4/801: rename d16/d21/d48/d66/lbe to d16/d21/d48/d80/dae/l117 0 2023-12-05T09:26:30.818 INFO:tasks.workunit.client.1.smithi134.stdout:4/802: chown d16/d18/d1b/l27 406614992 1 2023-12-05T09:26:30.818 INFO:tasks.workunit.client.1.smithi134.stdout:8/904: sync 2023-12-05T09:26:30.827 INFO:tasks.workunit.client.1.smithi134.stdout:0/755: dread d13/d14/d15/f21 [0,4194304] 0 2023-12-05T09:26:30.827 INFO:tasks.workunit.client.1.smithi134.stdout:5/774: dread d0/d11/d61/d75/f79 [0,4194304] 0 2023-12-05T09:26:30.828 INFO:tasks.workunit.client.1.smithi134.stdout:5/775: write d0/d11/d61/d75/f79 [682710,72143] 0 2023-12-05T09:26:30.828 INFO:tasks.workunit.client.1.smithi134.stdout:5/776: chown d0/d11/cf3 49757 1 2023-12-05T09:26:30.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/803: creat d16/d21/d48/d80/dae/f118 x:0 0 0 2023-12-05T09:26:30.830 INFO:tasks.workunit.client.1.smithi134.stdout:4/804: truncate d16/d21/d48/d66/fdf 1657058 0 2023-12-05T09:26:30.832 INFO:tasks.workunit.client.1.smithi134.stdout:8/905: link da/de/d8a/d42/d99/dc8/d3b/fb1 da/de/d8a/d42/df1/f136 0 2023-12-05T09:26:30.833 INFO:tasks.workunit.client.0.smithi067.stdout:7/546: dwrite d0/d9/d40/d48/f66 [0,4194304] 0 2023-12-05T09:26:30.833 INFO:tasks.workunit.client.0.smithi067.stdout:7/547: read d0/d9/d56/f5b [2987062,27778] 0 2023-12-05T09:26:30.836 INFO:tasks.workunit.client.0.smithi067.stdout:3/524: dwrite d9/d24/f34 [0,4194304] 0 2023-12-05T09:26:30.837 INFO:tasks.workunit.client.0.smithi067.stdout:3/525: fdatasync d9/da/d15/d17/f32 0 2023-12-05T09:26:30.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/756: mkdir d13/d14/d30/d4b/d66/da0/daf/dde/d9d/da5/dfd 0 2023-12-05T09:26:30.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/757: write d13/d14/d30/d4b/d66/da0/daf/dde/d9d/fdf [1044310,110167] 0 2023-12-05T09:26:30.843 INFO:tasks.workunit.client.1.smithi134.stdout:5/777: dread d0/d45/fcb [0,4194304] 0 2023-12-05T09:26:30.844 INFO:tasks.workunit.client.1.smithi134.stdout:9/805: dwrite d7/d8/d14/d26/d7f/d92/d53/dd4/ff6 [0,4194304] 0 2023-12-05T09:26:30.844 INFO:tasks.workunit.client.1.smithi134.stdout:4/805: truncate d16/d18/dc5/dc2/df6/f3a 3281165 0 2023-12-05T09:26:30.847 INFO:tasks.workunit.client.0.smithi067.stdout:6/499: dwrite da/d10/d1e/d17/d2f/d1f/d27/fac [0,4194304] 0 2023-12-05T09:26:30.847 INFO:tasks.workunit.client.0.smithi067.stdout:6/500: write da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fa4 [582454,68832] 0 2023-12-05T09:26:30.847 INFO:tasks.workunit.client.1.smithi134.stdout:0/758: mknod d13/d14/d15/d93/cfe 0 2023-12-05T09:26:30.848 INFO:tasks.workunit.client.0.smithi067.stdout:2/519: dwrite d0/d25/f8b [0,4194304] 0 2023-12-05T09:26:30.850 INFO:tasks.workunit.client.0.smithi067.stdout:2/520: write d0/d25/d34/f3d [4234305,90716] 0 2023-12-05T09:26:30.851 INFO:tasks.workunit.client.1.smithi134.stdout:3/835: dwrite d4/d5/d45/d60/ff9 [0,4194304] 0 2023-12-05T09:26:30.851 INFO:tasks.workunit.client.1.smithi134.stdout:3/836: readlink d4/d5/d45/l47 0 2023-12-05T09:26:30.858 INFO:tasks.workunit.client.0.smithi067.stdout:9/787: symlink d1b/dd3/d6c/l109 0 2023-12-05T09:26:30.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.860+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/30682311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc006fa30 msgr2=0x7f4fc006dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:30.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.860+0000 7f4fc5b0f700 1 --2- 172.21.15.67:0/30682311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc006fa30 0x7f4fc006dea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4004940 tx=0x7f4fb4009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:30.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.861+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/30682311 shutdown_connections 2023-12-05T09:26:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.861+0000 7f4fc5b0f700 1 --2- 172.21.15.67:0/30682311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fc006e470 0x7f4fc006e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.861+0000 7f4fc5b0f700 1 --2- 172.21.15.67:0/30682311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc006fa30 0x7f4fc006dea0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.861+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/30682311 >> 172.21.15.67:0/30682311 conn(0x7f4fc0069b70 msgr2=0x7f4fc006bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.861+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/30682311 shutdown_connections 2023-12-05T09:26:30.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.861+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/30682311 wait complete. 2023-12-05T09:26:30.863 INFO:tasks.workunit.client.0.smithi067.stdout:0/724: mkdir d3/d7/d30/d103 0 2023-12-05T09:26:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.862+0000 7f4fc5b0f700 1 Processor -- start 2023-12-05T09:26:30.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.863+0000 7f4fc5b0f700 1 -- start start 2023-12-05T09:26:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.863+0000 7f4fc5b0f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc006e470 0x7f4fc01068e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.863+0000 7f4fc5b0f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fc006fa30 0x7f4fc0104d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.863+0000 7f4fc5b0f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0105360 con 0x7f4fc006e470 2023-12-05T09:26:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.863+0000 7f4fc5b0f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc01054d0 con 0x7f4fc006fa30 2023-12-05T09:26:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.864+0000 7f4fbffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fc006fa30 0x7f4fc0104d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.864+0000 7f4fbffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fc006fa30 0x7f4fc0104d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:48074/0 (socket says 172.21.15.67:48074) 2023-12-05T09:26:30.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.864+0000 7f4fbffff700 1 -- 172.21.15.67:0/1574616389 learned_addr learned my addr 172.21.15.67:0/1574616389 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:26:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.865+0000 7f4fbffff700 1 -- 172.21.15.67:0/1574616389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc006e470 msgr2=0x7f4fc01068e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.865+0000 7f4fbffff700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc006e470 0x7f4fc01068e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:30.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.865+0000 7f4fbffff700 1 -- 172.21.15.67:0/1574616389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4005040 con 0x7f4fc006fa30 2023-12-05T09:26:30.866 INFO:tasks.workunit.client.0.smithi067.stdout:7/548: creat d0/d9/d40/d7a/dad/fb2 x:0 0 0 2023-12-05T09:26:30.866 INFO:tasks.workunit.client.1.smithi134.stdout:7/796: dwrite d2/d7/dc/d2e/fdf [0,4194304] 0 2023-12-05T09:26:30.866 INFO:tasks.workunit.client.1.smithi134.stdout:7/797: dread - d2/df/d2a/d63/f7f zero size 2023-12-05T09:26:30.867 INFO:tasks.workunit.client.1.smithi134.stdout:6/752: dwrite d4/d39/d42/d4f/d6d/d3a/da/de3/f5f [0,4194304] 0 2023-12-05T09:26:30.867 INFO:tasks.workunit.client.1.smithi134.stdout:6/753: creat d4/d32/fea x:0 0 0 2023-12-05T09:26:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.866+0000 7f4fbffff700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fc006fa30 0x7f4fc0104d60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4fac002a50 tx=0x7f4fac0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:30.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.866+0000 7f4fbd7fa700 1 -- 172.21.15.67:0/1574616389 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fac007cc0 con 0x7f4fc006fa30 2023-12-05T09:26:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.867+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc01057b0 con 0x7f4fc006fa30 2023-12-05T09:26:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.867+0000 7f4fbd7fa700 1 -- 172.21.15.67:0/1574616389 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fac00f040 con 0x7f4fc006fa30 2023-12-05T09:26:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.867+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc011dbb0 con 0x7f4fc006fa30 2023-12-05T09:26:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.868+0000 7f4fbd7fa700 1 -- 172.21.15.67:0/1574616389 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fac00d870 con 0x7f4fc006fa30 2023-12-05T09:26:30.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.868+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc004bb80 con 0x7f4fc006fa30 2023-12-05T09:26:30.868 INFO:tasks.workunit.client.1.smithi134.stdout:1/947: dwrite d2/d9/d10/d30/dfe/f100 [4194304,4194304] 0 2023-12-05T09:26:30.872 INFO:tasks.workunit.client.1.smithi134.stdout:9/806: creat d7/d10/d56/dd5/f10d x:0 0 0 2023-12-05T09:26:30.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.880+0000 7f4fbd7fa700 1 -- 172.21.15.67:0/1574616389 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f4fac00d9d0 con 0x7f4fc006fa30 2023-12-05T09:26:30.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.881+0000 7f4fbd7fa700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4fb006af00 0x7f4fb006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.882+0000 7f4fbd7fa700 1 -- 172.21.15.67:0/1574616389 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4fac088f40 con 0x7f4fc006fa30 2023-12-05T09:26:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.882+0000 7f4fbd7fa700 1 -- 172.21.15.67:0/1574616389 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4fac0893d0 con 0x7f4fc006fa30 2023-12-05T09:26:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.882+0000 7f4fc4b0d700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4fb006af00 0x7f4fb006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:30.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:30.885+0000 7f4fc4b0d700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4fb006af00 0x7f4fb006d3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009fd0 tx=0x7f4fb4009e30 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:30.886 INFO:tasks.workunit.client.0.smithi067.stdout:6/501: truncate da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/f4c 420522 0 2023-12-05T09:26:30.888 INFO:tasks.workunit.client.1.smithi134.stdout:5/778: dwrite d0/d1a/f8f [0,4194304] 0 2023-12-05T09:26:30.889 INFO:tasks.workunit.client.1.smithi134.stdout:5/779: rename d0/d1a/d1c/d3f/d5b/d5d to d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/d9b/ddb/d110 22 2023-12-05T09:26:30.895 INFO:tasks.workunit.client.1.smithi134.stdout:3/837: link d4/d5/d45/l8b d4/d5/d6f/l106 0 2023-12-05T09:26:30.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/597: dwrite d2/d4f/d15/d74/d76/fb9 [0,4194304] 0 2023-12-05T09:26:30.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/598: fdatasync d2/d4f/d54/d70/db4/fce 0 2023-12-05T09:26:30.917 INFO:tasks.workunit.client.1.smithi134.stdout:0/759: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/d9d/fc7 [0,4194304] 0 2023-12-05T09:26:30.921 INFO:tasks.workunit.client.1.smithi134.stdout:7/798: creat d2/df/d81/daf/de1/f108 x:0 0 0 2023-12-05T09:26:30.941 INFO:tasks.workunit.client.1.smithi134.stdout:5/780: dwrite d0/d1a/d1c/d25/d6a/fe9 [0,4194304] 0 2023-12-05T09:26:30.942 INFO:tasks.workunit.client.0.smithi067.stdout:9/788: dwrite d1b/d25/d35/d56/f68 [8388608,4194304] 0 2023-12-05T09:26:30.946 INFO:tasks.workunit.client.0.smithi067.stdout:4/535: getdents d0/d1d/d24 0 2023-12-05T09:26:30.954 INFO:tasks.workunit.client.0.smithi067.stdout:4/536: dread d0/d1d/d25/f9a [4194304,4194304] 0 2023-12-05T09:26:30.959 INFO:tasks.workunit.client.0.smithi067.stdout:7/549: rename d0/f4a to d0/d9/d40/d7a/fb3 0 2023-12-05T09:26:30.964 INFO:tasks.workunit.client.0.smithi067.stdout:6/502: rmdir da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6 39 2023-12-05T09:26:30.964 INFO:tasks.workunit.client.0.smithi067.stdout:7/550: write d0/d9/d40/f8d [409756,120183] 0 2023-12-05T09:26:30.972 INFO:tasks.workunit.client.0.smithi067.stdout:5/590: sync 2023-12-05T09:26:30.972 INFO:tasks.workunit.client.0.smithi067.stdout:8/596: sync 2023-12-05T09:26:30.977 INFO:tasks.workunit.client.0.smithi067.stdout:1/599: mknod d2/d5/d7/de/d19/d49/cd6 0 2023-12-05T09:26:30.977 INFO:tasks.workunit.client.0.smithi067.stdout:1/600: write d2/d4f/d14/d20/d4c/f65 [444658,1943] 0 2023-12-05T09:26:30.978 INFO:tasks.workunit.client.0.smithi067.stdout:1/601: truncate d2/d4f/d14/f3c 1999184 0 2023-12-05T09:26:30.978 INFO:tasks.workunit.client.0.smithi067.stdout:1/602: chown d2/d5/d7/de/f37 21879 1 2023-12-05T09:26:30.982 INFO:tasks.workunit.client.0.smithi067.stdout:0/725: write d3/d7/d3c/d67/f5b [2049423,62302] 0 2023-12-05T09:26:30.983 INFO:tasks.workunit.client.1.smithi134.stdout:1/948: mkdir d2/d9/d8d/da2/db1/d153 0 2023-12-05T09:26:30.984 INFO:tasks.workunit.client.1.smithi134.stdout:1/949: chown d2/c1a 75739 1 2023-12-05T09:26:30.986 INFO:tasks.workunit.client.0.smithi067.stdout:4/537: link d0/d1d/d53/da8/da9/l4b d0/d1d/d3c/lbb 0 2023-12-05T09:26:30.990 INFO:tasks.workunit.client.1.smithi134.stdout:9/807: mkdir d7/d8/d14/d26/d5a/d69/d10e 0 2023-12-05T09:26:30.990 INFO:tasks.workunit.client.1.smithi134.stdout:9/808: read d7/d8/d14/d26/f3e [631494,113291] 0 2023-12-05T09:26:30.990 INFO:tasks.workunit.client.1.smithi134.stdout:9/809: fsync d7/d8/d16/d52/f102 0 2023-12-05T09:26:30.992 INFO:tasks.workunit.client.1.smithi134.stdout:5/781: dwrite d0/d1a/d1c/d25/d4d/d97/fa0 [4194304,4194304] 0 2023-12-05T09:26:30.992 INFO:tasks.workunit.client.1.smithi134.stdout:5/782: chown d0/d1a/d1c/d25/d4d/d97/l8b 1 1 2023-12-05T09:26:30.992 INFO:tasks.workunit.client.0.smithi067.stdout:6/503: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/fb4 x:0 0 0 2023-12-05T09:26:30.997 INFO:tasks.workunit.client.1.smithi134.stdout:4/806: link d16/d18/dc5/dc2/df6/d63/l94 d16/d18/dad/d10e/l119 0 2023-12-05T09:26:30.997 INFO:tasks.workunit.client.1.smithi134.stdout:4/807: creat d16/d7b/db6/dbc/f11a x:0 0 0 2023-12-05T09:26:31.000 INFO:tasks.workunit.client.0.smithi067.stdout:8/597: symlink d5/dc/d1a/d62/d7e/la8 0 2023-12-05T09:26:31.006 INFO:tasks.workunit.client.0.smithi067.stdout:6/504: dread da/d10/d1e/d17/d2f/d3f/d92/fa2 [0,4194304] 0 2023-12-05T09:26:31.006 INFO:tasks.workunit.client.0.smithi067.stdout:5/591: unlink db/df/d1a/d1d/c27 0 2023-12-05T09:26:31.007 INFO:tasks.workunit.client.0.smithi067.stdout:5/592: read - db/df/d82/fab zero size 2023-12-05T09:26:31.007 INFO:tasks.workunit.client.0.smithi067.stdout:6/505: fdatasync da/d10/d1e/d17/d2f/d2c/d34/f3e 0 2023-12-05T09:26:31.007 INFO:tasks.workunit.client.0.smithi067.stdout:6/506: readlink da/d10/d1e/d17/d2f/d2c/d34/l54 0 2023-12-05T09:26:31.023 INFO:tasks.workunit.client.0.smithi067.stdout:1/603: dread d2/d4f/d14/f3c [0,4194304] 0 2023-12-05T09:26:31.074 INFO:tasks.workunit.client.0.smithi067.stdout:5/593: dread f9 [0,4194304] 0 2023-12-05T09:26:31.076 INFO:tasks.workunit.client.0.smithi067.stdout:7/551: dwrite d0/d9/d10/d37/d38/d64/d5a/f7c [0,4194304] 0 2023-12-05T09:26:31.076 INFO:tasks.workunit.client.0.smithi067.stdout:7/552: stat d0/d9/d56/d8e 0 2023-12-05T09:26:31.077 INFO:tasks.workunit.client.0.smithi067.stdout:7/553: stat d0/d9/d40/d48/l57 0 2023-12-05T09:26:31.077 INFO:tasks.workunit.client.0.smithi067.stdout:7/554: truncate d0/d9/d10/d1d/f6d 1853719 0 2023-12-05T09:26:31.077 INFO:tasks.workunit.client.1.smithi134.stdout:3/838: mknod d4/d5/d6f/d97/dae/de8/c107 0 2023-12-05T09:26:31.079 INFO:tasks.workunit.client.0.smithi067.stdout:9/789: dwrite d1b/d25/d54/fcc [0,4194304] 0 2023-12-05T09:26:31.084 INFO:tasks.workunit.client.0.smithi067.stdout:6/507: dwrite da/d10/f11 [0,4194304] 0 2023-12-05T09:26:31.088 INFO:tasks.workunit.client.0.smithi067.stdout:8/598: dwrite d5/dc/d1a/d20/f25 [0,4194304] 0 2023-12-05T09:26:31.088 INFO:tasks.workunit.client.0.smithi067.stdout:8/599: readlink d5/da/d30/d61/l8b 0 2023-12-05T09:26:31.094 INFO:tasks.workunit.client.0.smithi067.stdout:4/538: symlink d0/d1d/d53/da8/lbc 0 2023-12-05T09:26:31.111 INFO:tasks.workunit.client.0.smithi067.stdout:1/604: mknod d2/d4f/d15/cd7 0 2023-12-05T09:26:31.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/605: write d2/d4f/d14/d48/f4d [4819638,109870] 0 2023-12-05T09:26:31.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/606: chown d2/d3/l28 2 1 2023-12-05T09:26:31.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/607: chown d2/d4f/d14/d20/d83/fc2 117057 1 2023-12-05T09:26:31.135 INFO:tasks.workunit.client.0.smithi067.stdout:4/539: dwrite d0/d1d/d25/d32/f3f [0,4194304] 0 2023-12-05T09:26:31.136 INFO:tasks.workunit.client.0.smithi067.stdout:4/540: write d0/d1d/d53/f6e [5489529,18140] 0 2023-12-05T09:26:31.136 INFO:tasks.workunit.client.0.smithi067.stdout:4/541: dread - d0/d1d/d4d/fb2 zero size 2023-12-05T09:26:31.136 INFO:tasks.workunit.client.1.smithi134.stdout:0/760: mknod d13/d14/d30/d4b/d66/da0/daf/dce/d86/dd8/cff 0 2023-12-05T09:26:31.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:31 smithi067 ceph-mon[107174]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2023-12-05T09:26:31.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:31 smithi067 ceph-mon[107174]: Reconfiguring daemon prometheus.smithi067 on smithi067 2023-12-05T09:26:31.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:31 smithi067 ceph-mon[107174]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:31.141 INFO:tasks.workunit.client.1.smithi134.stdout:7/799: getdents d2/d7/d93/dcf 0 2023-12-05T09:26:31.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/542: dread d0/d1d/d25/d2c/f8e [0,4194304] 0 2023-12-05T09:26:31.145 INFO:tasks.workunit.client.1.smithi134.stdout:6/754: getdents d4/d39/d42/d4f/d6d 0 2023-12-05T09:26:31.168 INFO:tasks.workunit.client.1.smithi134.stdout:9/810: link d7/d8/d16/d52/d74/lfc d7/d5b/l10f 0 2023-12-05T09:26:31.178 INFO:tasks.workunit.client.1.smithi134.stdout:5/783: unlink d0/d66/f76 0 2023-12-05T09:26:31.178 INFO:tasks.workunit.client.1.smithi134.stdout:5/784: chown d0/d50/lce 1 1 2023-12-05T09:26:31.191 INFO:tasks.workunit.client.1.smithi134.stdout:4/808: link d16/d7b/lca d16/d7b/dce/d6e/daa/d3b/d8e/l11b 0 2023-12-05T09:26:31.212 INFO:tasks.workunit.client.1.smithi134.stdout:8/906: sync 2023-12-05T09:26:31.212 INFO:tasks.workunit.client.1.smithi134.stdout:8/907: chown da/de/d11/d8b 15 1 2023-12-05T09:26:31.212 INFO:tasks.workunit.client.1.smithi134.stdout:8/908: fsync da/de/d8a/d42/d99/f10e 0 2023-12-05T09:26:31.218 INFO:tasks.workunit.client.0.smithi067.stdout:4/543: dwrite d0/d1d/d25/f29 [0,4194304] 0 2023-12-05T09:26:31.233 INFO:tasks.workunit.client.1.smithi134.stdout:2/860: sync 2023-12-05T09:26:31.233 INFO:tasks.workunit.client.1.smithi134.stdout:2/861: dread - d19/d76/db9/f10a zero size 2023-12-05T09:26:31.249 INFO:tasks.workunit.client.0.smithi067.stdout:0/726: symlink d3/d7/d3c/d67/d59/l104 0 2023-12-05T09:26:31.251 INFO:tasks.workunit.client.0.smithi067.stdout:5/594: getdents db/df/d3f 0 2023-12-05T09:26:31.251 INFO:tasks.workunit.client.0.smithi067.stdout:5/595: write db/df/d3f/d88/d8d/fc4 [736355,87065] 0 2023-12-05T09:26:31.251 INFO:tasks.workunit.client.0.smithi067.stdout:5/596: fsync db/df/d3f/d88/d8d/fd0 0 2023-12-05T09:26:31.257 INFO:tasks.workunit.client.0.smithi067.stdout:7/555: mknod d0/d9/d10/d37/d38/d64/d54/cb4 0 2023-12-05T09:26:31.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/727: dread d3/d7/d3c/d67/d59/f41 [0,4194304] 0 2023-12-05T09:26:31.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/728: creat d3/d7/d3c/d67/d59/d4e/db2/f105 x:0 0 0 2023-12-05T09:26:31.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/729: chown d3/d7/d3c/f75 4178300 1 2023-12-05T09:26:31.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/730: write d3/d7/d3c/d6c/d76/da7/dec/d10/dd2/d99/fc5 [793720,110830] 0 2023-12-05T09:26:31.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/731: truncate d3/d7/d3c/d6c/d8a/f98 536432 0 2023-12-05T09:26:31.261 INFO:tasks.workunit.client.0.smithi067.stdout:0/732: chown d3/d7/d3c/dc2/fc8 452108 1 2023-12-05T09:26:31.264 INFO:tasks.workunit.client.0.smithi067.stdout:9/790: mknod d1b/dd3/d6c/c10a 0 2023-12-05T09:26:31.264 INFO:tasks.workunit.client.0.smithi067.stdout:9/791: chown d1b/d25/d35/cdf 1568 1 2023-12-05T09:26:31.312 INFO:tasks.workunit.client.0.smithi067.stdout:1/608: mkdir d2/d3/da6/dbd/dd8 0 2023-12-05T09:26:31.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.319+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fc010a580 con 0x7f4fb006af00 2023-12-05T09:26:31.324 INFO:tasks.workunit.client.0.smithi067.stdout:4/544: mkdir d0/d1d/d2a/d93/dbd 0 2023-12-05T09:26:31.331 INFO:tasks.workunit.client.0.smithi067.stdout:5/597: link db/df/d3f/fc3 db/df/d36/d57/fda 0 2023-12-05T09:26:31.331 INFO:tasks.workunit.client.0.smithi067.stdout:5/598: fdatasync db/df/d82/fce 0 2023-12-05T09:26:31.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.333+0000 7f4fbd7fa700 1 -- 172.21.15.67:0/1574616389 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f4fc010a580 con 0x7f4fb006af00 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 starting - - - - 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (7m) 38s ago 7m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (6m) 44s ago 6m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 starting - - - - 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (3m) 38s ago 3m 1602M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (2m) 38s ago 2m 451M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (2m) 44s ago 2m 12.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:26:31.333 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (2m) 44s ago 2m 13.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:9283 running (9m) 38s ago 9m 345M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 01173e871e1b 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283 running (66s) 44s ago 6m 495M - 19.0.0-11-g3fe8d441 56dea28e5206 86a20ad48d27 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (9m) 38s ago 9m 80.9M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (6m) 44s ago 6m 56.7M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 starting - - - - 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 44s ago 6m 8753k - 1.5.0 0da6a335fe13 2301b35d1166 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (6m) 38s ago 6m 189M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (5m) 38s ago 5m 205M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (5m) 38s ago 5m 163M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (4m) 44s ago 4m 208M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (4m) 44s ago 4m 173M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:26:31.334 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (4m) 44s ago 4m 187M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:26:31.335 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (6m) 38s ago 7m 48.1M - 2.43.0 a07b618ecd1d a79077dfa046 2023-12-05T09:26:31.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4fb006af00 msgr2=0x7f4fb006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4fb006af00 0x7f4fb006d3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009fd0 tx=0x7f4fb4009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fc006fa30 msgr2=0x7f4fc0104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fc006fa30 0x7f4fc0104d60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4fac002a50 tx=0x7f4fac0046b0 comp rx=0 tx=0).stop 2023-12-05T09:26:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 shutdown_connections 2023-12-05T09:26:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f4fb006af00 0x7f4fb006d3b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4fc006e470 0x7f4fc01068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:31.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 --2- 172.21.15.67:0/1574616389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fc006fa30 0x7f4fc0104d60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:31.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 >> 172.21.15.67:0/1574616389 conn(0x7f4fc0069b70 msgr2=0x7f4fc0108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:31.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 shutdown_connections 2023-12-05T09:26:31.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.336+0000 7f4fc5b0f700 1 -- 172.21.15.67:0/1574616389 wait complete. 2023-12-05T09:26:31.337 INFO:tasks.workunit.client.0.smithi067.stdout:7/556: symlink d0/d9/d10/d37/lb5 0 2023-12-05T09:26:31.342 INFO:tasks.workunit.client.0.smithi067.stdout:9/792: dwrite d1b/d25/d54/d5c/f69 [0,4194304] 0 2023-12-05T09:26:31.343 INFO:tasks.workunit.client.0.smithi067.stdout:1/609: mknod d2/d4f/cd9 0 2023-12-05T09:26:31.344 INFO:tasks.workunit.client.0.smithi067.stdout:1/610: write d2/d3/da6/dbb/fbc [419876,123973] 0 2023-12-05T09:26:31.347 INFO:tasks.workunit.client.0.smithi067.stdout:0/733: dwrite d3/d7/d3c/d67/d59/fe1 [0,4194304] 0 2023-12-05T09:26:31.348 INFO:tasks.workunit.client.0.smithi067.stdout:4/545: creat d0/d1d/d53/da8/fbe x:0 0 0 2023-12-05T09:26:31.351 INFO:tasks.workunit.client.0.smithi067.stdout:5/599: fdatasync db/df/d82/f8c 0 2023-12-05T09:26:31.355 INFO:tasks.workunit.client.0.smithi067.stdout:7/557: link d0/l3d d0/d9/d56/d8e/daa/lb6 0 2023-12-05T09:26:31.359 INFO:tasks.workunit.client.0.smithi067.stdout:6/508: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/fb5 x:0 0 0 2023-12-05T09:26:31.363 INFO:tasks.workunit.client.0.smithi067.stdout:9/793: link d1b/d25/d35/d56/c8e d1b/d25/d5b/d62/def/dfa/c10b 0 2023-12-05T09:26:31.365 INFO:tasks.workunit.client.0.smithi067.stdout:9/794: write d1b/f7a [719935,106715] 0 2023-12-05T09:26:31.365 INFO:tasks.workunit.client.0.smithi067.stdout:1/611: symlink d2/d4f/d54/lda 0 2023-12-05T09:26:31.375 INFO:tasks.workunit.client.0.smithi067.stdout:0/734: link d3/d7/d30/f9b d3/d7/d3c/d67/dd1/f106 0 2023-12-05T09:26:31.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:31 smithi134 ceph-mon[116304]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2023-12-05T09:26:31.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:31 smithi134 ceph-mon[116304]: Reconfiguring daemon prometheus.smithi067 on smithi067 2023-12-05T09:26:31.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:31 smithi134 ceph-mon[116304]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:31.378 INFO:tasks.workunit.client.0.smithi067.stdout:4/546: rename d0/d9/f85 to d0/d1d/d25/d38/fbf 0 2023-12-05T09:26:31.382 INFO:tasks.workunit.client.0.smithi067.stdout:5/600: mkdir db/df/ddb 0 2023-12-05T09:26:31.382 INFO:tasks.workunit.client.0.smithi067.stdout:5/601: write db/df/d52/f9d [1181757,47968] 0 2023-12-05T09:26:31.390 INFO:tasks.workunit.client.0.smithi067.stdout:9/795: symlink d1b/d25/d5b/d62/l10c 0 2023-12-05T09:26:31.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/796: stat d1b/d25/d35/d56/d90/fea 0 2023-12-05T09:26:31.391 INFO:tasks.workunit.client.0.smithi067.stdout:9/797: fdatasync d1b/dd3/d6c/dcd/f100 0 2023-12-05T09:26:31.393 INFO:tasks.workunit.client.0.smithi067.stdout:1/612: fdatasync d2/d5/d7/de/d1a/f44 0 2023-12-05T09:26:31.394 INFO:tasks.workunit.client.1.smithi134.stdout:3/839: mkdir d4/d5/d45/df2/d108 0 2023-12-05T09:26:31.395 INFO:tasks.workunit.client.1.smithi134.stdout:3/840: readlink d4/d5/d6f/ld6 0 2023-12-05T09:26:31.395 INFO:tasks.workunit.client.1.smithi134.stdout:3/841: truncate d4/d5/d6f/fd0 287669 0 2023-12-05T09:26:31.398 INFO:tasks.workunit.client.1.smithi134.stdout:0/761: truncate d13/d14/fdc 100898 0 2023-12-05T09:26:31.398 INFO:tasks.workunit.client.0.smithi067.stdout:0/735: truncate d3/fd6 713177 0 2023-12-05T09:26:31.398 INFO:tasks.workunit.client.0.smithi067.stdout:0/736: write d3/d7/d3c/d67/dd1/f106 [10218376,16404] 0 2023-12-05T09:26:31.408 INFO:tasks.workunit.client.1.smithi134.stdout:3/842: write d4/f3b [3707136,67065] 0 2023-12-05T09:26:31.415 INFO:tasks.workunit.client.1.smithi134.stdout:6/755: mknod d4/d39/d42/d4f/d6d/d3a/d75/dbc/ceb 0 2023-12-05T09:26:31.417 INFO:tasks.workunit.client.0.smithi067.stdout:6/509: rename da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d79/f9c to da/d10/d1e/d51/fb6 0 2023-12-05T09:26:31.420 INFO:tasks.workunit.client.1.smithi134.stdout:9/811: creat d7/d5b/d5e/f110 x:0 0 0 2023-12-05T09:26:31.424 INFO:tasks.workunit.client.0.smithi067.stdout:5/602: creat db/df/d35/d63/d75/fdc x:0 0 0 2023-12-05T09:26:31.424 INFO:tasks.workunit.client.0.smithi067.stdout:5/603: readlink db/df/d3f/l66 0 2023-12-05T09:26:31.424 INFO:tasks.workunit.client.0.smithi067.stdout:5/604: write db/df/d1a/d59/dae/fb8 [528052,77098] 0 2023-12-05T09:26:31.424 INFO:tasks.workunit.client.0.smithi067.stdout:5/605: chown db/df/d1a/d1d/d20/f51 6670 1 2023-12-05T09:26:31.424 INFO:tasks.workunit.client.0.smithi067.stdout:5/606: dread - db/df/d1a/d1d/d20/f70 zero size 2023-12-05T09:26:31.425 INFO:tasks.workunit.client.0.smithi067.stdout:9/798: symlink d1b/d25/d35/d56/dc7/l10d 0 2023-12-05T09:26:31.425 INFO:tasks.workunit.client.1.smithi134.stdout:5/785: unlink d0/dd/d37/f53 0 2023-12-05T09:26:31.426 INFO:tasks.workunit.client.1.smithi134.stdout:5/786: write d0/d1a/d1c/f23 [7002642,18977] 0 2023-12-05T09:26:31.426 INFO:tasks.workunit.client.1.smithi134.stdout:5/787: read d0/d1a/d1c/d25/d6a/f95 [540990,116396] 0 2023-12-05T09:26:31.429 INFO:tasks.workunit.client.0.smithi067.stdout:1/613: mkdir d2/ddb 0 2023-12-05T09:26:31.430 INFO:tasks.workunit.client.1.smithi134.stdout:8/909: truncate da/de/d11/d1d/f2e 3943402 0 2023-12-05T09:26:31.431 INFO:tasks.workunit.client.1.smithi134.stdout:2/862: getdents d19/d3f/dbf 0 2023-12-05T09:26:31.431 INFO:tasks.workunit.client.0.smithi067.stdout:6/510: dread da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/f4c [0,4194304] 0 2023-12-05T09:26:31.432 INFO:tasks.workunit.client.0.smithi067.stdout:6/511: dread - da/d10/d1e/d17/d2f/d72/f90 zero size 2023-12-05T09:26:31.432 INFO:tasks.workunit.client.0.smithi067.stdout:6/512: write da/d10/d1e/d17/d2f/d72/f85 [801844,122282] 0 2023-12-05T09:26:31.432 INFO:tasks.workunit.client.0.smithi067.stdout:6/513: dread - da/d10/d1e/d17/d2f/d1f/d27/d4f/fb5 zero size 2023-12-05T09:26:31.436 INFO:tasks.workunit.client.0.smithi067.stdout:4/547: rename d0/d1d/l8c to d0/d1d/d2a/lc0 0 2023-12-05T09:26:31.439 INFO:tasks.workunit.client.0.smithi067.stdout:7/558: dwrite d0/d9/d40/fa0 [0,4194304] 0 2023-12-05T09:26:31.446 INFO:tasks.workunit.client.0.smithi067.stdout:8/600: link d5/dc/d6e/f76 d5/dc/d1a/d20/fa9 0 2023-12-05T09:26:31.447 INFO:tasks.workunit.client.0.smithi067.stdout:5/607: truncate db/df/d3f/d88/f5c 457285 0 2023-12-05T09:26:31.447 INFO:tasks.workunit.client.0.smithi067.stdout:5/608: truncate db/df/d1a/d1d/d20/f8f 278163 0 2023-12-05T09:26:31.461 INFO:tasks.workunit.client.0.smithi067.stdout:9/799: unlink d1b/d25/c71 0 2023-12-05T09:26:31.463 INFO:tasks.workunit.client.1.smithi134.stdout:0/762: mkdir d13/d14/d15/d67/d73/d100 0 2023-12-05T09:26:31.463 INFO:tasks.workunit.client.1.smithi134.stdout:0/763: dread - d13/d14/d15/d93/fe0 zero size 2023-12-05T09:26:31.463 INFO:tasks.workunit.client.1.smithi134.stdout:0/764: write d13/d14/d15/f40 [3817307,66626] 0 2023-12-05T09:26:31.463 INFO:tasks.workunit.client.1.smithi134.stdout:7/800: getdents d2/df/d81/daf 0 2023-12-05T09:26:31.464 INFO:tasks.workunit.client.1.smithi134.stdout:7/801: chown d2/df/d2a/f40 1227304691 1 2023-12-05T09:26:31.469 INFO:tasks.workunit.client.1.smithi134.stdout:3/843: dwrite d4/d5/f95 [0,4194304] 0 2023-12-05T09:26:31.470 INFO:tasks.workunit.client.1.smithi134.stdout:3/844: fdatasync d4/d1f/d4e/d6a/fbf 0 2023-12-05T09:26:31.470 INFO:tasks.workunit.client.1.smithi134.stdout:3/845: truncate d4/d1f/d4e/f59 595968 0 2023-12-05T09:26:31.470 INFO:tasks.workunit.client.1.smithi134.stdout:3/846: chown d4/d1f/d50/db4/d102/dab/ddc/cf4 27 1 2023-12-05T09:26:31.470 INFO:tasks.workunit.client.1.smithi134.stdout:3/847: chown d4/d5/d45/df2/d108 183745709 1 2023-12-05T09:26:31.471 INFO:tasks.workunit.client.0.smithi067.stdout:4/548: symlink d0/d1d/d25/d2c/d34/d4e/d5a/d88/lc1 0 2023-12-05T09:26:31.475 INFO:tasks.workunit.client.1.smithi134.stdout:6/756: truncate d4/d39/d42/d4f/d6d/d3a/da/da0/fdf 2930583 0 2023-12-05T09:26:31.475 INFO:tasks.workunit.client.1.smithi134.stdout:6/757: fsync d4/d32/d57/f5d 0 2023-12-05T09:26:31.475 INFO:tasks.workunit.client.1.smithi134.stdout:6/758: chown d4/d39/d42/d4f/d6d/d3a/da/da0/lc0 25 1 2023-12-05T09:26:31.476 INFO:tasks.workunit.client.0.smithi067.stdout:1/614: dread d2/d5/d7/de/d19/d71/fb5 [0,4194304] 0 2023-12-05T09:26:31.478 INFO:tasks.workunit.client.1.smithi134.stdout:9/812: mkdir d7/d8/d14/d26/d5a/d111 0 2023-12-05T09:26:31.478 INFO:tasks.workunit.client.1.smithi134.stdout:9/813: read d7/fd8 [3169994,102311] 0 2023-12-05T09:26:31.479 INFO:tasks.workunit.client.0.smithi067.stdout:0/737: dwrite d3/d7/d3c/d6c/d76/da7/dec/d10/f1f [0,4194304] 0 2023-12-05T09:26:31.479 INFO:tasks.workunit.client.0.smithi067.stdout:0/738: fdatasync d3/f4d 0 2023-12-05T09:26:31.480 INFO:tasks.workunit.client.1.smithi134.stdout:5/788: link d0/d1a/d1c/d3f/d5b/f63 d0/d1a/f111 0 2023-12-05T09:26:31.480 INFO:tasks.workunit.client.1.smithi134.stdout:5/789: write d0/d1a/d1c/d3f/d81/db0/f102 [623695,110331] 0 2023-12-05T09:26:31.485 INFO:tasks.workunit.client.0.smithi067.stdout:5/609: getdents db 0 2023-12-05T09:26:31.491 INFO:tasks.workunit.client.0.smithi067.stdout:9/800: symlink d1b/l10e 0 2023-12-05T09:26:31.492 INFO:tasks.workunit.client.0.smithi067.stdout:9/801: creat d1b/f10f x:0 0 0 2023-12-05T09:26:31.506 INFO:tasks.workunit.client.0.smithi067.stdout:4/549: link d0/d1d/d2a/f7e d0/d1d/d53/d62/fc2 0 2023-12-05T09:26:31.508 INFO:tasks.workunit.client.0.smithi067.stdout:8/601: dread d5/dc/d1a/d20/d58/f8f [0,4194304] 0 2023-12-05T09:26:31.508 INFO:tasks.workunit.client.0.smithi067.stdout:8/602: dread - d5/da/f69 zero size 2023-12-05T09:26:31.508 INFO:tasks.workunit.client.0.smithi067.stdout:8/603: stat d5/f40 0 2023-12-05T09:26:31.510 INFO:tasks.workunit.client.1.smithi134.stdout:4/809: mknod d16/d21/d47/c11c 0 2023-12-05T09:26:31.513 INFO:tasks.workunit.client.0.smithi067.stdout:0/739: mknod d3/d7/d3c/ddb/de5/c107 0 2023-12-05T09:26:31.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/550: mknod d0/cc3 0 2023-12-05T09:26:31.523 INFO:tasks.workunit.client.0.smithi067.stdout:2/521: sync 2023-12-05T09:26:31.523 INFO:tasks.workunit.client.0.smithi067.stdout:2/522: creat d0/d25/d34/d4a/fb3 x:0 0 0 2023-12-05T09:26:31.525 INFO:tasks.workunit.client.0.smithi067.stdout:1/615: rename d2/c22 to d2/d5/d7/de/d1a/cdc 0 2023-12-05T09:26:31.538 INFO:tasks.workunit.client.0.smithi067.stdout:0/740: write d3/f1d [5291394,114171] 0 2023-12-05T09:26:31.544 INFO:tasks.workunit.client.1.smithi134.stdout:3/848: dwrite d4/d5/fa2 [0,4194304] 0 2023-12-05T09:26:31.545 INFO:tasks.workunit.client.0.smithi067.stdout:4/551: read d0/d1d/d25/d32/f44 [3066541,77408] 0 2023-12-05T09:26:31.545 INFO:tasks.workunit.client.0.smithi067.stdout:4/552: stat d0/d1d/d25 0 2023-12-05T09:26:31.548 INFO:tasks.workunit.client.0.smithi067.stdout:1/616: unlink d2/d5/d7/de/c62 0 2023-12-05T09:26:31.548 INFO:tasks.workunit.client.0.smithi067.stdout:9/802: dread d1b/d25/f50 [0,4194304] 0 2023-12-05T09:26:31.548 INFO:tasks.workunit.client.0.smithi067.stdout:8/604: unlink d5/dc/d1a/d20/d3e/f70 0 2023-12-05T09:26:31.548 INFO:tasks.workunit.client.0.smithi067.stdout:8/605: dread - d5/dc/d1a/d20/d2d/d7f/d94/da3/fa4 zero size 2023-12-05T09:26:31.548 INFO:tasks.workunit.client.0.smithi067.stdout:8/606: stat d5/dc/d6e/f78 0 2023-12-05T09:26:31.548 INFO:tasks.workunit.client.0.smithi067.stdout:8/607: write d5/f18 [3153417,86312] 0 2023-12-05T09:26:31.563 INFO:tasks.workunit.client.0.smithi067.stdout:4/553: rename d0/d1d/d25/c30 to d0/d1d/d4d/cc4 0 2023-12-05T09:26:31.567 INFO:tasks.workunit.client.0.smithi067.stdout:9/803: symlink d1b/d25/d54/d5c/d81/d96/l110 0 2023-12-05T09:26:31.567 INFO:tasks.workunit.client.0.smithi067.stdout:9/804: read - d1b/f75 zero size 2023-12-05T09:26:31.567 INFO:tasks.workunit.client.0.smithi067.stdout:9/805: chown d1b/d3e/d7f/f95 2 1 2023-12-05T09:26:31.567 INFO:tasks.workunit.client.0.smithi067.stdout:9/806: chown d1b/d25/d35/d56/f8c 7351 1 2023-12-05T09:26:31.567 INFO:tasks.workunit.client.1.smithi134.stdout:0/765: dwrite d13/d14/d30/d4b/d23/f60 [0,4194304] 0 2023-12-05T09:26:31.569 INFO:tasks.workunit.client.0.smithi067.stdout:8/608: rename d5/dc/d1a/d20/d2d/ca2 to d5/dc/d1a/d20/d2d/caa 0 2023-12-05T09:26:31.574 INFO:tasks.workunit.client.0.smithi067.stdout:5/610: dwrite db/df/d3f/d88/fc5 [0,4194304] 0 2023-12-05T09:26:31.574 INFO:tasks.workunit.client.0.smithi067.stdout:4/554: creat d0/d1d/d24/fc5 x:0 0 0 2023-12-05T09:26:31.574 INFO:tasks.workunit.client.0.smithi067.stdout:4/555: chown d0/d1d/d53/da8/da9/d15/f33 1516272 1 2023-12-05T09:26:31.575 INFO:tasks.workunit.client.0.smithi067.stdout:5/611: write db/df/d1a/d1d/d20/f37 [5361094,61303] 0 2023-12-05T09:26:31.575 INFO:tasks.workunit.client.0.smithi067.stdout:5/612: chown db/c43 5552 1 2023-12-05T09:26:31.576 INFO:tasks.workunit.client.0.smithi067.stdout:7/559: dwrite d0/d9/d10/d1d/f26 [0,4194304] 0 2023-12-05T09:26:31.578 INFO:tasks.workunit.client.0.smithi067.stdout:1/617: write d2/d4f/d54/f8c [3894321,63129] 0 2023-12-05T09:26:31.579 INFO:tasks.workunit.client.0.smithi067.stdout:5/613: read f9 [4510142,99576] 0 2023-12-05T09:26:31.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.584+0000 7f575ff3f700 1 -- 172.21.15.67:0/452151583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 msgr2=0x7f57580fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:31.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.584+0000 7f575ff3f700 1 --2- 172.21.15.67:0/452151583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 0x7f57580fd000 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f574c009ce0 tx=0x7f574c004d10 comp rx=0 tx=0).stop 2023-12-05T09:26:31.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.584+0000 7f575ff3f700 1 -- 172.21.15.67:0/452151583 shutdown_connections 2023-12-05T09:26:31.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.584+0000 7f575ff3f700 1 --2- 172.21.15.67:0/452151583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57580fde00 0x7f57580fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:31.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.584+0000 7f575ff3f700 1 --2- 172.21.15.67:0/452151583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 0x7f57580fd000 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:31.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.584+0000 7f575ff3f700 1 -- 172.21.15.67:0/452151583 >> 172.21.15.67:0/452151583 conn(0x7f57580f82d0 msgr2=0x7f57580fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:31.585 INFO:tasks.workunit.client.0.smithi067.stdout:2/523: dwrite d0/d2f/faf [0,4194304] 0 2023-12-05T09:26:31.585 INFO:tasks.workunit.client.0.smithi067.stdout:3/526: sync 2023-12-05T09:26:31.585 INFO:tasks.workunit.client.0.smithi067.stdout:3/527: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/fb5 x:0 0 0 2023-12-05T09:26:31.585 INFO:tasks.workunit.client.0.smithi067.stdout:9/807: rename d1b/d25/d35/d56/d90/ce8 to d1b/d25/d35/c111 0 2023-12-05T09:26:31.585 INFO:tasks.workunit.client.0.smithi067.stdout:9/808: creat d1b/d3e/f112 x:0 0 0 2023-12-05T09:26:31.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.587+0000 7f575ff3f700 1 -- 172.21.15.67:0/452151583 shutdown_connections 2023-12-05T09:26:31.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.587+0000 7f575ff3f700 1 -- 172.21.15.67:0/452151583 wait complete. 2023-12-05T09:26:31.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.588+0000 7f575ff3f700 1 Processor -- start 2023-12-05T09:26:31.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.590+0000 7f575ff3f700 1 -- start start 2023-12-05T09:26:31.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.592+0000 7f575ff3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 0x7f575806ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:31.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.592+0000 7f575ff3f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57580fde00 0x7f575806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.592+0000 7f575ff3f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758117120 con 0x7f57580fde00 2023-12-05T09:26:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.592+0000 7f575ff3f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758117290 con 0x7f57580fcbf0 2023-12-05T09:26:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.592+0000 7f575d4da700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57580fde00 0x7f575806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.592+0000 7f575dcdb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 0x7f575806ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.593+0000 7f575dcdb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 0x7f575806ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:48086/0 (socket says 172.21.15.67:48086) 2023-12-05T09:26:31.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.593+0000 7f575dcdb700 1 -- 172.21.15.67:0/3089749580 learned_addr learned my addr 172.21.15.67:0/3089749580 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:26:31.593 INFO:tasks.workunit.client.0.smithi067.stdout:6/514: dwrite da/d10/d1e/d7f/fad [0,4194304] 0 2023-12-05T09:26:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.593+0000 7f575dcdb700 1 -- 172.21.15.67:0/3089749580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57580fde00 msgr2=0x7f575806f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.593+0000 7f575dcdb700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57580fde00 0x7f575806f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.593+0000 7f575dcdb700 1 -- 172.21.15.67:0/3089749580 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c009940 con 0x7f57580fcbf0 2023-12-05T09:26:31.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.594+0000 7f575dcdb700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 0x7f575806ee10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f574c009cb0 tx=0x7f574c004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.595+0000 7f57567fc700 1 -- 172.21.15.67:0/3089749580 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f574c00e040 con 0x7f57580fcbf0 2023-12-05T09:26:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.595+0000 7f57567fc700 1 -- 172.21.15.67:0/3089749580 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f574c0128c0 con 0x7f57580fcbf0 2023-12-05T09:26:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.595+0000 7f57567fc700 1 -- 172.21.15.67:0/3089749580 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f574c01c820 con 0x7f57580fcbf0 2023-12-05T09:26:31.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.596+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57581174b0 con 0x7f57580fcbf0 2023-12-05T09:26:31.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.596+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57581179f0 con 0x7f57580fcbf0 2023-12-05T09:26:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.598+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57580fbf50 con 0x7f57580fcbf0 2023-12-05T09:26:31.598 INFO:tasks.workunit.client.0.smithi067.stdout:7/560: read d0/d9/d40/d7a/fb3 [8162807,84771] 0 2023-12-05T09:26:31.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.599+0000 7f57567fc700 1 -- 172.21.15.67:0/3089749580 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f574c012a30 con 0x7f57580fcbf0 2023-12-05T09:26:31.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.600+0000 7f57567fc700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f574806b020 0x7f574806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:31.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.601+0000 7f57567fc700 1 -- 172.21.15.67:0/3089749580 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f574c08b040 con 0x7f57580fcbf0 2023-12-05T09:26:31.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.601+0000 7f575d4da700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f574806b020 0x7f574806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:31.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.602+0000 7f575d4da700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f574806b020 0x7f574806d4d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5744004d60 tx=0x7f574400b040 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:31.602 INFO:tasks.workunit.client.0.smithi067.stdout:9/809: dread d1b/d3e/f91 [0,4194304] 0 2023-12-05T09:26:31.602 INFO:tasks.workunit.client.0.smithi067.stdout:9/810: fdatasync d1b/f51 0 2023-12-05T09:26:31.603 INFO:tasks.workunit.client.0.smithi067.stdout:5/614: dread db/df/d82/fb3 [0,4194304] 0 2023-12-05T09:26:31.605 INFO:tasks.workunit.client.0.smithi067.stdout:4/556: creat d0/d1d/d3c/d51/fc6 x:0 0 0 2023-12-05T09:26:31.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:31.606+0000 7f57567fc700 1 -- 172.21.15.67:0/3089749580 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f574c0bdce0 con 0x7f57580fcbf0 2023-12-05T09:26:31.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/802: fdatasync d2/d7/dc/d22/f9f 0 2023-12-05T09:26:31.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/803: stat d2/df/d81/daf/de1/cf2 0 2023-12-05T09:26:31.610 INFO:tasks.workunit.client.0.smithi067.stdout:6/515: dread da/d10/d1e/d17/d2f/d1f/d27/fac [0,4194304] 0 2023-12-05T09:26:31.610 INFO:tasks.workunit.client.0.smithi067.stdout:6/516: fsync da/d10/d1e/d17/d2f/d2c/d34/f74 0 2023-12-05T09:26:31.610 INFO:tasks.workunit.client.0.smithi067.stdout:6/517: chown da/d10/d1e/d17/d2f/d5f/c99 2 1 2023-12-05T09:26:31.626 INFO:tasks.workunit.client.0.smithi067.stdout:1/618: creat d2/d4f/d14/d48/fdd x:0 0 0 2023-12-05T09:26:31.626 INFO:tasks.workunit.client.0.smithi067.stdout:1/619: fsync d2/f5c 0 2023-12-05T09:26:31.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/759: creat d4/d39/d42/d4f/d6d/d3a/dd4/fec x:0 0 0 2023-12-05T09:26:31.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/760: write d4/d39/fc3 [966096,17171] 0 2023-12-05T09:26:31.628 INFO:tasks.workunit.client.1.smithi134.stdout:6/761: dread - d4/d39/d42/d4f/d6d/d3a/da/fe4 zero size 2023-12-05T09:26:31.634 INFO:tasks.workunit.client.1.smithi134.stdout:9/814: unlink d7/d8/d16/d52/d74/d97/d99/cf9 0 2023-12-05T09:26:31.634 INFO:tasks.workunit.client.1.smithi134.stdout:9/815: truncate d7/d8/d2e/f76 5135645 0 2023-12-05T09:26:31.637 INFO:tasks.workunit.client.0.smithi067.stdout:9/811: dwrite d1b/f75 [0,4194304] 0 2023-12-05T09:26:31.637 INFO:tasks.workunit.client.0.smithi067.stdout:9/812: stat d1b/dd3/d6c/dcd/f100 0 2023-12-05T09:26:31.638 INFO:tasks.workunit.client.1.smithi134.stdout:5/790: mkdir d0/d11/d61/d112 0 2023-12-05T09:26:31.638 INFO:tasks.workunit.client.1.smithi134.stdout:5/791: write d0/d1a/d1c/d3f/d5b/d5d/d78/f91 [1942456,89880] 0 2023-12-05T09:26:31.639 INFO:tasks.workunit.client.0.smithi067.stdout:1/620: dread d2/d4f/d14/f42 [0,4194304] 0 2023-12-05T09:26:31.639 INFO:tasks.workunit.client.0.smithi067.stdout:1/621: fdatasync d2/d4f/d15/d60/d68/f85 0 2023-12-05T09:26:31.640 INFO:tasks.workunit.client.0.smithi067.stdout:2/524: readlink d0/d25/d34/d4d/d72/l8f 0 2023-12-05T09:26:31.643 INFO:tasks.workunit.client.1.smithi134.stdout:4/810: creat d16/d7b/dce/d6e/daa/d3b/f11d x:0 0 0 2023-12-05T09:26:31.647 INFO:tasks.workunit.client.0.smithi067.stdout:3/528: fdatasync d9/f78 0 2023-12-05T09:26:31.651 INFO:tasks.workunit.client.1.smithi134.stdout:3/849: creat d4/d5/d7c/f109 x:0 0 0 2023-12-05T09:26:31.656 INFO:tasks.workunit.client.0.smithi067.stdout:8/609: rename d5/da/d30/d61 to d5/d9d/dab 0 2023-12-05T09:26:31.662 INFO:tasks.workunit.client.0.smithi067.stdout:7/561: mkdir d0/d9/d10/d37/d38/db7 0 2023-12-05T09:26:31.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/615: link db/df/d35/d63/d75/c80 db/df/d52/cdd 0 2023-12-05T09:26:31.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/616: chown db/c5f 397 1 2023-12-05T09:26:31.665 INFO:tasks.workunit.client.0.smithi067.stdout:8/610: dread d5/d9d/dab/d66/f81 [0,4194304] 0 2023-12-05T09:26:31.666 INFO:tasks.workunit.client.0.smithi067.stdout:8/611: creat d5/dc/fac x:0 0 0 2023-12-05T09:26:31.666 INFO:tasks.workunit.client.0.smithi067.stdout:8/612: stat d5/d9d/dab/d66 0 2023-12-05T09:26:31.666 INFO:tasks.workunit.client.0.smithi067.stdout:8/613: write d5/dc/d1a/d20/f72 [473247,74430] 0 2023-12-05T09:26:31.666 INFO:tasks.workunit.client.1.smithi134.stdout:0/766: rmdir d13/d14/d30/d4b/d66/da0/daf/dce/d7d 39 2023-12-05T09:26:31.673 INFO:tasks.workunit.client.1.smithi134.stdout:7/804: creat d2/d7/dc/d2e/d3a/d6d/d9e/f109 x:0 0 0 2023-12-05T09:26:31.676 INFO:tasks.workunit.client.1.smithi134.stdout:6/762: unlink d4/d39/d42/d4f/d6d/d3a/da/de3/d8c/fa2 0 2023-12-05T09:26:31.678 INFO:tasks.workunit.client.0.smithi067.stdout:1/622: creat d2/d3/da6/fde x:0 0 0 2023-12-05T09:26:31.680 INFO:tasks.workunit.client.1.smithi134.stdout:9/816: creat d7/d8/d14/d26/d5a/d69/d9e/f112 x:0 0 0 2023-12-05T09:26:31.683 INFO:tasks.workunit.client.0.smithi067.stdout:2/525: creat d0/fb4 x:0 0 0 2023-12-05T09:26:31.684 INFO:tasks.workunit.client.1.smithi134.stdout:5/792: creat d0/d1a/d1c/d25/d4d/d60/f113 x:0 0 0 2023-12-05T09:26:31.685 INFO:tasks.workunit.client.0.smithi067.stdout:3/529: mkdir d9/d24/db6 0 2023-12-05T09:26:31.687 INFO:tasks.workunit.client.1.smithi134.stdout:4/811: getdents d16/d18/d1b 0 2023-12-05T09:26:31.688 INFO:tasks.workunit.client.1.smithi134.stdout:3/850: truncate d4/d5/d6f/dc2/fca 3222558 0 2023-12-05T09:26:31.692 INFO:tasks.workunit.client.0.smithi067.stdout:7/562: creat d0/d9/d10/fb8 x:0 0 0 2023-12-05T09:26:31.692 INFO:tasks.workunit.client.0.smithi067.stdout:7/563: chown d0/d9/d10/d1d 1950519 1 2023-12-05T09:26:31.693 INFO:tasks.workunit.client.1.smithi134.stdout:9/817: dread d7/d8/d16/d52/d74/d97/fdb [0,4194304] 0 2023-12-05T09:26:31.694 INFO:tasks.workunit.client.1.smithi134.stdout:0/767: creat d13/d14/d15/d67/f101 x:0 0 0 2023-12-05T09:26:31.695 INFO:tasks.workunit.client.0.smithi067.stdout:1/623: dread d2/d5/f6f [0,4194304] 0 2023-12-05T09:26:31.698 INFO:tasks.workunit.client.1.smithi134.stdout:7/805: unlink d2/d7/d2b/d94/f102 0 2023-12-05T09:26:31.700 INFO:tasks.workunit.client.0.smithi067.stdout:8/614: symlink d5/dc/lad 0 2023-12-05T09:26:31.702 INFO:tasks.workunit.client.1.smithi134.stdout:6/763: chown d4/d39/d42/d4f/d8a/l98 249482 1 2023-12-05T09:26:31.702 INFO:tasks.workunit.client.1.smithi134.stdout:3/851: write d4/d5/f32 [2032207,12281] 0 2023-12-05T09:26:31.702 INFO:tasks.workunit.client.1.smithi134.stdout:3/852: truncate d4/d5/d6f/f5e 639017 0 2023-12-05T09:26:31.706 INFO:tasks.workunit.client.1.smithi134.stdout:5/793: symlink d0/dd/l114 0 2023-12-05T09:26:31.707 INFO:tasks.workunit.client.0.smithi067.stdout:4/557: rmdir d0/d1d/d25/d2c/d34/d4e 39 2023-12-05T09:26:31.714 INFO:tasks.workunit.client.0.smithi067.stdout:6/518: getdents da/d10/d1e 0 2023-12-05T09:26:31.716 INFO:tasks.workunit.client.0.smithi067.stdout:6/519: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/fb7 x:0 0 0 2023-12-05T09:26:31.716 INFO:tasks.workunit.client.0.smithi067.stdout:6/520: stat da/d10/d1e/d17/d2f/d72/f85 0 2023-12-05T09:26:31.716 INFO:tasks.workunit.client.0.smithi067.stdout:6/521: chown da/d10/d1e/d17/d2f/d1f/d27 18 1 2023-12-05T09:26:31.721 INFO:tasks.workunit.client.1.smithi134.stdout:3/853: symlink d4/d5/d6f/d97/dae/dc9/l10a 0 2023-12-05T09:26:31.722 INFO:tasks.workunit.client.1.smithi134.stdout:4/812: read d16/d18/dc5/dc2/df6/d63/fe1 [177836,78815] 0 2023-12-05T09:26:31.723 INFO:tasks.workunit.client.0.smithi067.stdout:6/522: read da/d10/d1e/d17/d2f/d72/f97 [59395,107115] 0 2023-12-05T09:26:31.723 INFO:tasks.workunit.client.0.smithi067.stdout:2/526: creat d0/d25/d9d/fb5 x:0 0 0 2023-12-05T09:26:31.723 INFO:tasks.workunit.client.0.smithi067.stdout:9/813: dwrite d1b/f1c [0,4194304] 0 2023-12-05T09:26:31.723 INFO:tasks.workunit.client.0.smithi067.stdout:9/814: dread - d1b/d25/fb5 zero size 2023-12-05T09:26:31.727 INFO:tasks.workunit.client.1.smithi134.stdout:5/794: mknod d0/d66/c115 0 2023-12-05T09:26:31.727 INFO:tasks.workunit.client.0.smithi067.stdout:3/530: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/fb7 x:0 0 0 2023-12-05T09:26:31.727 INFO:tasks.workunit.client.1.smithi134.stdout:3/854: mkdir d4/d1f/d10b 0 2023-12-05T09:26:31.728 INFO:tasks.workunit.client.0.smithi067.stdout:1/624: mkdir d2/d4f/d15/d74/ddf 0 2023-12-05T09:26:31.729 INFO:tasks.workunit.client.0.smithi067.stdout:1/625: creat d2/d3/da6/dbb/fe0 x:0 0 0 2023-12-05T09:26:31.731 INFO:tasks.workunit.client.1.smithi134.stdout:4/813: unlink d16/d7b/dce/d6e/daa/d3b/f5d 0 2023-12-05T09:26:31.736 INFO:tasks.workunit.client.0.smithi067.stdout:8/615: creat d5/dc/d1a/d62/fae x:0 0 0 2023-12-05T09:26:31.736 INFO:tasks.workunit.client.0.smithi067.stdout:8/616: write d5/dc/d1a/f5a [1663580,33626] 0 2023-12-05T09:26:31.736 INFO:tasks.workunit.client.0.smithi067.stdout:8/617: chown d5/dc/d1a/c44 4815 1 2023-12-05T09:26:31.739 INFO:tasks.workunit.client.0.smithi067.stdout:5/617: write db/df/f31 [1312902,75460] 0 2023-12-05T09:26:31.739 INFO:tasks.workunit.client.0.smithi067.stdout:4/558: creat d0/d1d/d4d/d8d/d98/fc7 x:0 0 0 2023-12-05T09:26:31.740 INFO:tasks.workunit.client.1.smithi134.stdout:4/814: mknod d16/d7b/c11e 0 2023-12-05T09:26:31.740 INFO:tasks.workunit.client.1.smithi134.stdout:4/815: write f5 [3652814,103256] 0 2023-12-05T09:26:31.740 INFO:tasks.workunit.client.1.smithi134.stdout:4/816: write d16/d7b/dce/d6e/daa/d3b/fde [1086528,34378] 0 2023-12-05T09:26:31.745 INFO:tasks.workunit.client.0.smithi067.stdout:6/523: dread da/d10/d1e/d17/d2f/d72/fa7 [0,4194304] 0 2023-12-05T09:26:31.749 INFO:tasks.workunit.client.1.smithi134.stdout:6/764: dwrite d4/d32/d57/f61 [0,4194304] 0 2023-12-05T09:26:31.749 INFO:tasks.workunit.client.1.smithi134.stdout:6/765: creat d4/d39/d42/d4f/d6d/d3a/da/fed x:0 0 0 2023-12-05T09:26:31.750 INFO:tasks.workunit.client.1.smithi134.stdout:5/795: dread d0/d1a/d1c/d3f/d5b/d5d/fd2 [0,4194304] 0 2023-12-05T09:26:31.751 INFO:tasks.workunit.client.1.smithi134.stdout:5/796: creat d0/dd/f116 x:0 0 0 2023-12-05T09:26:31.751 INFO:tasks.workunit.client.1.smithi134.stdout:5/797: chown d0/d11/f2f 56343 1 2023-12-05T09:26:31.751 INFO:tasks.workunit.client.1.smithi134.stdout:5/798: truncate d0/dd/d37/d90/f103 497653 0 2023-12-05T09:26:31.757 INFO:tasks.workunit.client.0.smithi067.stdout:8/618: dread d5/dc/d1a/d62/f73 [0,4194304] 0 2023-12-05T09:26:31.757 INFO:tasks.workunit.client.0.smithi067.stdout:9/815: dread d1b/d25/d35/f85 [0,4194304] 0 2023-12-05T09:26:31.766 INFO:tasks.workunit.client.0.smithi067.stdout:2/527: creat d0/d25/d9d/d53/d1e/d8e/fb6 x:0 0 0 2023-12-05T09:26:31.766 INFO:tasks.workunit.client.0.smithi067.stdout:2/528: write d0/d25/d34/d4d/d54/d56/f80 [359679,73695] 0 2023-12-05T09:26:31.767 INFO:tasks.workunit.client.0.smithi067.stdout:3/531: mkdir d9/d24/db8 0 2023-12-05T09:26:31.769 INFO:tasks.workunit.client.1.smithi134.stdout:0/768: dwrite f8 [0,4194304] 0 2023-12-05T09:26:31.771 INFO:tasks.workunit.client.1.smithi134.stdout:9/818: dwrite d7/d8/d16/d52/ff3 [0,4194304] 0 2023-12-05T09:26:31.771 INFO:tasks.workunit.client.1.smithi134.stdout:9/819: stat d7/d8/d14/d26/c71 0 2023-12-05T09:26:31.772 INFO:tasks.workunit.client.1.smithi134.stdout:4/817: dread d16/d21/d48/d66/fee [0,4194304] 0 2023-12-05T09:26:31.773 INFO:tasks.workunit.client.1.smithi134.stdout:6/766: mkdir d4/d32/d74/dee 0 2023-12-05T09:26:31.777 INFO:tasks.workunit.client.0.smithi067.stdout:7/564: dwrite d0/d9/d40/d48/f91 [0,4194304] 0 2023-12-05T09:26:31.779 INFO:tasks.workunit.client.0.smithi067.stdout:5/618: dread db/df/d1a/d1d/d20/fd1 [4194304,4194304] 0 2023-12-05T09:26:31.780 INFO:tasks.workunit.client.1.smithi134.stdout:5/799: mkdir d0/dd/d37/d90/dfe/d117 0 2023-12-05T09:26:31.781 INFO:tasks.workunit.client.0.smithi067.stdout:4/559: creat d0/d1d/d2a/dba/fc8 x:0 0 0 2023-12-05T09:26:31.783 INFO:tasks.workunit.client.0.smithi067.stdout:1/626: link d2/d5/d7/de/d19/d49/d5f/c72 d2/ddb/ce1 0 2023-12-05T09:26:31.783 INFO:tasks.workunit.client.0.smithi067.stdout:1/627: fsync d2/d5/f6f 0 2023-12-05T09:26:31.783 INFO:tasks.workunit.client.0.smithi067.stdout:1/628: fdatasync d2/fa7 0 2023-12-05T09:26:31.783 INFO:tasks.workunit.client.0.smithi067.stdout:8/619: write d5/f28 [1166407,23743] 0 2023-12-05T09:26:31.783 INFO:tasks.workunit.client.0.smithi067.stdout:8/620: write d5/dc/d1a/f5a [3435579,39597] 0 2023-12-05T09:26:31.784 INFO:tasks.workunit.client.0.smithi067.stdout:9/816: unlink d1b/d25/df6/ffd 0 2023-12-05T09:26:31.785 INFO:tasks.workunit.client.0.smithi067.stdout:9/817: fsync d1b/d3e/d7f/f97 0 2023-12-05T09:26:31.786 INFO:tasks.workunit.client.1.smithi134.stdout:0/769: truncate d13/d14/d30/d4b/d66/da0/daf/dde/f44 843449 0 2023-12-05T09:26:31.789 INFO:tasks.workunit.client.0.smithi067.stdout:3/532: mknod d9/d20/cb9 0 2023-12-05T09:26:31.797 INFO:tasks.workunit.client.1.smithi134.stdout:5/800: symlink d0/d1a/d1c/dde/d10d/l118 0 2023-12-05T09:26:31.798 INFO:tasks.workunit.client.1.smithi134.stdout:5/801: write d0/d1a/d1c/d25/d4d/d9e/fac [298575,88104] 0 2023-12-05T09:26:31.799 INFO:tasks.workunit.client.0.smithi067.stdout:5/619: symlink db/df/db5/lde 0 2023-12-05T09:26:31.805 INFO:tasks.workunit.client.1.smithi134.stdout:0/770: getdents d13/d14/d15/d93 0 2023-12-05T09:26:31.805 INFO:tasks.workunit.client.1.smithi134.stdout:0/771: read - d13/d14/d30/f3a zero size 2023-12-05T09:26:31.805 INFO:tasks.workunit.client.1.smithi134.stdout:0/772: write d13/d14/d30/d4b/d66/da0/daf/dce/d78/f97 [1364983,69982] 0 2023-12-05T09:26:31.805 INFO:tasks.workunit.client.1.smithi134.stdout:0/773: stat d13/d14/d30/d4b/d66/da0/daf/dce/d78 0 2023-12-05T09:26:31.809 INFO:tasks.workunit.client.0.smithi067.stdout:1/629: creat d2/d5/d7/de/d19/d49/fe2 x:0 0 0 2023-12-05T09:26:31.810 INFO:tasks.workunit.client.0.smithi067.stdout:4/560: write d0/d1d/d53/d62/fc2 [2751166,102287] 0 2023-12-05T09:26:31.810 INFO:tasks.workunit.client.1.smithi134.stdout:5/802: symlink d0/d11/d5c/dab/l119 0 2023-12-05T09:26:31.826 INFO:tasks.workunit.client.0.smithi067.stdout:8/621: dread d5/f40 [0,4194304] 0 2023-12-05T09:26:31.828 INFO:tasks.workunit.client.0.smithi067.stdout:6/524: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/fb5 [0,4194304] 0 2023-12-05T09:26:31.851 INFO:tasks.workunit.client.1.smithi134.stdout:4/818: dwrite d16/d21/f7c [0,4194304] 0 2023-12-05T09:26:31.853 INFO:tasks.workunit.client.1.smithi134.stdout:9/820: dwrite d7/d8/d16/d52/d74/d97/fdb [0,4194304] 0 2023-12-05T09:26:31.858 INFO:tasks.workunit.client.0.smithi067.stdout:6/525: write da/d10/d1e/d17/d2f/f2b [1525427,106192] 0 2023-12-05T09:26:31.876 INFO:tasks.workunit.client.1.smithi134.stdout:6/767: dwrite d4/d32/d57/f94 [0,4194304] 0 2023-12-05T09:26:31.876 INFO:tasks.workunit.client.1.smithi134.stdout:6/768: fsync d4/d39/d42/f4d 0 2023-12-05T09:26:31.877 INFO:tasks.workunit.client.0.smithi067.stdout:6/526: dread da/d10/d1e/d17/d2f/d72/f85 [0,4194304] 0 2023-12-05T09:26:31.881 INFO:tasks.workunit.client.1.smithi134.stdout:5/803: symlink d0/dd/l11a 0 2023-12-05T09:26:31.881 INFO:tasks.workunit.client.1.smithi134.stdout:5/804: chown d0/dd/f32 389564363 1 2023-12-05T09:26:31.881 INFO:tasks.workunit.client.1.smithi134.stdout:5/805: fdatasync d0/d50/fad 0 2023-12-05T09:26:31.882 INFO:tasks.workunit.client.1.smithi134.stdout:5/806: stat d0/d1a/d1c/dde/d10d 0 2023-12-05T09:26:31.882 INFO:tasks.workunit.client.1.smithi134.stdout:5/807: write d0/d11/d61/d75/f79 [1463462,25102] 0 2023-12-05T09:26:31.882 INFO:tasks.workunit.client.1.smithi134.stdout:5/808: write d0/d11/d61/d75/f9f [765416,93776] 0 2023-12-05T09:26:31.883 INFO:tasks.workunit.client.0.smithi067.stdout:9/818: creat d1b/dd3/f113 x:0 0 0 2023-12-05T09:26:31.910 INFO:tasks.workunit.client.1.smithi134.stdout:4/819: mknod d16/d18/dad/c11f 0 2023-12-05T09:26:31.910 INFO:tasks.workunit.client.1.smithi134.stdout:4/820: fsync d16/d7b/dce/d6e/daa/d3b/fe0 0 2023-12-05T09:26:31.914 INFO:tasks.workunit.client.0.smithi067.stdout:7/565: rmdir d0/d9/d40/d7a/dad 39 2023-12-05T09:26:31.914 INFO:tasks.workunit.client.0.smithi067.stdout:7/566: dread - d0/d9/d10/d37/d38/f7f zero size 2023-12-05T09:26:31.917 INFO:tasks.workunit.client.0.smithi067.stdout:5/620: creat db/df/d35/dc8/fdf x:0 0 0 2023-12-05T09:26:31.919 INFO:tasks.workunit.client.1.smithi134.stdout:9/821: mknod d7/dee/c113 0 2023-12-05T09:26:31.924 INFO:tasks.workunit.client.0.smithi067.stdout:4/561: dwrite d0/d1d/d4d/d8d/d98/fc7 [0,4194304] 0 2023-12-05T09:26:31.924 INFO:tasks.workunit.client.0.smithi067.stdout:4/562: chown d0/d1d/d25/d32/f89 105 1 2023-12-05T09:26:31.924 INFO:tasks.workunit.client.0.smithi067.stdout:1/630: mkdir d2/d3/da6/dbb/dd1/de3 0 2023-12-05T09:26:31.927 INFO:tasks.workunit.client.0.smithi067.stdout:3/533: read d9/da/d15/d17/d1a/f35 [377817,47760] 0 2023-12-05T09:26:31.927 INFO:tasks.workunit.client.0.smithi067.stdout:3/534: dread - d9/da/d15/d17/d1a/d51/f89 zero size 2023-12-05T09:26:31.930 INFO:tasks.workunit.client.0.smithi067.stdout:5/621: dread db/df/d36/d57/f73 [0,4194304] 0 2023-12-05T09:26:31.934 INFO:tasks.workunit.client.0.smithi067.stdout:8/622: mknod d5/dc/d1a/d20/d2d/caf 0 2023-12-05T09:26:31.937 INFO:tasks.workunit.client.0.smithi067.stdout:6/527: dwrite da/d10/d1e/d17/d2f/d2c/d34/f74 [4194304,4194304] 0 2023-12-05T09:26:32.007 INFO:tasks.workunit.client.0.smithi067.stdout:6/528: dwrite f4 [0,4194304] 0 2023-12-05T09:26:32.007 INFO:tasks.workunit.client.0.smithi067.stdout:4/563: dwrite d0/d1d/d25/f5f [0,4194304] 0 2023-12-05T09:26:32.028 INFO:tasks.workunit.client.0.smithi067.stdout:9/819: symlink d1b/dd3/d6c/dcd/l114 0 2023-12-05T09:26:32.028 INFO:tasks.workunit.client.0.smithi067.stdout:9/820: chown d1b/f5d 15 1 2023-12-05T09:26:32.028 INFO:tasks.workunit.client.0.smithi067.stdout:9/821: dread - d1b/d25/d35/d56/fc0 zero size 2023-12-05T09:26:32.029 INFO:tasks.workunit.client.1.smithi134.stdout:1/950: rename d2/d9/d10/f53 to d2/d27/d40/f154 0 2023-12-05T09:26:32.032 INFO:tasks.workunit.client.1.smithi134.stdout:8/910: unlink da/de/d11/d8b/d8c/fa7 0 2023-12-05T09:26:32.033 INFO:tasks.workunit.client.1.smithi134.stdout:1/951: write d2/f65 [3975296,5929] 0 2023-12-05T09:26:32.033 INFO:tasks.workunit.client.1.smithi134.stdout:1/952: truncate d2/d9/d10/d30/dd4/dfb/f11e 1223955 0 2023-12-05T09:26:32.034 INFO:tasks.workunit.client.0.smithi067.stdout:7/567: rename d0/d9/d56/f5b to d0/d9/d40/d7a/dad/fb9 0 2023-12-05T09:26:32.034 INFO:tasks.workunit.client.0.smithi067.stdout:7/568: stat d0/d9/d10/d37/d38/f7f 0 2023-12-05T09:26:32.034 INFO:tasks.workunit.client.0.smithi067.stdout:7/569: write d0/d9/d40/f97 [489198,10213] 0 2023-12-05T09:26:32.035 INFO:tasks.workunit.client.1.smithi134.stdout:1/953: link d2/d9/d10/d30/d66/de3/ff6 d2/d9/d10/d30/f155 0 2023-12-05T09:26:32.037 INFO:tasks.workunit.client.1.smithi134.stdout:6/769: rmdir d4/d39/d42/d4f/d6d/d3a/d75 39 2023-12-05T09:26:32.045 INFO:tasks.workunit.client.0.smithi067.stdout:1/631: fdatasync d2/d5/d7/de/d1a/f1b 0 2023-12-05T09:26:32.047 INFO:tasks.workunit.client.1.smithi134.stdout:5/809: creat d0/dd/d37/d90/dfe/d117/f11b x:0 0 0 2023-12-05T09:26:32.047 INFO:tasks.workunit.client.1.smithi134.stdout:5/810: write d0/f46 [326892,14527] 0 2023-12-05T09:26:32.047 INFO:tasks.workunit.client.1.smithi134.stdout:5/811: stat d0/d1a/d1c/dde/d10d 0 2023-12-05T09:26:32.048 INFO:tasks.workunit.client.0.smithi067.stdout:3/535: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/lba 0 2023-12-05T09:26:32.050 INFO:tasks.workunit.client.0.smithi067.stdout:5/622: link db/df/d3f/d88/f62 db/df/db5/fe0 0 2023-12-05T09:26:32.057 INFO:tasks.workunit.client.0.smithi067.stdout:8/623: rmdir d5/dc/d1a/d20/d2d/d7f/da5 0 2023-12-05T09:26:32.063 INFO:tasks.workunit.client.1.smithi134.stdout:4/821: rmdir d16/d7b/dce 39 2023-12-05T09:26:32.063 INFO:tasks.workunit.client.1.smithi134.stdout:4/822: chown d16/d18/dc5/lc7 693798 1 2023-12-05T09:26:32.063 INFO:tasks.workunit.client.1.smithi134.stdout:4/823: chown d16/d18/d1b/f7d 34 1 2023-12-05T09:26:32.088 INFO:tasks.workunit.client.1.smithi134.stdout:8/911: dwrite da/de/d16/d2d/f80 [0,4194304] 0 2023-12-05T09:26:32.089 INFO:tasks.workunit.client.0.smithi067.stdout:6/529: rmdir da/d10/d1e/d17 39 2023-12-05T09:26:32.089 INFO:tasks.workunit.client.0.smithi067.stdout:5/623: write db/df/d36/f7b [2691600,104920] 0 2023-12-05T09:26:32.092 INFO:tasks.workunit.client.0.smithi067.stdout:4/564: mknod d0/d1d/d53/d82/cc9 0 2023-12-05T09:26:32.093 INFO:tasks.workunit.client.1.smithi134.stdout:8/912: dread da/fc7 [0,4194304] 0 2023-12-05T09:26:32.093 INFO:tasks.workunit.client.1.smithi134.stdout:8/913: dread - da/de/d11/d1d/fec zero size 2023-12-05T09:26:32.095 INFO:tasks.workunit.client.0.smithi067.stdout:9/822: dwrite d1b/d25/d54/d5c/d81/d96/fe6 [0,4194304] 0 2023-12-05T09:26:32.096 INFO:tasks.workunit.client.1.smithi134.stdout:5/812: dwrite d0/dd/f116 [0,4194304] 0 2023-12-05T09:26:32.096 INFO:tasks.workunit.client.1.smithi134.stdout:5/813: getdents d0/d1a/d1c/d3f/d5b/d5d/d78 0 2023-12-05T09:26:32.096 INFO:tasks.workunit.client.1.smithi134.stdout:5/814: stat d0/f46 0 2023-12-05T09:26:32.097 INFO:tasks.workunit.client.1.smithi134.stdout:1/954: dwrite d2/d9/d8d/da2/db1/f150 [0,4194304] 0 2023-12-05T09:26:32.099 INFO:tasks.workunit.client.1.smithi134.stdout:2/863: sync 2023-12-05T09:26:32.100 INFO:tasks.workunit.client.1.smithi134.stdout:0/774: sync 2023-12-05T09:26:32.100 INFO:tasks.workunit.client.1.smithi134.stdout:0/775: chown d13/d14/d15/d67/d73/f81 7297405 1 2023-12-05T09:26:32.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.118+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5758105590 con 0x7f57580fcbf0 2023-12-05T09:26:32.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.118+0000 7f57567fc700 1 -- 172.21.15.67:0/3089749580 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f574c055420 con 0x7f57580fcbf0 2023-12-05T09:26:32.119 INFO:tasks.workunit.client.0.smithi067.stdout:3/536: creat d9/da/d15/fbb x:0 0 0 2023-12-05T09:26:32.119 INFO:tasks.workunit.client.0.smithi067.stdout:3/537: stat d9/d62/f8a 0 2023-12-05T09:26:32.120 INFO:tasks.workunit.client.0.smithi067.stdout:7/570: write d0/d9/f5f [1717404,46690] 0 2023-12-05T09:26:32.121 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:26:32.121 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:26:32.121 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:26:32.121 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:26:32.121 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:26:32.121 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T09:26:32.121 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 13, 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:26:32.122 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:26:32.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.122+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f574806b020 msgr2=0x7f574806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:32.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.122+0000 7f575ff3f700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f574806b020 0x7f574806d4d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5744004d60 tx=0x7f574400b040 comp rx=0 tx=0).stop 2023-12-05T09:26:32.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.122+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 msgr2=0x7f575806ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:32.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.122+0000 7f575ff3f700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 0x7f575806ee10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f574c009cb0 tx=0x7f574c004d10 comp rx=0 tx=0).stop 2023-12-05T09:26:32.123 INFO:tasks.workunit.client.0.smithi067.stdout:8/624: creat d5/dc/d1a/d20/d2d/d8a/fb0 x:0 0 0 2023-12-05T09:26:32.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.127+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 shutdown_connections 2023-12-05T09:26:32.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.127+0000 7f575ff3f700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57580fcbf0 0x7f575806ee10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.126 INFO:tasks.workunit.client.0.smithi067.stdout:6/530: rmdir da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19 39 2023-12-05T09:26:32.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.127+0000 7f575ff3f700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f574806b020 0x7f574806d4d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.127+0000 7f575ff3f700 1 --2- 172.21.15.67:0/3089749580 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f57580fde00 0x7f575806f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.127+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 >> 172.21.15.67:0/3089749580 conn(0x7f57580f82d0 msgr2=0x7f5758101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:32.127 INFO:tasks.workunit.client.0.smithi067.stdout:5/624: creat db/df/db5/fe1 x:0 0 0 2023-12-05T09:26:32.130 INFO:tasks.workunit.client.0.smithi067.stdout:5/625: readlink db/df/d36/l55 0 2023-12-05T09:26:32.130 INFO:tasks.workunit.client.0.smithi067.stdout:5/626: creat db/df/d1a/d1d/d20/fe2 x:0 0 0 2023-12-05T09:26:32.130 INFO:tasks.workunit.client.0.smithi067.stdout:5/627: write db/df/d1a/d1d/d20/f37 [5804993,52710] 0 2023-12-05T09:26:32.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.130+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 shutdown_connections 2023-12-05T09:26:32.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.130+0000 7f575ff3f700 1 -- 172.21.15.67:0/3089749580 wait complete. 2023-12-05T09:26:32.131 INFO:tasks.workunit.client.0.smithi067.stdout:9/823: creat d1b/dd3/d6c/d76/f115 x:0 0 0 2023-12-05T09:26:32.131 INFO:tasks.workunit.client.1.smithi134.stdout:4/824: rmdir d16/d7b/dce/d6e/daa 39 2023-12-05T09:26:32.132 INFO:tasks.workunit.client.1.smithi134.stdout:4/825: truncate d16/d7b/dce/d6e/daa/d3b/dcf/fe7 316431 0 2023-12-05T09:26:32.136 INFO:tasks.workunit.client.0.smithi067.stdout:3/538: creat d9/d24/fbc x:0 0 0 2023-12-05T09:26:32.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/914: rmdir da/de/d16/d33 39 2023-12-05T09:26:32.137 INFO:tasks.workunit.client.0.smithi067.stdout:7/571: rmdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da4 39 2023-12-05T09:26:32.139 INFO:tasks.workunit.client.0.smithi067.stdout:8/625: mknod d5/d3b/cb1 0 2023-12-05T09:26:32.142 INFO:tasks.workunit.client.0.smithi067.stdout:6/531: symlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d79/lb8 0 2023-12-05T09:26:32.144 INFO:tasks.workunit.client.0.smithi067.stdout:5/628: mknod db/df/db5/ce3 0 2023-12-05T09:26:32.145 INFO:tasks.workunit.client.0.smithi067.stdout:5/629: write db/f13 [3938770,34893] 0 2023-12-05T09:26:32.145 INFO:tasks.workunit.client.1.smithi134.stdout:8/915: creat da/de/d11/d8b/d8c/d10b/f137 x:0 0 0 2023-12-05T09:26:32.147 INFO:tasks.workunit.client.0.smithi067.stdout:9/824: unlink d1b/d25/d35/d56/f7d 0 2023-12-05T09:26:32.149 INFO:tasks.workunit.client.0.smithi067.stdout:3/539: mknod d9/d24/db6/cbd 0 2023-12-05T09:26:32.149 INFO:tasks.workunit.client.0.smithi067.stdout:3/540: dread - d9/da/d15/d17/d2b/fa9 zero size 2023-12-05T09:26:32.151 INFO:tasks.workunit.client.0.smithi067.stdout:7/572: symlink d0/d9/d10/lba 0 2023-12-05T09:26:32.153 INFO:tasks.workunit.client.1.smithi134.stdout:2/864: dwrite d19/d28/d2b/f57 [0,4194304] 0 2023-12-05T09:26:32.155 INFO:tasks.workunit.client.0.smithi067.stdout:8/626: mkdir d5/dc/d1a/d20/d2d/d41/db2 0 2023-12-05T09:26:32.157 INFO:tasks.workunit.client.1.smithi134.stdout:8/916: dread da/de/d8a/d42/d99/dc8/fe7 [0,4194304] 0 2023-12-05T09:26:32.157 INFO:tasks.workunit.client.1.smithi134.stdout:8/917: truncate da/de/d16/dbe/ffb 396736 0 2023-12-05T09:26:32.159 INFO:tasks.workunit.client.1.smithi134.stdout:1/955: dwrite d2/d9/d10/d30/f155 [0,4194304] 0 2023-12-05T09:26:32.160 INFO:tasks.workunit.client.0.smithi067.stdout:4/565: dwrite d0/d9/f2f [0,4194304] 0 2023-12-05T09:26:32.160 INFO:tasks.workunit.client.0.smithi067.stdout:6/532: mkdir da/d10/d1e/d17/d2f/d1f/d27/d45/db9 0 2023-12-05T09:26:32.160 INFO:tasks.workunit.client.0.smithi067.stdout:6/533: write da/d10/d1e/d17/f40 [1907562,42728] 0 2023-12-05T09:26:32.161 INFO:tasks.workunit.client.1.smithi134.stdout:0/776: creat d13/d14/d30/d4b/d66/da0/daf/dde/df6/f102 x:0 0 0 2023-12-05T09:26:32.161 INFO:tasks.workunit.client.1.smithi134.stdout:0/777: stat d13/d14/f5c 0 2023-12-05T09:26:32.162 INFO:tasks.workunit.client.1.smithi134.stdout:1/956: mknod d2/d9/d10/d30/d66/da9/d74/d99/c156 0 2023-12-05T09:26:32.163 INFO:tasks.workunit.client.1.smithi134.stdout:0/778: write d13/d14/d30/d4b/f42 [546710,90753] 0 2023-12-05T09:26:32.164 INFO:tasks.workunit.client.0.smithi067.stdout:5/630: mknod db/df/d36/ce4 0 2023-12-05T09:26:32.164 INFO:tasks.workunit.client.0.smithi067.stdout:5/631: chown db/df/d1a/d1d/cbd 2 1 2023-12-05T09:26:32.164 INFO:tasks.workunit.client.1.smithi134.stdout:5/815: dwrite d0/d1a/d3a/f74 [0,4194304] 0 2023-12-05T09:26:32.165 INFO:tasks.workunit.client.1.smithi134.stdout:1/957: symlink d2/d9/d10/l157 0 2023-12-05T09:26:32.165 INFO:tasks.workunit.client.1.smithi134.stdout:4/826: getdents d16 0 2023-12-05T09:26:32.167 INFO:tasks.workunit.client.1.smithi134.stdout:1/958: rmdir d2/d9/d10/d30/d66/da9/d74/d125 39 2023-12-05T09:26:32.168 INFO:tasks.workunit.client.1.smithi134.stdout:1/959: mkdir d2/d9/d10/d30/d66/da9/d74/d99/d158 0 2023-12-05T09:26:32.170 INFO:tasks.workunit.client.0.smithi067.stdout:3/541: symlink d9/da/d15/d17/d1a/d51/lbe 0 2023-12-05T09:26:32.170 INFO:tasks.workunit.client.0.smithi067.stdout:3/542: write d9/da/f6c [329963,115714] 0 2023-12-05T09:26:32.170 INFO:tasks.workunit.client.1.smithi134.stdout:1/960: symlink d2/d9/d10/d30/d66/da9/d74/d99/l159 0 2023-12-05T09:26:32.170 INFO:tasks.workunit.client.1.smithi134.stdout:1/961: chown d2/c60 100 1 2023-12-05T09:26:32.172 INFO:tasks.workunit.client.1.smithi134.stdout:1/962: link d2/d9/d10/d30/dfe/l12a d2/l15a 0 2023-12-05T09:26:32.173 INFO:tasks.workunit.client.0.smithi067.stdout:7/573: mknod d0/d9/d10/d37/d38/db7/cbb 0 2023-12-05T09:26:32.174 INFO:tasks.workunit.client.1.smithi134.stdout:1/963: mknod d2/d27/db4/df9/c15b 0 2023-12-05T09:26:32.174 INFO:tasks.workunit.client.1.smithi134.stdout:2/865: mknod d19/d28/d31/d38/d98/dcb/c11b 0 2023-12-05T09:26:32.176 INFO:tasks.workunit.client.0.smithi067.stdout:1/632: dwrite d2/d4f/d54/f58 [0,4194304] 0 2023-12-05T09:26:32.176 INFO:tasks.workunit.client.0.smithi067.stdout:8/627: mkdir d5/d3b/db3 0 2023-12-05T09:26:32.176 INFO:tasks.workunit.client.0.smithi067.stdout:8/628: chown d5/da/f56 0 1 2023-12-05T09:26:32.180 INFO:tasks.workunit.client.0.smithi067.stdout:0/741: sync 2023-12-05T09:26:32.181 INFO:tasks.workunit.client.1.smithi134.stdout:8/918: write da/de/d8a/f6e [2000897,41259] 0 2023-12-05T09:26:32.184 INFO:tasks.workunit.client.0.smithi067.stdout:4/566: creat d0/d1d/d2b/fca x:0 0 0 2023-12-05T09:26:32.185 INFO:tasks.workunit.client.0.smithi067.stdout:4/567: write d0/d9/fb7 [959676,128664] 0 2023-12-05T09:26:32.194 INFO:tasks.workunit.client.1.smithi134.stdout:0/779: mkdir d13/d14/d30/d4b/d66/da0/daf/dce/d103 0 2023-12-05T09:26:32.205 INFO:tasks.workunit.client.1.smithi134.stdout:5/816: symlink d0/d1a/d1c/d3f/d5b/l11c 0 2023-12-05T09:26:32.208 INFO:tasks.workunit.client.1.smithi134.stdout:4/827: mkdir d16/d18/dad/d120 0 2023-12-05T09:26:32.211 INFO:tasks.workunit.client.1.smithi134.stdout:2/866: symlink d19/d3f/dbf/l11c 0 2023-12-05T09:26:32.215 INFO:tasks.workunit.client.0.smithi067.stdout:6/534: unlink da/d10/d1e/l46 0 2023-12-05T09:26:32.215 INFO:tasks.workunit.client.0.smithi067.stdout:6/535: chown da/d10/c30 10367 1 2023-12-05T09:26:32.222 INFO:tasks.workunit.client.1.smithi134.stdout:0/780: unlink d13/d14/d30/d4b/d66/da0/daf/dde/da9/le3 0 2023-12-05T09:26:32.226 INFO:tasks.workunit.client.1.smithi134.stdout:5/817: symlink d0/d11/d61/d105/l11d 0 2023-12-05T09:26:32.226 INFO:tasks.workunit.client.1.smithi134.stdout:5/818: fdatasync d0/dd/f17 0 2023-12-05T09:26:32.227 INFO:tasks.workunit.client.0.smithi067.stdout:9/825: rmdir d1b/d25/d5b/d62 39 2023-12-05T09:26:32.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/543: link d9/da/d15/d17/d2b/l5e d9/da/d15/lbf 0 2023-12-05T09:26:32.229 INFO:tasks.workunit.client.0.smithi067.stdout:3/544: chown d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/c60 420971551 1 2023-12-05T09:26:32.230 INFO:tasks.workunit.client.1.smithi134.stdout:2/867: truncate d19/d3a/df4/f56 817075 0 2023-12-05T09:26:32.233 INFO:tasks.workunit.client.0.smithi067.stdout:2/529: sync 2023-12-05T09:26:32.237 INFO:tasks.workunit.client.1.smithi134.stdout:0/781: mknod d13/d14/d30/d4b/d66/da0/daf/dce/d7d/c104 0 2023-12-05T09:26:32.237 INFO:tasks.workunit.client.1.smithi134.stdout:5/819: getdents d0/d1a/d1c/d3f/d5b/d5d 0 2023-12-05T09:26:32.237 INFO:tasks.workunit.client.1.smithi134.stdout:0/782: fsync d13/d14/d30/d4b/d23/d77/f9b 0 2023-12-05T09:26:32.237 INFO:tasks.workunit.client.1.smithi134.stdout:0/783: chown d13/d14/d30/d4b/d66/da0/daf/dce/d78/c99 217 1 2023-12-05T09:26:32.237 INFO:tasks.workunit.client.1.smithi134.stdout:5/820: write d0/d11/d5c/dab/fcd [633501,113137] 0 2023-12-05T09:26:32.239 INFO:tasks.workunit.client.0.smithi067.stdout:1/633: creat d2/d4f/d54/fe4 x:0 0 0 2023-12-05T09:26:32.239 INFO:tasks.workunit.client.0.smithi067.stdout:1/634: fsync d2/d4f/d14/f42 0 2023-12-05T09:26:32.240 INFO:tasks.workunit.client.0.smithi067.stdout:8/629: symlink d5/dc/d1a/d20/d2d/d41/db2/lb4 0 2023-12-05T09:26:32.240 INFO:tasks.workunit.client.1.smithi134.stdout:0/784: symlink d13/d14/d30/d4b/d66/da0/l105 0 2023-12-05T09:26:32.243 INFO:tasks.workunit.client.0.smithi067.stdout:0/742: stat d3/d7/l1b 0 2023-12-05T09:26:32.244 INFO:tasks.workunit.client.1.smithi134.stdout:0/785: getdents d13/d14/d15/d2a/d8c 0 2023-12-05T09:26:32.244 INFO:tasks.workunit.client.1.smithi134.stdout:0/786: truncate d13/d14/d15/d2a/d8c/ff0 264595 0 2023-12-05T09:26:32.246 INFO:tasks.workunit.client.0.smithi067.stdout:9/826: dread d1b/d3e/f53 [0,4194304] 0 2023-12-05T09:26:32.246 INFO:tasks.workunit.client.0.smithi067.stdout:4/568: mknod d0/d1d/d2a/d93/da4/ccb 0 2023-12-05T09:26:32.249 INFO:tasks.workunit.client.0.smithi067.stdout:6/536: creat da/d10/d1e/d17/d2f/d2c/d34/fba x:0 0 0 2023-12-05T09:26:32.251 INFO:tasks.workunit.client.0.smithi067.stdout:6/537: read - da/d10/d1e/d17/d2f/d1f/d27/d45/fb0 zero size 2023-12-05T09:26:32.255 INFO:tasks.workunit.client.0.smithi067.stdout:1/635: link d2/d5/d7/de/d19/d8f/c77 d2/ddb/ce5 0 2023-12-05T09:26:32.256 INFO:tasks.workunit.client.1.smithi134.stdout:4/828: dwrite ff [8388608,4194304] 0 2023-12-05T09:26:32.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/630: mkdir d5/dc/d1a/d20/d2d/d8a/db5 0 2023-12-05T09:26:32.256 INFO:tasks.workunit.client.0.smithi067.stdout:8/631: chown d5/d3b/cb1 22446 1 2023-12-05T09:26:32.256 INFO:tasks.workunit.client.0.smithi067.stdout:3/545: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/lc0 0 2023-12-05T09:26:32.259 INFO:tasks.workunit.client.0.smithi067.stdout:5/632: rename db/c18 to db/df/d82/ce5 0 2023-12-05T09:26:32.260 INFO:tasks.workunit.client.0.smithi067.stdout:5/633: stat db/df/d35/dc8 0 2023-12-05T09:26:32.263 INFO:tasks.workunit.client.0.smithi067.stdout:0/743: creat d3/d7/df0/f108 x:0 0 0 2023-12-05T09:26:32.263 INFO:tasks.workunit.client.0.smithi067.stdout:0/744: chown d3/d7/d3c/d66 58 1 2023-12-05T09:26:32.267 INFO:tasks.workunit.client.0.smithi067.stdout:9/827: symlink d1b/dc2/l116 0 2023-12-05T09:26:32.271 INFO:tasks.workunit.client.1.smithi134.stdout:4/829: mkdir d16/d21/d48/d80/dae/d65/d121 0 2023-12-05T09:26:32.271 INFO:tasks.workunit.client.1.smithi134.stdout:4/830: chown d16/d7b/dce/d6e/daa/d3b/f5a 2 1 2023-12-05T09:26:32.272 INFO:tasks.workunit.client.0.smithi067.stdout:6/538: link da/d10/d1e/d69/f93 da/d10/d1e/d17/d2f/d2c/d34/d3b/fbb 0 2023-12-05T09:26:32.275 INFO:tasks.workunit.client.0.smithi067.stdout:8/632: creat d5/fb6 x:0 0 0 2023-12-05T09:26:32.276 INFO:tasks.workunit.client.1.smithi134.stdout:0/787: write d13/d14/d30/d4b/d23/f60 [432172,80679] 0 2023-12-05T09:26:32.276 INFO:tasks.workunit.client.1.smithi134.stdout:0/788: write d13/d14/d30/d4b/d23/f83 [9384145,2710] 0 2023-12-05T09:26:32.277 INFO:tasks.workunit.client.1.smithi134.stdout:2/868: dwrite d19/d3a/fa0 [0,4194304] 0 2023-12-05T09:26:32.277 INFO:tasks.workunit.client.1.smithi134.stdout:5/821: dwrite d0/d1a/d1c/d25/d4d/d9e/fed [0,4194304] 0 2023-12-05T09:26:32.277 INFO:tasks.workunit.client.1.smithi134.stdout:5/822: chown d0/d1a/d1c/d3f/d81/d8e/lae 3499 1 2023-12-05T09:26:32.278 INFO:tasks.workunit.client.0.smithi067.stdout:1/636: rmdir d2/d4f/d15/d60 39 2023-12-05T09:26:32.286 INFO:tasks.workunit.client.1.smithi134.stdout:2/869: dread d19/d28/d63/d70/f74 [0,4194304] 0 2023-12-05T09:26:32.303 INFO:tasks.workunit.client.0.smithi067.stdout:2/530: dwrite d0/d25/d34/d4a/f9a [0,4194304] 0 2023-12-05T09:26:32.313 INFO:tasks.workunit.client.0.smithi067.stdout:1/637: dwrite d2/f24 [0,4194304] 0 2023-12-05T09:26:32.313 INFO:tasks.workunit.client.0.smithi067.stdout:1/638: chown d2/d4f/d14/d48/f6b 2684984 1 2023-12-05T09:26:32.313 INFO:tasks.workunit.client.1.smithi134.stdout:4/831: creat d16/d7b/dce/d6e/daa/d3b/d8e/f122 x:0 0 0 2023-12-05T09:26:32.314 INFO:tasks.workunit.client.1.smithi134.stdout:4/832: dread - d16/d21/d48/d66/fbf zero size 2023-12-05T09:26:32.314 INFO:tasks.workunit.client.1.smithi134.stdout:4/833: chown d16/d7b/dce/d6e/daa/f8c 81 1 2023-12-05T09:26:32.314 INFO:tasks.workunit.client.1.smithi134.stdout:4/834: dread - d16/d18/dc5/fe4 zero size 2023-12-05T09:26:32.316 INFO:tasks.workunit.client.0.smithi067.stdout:3/546: mknod d9/da/d15/d17/d1a/d51/d70/cc1 0 2023-12-05T09:26:32.328 INFO:tasks.workunit.client.1.smithi134.stdout:9/822: write d7/d8/d14/d26/d7f/d92/f9d [5226858,128042] 0 2023-12-05T09:26:32.338 INFO:tasks.workunit.client.0.smithi067.stdout:3/547: write d9/da/d15/d17/f30 [2752932,25240] 0 2023-12-05T09:26:32.339 INFO:tasks.workunit.client.0.smithi067.stdout:3/548: fdatasync d9/da/d15/d17/d1a/d51/d66/d82/da1/fae 0 2023-12-05T09:26:32.345 INFO:tasks.workunit.client.0.smithi067.stdout:7/574: rename d0/d9/d10/f1a to d0/d9/d40/fbc 0 2023-12-05T09:26:32.346 INFO:tasks.workunit.client.0.smithi067.stdout:7/575: truncate d0/d9/d10/fb8 226418 0 2023-12-05T09:26:32.346 INFO:tasks.workunit.client.0.smithi067.stdout:7/576: write d0/f27 [1326268,8080] 0 2023-12-05T09:26:32.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/745: symlink d3/d7/d3c/d67/d59/deb/l109 0 2023-12-05T09:26:32.362 INFO:tasks.workunit.client.0.smithi067.stdout:8/633: link d5/da/f69 d5/dc/d1a/d20/d2d/d41/db2/fb7 0 2023-12-05T09:26:32.362 INFO:tasks.workunit.client.0.smithi067.stdout:8/634: write d5/dc/fac [580503,118877] 0 2023-12-05T09:26:32.363 INFO:tasks.workunit.client.1.smithi134.stdout:0/789: mknod d13/d14/d30/d4b/d66/da0/daf/db2/c106 0 2023-12-05T09:26:32.364 INFO:tasks.workunit.client.0.smithi067.stdout:7/577: dread d0/f4c [0,4194304] 0 2023-12-05T09:26:32.364 INFO:tasks.workunit.client.0.smithi067.stdout:7/578: fdatasync d0/d9/d3f/f7e 0 2023-12-05T09:26:32.371 INFO:tasks.workunit.client.0.smithi067.stdout:2/531: creat d0/d25/d9d/d63/fb7 x:0 0 0 2023-12-05T09:26:32.375 INFO:tasks.workunit.client.0.smithi067.stdout:1/639: creat d2/d5/d7/de/fe6 x:0 0 0 2023-12-05T09:26:32.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:32 smithi134 ceph-mon[116304]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:32.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:32 smithi134 ceph-mon[116304]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 161 MiB/s rd, 206 MiB/s wr, 291 op/s 2023-12-05T09:26:32.378 INFO:tasks.workunit.client.1.smithi134.stdout:2/870: readlink l11 0 2023-12-05T09:26:32.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.380+0000 7f24ea607700 1 -- 172.21.15.67:0/2107643386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24e40fcbf0 msgr2=0x7f24e40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:32.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.380+0000 7f24ea607700 1 --2- 172.21.15.67:0/2107643386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24e40fcbf0 0x7f24e40fd000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f24d4004940 tx=0x7f24d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:32.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.382+0000 7f24ea607700 1 -- 172.21.15.67:0/2107643386 shutdown_connections 2023-12-05T09:26:32.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.382+0000 7f24ea607700 1 --2- 172.21.15.67:0/2107643386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e40fde00 0x7f24e40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.382+0000 7f24ea607700 1 --2- 172.21.15.67:0/2107643386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24e40fcbf0 0x7f24e40fd000 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.382+0000 7f24ea607700 1 -- 172.21.15.67:0/2107643386 >> 172.21.15.67:0/2107643386 conn(0x7f24e40f82d0 msgr2=0x7f24e40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:32.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.383+0000 7f24ea607700 1 -- 172.21.15.67:0/2107643386 shutdown_connections 2023-12-05T09:26:32.383 INFO:tasks.workunit.client.1.smithi134.stdout:0/790: write d13/d14/d15/d93/ff4 [1685172,39941] 0 2023-12-05T09:26:32.383 INFO:tasks.workunit.client.1.smithi134.stdout:0/791: dread - d13/d14/d30/d4b/d23/f95 zero size 2023-12-05T09:26:32.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.383+0000 7f24ea607700 1 -- 172.21.15.67:0/2107643386 wait complete. 2023-12-05T09:26:32.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.384+0000 7f24ea607700 1 Processor -- start 2023-12-05T09:26:32.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.385+0000 7f24ea607700 1 -- start start 2023-12-05T09:26:32.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.385+0000 7f24ea607700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e40fcbf0 0x7f24e40714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:32.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.386+0000 7f24e3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e40fcbf0 0x7f24e40714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:32.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.386+0000 7f24e3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e40fcbf0 0x7f24e40714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:48106/0 (socket says 172.21.15.67:48106) 2023-12-05T09:26:32.386 INFO:tasks.workunit.client.0.smithi067.stdout:7/579: read d0/d9/d10/d37/d38/d64/d34/f36 [2452453,18365] 0 2023-12-05T09:26:32.386 INFO:tasks.workunit.client.0.smithi067.stdout:7/580: chown d0/f27 3268 1 2023-12-05T09:26:32.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.387+0000 7f24ea607700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24e40fde00 0x7f24e40719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:32.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.387+0000 7f24ea607700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e406ffd0 con 0x7f24e40fde00 2023-12-05T09:26:32.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.387+0000 7f24ea607700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e4070110 con 0x7f24e40fcbf0 2023-12-05T09:26:32.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.387+0000 7f24e3fff700 1 -- 172.21.15.67:0/2565614957 learned_addr learned my addr 172.21.15.67:0/2565614957 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:26:32.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.388+0000 7f24e37fe700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24e40fde00 0x7f24e40719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:32.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.389+0000 7f24e3fff700 1 -- 172.21.15.67:0/2565614957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24e40fde00 msgr2=0x7f24e40719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:32.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.389+0000 7f24e3fff700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24e40fde00 0x7f24e40719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.389+0000 7f24e3fff700 1 -- 172.21.15.67:0/2565614957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4005040 con 0x7f24e40fcbf0 2023-12-05T09:26:32.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.390+0000 7f24e3fff700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e40fcbf0 0x7f24e40714a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f24d400bbd0 tx=0x7f24d4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:32.391 INFO:tasks.workunit.client.0.smithi067.stdout:3/549: creat d9/da/d15/d17/fc2 x:0 0 0 2023-12-05T09:26:32.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.392+0000 7f24e0ff9700 1 -- 172.21.15.67:0/2565614957 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24d400e070 con 0x7f24e40fcbf0 2023-12-05T09:26:32.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.392+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e4070340 con 0x7f24e40fcbf0 2023-12-05T09:26:32.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.392+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e4070880 con 0x7f24e40fcbf0 2023-12-05T09:26:32.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.392+0000 7f24e0ff9700 1 -- 172.21.15.67:0/2565614957 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f24d40093b0 con 0x7f24e40fcbf0 2023-12-05T09:26:32.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.392+0000 7f24e0ff9700 1 -- 172.21.15.67:0/2565614957 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24d401c840 con 0x7f24e40fcbf0 2023-12-05T09:26:32.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.395+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d00052e0 con 0x7f24e40fcbf0 2023-12-05T09:26:32.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.398+0000 7f24e0ff9700 1 -- 172.21.15.67:0/2565614957 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f24d4013600 con 0x7f24e40fcbf0 2023-12-05T09:26:32.399 INFO:tasks.workunit.client.0.smithi067.stdout:7/581: write d0/d9/d10/d37/d38/d64/d54/f5e [4511483,101534] 0 2023-12-05T09:26:32.400 INFO:tasks.workunit.client.0.smithi067.stdout:4/569: rename d0/d1d/d25/d38/c61 to d0/d1d/d25/d2c/d34/d4e/daa/ccc 0 2023-12-05T09:26:32.400 INFO:tasks.workunit.client.1.smithi134.stdout:5/823: rmdir d0/d1a/d1c/d25/d4d/d9e 39 2023-12-05T09:26:32.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.401+0000 7f24e0ff9700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f24cc06ae90 0x7f24cc06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:26:32.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.401+0000 7f24e0ff9700 1 -- 172.21.15.67:0/2565614957 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f24d408b1b0 con 0x7f24e40fcbf0 2023-12-05T09:26:32.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.402+0000 7f24e37fe700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f24cc06ae90 0x7f24cc06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:26:32.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.403+0000 7f24e37fe700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f24cc06ae90 0x7f24cc06d340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f24d8004d60 tx=0x7f24d800b040 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:26:32.404 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.405+0000 7f24e0ff9700 1 -- 172.21.15.67:0/2565614957 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f24d40554d0 con 0x7f24e40fcbf0 2023-12-05T09:26:32.405 INFO:tasks.workunit.client.1.smithi134.stdout:2/871: creat d19/d76/db9/f11d x:0 0 0 2023-12-05T09:26:32.410 INFO:tasks.workunit.client.1.smithi134.stdout:0/792: creat d13/d14/d30/d4b/dc1/df8/f107 x:0 0 0 2023-12-05T09:26:32.412 INFO:tasks.workunit.client.1.smithi134.stdout:7/806: rename d2/d7/dc/d2e/fdf to d2/d7/d93/dcf/dd0/f10a 0 2023-12-05T09:26:32.412 INFO:tasks.workunit.client.0.smithi067.stdout:5/634: dwrite db/df/d1a/d1d/d20/f8f [0,4194304] 0 2023-12-05T09:26:32.413 INFO:tasks.workunit.client.0.smithi067.stdout:0/746: mkdir d3/d6b/d10a 0 2023-12-05T09:26:32.413 INFO:tasks.workunit.client.0.smithi067.stdout:6/539: getdents da/d10/d1e/d17/d2f/d72 0 2023-12-05T09:26:32.413 INFO:tasks.workunit.client.0.smithi067.stdout:3/550: fsync d9/da/f6c 0 2023-12-05T09:26:32.413 INFO:tasks.workunit.client.0.smithi067.stdout:9/828: mknod d1b/d25/d35/d56/dee/c117 0 2023-12-05T09:26:32.414 INFO:tasks.workunit.client.1.smithi134.stdout:7/807: chown d2/d7/d2b/d2d/d67 25 1 2023-12-05T09:26:32.414 INFO:tasks.workunit.client.1.smithi134.stdout:7/808: chown d2/d7/dc/d22 330 1 2023-12-05T09:26:32.414 INFO:tasks.workunit.client.0.smithi067.stdout:6/540: truncate da/d10/d1e/d17/d2f/d72/f97 1185969 0 2023-12-05T09:26:32.414 INFO:tasks.workunit.client.0.smithi067.stdout:0/747: creat d3/d7/d3c/d67/da1/f10b x:0 0 0 2023-12-05T09:26:32.417 INFO:tasks.workunit.client.0.smithi067.stdout:8/635: dwrite d5/f6b [0,4194304] 0 2023-12-05T09:26:32.419 INFO:tasks.workunit.client.1.smithi134.stdout:7/809: dread d2/d7/d6f/da0/fd4 [0,4194304] 0 2023-12-05T09:26:32.421 INFO:tasks.workunit.client.0.smithi067.stdout:3/551: mknod d9/da/d15/cc3 0 2023-12-05T09:26:32.421 INFO:tasks.workunit.client.0.smithi067.stdout:3/552: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/fc4 x:0 0 0 2023-12-05T09:26:32.421 INFO:tasks.workunit.client.1.smithi134.stdout:7/810: truncate d2/d7/dc/d2e/f4c 2106021 0 2023-12-05T09:26:32.425 INFO:tasks.workunit.client.1.smithi134.stdout:7/811: mkdir d2/d7/d2b/dd9/d10b 0 2023-12-05T09:26:32.425 INFO:tasks.workunit.client.1.smithi134.stdout:7/812: read - d2/d7/dc/d2e/d3a/fe2 zero size 2023-12-05T09:26:32.432 INFO:tasks.workunit.client.0.smithi067.stdout:1/640: dread d2/f39 [0,4194304] 0 2023-12-05T09:26:32.434 INFO:tasks.workunit.client.0.smithi067.stdout:7/582: dread d0/f76 [0,4194304] 0 2023-12-05T09:26:32.434 INFO:tasks.workunit.client.0.smithi067.stdout:7/583: dread - d0/d9/d40/d7a/fa3 zero size 2023-12-05T09:26:32.441 INFO:tasks.workunit.client.0.smithi067.stdout:7/584: mkdir d0/d9/d3f/dbd 0 2023-12-05T09:26:32.445 INFO:tasks.workunit.client.0.smithi067.stdout:3/553: symlink d9/lc5 0 2023-12-05T09:26:32.446 INFO:tasks.workunit.client.0.smithi067.stdout:2/532: dwrite d0/d25/d3a/fb1 [0,4194304] 0 2023-12-05T09:26:32.446 INFO:tasks.workunit.client.0.smithi067.stdout:9/829: dread d1b/d25/d54/d5c/d81/d96/fe6 [0,4194304] 0 2023-12-05T09:26:32.446 INFO:tasks.workunit.client.0.smithi067.stdout:9/830: readlink d1b/d25/d54/lde 0 2023-12-05T09:26:32.447 INFO:tasks.workunit.client.0.smithi067.stdout:8/636: dread d5/dc/d1a/d20/d58/f8f [0,4194304] 0 2023-12-05T09:26:32.449 INFO:tasks.workunit.client.1.smithi134.stdout:7/813: dread d2/d7/dc/d2e/d3a/f49 [0,4194304] 0 2023-12-05T09:26:32.449 INFO:tasks.workunit.client.1.smithi134.stdout:7/814: fdatasync d2/d7/dc/d2e/d3a/fee 0 2023-12-05T09:26:32.450 INFO:tasks.workunit.client.0.smithi067.stdout:6/541: rename da/d10/d1e/d17/d2f/d1f/d27/d45 to da/d10/d1e/d17/d2f/dbc 0 2023-12-05T09:26:32.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/815: creat d2/d7/d2b/dd9/df8/d103/f10c x:0 0 0 2023-12-05T09:26:32.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/816: write d2/d7/dc/d2e/d3a/f5e [4123541,122764] 0 2023-12-05T09:26:32.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/817: chown d2/d7/dc/d2e/f4c 22 1 2023-12-05T09:26:32.455 INFO:tasks.workunit.client.1.smithi134.stdout:7/818: fsync d2/dd/fc8 0 2023-12-05T09:26:32.459 INFO:tasks.workunit.client.1.smithi134.stdout:7/819: rmdir d2/d7/d2b/dd9 39 2023-12-05T09:26:32.461 INFO:tasks.workunit.client.0.smithi067.stdout:2/533: unlink d0/d25/d34/f6a 0 2023-12-05T09:26:32.461 INFO:tasks.workunit.client.0.smithi067.stdout:5/635: dwrite db/df/d1a/d1d/d20/fe2 [0,4194304] 0 2023-12-05T09:26:32.461 INFO:tasks.workunit.client.0.smithi067.stdout:2/534: write d0/d25/d9d/f76 [984807,15769] 0 2023-12-05T09:26:32.461 INFO:tasks.workunit.client.0.smithi067.stdout:2/535: chown d0/d2f/c45 9114 1 2023-12-05T09:26:32.462 INFO:tasks.workunit.client.0.smithi067.stdout:9/831: creat d1b/d25/f118 x:0 0 0 2023-12-05T09:26:32.463 INFO:tasks.workunit.client.1.smithi134.stdout:7/820: rmdir d2/d7/d93/dcf/dd0 39 2023-12-05T09:26:32.465 INFO:tasks.workunit.client.0.smithi067.stdout:8/637: unlink d5/dc/d1a/d20/d2d/d41/db2/lb4 0 2023-12-05T09:26:32.471 INFO:tasks.workunit.client.0.smithi067.stdout:6/542: getdents da/d10/d1e/d17/d2f/d1f/d9e 0 2023-12-05T09:26:32.479 INFO:tasks.workunit.client.0.smithi067.stdout:0/748: rename d3/d7/d3c/d6c/f92 to d3/d7/d3c/d6c/d76/da7/dec/d10/f10c 0 2023-12-05T09:26:32.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/821: dread d2/dd/d1a/f23 [0,4194304] 0 2023-12-05T09:26:32.479 INFO:tasks.workunit.client.1.smithi134.stdout:2/872: rmdir d19/d28/d31/d38 39 2023-12-05T09:26:32.480 INFO:tasks.workunit.client.1.smithi134.stdout:7/822: getdents d2/d7/d6f/da0 0 2023-12-05T09:26:32.481 INFO:tasks.workunit.client.0.smithi067.stdout:7/585: write d0/d9/d10/d37/f28 [4631369,80270] 0 2023-12-05T09:26:32.485 INFO:tasks.workunit.client.0.smithi067.stdout:3/554: dwrite d9/f27 [0,4194304] 0 2023-12-05T09:26:32.485 INFO:tasks.workunit.client.0.smithi067.stdout:3/555: read - d9/da/d15/d17/d1a/d51/d66/d82/da1/fc4 zero size 2023-12-05T09:26:32.487 INFO:tasks.workunit.client.1.smithi134.stdout:0/793: link d13/d14/d30/d4b/d66/da0/daf/dce/d78/lec d13/d14/d30/d4b/d66/da0/daf/dde/df6/l108 0 2023-12-05T09:26:32.496 INFO:tasks.workunit.client.0.smithi067.stdout:5/636: mknod db/ce6 0 2023-12-05T09:26:32.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/570: dwrite d0/d1d/d53/fa2 [0,4194304] 0 2023-12-05T09:26:32.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/571: dread - d0/d1d/d2b/f69 zero size 2023-12-05T09:26:32.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/572: readlink d0/l87 0 2023-12-05T09:26:32.505 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:32 smithi067 ceph-mon[107174]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:32.505 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:32 smithi067 ceph-mon[107174]: pgmap v31: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 161 MiB/s rd, 206 MiB/s wr, 291 op/s 2023-12-05T09:26:32.506 INFO:tasks.workunit.client.0.smithi067.stdout:2/536: mkdir d0/d25/d34/d4a/db8 0 2023-12-05T09:26:32.515 INFO:tasks.workunit.client.0.smithi067.stdout:4/573: dread d0/d9/f2f [0,4194304] 0 2023-12-05T09:26:32.518 INFO:tasks.workunit.client.0.smithi067.stdout:5/637: dread db/df/f15 [0,4194304] 0 2023-12-05T09:26:32.524 INFO:tasks.workunit.client.1.smithi134.stdout:8/919: sync 2023-12-05T09:26:32.524 INFO:tasks.workunit.client.1.smithi134.stdout:6/770: sync 2023-12-05T09:26:32.526 INFO:tasks.workunit.client.1.smithi134.stdout:0/794: creat d13/d14/d30/d4b/d66/da0/daf/dce/f109 x:0 0 0 2023-12-05T09:26:32.527 INFO:tasks.workunit.client.1.smithi134.stdout:8/920: symlink da/de/d11/d8b/d8c/d10b/l138 0 2023-12-05T09:26:32.527 INFO:tasks.workunit.client.1.smithi134.stdout:8/921: write da/de/d8a/d42/d99/d106/f131 [828076,2777] 0 2023-12-05T09:26:32.532 INFO:tasks.workunit.client.0.smithi067.stdout:2/537: write d0/d25/f8b [4123201,117104] 0 2023-12-05T09:26:32.533 INFO:tasks.workunit.client.0.smithi067.stdout:8/638: symlink d5/dc/d1a/d20/d58/lb8 0 2023-12-05T09:26:32.533 INFO:tasks.workunit.client.0.smithi067.stdout:8/639: write d5/f14 [4199478,3373] 0 2023-12-05T09:26:32.533 INFO:tasks.workunit.client.0.smithi067.stdout:8/640: truncate d5/dc/d1a/d20/d3e/f7a 287185 0 2023-12-05T09:26:32.535 INFO:tasks.workunit.client.1.smithi134.stdout:8/922: unlink da/de/d8a/d42/d99/dc8/d72/c113 0 2023-12-05T09:26:32.536 INFO:tasks.workunit.client.1.smithi134.stdout:8/923: write da/f89 [603032,115595] 0 2023-12-05T09:26:32.536 INFO:tasks.workunit.client.1.smithi134.stdout:8/924: truncate da/de/d16/d33/fd4 482725 0 2023-12-05T09:26:32.539 INFO:tasks.workunit.client.0.smithi067.stdout:0/749: fdatasync d3/d7/d3c/d6c/d76/da7/dec/f3e 0 2023-12-05T09:26:32.540 INFO:tasks.workunit.client.1.smithi134.stdout:2/873: dwrite d19/d28/d31/d38/fce [0,4194304] 0 2023-12-05T09:26:32.552 INFO:tasks.workunit.client.1.smithi134.stdout:0/795: write d13/d14/d15/d2a/f4a [547341,91568] 0 2023-12-05T09:26:32.552 INFO:tasks.workunit.client.1.smithi134.stdout:0/796: creat d13/d14/d30/d4b/d66/da0/daf/dce/d86/f10a x:0 0 0 2023-12-05T09:26:32.552 INFO:tasks.workunit.client.1.smithi134.stdout:0/797: chown d13/d14/d15/fc8 98463 1 2023-12-05T09:26:32.554 INFO:tasks.workunit.client.1.smithi134.stdout:6/771: dwrite d4/d39/d42/d4f/d6d/d3a/d75/d86/faf [0,4194304] 0 2023-12-05T09:26:32.565 INFO:tasks.workunit.client.0.smithi067.stdout:1/641: rename d2/d5/d7/d6a/da5 to d2/d4f/d15/d74/de7 0 2023-12-05T09:26:32.565 INFO:tasks.workunit.client.0.smithi067.stdout:1/642: fsync d2/d3/da6/dbb/fe0 0 2023-12-05T09:26:32.579 INFO:tasks.workunit.client.0.smithi067.stdout:3/556: link d9/da/d15/d17/f3a d9/da/d3b/fc6 0 2023-12-05T09:26:32.584 INFO:tasks.workunit.client.0.smithi067.stdout:3/557: write d9/da/d3b/f6b [242804,114979] 0 2023-12-05T09:26:32.590 INFO:tasks.workunit.client.1.smithi134.stdout:0/798: mknod d13/d14/d15/dee/c10b 0 2023-12-05T09:26:32.605 INFO:tasks.workunit.client.0.smithi067.stdout:0/750: dwrite d3/d7/d3c/d67/d59/d5c/ff1 [0,4194304] 0 2023-12-05T09:26:32.617 INFO:tasks.workunit.client.1.smithi134.stdout:6/772: truncate d4/d39/d42/d4f/d6d/d9f/fc6 706931 0 2023-12-05T09:26:32.618 INFO:tasks.workunit.client.0.smithi067.stdout:9/832: dwrite d1b/d3e/d7f/f95 [0,4194304] 0 2023-12-05T09:26:32.619 INFO:tasks.workunit.client.1.smithi134.stdout:0/799: truncate d13/f38 3022424 0 2023-12-05T09:26:32.622 INFO:tasks.workunit.client.0.smithi067.stdout:4/574: creat d0/d1d/d25/d2c/d34/fcd x:0 0 0 2023-12-05T09:26:32.627 INFO:tasks.workunit.client.0.smithi067.stdout:8/641: mkdir d5/dc/d1a/d20/d2d/d7f/d94/da3/db9 0 2023-12-05T09:26:32.627 INFO:tasks.workunit.client.0.smithi067.stdout:8/642: write d5/d3b/f3d [628992,8565] 0 2023-12-05T09:26:32.629 INFO:tasks.workunit.client.0.smithi067.stdout:1/643: symlink d2/d4f/d14/d20/le8 0 2023-12-05T09:26:32.630 INFO:tasks.workunit.client.0.smithi067.stdout:6/543: rename da/d10/d1e/d51/la3 to da/d10/d1e/d17/d2f/d1f/d27/d4f/lbd 0 2023-12-05T09:26:32.630 INFO:tasks.workunit.client.0.smithi067.stdout:6/544: truncate da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/f66 1154555 0 2023-12-05T09:26:32.631 INFO:tasks.workunit.client.0.smithi067.stdout:3/558: rmdir d9/da/d15/d17/d1a/d51 39 2023-12-05T09:26:32.631 INFO:tasks.workunit.client.0.smithi067.stdout:3/559: fsync f6 0 2023-12-05T09:26:32.635 INFO:tasks.workunit.client.0.smithi067.stdout:0/751: symlink d3/d7/d3c/d6c/d76/da7/dec/d10/l10d 0 2023-12-05T09:26:32.636 INFO:tasks.workunit.client.0.smithi067.stdout:0/752: write d3/f3b [489482,55583] 0 2023-12-05T09:26:32.639 INFO:tasks.workunit.client.0.smithi067.stdout:9/833: truncate d1b/dd3/d82/fb2 3306561 0 2023-12-05T09:26:32.639 INFO:tasks.workunit.client.0.smithi067.stdout:9/834: fdatasync d1b/f20 0 2023-12-05T09:26:32.639 INFO:tasks.workunit.client.0.smithi067.stdout:9/835: creat d1b/dd3/d6c/d76/f119 x:0 0 0 2023-12-05T09:26:32.641 INFO:tasks.workunit.client.0.smithi067.stdout:4/575: mknod d0/d1d/d53/da8/da9/d15/cce 0 2023-12-05T09:26:32.641 INFO:tasks.workunit.client.0.smithi067.stdout:4/576: dread - d0/d1d/d2b/f69 zero size 2023-12-05T09:26:32.667 INFO:tasks.workunit.client.1.smithi134.stdout:0/800: dwrite d13/d14/d30/d4b/d66/da0/fa1 [0,4194304] 0 2023-12-05T09:26:32.667 INFO:tasks.workunit.client.1.smithi134.stdout:0/801: chown d13/d14/d30/d4b/d66/da0/daf/dce/d78/f97 66 1 2023-12-05T09:26:32.667 INFO:tasks.workunit.client.1.smithi134.stdout:0/802: fdatasync d13/d14/d30/d4b/d66/da0/daf/dde/d9d/fc7 0 2023-12-05T09:26:32.667 INFO:tasks.workunit.client.1.smithi134.stdout:0/803: creat d13/d14/d30/d4b/d66/da0/daf/dce/d86/f10c x:0 0 0 2023-12-05T09:26:32.684 INFO:tasks.workunit.client.0.smithi067.stdout:8/643: mkdir d5/dc/d1a/d20/d58/d90/dba 0 2023-12-05T09:26:32.684 INFO:tasks.workunit.client.1.smithi134.stdout:5/824: getdents d0/d11/d61/d107 0 2023-12-05T09:26:32.706 INFO:tasks.workunit.client.0.smithi067.stdout:1/644: creat d2/d4f/d54/d70/fe9 x:0 0 0 2023-12-05T09:26:32.711 INFO:tasks.workunit.client.0.smithi067.stdout:2/538: rename d0/d25/d9d/d53/d1e/d7f/fa1 to d0/d2f/fb9 0 2023-12-05T09:26:32.712 INFO:tasks.workunit.client.1.smithi134.stdout:5/825: mkdir d0/d1a/d1c/d25/d4d/d9e/deb/d11e 0 2023-12-05T09:26:32.713 INFO:tasks.workunit.client.0.smithi067.stdout:6/545: mkdir da/d10/d1e/d17/d2f/d59/d6c/dbe 0 2023-12-05T09:26:32.717 INFO:tasks.workunit.client.1.smithi134.stdout:0/804: getdents d13/d14/d30/d4b/d66/da0/daf/dde/d9d/da5 0 2023-12-05T09:26:32.721 INFO:tasks.workunit.client.0.smithi067.stdout:3/560: link d9/da/d15/d17/d2b/f3e d9/da/d15/d17/d1a/d51/fc7 0 2023-12-05T09:26:32.725 INFO:tasks.workunit.client.1.smithi134.stdout:3/855: rename d4/d5/d6f/d97/dae/dc9/f70 to d4/d1f/d4e/d6a/f10c 0 2023-12-05T09:26:32.728 INFO:tasks.workunit.client.1.smithi134.stdout:5/826: truncate d0/fcc 14272 0 2023-12-05T09:26:32.728 INFO:tasks.workunit.client.0.smithi067.stdout:4/577: mkdir d0/d1d/d2a/d93/dbd/dcf 0 2023-12-05T09:26:32.728 INFO:tasks.workunit.client.0.smithi067.stdout:4/578: chown d0/d1d/d25/d2c/d34/d4e/daa/c77 0 1 2023-12-05T09:26:32.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/964: rename d2/l21 to d2/d27/d9d/l15c 0 2023-12-05T09:26:32.730 INFO:tasks.workunit.client.1.smithi134.stdout:0/805: dread f8 [0,4194304] 0 2023-12-05T09:26:32.730 INFO:tasks.workunit.client.1.smithi134.stdout:0/806: stat d13/d14/d30/f3a 0 2023-12-05T09:26:32.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/965: fsync d2/d27/d9d/fed 0 2023-12-05T09:26:32.730 INFO:tasks.workunit.client.1.smithi134.stdout:0/807: write d13/d14/d15/d67/f7a [695600,42220] 0 2023-12-05T09:26:32.731 INFO:tasks.workunit.client.1.smithi134.stdout:5/827: symlink d0/d1a/d1c/d3f/d5b/d5d/d78/l11f 0 2023-12-05T09:26:32.732 INFO:tasks.workunit.client.1.smithi134.stdout:1/966: mknod d2/d9/d8d/c15d 0 2023-12-05T09:26:32.732 INFO:tasks.workunit.client.1.smithi134.stdout:1/967: chown d2/d7e/f10f 465553719 1 2023-12-05T09:26:32.732 INFO:tasks.workunit.client.1.smithi134.stdout:1/968: chown d2/d9/d10/d94/fd9 800 1 2023-12-05T09:26:32.732 INFO:tasks.workunit.client.0.smithi067.stdout:1/645: symlink d2/d4f/d14/d20/d83/lea 0 2023-12-05T09:26:32.733 INFO:tasks.workunit.client.1.smithi134.stdout:4/835: rename d16/d21/d48/laf to d16/d21/d48/d80/l123 0 2023-12-05T09:26:32.735 INFO:tasks.workunit.client.1.smithi134.stdout:9/823: rename d7/d8/d14/d26/d7f/d92/d53/d7b to d7/dee/d114 0 2023-12-05T09:26:32.738 INFO:tasks.workunit.client.1.smithi134.stdout:8/925: rename da/de/d11/d8b/cd5 to da/de/d11/d1d/d5f/dea/d119/c139 0 2023-12-05T09:26:32.738 INFO:tasks.workunit.client.0.smithi067.stdout:2/539: truncate d0/fd 2771659 0 2023-12-05T09:26:32.740 INFO:tasks.workunit.client.1.smithi134.stdout:8/926: creat da/de/d11/d1d/f13a x:0 0 0 2023-12-05T09:26:32.740 INFO:tasks.workunit.client.1.smithi134.stdout:1/969: dread d2/d9/d10/d30/d4a/f9a [0,4194304] 0 2023-12-05T09:26:32.741 INFO:tasks.workunit.client.1.smithi134.stdout:0/808: symlink d13/d14/d30/d4b/d66/da0/daf/db2/l10d 0 2023-12-05T09:26:32.743 INFO:tasks.workunit.client.0.smithi067.stdout:0/753: rename d3/f1d to d3/d7/d3c/d67/d59/d4e/d94/f10e 0 2023-12-05T09:26:32.743 INFO:tasks.workunit.client.0.smithi067.stdout:0/754: chown d3/d7/d3c/d67/d59/d4e/d94/lad 2 1 2023-12-05T09:26:32.743 INFO:tasks.workunit.client.0.smithi067.stdout:0/755: fsync d3/d7/d3c/d6c/d76/da7/dec/d10/dd2/fb9 0 2023-12-05T09:26:32.744 INFO:tasks.workunit.client.1.smithi134.stdout:1/970: symlink d2/d9/d10/d5b/dc4/l15e 0 2023-12-05T09:26:32.744 INFO:tasks.workunit.client.1.smithi134.stdout:1/971: stat d2/d27/d40/f10c 0 2023-12-05T09:26:32.745 INFO:tasks.workunit.client.0.smithi067.stdout:6/546: symlink da/d10/d1e/d17/d2f/d3f/lbf 0 2023-12-05T09:26:32.745 INFO:tasks.workunit.client.0.smithi067.stdout:3/561: read d9/d62/f8f [2986111,78499] 0 2023-12-05T09:26:32.746 INFO:tasks.workunit.client.1.smithi134.stdout:4/836: getdents d16/d7b/dce/d6e/daa/d3b/d8e 0 2023-12-05T09:26:32.747 INFO:tasks.workunit.client.1.smithi134.stdout:1/972: link d2/d9/d10/d30/d66/d9b/l9e d2/d9/l15f 0 2023-12-05T09:26:32.747 INFO:tasks.workunit.client.1.smithi134.stdout:1/973: chown d2/d9/d10/d30/d66/da9/d74/d125 0 1 2023-12-05T09:26:32.747 INFO:tasks.workunit.client.0.smithi067.stdout:4/579: truncate d0/d1d/d25/d38/f49 1886764 0 2023-12-05T09:26:32.748 INFO:tasks.workunit.client.1.smithi134.stdout:0/809: symlink d13/d14/d30/d4b/d66/da0/daf/dce/d103/l10e 0 2023-12-05T09:26:32.749 INFO:tasks.workunit.client.0.smithi067.stdout:1/646: link d2/d5/d7/d6a/db7/cc4 d2/d4f/d14/d20/d4c/ceb 0 2023-12-05T09:26:32.749 INFO:tasks.workunit.client.0.smithi067.stdout:2/540: stat d0/d25/d9d/c22 0 2023-12-05T09:26:32.751 INFO:tasks.workunit.client.1.smithi134.stdout:0/810: mknod d13/d14/d30/d4b/d66/da0/daf/dce/d7d/c10f 0 2023-12-05T09:26:32.751 INFO:tasks.workunit.client.0.smithi067.stdout:0/756: symlink d3/d6b/d10a/l10f 0 2023-12-05T09:26:32.753 INFO:tasks.workunit.client.0.smithi067.stdout:3/562: symlink d9/da/d15/d17/d1a/lc8 0 2023-12-05T09:26:32.753 INFO:tasks.workunit.client.0.smithi067.stdout:3/563: fdatasync d9/d49/f9f 0 2023-12-05T09:26:32.755 INFO:tasks.workunit.client.1.smithi134.stdout:0/811: link d13/d14/d15/d2a/f49 d13/d14/d30/d4b/d66/da0/daf/dce/d7d/f110 0 2023-12-05T09:26:32.757 INFO:tasks.workunit.client.1.smithi134.stdout:5/828: dread d0/d1a/d1c/d3f/d5b/d5d/f86 [4194304,4194304] 0 2023-12-05T09:26:32.757 INFO:tasks.workunit.client.0.smithi067.stdout:4/580: mkdir d0/d1d/d53/da8/da9/d15/dd0 0 2023-12-05T09:26:32.757 INFO:tasks.workunit.client.0.smithi067.stdout:4/581: creat d0/d1d/d4d/fd1 x:0 0 0 2023-12-05T09:26:32.758 INFO:tasks.workunit.client.1.smithi134.stdout:8/927: write da/de/d16/d2d/f5e [1564394,90660] 0 2023-12-05T09:26:32.759 INFO:tasks.workunit.client.1.smithi134.stdout:1/974: dread d2/d9/d10/d30/d66/d9b/f117 [0,4194304] 0 2023-12-05T09:26:32.760 INFO:tasks.workunit.client.1.smithi134.stdout:5/829: creat d0/d1a/d1c/d3f/d5b/d5d/d78/db3/f120 x:0 0 0 2023-12-05T09:26:32.760 INFO:tasks.workunit.client.1.smithi134.stdout:5/830: write d0/dd/f51 [660108,22536] 0 2023-12-05T09:26:32.760 INFO:tasks.workunit.client.0.smithi067.stdout:1/647: truncate d2/d5/f6f 1521813 0 2023-12-05T09:26:32.765 INFO:tasks.workunit.client.1.smithi134.stdout:1/975: truncate d2/d9/d10/d30/d66/da9/d74/f7b 4037898 0 2023-12-05T09:26:32.765 INFO:tasks.workunit.client.1.smithi134.stdout:1/976: dread - d2/d9/d8d/da2/db1/f133 zero size 2023-12-05T09:26:32.765 INFO:tasks.workunit.client.1.smithi134.stdout:5/831: truncate d0/d1a/d3a/f47 3551020 0 2023-12-05T09:26:32.765 INFO:tasks.workunit.client.1.smithi134.stdout:4/837: write f13 [2170788,100605] 0 2023-12-05T09:26:32.765 INFO:tasks.workunit.client.1.smithi134.stdout:4/838: write d16/d18/dc5/dc2/ffe [4884775,18296] 0 2023-12-05T09:26:32.765 INFO:tasks.workunit.client.1.smithi134.stdout:4/839: fsync d16/d21/d48/d80/dae/d65/fdb 0 2023-12-05T09:26:32.767 INFO:tasks.workunit.client.0.smithi067.stdout:2/541: symlink d0/d25/d9d/d63/d88/lba 0 2023-12-05T09:26:32.770 INFO:tasks.workunit.client.0.smithi067.stdout:2/542: write d0/d25/d3f/d83/fad [397415,39068] 0 2023-12-05T09:26:32.773 INFO:tasks.workunit.client.0.smithi067.stdout:0/757: dread d3/d7/d3c/d6c/d76/da7/dec/d10/f1f [0,4194304] 0 2023-12-05T09:26:32.773 INFO:tasks.workunit.client.0.smithi067.stdout:0/758: stat d3/d7 0 2023-12-05T09:26:32.777 INFO:tasks.workunit.client.0.smithi067.stdout:3/564: rename d9/da/d15/d17/d1a/d51/d70/f8b to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/fc9 0 2023-12-05T09:26:32.780 INFO:tasks.workunit.client.1.smithi134.stdout:3/856: dwrite d4/d1f/f40 [0,4194304] 0 2023-12-05T09:26:32.794 INFO:tasks.workunit.client.1.smithi134.stdout:4/840: creat d16/d21/f124 x:0 0 0 2023-12-05T09:26:32.801 INFO:tasks.workunit.client.0.smithi067.stdout:3/565: read d9/da/d15/d17/d1a/d51/d66/d82/fb4 [2713676,98170] 0 2023-12-05T09:26:32.801 INFO:tasks.workunit.client.0.smithi067.stdout:3/566: write d9/da/d15/d17/d2b/fa9 [340356,25580] 0 2023-12-05T09:26:32.801 INFO:tasks.workunit.client.0.smithi067.stdout:3/567: write d9/da/d3b/f6b [1335720,87940] 0 2023-12-05T09:26:32.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/841: creat d16/d18/d1b/f125 x:0 0 0 2023-12-05T09:26:32.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/842: chown d16/d21/d48/d80/l123 27168829 1 2023-12-05T09:26:32.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/843: creat d16/d7b/db6/dbc/f126 x:0 0 0 2023-12-05T09:26:32.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/844: chown d16/d18/d1b/c100 4 1 2023-12-05T09:26:32.806 INFO:tasks.workunit.client.0.smithi067.stdout:4/582: rename d0/d1d/d53/da8/lbc to d0/d1d/d24/ld2 0 2023-12-05T09:26:32.806 INFO:tasks.workunit.client.0.smithi067.stdout:4/583: chown d0/d1d/d53/d62/fc2 126361 1 2023-12-05T09:26:32.806 INFO:tasks.workunit.client.0.smithi067.stdout:0/759: dread d3/d7/d30/f9b [4194304,4194304] 0 2023-12-05T09:26:32.812 INFO:tasks.workunit.client.0.smithi067.stdout:3/568: creat d9/da/fca x:0 0 0 2023-12-05T09:26:32.812 INFO:tasks.workunit.client.0.smithi067.stdout:3/569: dread - d9/da/d15/d17/fa6 zero size 2023-12-05T09:26:32.812 INFO:tasks.workunit.client.0.smithi067.stdout:3/570: fsync d9/d24/fbc 0 2023-12-05T09:26:32.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/845: getdents d16/d18/dc5/dc2/df6/d63 0 2023-12-05T09:26:32.818 INFO:tasks.workunit.client.0.smithi067.stdout:0/760: rmdir d3/d7/d3c/d6c/d76 39 2023-12-05T09:26:32.820 INFO:tasks.workunit.client.1.smithi134.stdout:4/846: symlink d16/d21/d48/l127 0 2023-12-05T09:26:32.821 INFO:tasks.workunit.client.0.smithi067.stdout:3/571: link d9/da/d15/d17/d1a/d51/f75 d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/fcb 0 2023-12-05T09:26:32.822 INFO:tasks.workunit.client.0.smithi067.stdout:3/572: write d9/d20/fb1 [1010760,68712] 0 2023-12-05T09:26:32.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/812: dwrite d13/d14/d15/d2a/f49 [0,4194304] 0 2023-12-05T09:26:32.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/813: write d13/d14/d30/fe9 [406312,74370] 0 2023-12-05T09:26:32.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/814: chown d13/d14/d30/d4b/d66/cb0 14326738 1 2023-12-05T09:26:32.841 INFO:tasks.workunit.client.1.smithi134.stdout:0/815: mkdir d13/d14/d15/d93/de4/d111 0 2023-12-05T09:26:32.845 INFO:tasks.workunit.client.1.smithi134.stdout:0/816: truncate f8 1408655 0 2023-12-05T09:26:32.845 INFO:tasks.workunit.client.1.smithi134.stdout:0/817: dread - d13/d14/d30/d4b/dc1/df8/f107 zero size 2023-12-05T09:26:32.848 INFO:tasks.workunit.client.1.smithi134.stdout:0/818: unlink d13/d14/d30/d4b/l6b 0 2023-12-05T09:26:32.848 INFO:tasks.workunit.client.1.smithi134.stdout:0/819: write d13/d14/d30/d4b/fe2 [1150968,117830] 0 2023-12-05T09:26:32.849 INFO:tasks.workunit.client.1.smithi134.stdout:0/820: truncate f7 3170141 0 2023-12-05T09:26:32.851 INFO:tasks.workunit.client.0.smithi067.stdout:1/648: dwrite d2/d4f/d15/f29 [0,4194304] 0 2023-12-05T09:26:32.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/821: unlink d13/d14/d30/d4b/d66/da0/daf/dde/da9/ce1 0 2023-12-05T09:26:32.861 INFO:tasks.workunit.client.0.smithi067.stdout:4/584: dwrite d0/d1d/d25/d2c/d34/d4e/d5a/d88/fb0 [0,4194304] 0 2023-12-05T09:26:32.862 INFO:tasks.workunit.client.1.smithi134.stdout:4/847: dwrite d16/d21/d35/fa5 [0,4194304] 0 2023-12-05T09:26:32.862 INFO:tasks.workunit.client.1.smithi134.stdout:4/848: dread - d16/d18/d1b/ff2 zero size 2023-12-05T09:26:32.863 INFO:tasks.workunit.client.0.smithi067.stdout:2/543: dwrite d0/d25/d34/d4a/fb3 [0,4194304] 0 2023-12-05T09:26:32.864 INFO:tasks.workunit.client.1.smithi134.stdout:7/823: sync 2023-12-05T09:26:32.864 INFO:tasks.workunit.client.1.smithi134.stdout:7/824: read - d2/d7/d2b/d2d/d67/dbb/fec zero size 2023-12-05T09:26:32.989 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:26:32.989 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:26:32.989 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:26:32.989 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [], 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "1/2 daemons upgraded", 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.896+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24d0000bf0 con 0x7f24cc06ae90 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.898+0000 7f24e0ff9700 1 -- 172.21.15.67:0/2565614957 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f24d0000bf0 con 0x7f24cc06ae90 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f24cc06ae90 msgr2=0x7f24cc06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f24cc06ae90 0x7f24cc06d340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f24d8004d60 tx=0x7f24d800b040 comp rx=0 tx=0).stop 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e40fcbf0 msgr2=0x7f24e40714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e40fcbf0 0x7f24e40714a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f24d400bbd0 tx=0x7f24d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:26:32.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 shutdown_connections 2023-12-05T09:26:32.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e40fcbf0 0x7f24e40714a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f24cc06ae90 0x7f24cc06d340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 --2- 172.21.15.67:0/2565614957 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24e40fde00 0x7f24e40719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:26:32.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 >> 172.21.15.67:0/2565614957 conn(0x7f24e40f82d0 msgr2=0x7f24e4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:26:32.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 shutdown_connections 2023-12-05T09:26:32.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:26:32.902+0000 7f24ea607700 1 -- 172.21.15.67:0/2565614957 wait complete. 2023-12-05T09:26:32.991 INFO:tasks.workunit.client.1.smithi134.stdout:4/849: rmdir d16/d18/dad/d10e 39 2023-12-05T09:26:32.999 INFO:tasks.workunit.client.1.smithi134.stdout:4/850: symlink d16/d21/d35/l128 0 2023-12-05T09:26:33.002 INFO:tasks.workunit.client.0.smithi067.stdout:4/585: rename d0/d1d/d25/d2c/d34/d4e/f52 to d0/d1d/d4d/d8d/fd3 0 2023-12-05T09:26:33.004 INFO:tasks.workunit.client.1.smithi134.stdout:4/851: truncate d16/d18/f92 3423243 0 2023-12-05T09:26:33.009 INFO:tasks.workunit.client.0.smithi067.stdout:0/761: dwrite d3/d7/d30/f9b [8388608,4194304] 0 2023-12-05T09:26:33.009 INFO:tasks.workunit.client.0.smithi067.stdout:0/762: read - d3/d7/d3c/d6c/d76/da7/dec/d10/dd2/dcf/fe9 zero size 2023-12-05T09:26:33.009 INFO:tasks.workunit.client.0.smithi067.stdout:3/573: dwrite d9/da/d15/d17/d2b/fa9 [0,4194304] 0 2023-12-05T09:26:33.010 INFO:tasks.workunit.client.1.smithi134.stdout:4/852: mkdir d16/d7b/d129 0 2023-12-05T09:26:33.010 INFO:tasks.workunit.client.0.smithi067.stdout:1/649: dwrite d2/d5/d7/de/d1a/f1b [4194304,4194304] 0 2023-12-05T09:26:33.010 INFO:tasks.workunit.client.0.smithi067.stdout:1/650: readlink d2/d5/d7/de/d1a/ld5 0 2023-12-05T09:26:33.016 INFO:tasks.workunit.client.1.smithi134.stdout:4/853: mknod d16/d7b/db6/dbc/c12a 0 2023-12-05T09:26:33.016 INFO:tasks.workunit.client.1.smithi134.stdout:4/854: readlink d16/d18/dc5/dc2/df6/d63/l98 0 2023-12-05T09:26:33.016 INFO:tasks.workunit.client.1.smithi134.stdout:4/855: stat d16/d18/dad/d10e/c10d 0 2023-12-05T09:26:33.016 INFO:tasks.workunit.client.1.smithi134.stdout:4/856: creat d16/d18/dc5/dc2/f12b x:0 0 0 2023-12-05T09:26:33.016 INFO:tasks.workunit.client.1.smithi134.stdout:4/857: read - d16/d18/d1b/d24/fcb zero size 2023-12-05T09:26:33.017 INFO:tasks.workunit.client.0.smithi067.stdout:2/544: mknod d0/d25/d34/d4a/db8/cbb 0 2023-12-05T09:26:33.017 INFO:tasks.workunit.client.0.smithi067.stdout:2/545: chown d0/d25/f8b 26 1 2023-12-05T09:26:33.030 INFO:tasks.workunit.client.0.smithi067.stdout:2/546: unlink d0/d25/d9d/d63/d88/ca9 0 2023-12-05T09:26:33.030 INFO:tasks.workunit.client.0.smithi067.stdout:2/547: dread - d0/d25/d3f/f79 zero size 2023-12-05T09:26:33.030 INFO:tasks.workunit.client.0.smithi067.stdout:4/586: write d0/d1d/f58 [4096949,57514] 0 2023-12-05T09:26:33.036 INFO:tasks.workunit.client.0.smithi067.stdout:1/651: dread d2/d4f/d14/d48/f6b [0,4194304] 0 2023-12-05T09:26:33.048 INFO:tasks.workunit.client.0.smithi067.stdout:1/652: dread d2/d5/d7/de/d19/d8f/d98/fc7 [0,4194304] 0 2023-12-05T09:26:33.048 INFO:tasks.workunit.client.0.smithi067.stdout:1/653: fdatasync d2/d4f/d15/d60/d68/f75 0 2023-12-05T09:26:33.062 INFO:tasks.workunit.client.0.smithi067.stdout:3/574: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/fcb [0,4194304] 0 2023-12-05T09:26:33.070 INFO:tasks.workunit.client.0.smithi067.stdout:4/587: symlink d0/d1d/d25/d2c/d34/d4e/ld4 0 2023-12-05T09:26:33.072 INFO:tasks.workunit.client.0.smithi067.stdout:1/654: unlink d2/d4f/d14/d20/d83/d78/fd2 0 2023-12-05T09:26:33.076 INFO:tasks.workunit.client.0.smithi067.stdout:1/655: write d2/d5/d7/de/d19/d8f/d98/fc7 [614844,29123] 0 2023-12-05T09:26:33.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/874: rename d19/l1b to d19/d76/dba/ded/l11e 0 2023-12-05T09:26:33.078 INFO:tasks.workunit.client.0.smithi067.stdout:4/588: mknod d0/d1d/d25/d2c/db5/cd5 0 2023-12-05T09:26:33.078 INFO:tasks.workunit.client.0.smithi067.stdout:4/589: dread - d0/d1d/d25/d2c/d34/d4e/fa1 zero size 2023-12-05T09:26:33.081 INFO:tasks.workunit.client.1.smithi134.stdout:2/875: link d19/d3a/fa0 d19/d3a/d60/f11f 0 2023-12-05T09:26:33.081 INFO:tasks.workunit.client.1.smithi134.stdout:2/876: chown d19/d3f/dbf/cf6 389 1 2023-12-05T09:26:33.081 INFO:tasks.workunit.client.1.smithi134.stdout:2/877: fsync d19/f114 0 2023-12-05T09:26:33.082 INFO:tasks.workunit.client.1.smithi134.stdout:2/878: getdents d19/d28/d31/d38/d98/dcb 0 2023-12-05T09:26:33.082 INFO:tasks.workunit.client.1.smithi134.stdout:2/879: readlink d19/d28/d31/d38/l85 0 2023-12-05T09:26:33.084 INFO:tasks.workunit.client.1.smithi134.stdout:2/880: creat d19/d6d/f120 x:0 0 0 2023-12-05T09:26:33.086 INFO:tasks.workunit.client.1.smithi134.stdout:6/773: rename d4/c50 to d4/d39/d42/d4f/d6d/d3a/da/de3/cef 0 2023-12-05T09:26:33.088 INFO:tasks.workunit.client.1.smithi134.stdout:6/774: rmdir d4/d39/d42/d4f/d6d/d3a/d75 39 2023-12-05T09:26:33.093 INFO:tasks.workunit.client.1.smithi134.stdout:6/775: symlink d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/lf0 0 2023-12-05T09:26:33.093 INFO:tasks.workunit.client.1.smithi134.stdout:6/776: chown d4/d32/f84 2032 1 2023-12-05T09:26:33.093 INFO:tasks.workunit.client.1.smithi134.stdout:9/824: rename f3 to d7/d8/d16/d52/d74/d97/f115 0 2023-12-05T09:26:33.095 INFO:tasks.workunit.client.0.smithi067.stdout:2/548: dwrite d0/d25/d9d/d53/d1e/f74 [0,4194304] 0 2023-12-05T09:26:33.096 INFO:tasks.workunit.client.1.smithi134.stdout:8/928: rename da/de/d8a/d42/f5b to da/de/d96/dc9/f13b 0 2023-12-05T09:26:33.096 INFO:tasks.workunit.client.1.smithi134.stdout:8/929: chown da/de/d11/d1d/d5f/d9b/fe1 5299 1 2023-12-05T09:26:33.098 INFO:tasks.workunit.client.1.smithi134.stdout:9/825: creat d7/f116 x:0 0 0 2023-12-05T09:26:33.100 INFO:tasks.workunit.client.1.smithi134.stdout:6/777: creat d4/d39/d42/d4f/d6d/d3a/da/de3/d8c/ff1 x:0 0 0 2023-12-05T09:26:33.100 INFO:tasks.workunit.client.1.smithi134.stdout:6/778: chown d4/d78/c91 3912 1 2023-12-05T09:26:33.101 INFO:tasks.workunit.client.1.smithi134.stdout:1/977: rename d2/d9/d10/d30/d66/da9/d74/d99/fbd to d2/d9/d10/d5b/f160 0 2023-12-05T09:26:33.102 INFO:tasks.workunit.client.0.smithi067.stdout:2/549: symlink d0/d2f/d39/lbc 0 2023-12-05T09:26:33.103 INFO:tasks.workunit.client.1.smithi134.stdout:9/826: read d7/d5b/d5e/daa/db7/f100 [120122,84125] 0 2023-12-05T09:26:33.106 INFO:tasks.workunit.client.1.smithi134.stdout:2/881: dread f16 [0,4194304] 0 2023-12-05T09:26:33.107 INFO:tasks.workunit.client.1.smithi134.stdout:5/832: rename d0/d1a/f111 to d0/dd/d37/d90/dfe/d117/f121 0 2023-12-05T09:26:33.107 INFO:tasks.workunit.client.1.smithi134.stdout:5/833: dread - d0/dd/d37/d90/d9d/f104 zero size 2023-12-05T09:26:33.107 INFO:tasks.workunit.client.0.smithi067.stdout:2/550: mkdir d0/dbd 0 2023-12-05T09:26:33.110 INFO:tasks.workunit.client.0.smithi067.stdout:2/551: link d0/d25/d9d/d53/l71 d0/d25/d9d/d53/lbe 0 2023-12-05T09:26:33.110 INFO:tasks.workunit.client.1.smithi134.stdout:6/779: creat d4/d39/d42/d4f/d6d/d3a/d75/ff2 x:0 0 0 2023-12-05T09:26:33.110 INFO:tasks.workunit.client.1.smithi134.stdout:6/780: fdatasync d4/d39/d42/d4f/d6d/d3a/d75/ff2 0 2023-12-05T09:26:33.110 INFO:tasks.workunit.client.1.smithi134.stdout:6/781: stat d4/d39/d42/d4f/c63 0 2023-12-05T09:26:33.110 INFO:tasks.workunit.client.1.smithi134.stdout:6/782: write d4/d39/d42/f4d [752123,46573] 0 2023-12-05T09:26:33.110 INFO:tasks.workunit.client.1.smithi134.stdout:1/978: unlink d2/d9/d10/d5b/d126/ce9 0 2023-12-05T09:26:33.112 INFO:tasks.workunit.client.1.smithi134.stdout:0/822: rename d13/d14/d30/d4b/d23/d77 to d13/d14/d15/d93/de4/d111/d112 0 2023-12-05T09:26:33.112 INFO:tasks.workunit.client.1.smithi134.stdout:5/834: mkdir d0/d1a/d1c/d25/d4d/d9e/d122 0 2023-12-05T09:26:33.114 INFO:tasks.workunit.client.0.smithi067.stdout:2/552: mkdir d0/d25/d34/d4d/db0/dbf 0 2023-12-05T09:26:33.114 INFO:tasks.workunit.client.0.smithi067.stdout:2/553: stat d0/d25/d9d/d63 0 2023-12-05T09:26:33.114 INFO:tasks.workunit.client.0.smithi067.stdout:2/554: creat d0/d2f/d84/fc0 x:0 0 0 2023-12-05T09:26:33.116 INFO:tasks.workunit.client.1.smithi134.stdout:7/825: rename d2/dd/d71 to d2/df/d81/d10d 0 2023-12-05T09:26:33.117 INFO:tasks.workunit.client.1.smithi134.stdout:6/783: symlink d4/d39/d42/d4f/d6d/d3a/da/lf3 0 2023-12-05T09:26:33.117 INFO:tasks.workunit.client.0.smithi067.stdout:2/555: mknod d0/d25/d34/d4d/d54/d90/cc1 0 2023-12-05T09:26:33.117 INFO:tasks.workunit.client.1.smithi134.stdout:5/835: unlink d0/d1a/d1c/d3f/cd1 0 2023-12-05T09:26:33.119 INFO:tasks.workunit.client.1.smithi134.stdout:4/858: rename d16/d18/dc5/fe4 to d16/d18/d1b/d24/f12c 0 2023-12-05T09:26:33.119 INFO:tasks.workunit.client.1.smithi134.stdout:4/859: stat d16/d18/dc5/dc2/df6/d63/fe1 0 2023-12-05T09:26:33.120 INFO:tasks.workunit.client.1.smithi134.stdout:4/860: stat d16/d18/dad/d10e/fe3 0 2023-12-05T09:26:33.122 INFO:tasks.workunit.client.1.smithi134.stdout:7/826: mkdir d2/d7/dc/d2e/d3a/d6d/d10e 0 2023-12-05T09:26:33.123 INFO:tasks.workunit.client.1.smithi134.stdout:6/784: rename d4/d39/d42/d4f/fe7 to d4/d39/d42/d4f/d6d/d9f/dc4/ff4 0 2023-12-05T09:26:33.123 INFO:tasks.workunit.client.1.smithi134.stdout:6/785: chown d4/d39/d5c/cc1 889414819 1 2023-12-05T09:26:33.126 INFO:tasks.workunit.client.1.smithi134.stdout:5/836: mkdir d0/d1a/d1c/d3f/d81/db0/dbe/d123 0 2023-12-05T09:26:33.126 INFO:tasks.workunit.client.1.smithi134.stdout:5/837: truncate d0/d1a/d1c/d3f/d5b/d5d/f69 111771 0 2023-12-05T09:26:33.126 INFO:tasks.workunit.client.1.smithi134.stdout:9/827: dread d7/d8/d14/d26/d7f/d92/d53/dd4/ff6 [0,4194304] 0 2023-12-05T09:26:33.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/786: rename d4/d39/d42/d4f/lde to d4/d39/d42/d4f/d6d/d3a/d75/d59/lf5 0 2023-12-05T09:26:33.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/787: rename d4/d39/d42/d4f/d6d/d3a to d4/d39/d42/d4f/d6d/d3a/dd4/df6 22 2023-12-05T09:26:33.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/788: fsync d4/d39/d5c/fb6 0 2023-12-05T09:26:33.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/789: stat d4/d32/d57/f61 0 2023-12-05T09:26:33.129 INFO:tasks.workunit.client.1.smithi134.stdout:7/827: mknod d2/df/d2a/c10f 0 2023-12-05T09:26:33.129 INFO:tasks.workunit.client.1.smithi134.stdout:7/828: chown d2/d7 1108069 1 2023-12-05T09:26:33.133 INFO:tasks.workunit.client.1.smithi134.stdout:8/930: read da/de/d11/d1d/f2e [3148885,37125] 0 2023-12-05T09:26:33.133 INFO:tasks.workunit.client.1.smithi134.stdout:6/790: creat d4/d39/d42/d4f/ff7 x:0 0 0 2023-12-05T09:26:33.133 INFO:tasks.workunit.client.1.smithi134.stdout:4/861: dread d16/d7b/dce/d6e/daa/d3b/dcf/fe7 [0,4194304] 0 2023-12-05T09:26:33.134 INFO:tasks.workunit.client.1.smithi134.stdout:5/838: creat d0/d1a/d1c/d25/d4d/d9e/f124 x:0 0 0 2023-12-05T09:26:33.134 INFO:tasks.workunit.client.1.smithi134.stdout:4/862: mkdir d16/d21/d48/d80/dae/d12d 0 2023-12-05T09:26:33.134 INFO:tasks.workunit.client.1.smithi134.stdout:4/863: fsync d16/d9c/ff4 0 2023-12-05T09:26:33.135 INFO:tasks.workunit.client.1.smithi134.stdout:0/823: dread f7 [0,4194304] 0 2023-12-05T09:26:33.135 INFO:tasks.workunit.client.1.smithi134.stdout:9/828: truncate d7/d8/d16/d52/ff3 2211639 0 2023-12-05T09:26:33.135 INFO:tasks.workunit.client.1.smithi134.stdout:1/979: dread d2/d27/db4/fdc [0,4194304] 0 2023-12-05T09:26:33.136 INFO:tasks.workunit.client.1.smithi134.stdout:5/839: truncate d0/d1a/d1c/d25/d4d/d9e/fed 3694974 0 2023-12-05T09:26:33.137 INFO:tasks.workunit.client.1.smithi134.stdout:6/791: creat d4/d39/d42/d4f/d6d/d3a/da/de3/d8c/db5/ff8 x:0 0 0 2023-12-05T09:26:33.141 INFO:tasks.workunit.client.1.smithi134.stdout:4/864: mkdir d16/d21/d48/d66/d12e 0 2023-12-05T09:26:33.141 INFO:tasks.workunit.client.1.smithi134.stdout:9/829: unlink d7/d8/d14/d26/d7f/d92/laf 0 2023-12-05T09:26:33.141 INFO:tasks.workunit.client.1.smithi134.stdout:9/830: readlink d7/d8/d14/d26/d5a/da1/ldf 0 2023-12-05T09:26:33.141 INFO:tasks.workunit.client.1.smithi134.stdout:0/824: creat d13/d14/d15/d93/de4/d111/d112/f113 x:0 0 0 2023-12-05T09:26:33.141 INFO:tasks.workunit.client.1.smithi134.stdout:0/825: readlink d13/d14/d15/d93/de4/d111/d112/l9e 0 2023-12-05T09:26:33.144 INFO:tasks.workunit.client.1.smithi134.stdout:5/840: link d0/dd/fe1 d0/dd/d37/d90/dfe/f125 0 2023-12-05T09:26:33.144 INFO:tasks.workunit.client.1.smithi134.stdout:6/792: mkdir d4/d39/d42/d4f/d6d/d3a/da/df9 0 2023-12-05T09:26:33.144 INFO:tasks.workunit.client.1.smithi134.stdout:2/882: write f17 [3095678,74958] 0 2023-12-05T09:26:33.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/826: mknod d13/d14/d30/d4b/d66/da0/daf/dde/c114 0 2023-12-05T09:26:33.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/827: write d13/d14/d30/d4b/d66/da0/daf/ff5 [137964,88006] 0 2023-12-05T09:26:33.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/828: readlink d13/d14/d30/d4b/d66/ldb 0 2023-12-05T09:26:33.149 INFO:tasks.workunit.client.1.smithi134.stdout:5/841: mknod d0/d1a/d1c/d25/d4d/d9e/c126 0 2023-12-05T09:26:33.149 INFO:tasks.workunit.client.1.smithi134.stdout:5/842: fsync d0/d1a/d1c/d3f/d5b/fba 0 2023-12-05T09:26:33.150 INFO:tasks.workunit.client.1.smithi134.stdout:5/843: stat d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/ld5 0 2023-12-05T09:26:33.155 INFO:tasks.workunit.client.1.smithi134.stdout:1/980: dread d2/d27/d9d/fd6 [0,4194304] 0 2023-12-05T09:26:33.156 INFO:tasks.workunit.client.0.smithi067.stdout:1/656: dwrite d2/d4f/d14/d20/fc9 [0,4194304] 0 2023-12-05T09:26:33.156 INFO:tasks.workunit.client.1.smithi134.stdout:1/981: write d2/d27/d40/ff8 [150896,49126] 0 2023-12-05T09:26:33.159 INFO:tasks.workunit.client.1.smithi134.stdout:7/829: write d2/d7/dc/d2e/d3a/fbf [715741,86634] 0 2023-12-05T09:26:33.162 INFO:tasks.workunit.client.1.smithi134.stdout:1/982: link d2/d9/d10/d94/de5/d112/de1/cec d2/d9/d10/d30/d66/da9/d74/d120/c161 0 2023-12-05T09:26:33.163 INFO:tasks.workunit.client.1.smithi134.stdout:1/983: fdatasync d2/d27/d40/f154 0 2023-12-05T09:26:33.165 INFO:tasks.workunit.client.1.smithi134.stdout:9/831: dread d7/d10/fa6 [0,4194304] 0 2023-12-05T09:26:33.174 INFO:tasks.workunit.client.0.smithi067.stdout:4/590: write d0/d1d/d25/f9a [1538343,48025] 0 2023-12-05T09:26:33.175 INFO:tasks.workunit.client.1.smithi134.stdout:3/857: sync 2023-12-05T09:26:33.175 INFO:tasks.workunit.client.1.smithi134.stdout:3/858: write d4/d1f/d4e/f59 [1244273,122096] 0 2023-12-05T09:26:33.175 INFO:tasks.workunit.client.1.smithi134.stdout:6/793: rename d4/d39/d42/d4f/d6d/d3a/da/de3/d8c/db5 to d4/d78/dfa 0 2023-12-05T09:26:33.175 INFO:tasks.workunit.client.1.smithi134.stdout:6/794: fdatasync d4/d39/d42/d4f/d6d/d3a/d75/fbe 0 2023-12-05T09:26:33.176 INFO:tasks.workunit.client.1.smithi134.stdout:9/832: dread d7/d8/d14/f46 [0,4194304] 0 2023-12-05T09:26:33.176 INFO:tasks.workunit.client.1.smithi134.stdout:9/833: chown d7/d10/d56/c73 34 1 2023-12-05T09:26:33.178 INFO:tasks.workunit.client.0.smithi067.stdout:3/575: dwrite d9/da/d3b/fc6 [0,4194304] 0 2023-12-05T09:26:33.178 INFO:tasks.workunit.client.0.smithi067.stdout:3/576: truncate d9/da/d15/d17/d1a/d51/d66/f97 79727 0 2023-12-05T09:26:33.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/591: rmdir d0/d1d/d25/d2c/d34/d4e/daa 39 2023-12-05T09:26:33.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/592: write d0/d1d/d24/f66 [28889,72423] 0 2023-12-05T09:26:33.182 INFO:tasks.workunit.client.0.smithi067.stdout:4/593: chown d0/d1d/d25/d32/f44 18072898 1 2023-12-05T09:26:33.185 INFO:tasks.workunit.client.1.smithi134.stdout:4/865: dread d16/d18/d1b/f31 [0,4194304] 0 2023-12-05T09:26:33.185 INFO:tasks.workunit.client.1.smithi134.stdout:4/866: creat d16/d21/de5/f12f x:0 0 0 2023-12-05T09:26:33.185 INFO:tasks.workunit.client.1.smithi134.stdout:4/867: creat d16/d18/d1b/f130 x:0 0 0 2023-12-05T09:26:33.186 INFO:tasks.workunit.client.1.smithi134.stdout:4/868: read d16/d21/d47/f67 [129616,58052] 0 2023-12-05T09:26:33.186 INFO:tasks.workunit.client.1.smithi134.stdout:4/869: creat d16/d9c/f131 x:0 0 0 2023-12-05T09:26:33.186 INFO:tasks.workunit.client.1.smithi134.stdout:4/870: fdatasync f4 0 2023-12-05T09:26:33.186 INFO:tasks.workunit.client.1.smithi134.stdout:4/871: chown d16/d21/l70 23649 1 2023-12-05T09:26:33.192 INFO:tasks.workunit.client.1.smithi134.stdout:4/872: symlink d16/d21/d48/d66/db0/l132 0 2023-12-05T09:26:33.214 INFO:tasks.workunit.client.1.smithi134.stdout:9/834: mkdir d7/d117 0 2023-12-05T09:26:33.214 INFO:tasks.workunit.client.1.smithi134.stdout:9/835: truncate d7/d8/d14/fad 1738252 0 2023-12-05T09:26:33.215 INFO:tasks.workunit.client.1.smithi134.stdout:6/795: rename d4/d78/d7a to d4/d39/dfb 0 2023-12-05T09:26:33.220 INFO:tasks.workunit.client.1.smithi134.stdout:0/829: rename d13/d14/d30/d4b/d66/da0/daf/dce/d78/la4 to d13/d14/d15/d93/de4/d111/l115 0 2023-12-05T09:26:33.226 INFO:tasks.workunit.client.1.smithi134.stdout:2/883: dwrite d19/f20 [0,4194304] 0 2023-12-05T09:26:33.229 INFO:tasks.workunit.client.1.smithi134.stdout:5/844: rename d0/d1a/d1c/dde to d0/d11/d61/d107/d127 0 2023-12-05T09:26:33.230 INFO:tasks.workunit.client.1.smithi134.stdout:5/845: readlink d0/d1a/d3a/l8c 0 2023-12-05T09:26:33.230 INFO:tasks.workunit.client.0.smithi067.stdout:1/657: dread d2/d5/d7/de/d19/f38 [0,4194304] 0 2023-12-05T09:26:33.230 INFO:tasks.workunit.client.0.smithi067.stdout:1/658: readlink d2/d3/da6/dbb/lb2 0 2023-12-05T09:26:33.231 INFO:tasks.workunit.client.0.smithi067.stdout:2/556: dwrite d0/d25/d34/d4d/f81 [0,4194304] 0 2023-12-05T09:26:33.231 INFO:tasks.workunit.client.1.smithi134.stdout:9/836: write d7/d8/f84 [3461873,101379] 0 2023-12-05T09:26:33.232 INFO:tasks.workunit.client.1.smithi134.stdout:8/931: dwrite da/de/d8a/d42/d99/f11a [0,4194304] 0 2023-12-05T09:26:33.234 INFO:tasks.workunit.client.1.smithi134.stdout:1/984: dwrite d2/d9/d8d/da2/db1/f150 [0,4194304] 0 2023-12-05T09:26:33.234 INFO:tasks.workunit.client.1.smithi134.stdout:1/985: fsync d2/d27/f3a 0 2023-12-05T09:26:33.237 INFO:tasks.workunit.client.1.smithi134.stdout:5/846: unlink d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/f92 0 2023-12-05T09:26:33.237 INFO:tasks.workunit.client.0.smithi067.stdout:2/557: rename d0/f5a to d0/d25/d9d/d53/d92/fc2 0 2023-12-05T09:26:33.237 INFO:tasks.workunit.client.0.smithi067.stdout:2/558: truncate d0/d2f/fb9 60126 0 2023-12-05T09:26:33.243 INFO:tasks.workunit.client.1.smithi134.stdout:3/859: rename d4/d1f/l36 to d4/d5/d45/d60/l10d 0 2023-12-05T09:26:33.243 INFO:tasks.workunit.client.1.smithi134.stdout:3/860: truncate d4/d5/d6f/dc2/fff 705877 0 2023-12-05T09:26:33.246 INFO:tasks.workunit.client.1.smithi134.stdout:0/830: dread d13/d14/d30/f88 [0,4194304] 0 2023-12-05T09:26:33.246 INFO:tasks.workunit.client.1.smithi134.stdout:0/831: fsync d13/d14/d30/f32 0 2023-12-05T09:26:33.248 INFO:tasks.workunit.client.1.smithi134.stdout:9/837: creat d7/d8/d16/d52/d74/f118 x:0 0 0 2023-12-05T09:26:33.253 INFO:tasks.workunit.client.1.smithi134.stdout:2/884: dread f16 [0,4194304] 0 2023-12-05T09:26:33.254 INFO:tasks.workunit.client.1.smithi134.stdout:0/832: rename d13/d14/d15/d67/f63 to d13/d14/d15/dee/f116 0 2023-12-05T09:26:33.254 INFO:tasks.workunit.client.1.smithi134.stdout:4/873: dwrite d16/d18/dc5/dc2/df6/ddd/fe2 [0,4194304] 0 2023-12-05T09:26:33.254 INFO:tasks.workunit.client.0.smithi067.stdout:2/559: rmdir d0/d2f/d39 39 2023-12-05T09:26:33.254 INFO:tasks.workunit.client.0.smithi067.stdout:2/560: readlink d0/l17 0 2023-12-05T09:26:33.254 INFO:tasks.workunit.client.0.smithi067.stdout:4/594: dwrite d0/d1d/d25/d38/fbf [0,4194304] 0 2023-12-05T09:26:33.255 INFO:tasks.workunit.client.0.smithi067.stdout:3/577: dwrite d9/d62/f88 [0,4194304] 0 2023-12-05T09:26:33.255 INFO:tasks.workunit.client.0.smithi067.stdout:2/561: mkdir d0/d25/d67/dc3 0 2023-12-05T09:26:33.256 INFO:tasks.workunit.client.0.smithi067.stdout:3/578: write d9/da/d15/f50 [106644,117292] 0 2023-12-05T09:26:33.256 INFO:tasks.workunit.client.1.smithi134.stdout:8/932: symlink da/de/d16/d2d/l13c 0 2023-12-05T09:26:33.263 INFO:tasks.workunit.client.1.smithi134.stdout:1/986: symlink d2/d9/d10/d94/d124/l162 0 2023-12-05T09:26:33.264 INFO:tasks.workunit.client.1.smithi134.stdout:3/861: getdents d4/d1f/d50/db1 0 2023-12-05T09:26:33.266 INFO:tasks.workunit.client.1.smithi134.stdout:5/847: symlink d0/d11/d5c/l128 0 2023-12-05T09:26:33.267 INFO:tasks.workunit.client.1.smithi134.stdout:4/874: mkdir d16/d18/d1b/d24/d133 0 2023-12-05T09:26:33.271 INFO:tasks.workunit.client.0.smithi067.stdout:4/595: rename d0/d1d/d4d/d8d/d98 to d0/d1d/d2b/dd6 0 2023-12-05T09:26:33.271 INFO:tasks.workunit.client.0.smithi067.stdout:4/596: fsync d0/d1d/d2a/dba/fc8 0 2023-12-05T09:26:33.271 INFO:tasks.workunit.client.0.smithi067.stdout:4/597: chown d0/d1d/d2a/d72/la0 94397321 1 2023-12-05T09:26:33.273 INFO:tasks.workunit.client.1.smithi134.stdout:4/875: mkdir d16/d18/dc5/dc2/df6/d134 0 2023-12-05T09:26:33.273 INFO:tasks.workunit.client.1.smithi134.stdout:4/876: getdents d16/d21/d48/d66/db0/dea 0 2023-12-05T09:26:33.275 INFO:tasks.workunit.client.0.smithi067.stdout:4/598: creat d0/d1d/d53/da8/da9/d15/fd7 x:0 0 0 2023-12-05T09:26:33.280 INFO:tasks.workunit.client.1.smithi134.stdout:6/796: dwrite d4/d39/d42/d4f/d6d/d3a/d75/d59/f6c [0,4194304] 0 2023-12-05T09:26:33.280 INFO:tasks.workunit.client.1.smithi134.stdout:6/797: chown d4/d39/d42/d4f/d6d/f60 1022 1 2023-12-05T09:26:33.281 INFO:tasks.workunit.client.0.smithi067.stdout:4/599: symlink d0/d9/ld8 0 2023-12-05T09:26:33.281 INFO:tasks.workunit.client.0.smithi067.stdout:4/600: readlink d0/d1d/d2a/d72/la7 0 2023-12-05T09:26:33.281 INFO:tasks.workunit.client.0.smithi067.stdout:4/601: fdatasync d0/d1d/d4d/fb2 0 2023-12-05T09:26:33.281 INFO:tasks.workunit.client.0.smithi067.stdout:4/602: dread - d0/f80 zero size 2023-12-05T09:26:33.282 INFO:tasks.workunit.client.0.smithi067.stdout:4/603: readlink d0/d1d/d25/d2c/d34/d4e/ld4 0 2023-12-05T09:26:33.283 INFO:tasks.workunit.client.1.smithi134.stdout:4/877: unlink d16/d18/dc5/dc2/df6/l38 0 2023-12-05T09:26:33.283 INFO:tasks.workunit.client.1.smithi134.stdout:4/878: chown d16/d21/d48/d66 838285207 1 2023-12-05T09:26:33.285 INFO:tasks.workunit.client.1.smithi134.stdout:0/833: write d13/d14/d30/f88 [262282,39389] 0 2023-12-05T09:26:33.285 INFO:tasks.workunit.client.1.smithi134.stdout:9/838: dread d7/f1a [4194304,4194304] 0 2023-12-05T09:26:33.286 INFO:tasks.workunit.client.1.smithi134.stdout:5/848: dread d0/d1a/d1c/d25/f56 [0,4194304] 0 2023-12-05T09:26:33.286 INFO:tasks.workunit.client.1.smithi134.stdout:5/849: fsync d0/d1a/d1c/d25/d4d/d9e/f109 0 2023-12-05T09:26:33.287 INFO:tasks.workunit.client.1.smithi134.stdout:2/885: dread d19/d28/d31/d6f/f84 [0,4194304] 0 2023-12-05T09:26:33.287 INFO:tasks.workunit.client.1.smithi134.stdout:2/886: write d19/d28/d2b/f4b [2431480,76746] 0 2023-12-05T09:26:33.287 INFO:tasks.workunit.client.1.smithi134.stdout:2/887: readlink d19/d3a/l4d 0 2023-12-05T09:26:33.290 INFO:tasks.workunit.client.1.smithi134.stdout:9/839: creat d7/d8/d14/d26/d5a/d69/d10e/f119 x:0 0 0 2023-12-05T09:26:33.290 INFO:tasks.workunit.client.1.smithi134.stdout:9/840: fdatasync d7/d10/d56/fe6 0 2023-12-05T09:26:33.290 INFO:tasks.workunit.client.1.smithi134.stdout:9/841: readlink d7/d10/lbe 0 2023-12-05T09:26:33.291 INFO:tasks.workunit.client.1.smithi134.stdout:6/798: truncate d4/d39/d42/d4f/d6d/d3a/d75/f29 4085304 0 2023-12-05T09:26:33.292 INFO:tasks.workunit.client.1.smithi134.stdout:5/850: mknod d0/dd/d37/d90/c129 0 2023-12-05T09:26:33.295 INFO:tasks.workunit.client.1.smithi134.stdout:9/842: mknod d7/d8/d2e/c11a 0 2023-12-05T09:26:33.295 INFO:tasks.workunit.client.1.smithi134.stdout:9/843: fdatasync d7/d8/d16/d52/d74/d97/df0/f10c 0 2023-12-05T09:26:33.295 INFO:tasks.workunit.client.1.smithi134.stdout:4/879: symlink d16/d7b/dce/d6e/daa/d3b/l135 0 2023-12-05T09:26:33.296 INFO:tasks.workunit.client.1.smithi134.stdout:0/834: creat d13/d14/d30/d4b/d66/da0/daf/dde/da9/f117 x:0 0 0 2023-12-05T09:26:33.297 INFO:tasks.workunit.client.0.smithi067.stdout:2/562: rename d0/d25/d67 to d0/d25/d9d/d53/d1e/d8e/dc4 0 2023-12-05T09:26:33.297 INFO:tasks.workunit.client.1.smithi134.stdout:4/880: truncate d16/d21/d47/f96 2934952 0 2023-12-05T09:26:33.300 INFO:tasks.workunit.client.1.smithi134.stdout:5/851: symlink d0/d1a/l12a 0 2023-12-05T09:26:33.302 INFO:tasks.workunit.client.1.smithi134.stdout:9/844: mknod d7/d8/d14/d26/d5a/d69/d10e/c11b 0 2023-12-05T09:26:33.302 INFO:tasks.workunit.client.1.smithi134.stdout:0/835: symlink d13/d14/d30/d4b/d66/da0/daf/dde/da9/l118 0 2023-12-05T09:26:33.303 INFO:tasks.workunit.client.1.smithi134.stdout:3/862: link d4/d5/f1e d4/d1f/d50/f10e 0 2023-12-05T09:26:33.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/836: mkdir d13/d14/d15/d67/d73/d119 0 2023-12-05T09:26:33.306 INFO:tasks.workunit.client.1.smithi134.stdout:9/845: rename d7/d10/d56/le1 to d7/d8/d14/d26/d7f/d92/d53/dd4/l11c 0 2023-12-05T09:26:33.308 INFO:tasks.workunit.client.1.smithi134.stdout:9/846: mknod d7/d8/d14/c11d 0 2023-12-05T09:26:33.309 INFO:tasks.workunit.client.1.smithi134.stdout:0/837: rename d13/d14/d30/d4b/d66/da0/daf/dce/d86/f10a to d13/d14/d30/d4b/dc1/f11a 0 2023-12-05T09:26:33.309 INFO:tasks.workunit.client.1.smithi134.stdout:0/838: write d13/d14/d30/d4b/d23/f60 [343610,49318] 0 2023-12-05T09:26:33.309 INFO:tasks.workunit.client.1.smithi134.stdout:0/839: write d13/d14/d30/fe9 [1248083,56253] 0 2023-12-05T09:26:33.310 INFO:tasks.workunit.client.1.smithi134.stdout:0/840: mkdir d13/d14/d15/d2a/d8c/d11b 0 2023-12-05T09:26:33.312 INFO:tasks.workunit.client.1.smithi134.stdout:9/847: unlink d7/fe3 0 2023-12-05T09:26:33.312 INFO:tasks.workunit.client.1.smithi134.stdout:9/848: write d7/d5b/d5e/f6c [543455,108195] 0 2023-12-05T09:26:33.312 INFO:tasks.workunit.client.0.smithi067.stdout:1/659: dwrite d2/d5/d7/de/f37 [0,4194304] 0 2023-12-05T09:26:33.314 INFO:tasks.workunit.client.1.smithi134.stdout:5/852: dread d0/d50/fdc [0,4194304] 0 2023-12-05T09:26:33.314 INFO:tasks.workunit.client.0.smithi067.stdout:3/579: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/fc4 [0,4194304] 0 2023-12-05T09:26:33.315 INFO:tasks.workunit.client.1.smithi134.stdout:9/849: mknod d7/d8/d14/d26/c11e 0 2023-12-05T09:26:33.316 INFO:tasks.workunit.client.1.smithi134.stdout:5/853: truncate d0/d11/d61/d75/f79 1328486 0 2023-12-05T09:26:33.320 INFO:tasks.workunit.client.1.smithi134.stdout:1/987: dwrite d2/d9/d10/d94/de5/f102 [0,4194304] 0 2023-12-05T09:26:33.321 INFO:tasks.workunit.client.0.smithi067.stdout:3/580: mknod d9/da/d15/d17/ccc 0 2023-12-05T09:26:33.321 INFO:tasks.workunit.client.0.smithi067.stdout:3/581: dread - d9/d20/f4f zero size 2023-12-05T09:26:33.321 INFO:tasks.workunit.client.0.smithi067.stdout:3/582: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/fb7 [754700,93541] 0 2023-12-05T09:26:33.322 INFO:tasks.workunit.client.1.smithi134.stdout:9/850: fdatasync d7/d8/f84 0 2023-12-05T09:26:33.326 INFO:tasks.workunit.client.1.smithi134.stdout:8/933: dwrite da/f89 [0,4194304] 0 2023-12-05T09:26:33.326 INFO:tasks.workunit.client.1.smithi134.stdout:8/934: write da/de/d16/d2d/f5e [125449,41482] 0 2023-12-05T09:26:33.327 INFO:tasks.workunit.client.1.smithi134.stdout:5/854: read d0/f46 [839088,124477] 0 2023-12-05T09:26:33.327 INFO:tasks.workunit.client.1.smithi134.stdout:1/988: creat d2/d9/d10/d30/d66/da9/d13c/f163 x:0 0 0 2023-12-05T09:26:33.327 INFO:tasks.workunit.client.1.smithi134.stdout:5/855: write d0/dd/d37/d90/dfe/f125 [732441,116637] 0 2023-12-05T09:26:33.327 INFO:tasks.workunit.client.1.smithi134.stdout:5/856: chown d0/d1a/d1c/cec 199334 1 2023-12-05T09:26:33.328 INFO:tasks.workunit.client.1.smithi134.stdout:9/851: getdents d7/d8/d16/d52/d74/d97/deb 0 2023-12-05T09:26:33.328 INFO:tasks.workunit.client.1.smithi134.stdout:9/852: chown d7/d8/d14/d26/d7f/d92/fde 106797 1 2023-12-05T09:26:33.329 INFO:tasks.workunit.client.1.smithi134.stdout:9/853: read - d7/d5b/d5e/ff5 zero size 2023-12-05T09:26:33.331 INFO:tasks.workunit.client.0.smithi067.stdout:1/660: read d2/d4f/d14/d48/f4d [494180,66541] 0 2023-12-05T09:26:33.331 INFO:tasks.workunit.client.0.smithi067.stdout:1/661: dread - d2/f7e zero size 2023-12-05T09:26:33.333 INFO:tasks.workunit.client.1.smithi134.stdout:4/881: write d16/d18/dc5/dc2/df6/d63/fe1 [776754,112162] 0 2023-12-05T09:26:33.333 INFO:tasks.workunit.client.1.smithi134.stdout:4/882: dread - d16/d21/d48/f88 zero size 2023-12-05T09:26:33.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/935: mknod da/de/d16/d2d/c13d 0 2023-12-05T09:26:33.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/936: chown da/de/d11/d1d/d5f/dea/d119/c139 120 1 2023-12-05T09:26:33.340 INFO:tasks.workunit.client.1.smithi134.stdout:7/830: sync 2023-12-05T09:26:33.342 INFO:tasks.workunit.client.1.smithi134.stdout:1/989: creat d2/d9/d10/d5b/d12f/f164 x:0 0 0 2023-12-05T09:26:33.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/854: link d7/dee/d114/d8f/d8a/cba d7/d8/d16/c11f 0 2023-12-05T09:26:33.346 INFO:tasks.workunit.client.1.smithi134.stdout:8/937: creat da/de/d8a/d42/d99/df5/f13e x:0 0 0 2023-12-05T09:26:33.351 INFO:tasks.workunit.client.0.smithi067.stdout:1/662: write d2/d3/da6/fb1 [715698,128949] 0 2023-12-05T09:26:33.351 INFO:tasks.workunit.client.0.smithi067.stdout:1/663: write d2/d3/da6/dbb/fe0 [591821,19667] 0 2023-12-05T09:26:33.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/664: rmdir d2/d4f/d54/dd0 0 2023-12-05T09:26:33.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/665: chown d2/d3/f21 4261 1 2023-12-05T09:26:33.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/666: fsync d2/d4f/d14/f3c 0 2023-12-05T09:26:33.355 INFO:tasks.workunit.client.0.smithi067.stdout:1/667: write d2/d4f/fc1 [266056,81537] 0 2023-12-05T09:26:33.355 INFO:tasks.workunit.client.0.smithi067.stdout:1/668: chown d2/d5/d7/de/d1a/f1b 15370 1 2023-12-05T09:26:33.355 INFO:tasks.workunit.client.1.smithi134.stdout:1/990: rename d2/d9/d10/d30/d4a/cb6 to d2/d9/d10/d5b/d126/c165 0 2023-12-05T09:26:33.355 INFO:tasks.workunit.client.1.smithi134.stdout:1/991: dread - d2/d9/d8d/da2/db1/f13d zero size 2023-12-05T09:26:33.355 INFO:tasks.workunit.client.1.smithi134.stdout:1/992: chown d2/d27/d40/lc2 461913799 1 2023-12-05T09:26:33.355 INFO:tasks.workunit.client.1.smithi134.stdout:9/855: mknod d7/d5b/d5e/daa/db7/c120 0 2023-12-05T09:26:33.356 INFO:tasks.workunit.client.1.smithi134.stdout:9/856: chown d7/d7d 10 1 2023-12-05T09:26:33.361 INFO:tasks.workunit.client.1.smithi134.stdout:9/857: rename d7/dee/d114/d8f/d8a/c9b to d7/d5b/d5e/daa/c121 0 2023-12-05T09:26:33.365 INFO:tasks.workunit.client.1.smithi134.stdout:3/863: dwrite d4/d1f/fdd [0,4194304] 0 2023-12-05T09:26:33.367 INFO:tasks.workunit.client.1.smithi134.stdout:8/938: dread da/de/d11/d8b/d8c/d10b/f114 [0,4194304] 0 2023-12-05T09:26:33.367 INFO:tasks.workunit.client.0.smithi067.stdout:3/583: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/faa [0,4194304] 0 2023-12-05T09:26:33.368 INFO:tasks.workunit.client.1.smithi134.stdout:0/841: dwrite d13/d14/d30/d4b/d66/da0/fa1 [4194304,4194304] 0 2023-12-05T09:26:33.369 INFO:tasks.workunit.client.1.smithi134.stdout:0/842: truncate d13/d14/d15/d2a/d8c/ff0 1294340 0 2023-12-05T09:26:33.369 INFO:tasks.workunit.client.1.smithi134.stdout:0/843: chown d13/d14/d15/d67/f101 14 1 2023-12-05T09:26:33.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:33 smithi067 ceph-mon[107174]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:33.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:33 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3089749580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:26:33.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:33 smithi067 ceph-mon[107174]: pgmap v32: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 235 MiB/s rd, 302 MiB/s wr, 437 op/s 2023-12-05T09:26:33.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:33 smithi067 ceph-mon[107174]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:33.370 INFO:tasks.workunit.client.1.smithi134.stdout:8/939: truncate da/de/f108 1518278 0 2023-12-05T09:26:33.371 INFO:tasks.workunit.client.1.smithi134.stdout:3/864: symlink d4/d1f/d50/db4/d102/dab/ddc/l10f 0 2023-12-05T09:26:33.371 INFO:tasks.workunit.client.1.smithi134.stdout:3/865: dread - d4/d5/d6f/dc2/ddb/fe3 zero size 2023-12-05T09:26:33.371 INFO:tasks.workunit.client.1.smithi134.stdout:3/866: fdatasync d4/d5/f95 0 2023-12-05T09:26:33.371 INFO:tasks.workunit.client.1.smithi134.stdout:3/867: chown d4/d1f/d4e/f59 1544 1 2023-12-05T09:26:33.374 INFO:tasks.workunit.client.1.smithi134.stdout:9/858: dread d7/d10/fa6 [0,4194304] 0 2023-12-05T09:26:33.376 INFO:tasks.workunit.client.1.smithi134.stdout:9/859: mkdir d7/d8/d14/d26/d7f/d92/d122 0 2023-12-05T09:26:33.378 INFO:tasks.workunit.client.1.smithi134.stdout:0/844: write d13/d14/d30/fe9 [877853,47736] 0 2023-12-05T09:26:33.382 INFO:tasks.workunit.client.1.smithi134.stdout:9/860: creat d7/d8/d14/d26/f123 x:0 0 0 2023-12-05T09:26:33.383 INFO:tasks.workunit.client.1.smithi134.stdout:1/993: dread d2/d27/f59 [0,4194304] 0 2023-12-05T09:26:33.388 INFO:tasks.workunit.client.1.smithi134.stdout:9/861: mknod d7/d8/d16/d52/d74/c124 0 2023-12-05T09:26:33.388 INFO:tasks.workunit.client.1.smithi134.stdout:8/940: dread da/de/d11/fcc [0,4194304] 0 2023-12-05T09:26:33.388 INFO:tasks.workunit.client.1.smithi134.stdout:8/941: write da/de/d11/d1d/fec [497746,11497] 0 2023-12-05T09:26:33.388 INFO:tasks.workunit.client.1.smithi134.stdout:1/994: rename d2/d9/l16 to d2/d27/d40/d10a/l166 0 2023-12-05T09:26:33.391 INFO:tasks.workunit.client.1.smithi134.stdout:8/942: mkdir da/de/d16/d33/d13f 0 2023-12-05T09:26:33.394 INFO:tasks.workunit.client.1.smithi134.stdout:8/943: symlink da/de/d11/d1d/d5f/dea/d12e/l140 0 2023-12-05T09:26:33.394 INFO:tasks.workunit.client.1.smithi134.stdout:8/944: chown da/de/d96/d9d 94772631 1 2023-12-05T09:26:33.394 INFO:tasks.workunit.client.1.smithi134.stdout:8/945: read - da/de/d11/d1d/f13a zero size 2023-12-05T09:26:33.395 INFO:tasks.workunit.client.1.smithi134.stdout:8/946: rename da/de/d11/d1d/d5f/d9b/ca5 to da/de/d8a/d42/c141 0 2023-12-05T09:26:33.397 INFO:tasks.workunit.client.1.smithi134.stdout:8/947: creat da/de/d96/dc9/f142 x:0 0 0 2023-12-05T09:26:33.397 INFO:tasks.workunit.client.1.smithi134.stdout:4/883: dwrite d16/d21/d48/d80/ff9 [0,4194304] 0 2023-12-05T09:26:33.399 INFO:tasks.workunit.client.1.smithi134.stdout:7/831: dwrite d2/d7/dc/d22/f4a [0,4194304] 0 2023-12-05T09:26:33.399 INFO:tasks.workunit.client.1.smithi134.stdout:7/832: chown d2/d7/d2b/d94/d105 17751 1 2023-12-05T09:26:33.400 INFO:tasks.workunit.client.1.smithi134.stdout:7/833: getdents d2/df/d81 0 2023-12-05T09:26:33.404 INFO:tasks.workunit.client.1.smithi134.stdout:7/834: getdents d2/d8f 0 2023-12-05T09:26:33.404 INFO:tasks.workunit.client.1.smithi134.stdout:9/862: dread d7/d8/d2e/f76 [0,4194304] 0 2023-12-05T09:26:33.405 INFO:tasks.workunit.client.1.smithi134.stdout:9/863: rmdir d7/d8/d14/d26/d5a/da1 39 2023-12-05T09:26:33.408 INFO:tasks.workunit.client.1.smithi134.stdout:7/835: rename d2/d7/d6f/db9/fc7 to d2/d7/d93/dcf/ddd/f110 0 2023-12-05T09:26:33.411 INFO:tasks.workunit.client.1.smithi134.stdout:9/864: mkdir d7/d8/d16/d52/d74/d97/d99/d10b/d125 0 2023-12-05T09:26:33.411 INFO:tasks.workunit.client.1.smithi134.stdout:9/865: chown d7/d10/db3 6 1 2023-12-05T09:26:33.412 INFO:tasks.workunit.client.1.smithi134.stdout:7/836: truncate d2/df/f79 401013 0 2023-12-05T09:26:33.413 INFO:tasks.workunit.client.1.smithi134.stdout:9/866: link d7/d8/d14/d26/c30 d7/d5b/d5e/daa/db7/c126 0 2023-12-05T09:26:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:4/604: dwrite d0/d1d/d25/d32/f16 [0,4194304] 0 2023-12-05T09:26:33.417 INFO:tasks.workunit.client.0.smithi067.stdout:4/605: write d0/d1d/f7b [467079,99721] 0 2023-12-05T09:26:33.417 INFO:tasks.workunit.client.1.smithi134.stdout:7/837: write d2/d7/dc/d2e/d3a/fa5 [212100,119945] 0 2023-12-05T09:26:33.418 INFO:tasks.workunit.client.1.smithi134.stdout:8/948: dread da/de/d16/f26 [4194304,4194304] 0 2023-12-05T09:26:33.420 INFO:tasks.workunit.client.1.smithi134.stdout:0/845: dwrite d13/d14/d30/d4b/f42 [0,4194304] 0 2023-12-05T09:26:33.420 INFO:tasks.workunit.client.1.smithi134.stdout:0/846: read d13/d14/d15/d2a/f4a [4042199,61813] 0 2023-12-05T09:26:33.424 INFO:tasks.workunit.client.1.smithi134.stdout:0/847: symlink d13/d14/d15/d2a/d8c/db6/l11c 0 2023-12-05T09:26:33.428 INFO:tasks.workunit.client.1.smithi134.stdout:0/848: creat d13/d14/d15/d93/de4/d111/f11d x:0 0 0 2023-12-05T09:26:33.428 INFO:tasks.workunit.client.1.smithi134.stdout:0/849: truncate d13/d14/d30/d4b/d66/da0/daf/dde/d9d/fc7 4872819 0 2023-12-05T09:26:33.428 INFO:tasks.workunit.client.1.smithi134.stdout:0/850: write d13/d14/d15/dee/f116 [108410,63811] 0 2023-12-05T09:26:33.428 INFO:tasks.workunit.client.1.smithi134.stdout:0/851: chown d13/d14/d15/d67/fcb 22593 1 2023-12-05T09:26:33.428 INFO:tasks.workunit.client.1.smithi134.stdout:0/852: stat d13/d14 0 2023-12-05T09:26:33.428 INFO:tasks.workunit.client.1.smithi134.stdout:0/853: chown d13/d14/d15/d2a/d8c 488496 1 2023-12-05T09:26:33.429 INFO:tasks.workunit.client.1.smithi134.stdout:8/949: rmdir da/de/d8a/d42/d99/df5 39 2023-12-05T09:26:33.429 INFO:tasks.workunit.client.1.smithi134.stdout:0/854: getdents d13/d14/d30/d4b/d66/da0/daf/dce/d103 0 2023-12-05T09:26:33.429 INFO:tasks.workunit.client.1.smithi134.stdout:0/855: truncate d13/d14/f87 4452542 0 2023-12-05T09:26:33.432 INFO:tasks.workunit.client.1.smithi134.stdout:0/856: link d13/d14/d30/d4b/dc1/f11a d13/d14/d15/d67/d73/d119/f11e 0 2023-12-05T09:26:33.432 INFO:tasks.workunit.client.1.smithi134.stdout:0/857: chown d13/d14/d30/d4b/d66/da0/l105 32770 1 2023-12-05T09:26:33.433 INFO:tasks.workunit.client.0.smithi067.stdout:7/586: sync 2023-12-05T09:26:33.433 INFO:tasks.workunit.client.0.smithi067.stdout:7/587: creat d0/d9/d10/d37/d38/d64/d34/fbe x:0 0 0 2023-12-05T09:26:33.434 INFO:tasks.workunit.client.1.smithi134.stdout:8/950: creat da/de/d8a/d42/d99/df5/f143 x:0 0 0 2023-12-05T09:26:33.445 INFO:tasks.workunit.client.0.smithi067.stdout:7/588: creat d0/fbf x:0 0 0 2023-12-05T09:26:33.447 INFO:tasks.workunit.client.0.smithi067.stdout:7/589: creat d0/d45/fc0 x:0 0 0 2023-12-05T09:26:33.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/584: dwrite d9/da/d15/d17/d1a/d51/d66/f93 [0,4194304] 0 2023-12-05T09:26:33.453 INFO:tasks.workunit.client.0.smithi067.stdout:7/590: symlink d0/d9/lc1 0 2023-12-05T09:26:33.453 INFO:tasks.workunit.client.0.smithi067.stdout:3/585: mkdir d9/da/d15/d17/d1a/d51/dcd 0 2023-12-05T09:26:33.453 INFO:tasks.workunit.client.0.smithi067.stdout:1/669: dwrite d2/d4f/d14/d20/d83/f84 [0,4194304] 0 2023-12-05T09:26:33.455 INFO:tasks.workunit.client.1.smithi134.stdout:3/868: dwrite d4/d5/d7c/f109 [0,4194304] 0 2023-12-05T09:26:33.455 INFO:tasks.workunit.client.1.smithi134.stdout:3/869: readlink d4/d5/d45/l5f 0 2023-12-05T09:26:33.457 INFO:tasks.workunit.client.0.smithi067.stdout:3/586: mkdir d9/d24/dce 0 2023-12-05T09:26:33.457 INFO:tasks.workunit.client.1.smithi134.stdout:7/838: getdents d2/d7/d93/dcf/ddd 0 2023-12-05T09:26:33.458 INFO:tasks.workunit.client.1.smithi134.stdout:7/839: truncate d2/d7/d93/dcf/ddd/f110 128602 0 2023-12-05T09:26:33.461 INFO:tasks.workunit.client.1.smithi134.stdout:9/867: dwrite d7/d7d/f106 [0,4194304] 0 2023-12-05T09:26:33.463 INFO:tasks.workunit.client.0.smithi067.stdout:1/670: unlink d2/d3/da6/dbb/cb3 0 2023-12-05T09:26:33.464 INFO:tasks.workunit.client.1.smithi134.stdout:4/884: dwrite d16/d21/d48/d80/dae/d65/f72 [0,4194304] 0 2023-12-05T09:26:33.469 INFO:tasks.workunit.client.0.smithi067.stdout:3/587: mknod d9/da/d15/d17/d1a/ccf 0 2023-12-05T09:26:33.469 INFO:tasks.workunit.client.0.smithi067.stdout:3/588: stat d9/da/d15/d17/fab 0 2023-12-05T09:26:33.469 INFO:tasks.workunit.client.0.smithi067.stdout:1/671: unlink d2/d4f/d14/f3c 0 2023-12-05T09:26:33.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/672: mkdir d2/d5/d7/de/d19/d49/dec 0 2023-12-05T09:26:33.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/673: readlink d2/d4f/d14/d20/le8 0 2023-12-05T09:26:33.475 INFO:tasks.workunit.client.1.smithi134.stdout:0/858: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/d9d/fdf [0,4194304] 0 2023-12-05T09:26:33.482 INFO:tasks.workunit.client.1.smithi134.stdout:9/868: unlink d7/d8/d14/d26/d5a/fb2 0 2023-12-05T09:26:33.482 INFO:tasks.workunit.client.1.smithi134.stdout:9/869: chown d7/d8/d14/c4d 383779 1 2023-12-05T09:26:33.483 INFO:tasks.workunit.client.1.smithi134.stdout:3/870: mkdir d4/d80/d110 0 2023-12-05T09:26:33.483 INFO:tasks.workunit.client.1.smithi134.stdout:3/871: dread - d4/d1f/fe1 zero size 2023-12-05T09:26:33.484 INFO:tasks.workunit.client.1.smithi134.stdout:3/872: stat d4/d1f/d50/db4/d102/dab/ddc/cf4 0 2023-12-05T09:26:33.484 INFO:tasks.workunit.client.1.smithi134.stdout:7/840: unlink d2/d7/dc/d22/f4a 0 2023-12-05T09:26:33.484 INFO:tasks.workunit.client.1.smithi134.stdout:7/841: fsync d2/d7/dc/d2e/d3a/f5e 0 2023-12-05T09:26:33.484 INFO:tasks.workunit.client.1.smithi134.stdout:9/870: mknod d7/d5b/c127 0 2023-12-05T09:26:33.485 INFO:tasks.workunit.client.1.smithi134.stdout:3/873: mkdir d4/d5/d7c/d92/d111 0 2023-12-05T09:26:33.486 INFO:tasks.workunit.client.1.smithi134.stdout:9/871: mkdir d7/d8/d14/d26/d7f/d92/d122/d128 0 2023-12-05T09:26:33.489 INFO:tasks.workunit.client.1.smithi134.stdout:7/842: truncate d2/dd/f19 273838 0 2023-12-05T09:26:33.490 INFO:tasks.workunit.client.1.smithi134.stdout:9/872: creat d7/d8/d14/d26/d5a/da1/de4/f129 x:0 0 0 2023-12-05T09:26:33.494 INFO:tasks.workunit.client.1.smithi134.stdout:7/843: chown d2/d7/dc/c30 37965683 1 2023-12-05T09:26:33.494 INFO:tasks.workunit.client.1.smithi134.stdout:7/844: read d2/d7/dc/d22/f85 [1095971,43311] 0 2023-12-05T09:26:33.494 INFO:tasks.workunit.client.1.smithi134.stdout:9/873: rename d7/d8/d14/d26/d5a/d69/dc5 to d7/d8/d14/d26/d7f/d92/d122/d128/d12a 0 2023-12-05T09:26:33.494 INFO:tasks.workunit.client.1.smithi134.stdout:3/874: rmdir d4/d5 39 2023-12-05T09:26:33.498 INFO:tasks.workunit.client.1.smithi134.stdout:9/874: creat d7/d8/d14/d26/d7f/d92/d53/f12b x:0 0 0 2023-12-05T09:26:33.500 INFO:tasks.workunit.client.1.smithi134.stdout:9/875: symlink d7/d8/d14/d26/d5a/da1/l12c 0 2023-12-05T09:26:33.513 INFO:tasks.workunit.client.1.smithi134.stdout:9/876: link d7/dee/c113 d7/d8/d14/d26/d5a/da1/c12d 0 2023-12-05T09:26:33.513 INFO:tasks.workunit.client.1.smithi134.stdout:8/951: write da/de/f54 [3672427,78799] 0 2023-12-05T09:26:33.513 INFO:tasks.workunit.client.1.smithi134.stdout:8/952: read da/f2a [98936,10748] 0 2023-12-05T09:26:33.515 INFO:tasks.workunit.client.1.smithi134.stdout:8/953: mknod da/de/d8a/d42/d99/df5/c144 0 2023-12-05T09:26:33.515 INFO:tasks.workunit.client.1.smithi134.stdout:8/954: write da/de/d11/d1d/db8/f124 [2351735,98013] 0 2023-12-05T09:26:33.516 INFO:tasks.workunit.client.1.smithi134.stdout:5/857: sync 2023-12-05T09:26:33.516 INFO:tasks.workunit.client.1.smithi134.stdout:6/799: sync 2023-12-05T09:26:33.516 INFO:tasks.workunit.client.1.smithi134.stdout:5/858: fdatasync d0/d66/fb1 0 2023-12-05T09:26:33.516 INFO:tasks.workunit.client.1.smithi134.stdout:6/800: write d4/d78/fe5 [835669,69103] 0 2023-12-05T09:26:33.516 INFO:tasks.workunit.client.1.smithi134.stdout:6/801: symlink d4/d39/d42/d4f/d6d/d3a/da/lfc 2 2023-12-05T09:26:33.519 INFO:tasks.workunit.client.1.smithi134.stdout:2/888: sync 2023-12-05T09:26:33.521 INFO:tasks.workunit.client.0.smithi067.stdout:3/589: dwrite d9/d49/f9f [0,4194304] 0 2023-12-05T09:26:33.521 INFO:tasks.workunit.client.1.smithi134.stdout:4/885: dwrite d16/d18/d1b/f7d [0,4194304] 0 2023-12-05T09:26:33.521 INFO:tasks.workunit.client.1.smithi134.stdout:4/886: write d16/d7b/dce/d6e/daa/d3b/fe0 [821724,117181] 0 2023-12-05T09:26:33.521 INFO:tasks.workunit.client.1.smithi134.stdout:8/955: symlink da/de/d16/l145 0 2023-12-05T09:26:33.522 INFO:tasks.workunit.client.1.smithi134.stdout:5/859: link d0/dd/d37/d7d/cfc d0/d11/d61/d112/c12b 0 2023-12-05T09:26:33.522 INFO:tasks.workunit.client.1.smithi134.stdout:5/860: fsync d0/d1a/d1c/d3f/d5b/d5d/f86 0 2023-12-05T09:26:33.522 INFO:tasks.workunit.client.1.smithi134.stdout:8/956: write da/de/d11/d1d/f92 [625996,99325] 0 2023-12-05T09:26:33.523 INFO:tasks.workunit.client.1.smithi134.stdout:6/802: getdents d4/d39/d42/d4f/d6d/d3a/d75 0 2023-12-05T09:26:33.529 INFO:tasks.workunit.client.1.smithi134.stdout:4/887: creat d16/d21/d48/d80/dae/d12d/f136 x:0 0 0 2023-12-05T09:26:33.530 INFO:tasks.workunit.client.1.smithi134.stdout:7/845: dread d2/d7/dc/f2c [0,4194304] 0 2023-12-05T09:26:33.530 INFO:tasks.workunit.client.1.smithi134.stdout:7/846: fdatasync d2/df/d2a/d63/f7f 0 2023-12-05T09:26:33.530 INFO:tasks.workunit.client.1.smithi134.stdout:7/847: dread - d2/d7/d2b/d2d/fb5 zero size 2023-12-05T09:26:33.531 INFO:tasks.workunit.client.0.smithi067.stdout:3/590: mkdir d9/d62/dd0 0 2023-12-05T09:26:33.533 INFO:tasks.workunit.client.1.smithi134.stdout:0/859: dwrite d13/d14/d15/f21 [4194304,4194304] 0 2023-12-05T09:26:33.533 INFO:tasks.workunit.client.1.smithi134.stdout:5/861: rename d0/d11/d61/d75 to d0/d1a/d1c/d25/d4d/d12c 0 2023-12-05T09:26:33.533 INFO:tasks.workunit.client.1.smithi134.stdout:6/803: rename d4/d39/d42/d4f/d6d/d3a/d75 to d4/d39/d42/d4f/d6d/d3a/d75/dbc/dfd 22 2023-12-05T09:26:33.534 INFO:tasks.workunit.client.0.smithi067.stdout:7/591: write d0/f76 [7671169,26902] 0 2023-12-05T09:26:33.535 INFO:tasks.workunit.client.1.smithi134.stdout:8/957: getdents da/de/d96/d9d 0 2023-12-05T09:26:33.536 INFO:tasks.workunit.client.1.smithi134.stdout:8/958: getdents da/de/d96/d9d 0 2023-12-05T09:26:33.538 INFO:tasks.workunit.client.1.smithi134.stdout:7/848: read d2/d7/dc/d2e/f89 [45209,80228] 0 2023-12-05T09:26:33.538 INFO:tasks.workunit.client.1.smithi134.stdout:4/888: mknod d16/d18/dc5/c137 0 2023-12-05T09:26:33.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/606: dwrite d0/d1d/d53/d62/fc2 [0,4194304] 0 2023-12-05T09:26:33.541 INFO:tasks.workunit.client.1.smithi134.stdout:5/862: getdents d0/d66 0 2023-12-05T09:26:33.541 INFO:tasks.workunit.client.1.smithi134.stdout:8/959: creat da/de/d11/f146 x:0 0 0 2023-12-05T09:26:33.544 INFO:tasks.workunit.client.1.smithi134.stdout:5/863: mknod d0/d1a/d1c/d25/d4d/d9e/d122/c12d 0 2023-12-05T09:26:33.544 INFO:tasks.workunit.client.1.smithi134.stdout:8/960: truncate f9 4716882 0 2023-12-05T09:26:33.544 INFO:tasks.workunit.client.1.smithi134.stdout:8/961: truncate da/de/d8a/d42/d99/df5/f13e 896075 0 2023-12-05T09:26:33.544 INFO:tasks.workunit.client.1.smithi134.stdout:8/962: chown da 7 1 2023-12-05T09:26:33.545 INFO:tasks.workunit.client.1.smithi134.stdout:8/963: chown da/de/f4c 6139518 1 2023-12-05T09:26:33.549 INFO:tasks.workunit.client.0.smithi067.stdout:3/591: mknod d9/cd1 0 2023-12-05T09:26:33.549 INFO:tasks.workunit.client.1.smithi134.stdout:0/860: rename d13/d14/d30/d4b/fe2 to d13/d14/d30/d4b/d66/da0/daf/dde/d9d/da5/dfd/f11f 0 2023-12-05T09:26:33.549 INFO:tasks.workunit.client.0.smithi067.stdout:3/592: write d9/da/d15/d17/d1a/d51/d66/d82/fb4 [2931484,79531] 0 2023-12-05T09:26:33.555 INFO:tasks.workunit.client.1.smithi134.stdout:8/964: rename da/de/f4c to da/de/d11/d1d/d5f/dea/f147 0 2023-12-05T09:26:33.556 INFO:tasks.workunit.client.1.smithi134.stdout:8/965: dread - da/de/d11/d8b/f133 zero size 2023-12-05T09:26:33.556 INFO:tasks.workunit.client.0.smithi067.stdout:7/592: rename d0/d9/d40/d48 to d0/d9/d40/d7a/dad/dc2 0 2023-12-05T09:26:33.557 INFO:tasks.workunit.client.0.smithi067.stdout:7/593: dread - d0/d9/d10/d37/d38/d64/d5a/fa2 zero size 2023-12-05T09:26:33.557 INFO:tasks.workunit.client.0.smithi067.stdout:7/594: stat d0/d9/d40/f77 0 2023-12-05T09:26:33.557 INFO:tasks.workunit.client.0.smithi067.stdout:7/595: chown d0/d9/d10/d37/d38/d64/d54/l81 1 1 2023-12-05T09:26:33.557 INFO:tasks.workunit.client.0.smithi067.stdout:7/596: stat d0/d9/d40/d7a/dad/dc2/l74 0 2023-12-05T09:26:33.557 INFO:tasks.workunit.client.0.smithi067.stdout:5/638: sync 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:8/966: creat da/de/d16/f148 x:0 0 0 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:3/875: dwrite d4/f2f [0,4194304] 0 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:3/876: write d4/d5/f32 [4213711,1046] 0 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:2/889: dread f17 [0,4194304] 0 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:3/877: write d4/d5/d7c/d92/fd1 [255436,95658] 0 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:3/878: dread - d4/d5/d45/d86/f9a zero size 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:0/861: symlink d13/d14/d30/d4b/d66/da0/da2/l120 0 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:2/890: creat d19/d3f/dbf/d10f/f121 x:0 0 0 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:2/891: chown d19/d28/f2a 33445 1 2023-12-05T09:26:33.562 INFO:tasks.workunit.client.1.smithi134.stdout:2/892: stat d19/d28/d31/d38/f6a 0 2023-12-05T09:26:33.565 INFO:tasks.workunit.client.1.smithi134.stdout:9/877: write d7/d5b/d5e/daa/db7/fb9 [1244693,55831] 0 2023-12-05T09:26:33.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/879: creat d4/d1f/d50/db4/d102/d99/f112 x:0 0 0 2023-12-05T09:26:33.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/880: write d4/d80/f93 [274035,61135] 0 2023-12-05T09:26:33.566 INFO:tasks.workunit.client.1.smithi134.stdout:3/881: stat d4/d1f/df6 0 2023-12-05T09:26:33.570 INFO:tasks.workunit.client.0.smithi067.stdout:4/607: dread d0/d1d/d25/d32/f3f [0,4194304] 0 2023-12-05T09:26:33.571 INFO:tasks.workunit.client.0.smithi067.stdout:1/674: dwrite d2/d4f/d15/d60/fae [0,4194304] 0 2023-12-05T09:26:33.571 INFO:tasks.workunit.client.1.smithi134.stdout:0/862: creat d13/d14/d15/d93/de4/d111/d112/f121 x:0 0 0 2023-12-05T09:26:33.571 INFO:tasks.workunit.client.0.smithi067.stdout:4/608: truncate d0/d1d/d24/f7f 2242726 0 2023-12-05T09:26:33.576 INFO:tasks.workunit.client.1.smithi134.stdout:0/863: creat d13/d14/d30/d4b/d66/da0/daf/dde/d9d/f122 x:0 0 0 2023-12-05T09:26:33.577 INFO:tasks.workunit.client.0.smithi067.stdout:1/675: mknod d2/d4f/d14/d20/d83/d78/ced 0 2023-12-05T09:26:33.578 INFO:tasks.workunit.client.0.smithi067.stdout:4/609: mkdir d0/d1d/d53/da8/da9/d15/dd0/dd9 0 2023-12-05T09:26:33.578 INFO:tasks.workunit.client.0.smithi067.stdout:4/610: creat d0/d1d/d4d/d8d/fda x:0 0 0 2023-12-05T09:26:33.580 INFO:tasks.workunit.client.1.smithi134.stdout:3/882: mknod d4/c113 0 2023-12-05T09:26:33.582 INFO:tasks.workunit.client.0.smithi067.stdout:1/676: mkdir d2/d4f/d15/dee 0 2023-12-05T09:26:33.582 INFO:tasks.workunit.client.0.smithi067.stdout:1/677: truncate d2/fa7 293865 0 2023-12-05T09:26:33.583 INFO:tasks.workunit.client.1.smithi134.stdout:9/878: write d7/d8/d14/d26/d7f/d92/d53/dd4/ff6 [1880050,12260] 0 2023-12-05T09:26:33.584 INFO:tasks.workunit.client.0.smithi067.stdout:5/639: dread db/df/d1a/f4c [0,4194304] 0 2023-12-05T09:26:33.584 INFO:tasks.workunit.client.0.smithi067.stdout:5/640: dread - db/df/d35/d63/d75/fdc zero size 2023-12-05T09:26:33.585 INFO:tasks.workunit.client.1.smithi134.stdout:1/995: sync 2023-12-05T09:26:33.585 INFO:tasks.workunit.client.0.smithi067.stdout:3/593: dread d9/da/d15/d17/d2b/f3e [4194304,4194304] 0 2023-12-05T09:26:33.586 INFO:tasks.workunit.client.1.smithi134.stdout:9/879: truncate d7/d8/d16/f33 612444 0 2023-12-05T09:26:33.588 INFO:tasks.workunit.client.0.smithi067.stdout:5/641: mkdir db/df/d3f/dd9/de7 0 2023-12-05T09:26:33.589 INFO:tasks.workunit.client.1.smithi134.stdout:1/996: rename d2/d9/d10/d30/lb5 to d2/d9/d8d/da2/l167 0 2023-12-05T09:26:33.591 INFO:tasks.workunit.client.1.smithi134.stdout:1/997: rmdir d2/d9/d10/d30/d66/da9/d13c 39 2023-12-05T09:26:33.591 INFO:tasks.workunit.client.0.smithi067.stdout:3/594: truncate d9/da/d15/d17/f32 671914 0 2023-12-05T09:26:33.594 INFO:tasks.workunit.client.1.smithi134.stdout:1/998: write d2/d27/fa4 [4482540,70184] 0 2023-12-05T09:26:33.601 INFO:tasks.workunit.client.0.smithi067.stdout:5/642: link db/df/d3f/fc3 db/df/d1a/d1d/fe8 0 2023-12-05T09:26:33.602 INFO:tasks.workunit.client.1.smithi134.stdout:8/967: write f9 [2864683,14019] 0 2023-12-05T09:26:33.602 INFO:tasks.workunit.client.1.smithi134.stdout:8/968: chown da/de/d16/dbe/f11f 1 1 2023-12-05T09:26:33.602 INFO:tasks.workunit.client.1.smithi134.stdout:8/969: write da/de/d8a/d42/d99/dc8/d72/fa6 [587133,42495] 0 2023-12-05T09:26:33.602 INFO:tasks.workunit.client.1.smithi134.stdout:6/804: dwrite d4/d39/d42/d4f/d6d/d3a/da/f77 [0,4194304] 0 2023-12-05T09:26:33.602 INFO:tasks.workunit.client.1.smithi134.stdout:6/805: write d4/d32/fea [201562,107480] 0 2023-12-05T09:26:33.604 INFO:tasks.workunit.client.0.smithi067.stdout:3/595: symlink d9/da/ld2 0 2023-12-05T09:26:33.604 INFO:tasks.workunit.client.1.smithi134.stdout:7/849: dread d2/df/d2a/d36/f5c [0,4194304] 0 2023-12-05T09:26:33.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/643: mknod db/df/d1a/d1d/ce9 0 2023-12-05T09:26:33.611 INFO:tasks.workunit.client.0.smithi067.stdout:5/644: chown db/df/d3f 980 1 2023-12-05T09:26:33.613 INFO:tasks.workunit.client.1.smithi134.stdout:6/806: mknod d4/d39/d42/d4f/d6d/d9f/dc4/cfe 0 2023-12-05T09:26:33.614 INFO:tasks.workunit.client.0.smithi067.stdout:3/596: rename d9/d62/f8a to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/fd3 0 2023-12-05T09:26:33.624 INFO:tasks.workunit.client.0.smithi067.stdout:7/597: dwrite d0/d9/f6f [0,4194304] 0 2023-12-05T09:26:33.626 INFO:tasks.workunit.client.1.smithi134.stdout:6/807: rename d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/le9 to d4/d39/d42/d4f/d6d/d3a/d75/d86/lff 0 2023-12-05T09:26:33.626 INFO:tasks.workunit.client.1.smithi134.stdout:7/850: dread d2/df/d2a/d63/f77 [0,4194304] 0 2023-12-05T09:26:33.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:33 smithi134 ceph-mon[116304]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:33.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:33 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3089749580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:26:33.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:33 smithi134 ceph-mon[116304]: pgmap v32: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 235 MiB/s rd, 302 MiB/s wr, 437 op/s 2023-12-05T09:26:33.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:33 smithi134 ceph-mon[116304]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:26:33.629 INFO:tasks.workunit.client.1.smithi134.stdout:6/808: truncate d4/d39/d42/d4f/d6d/d3a/f8d 14882 0 2023-12-05T09:26:33.632 INFO:tasks.workunit.client.1.smithi134.stdout:1/999: write d2/d9/d10/d30/d66/da9/feb [2968066,33697] 0 2023-12-05T09:26:33.633 INFO:tasks.workunit.client.1.smithi134.stdout:2/893: dwrite d19/d76/db9/f10a [0,4194304] 0 2023-12-05T09:26:33.633 INFO:tasks.workunit.client.1.smithi134.stdout:2/894: write d19/d3f/f5a [583038,32064] 0 2023-12-05T09:26:33.633 INFO:tasks.workunit.client.1.smithi134.stdout:6/809: getdents d4/d32/d57 0 2023-12-05T09:26:33.636 INFO:tasks.workunit.client.1.smithi134.stdout:6/810: mkdir d4/d39/d42/d4f/d6d/d9f/dc4/d100 0 2023-12-05T09:26:33.637 INFO:tasks.workunit.client.1.smithi134.stdout:2/895: readlink l11 0 2023-12-05T09:26:33.639 INFO:tasks.workunit.client.0.smithi067.stdout:1/678: rmdir d2/d4f/d14/d20/d83/d78 39 2023-12-05T09:26:33.641 INFO:tasks.workunit.client.1.smithi134.stdout:3/883: dwrite d4/d5/d45/d60/f72 [0,4194304] 0 2023-12-05T09:26:33.644 INFO:tasks.workunit.client.1.smithi134.stdout:3/884: getdents d4/d5/d45/d86/db5/dc3 0 2023-12-05T09:26:33.646 INFO:tasks.workunit.client.0.smithi067.stdout:1/679: symlink d2/d4f/d15/lef 0 2023-12-05T09:26:33.646 INFO:tasks.workunit.client.0.smithi067.stdout:1/680: truncate d2/f7e 845932 0 2023-12-05T09:26:33.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/864: dwrite d0/d1a/d3a/f74 [0,4194304] 0 2023-12-05T09:26:33.648 INFO:tasks.workunit.client.0.smithi067.stdout:1/681: truncate d2/f5c 3297506 0 2023-12-05T09:26:33.660 INFO:tasks.workunit.client.0.smithi067.stdout:1/682: creat d2/d5/d7/de/d19/d8f/d98/ff0 x:0 0 0 2023-12-05T09:26:33.661 INFO:tasks.workunit.client.0.smithi067.stdout:1/683: write d2/d5/d7/de/d19/d49/d5f/f9f [2129808,20742] 0 2023-12-05T09:26:33.661 INFO:tasks.workunit.client.0.smithi067.stdout:1/684: readlink d2/d4f/d14/d48/lc6 0 2023-12-05T09:26:33.662 INFO:tasks.workunit.client.0.smithi067.stdout:1/685: read d2/f7e [62338,56285] 0 2023-12-05T09:26:33.665 INFO:tasks.workunit.client.0.smithi067.stdout:7/598: dwrite d0/d9/d40/d7a/f87 [0,4194304] 0 2023-12-05T09:26:33.670 INFO:tasks.workunit.client.1.smithi134.stdout:8/970: dread da/de/d8a/d42/d99/dc8/f61 [0,4194304] 0 2023-12-05T09:26:33.670 INFO:tasks.workunit.client.1.smithi134.stdout:8/971: read da/de/d43/fae [5673,121739] 0 2023-12-05T09:26:33.671 INFO:tasks.workunit.client.0.smithi067.stdout:4/611: dwrite d0/d9/f78 [0,4194304] 0 2023-12-05T09:26:33.671 INFO:tasks.workunit.client.0.smithi067.stdout:3/597: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/fc4 [0,4194304] 0 2023-12-05T09:26:33.673 INFO:tasks.workunit.client.1.smithi134.stdout:2/896: read d19/d28/d31/d38/db7/fc2 [1537877,81671] 0 2023-12-05T09:26:33.673 INFO:tasks.workunit.client.1.smithi134.stdout:8/972: symlink da/de/d11/d1d/d5f/def/l149 0 2023-12-05T09:26:33.676 INFO:tasks.workunit.client.0.smithi067.stdout:7/599: mkdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/dc3 0 2023-12-05T09:26:33.677 INFO:tasks.workunit.client.0.smithi067.stdout:7/600: write d0/f11 [3648798,94940] 0 2023-12-05T09:26:33.677 INFO:tasks.workunit.client.0.smithi067.stdout:7/601: stat d0/d9/d10/d37/d38/d64/d5a/f99 0 2023-12-05T09:26:33.677 INFO:tasks.workunit.client.1.smithi134.stdout:8/973: rename da/de/d11/d1d/d5f/d9b/ffe to da/de/d11/d1d/d5f/f14a 0 2023-12-05T09:26:33.681 INFO:tasks.workunit.client.1.smithi134.stdout:2/897: mkdir d19/d28/d63/d70/d122 0 2023-12-05T09:26:33.684 INFO:tasks.workunit.client.1.smithi134.stdout:8/974: creat da/de/d8a/f14b x:0 0 0 2023-12-05T09:26:33.686 INFO:tasks.workunit.client.0.smithi067.stdout:1/686: getdents d2/d3/da6 0 2023-12-05T09:26:33.687 INFO:tasks.workunit.client.0.smithi067.stdout:4/612: creat d0/d1d/d25/d2c/d34/d4e/daa/fdb x:0 0 0 2023-12-05T09:26:33.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/645: dwrite db/df/d35/d63/d75/f7d [0,4194304] 0 2023-12-05T09:26:33.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/646: chown db/df/d82/fb3 54132957 1 2023-12-05T09:26:33.689 INFO:tasks.workunit.client.0.smithi067.stdout:7/602: mkdir d0/d9/d56/dc4 0 2023-12-05T09:26:33.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/851: dwrite d2/d7/d2b/d2d/ff1 [0,4194304] 0 2023-12-05T09:26:33.696 INFO:tasks.workunit.client.1.smithi134.stdout:2/898: rename d19/d28/f33 to d19/d28/d31/dd3/f123 0 2023-12-05T09:26:33.701 INFO:tasks.workunit.client.1.smithi134.stdout:3/885: dwrite d4/d1f/f35 [0,4194304] 0 2023-12-05T09:26:33.701 INFO:tasks.workunit.client.1.smithi134.stdout:8/975: symlink da/de/d11/d1d/d70/l14c 0 2023-12-05T09:26:33.701 INFO:tasks.workunit.client.1.smithi134.stdout:8/976: truncate da/de/d11/d1d/d5f/f14a 575006 0 2023-12-05T09:26:33.710 INFO:tasks.workunit.client.1.smithi134.stdout:7/852: link d2/df/d2a/d36/f5c d2/d7/d93/dcf/ddd/f111 0 2023-12-05T09:26:33.710 INFO:tasks.workunit.client.0.smithi067.stdout:1/687: write d2/d5/d7/de/d1a/f44 [1558188,14072] 0 2023-12-05T09:26:33.714 INFO:tasks.workunit.client.1.smithi134.stdout:3/886: mknod d4/d5/d45/d86/c114 0 2023-12-05T09:26:33.714 INFO:tasks.workunit.client.1.smithi134.stdout:8/977: link da/de/d8a/d42/d99/d106/c121 da/de/d16/dbe/c14d 0 2023-12-05T09:26:33.718 INFO:tasks.workunit.client.0.smithi067.stdout:7/603: mknod d0/d9/d56/d8e/daa/cc5 0 2023-12-05T09:26:33.720 INFO:tasks.workunit.client.0.smithi067.stdout:1/688: dread - d2/d5/d7/de/d1a/faf zero size 2023-12-05T09:26:33.727 INFO:tasks.workunit.client.0.smithi067.stdout:7/604: creat d0/d9/d10/d37/d38/d64/d34/d67/d72/da4/fc6 x:0 0 0 2023-12-05T09:26:33.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/689: rename d2/d4f/d15/d60/d68/f85 to d2/d4f/d15/d74/de7/ff1 0 2023-12-05T09:26:33.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/690: truncate d2/d4f/d54/fe4 685999 0 2023-12-05T09:26:33.727 INFO:tasks.workunit.client.0.smithi067.stdout:3/598: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/fcb [0,4194304] 0 2023-12-05T09:26:33.734 INFO:tasks.workunit.client.0.smithi067.stdout:1/691: mkdir d2/d5/d7/de/d19/df2 0 2023-12-05T09:26:33.735 INFO:tasks.workunit.client.1.smithi134.stdout:7/853: dread d2/f8 [0,4194304] 0 2023-12-05T09:26:33.735 INFO:tasks.workunit.client.0.smithi067.stdout:3/599: link d9/da/d15/d17/l5d d9/da/d3b/ld4 0 2023-12-05T09:26:33.735 INFO:tasks.workunit.client.0.smithi067.stdout:7/605: write d0/d9/f71 [502332,101559] 0 2023-12-05T09:26:33.737 INFO:tasks.workunit.client.0.smithi067.stdout:4/613: rmdir d0/d1d/d25/d2c/d34 39 2023-12-05T09:26:33.741 INFO:tasks.workunit.client.0.smithi067.stdout:7/606: write d0/d9/d10/d37/d38/f7f [50762,74668] 0 2023-12-05T09:26:33.744 INFO:tasks.workunit.client.1.smithi134.stdout:7/854: creat d2/d7/d2b/d94/d105/f112 x:0 0 0 2023-12-05T09:26:33.745 INFO:tasks.workunit.client.1.smithi134.stdout:7/855: readlink d2/d7/dc/d2e/d3a/l3f 0 2023-12-05T09:26:33.745 INFO:tasks.workunit.client.1.smithi134.stdout:7/856: truncate d2/d7/dc/d2e/d3a/d6d/d9e/f109 622211 0 2023-12-05T09:26:33.745 INFO:tasks.workunit.client.1.smithi134.stdout:7/857: readlink d2/d7/lae 0 2023-12-05T09:26:33.746 INFO:tasks.workunit.client.0.smithi067.stdout:3/600: rename d9/da/d15/d17/d2b/f3e to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/fd5 0 2023-12-05T09:26:33.749 INFO:tasks.workunit.client.1.smithi134.stdout:7/858: mkdir d2/dd/d113 0 2023-12-05T09:26:33.752 INFO:tasks.workunit.client.0.smithi067.stdout:4/614: mkdir d0/d1d/d2a/d93/ddc 0 2023-12-05T09:26:33.752 INFO:tasks.workunit.client.0.smithi067.stdout:4/615: truncate d0/d1d/d53/d62/f83 1676277 0 2023-12-05T09:26:33.754 INFO:tasks.workunit.client.1.smithi134.stdout:6/811: dwrite d4/d39/f51 [0,4194304] 0 2023-12-05T09:26:33.754 INFO:tasks.workunit.client.1.smithi134.stdout:6/812: write d4/d39/d42/d4f/d6d/d3a/d75/d59/f7c [2525692,44916] 0 2023-12-05T09:26:33.754 INFO:tasks.workunit.client.1.smithi134.stdout:6/813: truncate d4/d39/d42/d4f/d6d/d3a/d75/ff2 585589 0 2023-12-05T09:26:33.757 INFO:tasks.workunit.client.0.smithi067.stdout:1/692: dread d2/d5/d7/de/d19/d71/fb5 [0,4194304] 0 2023-12-05T09:26:33.758 INFO:tasks.workunit.client.0.smithi067.stdout:1/693: write d2/d4f/d54/f8c [4252544,4875] 0 2023-12-05T09:26:33.760 INFO:tasks.workunit.client.1.smithi134.stdout:6/814: creat d4/d32/f101 x:0 0 0 2023-12-05T09:26:33.760 INFO:tasks.workunit.client.1.smithi134.stdout:6/815: dread - d4/d32/fbf zero size 2023-12-05T09:26:33.760 INFO:tasks.workunit.client.0.smithi067.stdout:1/694: rmdir d2/d3 39 2023-12-05T09:26:33.761 INFO:tasks.workunit.client.0.smithi067.stdout:1/695: getdents d2/d5/d7/de/d19/d49/dec 0 2023-12-05T09:26:33.761 INFO:tasks.workunit.client.1.smithi134.stdout:6/816: write d4/d39/d42/f4d [269724,907] 0 2023-12-05T09:26:33.761 INFO:tasks.workunit.client.1.smithi134.stdout:6/817: creat d4/d39/d42/d4f/d6d/d3a/d75/d59/f102 x:0 0 0 2023-12-05T09:26:33.761 INFO:tasks.workunit.client.1.smithi134.stdout:6/818: truncate d4/d39/d42/d4f/ff7 141474 0 2023-12-05T09:26:33.761 INFO:tasks.workunit.client.1.smithi134.stdout:6/819: creat d4/d39/d42/d4f/f103 x:0 0 0 2023-12-05T09:26:33.761 INFO:tasks.workunit.client.1.smithi134.stdout:6/820: chown d4/d32/fbf 313386 1 2023-12-05T09:26:33.764 INFO:tasks.workunit.client.0.smithi067.stdout:7/607: dread d0/d9/d10/d1d/f6d [0,4194304] 0 2023-12-05T09:26:33.766 INFO:tasks.workunit.client.0.smithi067.stdout:8/644: sync 2023-12-05T09:26:33.767 INFO:tasks.workunit.client.1.smithi134.stdout:7/859: write d2/d7/dc/d2e/d3a/f4e [3770185,20065] 0 2023-12-05T09:26:33.769 INFO:tasks.workunit.client.1.smithi134.stdout:3/887: dwrite d4/f34 [0,4194304] 0 2023-12-05T09:26:33.770 INFO:tasks.workunit.client.1.smithi134.stdout:5/865: dwrite d0/d1a/d3a/f74 [0,4194304] 0 2023-12-05T09:26:33.770 INFO:tasks.workunit.client.1.smithi134.stdout:5/866: chown d0/dd/le8 17475799 1 2023-12-05T09:26:33.771 INFO:tasks.workunit.client.0.smithi067.stdout:3/601: write d9/f78 [3573568,124251] 0 2023-12-05T09:26:33.772 INFO:tasks.workunit.client.0.smithi067.stdout:5/647: dwrite db/f14 [0,4194304] 0 2023-12-05T09:26:33.774 INFO:tasks.workunit.client.1.smithi134.stdout:6/821: creat d4/d32/d74/f104 x:0 0 0 2023-12-05T09:26:33.774 INFO:tasks.workunit.client.1.smithi134.stdout:6/822: fdatasync d4/d39/f53 0 2023-12-05T09:26:33.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/899: dwrite d19/d3a/f44 [0,4194304] 0 2023-12-05T09:26:33.779 INFO:tasks.workunit.client.1.smithi134.stdout:6/823: creat d4/f105 x:0 0 0 2023-12-05T09:26:33.782 INFO:tasks.workunit.client.1.smithi134.stdout:4/889: sync 2023-12-05T09:26:33.782 INFO:tasks.workunit.client.1.smithi134.stdout:4/890: stat d16/d21/de5 0 2023-12-05T09:26:33.783 INFO:tasks.workunit.client.1.smithi134.stdout:3/888: truncate d4/d1f/d50/d52/fbe 2614216 0 2023-12-05T09:26:33.783 INFO:tasks.workunit.client.0.smithi067.stdout:7/608: rename d0/d45/fc0 to d0/d9/d10/d37/d38/d64/d34/d67/fc7 0 2023-12-05T09:26:33.783 INFO:tasks.workunit.client.0.smithi067.stdout:0/763: sync 2023-12-05T09:26:33.784 INFO:tasks.workunit.client.0.smithi067.stdout:6/547: sync 2023-12-05T09:26:33.784 INFO:tasks.workunit.client.0.smithi067.stdout:9/836: sync 2023-12-05T09:26:33.784 INFO:tasks.workunit.client.0.smithi067.stdout:2/563: sync 2023-12-05T09:26:33.784 INFO:tasks.workunit.client.0.smithi067.stdout:2/564: stat d0/d25/d3f/d83/l9c 0 2023-12-05T09:26:33.786 INFO:tasks.workunit.client.0.smithi067.stdout:8/645: rename d5/dc/d1a/d20/d2d/d7f/f93 to d5/da/d30/d7c/fbb 0 2023-12-05T09:26:33.786 INFO:tasks.workunit.client.0.smithi067.stdout:4/616: dread d0/d1d/d25/f29 [0,4194304] 0 2023-12-05T09:26:33.786 INFO:tasks.workunit.client.0.smithi067.stdout:4/617: truncate d0/d1d/d2b/fca 262054 0 2023-12-05T09:26:33.786 INFO:tasks.workunit.client.0.smithi067.stdout:4/618: stat d0/d1d/d3c/d51/l7d 0 2023-12-05T09:26:33.787 INFO:tasks.workunit.client.0.smithi067.stdout:3/602: dread f6 [0,4194304] 0 2023-12-05T09:26:33.788 INFO:tasks.workunit.client.1.smithi134.stdout:8/978: dwrite da/de/d8a/d42/d99/dc8/fe7 [0,4194304] 0 2023-12-05T09:26:33.788 INFO:tasks.workunit.client.1.smithi134.stdout:8/979: chown da/de/d4d/f118 594778264 1 2023-12-05T09:26:33.788 INFO:tasks.workunit.client.1.smithi134.stdout:8/980: chown da/de/d8a/d42/d99/df5 655848 1 2023-12-05T09:26:33.789 INFO:tasks.workunit.client.1.smithi134.stdout:8/981: chown da/de/d16/d98/f112 46462 1 2023-12-05T09:26:33.789 INFO:tasks.workunit.client.1.smithi134.stdout:5/867: truncate d0/d1a/d1c/d25/d4d/f70 1494289 0 2023-12-05T09:26:33.789 INFO:tasks.workunit.client.1.smithi134.stdout:5/868: rename d0/d50 to d0/d50/d12e 22 2023-12-05T09:26:33.789 INFO:tasks.workunit.client.1.smithi134.stdout:5/869: write d0/d1a/d1c/d3f/d81/d8e/fd9 [1008056,120728] 0 2023-12-05T09:26:33.792 INFO:tasks.workunit.client.1.smithi134.stdout:2/900: creat d19/d28/d9e/f124 x:0 0 0 2023-12-05T09:26:33.792 INFO:tasks.workunit.client.1.smithi134.stdout:2/901: chown d19/d28/d2b/cfb 1421887925 1 2023-12-05T09:26:33.792 INFO:tasks.workunit.client.1.smithi134.stdout:2/902: chown d19/d28/d31/d6f/ccc 0 1 2023-12-05T09:26:33.792 INFO:tasks.workunit.client.0.smithi067.stdout:0/764: symlink d3/d7/d3c/d66/l110 0 2023-12-05T09:26:33.792 INFO:tasks.workunit.client.0.smithi067.stdout:0/765: write d3/d7/d3c/d67/d59/d4e/f101 [1016547,37130] 0 2023-12-05T09:26:33.794 INFO:tasks.workunit.client.0.smithi067.stdout:6/548: link da/d10/d1e/d17/d2f/f77 da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fc0 0 2023-12-05T09:26:33.796 INFO:tasks.workunit.client.0.smithi067.stdout:8/646: mknod d5/dc/d1a/d62/cbc 0 2023-12-05T09:26:33.796 INFO:tasks.workunit.client.0.smithi067.stdout:8/647: getdents d5/d3b/db3 0 2023-12-05T09:26:33.796 INFO:tasks.workunit.client.0.smithi067.stdout:8/648: fsync d5/dc/d1a/d20/d2d/d41/f86 0 2023-12-05T09:26:33.797 INFO:tasks.workunit.client.1.smithi134.stdout:3/889: symlink d4/d5/d45/df2/d108/l115 0 2023-12-05T09:26:33.797 INFO:tasks.workunit.client.1.smithi134.stdout:8/982: mkdir da/de/d96/dc9/d14e 0 2023-12-05T09:26:33.798 INFO:tasks.workunit.client.1.smithi134.stdout:4/891: dread d16/d18/d1b/d24/f61 [0,4194304] 0 2023-12-05T09:26:33.803 INFO:tasks.workunit.client.0.smithi067.stdout:4/619: mknod d0/d1d/d2a/dba/cdd 0 2023-12-05T09:26:33.803 INFO:tasks.workunit.client.0.smithi067.stdout:4/620: creat d0/d1d/d2a/fde x:0 0 0 2023-12-05T09:26:33.803 INFO:tasks.workunit.client.0.smithi067.stdout:4/621: fdatasync d0/d1d/d24/f73 0 2023-12-05T09:26:33.808 INFO:tasks.workunit.client.1.smithi134.stdout:4/892: rename d16/d21/d47/fe9 to d16/d7b/dce/d6e/daa/d3b/f138 0 2023-12-05T09:26:33.811 INFO:tasks.workunit.client.0.smithi067.stdout:8/649: write d5/dc/f96 [156939,127503] 0 2023-12-05T09:26:33.811 INFO:tasks.workunit.client.0.smithi067.stdout:8/650: chown d5/dc/fac 411856278 1 2023-12-05T09:26:33.814 INFO:tasks.workunit.client.0.smithi067.stdout:3/603: rmdir d9/d62 39 2023-12-05T09:26:33.814 INFO:tasks.workunit.client.0.smithi067.stdout:3/604: creat d9/da/d15/d17/d2b/fd6 x:0 0 0 2023-12-05T09:26:33.816 INFO:tasks.workunit.client.0.smithi067.stdout:9/837: read d1b/d25/d54/d5c/d81/d96/f9c [975449,93481] 0 2023-12-05T09:26:33.818 INFO:tasks.workunit.client.0.smithi067.stdout:0/766: mknod d3/d6b/d6e/c111 0 2023-12-05T09:26:33.818 INFO:tasks.workunit.client.1.smithi134.stdout:7/860: dwrite d2/d7/d65/f92 [0,4194304] 0 2023-12-05T09:26:33.821 INFO:tasks.workunit.client.1.smithi134.stdout:4/893: rmdir d16/d7b/dce/d6e/daa/d3b/dcf 39 2023-12-05T09:26:33.822 INFO:tasks.workunit.client.1.smithi134.stdout:4/894: creat d16/d18/dc5/dc2/f139 x:0 0 0 2023-12-05T09:26:33.828 INFO:tasks.workunit.client.0.smithi067.stdout:2/565: dread d0/d2f/d39/f89 [0,4194304] 0 2023-12-05T09:26:33.828 INFO:tasks.workunit.client.0.smithi067.stdout:2/566: chown d0/d25/d34/l3b 436649 1 2023-12-05T09:26:33.831 INFO:tasks.workunit.client.1.smithi134.stdout:7/861: dread d2/d7/fe0 [0,4194304] 0 2023-12-05T09:26:33.832 INFO:tasks.workunit.client.1.smithi134.stdout:2/903: dwrite d19/d28/d2b/ff2 [0,4194304] 0 2023-12-05T09:26:33.832 INFO:tasks.workunit.client.1.smithi134.stdout:2/904: write d19/d76/db9/f11d [868943,28071] 0 2023-12-05T09:26:33.833 INFO:tasks.workunit.client.1.smithi134.stdout:7/862: creat d2/d7/d6f/f114 x:0 0 0 2023-12-05T09:26:33.836 INFO:tasks.workunit.client.0.smithi067.stdout:6/549: rename da/d10/d1e/d17/d2f/d2c/d34/c6b to da/d10/d1e/d17/d2f/d72/cc1 0 2023-12-05T09:26:33.836 INFO:tasks.workunit.client.1.smithi134.stdout:2/905: getdents d19/d28/d31/d38/d98 0 2023-12-05T09:26:33.836 INFO:tasks.workunit.client.1.smithi134.stdout:2/906: dread - d19/f114 zero size 2023-12-05T09:26:33.836 INFO:tasks.workunit.client.0.smithi067.stdout:4/622: creat d0/d1d/d2a/d93/ddc/fdf x:0 0 0 2023-12-05T09:26:33.836 INFO:tasks.workunit.client.0.smithi067.stdout:4/623: readlink d0/d9/ld8 0 2023-12-05T09:26:33.837 INFO:tasks.workunit.client.1.smithi134.stdout:9/880: sync 2023-12-05T09:26:33.837 INFO:tasks.workunit.client.1.smithi134.stdout:0/864: sync 2023-12-05T09:26:33.838 INFO:tasks.workunit.client.1.smithi134.stdout:7/863: symlink d2/df/d2a/d36/ded/l115 0 2023-12-05T09:26:33.839 INFO:tasks.workunit.client.0.smithi067.stdout:3/605: mknod d9/d62/cd7 0 2023-12-05T09:26:33.840 INFO:tasks.workunit.client.1.smithi134.stdout:7/864: mkdir d2/d7/d93/dcf/d116 0 2023-12-05T09:26:33.840 INFO:tasks.workunit.client.1.smithi134.stdout:7/865: chown d2/d7/cb 36 1 2023-12-05T09:26:33.843 INFO:tasks.workunit.client.1.smithi134.stdout:7/866: mkdir d2/d7/dc/d2e/d3a/d6d/d9e/d117 0 2023-12-05T09:26:33.845 INFO:tasks.workunit.client.1.smithi134.stdout:0/865: dread d13/d14/d15/d2a/f58 [0,4194304] 0 2023-12-05T09:26:33.847 INFO:tasks.workunit.client.1.smithi134.stdout:7/867: truncate d2/f8 145409 0 2023-12-05T09:26:33.853 INFO:tasks.workunit.client.1.smithi134.stdout:6/824: rmdir d4/d39/d42/d4f 39 2023-12-05T09:26:33.854 INFO:tasks.workunit.client.0.smithi067.stdout:9/838: symlink d1b/d3e/d7f/l11a 0 2023-12-05T09:26:33.854 INFO:tasks.workunit.client.0.smithi067.stdout:0/767: symlink d3/d7/d3c/d67/d59/d4e/l112 0 2023-12-05T09:26:33.854 INFO:tasks.workunit.client.0.smithi067.stdout:2/567: symlink d0/d25/d34/d4d/d54/lc5 0 2023-12-05T09:26:33.854 INFO:tasks.workunit.client.0.smithi067.stdout:4/624: mkdir d0/d1d/d53/da8/da9/de0 0 2023-12-05T09:26:33.856 INFO:tasks.workunit.client.1.smithi134.stdout:7/868: dread d2/d7/d93/dcf/ddd/f110 [0,4194304] 0 2023-12-05T09:26:33.858 INFO:tasks.workunit.client.0.smithi067.stdout:8/651: rename d5/da/f1f to d5/dc/d1a/d20/fbd 0 2023-12-05T09:26:33.859 INFO:tasks.workunit.client.1.smithi134.stdout:7/869: rmdir d2/d7/dc/d2e 39 2023-12-05T09:26:33.862 INFO:tasks.workunit.client.1.smithi134.stdout:4/895: mkdir d16/d7b/dce/d13a 0 2023-12-05T09:26:33.862 INFO:tasks.workunit.client.1.smithi134.stdout:3/890: write d4/d1f/d50/d52/fbe [1211546,26748] 0 2023-12-05T09:26:33.862 INFO:tasks.workunit.client.1.smithi134.stdout:3/891: chown d4/d1f/f28 1 1 2023-12-05T09:26:33.865 INFO:tasks.workunit.client.0.smithi067.stdout:3/606: creat d9/da/d15/d17/d1a/d51/dcd/fd8 x:0 0 0 2023-12-05T09:26:33.868 INFO:tasks.workunit.client.0.smithi067.stdout:0/768: dread d3/d7/d30/f55 [0,4194304] 0 2023-12-05T09:26:33.868 INFO:tasks.workunit.client.1.smithi134.stdout:7/870: mkdir d2/d118 0 2023-12-05T09:26:33.868 INFO:tasks.workunit.client.1.smithi134.stdout:7/871: fdatasync d2/d7/dc/d22/f27 0 2023-12-05T09:26:33.868 INFO:tasks.workunit.client.1.smithi134.stdout:0/866: unlink d13/d14/d15/c46 0 2023-12-05T09:26:33.869 INFO:tasks.workunit.client.0.smithi067.stdout:1/696: dwrite d2/d5/d7/de/d19/d49/d5f/f79 [0,4194304] 0 2023-12-05T09:26:33.869 INFO:tasks.workunit.client.0.smithi067.stdout:9/839: creat d1b/dd3/d6c/f11b x:0 0 0 2023-12-05T09:26:33.870 INFO:tasks.workunit.client.1.smithi134.stdout:6/825: symlink d4/d32/d57/l106 0 2023-12-05T09:26:33.870 INFO:tasks.workunit.client.1.smithi134.stdout:3/892: truncate d4/d5/d6f/d97/dae/dc9/f2a 3149615 0 2023-12-05T09:26:33.870 INFO:tasks.workunit.client.0.smithi067.stdout:1/697: write d2/d5/d7/de/d19/d8f/d98/fc7 [260691,121643] 0 2023-12-05T09:26:33.872 INFO:tasks.workunit.client.0.smithi067.stdout:2/568: creat d0/d25/d34/d4d/d78/fc6 x:0 0 0 2023-12-05T09:26:33.872 INFO:tasks.workunit.client.1.smithi134.stdout:4/896: creat d16/d7b/d10f/f13b x:0 0 0 2023-12-05T09:26:33.875 INFO:tasks.workunit.client.0.smithi067.stdout:4/625: mknod d0/d1d/d25/d2c/d34/d4e/ce1 0 2023-12-05T09:26:33.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/652: unlink d5/dc/d1a/d20/d2d/f5f 0 2023-12-05T09:26:33.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/653: write d5/fb6 [1036783,71218] 0 2023-12-05T09:26:33.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/654: write d5/dc/d1a/d20/f72 [1240422,6733] 0 2023-12-05T09:26:33.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/655: truncate d5/dc/d1a/d20/d3e/f7a 1121805 0 2023-12-05T09:26:33.878 INFO:tasks.workunit.client.1.smithi134.stdout:0/867: mkdir d13/d14/d15/d2a/d8c/db6/d123 0 2023-12-05T09:26:33.878 INFO:tasks.workunit.client.1.smithi134.stdout:7/872: mknod d2/d7/d6f/da0/c119 0 2023-12-05T09:26:33.878 INFO:tasks.workunit.client.1.smithi134.stdout:3/893: creat d4/d1f/d10b/f116 x:0 0 0 2023-12-05T09:26:33.878 INFO:tasks.workunit.client.1.smithi134.stdout:6/826: creat d4/d32/d57/f107 x:0 0 0 2023-12-05T09:26:33.881 INFO:tasks.workunit.client.0.smithi067.stdout:7/609: dwrite d0/d9/d40/fbc [0,4194304] 0 2023-12-05T09:26:33.881 INFO:tasks.workunit.client.1.smithi134.stdout:7/873: creat d2/dd/f11a x:0 0 0 2023-12-05T09:26:33.885 INFO:tasks.workunit.client.1.smithi134.stdout:6/827: creat d4/d39/d42/d4f/d6d/d3a/dd4/f108 x:0 0 0 2023-12-05T09:26:33.889 INFO:tasks.workunit.client.0.smithi067.stdout:3/607: rename d9/f78 to d9/da/d15/d17/d1a/d51/d66/fd9 0 2023-12-05T09:26:33.892 INFO:tasks.workunit.client.1.smithi134.stdout:6/828: mknod d4/d78/c109 0 2023-12-05T09:26:33.892 INFO:tasks.workunit.client.0.smithi067.stdout:0/769: link d3/d7/f29 d3/d7/d3c/d67/d59/d4e/db2/f113 0 2023-12-05T09:26:33.893 INFO:tasks.workunit.client.0.smithi067.stdout:9/840: creat d1b/d25/d5b/d62/def/f11c x:0 0 0 2023-12-05T09:26:33.894 INFO:tasks.workunit.client.0.smithi067.stdout:2/569: symlink d0/d25/d34/d4d/d54/d90/lc7 0 2023-12-05T09:26:33.895 INFO:tasks.workunit.client.1.smithi134.stdout:6/829: creat d4/d39/d42/d4f/d6d/d3a/d75/f10a x:0 0 0 2023-12-05T09:26:33.895 INFO:tasks.workunit.client.1.smithi134.stdout:6/830: write d4/d32/d57/f6e [1559208,109850] 0 2023-12-05T09:26:33.897 INFO:tasks.workunit.client.1.smithi134.stdout:5/870: dwrite d0/d1a/d1c/d25/d4d/f70 [0,4194304] 0 2023-12-05T09:26:33.897 INFO:tasks.workunit.client.1.smithi134.stdout:5/871: fsync d0/dd/f2c 0 2023-12-05T09:26:33.901 INFO:tasks.workunit.client.1.smithi134.stdout:3/894: creat d4/d5/d45/d60/f117 x:0 0 0 2023-12-05T09:26:33.901 INFO:tasks.workunit.client.0.smithi067.stdout:7/610: creat d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/fc8 x:0 0 0 2023-12-05T09:26:33.901 INFO:tasks.workunit.client.0.smithi067.stdout:7/611: chown d0/d9/d40/d7a/dad/dc2/l57 2470 1 2023-12-05T09:26:33.901 INFO:tasks.workunit.client.0.smithi067.stdout:7/612: fsync d0/d9/d10/d37/f2a 0 2023-12-05T09:26:33.902 INFO:tasks.workunit.client.0.smithi067.stdout:1/698: rename d2/d3/f96 to d2/d4f/d15/d60/d68/ff3 0 2023-12-05T09:26:33.903 INFO:tasks.workunit.client.1.smithi134.stdout:6/831: truncate d4/d32/d57/f94 3892472 0 2023-12-05T09:26:33.904 INFO:tasks.workunit.client.0.smithi067.stdout:0/770: mknod d3/d7/d3c/ddb/c114 0 2023-12-05T09:26:33.907 INFO:tasks.workunit.client.0.smithi067.stdout:7/613: mknod d0/d9/d10/d37/d38/d64/d5a/cc9 0 2023-12-05T09:26:33.907 INFO:tasks.workunit.client.0.smithi067.stdout:1/699: symlink d2/d5/d7/de/d19/d49/lf4 0 2023-12-05T09:26:33.907 INFO:tasks.workunit.client.0.smithi067.stdout:1/700: write d2/d3/da6/dbb/fbc [1086234,49705] 0 2023-12-05T09:26:33.911 INFO:tasks.workunit.client.0.smithi067.stdout:8/656: dread d5/dc/f6c [0,4194304] 0 2023-12-05T09:26:33.914 INFO:tasks.workunit.client.0.smithi067.stdout:7/614: unlink d0/d9/f9d 0 2023-12-05T09:26:33.918 INFO:tasks.workunit.client.1.smithi134.stdout:7/874: getdents d2/d7/d6f/da0/ddb 0 2023-12-05T09:26:33.921 INFO:tasks.workunit.client.0.smithi067.stdout:1/701: creat d2/d5/d7/de/d19/d49/d5f/ff5 x:0 0 0 2023-12-05T09:26:33.922 INFO:tasks.workunit.client.1.smithi134.stdout:6/832: creat d4/d32/d74/dee/f10b x:0 0 0 2023-12-05T09:26:33.922 INFO:tasks.workunit.client.1.smithi134.stdout:5/872: rmdir d0/d1a/d1c/d3f/d81/d8a 39 2023-12-05T09:26:33.922 INFO:tasks.workunit.client.0.smithi067.stdout:8/657: symlink d5/dc/d1a/d20/lbe 0 2023-12-05T09:26:33.925 INFO:tasks.workunit.client.0.smithi067.stdout:7/615: symlink d0/d9/d10/d37/d38/lca 0 2023-12-05T09:26:33.925 INFO:tasks.workunit.client.0.smithi067.stdout:1/702: rename d2/d4f/d14/d20/d83/d78/ced to d2/d5/d7/de/d19/d8f/d98/cf6 0 2023-12-05T09:26:33.925 INFO:tasks.workunit.client.0.smithi067.stdout:1/703: chown d2/d5/d7/de/d1a/faf 1 1 2023-12-05T09:26:33.926 INFO:tasks.workunit.client.0.smithi067.stdout:8/658: mkdir d5/dc/d1a/d20/d3e/dbf 0 2023-12-05T09:26:33.927 INFO:tasks.workunit.client.1.smithi134.stdout:0/868: dread d13/d14/d30/d4b/d66/da0/daf/dde/fb8 [0,4194304] 0 2023-12-05T09:26:33.927 INFO:tasks.workunit.client.1.smithi134.stdout:9/881: dwrite d7/d8/fe2 [0,4194304] 0 2023-12-05T09:26:33.927 INFO:tasks.workunit.client.1.smithi134.stdout:3/895: getdents d4/d5/d6f/d97/dae 0 2023-12-05T09:26:33.927 INFO:tasks.workunit.client.1.smithi134.stdout:4/897: dwrite d16/d18/dad/d10e/fd0 [0,4194304] 0 2023-12-05T09:26:33.927 INFO:tasks.workunit.client.1.smithi134.stdout:4/898: dread - d16/d21/de5/f12f zero size 2023-12-05T09:26:33.927 INFO:tasks.workunit.client.1.smithi134.stdout:4/899: chown d16/d21/d48/d80/dae/d65/fdb 311 1 2023-12-05T09:26:33.933 INFO:tasks.workunit.client.0.smithi067.stdout:7/616: link d0/d9/d40/fbc d0/fcb 0 2023-12-05T09:26:33.933 INFO:tasks.workunit.client.0.smithi067.stdout:7/617: fdatasync d0/d9/d40/d7a/dad/dc2/f66 0 2023-12-05T09:26:33.935 INFO:tasks.workunit.client.0.smithi067.stdout:5/648: dwrite db/df/d3f/d88/f5c [0,4194304] 0 2023-12-05T09:26:33.937 INFO:tasks.workunit.client.0.smithi067.stdout:0/771: write d3/d7/d3c/d6c/d8a/fce [4897974,99017] 0 2023-12-05T09:26:33.937 INFO:tasks.workunit.client.1.smithi134.stdout:5/873: rmdir d0/d11/d5c 39 2023-12-05T09:26:33.937 INFO:tasks.workunit.client.1.smithi134.stdout:5/874: chown d0/dd/le 772170 1 2023-12-05T09:26:33.940 INFO:tasks.workunit.client.0.smithi067.stdout:1/704: mknod d2/d4f/d14/d20/d83/cf7 0 2023-12-05T09:26:33.941 INFO:tasks.workunit.client.1.smithi134.stdout:0/869: link d13/d14/d30/d4b/d23/f65 d13/d14/d30/d4b/dc1/dda/f124 0 2023-12-05T09:26:33.941 INFO:tasks.workunit.client.0.smithi067.stdout:4/626: dwrite d0/d1d/d53/da8/da9/d15/f9c [0,4194304] 0 2023-12-05T09:26:33.942 INFO:tasks.workunit.client.1.smithi134.stdout:3/896: truncate d4/d1f/f40 3240222 0 2023-12-05T09:26:33.942 INFO:tasks.workunit.client.1.smithi134.stdout:3/897: chown d4/d5/f32 31183044 1 2023-12-05T09:26:33.943 INFO:tasks.workunit.client.1.smithi134.stdout:3/898: write d4/d1f/d50/db4/d102/dab/fd8 [516588,19378] 0 2023-12-05T09:26:33.946 INFO:tasks.workunit.client.0.smithi067.stdout:8/659: dread d5/da/f80 [0,4194304] 0 2023-12-05T09:26:33.946 INFO:tasks.workunit.client.1.smithi134.stdout:5/875: getdents d0/d1a/d1c/d3f/d5b 0 2023-12-05T09:26:33.948 INFO:tasks.workunit.client.1.smithi134.stdout:4/900: unlink d16/d21/d48/f34 0 2023-12-05T09:26:33.951 INFO:tasks.workunit.client.1.smithi134.stdout:3/899: unlink d4/d5/d6f/d97/dae/dc9/f2a 0 2023-12-05T09:26:33.952 INFO:tasks.workunit.client.1.smithi134.stdout:3/900: dread - d4/d1f/d50/db4/d102/dab/ddc/fe7 zero size 2023-12-05T09:26:33.953 INFO:tasks.workunit.client.1.smithi134.stdout:0/870: mknod d13/d14/d15/d67/d73/c125 0 2023-12-05T09:26:33.954 INFO:tasks.workunit.client.0.smithi067.stdout:5/649: mkdir db/df/d35/dea 0 2023-12-05T09:26:33.954 INFO:tasks.workunit.client.1.smithi134.stdout:2/907: creat d19/d28/f125 x:0 0 0 2023-12-05T09:26:33.960 INFO:tasks.workunit.client.0.smithi067.stdout:0/772: creat d3/d7/d3c/d67/d59/deb/f115 x:0 0 0 2023-12-05T09:26:33.961 INFO:tasks.workunit.client.1.smithi134.stdout:2/908: creat d19/d28/d2b/da3/f126 x:0 0 0 2023-12-05T09:26:33.961 INFO:tasks.workunit.client.1.smithi134.stdout:2/909: chown d19/d28/d2b/f2f 178776 1 2023-12-05T09:26:33.961 INFO:tasks.workunit.client.1.smithi134.stdout:2/910: chown d19/d3a/l4d 0 1 2023-12-05T09:26:33.963 INFO:tasks.workunit.client.1.smithi134.stdout:4/901: creat d16/d7b/dce/d6e/daa/d3b/d8e/f13c x:0 0 0 2023-12-05T09:26:33.964 INFO:tasks.workunit.client.0.smithi067.stdout:1/705: mkdir d2/d3/da6/dbd/dd8/df8 0 2023-12-05T09:26:33.965 INFO:tasks.workunit.client.1.smithi134.stdout:6/833: dread d4/d39/d42/d4f/d6d/d3a/d80/f8b [0,4194304] 0 2023-12-05T09:26:33.966 INFO:tasks.workunit.client.1.smithi134.stdout:2/911: mknod d19/d28/d31/c127 0 2023-12-05T09:26:33.970 INFO:tasks.workunit.client.0.smithi067.stdout:4/627: mknod d0/d1d/d2a/d93/ce2 0 2023-12-05T09:26:33.972 INFO:tasks.workunit.client.0.smithi067.stdout:3/608: dwrite d9/da/d15/d17/f55 [0,4194304] 0 2023-12-05T09:26:33.974 INFO:tasks.workunit.client.1.smithi134.stdout:6/834: rename d4/d39/d42/d4f/d6d/d3a/da/f19 to d4/d39/d42/d4f/d6d/d3a/d75/d86/f10c 0 2023-12-05T09:26:33.975 INFO:tasks.workunit.client.1.smithi134.stdout:3/901: dread d4/d5/d7c/d92/fbc [0,4194304] 0 2023-12-05T09:26:33.976 INFO:tasks.workunit.client.1.smithi134.stdout:3/902: chown d4/d5/d6f/d97/f100 0 1 2023-12-05T09:26:33.976 INFO:tasks.workunit.client.1.smithi134.stdout:2/912: mkdir d19/d28/d31/d6f/d101/d128 0 2023-12-05T09:26:33.977 INFO:tasks.workunit.client.0.smithi067.stdout:0/773: fsync d3/d7/f29 0 2023-12-05T09:26:33.979 INFO:tasks.workunit.client.1.smithi134.stdout:0/871: write d13/d14/d15/d2a/f49 [3035990,130204] 0 2023-12-05T09:26:33.980 INFO:tasks.workunit.client.0.smithi067.stdout:8/660: creat d5/dc/d1a/d20/d2d/d41/db2/fc0 x:0 0 0 2023-12-05T09:26:33.982 INFO:tasks.workunit.client.1.smithi134.stdout:2/913: link d19/d5f/c94 d19/d28/d31/c129 0 2023-12-05T09:26:33.982 INFO:tasks.workunit.client.1.smithi134.stdout:5/876: dread d0/d1a/d1c/d25/d4d/d97/fa0 [4194304,4194304] 0 2023-12-05T09:26:33.983 INFO:tasks.workunit.client.0.smithi067.stdout:0/774: write d3/d7/d3c/d6c/d76/da7/dec/d10/f1a [2378482,124631] 0 2023-12-05T09:26:33.983 INFO:tasks.workunit.client.0.smithi067.stdout:4/628: mkdir d0/d1d/d53/da8/de3 0 2023-12-05T09:26:33.993 INFO:tasks.workunit.client.1.smithi134.stdout:2/914: creat d19/d28/d63/d70/f12a x:0 0 0 2023-12-05T09:26:33.994 INFO:tasks.workunit.client.0.smithi067.stdout:9/841: dwrite d1b/d25/d35/f4f [0,4194304] 0 2023-12-05T09:26:33.996 INFO:tasks.workunit.client.0.smithi067.stdout:2/570: dwrite d0/d2f/f37 [0,4194304] 0 2023-12-05T09:26:33.998 INFO:tasks.workunit.client.1.smithi134.stdout:6/835: rename d4/d32/d74/f104 to d4/d39/d5c/f10d 0 2023-12-05T09:26:34.000 INFO:tasks.workunit.client.1.smithi134.stdout:2/915: unlink d19/d3f/c46 0 2023-12-05T09:26:34.002 INFO:tasks.workunit.client.0.smithi067.stdout:1/706: write d2/d5/d7/de/d1a/f7c [2850068,81058] 0 2023-12-05T09:26:34.002 INFO:tasks.workunit.client.0.smithi067.stdout:1/707: write d2/d4f/d14/d20/fcb [142096,76916] 0 2023-12-05T09:26:34.004 INFO:tasks.workunit.client.1.smithi134.stdout:0/872: creat d13/d14/d30/d4b/dc1/f126 x:0 0 0 2023-12-05T09:26:34.004 INFO:tasks.workunit.client.1.smithi134.stdout:9/882: dwrite d7/d8/d14/f25 [4194304,4194304] 0 2023-12-05T09:26:34.005 INFO:tasks.workunit.client.1.smithi134.stdout:7/875: dwrite d2/d7/d93/dcf/ddd/f106 [0,4194304] 0 2023-12-05T09:26:34.010 INFO:tasks.workunit.client.0.smithi067.stdout:3/609: mkdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda 0 2023-12-05T09:26:34.012 INFO:tasks.workunit.client.1.smithi134.stdout:2/916: dread d19/d3a/df4/f8e [0,4194304] 0 2023-12-05T09:26:34.015 INFO:tasks.workunit.client.0.smithi067.stdout:5/650: dwrite db/df/d1a/d59/dae/fb8 [0,4194304] 0 2023-12-05T09:26:34.022 INFO:tasks.workunit.client.1.smithi134.stdout:9/883: creat d7/d8/d14/d26/d5a/d69/f12e x:0 0 0 2023-12-05T09:26:34.023 INFO:tasks.workunit.client.1.smithi134.stdout:6/836: creat d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/f10e x:0 0 0 2023-12-05T09:26:34.026 INFO:tasks.workunit.client.1.smithi134.stdout:2/917: mkdir d19/d76/db8/d12b 0 2023-12-05T09:26:34.027 INFO:tasks.workunit.client.0.smithi067.stdout:8/661: unlink d5/dc/d1a/d62/cbc 0 2023-12-05T09:26:34.029 INFO:tasks.workunit.client.1.smithi134.stdout:4/902: dwrite d16/d21/f57 [0,4194304] 0 2023-12-05T09:26:34.031 INFO:tasks.workunit.client.1.smithi134.stdout:6/837: dread d4/d39/d42/f4d [0,4194304] 0 2023-12-05T09:26:34.032 INFO:tasks.workunit.client.0.smithi067.stdout:7/618: dwrite d0/d9/d40/d7a/f87 [0,4194304] 0 2023-12-05T09:26:34.032 INFO:tasks.workunit.client.1.smithi134.stdout:0/873: rename d13/d14/d30/d4b/d66/da0/daf/dce/d7d to d13/d14/d30/d4b/d66/da0/da2/df2/d127 0 2023-12-05T09:26:34.033 INFO:tasks.workunit.client.1.smithi134.stdout:7/876: write d2/df/d2a/d36/f5d [2701094,102604] 0 2023-12-05T09:26:34.036 INFO:tasks.workunit.client.0.smithi067.stdout:9/842: creat d1b/d25/d54/d5c/de2/f11d x:0 0 0 2023-12-05T09:26:34.036 INFO:tasks.workunit.client.1.smithi134.stdout:5/877: dread d0/d1a/d3a/f4e [0,4194304] 0 2023-12-05T09:26:34.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/838: mknod d4/d39/d42/d4f/d6d/d3a/d75/d86/c10f 0 2023-12-05T09:26:34.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/839: chown d4/d39/d42/d4f/d6d/d3a/d75 1763 1 2023-12-05T09:26:34.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/840: fdatasync d4/d39/d42/d4f/d6d/d3a/d80/f81 0 2023-12-05T09:26:34.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/841: truncate d4/d39/f37 5131701 0 2023-12-05T09:26:34.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/842: chown d4/d39/f37 288 1 2023-12-05T09:26:34.044 INFO:tasks.workunit.client.0.smithi067.stdout:5/651: write db/df/d3f/d88/f62 [2380796,57398] 0 2023-12-05T09:26:34.046 INFO:tasks.workunit.client.1.smithi134.stdout:6/843: mknod d4/d39/d42/d4f/d6d/d3a/dd4/c110 0 2023-12-05T09:26:34.046 INFO:tasks.workunit.client.1.smithi134.stdout:6/844: dread - d4/d39/d42/d4f/f85 zero size 2023-12-05T09:26:34.047 INFO:tasks.workunit.client.1.smithi134.stdout:2/918: mkdir d19/d76/db9/d12c 0 2023-12-05T09:26:34.048 INFO:tasks.workunit.client.1.smithi134.stdout:5/878: getdents d0/dd/d37/d90/d9d/de0 0 2023-12-05T09:26:34.048 INFO:tasks.workunit.client.1.smithi134.stdout:5/879: fsync d0/d11/d61/d107/d127/f108 0 2023-12-05T09:26:34.048 INFO:tasks.workunit.client.1.smithi134.stdout:8/983: sync 2023-12-05T09:26:34.049 INFO:tasks.workunit.client.1.smithi134.stdout:2/919: truncate d19/d76/db9/f10a 73427 0 2023-12-05T09:26:34.051 INFO:tasks.workunit.client.1.smithi134.stdout:7/877: dread d2/d7/dc/d2e/d3a/f49 [0,4194304] 0 2023-12-05T09:26:34.051 INFO:tasks.workunit.client.1.smithi134.stdout:5/880: link d0/d1a/d1c/d25/d4d/d12c/fc1 d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/f12f 0 2023-12-05T09:26:34.059 INFO:tasks.workunit.client.1.smithi134.stdout:6/845: creat d4/d39/dfb/daa/f111 x:0 0 0 2023-12-05T09:26:34.059 INFO:tasks.workunit.client.1.smithi134.stdout:0/874: dread d13/d14/d15/d2a/f3e [0,4194304] 0 2023-12-05T09:26:34.059 INFO:tasks.workunit.client.1.smithi134.stdout:6/846: write d4/d39/d42/d4f/d6d/f60 [521869,14039] 0 2023-12-05T09:26:34.060 INFO:tasks.workunit.client.1.smithi134.stdout:8/984: unlink f9 0 2023-12-05T09:26:34.060 INFO:tasks.workunit.client.1.smithi134.stdout:9/884: dread d7/d8/d14/d26/f4a [0,4194304] 0 2023-12-05T09:26:34.060 INFO:tasks.workunit.client.1.smithi134.stdout:7/878: truncate d2/d7/d2b/d2d/d67/d73/f7e 2074405 0 2023-12-05T09:26:34.060 INFO:tasks.workunit.client.1.smithi134.stdout:7/879: fsync d2/d70/f95 0 2023-12-05T09:26:34.060 INFO:tasks.workunit.client.1.smithi134.stdout:3/903: dwrite d4/d5/d7c/f83 [0,4194304] 0 2023-12-05T09:26:34.070 INFO:tasks.workunit.client.1.smithi134.stdout:8/985: mkdir da/de/d8a/d42/d99/dc8/d3b/d14f 0 2023-12-05T09:26:34.070 INFO:tasks.workunit.client.1.smithi134.stdout:0/875: symlink d13/d14/d30/l128 0 2023-12-05T09:26:34.073 INFO:tasks.workunit.client.0.smithi067.stdout:8/662: mkdir d5/dc/d1a/d20/d2d/d41/db2/dc1 0 2023-12-05T09:26:34.074 INFO:tasks.workunit.client.0.smithi067.stdout:8/663: fdatasync d5/dc/d1a/d20/d2d/d7f/f97 0 2023-12-05T09:26:34.074 INFO:tasks.workunit.client.0.smithi067.stdout:8/664: fdatasync d5/dc/d1a/d20/f25 0 2023-12-05T09:26:34.075 INFO:tasks.workunit.client.1.smithi134.stdout:0/876: rmdir d13/d14/d30/d4b/d66 39 2023-12-05T09:26:34.075 INFO:tasks.workunit.client.1.smithi134.stdout:0/877: stat d13/d14/d30/d4b/d66/da0/daf/dce/d78/f97 0 2023-12-05T09:26:34.079 INFO:tasks.workunit.client.1.smithi134.stdout:2/920: write d19/f20 [2517910,106266] 0 2023-12-05T09:26:34.085 INFO:tasks.workunit.client.0.smithi067.stdout:9/843: creat d1b/d25/d35/d56/dc7/f11e x:0 0 0 2023-12-05T09:26:34.094 INFO:tasks.workunit.client.1.smithi134.stdout:3/904: dread d4/d5/d6f/d97/dae/dc9/f30 [0,4194304] 0 2023-12-05T09:26:34.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/921: getdents d19/d28/d31 0 2023-12-05T09:26:34.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/922: dread - d19/f97 zero size 2023-12-05T09:26:34.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/923: readlink d19/d3a/df4/la6 0 2023-12-05T09:26:34.099 INFO:tasks.workunit.client.1.smithi134.stdout:7/880: dread d2/d7/dc/d2e/f3e [0,4194304] 0 2023-12-05T09:26:34.100 INFO:tasks.workunit.client.1.smithi134.stdout:7/881: dread - d2/df/d2a/d36/fc9 zero size 2023-12-05T09:26:34.100 INFO:tasks.workunit.client.1.smithi134.stdout:7/882: getdents d2/d8f 0 2023-12-05T09:26:34.103 INFO:tasks.workunit.client.1.smithi134.stdout:3/905: creat d4/d1f/d4e/d6a/f118 x:0 0 0 2023-12-05T09:26:34.103 INFO:tasks.workunit.client.1.smithi134.stdout:3/906: truncate d4/d5/d45/d86/f9a 290681 0 2023-12-05T09:26:34.107 INFO:tasks.workunit.client.1.smithi134.stdout:2/924: creat d19/d28/d31/dd3/f12d x:0 0 0 2023-12-05T09:26:34.107 INFO:tasks.workunit.client.1.smithi134.stdout:2/925: dread - d19/d3f/f10d zero size 2023-12-05T09:26:34.108 INFO:tasks.workunit.client.1.smithi134.stdout:7/883: symlink d2/d7/dc/d2e/d3a/d6d/d9e/l11b 0 2023-12-05T09:26:34.108 INFO:tasks.workunit.client.1.smithi134.stdout:7/884: readlink d2/df/l39 0 2023-12-05T09:26:34.108 INFO:tasks.workunit.client.1.smithi134.stdout:0/878: write d13/d14/d30/d4b/f42 [3524658,129609] 0 2023-12-05T09:26:34.108 INFO:tasks.workunit.client.1.smithi134.stdout:6/847: rename d4/d39/dfb/daa to d4/d39/d42/d4f/d6d/d3a/d75/dbc/d112 0 2023-12-05T09:26:34.109 INFO:tasks.workunit.client.0.smithi067.stdout:3/610: rmdir d9/da/d15/d17 39 2023-12-05T09:26:34.109 INFO:tasks.workunit.client.0.smithi067.stdout:3/611: truncate d9/da/d15/d17/fab 373364 0 2023-12-05T09:26:34.109 INFO:tasks.workunit.client.0.smithi067.stdout:0/775: dread d3/d7/d3c/d6c/d76/da7/dec/f26 [0,4194304] 0 2023-12-05T09:26:34.111 INFO:tasks.workunit.client.1.smithi134.stdout:4/903: dwrite d16/d21/d48/d80/dae/f118 [0,4194304] 0 2023-12-05T09:26:34.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/708: dwrite d2/d4f/d14/d20/d83/fc2 [0,4194304] 0 2023-12-05T09:26:34.112 INFO:tasks.workunit.client.0.smithi067.stdout:1/709: chown d2/d5/d7/de/fe6 226926 1 2023-12-05T09:26:34.112 INFO:tasks.workunit.client.0.smithi067.stdout:8/665: rename c3 to d5/dc/d1a/d20/d58/d90/dba/cc2 0 2023-12-05T09:26:34.112 INFO:tasks.workunit.client.0.smithi067.stdout:4/629: dwrite d0/d1d/d4d/d8d/fd3 [0,4194304] 0 2023-12-05T09:26:34.114 INFO:tasks.workunit.client.0.smithi067.stdout:9/844: truncate d1b/dd3/d6c/f92 977335 0 2023-12-05T09:26:34.114 INFO:tasks.workunit.client.0.smithi067.stdout:9/845: read d1b/d25/d35/d56/f103 [2169491,103172] 0 2023-12-05T09:26:34.114 INFO:tasks.workunit.client.0.smithi067.stdout:9/846: creat d1b/dd3/d82/f11f x:0 0 0 2023-12-05T09:26:34.114 INFO:tasks.workunit.client.0.smithi067.stdout:9/847: write d1b/d25/d54/d5c/d81/d96/f9c [2654545,8101] 0 2023-12-05T09:26:34.114 INFO:tasks.workunit.client.0.smithi067.stdout:9/848: dread - d1b/d25/d35/d56/fe3 zero size 2023-12-05T09:26:34.116 INFO:tasks.workunit.client.0.smithi067.stdout:7/619: dwrite d0/d9/d10/d37/d38/d64/d34/f46 [0,4194304] 0 2023-12-05T09:26:34.119 INFO:tasks.workunit.client.1.smithi134.stdout:7/885: symlink d2/d7/d6f/da0/l11c 0 2023-12-05T09:26:34.120 INFO:tasks.workunit.client.0.smithi067.stdout:3/612: truncate d9/da/d15/d17/d1a/d51/d66/fd9 2135750 0 2023-12-05T09:26:34.120 INFO:tasks.workunit.client.1.smithi134.stdout:6/848: getdents d4/d39/d42/d4f/d6d/d3a/d75/d86 0 2023-12-05T09:26:34.120 INFO:tasks.workunit.client.1.smithi134.stdout:8/986: dwrite da/de/d4d/f79 [0,4194304] 0 2023-12-05T09:26:34.132 INFO:tasks.workunit.client.1.smithi134.stdout:2/926: dread d19/d28/f4e [0,4194304] 0 2023-12-05T09:26:34.133 INFO:tasks.workunit.client.1.smithi134.stdout:7/886: creat d2/d7/d6f/da0/f11d x:0 0 0 2023-12-05T09:26:34.134 INFO:tasks.workunit.client.1.smithi134.stdout:8/987: creat da/de/d8a/d42/d99/dc8/d72/f150 x:0 0 0 2023-12-05T09:26:34.136 INFO:tasks.workunit.client.1.smithi134.stdout:4/904: getdents d16/d7b/dce/d6e/daa 0 2023-12-05T09:26:34.136 INFO:tasks.workunit.client.1.smithi134.stdout:4/905: chown d16/d21/d48/d66/cfc 23166963 1 2023-12-05T09:26:34.136 INFO:tasks.workunit.client.1.smithi134.stdout:4/906: write d16/d18/dc5/f107 [762215,60134] 0 2023-12-05T09:26:34.137 INFO:tasks.workunit.client.1.smithi134.stdout:4/907: creat d16/d9c/f13d x:0 0 0 2023-12-05T09:26:34.137 INFO:tasks.workunit.client.0.smithi067.stdout:9/849: write d1b/d25/d35/d56/f68 [5313995,110622] 0 2023-12-05T09:26:34.137 INFO:tasks.workunit.client.0.smithi067.stdout:1/710: creat d2/d4f/d15/d74/d76/ff9 x:0 0 0 2023-12-05T09:26:34.137 INFO:tasks.workunit.client.0.smithi067.stdout:1/711: write d2/d4f/d15/d60/d68/ff3 [160256,69753] 0 2023-12-05T09:26:34.137 INFO:tasks.workunit.client.0.smithi067.stdout:8/666: mkdir d5/d6a/dc3 0 2023-12-05T09:26:34.137 INFO:tasks.workunit.client.0.smithi067.stdout:8/667: write d5/dc/d1a/d62/f73 [1558237,54815] 0 2023-12-05T09:26:34.137 INFO:tasks.workunit.client.0.smithi067.stdout:0/776: rename d3/d7/d3c/d6c/d76/da7/dec/d10 to d3/d7/d3c/d67/d59/d4e/d94/d116 0 2023-12-05T09:26:34.140 INFO:tasks.workunit.client.0.smithi067.stdout:4/630: mknod d0/d1d/d25/d2c/d34/d4e/ce4 0 2023-12-05T09:26:34.144 INFO:tasks.workunit.client.0.smithi067.stdout:5/652: dwrite db/f14 [8388608,4194304] 0 2023-12-05T09:26:34.146 INFO:tasks.workunit.client.1.smithi134.stdout:6/849: symlink d4/d39/d42/d4f/d6d/d3a/d75/dbc/l113 0 2023-12-05T09:26:34.147 INFO:tasks.workunit.client.1.smithi134.stdout:9/885: rename d7/d8/d14/d26/d5a/da1/de4 to d7/d8/d14/d26/d5a/d12f 0 2023-12-05T09:26:34.153 INFO:tasks.workunit.client.1.smithi134.stdout:9/886: mknod d7/d8/d16/d52/d74/d97/deb/c130 0 2023-12-05T09:26:34.157 INFO:tasks.workunit.client.1.smithi134.stdout:3/907: mknod d4/d1f/d50/d52/c119 0 2023-12-05T09:26:34.158 INFO:tasks.workunit.client.1.smithi134.stdout:3/908: stat d4/d1f/d50/f64 0 2023-12-05T09:26:34.159 INFO:tasks.workunit.client.0.smithi067.stdout:8/668: dread d5/f45 [0,4194304] 0 2023-12-05T09:26:34.159 INFO:tasks.workunit.client.1.smithi134.stdout:3/909: rmdir d4/d80 39 2023-12-05T09:26:34.159 INFO:tasks.workunit.client.0.smithi067.stdout:3/613: truncate d9/da/d15/d17/d1a/f35 157641 0 2023-12-05T09:26:34.166 INFO:tasks.workunit.client.0.smithi067.stdout:0/777: rename d3/d7/d3c/d6c/fa5 to d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/db4/f117 0 2023-12-05T09:26:34.169 INFO:tasks.workunit.client.0.smithi067.stdout:4/631: mknod d0/d1d/d53/da8/da9/d15/ce5 0 2023-12-05T09:26:34.169 INFO:tasks.workunit.client.0.smithi067.stdout:4/632: chown d0/d1d/d25/d2c/d34/d4e/daa/f9d 4 1 2023-12-05T09:26:34.187 INFO:tasks.workunit.client.0.smithi067.stdout:8/669: creat d5/dc/d1a/d20/d3e/dbf/fc4 x:0 0 0 2023-12-05T09:26:34.192 INFO:tasks.workunit.client.1.smithi134.stdout:6/850: dwrite d4/d39/d42/d4f/f103 [0,4194304] 0 2023-12-05T09:26:34.192 INFO:tasks.workunit.client.1.smithi134.stdout:6/851: read - d4/d39/d42/d4f/d6d/d3a/d75/dbc/d112/f111 zero size 2023-12-05T09:26:34.196 INFO:tasks.workunit.client.0.smithi067.stdout:3/614: unlink d9/da/d15/d17/l23 0 2023-12-05T09:26:34.197 INFO:tasks.workunit.client.0.smithi067.stdout:9/850: rename d1b/l10e to d1b/dd3/l120 0 2023-12-05T09:26:34.197 INFO:tasks.workunit.client.0.smithi067.stdout:9/851: dread - d1b/d25/d35/d56/d90/fea zero size 2023-12-05T09:26:34.197 INFO:tasks.workunit.client.0.smithi067.stdout:9/852: truncate d1b/d25/d5b/ffc 761932 0 2023-12-05T09:26:34.197 INFO:tasks.workunit.client.0.smithi067.stdout:9/853: dread - d1b/d25/d5b/d62/fba zero size 2023-12-05T09:26:34.200 INFO:tasks.workunit.client.0.smithi067.stdout:4/633: mkdir d0/d1d/d53/da8/da9/d15/dd0/dd9/de6 0 2023-12-05T09:26:34.202 INFO:tasks.workunit.client.1.smithi134.stdout:0/879: rmdir d13/d14 39 2023-12-05T09:26:34.202 INFO:tasks.workunit.client.1.smithi134.stdout:0/880: readlink d13/d14/d15/d93/de4/d111/l115 0 2023-12-05T09:26:34.202 INFO:tasks.workunit.client.1.smithi134.stdout:0/881: write d13/d14/d30/d4b/d66/da0/daf/dce/f109 [599465,36852] 0 2023-12-05T09:26:34.202 INFO:tasks.workunit.client.1.smithi134.stdout:0/882: chown d13 49 1 2023-12-05T09:26:34.203 INFO:tasks.workunit.client.0.smithi067.stdout:7/620: dwrite d0/d9/d40/f77 [8388608,4194304] 0 2023-12-05T09:26:34.208 INFO:tasks.workunit.client.0.smithi067.stdout:5/653: rmdir db/df/d1a/d59/dae 39 2023-12-05T09:26:34.208 INFO:tasks.workunit.client.0.smithi067.stdout:5/654: creat db/df/d35/dc8/feb x:0 0 0 2023-12-05T09:26:34.208 INFO:tasks.workunit.client.1.smithi134.stdout:2/927: rename d19/d28/d31/d38/f105 to d19/f12e 0 2023-12-05T09:26:34.211 INFO:tasks.workunit.client.1.smithi134.stdout:7/887: rename d2/d7/dc/d2e/d3a/f4e to d2/d7/dc/d2e/d3a/d6d/d9e/d117/f11e 0 2023-12-05T09:26:34.212 INFO:tasks.workunit.client.0.smithi067.stdout:7/621: mkdir d0/d9/d3f/dcc 0 2023-12-05T09:26:34.213 INFO:tasks.workunit.client.0.smithi067.stdout:4/634: link d0/d1d/d2a/d72/la7 d0/d1d/d2b/le7 0 2023-12-05T09:26:34.214 INFO:tasks.workunit.client.1.smithi134.stdout:8/988: rename da/de/d16/d2d/f80 to da/de/d11/d1d/d5f/d9b/f151 0 2023-12-05T09:26:34.216 INFO:tasks.workunit.client.1.smithi134.stdout:3/910: rmdir d4/d1f/d10b 39 2023-12-05T09:26:34.216 INFO:tasks.workunit.client.0.smithi067.stdout:5/655: unlink db/df/d1a/f4c 0 2023-12-05T09:26:34.217 INFO:tasks.workunit.client.0.smithi067.stdout:5/656: fsync db/f14 0 2023-12-05T09:26:34.218 INFO:tasks.workunit.client.1.smithi134.stdout:9/887: dwrite d7/d8/d16/d52/d74/d97/d99/f9a [0,4194304] 0 2023-12-05T09:26:34.218 INFO:tasks.workunit.client.1.smithi134.stdout:9/888: write d7/d8/d14/d26/f3e [1267057,80734] 0 2023-12-05T09:26:34.219 INFO:tasks.workunit.client.0.smithi067.stdout:4/635: rmdir d0/d1d/d25/d2c/d34/d4e/daa 39 2023-12-05T09:26:34.219 INFO:tasks.workunit.client.1.smithi134.stdout:3/911: creat d4/d5/d7c/f11a x:0 0 0 2023-12-05T09:26:34.219 INFO:tasks.workunit.client.1.smithi134.stdout:6/852: mkdir d4/d39/d42/d4f/d6d/d3a/d75/dbc/d112/dba/d114 0 2023-12-05T09:26:34.220 INFO:tasks.workunit.client.1.smithi134.stdout:0/883: mkdir d13/d14/d30/d4b/d66/da0/daf/dce/d86/dd8/d129 0 2023-12-05T09:26:34.220 INFO:tasks.workunit.client.1.smithi134.stdout:0/884: write d13/d14/d15/d67/d73/d119/f11e [774563,50139] 0 2023-12-05T09:26:34.221 INFO:tasks.workunit.client.1.smithi134.stdout:9/889: link d7/d7d/f106 d7/d8/d14/d26/d7f/d92/d53/dd4/f131 0 2023-12-05T09:26:34.221 INFO:tasks.workunit.client.0.smithi067.stdout:0/778: dwrite d3/d7/d3c/fa3 [0,4194304] 0 2023-12-05T09:26:34.222 INFO:tasks.workunit.client.0.smithi067.stdout:5/657: rmdir db/df/d35/dc8/dd2 0 2023-12-05T09:26:34.224 INFO:tasks.workunit.client.1.smithi134.stdout:9/890: link d7/d8/d14/fad d7/d8/d14/d26/d5a/d111/f132 0 2023-12-05T09:26:34.227 INFO:tasks.workunit.client.1.smithi134.stdout:6/853: mknod d4/d39/d42/c115 0 2023-12-05T09:26:34.228 INFO:tasks.workunit.client.1.smithi134.stdout:0/885: mkdir d13/d14/d15/d67/d73/d119/d12a 0 2023-12-05T09:26:34.229 INFO:tasks.workunit.client.0.smithi067.stdout:0/779: unlink d3/d7/d3c/d6c/d8a/fce 0 2023-12-05T09:26:34.230 INFO:tasks.workunit.client.1.smithi134.stdout:3/912: dread d4/d1f/d50/f64 [0,4194304] 0 2023-12-05T09:26:34.232 INFO:tasks.workunit.client.1.smithi134.stdout:2/928: dread d19/f12e [4194304,4194304] 0 2023-12-05T09:26:34.232 INFO:tasks.workunit.client.1.smithi134.stdout:2/929: stat d19/d76/f7b 0 2023-12-05T09:26:34.233 INFO:tasks.workunit.client.1.smithi134.stdout:2/930: write d19/f25 [1749782,55937] 0 2023-12-05T09:26:34.233 INFO:tasks.workunit.client.1.smithi134.stdout:2/931: chown d19/d28/d63/f7c 13479158 1 2023-12-05T09:26:34.234 INFO:tasks.workunit.client.1.smithi134.stdout:2/932: fsync d19/d28/d31/d6f/f107 0 2023-12-05T09:26:34.237 INFO:tasks.workunit.client.1.smithi134.stdout:2/933: creat d19/d28/d31/d38/db7/d111/f12f x:0 0 0 2023-12-05T09:26:34.243 INFO:tasks.workunit.client.1.smithi134.stdout:2/934: rename d19/f34 to d19/d28/d31/d6f/f130 0 2023-12-05T09:26:34.248 INFO:tasks.workunit.client.1.smithi134.stdout:6/854: dread d4/d39/d42/f7e [0,4194304] 0 2023-12-05T09:26:34.248 INFO:tasks.workunit.client.1.smithi134.stdout:6/855: write d4/d39/d42/d4f/d6d/d3a/da/da4/fb7 [185530,2054] 0 2023-12-05T09:26:34.248 INFO:tasks.workunit.client.1.smithi134.stdout:6/856: write d4/d39/d42/d4f/d6d/d9f/fc6 [1646997,11525] 0 2023-12-05T09:26:34.249 INFO:tasks.workunit.client.0.smithi067.stdout:0/780: dread d3/f31 [0,4194304] 0 2023-12-05T09:26:34.249 INFO:tasks.workunit.client.0.smithi067.stdout:0/781: fdatasync d3/d7/f8f 0 2023-12-05T09:26:34.249 INFO:tasks.workunit.client.0.smithi067.stdout:0/782: truncate d3/d7/d3c/f48 1097819 0 2023-12-05T09:26:34.252 INFO:tasks.workunit.client.0.smithi067.stdout:5/658: dread db/f14 [8388608,4194304] 0 2023-12-05T09:26:34.253 INFO:tasks.workunit.client.0.smithi067.stdout:5/659: dread - db/df/d82/fce zero size 2023-12-05T09:26:34.257 INFO:tasks.workunit.client.1.smithi134.stdout:8/989: unlink da/de/d8a/d42/d99/dc8/l51 0 2023-12-05T09:26:34.258 INFO:tasks.workunit.client.1.smithi134.stdout:2/935: mknod d19/d28/d31/c131 0 2023-12-05T09:26:34.259 INFO:tasks.workunit.client.1.smithi134.stdout:2/936: creat d19/d28/d9e/f132 x:0 0 0 2023-12-05T09:26:34.259 INFO:tasks.workunit.client.1.smithi134.stdout:2/937: write d19/d28/fc9 [75756,15301] 0 2023-12-05T09:26:34.259 INFO:tasks.workunit.client.1.smithi134.stdout:2/938: fsync d19/f5d 0 2023-12-05T09:26:34.260 INFO:tasks.workunit.client.0.smithi067.stdout:0/783: unlink d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/c61 0 2023-12-05T09:26:34.262 INFO:tasks.workunit.client.1.smithi134.stdout:6/857: rmdir d4/d32/d74/dee 39 2023-12-05T09:26:34.263 INFO:tasks.workunit.client.0.smithi067.stdout:0/784: read d3/d7/d3c/f9d [337286,110016] 0 2023-12-05T09:26:34.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/785: chown d3/d7/d30/f9b 10 1 2023-12-05T09:26:34.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/786: dread - d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/fbc zero size 2023-12-05T09:26:34.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/787: stat d3/d7/d3c/d6c/d76/l87 0 2023-12-05T09:26:34.265 INFO:tasks.workunit.client.0.smithi067.stdout:5/660: truncate db/df/d1a/f21 148138 0 2023-12-05T09:26:34.268 INFO:tasks.workunit.client.1.smithi134.stdout:8/990: unlink da/c105 0 2023-12-05T09:26:34.270 INFO:tasks.workunit.client.1.smithi134.stdout:8/991: creat da/de/d8a/d42/da2/f152 x:0 0 0 2023-12-05T09:26:34.271 INFO:tasks.workunit.client.1.smithi134.stdout:8/992: creat da/de/d11/d1d/d135/f153 x:0 0 0 2023-12-05T09:26:34.272 INFO:tasks.workunit.client.1.smithi134.stdout:2/939: dread d19/d28/d63/d70/f74 [0,4194304] 0 2023-12-05T09:26:34.272 INFO:tasks.workunit.client.1.smithi134.stdout:8/993: symlink da/de/d11/d1d/d5f/dea/d12e/l154 0 2023-12-05T09:26:34.273 INFO:tasks.workunit.client.0.smithi067.stdout:3/615: dwrite d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:34.274 INFO:tasks.workunit.client.0.smithi067.stdout:3/616: creat d9/d24/db6/fdb x:0 0 0 2023-12-05T09:26:34.276 INFO:tasks.workunit.client.1.smithi134.stdout:2/940: unlink d19/d28/d31/d6f/f84 0 2023-12-05T09:26:34.281 INFO:tasks.workunit.client.1.smithi134.stdout:7/888: dwrite d2/d7/dc/d22/f3d [4194304,4194304] 0 2023-12-05T09:26:34.281 INFO:tasks.workunit.client.1.smithi134.stdout:7/889: write d2/d7/dc/d2e/d3a/fee [793650,574] 0 2023-12-05T09:26:34.285 INFO:tasks.workunit.client.1.smithi134.stdout:7/890: creat d2/df/d81/daf/f11f x:0 0 0 2023-12-05T09:26:34.287 INFO:tasks.workunit.client.1.smithi134.stdout:9/891: dwrite d7/f116 [0,4194304] 0 2023-12-05T09:26:34.287 INFO:tasks.workunit.client.1.smithi134.stdout:6/858: dread d4/d39/d5c/f82 [0,4194304] 0 2023-12-05T09:26:34.287 INFO:tasks.workunit.client.1.smithi134.stdout:9/892: dread - d7/d5b/d5e/fac zero size 2023-12-05T09:26:34.287 INFO:tasks.workunit.client.1.smithi134.stdout:7/891: creat d2/df/d2a/d36/f120 x:0 0 0 2023-12-05T09:26:34.287 INFO:tasks.workunit.client.1.smithi134.stdout:7/892: truncate d2/df/f9d 1579150 0 2023-12-05T09:26:34.287 INFO:tasks.workunit.client.1.smithi134.stdout:7/893: write d2/d7/dc/d2e/d3a/d6d/d9e/f109 [1582892,72209] 0 2023-12-05T09:26:34.288 INFO:tasks.workunit.client.1.smithi134.stdout:6/859: mknod d4/d32/d74/dee/c116 0 2023-12-05T09:26:34.297 INFO:tasks.workunit.client.1.smithi134.stdout:9/893: creat d7/d8/d16/d52/f133 x:0 0 0 2023-12-05T09:26:34.300 INFO:tasks.workunit.client.1.smithi134.stdout:7/894: mkdir d2/d7/dc/d2e/d3a/d6d/d121 0 2023-12-05T09:26:34.303 INFO:tasks.workunit.client.1.smithi134.stdout:5/881: sync 2023-12-05T09:26:34.303 INFO:tasks.workunit.client.1.smithi134.stdout:4/908: sync 2023-12-05T09:26:34.304 INFO:tasks.workunit.client.1.smithi134.stdout:5/882: dread - d0/d1a/d1c/d3f/d5b/d5d/d78/db3/f120 zero size 2023-12-05T09:26:34.304 INFO:tasks.workunit.client.1.smithi134.stdout:5/883: read - d0/d1a/d1c/fdd zero size 2023-12-05T09:26:34.304 INFO:tasks.workunit.client.1.smithi134.stdout:5/884: fsync d0/d1a/d1c/d25/d6a/f6c 0 2023-12-05T09:26:34.304 INFO:tasks.workunit.client.1.smithi134.stdout:5/885: truncate d0/d1a/d1c/d25/d4d/d12c/f9f 1836039 0 2023-12-05T09:26:34.304 INFO:tasks.workunit.client.1.smithi134.stdout:5/886: chown d0/d11/d5c/dab/fcd 118979 1 2023-12-05T09:26:34.305 INFO:tasks.workunit.client.1.smithi134.stdout:5/887: truncate d0/d1a/d1c/d25/f56 544275 0 2023-12-05T09:26:34.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/617: write d9/da/f19 [1106386,30441] 0 2023-12-05T09:26:34.309 INFO:tasks.workunit.client.0.smithi067.stdout:3/618: symlink d9/da/d15/d17/d1a/d51/d70/ldc 0 2023-12-05T09:26:34.309 INFO:tasks.workunit.client.0.smithi067.stdout:3/619: dread - d9/da/f96 zero size 2023-12-05T09:26:34.309 INFO:tasks.workunit.client.0.smithi067.stdout:3/620: fsync d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/f8d 0 2023-12-05T09:26:34.310 INFO:tasks.workunit.client.0.smithi067.stdout:5/661: dwrite db/df/d35/d63/faf [0,4194304] 0 2023-12-05T09:26:34.310 INFO:tasks.workunit.client.0.smithi067.stdout:5/662: stat db/df/d3f/c48 0 2023-12-05T09:26:34.311 INFO:tasks.workunit.client.0.smithi067.stdout:5/663: creat db/df/d1a/fec x:0 0 0 2023-12-05T09:26:34.312 INFO:tasks.workunit.client.1.smithi134.stdout:2/941: getdents d19/d28/d9e 0 2023-12-05T09:26:34.312 INFO:tasks.workunit.client.0.smithi067.stdout:3/621: getdents d9/da/d15 0 2023-12-05T09:26:34.314 INFO:tasks.workunit.client.0.smithi067.stdout:3/622: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/fdd x:0 0 0 2023-12-05T09:26:34.317 INFO:tasks.workunit.client.0.smithi067.stdout:3/623: rename d9/d24/f34 to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/fde 0 2023-12-05T09:26:34.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/860: write d4/d39/d42/d4f/d6d/d3a/d75/d86/f10c [4073187,55309] 0 2023-12-05T09:26:34.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/861: truncate d4/d39/fb1 277672 0 2023-12-05T09:26:34.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/862: creat d4/d39/d42/f117 x:0 0 0 2023-12-05T09:26:34.322 INFO:tasks.workunit.client.1.smithi134.stdout:4/909: dread d16/d21/d48/d66/fee [4194304,4194304] 0 2023-12-05T09:26:34.323 INFO:tasks.workunit.client.1.smithi134.stdout:9/894: read d7/d8/fb6 [2870705,25437] 0 2023-12-05T09:26:34.323 INFO:tasks.workunit.client.1.smithi134.stdout:9/895: fsync d7/d8/d14/d26/d5a/d111/f132 0 2023-12-05T09:26:34.325 INFO:tasks.workunit.client.1.smithi134.stdout:8/994: rename da/de/d11/d1d/d135 to da/de/d16/d33/d13f/d155 0 2023-12-05T09:26:34.325 INFO:tasks.workunit.client.0.smithi067.stdout:9/854: dwrite d1b/f5d [0,4194304] 0 2023-12-05T09:26:34.325 INFO:tasks.workunit.client.1.smithi134.stdout:2/942: getdents d19/d28/d31/d38 0 2023-12-05T09:26:34.326 INFO:tasks.workunit.client.1.smithi134.stdout:5/888: read d0/d11/f89 [920278,26892] 0 2023-12-05T09:26:34.326 INFO:tasks.workunit.client.1.smithi134.stdout:5/889: write d0/d50/fc2 [1795067,34244] 0 2023-12-05T09:26:34.327 INFO:tasks.workunit.client.0.smithi067.stdout:9/855: rmdir d1b/d25/d54/d5c/dc5 39 2023-12-05T09:26:34.330 INFO:tasks.workunit.client.1.smithi134.stdout:4/910: symlink d16/d9c/dac/l13e 0 2023-12-05T09:26:34.330 INFO:tasks.workunit.client.1.smithi134.stdout:4/911: fsync d16/d7b/dce/d6e/daa/d3b/f138 0 2023-12-05T09:26:34.332 INFO:tasks.workunit.client.1.smithi134.stdout:0/886: sync 2023-12-05T09:26:34.332 INFO:tasks.workunit.client.1.smithi134.stdout:3/913: sync 2023-12-05T09:26:34.332 INFO:tasks.workunit.client.1.smithi134.stdout:3/914: readlink d4/d5/d45/d86/l8e 0 2023-12-05T09:26:34.332 INFO:tasks.workunit.client.1.smithi134.stdout:7/895: rename d2/d7/d93/dcf/dd6/lfa to d2/df/d81/daf/de1/l122 0 2023-12-05T09:26:34.333 INFO:tasks.workunit.client.1.smithi134.stdout:7/896: chown d2/d7/d2b/d2d/d67/d73/f107 13 1 2023-12-05T09:26:34.334 INFO:tasks.workunit.client.0.smithi067.stdout:9/856: rename d1b/d25/d35/d56/lce to d1b/d25/d35/d56/d90/l121 0 2023-12-05T09:26:34.334 INFO:tasks.workunit.client.0.smithi067.stdout:5/664: dread db/df/d3f/f60 [0,4194304] 0 2023-12-05T09:26:34.334 INFO:tasks.workunit.client.0.smithi067.stdout:5/665: chown db/df/d1a/c74 17 1 2023-12-05T09:26:34.335 INFO:tasks.workunit.client.0.smithi067.stdout:5/666: truncate db/df/db5/fe1 639995 0 2023-12-05T09:26:34.335 INFO:tasks.workunit.client.0.smithi067.stdout:5/667: chown db/df/d3f 82 1 2023-12-05T09:26:34.335 INFO:tasks.workunit.client.1.smithi134.stdout:6/863: dread d4/d39/d42/f7e [0,4194304] 0 2023-12-05T09:26:34.335 INFO:tasks.workunit.client.1.smithi134.stdout:2/943: creat d19/d3f/dbf/f133 x:0 0 0 2023-12-05T09:26:34.335 INFO:tasks.workunit.client.1.smithi134.stdout:2/944: fsync d19/d76/db9/f10a 0 2023-12-05T09:26:34.337 INFO:tasks.workunit.client.1.smithi134.stdout:4/912: mkdir d16/d7b/d10f/d13f 0 2023-12-05T09:26:34.337 INFO:tasks.workunit.client.1.smithi134.stdout:4/913: chown d16/d18/dad/d10e/lef 415865 1 2023-12-05T09:26:34.337 INFO:tasks.workunit.client.1.smithi134.stdout:5/890: mknod d0/d1a/d1c/d3f/d81/db0/c130 0 2023-12-05T09:26:34.340 INFO:tasks.workunit.client.1.smithi134.stdout:7/897: unlink d2/d7/dc/d2e/f89 0 2023-12-05T09:26:34.341 INFO:tasks.workunit.client.1.smithi134.stdout:0/887: rename d13/d14/d15/d93/de4/d111/d112/l9e to d13/d14/d30/d4b/l12b 0 2023-12-05T09:26:34.341 INFO:tasks.workunit.client.1.smithi134.stdout:7/898: write d2/d7/dc/d2e/d3a/d6d/d9e/d117/f11e [84824,115607] 0 2023-12-05T09:26:34.342 INFO:tasks.workunit.client.0.smithi067.stdout:5/668: creat db/df/d82/fed x:0 0 0 2023-12-05T09:26:34.342 INFO:tasks.workunit.client.0.smithi067.stdout:5/669: stat db/df/d1a/d1d/d20/fa5 0 2023-12-05T09:26:34.346 INFO:tasks.workunit.client.0.smithi067.stdout:0/788: dwrite d3/d6b/fbe [0,4194304] 0 2023-12-05T09:26:34.347 INFO:tasks.workunit.client.0.smithi067.stdout:0/789: chown d3/d7/d3c/d8d/df7 798013498 1 2023-12-05T09:26:34.347 INFO:tasks.workunit.client.1.smithi134.stdout:8/995: mkdir da/d156 0 2023-12-05T09:26:34.347 INFO:tasks.workunit.client.1.smithi134.stdout:5/891: dread d0/f7 [0,4194304] 0 2023-12-05T09:26:34.347 INFO:tasks.workunit.client.1.smithi134.stdout:5/892: chown d0/d1a/d1c/d3f/d5b/d5d/d78/db3/ffa 1071 1 2023-12-05T09:26:34.347 INFO:tasks.workunit.client.1.smithi134.stdout:7/899: rmdir d2/d7/dc/d2e/d3a/d6d 39 2023-12-05T09:26:34.347 INFO:tasks.workunit.client.1.smithi134.stdout:6/864: truncate d4/d39/d42/d4f/d6d/d3a/da/f77 2860991 0 2023-12-05T09:26:34.348 INFO:tasks.workunit.client.0.smithi067.stdout:9/857: unlink d1b/d25/d35/f79 0 2023-12-05T09:26:34.348 INFO:tasks.workunit.client.1.smithi134.stdout:9/896: dread d7/d8/f84 [0,4194304] 0 2023-12-05T09:26:34.349 INFO:tasks.workunit.client.1.smithi134.stdout:4/914: symlink d16/d7b/d10f/d13f/l140 0 2023-12-05T09:26:34.350 INFO:tasks.workunit.client.1.smithi134.stdout:8/996: unlink da/fc7 0 2023-12-05T09:26:34.350 INFO:tasks.workunit.client.1.smithi134.stdout:8/997: read - da/de/d16/d98/f112 zero size 2023-12-05T09:26:34.352 INFO:tasks.workunit.client.0.smithi067.stdout:5/670: rename db/df/d1a/d59/dae/cb9 to db/df/d35/d63/cee 0 2023-12-05T09:26:34.353 INFO:tasks.workunit.client.1.smithi134.stdout:5/893: symlink d0/dd/d37/d90/l131 0 2023-12-05T09:26:34.355 INFO:tasks.workunit.client.1.smithi134.stdout:7/900: creat d2/d70/f123 x:0 0 0 2023-12-05T09:26:34.355 INFO:tasks.workunit.client.1.smithi134.stdout:7/901: write d2/d7/dc/d2e/d3a/f3b [1905084,88917] 0 2023-12-05T09:26:34.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/865: creat d4/d39/d42/d4f/d6d/d3a/d75/d59/f118 x:0 0 0 2023-12-05T09:26:34.358 INFO:tasks.workunit.client.1.smithi134.stdout:9/897: link d7/d8/d14/d26/d5a/d69/f12e d7/d8/d14/d26/d7f/d92/d53/f134 0 2023-12-05T09:26:34.361 INFO:tasks.workunit.client.1.smithi134.stdout:4/915: creat d16/d18/dc5/dc2/df6/f141 x:0 0 0 2023-12-05T09:26:34.361 INFO:tasks.workunit.client.1.smithi134.stdout:4/916: read - d16/d21/d48/d80/dae/f8a zero size 2023-12-05T09:26:34.361 INFO:tasks.workunit.client.1.smithi134.stdout:4/917: creat d16/d7b/dce/d6e/daa/d3b/f142 x:0 0 0 2023-12-05T09:26:34.361 INFO:tasks.workunit.client.1.smithi134.stdout:7/902: creat d2/d7/d2b/dd9/d10b/f124 x:0 0 0 2023-12-05T09:26:34.364 INFO:tasks.workunit.client.1.smithi134.stdout:9/898: truncate d7/d5b/d5e/daa/db7/f100 848088 0 2023-12-05T09:26:34.364 INFO:tasks.workunit.client.1.smithi134.stdout:9/899: fsync d7/d8/d2e/f76 0 2023-12-05T09:26:34.365 INFO:tasks.workunit.client.1.smithi134.stdout:6/866: mkdir d4/d39/d42/d4f/d6d/d3a/d75/dbc/d112/dba/d114/d119 0 2023-12-05T09:26:34.365 INFO:tasks.workunit.client.1.smithi134.stdout:6/867: dread - d4/f6b zero size 2023-12-05T09:26:34.365 INFO:tasks.workunit.client.1.smithi134.stdout:7/903: creat d2/d7/d2b/f125 x:0 0 0 2023-12-05T09:26:34.365 INFO:tasks.workunit.client.1.smithi134.stdout:6/868: chown d4/d39/d42/d4f/d6d/cd3 1763205025 1 2023-12-05T09:26:34.365 INFO:tasks.workunit.client.1.smithi134.stdout:6/869: truncate d4/d39/d42/fa7 592270 0 2023-12-05T09:26:34.366 INFO:tasks.workunit.client.1.smithi134.stdout:9/900: symlink d7/d8/d14/d26/d5a/df1/l135 0 2023-12-05T09:26:34.366 INFO:tasks.workunit.client.1.smithi134.stdout:9/901: write d7/d8/d16/fda [1589193,84672] 0 2023-12-05T09:26:34.366 INFO:tasks.workunit.client.1.smithi134.stdout:9/902: dread - d7/d8/d14/d26/d5a/d69/f12e zero size 2023-12-05T09:26:34.366 INFO:tasks.workunit.client.1.smithi134.stdout:9/903: write d7/d8/d16/d52/f8b [1070344,1112] 0 2023-12-05T09:26:34.371 INFO:tasks.workunit.client.1.smithi134.stdout:4/918: mkdir d16/d7b/dce/d6e/daa/d3b/d143 0 2023-12-05T09:26:34.371 INFO:tasks.workunit.client.1.smithi134.stdout:4/919: read - d16/d18/d1b/ff2 zero size 2023-12-05T09:26:34.371 INFO:tasks.workunit.client.1.smithi134.stdout:4/920: fdatasync f5 0 2023-12-05T09:26:34.371 INFO:tasks.workunit.client.1.smithi134.stdout:6/870: link d4/d32/f101 d4/d32/d74/f11a 0 2023-12-05T09:26:34.374 INFO:tasks.workunit.client.1.smithi134.stdout:4/921: mkdir d16/d18/dc5/d144 0 2023-12-05T09:26:34.376 INFO:tasks.workunit.client.1.smithi134.stdout:9/904: dread d7/d8/d14/f46 [0,4194304] 0 2023-12-05T09:26:34.377 INFO:tasks.workunit.client.0.smithi067.stdout:0/790: creat d3/d7/f118 x:0 0 0 2023-12-05T09:26:34.377 INFO:tasks.workunit.client.1.smithi134.stdout:6/871: unlink d4/d39/d42/d4f/d6d/d3a/d75/d59/f118 0 2023-12-05T09:26:34.378 INFO:tasks.workunit.client.1.smithi134.stdout:9/905: rmdir d7/d8/d14 39 2023-12-05T09:26:34.378 INFO:tasks.workunit.client.1.smithi134.stdout:4/922: mkdir d16/d18/d1b/d24/d133/d145 0 2023-12-05T09:26:34.380 INFO:tasks.workunit.client.0.smithi067.stdout:9/858: link d1b/dd3/d6c/l109 d1b/dd3/d6c/d78/daa/l122 0 2023-12-05T09:26:34.380 INFO:tasks.workunit.client.0.smithi067.stdout:9/859: fdatasync d1b/f10f 0 2023-12-05T09:26:34.380 INFO:tasks.workunit.client.0.smithi067.stdout:9/860: write d1b/d25/d54/d5c/de2/f11d [270442,128656] 0 2023-12-05T09:26:34.381 INFO:tasks.workunit.client.1.smithi134.stdout:9/906: mkdir d7/d8/d14/d26/d5a/d69/d136 0 2023-12-05T09:26:34.381 INFO:tasks.workunit.client.1.smithi134.stdout:6/872: mknod d4/d32/c11b 0 2023-12-05T09:26:34.381 INFO:tasks.workunit.client.1.smithi134.stdout:6/873: write d4/d39/d5c/f10d [34463,112062] 0 2023-12-05T09:26:34.381 INFO:tasks.workunit.client.1.smithi134.stdout:2/945: dread f16 [0,4194304] 0 2023-12-05T09:26:34.382 INFO:tasks.workunit.client.1.smithi134.stdout:3/915: dwrite d4/d5/d45/d60/ff9 [0,4194304] 0 2023-12-05T09:26:34.382 INFO:tasks.workunit.client.0.smithi067.stdout:5/671: creat db/df/d1a/d59/dae/fef x:0 0 0 2023-12-05T09:26:34.384 INFO:tasks.workunit.client.1.smithi134.stdout:4/923: creat d16/d18/dc5/d144/f146 x:0 0 0 2023-12-05T09:26:34.384 INFO:tasks.workunit.client.1.smithi134.stdout:2/946: mknod d19/d28/d9e/dcd/c134 0 2023-12-05T09:26:34.384 INFO:tasks.workunit.client.1.smithi134.stdout:4/924: readlink d16/d21/d48/d80/dae/d65/l116 0 2023-12-05T09:26:34.384 INFO:tasks.workunit.client.1.smithi134.stdout:4/925: fsync d16/d21/f7c 0 2023-12-05T09:26:34.384 INFO:tasks.workunit.client.1.smithi134.stdout:4/926: creat d16/d21/d48/d66/db0/db3/f147 x:0 0 0 2023-12-05T09:26:34.384 INFO:tasks.workunit.client.0.smithi067.stdout:0/791: symlink d3/d7/d3c/d67/dd1/l119 0 2023-12-05T09:26:34.385 INFO:tasks.workunit.client.1.smithi134.stdout:2/947: mknod d19/d28/d31/d38/db7/d111/c135 0 2023-12-05T09:26:34.389 INFO:tasks.workunit.client.0.smithi067.stdout:3/624: dwrite d9/da/d15/d17/d1a/d51/fc7 [4194304,4194304] 0 2023-12-05T09:26:34.392 INFO:tasks.workunit.client.0.smithi067.stdout:5/672: getdents db/df 0 2023-12-05T09:26:34.395 INFO:tasks.workunit.client.1.smithi134.stdout:0/888: dread d13/d14/d30/d4b/d23/f60 [0,4194304] 0 2023-12-05T09:26:34.397 INFO:tasks.workunit.client.1.smithi134.stdout:4/927: symlink d16/d21/d48/d66/l148 0 2023-12-05T09:26:34.397 INFO:tasks.workunit.client.1.smithi134.stdout:4/928: chown d16/d18/dc5/dc2/df6/d134 10642310 1 2023-12-05T09:26:34.401 INFO:tasks.workunit.client.0.smithi067.stdout:9/861: dread d1b/d25/d54/fc9 [0,4194304] 0 2023-12-05T09:26:34.401 INFO:tasks.workunit.client.0.smithi067.stdout:9/862: fsync d1b/f24 0 2023-12-05T09:26:34.401 INFO:tasks.workunit.client.0.smithi067.stdout:9/863: stat d1b/d25/d54/d5c/d81/d96/l110 0 2023-12-05T09:26:34.401 INFO:tasks.workunit.client.0.smithi067.stdout:5/673: rename db/df/d1a/c74 to db/df/d1a/d1d/d20/cf0 0 2023-12-05T09:26:34.403 INFO:tasks.workunit.client.0.smithi067.stdout:5/674: mknod db/df/d1a/d59/cf1 0 2023-12-05T09:26:34.407 INFO:tasks.workunit.client.1.smithi134.stdout:3/916: dread d4/d5/fa2 [0,4194304] 0 2023-12-05T09:26:34.407 INFO:tasks.workunit.client.1.smithi134.stdout:3/917: fdatasync d4/d5/d45/d86/fb8 0 2023-12-05T09:26:34.409 INFO:tasks.workunit.client.1.smithi134.stdout:9/907: dread d7/d8/d16/d52/d74/d97/d99/f9a [0,4194304] 0 2023-12-05T09:26:34.410 INFO:tasks.workunit.client.0.smithi067.stdout:5/675: truncate db/df/db5/fe0 1730367 0 2023-12-05T09:26:34.410 INFO:tasks.workunit.client.0.smithi067.stdout:6/550: sync 2023-12-05T09:26:34.411 INFO:tasks.workunit.client.1.smithi134.stdout:7/904: dwrite d2/d7/dc/d2e/d3a/d6d/d9e/d117/f11e [0,4194304] 0 2023-12-05T09:26:34.412 INFO:tasks.workunit.client.0.smithi067.stdout:3/625: dread d9/da/d15/d17/d2b/fa9 [0,4194304] 0 2023-12-05T09:26:34.412 INFO:tasks.workunit.client.0.smithi067.stdout:9/864: dread d1b/d25/d5b/ffc [0,4194304] 0 2023-12-05T09:26:34.412 INFO:tasks.workunit.client.0.smithi067.stdout:9/865: fsync d1b/d25/d54/d5c/ff1 0 2023-12-05T09:26:34.413 INFO:tasks.workunit.client.1.smithi134.stdout:0/889: rmdir d13/d14/d30/d4b/d66/da0/da2/df2 39 2023-12-05T09:26:34.413 INFO:tasks.workunit.client.1.smithi134.stdout:0/890: fsync d13/d14/d30/d4b/d66/da0/daf/dce/d78/f97 0 2023-12-05T09:26:34.414 INFO:tasks.workunit.client.0.smithi067.stdout:5/676: rmdir db 39 2023-12-05T09:26:34.414 INFO:tasks.workunit.client.0.smithi067.stdout:5/677: read db/df/d1a/d1d/d20/f37 [3124569,118252] 0 2023-12-05T09:26:34.414 INFO:tasks.workunit.client.0.smithi067.stdout:5/678: fsync db/df/d1a/d1d/d20/f2a 0 2023-12-05T09:26:34.415 INFO:tasks.workunit.client.1.smithi134.stdout:7/905: creat d2/d7/d2b/d2d/dac/f126 x:0 0 0 2023-12-05T09:26:34.415 INFO:tasks.workunit.client.1.smithi134.stdout:7/906: fsync d2/df/d81/daf/f11f 0 2023-12-05T09:26:34.415 INFO:tasks.workunit.client.1.smithi134.stdout:7/907: chown d2/d7/d2b/d2d/d67/d73/f5b 66157399 1 2023-12-05T09:26:34.415 INFO:tasks.workunit.client.0.smithi067.stdout:5/679: creat db/df/d1a/d1d/d20/ff2 x:0 0 0 2023-12-05T09:26:34.415 INFO:tasks.workunit.client.0.smithi067.stdout:6/551: mknod da/d10/d1e/d17/d2f/d2c/d34/d3b/cc2 0 2023-12-05T09:26:34.417 INFO:tasks.workunit.client.0.smithi067.stdout:0/792: dread d3/d7/d3c/d67/dd1/f106 [8388608,4194304] 0 2023-12-05T09:26:34.417 INFO:tasks.workunit.client.1.smithi134.stdout:7/908: creat d2/d118/f127 x:0 0 0 2023-12-05T09:26:34.417 INFO:tasks.workunit.client.1.smithi134.stdout:7/909: chown d2/d7/d2b/d2d/d67/fc1 689416997 1 2023-12-05T09:26:34.418 INFO:tasks.workunit.client.0.smithi067.stdout:3/626: creat d9/da/d15/d17/d1a/fdf x:0 0 0 2023-12-05T09:26:34.418 INFO:tasks.workunit.client.0.smithi067.stdout:3/627: stat d9/da/d15/d17/d1a/f77 0 2023-12-05T09:26:34.423 INFO:tasks.workunit.client.1.smithi134.stdout:9/908: truncate d7/d8/d16/d52/f8b 562611 0 2023-12-05T09:26:34.424 INFO:tasks.workunit.client.0.smithi067.stdout:5/680: rename db/df/la0 to db/df/db5/lf3 0 2023-12-05T09:26:34.425 INFO:tasks.workunit.client.1.smithi134.stdout:3/918: dread d4/d5/d6f/d97/dae/dc9/f37 [0,4194304] 0 2023-12-05T09:26:34.426 INFO:tasks.workunit.client.1.smithi134.stdout:9/909: symlink d7/d8/d16/d52/d74/d97/d99/d10b/l137 0 2023-12-05T09:26:34.427 INFO:tasks.workunit.client.0.smithi067.stdout:6/552: mkdir da/d10/d1e/d17/d2f/d2c/dc3 0 2023-12-05T09:26:34.427 INFO:tasks.workunit.client.0.smithi067.stdout:6/553: fdatasync da/d10/d1e/d7f/fad 0 2023-12-05T09:26:34.427 INFO:tasks.workunit.client.0.smithi067.stdout:6/554: stat da/d10/d1e/f4b 0 2023-12-05T09:26:34.428 INFO:tasks.workunit.client.0.smithi067.stdout:3/628: mknod d9/d24/dce/ce0 0 2023-12-05T09:26:34.430 INFO:tasks.workunit.client.1.smithi134.stdout:3/919: mkdir d4/d1f/d50/db4/d102/d96/dde/d11b 0 2023-12-05T09:26:34.430 INFO:tasks.workunit.client.1.smithi134.stdout:0/891: write d13/d14/d30/d4b/d66/da0/daf/dde/d9d/fc7 [3129511,11856] 0 2023-12-05T09:26:34.430 INFO:tasks.workunit.client.1.smithi134.stdout:0/892: chown d13/d14/d15/d2a/d8c/db6/l11c 29471958 1 2023-12-05T09:26:34.430 INFO:tasks.workunit.client.1.smithi134.stdout:0/893: read f3 [99151,95180] 0 2023-12-05T09:26:34.430 INFO:tasks.workunit.client.1.smithi134.stdout:0/894: chown d13/d14/d15/d93/de4/d111/d112 20627488 1 2023-12-05T09:26:34.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/929: dread d16/d18/d1b/f7d [0,4194304] 0 2023-12-05T09:26:34.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/930: fsync d16/d18/dad/d10e/fe3 0 2023-12-05T09:26:34.431 INFO:tasks.workunit.client.1.smithi134.stdout:9/910: mkdir d7/d8/d16/d52/d74/d97/d99/d10b/d125/d138 0 2023-12-05T09:26:34.433 INFO:tasks.workunit.client.1.smithi134.stdout:6/874: rename d4/d39/d42/d4f/d6d/d3a/d75 to d4/d39/d42/d4f/d6d/d3a/da/d11c 0 2023-12-05T09:26:34.434 INFO:tasks.workunit.client.1.smithi134.stdout:3/920: mkdir d4/d11c 0 2023-12-05T09:26:34.435 INFO:tasks.workunit.client.0.smithi067.stdout:0/793: rename d3/d7/d3c/f75 to d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/dcf/f11a 0 2023-12-05T09:26:34.435 INFO:tasks.workunit.client.0.smithi067.stdout:0/794: fdatasync d3/f3d 0 2023-12-05T09:26:34.436 INFO:tasks.workunit.client.1.smithi134.stdout:9/911: symlink d7/d8/d14/d26/d5a/d69/d9e/l139 0 2023-12-05T09:26:34.439 INFO:tasks.workunit.client.1.smithi134.stdout:3/921: link d4/d1f/fe1 d4/d1f/d50/db4/dc1/f11d 0 2023-12-05T09:26:34.439 INFO:tasks.workunit.client.0.smithi067.stdout:5/681: symlink db/df/d38/lf4 0 2023-12-05T09:26:34.440 INFO:tasks.workunit.client.1.smithi134.stdout:3/922: write d4/d1f/fe1 [28694,124982] 0 2023-12-05T09:26:34.440 INFO:tasks.workunit.client.0.smithi067.stdout:9/866: dread d1b/d25/d35/f4a [0,4194304] 0 2023-12-05T09:26:34.440 INFO:tasks.workunit.client.0.smithi067.stdout:9/867: stat d1b/f7a 0 2023-12-05T09:26:34.440 INFO:tasks.workunit.client.0.smithi067.stdout:9/868: write d1b/dd3/d6c/d76/fa4 [2843587,119000] 0 2023-12-05T09:26:34.442 INFO:tasks.workunit.client.1.smithi134.stdout:7/910: dread d2/df/d2a/d36/f5d [0,4194304] 0 2023-12-05T09:26:34.442 INFO:tasks.workunit.client.1.smithi134.stdout:9/912: symlink d7/dee/d114/d8f/d8a/l13a 0 2023-12-05T09:26:34.442 INFO:tasks.workunit.client.1.smithi134.stdout:0/895: creat d13/d14/d15/f12c x:0 0 0 2023-12-05T09:26:34.442 INFO:tasks.workunit.client.1.smithi134.stdout:0/896: chown d13/d14/d15/dee/ffb 2212435 1 2023-12-05T09:26:34.443 INFO:tasks.workunit.client.1.smithi134.stdout:2/948: dwrite d19/d3a/ff8 [0,4194304] 0 2023-12-05T09:26:34.444 INFO:tasks.workunit.client.1.smithi134.stdout:5/894: dwrite d0/fcc [0,4194304] 0 2023-12-05T09:26:34.445 INFO:tasks.workunit.client.1.smithi134.stdout:6/875: mkdir d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/dba/d114/d119/d11d 0 2023-12-05T09:26:34.446 INFO:tasks.workunit.client.1.smithi134.stdout:7/911: rename d2/ca8 to d2/d7/d6f/dd3/c128 0 2023-12-05T09:26:34.447 INFO:tasks.workunit.client.0.smithi067.stdout:3/629: stat d9/c5b 0 2023-12-05T09:26:34.448 INFO:tasks.workunit.client.1.smithi134.stdout:0/897: getdents d13/d14/d30/d4b/dc1 0 2023-12-05T09:26:34.449 INFO:tasks.workunit.client.1.smithi134.stdout:9/913: mknod d7/d8/d14/c13b 0 2023-12-05T09:26:34.449 INFO:tasks.workunit.client.1.smithi134.stdout:9/914: fsync d7/d8/d14/d26/d5a/da1/fc4 0 2023-12-05T09:26:34.449 INFO:tasks.workunit.client.1.smithi134.stdout:3/923: dread d4/d5/d45/d60/f66 [0,4194304] 0 2023-12-05T09:26:34.452 INFO:tasks.workunit.client.1.smithi134.stdout:5/895: creat d0/d1a/d3a/f132 x:0 0 0 2023-12-05T09:26:34.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/555: rename da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/l9a to da/d10/d1e/d7f/lc4 0 2023-12-05T09:26:34.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/556: chown da/d10/d1e/f36 752 1 2023-12-05T09:26:34.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/557: write da/d10/d1e/d17/d2f/d3f/d92/f9b [652851,127578] 0 2023-12-05T09:26:34.454 INFO:tasks.workunit.client.1.smithi134.stdout:2/949: rename d19/d3f/f88 to d19/d28/d31/db3/f136 0 2023-12-05T09:26:34.454 INFO:tasks.workunit.client.1.smithi134.stdout:3/924: mknod d4/c11e 0 2023-12-05T09:26:34.455 INFO:tasks.workunit.client.1.smithi134.stdout:5/896: creat d0/d1a/d1c/d3f/d81/d8a/f133 x:0 0 0 2023-12-05T09:26:34.457 INFO:tasks.workunit.client.1.smithi134.stdout:5/897: creat d0/d1a/d1c/d25/d4d/d9e/deb/f134 x:0 0 0 2023-12-05T09:26:34.457 INFO:tasks.workunit.client.1.smithi134.stdout:5/898: chown d0/d1a/d1c/d25/d4d/d12c/fc1 132859571 1 2023-12-05T09:26:34.457 INFO:tasks.workunit.client.0.smithi067.stdout:0/795: link d3/da2/c100 d3/d7/d3c/ddb/de5/c11b 0 2023-12-05T09:26:34.457 INFO:tasks.workunit.client.1.smithi134.stdout:5/899: write d0/d1a/d1c/d3f/d5b/d5d/d78/db3/f120 [189739,126365] 0 2023-12-05T09:26:34.462 INFO:tasks.workunit.client.1.smithi134.stdout:9/915: write d7/d8/d16/d52/d74/d97/fdb [1382024,63021] 0 2023-12-05T09:26:34.462 INFO:tasks.workunit.client.1.smithi134.stdout:3/925: read d4/d5/d7c/d92/fd1 [170886,15127] 0 2023-12-05T09:26:34.462 INFO:tasks.workunit.client.1.smithi134.stdout:3/926: chown d4/d5/c14 25865 1 2023-12-05T09:26:34.462 INFO:tasks.workunit.client.1.smithi134.stdout:3/927: rename d4/d5/d6f/d97/dae/de8 to d4/d5/d6f/d97/dae/de8/d11f 22 2023-12-05T09:26:34.463 INFO:tasks.workunit.client.1.smithi134.stdout:5/900: read d0/dd/f51 [82013,120324] 0 2023-12-05T09:26:34.463 INFO:tasks.workunit.client.1.smithi134.stdout:5/901: fdatasync d0/dd/d37/d7d/ff1 0 2023-12-05T09:26:34.465 INFO:tasks.workunit.client.0.smithi067.stdout:9/869: creat d1b/d3e/d7f/f123 x:0 0 0 2023-12-05T09:26:34.465 INFO:tasks.workunit.client.1.smithi134.stdout:9/916: truncate d7/d8/d16/f1f 918446 0 2023-12-05T09:26:34.466 INFO:tasks.workunit.client.1.smithi134.stdout:9/917: dread - d7/d8/d14/d26/d7f/d92/fde zero size 2023-12-05T09:26:34.467 INFO:tasks.workunit.client.1.smithi134.stdout:3/928: unlink d4/d5/d45/d60/fa7 0 2023-12-05T09:26:34.468 INFO:tasks.workunit.client.1.smithi134.stdout:5/902: mkdir d0/d66/d135 0 2023-12-05T09:26:34.468 INFO:tasks.workunit.client.1.smithi134.stdout:5/903: chown d0/dd/d37/f101 0 1 2023-12-05T09:26:34.470 INFO:tasks.workunit.client.1.smithi134.stdout:3/929: mkdir d4/d1f/d50/db4/d102/dba/d120 0 2023-12-05T09:26:34.470 INFO:tasks.workunit.client.1.smithi134.stdout:3/930: chown d4/d1f/d4e/d6a/c74 0 1 2023-12-05T09:26:34.471 INFO:tasks.workunit.client.1.smithi134.stdout:0/898: symlink d13/d14/d30/d4b/d66/da0/daf/dce/d78/dd7/l12d 0 2023-12-05T09:26:34.471 INFO:tasks.workunit.client.1.smithi134.stdout:5/904: getdents d0/d11/d61/d107/d127/d10d 0 2023-12-05T09:26:34.471 INFO:tasks.workunit.client.1.smithi134.stdout:5/905: fsync d0/dd/f51 0 2023-12-05T09:26:34.474 INFO:tasks.workunit.client.0.smithi067.stdout:6/558: rename da/d10/d1e/d17/d2f/d2c/l8a to da/d10/d1e/d17/d2f/d59/lc5 0 2023-12-05T09:26:34.474 INFO:tasks.workunit.client.0.smithi067.stdout:6/559: truncate da/d10/d1e/d17/d2f/d1f/d27/daa/faf 607750 0 2023-12-05T09:26:34.474 INFO:tasks.workunit.client.1.smithi134.stdout:3/931: symlink d4/d5/l121 0 2023-12-05T09:26:34.476 INFO:tasks.workunit.client.0.smithi067.stdout:0/796: getdents d3/d7/d3c/d6c/d76/da7/dec 0 2023-12-05T09:26:34.476 INFO:tasks.workunit.client.0.smithi067.stdout:0/797: write d3/d7/dd7/ff2 [738389,33989] 0 2023-12-05T09:26:34.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/932: creat d4/dec/f122 x:0 0 0 2023-12-05T09:26:34.478 INFO:tasks.workunit.client.1.smithi134.stdout:5/906: getdents d0/d1a/d1c/d3f/d5b/d5d/d78/db3 0 2023-12-05T09:26:34.479 INFO:tasks.workunit.client.1.smithi134.stdout:3/933: readlink d4/d1f/d50/db4/lc4 0 2023-12-05T09:26:34.479 INFO:tasks.workunit.client.1.smithi134.stdout:3/934: readlink d4/d1f/l57 0 2023-12-05T09:26:34.479 INFO:tasks.workunit.client.1.smithi134.stdout:3/935: fsync d4/f34 0 2023-12-05T09:26:34.479 INFO:tasks.workunit.client.1.smithi134.stdout:5/907: read d0/d11/f89 [3507340,106221] 0 2023-12-05T09:26:34.479 INFO:tasks.workunit.client.1.smithi134.stdout:3/936: truncate d4/d1f/f5d 5229471 0 2023-12-05T09:26:34.479 INFO:tasks.workunit.client.1.smithi134.stdout:3/937: fsync d4/d1f/f35 0 2023-12-05T09:26:34.479 INFO:tasks.workunit.client.0.smithi067.stdout:9/870: getdents d1b/d25/d35/d56/dee 0 2023-12-05T09:26:34.480 INFO:tasks.workunit.client.1.smithi134.stdout:0/899: unlink d13/d14/d30/d4b/d66/da0/da2/l120 0 2023-12-05T09:26:34.482 INFO:tasks.workunit.client.0.smithi067.stdout:6/560: link da/d10/d1e/d17/d2f/d3f/f64 da/d10/d1e/d17/d2f/d1f/d27/daa/fc6 0 2023-12-05T09:26:34.483 INFO:tasks.workunit.client.1.smithi134.stdout:5/908: mknod d0/d1a/d1c/c136 0 2023-12-05T09:26:34.488 INFO:tasks.workunit.client.0.smithi067.stdout:9/871: mkdir d1b/dd3/d82/d124 0 2023-12-05T09:26:34.489 INFO:tasks.workunit.client.0.smithi067.stdout:6/561: link f4 da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fc7 0 2023-12-05T09:26:34.489 INFO:tasks.workunit.client.1.smithi134.stdout:5/909: creat d0/dd/d37/d90/d9d/de0/f137 x:0 0 0 2023-12-05T09:26:34.491 INFO:tasks.workunit.client.1.smithi134.stdout:8/998: sync 2023-12-05T09:26:34.491 INFO:tasks.workunit.client.1.smithi134.stdout:8/999: write da/de/d8a/d42/d99/dc8/d3b/f65 [1772267,95013] 0 2023-12-05T09:26:34.493 INFO:tasks.workunit.client.0.smithi067.stdout:9/872: truncate d1b/dd3/d6c/d76/f7b 909567 0 2023-12-05T09:26:34.494 INFO:tasks.workunit.client.0.smithi067.stdout:6/562: stat da/d10/d1e/d17/d2f/l60 0 2023-12-05T09:26:34.494 INFO:tasks.workunit.client.0.smithi067.stdout:6/563: fdatasync da/d10/d1e/d17/f23 0 2023-12-05T09:26:34.495 INFO:tasks.workunit.client.1.smithi134.stdout:5/910: mkdir d0/d1a/d1c/d3f/d81/d8a/d138 0 2023-12-05T09:26:34.495 INFO:tasks.workunit.client.1.smithi134.stdout:3/938: dread d4/d5/d45/f46 [0,4194304] 0 2023-12-05T09:26:34.498 INFO:tasks.workunit.client.1.smithi134.stdout:0/900: dread d13/d14/d15/d93/ff4 [0,4194304] 0 2023-12-05T09:26:34.499 INFO:tasks.workunit.client.1.smithi134.stdout:6/876: write d4/d39/d42/d4f/d6d/d3a/f8d [537371,448] 0 2023-12-05T09:26:34.499 INFO:tasks.workunit.client.0.smithi067.stdout:9/873: mkdir d1b/d125 0 2023-12-05T09:26:34.500 INFO:tasks.workunit.client.0.smithi067.stdout:9/874: truncate d1b/d25/d35/d56/fc0 401058 0 2023-12-05T09:26:34.500 INFO:tasks.workunit.client.0.smithi067.stdout:6/564: mknod da/d10/d1e/d17/d2f/d59/cc8 0 2023-12-05T09:26:34.509 INFO:tasks.workunit.client.0.smithi067.stdout:6/565: rename da/d10/d1e/d17/f29 to da/d10/d1e/d17/d2f/d59/d6c/fc9 0 2023-12-05T09:26:34.512 INFO:tasks.workunit.client.0.smithi067.stdout:3/630: dwrite d9/da/d15/d17/d1a/d51/d66/d82/fb4 [4194304,4194304] 0 2023-12-05T09:26:34.514 INFO:tasks.workunit.client.1.smithi134.stdout:0/901: rename d13/d14/d15/d2a to d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e 0 2023-12-05T09:26:34.515 INFO:tasks.workunit.client.1.smithi134.stdout:0/902: dread - d13/d14/d15/d93/de4/d111/f11d zero size 2023-12-05T09:26:34.515 INFO:tasks.workunit.client.1.smithi134.stdout:6/877: unlink d4/f26 0 2023-12-05T09:26:34.516 INFO:tasks.workunit.client.1.smithi134.stdout:9/918: dwrite d7/d8/d16/d52/f133 [0,4194304] 0 2023-12-05T09:26:34.516 INFO:tasks.workunit.client.1.smithi134.stdout:9/919: chown d7/d8/d14/d26/d5a/da1/fff 6138 1 2023-12-05T09:26:34.518 INFO:tasks.workunit.client.1.smithi134.stdout:0/903: rmdir d13/d14/d30/d4b/d66/da0 39 2023-12-05T09:26:34.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/920: mknod d7/d8/d14/d26/d5a/da1/c13c 0 2023-12-05T09:26:34.523 INFO:tasks.workunit.client.1.smithi134.stdout:9/921: write d7/d10/d56/f9f [146363,121576] 0 2023-12-05T09:26:34.526 INFO:tasks.workunit.client.1.smithi134.stdout:9/922: creat d7/d8/d16/d52/d74/d97/df0/f13d x:0 0 0 2023-12-05T09:26:34.526 INFO:tasks.workunit.client.0.smithi067.stdout:0/798: dwrite d3/d7/d3c/d67/d59/d4e/d94/d116/f10c [0,4194304] 0 2023-12-05T09:26:34.532 INFO:tasks.workunit.client.0.smithi067.stdout:3/631: dread d9/d20/fac [0,4194304] 0 2023-12-05T09:26:34.542 INFO:tasks.workunit.client.1.smithi134.stdout:9/923: write f1 [4337351,10626] 0 2023-12-05T09:26:34.557 INFO:tasks.workunit.client.1.smithi134.stdout:9/924: dread d7/d7d/f106 [0,4194304] 0 2023-12-05T09:26:34.589 INFO:tasks.workunit.client.1.smithi134.stdout:9/925: mkdir d7/d8/d14/d26/d7f/d92/d53/dd4/d13e 0 2023-12-05T09:26:34.590 INFO:tasks.workunit.client.1.smithi134.stdout:6/878: rename d4/d39/d42/d4f/d6d/d3a/da/fed to d4/d32/d74/dee/f11e 0 2023-12-05T09:26:34.597 INFO:tasks.workunit.client.0.smithi067.stdout:9/875: dwrite d1b/d25/d54/d5c/f98 [0,4194304] 0 2023-12-05T09:26:34.600 INFO:tasks.workunit.client.1.smithi134.stdout:0/904: truncate d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/f49 805003 0 2023-12-05T09:26:34.603 INFO:tasks.workunit.client.1.smithi134.stdout:5/911: dwrite d0/d1a/d1c/d25/d4d/d9e/fac [0,4194304] 0 2023-12-05T09:26:34.603 INFO:tasks.workunit.client.1.smithi134.stdout:9/926: dread d7/d8/d14/d26/fbd [0,4194304] 0 2023-12-05T09:26:34.603 INFO:tasks.workunit.client.1.smithi134.stdout:9/927: write d7/d8/f84 [1051924,36719] 0 2023-12-05T09:26:34.605 INFO:tasks.workunit.client.1.smithi134.stdout:6/879: mkdir d4/d39/d42/d4f/d6d/d3a/da/d11f 0 2023-12-05T09:26:34.605 INFO:tasks.workunit.client.1.smithi134.stdout:5/912: creat d0/d1a/d1c/d3f/d5b/d5d/d78/db3/f139 x:0 0 0 2023-12-05T09:26:34.606 INFO:tasks.workunit.client.0.smithi067.stdout:6/566: rmdir da/d10/d1e/d17/d2f/d1f 39 2023-12-05T09:26:34.607 INFO:tasks.workunit.client.0.smithi067.stdout:6/567: write da/d10/d1e/d51/f7a [83344,67560] 0 2023-12-05T09:26:34.611 INFO:tasks.workunit.client.1.smithi134.stdout:9/928: symlink d7/d8/d16/d52/d74/d97/d99/l13f 0 2023-12-05T09:26:34.611 INFO:tasks.workunit.client.1.smithi134.stdout:9/929: chown d7/d8/d14/fad 395758075 1 2023-12-05T09:26:34.611 INFO:tasks.workunit.client.1.smithi134.stdout:4/931: sync 2023-12-05T09:26:34.611 INFO:tasks.workunit.client.1.smithi134.stdout:4/932: getdents d16/d7b/dce/d13a 0 2023-12-05T09:26:34.613 INFO:tasks.workunit.client.0.smithi067.stdout:2/571: sync 2023-12-05T09:26:34.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/905: write d13/d14/d30/d4b/d66/da0/daf/dce/f82 [744152,5453] 0 2023-12-05T09:26:34.614 INFO:tasks.workunit.client.1.smithi134.stdout:0/906: truncate d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/f58 978681 0 2023-12-05T09:26:34.614 INFO:tasks.workunit.client.0.smithi067.stdout:0/799: mkdir d3/d7/d3c/d66/d11c 0 2023-12-05T09:26:34.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/933: link d16/d18/dad/d10e/c52 d16/d21/d48/d101/c149 0 2023-12-05T09:26:34.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/934: write d16/d21/d48/d66/fbf [858594,41455] 0 2023-12-05T09:26:34.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/935: creat d16/d18/dc5/dc2/f14a x:0 0 0 2023-12-05T09:26:34.617 INFO:tasks.workunit.client.0.smithi067.stdout:3/632: symlink d9/da/d15/d17/d1a/le1 0 2023-12-05T09:26:34.623 INFO:tasks.workunit.client.1.smithi134.stdout:2/950: sync 2023-12-05T09:26:34.623 INFO:tasks.workunit.client.1.smithi134.stdout:7/912: sync 2023-12-05T09:26:34.623 INFO:tasks.workunit.client.1.smithi134.stdout:0/907: rename d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/c61 to d13/d14/d30/d4b/d66/da0/da2/df2/d127/c12f 0 2023-12-05T09:26:34.623 INFO:tasks.workunit.client.1.smithi134.stdout:7/913: readlink d2/df/lc4 0 2023-12-05T09:26:34.623 INFO:tasks.workunit.client.1.smithi134.stdout:7/914: dread - d2/df/d2a/d36/f120 zero size 2023-12-05T09:26:34.623 INFO:tasks.workunit.client.1.smithi134.stdout:6/880: getdents d4/d39/d42 0 2023-12-05T09:26:34.624 INFO:tasks.workunit.client.1.smithi134.stdout:5/913: read d0/f33 [3087825,124294] 0 2023-12-05T09:26:34.624 INFO:tasks.workunit.client.1.smithi134.stdout:5/914: write d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/f12f [1155490,71385] 0 2023-12-05T09:26:34.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/951: creat d19/d28/d63/d70/d122/f137 x:0 0 0 2023-12-05T09:26:34.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/952: dread - d19/d28/d31/d38/d98/db5/ff1 zero size 2023-12-05T09:26:34.632 INFO:tasks.workunit.client.0.smithi067.stdout:6/568: rmdir da/d10/d1e/d17/d2f/d1f/d27 39 2023-12-05T09:26:34.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/915: creat d2/d7/dc/d2e/d3a/d6d/d9e/f129 x:0 0 0 2023-12-05T09:26:34.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/916: stat d2/df/d81/def 0 2023-12-05T09:26:34.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/917: chown d2/d7/d2b/d2d/d67/d73/d26/l5a 1783 1 2023-12-05T09:26:34.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/918: chown d2/d7/d2b/dd9/df8/d103/f10c 138981 1 2023-12-05T09:26:34.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/919: readlink d2/d7/dc/d2e/le7 0 2023-12-05T09:26:34.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/920: read d2/d7/d93/dcf/ddd/f111 [2373193,36753] 0 2023-12-05T09:26:34.636 INFO:tasks.workunit.client.1.smithi134.stdout:5/915: creat d0/d1a/d1c/d25/d4d/f13a x:0 0 0 2023-12-05T09:26:34.636 INFO:tasks.workunit.client.1.smithi134.stdout:2/953: symlink d19/d76/db9/l138 0 2023-12-05T09:26:34.636 INFO:tasks.workunit.client.1.smithi134.stdout:5/916: write d0/d1a/d1c/fdd [572207,5959] 0 2023-12-05T09:26:34.636 INFO:tasks.workunit.client.1.smithi134.stdout:7/921: creat d2/d7/d6f/da0/ddb/f12a x:0 0 0 2023-12-05T09:26:34.636 INFO:tasks.workunit.client.0.smithi067.stdout:6/569: mkdir da/d7d/dca 0 2023-12-05T09:26:34.637 INFO:tasks.workunit.client.1.smithi134.stdout:2/954: symlink d19/d3a/d60/l139 0 2023-12-05T09:26:34.638 INFO:tasks.workunit.client.1.smithi134.stdout:3/939: sync 2023-12-05T09:26:34.639 INFO:tasks.workunit.client.1.smithi134.stdout:7/922: getdents d2/d7/dc/d2e/d3a 0 2023-12-05T09:26:34.644 INFO:tasks.workunit.client.1.smithi134.stdout:2/955: unlink d19/d3a/df4/fab 0 2023-12-05T09:26:34.644 INFO:tasks.workunit.client.1.smithi134.stdout:4/936: rename d16/d7b/dce/d6e to d16/d7b/db6/dbc/d14b 0 2023-12-05T09:26:34.645 INFO:tasks.workunit.client.1.smithi134.stdout:3/940: creat d4/d1f/d50/db4/d102/d96/dde/d11b/f123 x:0 0 0 2023-12-05T09:26:34.648 INFO:tasks.workunit.client.1.smithi134.stdout:7/923: unlink d2/df/d2a/d36/fc9 0 2023-12-05T09:26:34.648 INFO:tasks.workunit.client.1.smithi134.stdout:4/937: creat d16/d21/d48/d66/db0/dea/f14c x:0 0 0 2023-12-05T09:26:34.649 INFO:tasks.workunit.client.1.smithi134.stdout:2/956: truncate d19/d28/d2b/ff2 919392 0 2023-12-05T09:26:34.650 INFO:tasks.workunit.client.1.smithi134.stdout:2/957: fsync d19/d28/d31/d6f/f10e 0 2023-12-05T09:26:34.650 INFO:tasks.workunit.client.1.smithi134.stdout:2/958: dread - d19/d28/d9e/f132 zero size 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:4/938: mkdir d16/d18/dad/d14d 0 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:4/939: readlink d16/d21/d48/ld1 0 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:4/940: stat d16/d21/led 0 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:4/941: truncate d16/d21/d48/f58 241457 0 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:4/942: chown d16/d21/d48/d66/l99 21098 1 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:3/941: symlink d4/d11c/l124 0 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:3/942: write d4/d5/f1e [187076,59805] 0 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:3/943: truncate d4/d5/d45/d86/f9a 1131778 0 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:3/944: readlink d4/d5/l21 0 2023-12-05T09:26:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:3/945: truncate d4/d5/d45/ffc 909220 0 2023-12-05T09:26:34.653 INFO:tasks.workunit.client.1.smithi134.stdout:9/930: dwrite d7/d8/d2e/f31 [0,4194304] 0 2023-12-05T09:26:34.654 INFO:tasks.workunit.client.0.smithi067.stdout:6/570: write da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fc7 [1625006,124480] 0 2023-12-05T09:26:34.654 INFO:tasks.workunit.client.0.smithi067.stdout:6/571: truncate da/d10/d1e/d17/d2f/d1f/d27/d4f/fb7 63593 0 2023-12-05T09:26:34.655 INFO:tasks.workunit.client.1.smithi134.stdout:4/943: link d16/d21/de5/f12f d16/d9c/dac/f14e 0 2023-12-05T09:26:34.656 INFO:tasks.workunit.client.1.smithi134.stdout:4/944: creat d16/d21/d48/d80/dae/d65/f14f x:0 0 0 2023-12-05T09:26:34.656 INFO:tasks.workunit.client.1.smithi134.stdout:4/945: read - d16/d7b/db6/dbc/f126 zero size 2023-12-05T09:26:34.658 INFO:tasks.workunit.client.1.smithi134.stdout:2/959: link d19/d28/d31/d38/fce d19/d3a/df4/f13a 0 2023-12-05T09:26:34.658 INFO:tasks.workunit.client.1.smithi134.stdout:2/960: fsync d19/f8f 0 2023-12-05T09:26:34.659 INFO:tasks.workunit.client.1.smithi134.stdout:3/946: getdents d4/d5/d45/df2/d108 0 2023-12-05T09:26:34.660 INFO:tasks.workunit.client.1.smithi134.stdout:0/908: dread d13/d14/d30/f32 [0,4194304] 0 2023-12-05T09:26:34.660 INFO:tasks.workunit.client.1.smithi134.stdout:0/909: fsync d13/fb1 0 2023-12-05T09:26:34.666 INFO:tasks.workunit.client.1.smithi134.stdout:4/946: symlink d16/d18/dad/l150 0 2023-12-05T09:26:34.666 INFO:tasks.workunit.client.1.smithi134.stdout:4/947: readlink d16/d7b/db6/dbc/d14b/daa/ld3 0 2023-12-05T09:26:34.667 INFO:tasks.workunit.client.1.smithi134.stdout:9/931: unlink d7/d10/d56/dd5/c101 0 2023-12-05T09:26:34.676 INFO:tasks.workunit.client.1.smithi134.stdout:2/961: rename d19/d28/d2b/l8a to d19/d28/d63/d70/l13b 0 2023-12-05T09:26:34.677 INFO:tasks.workunit.client.1.smithi134.stdout:3/947: unlink d4/d5/d6f/d97/dae/dc9/f37 0 2023-12-05T09:26:34.684 INFO:tasks.workunit.client.1.smithi134.stdout:0/910: write d13/d14/f87 [4597270,95582] 0 2023-12-05T09:26:34.687 INFO:tasks.workunit.client.1.smithi134.stdout:0/911: symlink d13/d14/l130 0 2023-12-05T09:26:34.688 INFO:tasks.workunit.client.1.smithi134.stdout:0/912: readlink d13/d14/d30/d4b/d66/l7b 0 2023-12-05T09:26:34.692 INFO:tasks.workunit.client.1.smithi134.stdout:0/913: mknod d13/d14/d30/d4b/d66/da0/daf/dce/d103/c131 0 2023-12-05T09:26:34.692 INFO:tasks.workunit.client.1.smithi134.stdout:0/914: chown d13/d14/d30/d4b/d66/da0/daf/dde/ld0 19 1 2023-12-05T09:26:34.705 INFO:tasks.workunit.client.1.smithi134.stdout:0/915: dread d13/d14/d30/d4b/d66/da0/daf/db2/fcc [0,4194304] 0 2023-12-05T09:26:34.709 INFO:tasks.workunit.client.1.smithi134.stdout:3/948: dread d4/d5/d6f/dc2/fca [0,4194304] 0 2023-12-05T09:26:34.709 INFO:tasks.workunit.client.0.smithi067.stdout:0/800: dwrite d3/d7/d3c/d6c/d76/da7/dec/f26 [4194304,4194304] 0 2023-12-05T09:26:34.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/881: dwrite d4/d39/d42/d4f/f103 [0,4194304] 0 2023-12-05T09:26:34.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/882: getdents d4/d39/d42/d4f/d6d 0 2023-12-05T09:26:34.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/883: fdatasync d4/d39/d42/d4f/d6d/d3a/d80/f87 0 2023-12-05T09:26:34.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/884: write d4/d39/d42/d4f/d6d/d3a/f3d [3169417,32315] 0 2023-12-05T09:26:34.711 INFO:tasks.workunit.client.0.smithi067.stdout:0/801: link d3/d6b/fbe d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/f11d 0 2023-12-05T09:26:34.712 INFO:tasks.workunit.client.0.smithi067.stdout:0/802: truncate d3/d7/d30/f9b 6255040 0 2023-12-05T09:26:34.714 INFO:tasks.workunit.client.0.smithi067.stdout:0/803: truncate d3/d7/d3c/fa3 181753 0 2023-12-05T09:26:34.714 INFO:tasks.workunit.client.0.smithi067.stdout:0/804: readlink d3/d6b/d10a/l10f 0 2023-12-05T09:26:34.714 INFO:tasks.workunit.client.0.smithi067.stdout:0/805: chown d3/d7/dd7/fdc 1 1 2023-12-05T09:26:34.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/806: truncate d3/d6b/f6f 1751918 0 2023-12-05T09:26:34.716 INFO:tasks.workunit.client.0.smithi067.stdout:0/807: truncate d3/d7/d3c/f50 2872812 0 2023-12-05T09:26:34.723 INFO:tasks.workunit.client.1.smithi134.stdout:3/949: write d4/d1f/d4e/f61 [1033001,63447] 0 2023-12-05T09:26:34.725 INFO:tasks.workunit.client.1.smithi134.stdout:6/885: creat d4/d39/d5c/f120 x:0 0 0 2023-12-05T09:26:34.726 INFO:tasks.workunit.client.1.smithi134.stdout:6/886: symlink d4/d39/d42/d4f/d6d/d3a/da/d11c/d59/l121 0 2023-12-05T09:26:34.728 INFO:tasks.workunit.client.1.smithi134.stdout:6/887: mknod d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/dba/d114/c122 0 2023-12-05T09:26:34.730 INFO:tasks.workunit.client.1.smithi134.stdout:3/950: mknod d4/d1f/d50/db4/d102/dab/ddc/c125 0 2023-12-05T09:26:34.733 INFO:tasks.workunit.client.1.smithi134.stdout:3/951: creat d4/d5/d45/d86/db0/f126 x:0 0 0 2023-12-05T09:26:34.736 INFO:tasks.workunit.client.1.smithi134.stdout:3/952: unlink d4/d1f/d50/db4/d102/d96/cb2 0 2023-12-05T09:26:34.737 INFO:tasks.workunit.client.1.smithi134.stdout:6/888: rmdir d4/d39/d42/d4f/d6d/d3a/da/d11c/d8f 0 2023-12-05T09:26:34.737 INFO:tasks.workunit.client.1.smithi134.stdout:6/889: chown d4/d78/fdd 14501 1 2023-12-05T09:26:34.738 INFO:tasks.workunit.client.1.smithi134.stdout:3/953: chown d4/d5/d6f/d76/lda 2650792 1 2023-12-05T09:26:34.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/954: creat d4/d5/f127 x:0 0 0 2023-12-05T09:26:34.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/955: write d4/d5/d45/d60/f66 [2712529,23903] 0 2023-12-05T09:26:34.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/956: truncate d4/d5/d6f/d97/dae/dc9/f30 4393951 0 2023-12-05T09:26:34.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/957: fdatasync d4/d5/d7c/f11a 0 2023-12-05T09:26:34.746 INFO:tasks.workunit.client.1.smithi134.stdout:6/890: truncate d4/d39/f51 1813746 0 2023-12-05T09:26:34.746 INFO:tasks.workunit.client.1.smithi134.stdout:6/891: creat d4/d39/d42/d4f/d6d/d3a/dd4/f123 x:0 0 0 2023-12-05T09:26:34.747 INFO:tasks.workunit.client.1.smithi134.stdout:6/892: chown d4/d39/d42/d4f/d6d/l97 12504562 1 2023-12-05T09:26:34.747 INFO:tasks.workunit.client.1.smithi134.stdout:5/917: dwrite d0/d1a/d1c/d25/d6a/f95 [0,4194304] 0 2023-12-05T09:26:34.747 INFO:tasks.workunit.client.0.smithi067.stdout:9/876: dwrite d1b/d25/d35/f85 [0,4194304] 0 2023-12-05T09:26:34.747 INFO:tasks.workunit.client.0.smithi067.stdout:2/572: dwrite d0/d25/d9d/d53/d1e/f74 [0,4194304] 0 2023-12-05T09:26:34.747 INFO:tasks.workunit.client.0.smithi067.stdout:2/573: fdatasync d0/d25/d34/d4d/d78/fc6 0 2023-12-05T09:26:34.747 INFO:tasks.workunit.client.0.smithi067.stdout:9/877: truncate d1b/d25/fb5 307146 0 2023-12-05T09:26:34.747 INFO:tasks.workunit.client.0.smithi067.stdout:2/574: creat d0/d7c/fc8 x:0 0 0 2023-12-05T09:26:34.749 INFO:tasks.workunit.client.0.smithi067.stdout:6/572: dwrite da/d10/d1e/d17/d2f/d72/f82 [0,4194304] 0 2023-12-05T09:26:34.750 INFO:tasks.workunit.client.1.smithi134.stdout:5/918: symlink d0/d1a/d1c/d3f/d81/d8e/l13b 0 2023-12-05T09:26:34.752 INFO:tasks.workunit.client.0.smithi067.stdout:9/878: rename d1b/d3e/d7f/f123 to d1b/d25/d5b/d62/def/dca/f126 0 2023-12-05T09:26:34.752 INFO:tasks.workunit.client.1.smithi134.stdout:5/919: read d0/d11/d61/d107/d127/f108 [598425,99124] 0 2023-12-05T09:26:34.754 INFO:tasks.workunit.client.0.smithi067.stdout:2/575: symlink d0/d25/d9d/d53/d92/lc9 0 2023-12-05T09:26:34.755 INFO:tasks.workunit.client.1.smithi134.stdout:4/948: dwrite d16/f7a [0,4194304] 0 2023-12-05T09:26:34.756 INFO:tasks.workunit.client.1.smithi134.stdout:4/949: chown d16/d9c/f13d 2988 1 2023-12-05T09:26:34.756 INFO:tasks.workunit.client.1.smithi134.stdout:4/950: write d16/d9c/f131 [338553,13952] 0 2023-12-05T09:26:34.758 INFO:tasks.workunit.client.0.smithi067.stdout:6/573: stat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/l57 0 2023-12-05T09:26:34.762 INFO:tasks.workunit.client.0.smithi067.stdout:2/576: mknod d0/d25/d34/d4d/d54/d56/cca 0 2023-12-05T09:26:34.762 INFO:tasks.workunit.client.0.smithi067.stdout:9/879: creat d1b/d25/d5b/f127 x:0 0 0 2023-12-05T09:26:34.762 INFO:tasks.workunit.client.0.smithi067.stdout:9/880: write d1b/dd3/f80 [1667970,114763] 0 2023-12-05T09:26:34.765 INFO:tasks.workunit.client.1.smithi134.stdout:2/962: dwrite d19/d28/d63/f67 [0,4194304] 0 2023-12-05T09:26:34.765 INFO:tasks.workunit.client.1.smithi134.stdout:2/963: fsync d19/d76/dba/fd0 0 2023-12-05T09:26:34.765 INFO:tasks.workunit.client.1.smithi134.stdout:2/964: fdatasync d19/d28/d2b/f2f 0 2023-12-05T09:26:34.767 INFO:tasks.workunit.client.1.smithi134.stdout:2/965: unlink d19/d3a/df4/la6 0 2023-12-05T09:26:34.768 INFO:tasks.workunit.client.0.smithi067.stdout:6/574: mkdir da/d10/d1e/d69/dcb 0 2023-12-05T09:26:34.769 INFO:tasks.workunit.client.1.smithi134.stdout:4/951: truncate d16/d21/d48/d66/fdf 396583 0 2023-12-05T09:26:34.771 INFO:tasks.workunit.client.0.smithi067.stdout:9/881: mknod d1b/d25/c128 0 2023-12-05T09:26:34.774 INFO:tasks.workunit.client.1.smithi134.stdout:0/916: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/d9d/f122 [0,4194304] 0 2023-12-05T09:26:34.776 INFO:tasks.workunit.client.1.smithi134.stdout:7/924: dwrite d2/df/d2a/d36/f104 [0,4194304] 0 2023-12-05T09:26:34.776 INFO:tasks.workunit.client.1.smithi134.stdout:9/932: dwrite d7/d8/d14/d26/fbd [0,4194304] 0 2023-12-05T09:26:34.776 INFO:tasks.workunit.client.1.smithi134.stdout:9/933: readlink d7/d8/d16/d52/l5d 0 2023-12-05T09:26:34.783 INFO:tasks.workunit.client.0.smithi067.stdout:6/575: getdents da/d10/d1e/d17/d2f/d59/d6c 0 2023-12-05T09:26:34.783 INFO:tasks.workunit.client.0.smithi067.stdout:6/576: truncate da/d10/d1e/d17/d2f/d3f/d92/f9b 1477828 0 2023-12-05T09:26:34.783 INFO:tasks.workunit.client.0.smithi067.stdout:6/577: fsync da/d7d/fb3 0 2023-12-05T09:26:34.787 INFO:tasks.workunit.client.1.smithi134.stdout:9/934: symlink d7/d8/d14/d26/d5a/d69/d10e/l140 0 2023-12-05T09:26:34.790 INFO:tasks.workunit.client.1.smithi134.stdout:0/917: creat d13/d14/d15/d93/de4/d111/d112/f132 x:0 0 0 2023-12-05T09:26:34.794 INFO:tasks.workunit.client.1.smithi134.stdout:7/925: rename d2/d7/dc/d2e/c84 to d2/d7/d2b/dd9/c12b 0 2023-12-05T09:26:34.796 INFO:tasks.workunit.client.1.smithi134.stdout:7/926: creat d2/d7/d2b/d94/f12c x:0 0 0 2023-12-05T09:26:34.799 INFO:tasks.workunit.client.0.smithi067.stdout:9/882: write d1b/d25/d54/d5c/ff1 [3437038,51181] 0 2023-12-05T09:26:34.799 INFO:tasks.workunit.client.0.smithi067.stdout:9/883: read - d1b/d25/d35/d56/fbc zero size 2023-12-05T09:26:34.799 INFO:tasks.workunit.client.0.smithi067.stdout:9/884: creat d1b/d25/d5b/d62/def/f129 x:0 0 0 2023-12-05T09:26:34.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/918: rename d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/d8c/db6/fc4 to d13/d14/d30/d4b/d66/da0/daf/dde/da9/f133 0 2023-12-05T09:26:34.801 INFO:tasks.workunit.client.1.smithi134.stdout:7/927: creat d2/df/d81/def/f12d x:0 0 0 2023-12-05T09:26:34.801 INFO:tasks.workunit.client.1.smithi134.stdout:7/928: chown d2/d7/d2b/dd9/df8/d103 26891 1 2023-12-05T09:26:34.804 INFO:tasks.workunit.client.1.smithi134.stdout:7/929: rmdir d2/d7/dc/d2e/d3a/d6d 39 2023-12-05T09:26:34.804 INFO:tasks.workunit.client.1.smithi134.stdout:7/930: creat d2/d7/d2b/f12e x:0 0 0 2023-12-05T09:26:34.811 INFO:tasks.workunit.client.1.smithi134.stdout:7/931: mkdir d2/d70/d12f 0 2023-12-05T09:26:34.811 INFO:tasks.workunit.client.1.smithi134.stdout:7/932: write d2/d7/dc/d2e/d3a/d6d/d9e/f129 [605965,103840] 0 2023-12-05T09:26:34.813 INFO:tasks.workunit.client.1.smithi134.stdout:9/935: dread d7/d10/db3/fd3 [0,4194304] 0 2023-12-05T09:26:34.815 INFO:tasks.workunit.client.1.smithi134.stdout:7/933: creat d2/d7/d93/dcf/f130 x:0 0 0 2023-12-05T09:26:34.815 INFO:tasks.workunit.client.1.smithi134.stdout:0/919: dread d13/d14/d30/d4b/d66/da0/da2/df2/d127/f110 [0,4194304] 0 2023-12-05T09:26:34.817 INFO:tasks.workunit.client.1.smithi134.stdout:9/936: rmdir d7/d8/d14/d26/d7f/d92/d122 39 2023-12-05T09:26:34.818 INFO:tasks.workunit.client.1.smithi134.stdout:7/934: mkdir d2/d7/d93/dcf/d116/d131 0 2023-12-05T09:26:34.819 INFO:tasks.workunit.client.1.smithi134.stdout:6/893: dwrite d4/d32/d74/dee/f10b [0,4194304] 0 2023-12-05T09:26:34.819 INFO:tasks.workunit.client.1.smithi134.stdout:3/958: dwrite d4/d5/d45/d60/f82 [0,4194304] 0 2023-12-05T09:26:34.821 INFO:tasks.workunit.client.1.smithi134.stdout:7/935: unlink d2/d7/d2b/d2d/d67/d73/c82 0 2023-12-05T09:26:34.822 INFO:tasks.workunit.client.1.smithi134.stdout:6/894: creat d4/f124 x:0 0 0 2023-12-05T09:26:34.824 INFO:tasks.workunit.client.1.smithi134.stdout:9/937: rename d7/dee/d114/d8f/l6d to d7/l141 0 2023-12-05T09:26:34.824 INFO:tasks.workunit.client.1.smithi134.stdout:9/938: fdatasync d7/d8/d2e/f31 0 2023-12-05T09:26:34.824 INFO:tasks.workunit.client.1.smithi134.stdout:7/936: creat d2/d7/d2b/d2d/d67/f132 x:0 0 0 2023-12-05T09:26:34.826 INFO:tasks.workunit.client.1.smithi134.stdout:6/895: rename d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/dd7 to d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/d125 0 2023-12-05T09:26:34.827 INFO:tasks.workunit.client.1.smithi134.stdout:7/937: rename d2/d7/d2b to d2/d7/d2b/d2d/d67/d73/d26/d133 22 2023-12-05T09:26:34.828 INFO:tasks.workunit.client.1.smithi134.stdout:7/938: getdents d2/d7/d93/dcf/dd6 0 2023-12-05T09:26:34.831 INFO:tasks.workunit.client.1.smithi134.stdout:6/896: creat d4/d78/f126 x:0 0 0 2023-12-05T09:26:34.842 INFO:tasks.workunit.client.1.smithi134.stdout:5/920: dwrite d0/d1a/d1c/f23 [0,4194304] 0 2023-12-05T09:26:34.842 INFO:tasks.workunit.client.1.smithi134.stdout:5/921: write d0/d11/f89 [1470807,94371] 0 2023-12-05T09:26:34.842 INFO:tasks.workunit.client.1.smithi134.stdout:2/966: dwrite d19/d28/d31/d38/f59 [0,4194304] 0 2023-12-05T09:26:34.856 INFO:tasks.workunit.client.0.smithi067.stdout:6/578: dwrite da/d10/d1e/d17/d2f/d2c/d34/d3b/fbb [0,4194304] 0 2023-12-05T09:26:34.869 INFO:tasks.workunit.client.1.smithi134.stdout:6/897: dread d4/d39/d42/d4f/d6d/d3a/da/f77 [0,4194304] 0 2023-12-05T09:26:34.869 INFO:tasks.workunit.client.1.smithi134.stdout:6/898: truncate d4/f105 195540 0 2023-12-05T09:26:34.871 INFO:tasks.workunit.client.1.smithi134.stdout:6/899: mknod d4/d39/d42/d4f/d6d/d3a/da/d11f/c127 0 2023-12-05T09:26:34.892 INFO:tasks.workunit.client.1.smithi134.stdout:6/900: write d4/d39/d42/d4f/d6d/d3a/da/d11c/f29 [309274,76208] 0 2023-12-05T09:26:34.892 INFO:tasks.workunit.client.1.smithi134.stdout:6/901: readlink d4/d39/d42/d4f/d6d/d3a/da/l56 0 2023-12-05T09:26:34.892 INFO:tasks.workunit.client.1.smithi134.stdout:6/902: fdatasync d4/d39/d42/d4f/d6d/d3a/da/f72 0 2023-12-05T09:26:34.893 INFO:tasks.workunit.client.1.smithi134.stdout:6/903: creat d4/d39/d42/d4f/d6d/d3a/da/d11c/f128 x:0 0 0 2023-12-05T09:26:34.894 INFO:tasks.workunit.client.1.smithi134.stdout:0/920: dwrite d13/d14/d15/d93/de4/d111/f11d [0,4194304] 0 2023-12-05T09:26:34.904 INFO:tasks.workunit.client.1.smithi134.stdout:6/904: write d4/d39/f51 [895208,104928] 0 2023-12-05T09:26:34.904 INFO:tasks.workunit.client.1.smithi134.stdout:6/905: fsync d4/d39/d42/d4f/d6d/d3a/da/d11c/f10a 0 2023-12-05T09:26:34.906 INFO:tasks.workunit.client.1.smithi134.stdout:6/906: truncate d4/d32/d57/f5d 3654821 0 2023-12-05T09:26:34.906 INFO:tasks.workunit.client.1.smithi134.stdout:6/907: chown d4/d32/d57/f107 3 1 2023-12-05T09:26:34.916 INFO:tasks.workunit.client.1.smithi134.stdout:0/921: dread d13/d14/f5c [0,4194304] 0 2023-12-05T09:26:34.917 INFO:tasks.workunit.client.1.smithi134.stdout:0/922: rmdir d13/d14/d30/d4b/dc1/dda 39 2023-12-05T09:26:34.918 INFO:tasks.workunit.client.1.smithi134.stdout:0/923: creat d13/d14/d30/d4b/d66/da0/daf/dce/d86/f134 x:0 0 0 2023-12-05T09:26:34.918 INFO:tasks.workunit.client.1.smithi134.stdout:0/924: chown d13/d14/l130 1 1 2023-12-05T09:26:34.920 INFO:tasks.workunit.client.0.smithi067.stdout:2/577: dwrite d0/d25/d9d/d53/d1e/d7f/f91 [0,4194304] 0 2023-12-05T09:26:34.920 INFO:tasks.workunit.client.1.smithi134.stdout:2/967: dwrite d19/d28/f4e [0,4194304] 0 2023-12-05T09:26:34.920 INFO:tasks.workunit.client.1.smithi134.stdout:9/939: dwrite d7/d5b/d5e/f105 [0,4194304] 0 2023-12-05T09:26:34.921 INFO:tasks.workunit.client.1.smithi134.stdout:7/939: dwrite d2/d7/f13 [4194304,4194304] 0 2023-12-05T09:26:34.921 INFO:tasks.workunit.client.0.smithi067.stdout:6/579: dwrite da/d10/d1e/d17/d2f/d72/fa7 [0,4194304] 0 2023-12-05T09:26:34.922 INFO:tasks.workunit.client.1.smithi134.stdout:5/922: dwrite d0/d1a/d1c/d25/d4d/f70 [0,4194304] 0 2023-12-05T09:26:34.923 INFO:tasks.workunit.client.1.smithi134.stdout:2/968: mknod d19/d28/d31/db3/c13c 0 2023-12-05T09:26:34.923 INFO:tasks.workunit.client.1.smithi134.stdout:2/969: dread - d19/d28/d63/d70/d122/f137 zero size 2023-12-05T09:26:34.924 INFO:tasks.workunit.client.1.smithi134.stdout:7/940: creat d2/d7/d2b/dd9/f134 x:0 0 0 2023-12-05T09:26:34.925 INFO:tasks.workunit.client.1.smithi134.stdout:2/970: getdents d19/d28/d31/dd3 0 2023-12-05T09:26:34.925 INFO:tasks.workunit.client.1.smithi134.stdout:2/971: fdatasync d19/d76/db9/f100 0 2023-12-05T09:26:34.926 INFO:tasks.workunit.client.1.smithi134.stdout:6/908: write d4/d39/d42/d4f/d6d/d3a/d80/f8b [2734101,36048] 0 2023-12-05T09:26:35.026 INFO:tasks.workunit.client.1.smithi134.stdout:2/972: getdents d19/d76/db8 0 2023-12-05T09:26:35.028 INFO:tasks.workunit.client.1.smithi134.stdout:5/923: creat d0/f13c x:0 0 0 2023-12-05T09:26:35.028 INFO:tasks.workunit.client.1.smithi134.stdout:5/924: write d0/d11/f1b [641712,49763] 0 2023-12-05T09:26:35.028 INFO:tasks.workunit.client.1.smithi134.stdout:2/973: creat d19/d76/dba/f13d x:0 0 0 2023-12-05T09:26:35.030 INFO:tasks.workunit.client.1.smithi134.stdout:5/925: rmdir d0/d1a/d1c/d3f/d5b/d5d 39 2023-12-05T09:26:35.032 INFO:tasks.workunit.client.1.smithi134.stdout:2/974: truncate d19/d3a/fb4 940467 0 2023-12-05T09:26:35.033 INFO:tasks.workunit.client.1.smithi134.stdout:0/925: write d13/f38 [2828265,96352] 0 2023-12-05T09:26:35.036 INFO:tasks.workunit.client.1.smithi134.stdout:5/926: mkdir d0/d45/daf/d13d 0 2023-12-05T09:26:35.037 INFO:tasks.workunit.client.1.smithi134.stdout:0/926: creat d13/d14/d15/d67/d73/d100/f135 x:0 0 0 2023-12-05T09:26:35.038 INFO:tasks.workunit.client.1.smithi134.stdout:0/927: write d13/d14/d15/d67/d73/d100/f135 [424105,77651] 0 2023-12-05T09:26:35.039 INFO:tasks.workunit.client.0.smithi067.stdout:6/580: rename da/d10/d1e/d17/d2f/f77 to da/d10/d1e/d69/dcb/fcc 0 2023-12-05T09:26:35.039 INFO:tasks.workunit.client.0.smithi067.stdout:6/581: fdatasync da/d10/d1e/d17/d2f/dbc/fb0 0 2023-12-05T09:26:35.040 INFO:tasks.workunit.client.1.smithi134.stdout:4/952: sync 2023-12-05T09:26:35.042 INFO:tasks.workunit.client.1.smithi134.stdout:0/928: rename d13/d14/d15/d93/de4/d111/d112/f121 to d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/f136 0 2023-12-05T09:26:35.045 INFO:tasks.workunit.client.1.smithi134.stdout:4/953: rmdir d16/d21/d48/d66/d12e 0 2023-12-05T09:26:35.047 INFO:tasks.workunit.client.0.smithi067.stdout:1/712: sync 2023-12-05T09:26:35.050 INFO:tasks.workunit.client.0.smithi067.stdout:6/582: fsync da/d10/d1e/d69/dcb/fcc 0 2023-12-05T09:26:35.052 INFO:tasks.workunit.client.1.smithi134.stdout:9/940: dwrite d7/d8/d14/d26/d7f/d92/fde [0,4194304] 0 2023-12-05T09:26:35.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/583: rename da/fa1 to da/d10/d1e/d17/d2f/d3f/d92/fcd 0 2023-12-05T09:26:35.055 INFO:tasks.workunit.client.0.smithi067.stdout:6/584: fsync da/d10/d1e/d17/d2f/d1f/d27/d4f/fb7 0 2023-12-05T09:26:35.055 INFO:tasks.workunit.client.0.smithi067.stdout:6/585: fsync da/d10/d1e/d17/d2f/d2c/d34/f58 0 2023-12-05T09:26:35.055 INFO:tasks.workunit.client.1.smithi134.stdout:9/941: getdents d7/d8/d16/d52/d74/d97 0 2023-12-05T09:26:35.055 INFO:tasks.workunit.client.1.smithi134.stdout:9/942: write d7/d8/d14/f59 [1606827,124535] 0 2023-12-05T09:26:35.055 INFO:tasks.workunit.client.1.smithi134.stdout:9/943: fsync d7/d8/d14/d26/d5a/d69/fe0 0 2023-12-05T09:26:35.056 INFO:tasks.workunit.client.0.smithi067.stdout:6/586: write da/d10/d1e/d17/d2f/d3f/d92/f9b [1073214,20] 0 2023-12-05T09:26:35.057 INFO:tasks.workunit.client.1.smithi134.stdout:9/944: getdents d7/d10/db3 0 2023-12-05T09:26:35.058 INFO:tasks.workunit.client.0.smithi067.stdout:6/587: creat da/d10/d1e/d17/d2f/d1f/d9e/fce x:0 0 0 2023-12-05T09:26:35.061 INFO:tasks.workunit.client.0.smithi067.stdout:6/588: rename da/d10/d1e/f36 to da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/fcf 0 2023-12-05T09:26:35.063 INFO:tasks.workunit.client.0.smithi067.stdout:6/589: creat da/d10/d1e/d17/d2f/d1f/fd0 x:0 0 0 2023-12-05T09:26:35.075 INFO:tasks.workunit.client.1.smithi134.stdout:5/927: dwrite d0/d1a/d1c/d25/d4d/d9e/deb/f134 [0,4194304] 0 2023-12-05T09:26:35.075 INFO:tasks.workunit.client.1.smithi134.stdout:5/928: write d0/d1a/d1c/d3f/d5b/d5d/d78/fd7 [452398,5560] 0 2023-12-05T09:26:35.075 INFO:tasks.workunit.client.1.smithi134.stdout:5/929: readlink d0/l3e 0 2023-12-05T09:26:35.075 INFO:tasks.workunit.client.1.smithi134.stdout:5/930: fsync d0/d1a/d1c/d25/fa2 0 2023-12-05T09:26:35.077 INFO:tasks.workunit.client.1.smithi134.stdout:9/945: write d7/d5b/d5e/daa/fcb [3188187,6129] 0 2023-12-05T09:26:35.083 INFO:tasks.workunit.client.1.smithi134.stdout:3/959: sync 2023-12-05T09:26:35.083 INFO:tasks.workunit.client.1.smithi134.stdout:3/960: chown d4/d1f/d50/db4/d102/d96/fa4 1 1 2023-12-05T09:26:35.084 INFO:tasks.workunit.client.1.smithi134.stdout:9/946: symlink d7/d8/d14/d26/d7f/d92/d122/d128/l142 0 2023-12-05T09:26:35.085 INFO:tasks.workunit.client.1.smithi134.stdout:5/931: unlink d0/c4 0 2023-12-05T09:26:35.087 INFO:tasks.workunit.client.1.smithi134.stdout:9/947: creat d7/d8/d14/d26/d7f/d92/d122/d128/d12a/f143 x:0 0 0 2023-12-05T09:26:35.087 INFO:tasks.workunit.client.1.smithi134.stdout:9/948: write d7/d8/d2e/f42 [4693586,112251] 0 2023-12-05T09:26:35.088 INFO:tasks.workunit.client.1.smithi134.stdout:5/932: creat d0/dd/d37/d90/dfe/d117/f13e x:0 0 0 2023-12-05T09:26:35.090 INFO:tasks.workunit.client.1.smithi134.stdout:9/949: truncate d7/d8/f4c 3157093 0 2023-12-05T09:26:35.090 INFO:tasks.workunit.client.1.smithi134.stdout:9/950: chown d7/dee/d114/ldd 30109 1 2023-12-05T09:26:35.090 INFO:tasks.workunit.client.1.smithi134.stdout:5/933: getdents d0/d11/d61 0 2023-12-05T09:26:35.092 INFO:tasks.workunit.client.1.smithi134.stdout:9/951: mknod d7/d10/d56/c144 0 2023-12-05T09:26:35.092 INFO:tasks.workunit.client.1.smithi134.stdout:9/952: readlink d7/d8/d14/d26/d5a/da1/ldf 0 2023-12-05T09:26:35.093 INFO:tasks.workunit.client.1.smithi134.stdout:5/934: rename d0/d50/fa4 to d0/dd/d37/f13f 0 2023-12-05T09:26:35.099 INFO:tasks.workunit.client.1.smithi134.stdout:5/935: mknod d0/d66/d135/c140 0 2023-12-05T09:26:35.099 INFO:tasks.workunit.client.1.smithi134.stdout:9/953: getdents d7/d8/d14/d26/d7f/d92/d53 0 2023-12-05T09:26:35.103 INFO:tasks.workunit.client.0.smithi067.stdout:1/713: dwrite d2/d4f/d54/f58 [0,4194304] 0 2023-12-05T09:26:35.108 INFO:tasks.workunit.client.1.smithi134.stdout:4/954: write d16/d21/d48/d80/dae/f6c [540529,61306] 0 2023-12-05T09:26:35.113 INFO:tasks.workunit.client.1.smithi134.stdout:2/975: dwrite d19/d28/d2b/f5b [0,4194304] 0 2023-12-05T09:26:35.116 INFO:tasks.workunit.client.1.smithi134.stdout:5/936: dread d0/d1a/d1c/d25/d4d/d9e/fc5 [0,4194304] 0 2023-12-05T09:26:35.116 INFO:tasks.workunit.client.1.smithi134.stdout:5/937: write d0/f43 [3821475,118575] 0 2023-12-05T09:26:35.116 INFO:tasks.workunit.client.1.smithi134.stdout:5/938: truncate d0/d1a/d1c/d3f/d81/d8e/fd9 1974941 0 2023-12-05T09:26:35.118 INFO:tasks.workunit.client.1.smithi134.stdout:2/976: truncate d19/d5f/f93 2928732 0 2023-12-05T09:26:35.123 INFO:tasks.workunit.client.1.smithi134.stdout:5/939: creat d0/dd/d37/d90/dfe/f141 x:0 0 0 2023-12-05T09:26:35.124 INFO:tasks.workunit.client.0.smithi067.stdout:6/590: dwrite da/d10/d1e/d17/f23 [0,4194304] 0 2023-12-05T09:26:35.126 INFO:tasks.workunit.client.1.smithi134.stdout:5/940: creat d0/d66/d135/f142 x:0 0 0 2023-12-05T09:26:35.126 INFO:tasks.workunit.client.1.smithi134.stdout:5/941: getdents d0/d11/d61/d107/d127/d10d 0 2023-12-05T09:26:35.126 INFO:tasks.workunit.client.1.smithi134.stdout:5/942: chown d0/d1a/d1c/d25/d4d/d9e/fc5 156505165 1 2023-12-05T09:26:35.127 INFO:tasks.workunit.client.1.smithi134.stdout:7/941: sync 2023-12-05T09:26:35.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/909: sync 2023-12-05T09:26:35.128 INFO:tasks.workunit.client.1.smithi134.stdout:7/942: write d2/df/d2a/d36/f120 [1020619,28977] 0 2023-12-05T09:26:35.128 INFO:tasks.workunit.client.1.smithi134.stdout:7/943: chown d2/df/l1e 14 1 2023-12-05T09:26:35.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/910: symlink d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/dba/d114/d119/d11d/l129 0 2023-12-05T09:26:35.129 INFO:tasks.workunit.client.1.smithi134.stdout:6/911: fdatasync d4/d39/d42/d4f/d8a/f99 0 2023-12-05T09:26:35.130 INFO:tasks.workunit.client.1.smithi134.stdout:6/912: mkdir d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/d12a 0 2023-12-05T09:26:35.131 INFO:tasks.workunit.client.1.smithi134.stdout:6/913: truncate d4/d39/d5c/fb6 3206857 0 2023-12-05T09:26:35.136 INFO:tasks.workunit.client.1.smithi134.stdout:9/954: dread d7/d8/d2e/f31 [0,4194304] 0 2023-12-05T09:26:35.136 INFO:tasks.workunit.client.1.smithi134.stdout:2/977: dread d19/d28/d2b/ff2 [0,4194304] 0 2023-12-05T09:26:35.136 INFO:tasks.workunit.client.1.smithi134.stdout:0/929: dwrite d13/d14/d30/d4b/d66/da0/daf/ff5 [0,4194304] 0 2023-12-05T09:26:35.138 INFO:tasks.workunit.client.0.smithi067.stdout:6/591: dread da/d10/d1e/d17/d2f/d2c/d34/f3e [0,4194304] 0 2023-12-05T09:26:35.139 INFO:tasks.workunit.client.0.smithi067.stdout:6/592: mknod da/d10/d1e/d17/d2f/cd1 0 2023-12-05T09:26:35.139 INFO:tasks.workunit.client.0.smithi067.stdout:6/593: chown da/d10/d1e/d17/d2f/d59/d6c/dbe 55 1 2023-12-05T09:26:35.143 INFO:tasks.workunit.client.1.smithi134.stdout:9/955: dread d7/dee/d114/d8f/fec [0,4194304] 0 2023-12-05T09:26:35.150 INFO:tasks.workunit.client.1.smithi134.stdout:6/914: dread d4/d39/d42/d4f/d6d/d3a/da/f77 [0,4194304] 0 2023-12-05T09:26:35.152 INFO:tasks.workunit.client.1.smithi134.stdout:9/956: rmdir d7/d8/d14/d26/d7f/d92/d122/d128 39 2023-12-05T09:26:35.154 INFO:tasks.workunit.client.1.smithi134.stdout:2/978: rename d19/d28/d31 to d19/d3a/df4/d13e 0 2023-12-05T09:26:35.154 INFO:tasks.workunit.client.1.smithi134.stdout:2/979: write d19/d76/da9/fbd [353903,122062] 0 2023-12-05T09:26:35.155 INFO:tasks.workunit.client.1.smithi134.stdout:2/980: write d19/d28/d2b/f64 [629662,55447] 0 2023-12-05T09:26:35.155 INFO:tasks.workunit.client.1.smithi134.stdout:9/957: creat d7/d10/f145 x:0 0 0 2023-12-05T09:26:35.155 INFO:tasks.workunit.client.0.smithi067.stdout:6/594: dread da/d10/d1e/d69/dcb/fcc [0,4194304] 0 2023-12-05T09:26:35.156 INFO:tasks.workunit.client.1.smithi134.stdout:2/981: rename d19/d6d/fa4 to d19/d28/d63/f13f 0 2023-12-05T09:26:35.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/915: symlink d4/d39/d42/d4f/d6d/d3a/da/d11f/l12b 0 2023-12-05T09:26:35.156 INFO:tasks.workunit.client.1.smithi134.stdout:6/916: chown d4/d39/d42/l69 683571 1 2023-12-05T09:26:35.158 INFO:tasks.workunit.client.0.smithi067.stdout:6/595: rename da/d10/d1e/c5c to da/d10/d1e/d17/d2f/d72/cd2 0 2023-12-05T09:26:35.158 INFO:tasks.workunit.client.1.smithi134.stdout:3/961: dwrite d4/d1f/f40 [0,4194304] 0 2023-12-05T09:26:35.158 INFO:tasks.workunit.client.1.smithi134.stdout:3/962: chown d4/d1f/d4e/d6a 90 1 2023-12-05T09:26:35.158 INFO:tasks.workunit.client.1.smithi134.stdout:9/958: creat d7/d8/d14/d26/d5a/df1/f146 x:0 0 0 2023-12-05T09:26:35.158 INFO:tasks.workunit.client.0.smithi067.stdout:6/596: mkdir da/d10/d1e/d69/dd3 0 2023-12-05T09:26:35.160 INFO:tasks.workunit.client.0.smithi067.stdout:6/597: creat da/d7d/dca/fd4 x:0 0 0 2023-12-05T09:26:35.160 INFO:tasks.workunit.client.1.smithi134.stdout:2/982: rename d19/d3a/df4/d13e/d38/fc8 to d19/d28/d9e/f140 0 2023-12-05T09:26:35.161 INFO:tasks.workunit.client.0.smithi067.stdout:1/714: dwrite d2/d5/fad [0,4194304] 0 2023-12-05T09:26:35.162 INFO:tasks.workunit.client.1.smithi134.stdout:9/959: mkdir d7/d5b/d5e/daa/d147 0 2023-12-05T09:26:35.163 INFO:tasks.workunit.client.1.smithi134.stdout:9/960: mkdir d7/d8/d16/d52/d74/d97/d99/d10b/d125/d148 0 2023-12-05T09:26:35.163 INFO:tasks.workunit.client.1.smithi134.stdout:9/961: fdatasync d7/d5b/d5e/daa/db7/fb9 0 2023-12-05T09:26:35.163 INFO:tasks.workunit.client.1.smithi134.stdout:2/983: write d19/d28/d2b/ff2 [343066,113828] 0 2023-12-05T09:26:35.163 INFO:tasks.workunit.client.1.smithi134.stdout:2/984: truncate d19/d28/d63/d70/d122/f137 279511 0 2023-12-05T09:26:35.164 INFO:tasks.workunit.client.1.smithi134.stdout:9/962: creat d7/d8/d2e/f149 x:0 0 0 2023-12-05T09:26:35.164 INFO:tasks.workunit.client.1.smithi134.stdout:9/963: chown d7/d5b/d5e/c96 9756 1 2023-12-05T09:26:35.165 INFO:tasks.workunit.client.1.smithi134.stdout:4/955: dwrite d16/d7b/db6/dbc/d14b/daa/d3b/d8e/f13c [0,4194304] 0 2023-12-05T09:26:35.169 INFO:tasks.workunit.client.1.smithi134.stdout:9/964: getdents d7/d8/d14 0 2023-12-05T09:26:35.171 INFO:tasks.workunit.client.1.smithi134.stdout:2/985: truncate f1 1716989 0 2023-12-05T09:26:35.173 INFO:tasks.workunit.client.1.smithi134.stdout:4/956: creat d16/d7b/f151 x:0 0 0 2023-12-05T09:26:35.175 INFO:tasks.workunit.client.0.smithi067.stdout:1/715: rename d2/d4f/d14/d20/fc9 to d2/d5/d7/d6a/db7/ffa 0 2023-12-05T09:26:35.176 INFO:tasks.workunit.client.0.smithi067.stdout:1/716: stat d2/d5/d7/cab 0 2023-12-05T09:26:35.176 INFO:tasks.workunit.client.0.smithi067.stdout:1/717: creat d2/d4f/d14/d48/ffb x:0 0 0 2023-12-05T09:26:35.179 INFO:tasks.workunit.client.1.smithi134.stdout:9/965: dread d7/d8/d14/d26/d7f/dab/f103 [0,4194304] 0 2023-12-05T09:26:35.180 INFO:tasks.workunit.client.1.smithi134.stdout:3/963: dread d4/f34 [0,4194304] 0 2023-12-05T09:26:35.180 INFO:tasks.workunit.client.1.smithi134.stdout:6/917: link d4/d39/d5c/fc2 d4/f12c 0 2023-12-05T09:26:35.182 INFO:tasks.workunit.client.1.smithi134.stdout:4/957: symlink d16/d7b/db6/dbc/l152 0 2023-12-05T09:26:35.182 INFO:tasks.workunit.client.1.smithi134.stdout:4/958: write d16/d21/d48/d66/f71 [795878,53856] 0 2023-12-05T09:26:35.183 INFO:tasks.workunit.client.1.smithi134.stdout:4/959: dread - d16/d21/d48/d80/dae/f8a zero size 2023-12-05T09:26:35.184 INFO:tasks.workunit.client.0.smithi067.stdout:8/670: sync 2023-12-05T09:26:35.185 INFO:tasks.workunit.client.0.smithi067.stdout:8/671: fdatasync d5/d6a/f74 0 2023-12-05T09:26:35.186 INFO:tasks.workunit.client.1.smithi134.stdout:3/964: creat d4/d5/d6f/d97/f128 x:0 0 0 2023-12-05T09:26:35.187 INFO:tasks.workunit.client.1.smithi134.stdout:2/986: dread d19/d28/d2b/f64 [0,4194304] 0 2023-12-05T09:26:35.187 INFO:tasks.workunit.client.1.smithi134.stdout:2/987: fdatasync d19/d76/dba/f13d 0 2023-12-05T09:26:35.187 INFO:tasks.workunit.client.1.smithi134.stdout:2/988: creat d19/d76/dba/f141 x:0 0 0 2023-12-05T09:26:35.187 INFO:tasks.workunit.client.1.smithi134.stdout:7/944: dread d2/d7/dc/d2e/d3a/d6d/d9e/f129 [0,4194304] 0 2023-12-05T09:26:35.188 INFO:tasks.workunit.client.1.smithi134.stdout:2/989: write d19/d3f/f58 [4587454,112846] 0 2023-12-05T09:26:35.193 INFO:tasks.workunit.client.1.smithi134.stdout:3/965: mkdir d4/d5/d6f/d97/dae/de8/d129 0 2023-12-05T09:26:35.194 INFO:tasks.workunit.client.0.smithi067.stdout:8/672: symlink d5/dc/d1a/lc5 0 2023-12-05T09:26:35.198 INFO:tasks.workunit.client.1.smithi134.stdout:9/966: rename d7/d8/d14/d26/d5a to d7/d8/d16/d52/d74/d14a 0 2023-12-05T09:26:35.199 INFO:tasks.workunit.client.1.smithi134.stdout:3/966: symlink d4/l12a 0 2023-12-05T09:26:35.202 INFO:tasks.workunit.client.1.smithi134.stdout:3/967: rename d4/d5/d7c/d92/fbc to d4/d5/d45/df2/f12b 0 2023-12-05T09:26:35.202 INFO:tasks.workunit.client.1.smithi134.stdout:2/990: rename d19 to d19/d76/db9/d142 22 2023-12-05T09:26:35.202 INFO:tasks.workunit.client.1.smithi134.stdout:2/991: fsync d19/d28/f41 0 2023-12-05T09:26:35.208 INFO:tasks.workunit.client.1.smithi134.stdout:2/992: mkdir d19/d3a/df4/d13e/d38/db7/d143 0 2023-12-05T09:26:35.208 INFO:tasks.workunit.client.1.smithi134.stdout:0/930: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/fc2 [0,4194304] 0 2023-12-05T09:26:35.212 INFO:tasks.workunit.client.1.smithi134.stdout:0/931: link d13/d14/d30/l128 d13/d14/d30/d4b/d66/da0/daf/dce/l137 0 2023-12-05T09:26:35.212 INFO:tasks.workunit.client.1.smithi134.stdout:0/932: creat d13/d14/d15/d93/de4/d111/d112/f138 x:0 0 0 2023-12-05T09:26:35.215 INFO:tasks.workunit.client.0.smithi067.stdout:8/673: read d5/dc/d1a/d20/f22 [4975191,74514] 0 2023-12-05T09:26:35.215 INFO:tasks.workunit.client.0.smithi067.stdout:8/674: write d5/dc/d1a/d20/d2d/d41/db2/fb7 [567658,42676] 0 2023-12-05T09:26:35.215 INFO:tasks.workunit.client.0.smithi067.stdout:8/675: fsync d5/dc/d1a/d20/d3e/dbf/fc4 0 2023-12-05T09:26:35.216 INFO:tasks.workunit.client.1.smithi134.stdout:0/933: getdents d13/d14/d30/d4b/d66/da0/daf/dde 0 2023-12-05T09:26:35.217 INFO:tasks.workunit.client.1.smithi134.stdout:9/967: dread d7/d8/d16/d52/ff3 [0,4194304] 0 2023-12-05T09:26:35.218 INFO:tasks.workunit.client.1.smithi134.stdout:0/934: mkdir d13/d139 0 2023-12-05T09:26:35.222 INFO:tasks.workunit.client.1.smithi134.stdout:0/935: rename d13/d14/d30/d4b/d66/da0/daf/dde/d9d/da5/cc3 to d13/d14/d30/d4b/d66/da0/daf/dce/d86/c13a 0 2023-12-05T09:26:35.226 INFO:tasks.workunit.client.1.smithi134.stdout:0/936: symlink d13/d14/d30/d4b/d66/da0/daf/dde/d9d/l13b 0 2023-12-05T09:26:35.226 INFO:tasks.workunit.client.1.smithi134.stdout:9/968: creat d7/dee/d114/d8f/d8a/f14b x:0 0 0 2023-12-05T09:26:35.228 INFO:tasks.workunit.client.1.smithi134.stdout:0/937: creat d13/d14/d30/d4b/d66/da0/daf/f13c x:0 0 0 2023-12-05T09:26:35.236 INFO:tasks.workunit.client.1.smithi134.stdout:3/968: write d4/d5/d6f/fd0 [561776,119110] 0 2023-12-05T09:26:35.238 INFO:tasks.workunit.client.1.smithi134.stdout:3/969: rename d4/d5/c14 to d4/d5/d6f/dc2/c12c 0 2023-12-05T09:26:35.244 INFO:tasks.workunit.client.1.smithi134.stdout:7/945: dwrite d2/d7/dc/d2e/f3e [4194304,4194304] 0 2023-12-05T09:26:35.244 INFO:tasks.workunit.client.1.smithi134.stdout:7/946: creat d2/df/d2a/d36/f135 x:0 0 0 2023-12-05T09:26:35.244 INFO:tasks.workunit.client.1.smithi134.stdout:7/947: fsync d2/d7/d2b/f12e 0 2023-12-05T09:26:35.244 INFO:tasks.workunit.client.1.smithi134.stdout:7/948: fsync d2/d7/fe0 0 2023-12-05T09:26:35.244 INFO:tasks.workunit.client.1.smithi134.stdout:3/970: rename d4/d1f/d10b/f116 to d4/d5/d45/d86/db5/dcf/f12d 0 2023-12-05T09:26:35.245 INFO:tasks.workunit.client.0.smithi067.stdout:6/598: dwrite da/d10/d1e/d17/d2f/d3f/f64 [0,4194304] 0 2023-12-05T09:26:35.248 INFO:tasks.workunit.client.1.smithi134.stdout:7/949: mknod d2/df/d2a/d63/c136 0 2023-12-05T09:26:35.248 INFO:tasks.workunit.client.1.smithi134.stdout:7/950: chown d2/d7/dc/d2e/l8d 21 1 2023-12-05T09:26:35.248 INFO:tasks.workunit.client.1.smithi134.stdout:6/918: dwrite d4/d39/d42/d4f/d6d/d9f/fc6 [0,4194304] 0 2023-12-05T09:26:35.248 INFO:tasks.workunit.client.1.smithi134.stdout:7/951: creat d2/df/d2a/d36/f137 x:0 0 0 2023-12-05T09:26:35.248 INFO:tasks.workunit.client.1.smithi134.stdout:6/919: dread - d4/d39/d42/d4f/f85 zero size 2023-12-05T09:26:35.248 INFO:tasks.workunit.client.1.smithi134.stdout:7/952: chown d2/l100 724 1 2023-12-05T09:26:35.252 INFO:tasks.workunit.client.1.smithi134.stdout:7/953: mknod d2/d7/d2b/d94/c138 0 2023-12-05T09:26:35.253 INFO:tasks.workunit.client.0.smithi067.stdout:6/599: creat da/d10/d1e/d17/d2f/d72/fd5 x:0 0 0 2023-12-05T09:26:35.259 INFO:tasks.workunit.client.1.smithi134.stdout:6/920: getdents d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/dba/d114/d119/d11d 0 2023-12-05T09:26:35.259 INFO:tasks.workunit.client.1.smithi134.stdout:6/921: dread - d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/f10e zero size 2023-12-05T09:26:35.260 INFO:tasks.workunit.client.1.smithi134.stdout:6/922: rmdir d4/d39/d42/d4f/d6d/d3a/da/da4/ddb 39 2023-12-05T09:26:35.263 INFO:tasks.workunit.client.1.smithi134.stdout:4/960: dwrite d16/d7b/db6/dbc/d14b/daa/d3b/f11d [0,4194304] 0 2023-12-05T09:26:35.263 INFO:tasks.workunit.client.1.smithi134.stdout:4/961: stat d16/d7b/db6/dbc/d14b/c8b 0 2023-12-05T09:26:35.263 INFO:tasks.workunit.client.1.smithi134.stdout:4/962: write d16/d21/d48/d80/dae/f6c [310527,88807] 0 2023-12-05T09:26:35.264 INFO:tasks.workunit.client.0.smithi067.stdout:8/676: dwrite d5/f40 [0,4194304] 0 2023-12-05T09:26:35.264 INFO:tasks.workunit.client.0.smithi067.stdout:8/677: chown d5/dc/d1a/d20/d3e/c98 52081571 1 2023-12-05T09:26:35.264 INFO:tasks.workunit.client.0.smithi067.stdout:8/678: creat d5/dc/d1a/d20/d2d/d41/fc6 x:0 0 0 2023-12-05T09:26:35.267 INFO:tasks.workunit.client.1.smithi134.stdout:5/943: dwrite d0/dd/d37/d7d/ff1 [0,4194304] 0 2023-12-05T09:26:35.269 INFO:tasks.workunit.client.0.smithi067.stdout:8/679: truncate d5/dc/d1a/d20/d3e/f7a 286674 0 2023-12-05T09:26:35.269 INFO:tasks.workunit.client.0.smithi067.stdout:8/680: read - d5/d6a/f74 zero size 2023-12-05T09:26:35.269 INFO:tasks.workunit.client.0.smithi067.stdout:8/681: creat d5/dc/d1a/d62/fc7 x:0 0 0 2023-12-05T09:26:35.270 INFO:tasks.workunit.client.1.smithi134.stdout:7/954: rmdir d2/d7/dc/d2e/d3a/d6d/d9e/d117 39 2023-12-05T09:26:35.270 INFO:tasks.workunit.client.1.smithi134.stdout:7/955: write d2/dd/fb6 [3188036,103684] 0 2023-12-05T09:26:35.271 INFO:tasks.workunit.client.1.smithi134.stdout:2/993: dwrite d19/f1d [0,4194304] 0 2023-12-05T09:26:35.273 INFO:tasks.workunit.client.0.smithi067.stdout:8/682: symlink d5/dc/d1a/d20/d58/lc8 0 2023-12-05T09:26:35.273 INFO:tasks.workunit.client.1.smithi134.stdout:5/944: mkdir d0/d1a/d1c/d3f/d81/d8a/d143 0 2023-12-05T09:26:35.274 INFO:tasks.workunit.client.0.smithi067.stdout:8/683: link d5/d3b/f3d d5/dc/d1a/d20/d3e/d79/fc9 0 2023-12-05T09:26:35.277 INFO:tasks.workunit.client.1.smithi134.stdout:7/956: creat d2/df/f139 x:0 0 0 2023-12-05T09:26:35.277 INFO:tasks.workunit.client.1.smithi134.stdout:5/945: getdents d0/d66 0 2023-12-05T09:26:35.277 INFO:tasks.workunit.client.1.smithi134.stdout:4/963: dread d16/d21/d47/f4a [0,4194304] 0 2023-12-05T09:26:35.278 INFO:tasks.workunit.client.0.smithi067.stdout:8/684: write d5/dc/d1a/d62/f73 [1487424,23599] 0 2023-12-05T09:26:35.279 INFO:tasks.workunit.client.0.smithi067.stdout:8/685: creat d5/dc/d1a/d20/d2d/d8a/fca x:0 0 0 2023-12-05T09:26:35.280 INFO:tasks.workunit.client.1.smithi134.stdout:7/957: rename d2/d7/d2b/d2d/d67/d73/d26/ce9 to d2/df/d81/daf/c13a 0 2023-12-05T09:26:35.281 INFO:tasks.workunit.client.0.smithi067.stdout:8/686: read d5/da/f8d [356068,88530] 0 2023-12-05T09:26:35.282 INFO:tasks.workunit.client.0.smithi067.stdout:8/687: creat d5/dc/d1a/d62/d7e/fcb x:0 0 0 2023-12-05T09:26:35.282 INFO:tasks.workunit.client.0.smithi067.stdout:8/688: truncate d5/dc/d1a/d20/d2d/d8a/fca 410706 0 2023-12-05T09:26:35.282 INFO:tasks.workunit.client.0.smithi067.stdout:8/689: chown d5/da/d30 791502739 1 2023-12-05T09:26:35.282 INFO:tasks.workunit.client.0.smithi067.stdout:8/690: fdatasync d5/dc/d1a/d20/d2d/d41/db2/fb7 0 2023-12-05T09:26:35.283 INFO:tasks.workunit.client.1.smithi134.stdout:5/946: creat d0/d50/f144 x:0 0 0 2023-12-05T09:26:35.283 INFO:tasks.workunit.client.1.smithi134.stdout:5/947: chown d0/d11/d61/d107/d127/d10d 15 1 2023-12-05T09:26:35.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/958: truncate d2/d7/dc/d2e/fd2 361226 0 2023-12-05T09:26:35.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/959: write d2/d7/d6f/feb [1089785,33678] 0 2023-12-05T09:26:35.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/960: chown d2/d7/d93/dcf/lfe 128017 1 2023-12-05T09:26:35.284 INFO:tasks.workunit.client.0.smithi067.stdout:8/691: mknod d5/dc/d1a/d20/d2d/d41/ccc 0 2023-12-05T09:26:35.285 INFO:tasks.workunit.client.0.smithi067.stdout:6/600: write da/d10/d1e/d17/d2f/d3f/d92/f9d [1721065,22417] 0 2023-12-05T09:26:35.287 INFO:tasks.workunit.client.1.smithi134.stdout:6/923: dread d4/d39/f37 [0,4194304] 0 2023-12-05T09:26:35.288 INFO:tasks.workunit.client.1.smithi134.stdout:7/961: symlink d2/d7/d93/dcf/ddd/l13b 0 2023-12-05T09:26:35.288 INFO:tasks.workunit.client.1.smithi134.stdout:7/962: truncate d2/d7/d93/dcf/f130 390015 0 2023-12-05T09:26:35.290 INFO:tasks.workunit.client.0.smithi067.stdout:8/692: creat d5/da/fcd x:0 0 0 2023-12-05T09:26:35.291 INFO:tasks.workunit.client.1.smithi134.stdout:7/963: write d2/d7/dc/d2e/d3a/f3b [2014635,8240] 0 2023-12-05T09:26:35.291 INFO:tasks.workunit.client.1.smithi134.stdout:6/924: unlink d4/f105 0 2023-12-05T09:26:35.292 INFO:tasks.workunit.client.1.smithi134.stdout:6/925: symlink d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/l12d 0 2023-12-05T09:26:35.303 INFO:tasks.workunit.client.1.smithi134.stdout:0/938: dwrite d13/d14/d15/d67/d73/d119/f11e [0,4194304] 0 2023-12-05T09:26:35.305 INFO:tasks.workunit.client.1.smithi134.stdout:3/971: dwrite d4/d5/d45/d86/db0/f126 [0,4194304] 0 2023-12-05T09:26:35.313 INFO:tasks.workunit.client.1.smithi134.stdout:0/939: rename d13/d14/d30/d4b/d23/f83 to d13/d14/d30/d4b/d66/da0/daf/dce/d86/dd8/d129/f13d 0 2023-12-05T09:26:35.317 INFO:tasks.workunit.client.1.smithi134.stdout:0/940: rename d13/d14/d15/d67/l5f to d13/d14/d15/d93/l13e 0 2023-12-05T09:26:35.318 INFO:tasks.workunit.client.1.smithi134.stdout:0/941: write d13/d14/d15/d93/de4/d111/d112/f113 [319817,126526] 0 2023-12-05T09:26:35.318 INFO:tasks.workunit.client.1.smithi134.stdout:0/942: truncate d13/d14/d30/fe9 2259087 0 2023-12-05T09:26:35.323 INFO:tasks.workunit.client.1.smithi134.stdout:0/943: truncate d13/d14/d30/d4b/d66/da0/daf/dce/f82 279831 0 2023-12-05T09:26:35.325 INFO:tasks.workunit.client.1.smithi134.stdout:0/944: rmdir d13/d14/d15/d93/de4 39 2023-12-05T09:26:35.326 INFO:tasks.workunit.client.1.smithi134.stdout:0/945: rename d13/f17 to d13/d14/d30/d4b/f13f 0 2023-12-05T09:26:35.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/964: dwrite f13 [0,4194304] 0 2023-12-05T09:26:35.332 INFO:tasks.workunit.client.1.smithi134.stdout:4/965: rename d16/d7b/d10f/d13f/l140 to d16/d7b/l153 0 2023-12-05T09:26:35.335 INFO:tasks.workunit.client.1.smithi134.stdout:4/966: mknod d16/d18/d1b/d24/c154 0 2023-12-05T09:26:35.335 INFO:tasks.workunit.client.1.smithi134.stdout:4/967: chown d16/d7b/db6/dbc/d14b/daa/d3b/fa0 218516 1 2023-12-05T09:26:35.335 INFO:tasks.workunit.client.1.smithi134.stdout:4/968: truncate d16/d9c/ff0 4461603 0 2023-12-05T09:26:35.335 INFO:tasks.workunit.client.1.smithi134.stdout:4/969: creat d16/d21/f155 x:0 0 0 2023-12-05T09:26:35.338 INFO:tasks.workunit.client.1.smithi134.stdout:4/970: getdents d16/d18/dc5/dc2/df6 0 2023-12-05T09:26:35.339 INFO:tasks.workunit.client.1.smithi134.stdout:9/969: dwrite d7/d10/f145 [0,4194304] 0 2023-12-05T09:26:35.340 INFO:tasks.workunit.client.1.smithi134.stdout:4/971: mkdir d16/d18/d1b/d24/d133/d156 0 2023-12-05T09:26:35.343 INFO:tasks.workunit.client.1.smithi134.stdout:4/972: mkdir d16/d18/dc5/dc2/df6/ddd/d157 0 2023-12-05T09:26:35.344 INFO:tasks.workunit.client.1.smithi134.stdout:9/970: creat d7/d8/d14/d26/d7f/d92/d53/f14c x:0 0 0 2023-12-05T09:26:35.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/971: rmdir d7/d8/d16/d52/d74/d14a/d69/d10e 39 2023-12-05T09:26:35.346 INFO:tasks.workunit.client.1.smithi134.stdout:2/994: dwrite d19/fc6 [0,4194304] 0 2023-12-05T09:26:35.346 INFO:tasks.workunit.client.1.smithi134.stdout:2/995: stat d19/d76/dba/ld6 0 2023-12-05T09:26:35.347 INFO:tasks.workunit.client.1.smithi134.stdout:9/972: mknod d7/d8/d16/d52/d74/d14a/d69/d10e/c14d 0 2023-12-05T09:26:35.347 INFO:tasks.workunit.client.1.smithi134.stdout:9/973: write d7/d5b/d5e/daa/db7/fb9 [839262,98866] 0 2023-12-05T09:26:35.347 INFO:tasks.workunit.client.1.smithi134.stdout:2/996: truncate d19/d3a/fbc 3272613 0 2023-12-05T09:26:35.349 INFO:tasks.workunit.client.1.smithi134.stdout:9/974: symlink d7/d8/d16/d52/d74/d97/d99/d10b/d125/d138/l14e 0 2023-12-05T09:26:35.350 INFO:tasks.workunit.client.1.smithi134.stdout:2/997: symlink d19/d3a/df4/d13e/d38/db7/d111/l144 0 2023-12-05T09:26:35.355 INFO:tasks.workunit.client.1.smithi134.stdout:9/975: mknod d7/d8/d16/d52/d74/d97/d99/d10b/d125/d148/c14f 0 2023-12-05T09:26:35.355 INFO:tasks.workunit.client.1.smithi134.stdout:9/976: write d7/d8/d16/d52/d74/d14a/da1/fff [841893,26627] 0 2023-12-05T09:26:35.355 INFO:tasks.workunit.client.1.smithi134.stdout:9/977: write d7/d5b/d5e/ff5 [66726,59243] 0 2023-12-05T09:26:35.355 INFO:tasks.workunit.client.1.smithi134.stdout:9/978: dread - d7/d8/d16/d52/d74/d14a/d69/f109 zero size 2023-12-05T09:26:35.355 INFO:tasks.workunit.client.1.smithi134.stdout:4/973: dread d16/d7b/dce/fec [4194304,4194304] 0 2023-12-05T09:26:35.356 INFO:tasks.workunit.client.1.smithi134.stdout:9/979: symlink d7/d8/d16/d52/d74/d97/d99/l150 0 2023-12-05T09:26:35.356 INFO:tasks.workunit.client.1.smithi134.stdout:9/980: truncate d7/d8/d16/d52/d74/d14a/d69/f12e 601428 0 2023-12-05T09:26:35.357 INFO:tasks.workunit.client.1.smithi134.stdout:4/974: creat d16/d7b/d10f/d13f/f158 x:0 0 0 2023-12-05T09:26:35.358 INFO:tasks.workunit.client.1.smithi134.stdout:4/975: write d16/d7b/d6f/fb2 [827529,48079] 0 2023-12-05T09:26:35.358 INFO:tasks.workunit.client.1.smithi134.stdout:4/976: read - d16/d18/dc5/dc2/f139 zero size 2023-12-05T09:26:35.359 INFO:tasks.workunit.client.1.smithi134.stdout:4/977: mknod d16/d7b/db6/dbc/d14b/daa/d3b/d143/c159 0 2023-12-05T09:26:35.364 INFO:tasks.workunit.client.1.smithi134.stdout:5/948: dwrite d0/d11/f89 [0,4194304] 0 2023-12-05T09:26:35.364 INFO:tasks.workunit.client.1.smithi134.stdout:6/926: dwrite d4/d39/d42/d4f/d6d/d3a/d80/fd0 [0,4194304] 0 2023-12-05T09:26:35.366 INFO:tasks.workunit.client.1.smithi134.stdout:5/949: read d0/d1a/d3a/f47 [724680,8281] 0 2023-12-05T09:26:35.372 INFO:tasks.workunit.client.0.smithi067.stdout:8/693: dwrite d5/dc/f9b [0,4194304] 0 2023-12-05T09:26:35.378 INFO:tasks.workunit.client.1.smithi134.stdout:7/964: dwrite d2/d7/dc/d2e/d3a/d6d/f96 [0,4194304] 0 2023-12-05T09:26:35.380 INFO:tasks.workunit.client.0.smithi067.stdout:7/622: sync 2023-12-05T09:26:35.386 INFO:tasks.workunit.client.1.smithi134.stdout:7/965: symlink d2/df/d81/def/l13c 0 2023-12-05T09:26:35.392 INFO:tasks.workunit.client.1.smithi134.stdout:7/966: mkdir d2/d7/dc/d2e/d13d 0 2023-12-05T09:26:35.392 INFO:tasks.workunit.client.1.smithi134.stdout:4/978: rename d16/d18/dc5 to d16/d18/d1b/d24/d133/d156/d15a 0 2023-12-05T09:26:35.392 INFO:tasks.workunit.client.1.smithi134.stdout:4/979: dread - d16/d21/d48/d80/f85 zero size 2023-12-05T09:26:35.395 INFO:tasks.workunit.client.0.smithi067.stdout:7/623: dread d0/d9/d10/d37/d38/d64/d54/f88 [0,4194304] 0 2023-12-05T09:26:35.399 INFO:tasks.workunit.client.1.smithi134.stdout:4/980: rmdir d16/d7b/dce/d103 0 2023-12-05T09:26:35.399 INFO:tasks.workunit.client.1.smithi134.stdout:2/998: dwrite d19/d3a/df4/d13e/dd3/f123 [0,4194304] 0 2023-12-05T09:26:35.399 INFO:tasks.workunit.client.1.smithi134.stdout:4/981: chown d16/d7b/db6/dbc/d14b/daa/d3b/d8e/f122 2127 1 2023-12-05T09:26:35.399 INFO:tasks.workunit.client.1.smithi134.stdout:2/999: truncate d19/d3f/f5a 1508264 0 2023-12-05T09:26:35.402 INFO:tasks.workunit.client.1.smithi134.stdout:6/927: rename d4/d39/d42/d4f/d6d/d3a/d80/fd0 to d4/d39/d42/f12e 0 2023-12-05T09:26:35.403 INFO:tasks.workunit.client.1.smithi134.stdout:6/928: write d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/f111 [729282,33811] 0 2023-12-05T09:26:35.403 INFO:tasks.workunit.client.1.smithi134.stdout:6/929: stat d4/d39/d42/d4f/d6d/d3a/da 0 2023-12-05T09:26:35.405 INFO:tasks.workunit.client.0.smithi067.stdout:4/636: sync 2023-12-05T09:26:35.405 INFO:tasks.workunit.client.0.smithi067.stdout:4/637: chown d0/d1d/d2b/cb1 11058811 1 2023-12-05T09:26:35.407 INFO:tasks.workunit.client.1.smithi134.stdout:5/950: rename d0/d11/d61/d107/d127 to d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/d145 0 2023-12-05T09:26:35.407 INFO:tasks.workunit.client.1.smithi134.stdout:4/982: symlink d16/d21/d48/d80/dae/l15b 0 2023-12-05T09:26:35.408 INFO:tasks.workunit.client.1.smithi134.stdout:4/983: write d16/d21/f124 [571451,47367] 0 2023-12-05T09:26:35.411 INFO:tasks.workunit.client.0.smithi067.stdout:7/624: rename d0/d9/d56/d8e/fa7 to d0/d9/d40/d7a/dad/fcd 0 2023-12-05T09:26:35.412 INFO:tasks.workunit.client.1.smithi134.stdout:6/930: unlink d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/d125/ce6 0 2023-12-05T09:26:35.412 INFO:tasks.workunit.client.1.smithi134.stdout:6/931: chown d4/d39/d42/d4f/d6d/d3a/da/d11c/ff2 1558737 1 2023-12-05T09:26:35.414 INFO:tasks.workunit.client.0.smithi067.stdout:4/638: link d0/d1d/c31 d0/d1d/d2a/d93/dbd/ce8 0 2023-12-05T09:26:35.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/984: symlink d16/d18/dad/l15c 0 2023-12-05T09:26:35.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/985: fdatasync d16/d21/d48/d66/db0/db3/f147 0 2023-12-05T09:26:35.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/986: chown d16/d21/d48/d80/dae/d65/lba 431657590 1 2023-12-05T09:26:35.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/987: truncate d16/d7b/d10f/f13b 298422 0 2023-12-05T09:26:35.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/988: chown d16/d21/d48/d80/dae/l117 823210 1 2023-12-05T09:26:35.416 INFO:tasks.workunit.client.0.smithi067.stdout:7/625: creat d0/d9/d3f/dbd/fce x:0 0 0 2023-12-05T09:26:35.417 INFO:tasks.workunit.client.1.smithi134.stdout:6/932: link d4/d39/d42/d4f/d6d/d3a/da/d11c/d59/l66 d4/d39/d42/d4f/d6d/d3a/da/df9/l12f 0 2023-12-05T09:26:35.418 INFO:tasks.workunit.client.1.smithi134.stdout:3/972: dwrite d4/d1f/f7a [0,4194304] 0 2023-12-05T09:26:35.419 INFO:tasks.workunit.client.0.smithi067.stdout:7/626: creat d0/d9/d40/d7a/dad/fcf x:0 0 0 2023-12-05T09:26:35.421 INFO:tasks.workunit.client.1.smithi134.stdout:6/933: mknod d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/d12a/c130 0 2023-12-05T09:26:35.421 INFO:tasks.workunit.client.1.smithi134.stdout:3/973: rename d4/d1f/d50/db4/lc4 to d4/d5/d45/d60/l12e 0 2023-12-05T09:26:35.423 INFO:tasks.workunit.client.1.smithi134.stdout:6/934: creat d4/d39/d42/d4f/d6d/d3a/da/d11c/d59/f131 x:0 0 0 2023-12-05T09:26:35.425 INFO:tasks.workunit.client.1.smithi134.stdout:3/974: rename d4/d1f/d50/db4/d102/d96/dde/le6 to d4/d5/d6f/d76/l12f 0 2023-12-05T09:26:35.425 INFO:tasks.workunit.client.1.smithi134.stdout:3/975: dread - d4/d5/d45/d86/db5/dcf/f12d zero size 2023-12-05T09:26:35.432 INFO:tasks.workunit.client.1.smithi134.stdout:9/981: dwrite d7/d8/d16/d52/d74/d14a/da1/fff [0,4194304] 0 2023-12-05T09:26:35.432 INFO:tasks.workunit.client.0.smithi067.stdout:8/694: dwrite d5/dc/d1a/d20/d2d/d41/f86 [0,4194304] 0 2023-12-05T09:26:35.438 INFO:tasks.workunit.client.1.smithi134.stdout:6/935: dread d4/d39/f51 [0,4194304] 0 2023-12-05T09:26:35.440 INFO:tasks.workunit.client.1.smithi134.stdout:6/936: read d4/d39/d42/d4f/d6d/f60 [266602,97754] 0 2023-12-05T09:26:35.442 INFO:tasks.workunit.client.1.smithi134.stdout:9/982: mkdir d7/d5b/d5e/d151 0 2023-12-05T09:26:35.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/639: write d0/d9/f78 [280353,124429] 0 2023-12-05T09:26:35.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/640: write d0/d9/f78 [5011197,32615] 0 2023-12-05T09:26:35.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/641: truncate d0/fc 9419514 0 2023-12-05T09:26:35.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/642: write d0/d1d/d2b/f2e [8558878,12992] 0 2023-12-05T09:26:35.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/643: stat d0/d1d/d25/d32/f44 0 2023-12-05T09:26:35.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/644: chown d0/d1d/d2b/f2e 511 1 2023-12-05T09:26:35.443 INFO:tasks.workunit.client.0.smithi067.stdout:4/645: write d0/d1d/d25/d32/f44 [5365780,21794] 0 2023-12-05T09:26:35.448 INFO:tasks.workunit.client.0.smithi067.stdout:8/695: mkdir d5/da/d30/dce 0 2023-12-05T09:26:35.449 INFO:tasks.workunit.client.1.smithi134.stdout:3/976: dread d4/d5/d7c/d92/fa3 [0,4194304] 0 2023-12-05T09:26:35.456 INFO:tasks.workunit.client.0.smithi067.stdout:4/646: symlink d0/d1d/d2a/d93/dbd/le9 0 2023-12-05T09:26:35.456 INFO:tasks.workunit.client.0.smithi067.stdout:4/647: chown d0/d1d/l54 715571453 1 2023-12-05T09:26:35.456 INFO:tasks.workunit.client.0.smithi067.stdout:4/648: readlink d0/l87 0 2023-12-05T09:26:35.456 INFO:tasks.workunit.client.0.smithi067.stdout:4/649: fsync d0/f8 0 2023-12-05T09:26:35.457 INFO:tasks.workunit.client.1.smithi134.stdout:5/951: dwrite d0/d11/d5c/dab/fcd [0,4194304] 0 2023-12-05T09:26:35.457 INFO:tasks.workunit.client.1.smithi134.stdout:5/952: creat d0/d1a/d1c/d25/d4d/f146 x:0 0 0 2023-12-05T09:26:35.459 INFO:tasks.workunit.client.0.smithi067.stdout:8/696: rename d5/d9d/dab/d66/f81 to d5/dc/d1a/fcf 0 2023-12-05T09:26:35.463 INFO:tasks.workunit.client.0.smithi067.stdout:4/650: mknod d0/d1d/d53/da8/da9/cea 0 2023-12-05T09:26:35.468 INFO:tasks.workunit.client.0.smithi067.stdout:8/697: getdents d5/dc/d1a/d20/d3e/d79 0 2023-12-05T09:26:35.468 INFO:tasks.workunit.client.0.smithi067.stdout:8/698: write d5/dc/d1a/d20/d58/f8f [908763,70976] 0 2023-12-05T09:26:35.471 INFO:tasks.workunit.client.0.smithi067.stdout:4/651: mkdir d0/d1d/d25/d2c/db5/deb 0 2023-12-05T09:26:35.473 INFO:tasks.workunit.client.1.smithi134.stdout:7/967: dwrite d2/d7/dc/d2e/fd2 [0,4194304] 0 2023-12-05T09:26:35.473 INFO:tasks.workunit.client.1.smithi134.stdout:6/937: symlink d4/d39/d42/d4f/d6d/d3a/d80/l132 0 2023-12-05T09:26:35.474 INFO:tasks.workunit.client.1.smithi134.stdout:6/938: dread - d4/d39/d42/d4f/d6d/d3a/dd4/f108 zero size 2023-12-05T09:26:35.476 INFO:tasks.workunit.client.0.smithi067.stdout:4/652: symlink d0/d1d/d2a/d93/dbd/dcf/lec 0 2023-12-05T09:26:35.479 INFO:tasks.workunit.client.1.smithi134.stdout:4/989: dread d16/d21/f124 [0,4194304] 0 2023-12-05T09:26:35.479 INFO:tasks.workunit.client.1.smithi134.stdout:6/939: link d4/d39/d42/d4f/d6d/d3a/da/d11c/fbe d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/dba/d114/f133 0 2023-12-05T09:26:35.479 INFO:tasks.workunit.client.1.smithi134.stdout:6/940: chown d4/d39/d42/d4f/d6d/d9f/dc4/d100 45075 1 2023-12-05T09:26:35.481 INFO:tasks.workunit.client.1.smithi134.stdout:6/941: mkdir d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/d134 0 2023-12-05T09:26:35.482 INFO:tasks.workunit.client.0.smithi067.stdout:4/653: unlink d0/d1d/d53/fa2 0 2023-12-05T09:26:35.482 INFO:tasks.workunit.client.0.smithi067.stdout:4/654: truncate d0/d1d/d25/d2c/d34/d4e/daa/fdb 649519 0 2023-12-05T09:26:35.482 INFO:tasks.workunit.client.1.smithi134.stdout:7/968: dread d2/df/d2a/d36/f120 [0,4194304] 0 2023-12-05T09:26:35.483 INFO:tasks.workunit.client.1.smithi134.stdout:6/942: mkdir d4/d39/d42/d4f/d6d/d3a/d135 0 2023-12-05T09:26:35.483 INFO:tasks.workunit.client.1.smithi134.stdout:6/943: stat d4/d32/d74/dee/f11e 0 2023-12-05T09:26:35.486 INFO:tasks.workunit.client.1.smithi134.stdout:6/944: unlink d4/d39/d42/d4f/d6d/d3a/da/d11c/d59/f131 0 2023-12-05T09:26:35.486 INFO:tasks.workunit.client.1.smithi134.stdout:6/945: chown d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/d12a/c130 15116576 1 2023-12-05T09:26:35.486 INFO:tasks.workunit.client.1.smithi134.stdout:6/946: chown d4/d78/c83 65529898 1 2023-12-05T09:26:35.489 INFO:tasks.workunit.client.1.smithi134.stdout:7/969: dread d2/df/d2a/f40 [0,4194304] 0 2023-12-05T09:26:35.489 INFO:tasks.workunit.client.1.smithi134.stdout:7/970: fsync d2/d7/d6f/da0/ddb/f12a 0 2023-12-05T09:26:35.489 INFO:tasks.workunit.client.1.smithi134.stdout:7/971: chown d2/d7/d93/dcf/f130 9482162 1 2023-12-05T09:26:35.490 INFO:tasks.workunit.client.1.smithi134.stdout:7/972: mknod d2/d7/d6f/db9/c13e 0 2023-12-05T09:26:35.498 INFO:tasks.workunit.client.1.smithi134.stdout:4/990: dread d16/d18/d1b/f31 [0,4194304] 0 2023-12-05T09:26:35.500 INFO:tasks.workunit.client.1.smithi134.stdout:4/991: mkdir d16/d21/d47/d15d 0 2023-12-05T09:26:35.501 INFO:tasks.workunit.client.1.smithi134.stdout:7/973: dread d2/d7/d2b/d2d/d67/d73/d26/f58 [0,4194304] 0 2023-12-05T09:26:35.501 INFO:tasks.workunit.client.1.smithi134.stdout:7/974: dread - d2/d7/d2b/d94/d105/f112 zero size 2023-12-05T09:26:35.501 INFO:tasks.workunit.client.1.smithi134.stdout:7/975: stat d2/d7/dc/d2e/d3a/d6d/d9e/d117 0 2023-12-05T09:26:35.502 INFO:tasks.workunit.client.1.smithi134.stdout:4/992: creat d16/d21/d48/d80/dae/d65/d121/f15e x:0 0 0 2023-12-05T09:26:35.503 INFO:tasks.workunit.client.1.smithi134.stdout:4/993: rmdir d16/d7b/db6/dbc/d14b/daa/d3b/dcf 39 2023-12-05T09:26:35.504 INFO:tasks.workunit.client.1.smithi134.stdout:4/994: mknod d16/d18/d1b/d24/d133/d156/d15a/dc2/c15f 0 2023-12-05T09:26:35.509 INFO:tasks.workunit.client.1.smithi134.stdout:4/995: mkdir d16/d18/dad/d120/d160 0 2023-12-05T09:26:35.509 INFO:tasks.workunit.client.1.smithi134.stdout:7/976: dread d2/d7/fe0 [0,4194304] 0 2023-12-05T09:26:35.510 INFO:tasks.workunit.client.1.smithi134.stdout:4/996: symlink d16/d7b/db6/dbc/d14b/daa/d3b/d143/l161 0 2023-12-05T09:26:35.512 INFO:tasks.workunit.client.1.smithi134.stdout:9/983: dwrite d7/d8/d16/d52/d74/d14a/d69/f12e [0,4194304] 0 2023-12-05T09:26:35.513 INFO:tasks.workunit.client.1.smithi134.stdout:3/977: dwrite d4/d1f/d50/db4/d102/d96/dde/d11b/f123 [0,4194304] 0 2023-12-05T09:26:35.513 INFO:tasks.workunit.client.1.smithi134.stdout:3/978: getdents d4/d80/d110 0 2023-12-05T09:26:35.515 INFO:tasks.workunit.client.1.smithi134.stdout:7/977: creat d2/d7/d93/dcf/dd0/f13f x:0 0 0 2023-12-05T09:26:35.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/627: dwrite d0/d9/f6f [4194304,4194304] 0 2023-12-05T09:26:35.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/655: dread d0/f8 [0,4194304] 0 2023-12-05T09:26:35.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/656: fdatasync d0/d1d/d25/d2c/d34/fcd 0 2023-12-05T09:26:35.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/657: dread - d0/d1d/d25/d2c/d34/d4e/d5a/d88/fb8 zero size 2023-12-05T09:26:35.522 INFO:tasks.workunit.client.1.smithi134.stdout:7/978: rename d2/d7/d2b/dd9/d10b/f124 to d2/d118/f140 0 2023-12-05T09:26:35.526 INFO:tasks.workunit.client.1.smithi134.stdout:6/947: dwrite d4/d39/d42/d4f/d6d/d3a/da/fe4 [0,4194304] 0 2023-12-05T09:26:35.526 INFO:tasks.workunit.client.1.smithi134.stdout:6/948: chown d4/d39/dfb/l90 0 1 2023-12-05T09:26:35.536 INFO:tasks.workunit.client.0.smithi067.stdout:4/658: getdents d0/d1d/d2a/d93 0 2023-12-05T09:26:35.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/659: symlink d0/d1d/d25/d2c/db5/deb/led 0 2023-12-05T09:26:35.542 INFO:tasks.workunit.client.0.smithi067.stdout:4/660: creat d0/d1d/d25/d2c/d34/d4e/d5a/d88/fee x:0 0 0 2023-12-05T09:26:35.542 INFO:tasks.workunit.client.1.smithi134.stdout:6/949: rename d4/d39/d5c/l6a to d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/d134/l136 0 2023-12-05T09:26:35.544 INFO:tasks.workunit.client.0.smithi067.stdout:4/661: mkdir d0/d1d/d2b/def 0 2023-12-05T09:26:35.549 INFO:tasks.workunit.client.1.smithi134.stdout:6/950: rmdir d4/d39/d42/d4f/d6d/d3a/da/d11c/d86 39 2023-12-05T09:26:35.549 INFO:tasks.workunit.client.1.smithi134.stdout:6/951: fdatasync d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/f10e 0 2023-12-05T09:26:35.551 INFO:tasks.workunit.client.0.smithi067.stdout:8/699: dwrite d5/f1c [0,4194304] 0 2023-12-05T09:26:35.551 INFO:tasks.workunit.client.0.smithi067.stdout:8/700: chown d5/dc/l1b 294686340 1 2023-12-05T09:26:35.554 INFO:tasks.workunit.client.0.smithi067.stdout:8/701: rename d5/f6b to d5/d9d/dab/fd0 0 2023-12-05T09:26:35.554 INFO:tasks.workunit.client.0.smithi067.stdout:8/702: stat d5/dc/d1a/d20/d2d/d8a/db5 0 2023-12-05T09:26:35.562 INFO:tasks.workunit.client.0.smithi067.stdout:0/808: sync 2023-12-05T09:26:35.562 INFO:tasks.workunit.client.0.smithi067.stdout:9/885: sync 2023-12-05T09:26:35.563 INFO:tasks.workunit.client.0.smithi067.stdout:9/886: chown d1b/fa2 539 1 2023-12-05T09:26:35.564 INFO:tasks.workunit.client.0.smithi067.stdout:0/809: rename d3/d7/d3c/d8d/df7 to d3/d7/d3c/d67/d59/deb/d11e 0 2023-12-05T09:26:35.565 INFO:tasks.workunit.client.1.smithi134.stdout:0/946: sync 2023-12-05T09:26:35.565 INFO:tasks.workunit.client.0.smithi067.stdout:0/810: mknod d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/c11f 0 2023-12-05T09:26:35.569 INFO:tasks.workunit.client.0.smithi067.stdout:5/682: sync 2023-12-05T09:26:35.569 INFO:tasks.workunit.client.0.smithi067.stdout:0/811: creat d3/d6b/f120 x:0 0 0 2023-12-05T09:26:35.569 INFO:tasks.workunit.client.0.smithi067.stdout:2/578: sync 2023-12-05T09:26:35.569 INFO:tasks.workunit.client.0.smithi067.stdout:2/579: chown d0/l17 3799 1 2023-12-05T09:26:35.569 INFO:tasks.workunit.client.0.smithi067.stdout:2/580: chown d0/d25/f4e 934 1 2023-12-05T09:26:35.569 INFO:tasks.workunit.client.0.smithi067.stdout:3/633: sync 2023-12-05T09:26:35.569 INFO:tasks.workunit.client.0.smithi067.stdout:3/634: read d9/da/d15/d17/d1a/d51/d66/d82/fb4 [3185447,126723] 0 2023-12-05T09:26:35.574 INFO:tasks.workunit.client.0.smithi067.stdout:0/812: rename d3/d7/c54 to d3/d6b/d10a/c121 0 2023-12-05T09:26:35.574 INFO:tasks.workunit.client.0.smithi067.stdout:0/813: fsync d3/da2/fac 0 2023-12-05T09:26:35.575 INFO:tasks.workunit.client.0.smithi067.stdout:2/581: link d0/d25/d9d/d53/d1e/d7f/c85 d0/d25/ccb 0 2023-12-05T09:26:35.577 INFO:tasks.workunit.client.0.smithi067.stdout:3/635: mknod d9/da/ce2 0 2023-12-05T09:26:35.577 INFO:tasks.workunit.client.0.smithi067.stdout:3/636: readlink d9/da/d15/l9a 0 2023-12-05T09:26:35.580 INFO:tasks.workunit.client.1.smithi134.stdout:9/984: dwrite d7/d10/f37 [0,4194304] 0 2023-12-05T09:26:35.580 INFO:tasks.workunit.client.0.smithi067.stdout:0/814: mkdir d3/d7/d3c/d66/df8/d122 0 2023-12-05T09:26:35.580 INFO:tasks.workunit.client.0.smithi067.stdout:0/815: readlink d3/da2/l7d 0 2023-12-05T09:26:35.580 INFO:tasks.workunit.client.0.smithi067.stdout:0/816: dread - d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/dcf/fe9 zero size 2023-12-05T09:26:35.581 INFO:tasks.workunit.client.0.smithi067.stdout:2/582: creat d0/d25/d9d/d53/d1e/d7f/fcc x:0 0 0 2023-12-05T09:26:35.581 INFO:tasks.workunit.client.0.smithi067.stdout:2/583: chown d0/d2f/fb9 257395475 1 2023-12-05T09:26:35.581 INFO:tasks.workunit.client.0.smithi067.stdout:2/584: creat d0/d25/d34/fcd x:0 0 0 2023-12-05T09:26:35.582 INFO:tasks.workunit.client.1.smithi134.stdout:9/985: creat d7/d117/f152 x:0 0 0 2023-12-05T09:26:35.583 INFO:tasks.workunit.client.1.smithi134.stdout:3/979: dwrite d4/d1f/f2b [0,4194304] 0 2023-12-05T09:26:35.583 INFO:tasks.workunit.client.1.smithi134.stdout:5/953: sync 2023-12-05T09:26:35.583 INFO:tasks.workunit.client.1.smithi134.stdout:5/954: fdatasync d0/d1a/d1c/d25/f56 0 2023-12-05T09:26:35.586 INFO:tasks.workunit.client.1.smithi134.stdout:4/997: dwrite d16/d21/d48/d66/fbf [0,4194304] 0 2023-12-05T09:26:35.586 INFO:tasks.workunit.client.1.smithi134.stdout:4/998: stat d16/d21/f124 0 2023-12-05T09:26:35.586 INFO:tasks.workunit.client.0.smithi067.stdout:0/817: creat d3/d7/d3c/ddb/f123 x:0 0 0 2023-12-05T09:26:35.591 INFO:tasks.workunit.client.0.smithi067.stdout:2/585: rename d0/d25/d9d/d53/d1e/d8e/dc4/dc3 to d0/d25/d34/d4d/db0/dce 0 2023-12-05T09:26:35.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/683: write db/df/d1a/d59/dae/fb8 [1631762,82871] 0 2023-12-05T09:26:35.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/684: fsync db/df/d1a/f21 0 2023-12-05T09:26:35.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/685: dread - db/df/fad zero size 2023-12-05T09:26:35.602 INFO:tasks.workunit.client.0.smithi067.stdout:4/662: fsync d0/d1d/d25/d2c/d34/d4e/d5a/d88/fee 0 2023-12-05T09:26:35.604 INFO:tasks.workunit.client.0.smithi067.stdout:3/637: dread d9/d24/f33 [0,4194304] 0 2023-12-05T09:26:35.609 INFO:tasks.workunit.client.1.smithi134.stdout:4/999: unlink d16/d21/d48/d80/dae/l75 0 2023-12-05T09:26:35.612 INFO:tasks.workunit.client.0.smithi067.stdout:6/601: sync 2023-12-05T09:26:35.613 INFO:tasks.workunit.client.0.smithi067.stdout:6/602: write da/d10/d1e/d17/d2f/d2c/d34/f3e [908718,98959] 0 2023-12-05T09:26:35.613 INFO:tasks.workunit.client.0.smithi067.stdout:6/603: chown da/d10/d1e/d17/d2f/d1f/d27/daa/fc6 1 1 2023-12-05T09:26:35.613 INFO:tasks.workunit.client.0.smithi067.stdout:1/718: sync 2023-12-05T09:26:35.616 INFO:tasks.workunit.client.0.smithi067.stdout:4/663: creat d0/d1d/d25/d2c/d34/ff0 x:0 0 0 2023-12-05T09:26:35.616 INFO:tasks.workunit.client.0.smithi067.stdout:4/664: dread - d0/d1d/d25/d2c/d34/d4e/fa1 zero size 2023-12-05T09:26:35.616 INFO:tasks.workunit.client.0.smithi067.stdout:4/665: fdatasync d0/d1d/d2b/f69 0 2023-12-05T09:26:35.617 INFO:tasks.workunit.client.0.smithi067.stdout:4/666: write d0/d1d/d25/d2c/d34/d4e/daa/fdb [908151,83984] 0 2023-12-05T09:26:35.617 INFO:tasks.workunit.client.0.smithi067.stdout:4/667: readlink d0/d1d/d53/da8/da9/d15/l3d 0 2023-12-05T09:26:35.617 INFO:tasks.workunit.client.0.smithi067.stdout:4/668: chown d0/d1d/f58 1899 1 2023-12-05T09:26:35.617 INFO:tasks.workunit.client.0.smithi067.stdout:4/669: chown d0/d1d/d25/d32/c18 246 1 2023-12-05T09:26:35.617 INFO:tasks.workunit.client.0.smithi067.stdout:4/670: truncate d0/d1d/f7b 689604 0 2023-12-05T09:26:35.622 INFO:tasks.workunit.client.0.smithi067.stdout:6/604: mkdir da/d10/d1e/d51/d7b/dd6 0 2023-12-05T09:26:35.625 INFO:tasks.workunit.client.1.smithi134.stdout:6/952: dwrite d4/d39/f51 [0,4194304] 0 2023-12-05T09:26:35.625 INFO:tasks.workunit.client.1.smithi134.stdout:6/953: write d4/d39/fca [396746,28921] 0 2023-12-05T09:26:35.625 INFO:tasks.workunit.client.1.smithi134.stdout:6/954: dread - d4/d78/dfa/ff8 zero size 2023-12-05T09:26:35.625 INFO:tasks.workunit.client.0.smithi067.stdout:0/818: rename d3/d7/d3c/dc2 to d3/d7/d3c/d67/d59/d4e/d94/d116/d124 0 2023-12-05T09:26:35.630 INFO:tasks.workunit.client.0.smithi067.stdout:2/586: dread d0/d25/d9d/d53/d92/fc2 [0,4194304] 0 2023-12-05T09:26:35.632 INFO:tasks.workunit.client.1.smithi134.stdout:5/955: dread d0/d1a/d1c/d3f/d81/fe5 [0,4194304] 0 2023-12-05T09:26:35.632 INFO:tasks.workunit.client.1.smithi134.stdout:5/956: creat d0/d1a/d1c/d3f/d5b/d5d/d78/db3/f147 x:0 0 0 2023-12-05T09:26:35.637 INFO:tasks.workunit.client.1.smithi134.stdout:5/957: write d0/d11/d5c/fe6 [4912415,96031] 0 2023-12-05T09:26:35.638 INFO:tasks.workunit.client.1.smithi134.stdout:7/979: dwrite d2/df/d2a/d36/f5d [4194304,4194304] 0 2023-12-05T09:26:35.639 INFO:tasks.workunit.client.0.smithi067.stdout:9/887: dread d1b/f7a [0,4194304] 0 2023-12-05T09:26:35.639 INFO:tasks.workunit.client.0.smithi067.stdout:9/888: write d1b/d25/d35/d56/fbc [656353,40850] 0 2023-12-05T09:26:35.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/628: dwrite d0/d9/d10/d37/d38/d64/d34/d67/fc7 [0,4194304] 0 2023-12-05T09:26:35.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/629: dread - d0/d9/d10/d37/d38/d64/d34/f9a zero size 2023-12-05T09:26:35.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/630: write d0/d9/d3f/dbd/fce [240452,109760] 0 2023-12-05T09:26:35.640 INFO:tasks.workunit.client.0.smithi067.stdout:0/819: symlink d3/d7/df0/l125 0 2023-12-05T09:26:35.640 INFO:tasks.workunit.client.0.smithi067.stdout:2/587: mkdir d0/d25/d34/d4d/d54/d90/dcf 0 2023-12-05T09:26:35.640 INFO:tasks.workunit.client.1.smithi134.stdout:0/947: dwrite d13/d14/d30/d4b/d66/da0/daf/dce/f109 [0,4194304] 0 2023-12-05T09:26:35.640 INFO:tasks.workunit.client.1.smithi134.stdout:9/986: dread d7/d8/fe2 [0,4194304] 0 2023-12-05T09:26:35.641 INFO:tasks.workunit.client.0.smithi067.stdout:6/605: getdents da/d10/d1e/d17/d2f/d3f/d92 0 2023-12-05T09:26:35.641 INFO:tasks.workunit.client.0.smithi067.stdout:6/606: truncate da/d10/d1e/d17/d2f/d72/f85 5065891 0 2023-12-05T09:26:35.646 INFO:tasks.workunit.client.0.smithi067.stdout:9/889: mkdir d1b/d25/d5b/d62/def/dca/d12a 0 2023-12-05T09:26:35.649 INFO:tasks.workunit.client.1.smithi134.stdout:5/958: unlink d0/d1a/d1c/cb9 0 2023-12-05T09:26:35.651 INFO:tasks.workunit.client.1.smithi134.stdout:9/987: creat d7/d8/d16/d52/d74/d97/d99/d10b/d125/f153 x:0 0 0 2023-12-05T09:26:35.652 INFO:tasks.workunit.client.0.smithi067.stdout:7/631: symlink d0/d9/d10/d37/d38/d64/d9c/ld0 0 2023-12-05T09:26:35.655 INFO:tasks.workunit.client.0.smithi067.stdout:0/820: creat d3/d6b/dae/f126 x:0 0 0 2023-12-05T09:26:35.655 INFO:tasks.workunit.client.1.smithi134.stdout:9/988: truncate d7/d8/d14/d26/d7f/d92/f8e 445157 0 2023-12-05T09:26:35.655 INFO:tasks.workunit.client.0.smithi067.stdout:0/821: stat d3/d7/d3c/d66/d11c 0 2023-12-05T09:26:35.655 INFO:tasks.workunit.client.0.smithi067.stdout:0/822: write d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/dcf/f11a [2812291,51480] 0 2023-12-05T09:26:35.656 INFO:tasks.workunit.client.1.smithi134.stdout:5/959: dread d0/d1a/f39 [0,4194304] 0 2023-12-05T09:26:35.656 INFO:tasks.workunit.client.1.smithi134.stdout:0/948: dread d13/d14/f87 [0,4194304] 0 2023-12-05T09:26:35.656 INFO:tasks.workunit.client.1.smithi134.stdout:5/960: write d0/d50/f144 [367144,74975] 0 2023-12-05T09:26:35.656 INFO:tasks.workunit.client.1.smithi134.stdout:5/961: chown d0/d1a/d3a/f4e 0 1 2023-12-05T09:26:35.656 INFO:tasks.workunit.client.1.smithi134.stdout:0/949: write d13/d14/d15/f40 [210060,111676] 0 2023-12-05T09:26:35.657 INFO:tasks.workunit.client.1.smithi134.stdout:9/989: getdents d7/d8/d16/d52/d74/d14a/d69/d10e 0 2023-12-05T09:26:35.659 INFO:tasks.workunit.client.1.smithi134.stdout:9/990: creat d7/d10/d56/f154 x:0 0 0 2023-12-05T09:26:35.659 INFO:tasks.workunit.client.0.smithi067.stdout:6/607: mkdir da/d7d/dd7 0 2023-12-05T09:26:35.659 INFO:tasks.workunit.client.0.smithi067.stdout:6/608: write da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fc7 [1195047,121784] 0 2023-12-05T09:26:35.660 INFO:tasks.workunit.client.0.smithi067.stdout:4/671: dread d0/d1d/d25/d2c/d34/d4e/d5a/d88/fb0 [0,4194304] 0 2023-12-05T09:26:35.662 INFO:tasks.workunit.client.1.smithi134.stdout:0/950: rmdir d13/d14/d15/d93 39 2023-12-05T09:26:35.664 INFO:tasks.workunit.client.0.smithi067.stdout:9/890: truncate d1b/dd3/d6c/d78/f102 26894 0 2023-12-05T09:26:35.664 INFO:tasks.workunit.client.0.smithi067.stdout:9/891: write d1b/dd3/d82/f11f [208096,110383] 0 2023-12-05T09:26:35.664 INFO:tasks.workunit.client.1.smithi134.stdout:9/991: mkdir d7/d8/d16/d52/d74/d155 0 2023-12-05T09:26:35.666 INFO:tasks.workunit.client.1.smithi134.stdout:3/980: dwrite d4/d5/d7c/f109 [0,4194304] 0 2023-12-05T09:26:35.670 INFO:tasks.workunit.client.1.smithi134.stdout:9/992: creat d7/d8/d14/f156 x:0 0 0 2023-12-05T09:26:35.670 INFO:tasks.workunit.client.1.smithi134.stdout:9/993: creat d7/dee/d114/d8f/d8a/f157 x:0 0 0 2023-12-05T09:26:35.671 INFO:tasks.workunit.client.0.smithi067.stdout:7/632: mkdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/dd1 0 2023-12-05T09:26:35.671 INFO:tasks.workunit.client.1.smithi134.stdout:3/981: getdents d4/dec 0 2023-12-05T09:26:35.672 INFO:tasks.workunit.client.1.smithi134.stdout:5/962: dread d0/d1a/f8f [0,4194304] 0 2023-12-05T09:26:35.673 INFO:tasks.workunit.client.1.smithi134.stdout:5/963: read d0/dd/d37/d90/f103 [150039,91598] 0 2023-12-05T09:26:35.673 INFO:tasks.workunit.client.0.smithi067.stdout:5/686: dread db/df/d1a/d59/dae/fb8 [0,4194304] 0 2023-12-05T09:26:35.674 INFO:tasks.workunit.client.0.smithi067.stdout:5/687: dread - db/df/d35/d63/d75/fb2 zero size 2023-12-05T09:26:35.680 INFO:tasks.workunit.client.0.smithi067.stdout:8/703: dwrite d5/dc/d1a/d20/d2d/d7f/d94/da3/fa4 [0,4194304] 0 2023-12-05T09:26:35.680 INFO:tasks.workunit.client.0.smithi067.stdout:8/704: write d5/dc/d1a/f5a [5381866,46973] 0 2023-12-05T09:26:35.683 INFO:tasks.workunit.client.0.smithi067.stdout:0/823: creat d3/d7/d3c/d6c/d76/da7/f127 x:0 0 0 2023-12-05T09:26:35.684 INFO:tasks.workunit.client.0.smithi067.stdout:6/609: rmdir da/d10/d1e/d17/d2f/d3f/d92 39 2023-12-05T09:26:35.685 INFO:tasks.workunit.client.0.smithi067.stdout:7/633: symlink d0/d9/d10/d37/d38/d64/d34/ld2 0 2023-12-05T09:26:35.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/688: creat db/df/d3f/d88/ff5 x:0 0 0 2023-12-05T09:26:35.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/689: write db/df/f50 [4097235,7790] 0 2023-12-05T09:26:35.692 INFO:tasks.workunit.client.1.smithi134.stdout:5/964: creat d0/dd/d37/d7d/f148 x:0 0 0 2023-12-05T09:26:35.692 INFO:tasks.workunit.client.0.smithi067.stdout:1/719: dwrite d2/d4f/d14/f42 [0,4194304] 0 2023-12-05T09:26:35.698 INFO:tasks.workunit.client.1.smithi134.stdout:5/965: creat d0/d1a/d1c/d25/d6a/f149 x:0 0 0 2023-12-05T09:26:35.700 INFO:tasks.workunit.client.1.smithi134.stdout:9/994: unlink d7/d8/d16/d52/d74/d97/df0/f10c 0 2023-12-05T09:26:35.702 INFO:tasks.workunit.client.1.smithi134.stdout:5/966: getdents d0/d1a/d1c/d3f/d81/db0 0 2023-12-05T09:26:35.702 INFO:tasks.workunit.client.1.smithi134.stdout:5/967: truncate d0/d1a/d1c/d25/f56 1229278 0 2023-12-05T09:26:35.702 INFO:tasks.workunit.client.1.smithi134.stdout:5/968: readlink d0/d45/daf/lfb 0 2023-12-05T09:26:35.705 INFO:tasks.workunit.client.0.smithi067.stdout:4/672: write d0/d1d/d25/d2c/d34/f43 [885291,108269] 0 2023-12-05T09:26:35.705 INFO:tasks.workunit.client.1.smithi134.stdout:5/969: unlink d0/d1a/d1c/d3f/d81/d8e/lf5 0 2023-12-05T09:26:35.705 INFO:tasks.workunit.client.1.smithi134.stdout:5/970: fsync d0/f13c 0 2023-12-05T09:26:35.705 INFO:tasks.workunit.client.1.smithi134.stdout:5/971: fsync d0/dd/d37/f9c 0 2023-12-05T09:26:35.706 INFO:tasks.workunit.client.1.smithi134.stdout:5/972: creat d0/d1a/d1c/d25/d6a/f14a x:0 0 0 2023-12-05T09:26:35.706 INFO:tasks.workunit.client.1.smithi134.stdout:5/973: chown d0/d1a/d3a/f132 61 1 2023-12-05T09:26:35.708 INFO:tasks.workunit.client.1.smithi134.stdout:5/974: mknod d0/d1a/d1c/d3f/d81/db0/dbe/c14b 0 2023-12-05T09:26:35.708 INFO:tasks.workunit.client.1.smithi134.stdout:5/975: dread - d0/d1a/d1c/d3f/d81/d8a/f133 zero size 2023-12-05T09:26:35.708 INFO:tasks.workunit.client.1.smithi134.stdout:5/976: chown d0/d1a/d1c/d3f/d5b/d5d 10 1 2023-12-05T09:26:35.709 INFO:tasks.workunit.client.0.smithi067.stdout:6/610: dread da/d10/d1e/d17/d2f/d3f/f64 [0,4194304] 0 2023-12-05T09:26:35.709 INFO:tasks.workunit.client.0.smithi067.stdout:6/611: dread - da/d10/d1e/d17/d2f/d72/f90 zero size 2023-12-05T09:26:35.710 INFO:tasks.workunit.client.1.smithi134.stdout:5/977: unlink d0/d1a/d3a/f3b 0 2023-12-05T09:26:35.710 INFO:tasks.workunit.client.1.smithi134.stdout:5/978: dread - d0/d1a/d1c/d3f/d5b/d5d/d78/db3/ffa zero size 2023-12-05T09:26:35.713 INFO:tasks.workunit.client.1.smithi134.stdout:7/980: dwrite d2/d7/dc/d2e/d3a/fee [0,4194304] 0 2023-12-05T09:26:35.713 INFO:tasks.workunit.client.1.smithi134.stdout:7/981: chown d2/d7/d2b/d2d/d67/d73/d26/f58 787378400 1 2023-12-05T09:26:35.719 INFO:tasks.workunit.client.1.smithi134.stdout:3/982: rmdir d4/d1f 39 2023-12-05T09:26:35.721 INFO:tasks.workunit.client.0.smithi067.stdout:2/588: rename d0/d2f to d0/d25/d9d/d53/d1e/d8e/dd0 0 2023-12-05T09:26:35.721 INFO:tasks.workunit.client.0.smithi067.stdout:2/589: write d0/d25/d9d/d53/d1e/f2d [1139495,59504] 0 2023-12-05T09:26:35.721 INFO:tasks.workunit.client.0.smithi067.stdout:0/824: creat d3/d7/d3c/d6c/d76/da7/dec/f128 x:0 0 0 2023-12-05T09:26:35.725 INFO:tasks.workunit.client.1.smithi134.stdout:7/982: mknod d2/d7/d93/dcf/d116/c141 0 2023-12-05T09:26:35.727 INFO:tasks.workunit.client.1.smithi134.stdout:5/979: getdents d0/d50 0 2023-12-05T09:26:35.727 INFO:tasks.workunit.client.0.smithi067.stdout:4/673: symlink d0/d1d/d53/da8/da9/d15/dd0/dd9/lf1 0 2023-12-05T09:26:35.728 INFO:tasks.workunit.client.0.smithi067.stdout:9/892: dwrite d1b/f104 [0,4194304] 0 2023-12-05T09:26:35.728 INFO:tasks.workunit.client.0.smithi067.stdout:9/893: fdatasync d1b/d25/d5b/d62/def/f129 0 2023-12-05T09:26:35.730 INFO:tasks.workunit.client.1.smithi134.stdout:7/983: symlink d2/d7/d93/dcf/dd6/l142 0 2023-12-05T09:26:35.731 INFO:tasks.workunit.client.0.smithi067.stdout:6/612: creat da/d10/d1e/d69/fd8 x:0 0 0 2023-12-05T09:26:35.732 INFO:tasks.workunit.client.0.smithi067.stdout:8/705: rmdir d5/dc/d1a/d20/d2d/d7f/d94/da3 39 2023-12-05T09:26:35.732 INFO:tasks.workunit.client.0.smithi067.stdout:8/706: write d5/f28 [4046405,23899] 0 2023-12-05T09:26:35.734 INFO:tasks.workunit.client.1.smithi134.stdout:9/995: dread d7/d5b/d5e/daa/db7/fb9 [0,4194304] 0 2023-12-05T09:26:35.738 INFO:tasks.workunit.client.0.smithi067.stdout:7/634: rename d0/d9/d10/d37/d38/f7f to d0/d9/d10/d37/d38/d64/d34/d67/fd3 0 2023-12-05T09:26:35.738 INFO:tasks.workunit.client.0.smithi067.stdout:7/635: write d0/d9/d10/d37/f2a [1710903,24065] 0 2023-12-05T09:26:35.739 INFO:tasks.workunit.client.0.smithi067.stdout:2/590: mknod d0/d25/d34/d4d/db0/dbf/cd1 0 2023-12-05T09:26:35.739 INFO:tasks.workunit.client.0.smithi067.stdout:2/591: chown d0/l11 54 1 2023-12-05T09:26:35.739 INFO:tasks.workunit.client.0.smithi067.stdout:2/592: creat d0/d7c/fd2 x:0 0 0 2023-12-05T09:26:35.739 INFO:tasks.workunit.client.1.smithi134.stdout:9/996: symlink d7/d8/d16/d52/d74/d14a/l158 0 2023-12-05T09:26:35.739 INFO:tasks.workunit.client.1.smithi134.stdout:9/997: write d7/d8/d14/d26/d7f/d92/d53/f14c [89640,44042] 0 2023-12-05T09:26:35.740 INFO:tasks.workunit.client.1.smithi134.stdout:3/983: write d4/d1f/d4e/f65 [3241075,122318] 0 2023-12-05T09:26:35.741 INFO:tasks.workunit.client.0.smithi067.stdout:0/825: mkdir d3/d7/d3c/d67/d59/d4e/db2/d129 0 2023-12-05T09:26:35.741 INFO:tasks.workunit.client.0.smithi067.stdout:4/674: stat d0/d1d/d2a/d72/la7 0 2023-12-05T09:26:35.746 INFO:tasks.workunit.client.1.smithi134.stdout:0/951: sync 2023-12-05T09:26:35.746 INFO:tasks.workunit.client.1.smithi134.stdout:6/955: sync 2023-12-05T09:26:35.747 INFO:tasks.workunit.client.1.smithi134.stdout:6/956: chown d4/d39/d5c/f120 3 1 2023-12-05T09:26:35.748 INFO:tasks.workunit.client.0.smithi067.stdout:9/894: link d1b/l1e d1b/d25/d54/d5c/l12b 0 2023-12-05T09:26:35.750 INFO:tasks.workunit.client.0.smithi067.stdout:6/613: symlink da/d10/d1e/d17/d2f/d1f/d27/daa/ld9 0 2023-12-05T09:26:35.751 INFO:tasks.workunit.client.0.smithi067.stdout:6/614: stat da/d10/d1e/d17/d2f/d1f/d27/d4f/fb7 0 2023-12-05T09:26:35.755 INFO:tasks.workunit.client.1.smithi134.stdout:6/957: rename d4/d39/d5c/dda to d4/d39/d42/d4f/d6d/d137 0 2023-12-05T09:26:35.758 INFO:tasks.workunit.client.0.smithi067.stdout:2/593: truncate d0/d25/d9d/d53/d1e/d8e/dd0/f37 1266544 0 2023-12-05T09:26:35.758 INFO:tasks.workunit.client.0.smithi067.stdout:2/594: write d0/f41 [1757232,42358] 0 2023-12-05T09:26:35.758 INFO:tasks.workunit.client.1.smithi134.stdout:7/984: dread d2/d7/f13 [0,4194304] 0 2023-12-05T09:26:35.759 INFO:tasks.workunit.client.0.smithi067.stdout:8/707: dread d5/dc/fac [0,4194304] 0 2023-12-05T09:26:35.760 INFO:tasks.workunit.client.1.smithi134.stdout:6/958: rmdir d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112 39 2023-12-05T09:26:35.761 INFO:tasks.workunit.client.0.smithi067.stdout:0/826: unlink d3/d7/df0/l125 0 2023-12-05T09:26:35.762 INFO:tasks.workunit.client.1.smithi134.stdout:7/985: mkdir d2/d7/d2b/d2d/d67/d73/d143 0 2023-12-05T09:26:35.767 INFO:tasks.workunit.client.1.smithi134.stdout:6/959: creat d4/d39/d42/d4f/d6d/d3a/d135/f138 x:0 0 0 2023-12-05T09:26:35.768 INFO:tasks.workunit.client.0.smithi067.stdout:4/675: mkdir d0/d1d/d25/d2c/df2 0 2023-12-05T09:26:35.768 INFO:tasks.workunit.client.0.smithi067.stdout:9/895: getdents d1b/d25/d35 0 2023-12-05T09:26:35.774 INFO:tasks.workunit.client.0.smithi067.stdout:7/636: dread d0/d9/d10/d37/d38/d64/d34/f36 [0,4194304] 0 2023-12-05T09:26:35.774 INFO:tasks.workunit.client.0.smithi067.stdout:7/637: fdatasync d0/d9/d40/d7a/dad/fcf 0 2023-12-05T09:26:35.776 INFO:tasks.workunit.client.1.smithi134.stdout:6/960: rename d4/d39/d42/d4f/d6d/d3a/da/de3/cef to d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/dba/d114/d119/c139 0 2023-12-05T09:26:35.779 INFO:tasks.workunit.client.0.smithi067.stdout:6/615: dread da/d10/d1e/d17/d2f/d3f/f64 [0,4194304] 0 2023-12-05T09:26:35.780 INFO:tasks.workunit.client.1.smithi134.stdout:6/961: symlink d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/l13a 0 2023-12-05T09:26:35.780 INFO:tasks.workunit.client.1.smithi134.stdout:6/962: creat d4/d39/d42/d4f/d6d/d3a/da/d11c/f13b x:0 0 0 2023-12-05T09:26:35.780 INFO:tasks.workunit.client.0.smithi067.stdout:5/690: dwrite db/f13 [4194304,4194304] 0 2023-12-05T09:26:35.787 INFO:tasks.workunit.client.0.smithi067.stdout:1/720: dwrite d2/d5/d7/de/d19/d49/d6d/f5b [0,4194304] 0 2023-12-05T09:26:35.788 INFO:tasks.workunit.client.1.smithi134.stdout:0/952: read d13/fb1 [4486600,72487] 0 2023-12-05T09:26:35.788 INFO:tasks.workunit.client.1.smithi134.stdout:5/980: dwrite d0/d11/f1f [0,4194304] 0 2023-12-05T09:26:35.788 INFO:tasks.workunit.client.1.smithi134.stdout:6/963: symlink d4/d39/d42/d4f/d6d/d3a/da/df9/l13c 0 2023-12-05T09:26:35.788 INFO:tasks.workunit.client.1.smithi134.stdout:6/964: fsync d4/d39/d42/d4f/ff7 0 2023-12-05T09:26:35.789 INFO:tasks.workunit.client.1.smithi134.stdout:6/965: write d4/d39/d42/d4f/d6d/d3a/d135/f138 [260422,107244] 0 2023-12-05T09:26:35.789 INFO:tasks.workunit.client.1.smithi134.stdout:6/966: write d4/d39/d5c/f10d [977798,18865] 0 2023-12-05T09:26:35.791 INFO:tasks.workunit.client.1.smithi134.stdout:0/953: symlink d13/d14/d30/d4b/d66/da0/daf/dce/d103/l140 0 2023-12-05T09:26:35.795 INFO:tasks.workunit.client.1.smithi134.stdout:5/981: mknod d0/d11/d61/c14c 0 2023-12-05T09:26:35.797 INFO:tasks.workunit.client.1.smithi134.stdout:0/954: mknod d13/d14/d30/d4b/d66/da0/da2/df2/d127/c141 0 2023-12-05T09:26:35.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/955: symlink d13/d14/d30/d4b/d66/da0/daf/dce/d103/l142 0 2023-12-05T09:26:35.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/956: chown d13/d14/d30/d4b/f13f 5131 1 2023-12-05T09:26:35.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/957: write d13/d14/d30/d4b/d66/da0/daf/dce/d86/f134 [904823,76109] 0 2023-12-05T09:26:35.803 INFO:tasks.workunit.client.1.smithi134.stdout:0/958: creat d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/d8c/f143 x:0 0 0 2023-12-05T09:26:35.803 INFO:tasks.workunit.client.1.smithi134.stdout:0/959: readlink d13/d14/d30/d4b/d66/da0/l105 0 2023-12-05T09:26:35.806 INFO:tasks.workunit.client.1.smithi134.stdout:0/960: rename d13/d14/d30/d4b/d66/da0/daf/dde/c91 to d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/d8c/d11b/c144 0 2023-12-05T09:26:35.806 INFO:tasks.workunit.client.1.smithi134.stdout:6/967: dread d4/d39/d42/d4f/d6d/d3a/da/da0/fdf [0,4194304] 0 2023-12-05T09:26:35.806 INFO:tasks.workunit.client.1.smithi134.stdout:6/968: write d4/d39/d42/d4f/d6d/d3a/da/d11c/f13b [879823,85978] 0 2023-12-05T09:26:35.806 INFO:tasks.workunit.client.1.smithi134.stdout:6/969: creat d4/d39/d42/d4f/d6d/d3a/da/d11c/f13d x:0 0 0 2023-12-05T09:26:35.807 INFO:tasks.workunit.client.1.smithi134.stdout:0/961: getdents d13/d14/d30 0 2023-12-05T09:26:35.810 INFO:tasks.workunit.client.1.smithi134.stdout:6/970: creat d4/d39/d42/d4f/d6d/f13e x:0 0 0 2023-12-05T09:26:35.810 INFO:tasks.workunit.client.1.smithi134.stdout:6/971: dread - d4/d39/d42/d4f/d6d/d3a/dd4/f123 zero size 2023-12-05T09:26:35.812 INFO:tasks.workunit.client.0.smithi067.stdout:2/595: mkdir d0/d25/d34/d4d/db0/dce/dd3 0 2023-12-05T09:26:35.812 INFO:tasks.workunit.client.0.smithi067.stdout:8/708: rename d5/dc/d1a/d62/d7e/ca6 to d5/dc/d1a/cd1 0 2023-12-05T09:26:35.812 INFO:tasks.workunit.client.0.smithi067.stdout:0/827: symlink d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/l12a 0 2023-12-05T09:26:35.812 INFO:tasks.workunit.client.0.smithi067.stdout:8/709: chown d5/dc/d1a/d20/d2d/d7f/d94/da3 197890 1 2023-12-05T09:26:35.815 INFO:tasks.workunit.client.0.smithi067.stdout:9/896: symlink d1b/d25/d5b/l12c 0 2023-12-05T09:26:35.825 INFO:tasks.workunit.client.0.smithi067.stdout:7/638: getdents d0/d9/d10/d37/d82 0 2023-12-05T09:26:35.825 INFO:tasks.workunit.client.0.smithi067.stdout:6/616: creat da/d10/d1e/fda x:0 0 0 2023-12-05T09:26:35.827 INFO:tasks.workunit.client.1.smithi134.stdout:7/986: dwrite d2/d7/dc/fc0 [4194304,4194304] 0 2023-12-05T09:26:35.830 INFO:tasks.workunit.client.0.smithi067.stdout:7/639: mkdir d0/dd4 0 2023-12-05T09:26:35.831 INFO:tasks.workunit.client.1.smithi134.stdout:3/984: dwrite d4/d5/f32 [0,4194304] 0 2023-12-05T09:26:35.838 INFO:tasks.workunit.client.1.smithi134.stdout:7/987: creat d2/df/d81/daf/de3/f144 x:0 0 0 2023-12-05T09:26:35.847 INFO:tasks.workunit.client.1.smithi134.stdout:3/985: symlink d4/d1f/d4e/l130 0 2023-12-05T09:26:35.849 INFO:tasks.workunit.client.1.smithi134.stdout:3/986: rename d4/d1f/d50/db4/d102/d96/dde/d11b/f123 to d4/d1f/d50/db4/dc1/f131 0 2023-12-05T09:26:35.850 INFO:tasks.workunit.client.1.smithi134.stdout:3/987: symlink d4/d1f/d50/db4/d102/dba/l132 0 2023-12-05T09:26:35.850 INFO:tasks.workunit.client.1.smithi134.stdout:5/982: dread d0/d1a/d3a/f74 [0,4194304] 0 2023-12-05T09:26:35.853 INFO:tasks.workunit.client.1.smithi134.stdout:3/988: symlink d4/d1f/d50/db4/d102/l133 0 2023-12-05T09:26:35.853 INFO:tasks.workunit.client.1.smithi134.stdout:3/989: chown d4/fb 1188138883 1 2023-12-05T09:26:35.853 INFO:tasks.workunit.client.1.smithi134.stdout:3/990: read - d4/d1f/d50/db4/d102/dab/ddc/fef zero size 2023-12-05T09:26:35.855 INFO:tasks.workunit.client.1.smithi134.stdout:5/983: unlink d0/d1a/d1c/d25/d4d/d9e/fc5 0 2023-12-05T09:26:35.859 INFO:tasks.workunit.client.1.smithi134.stdout:5/984: mkdir d0/d1a/d1c/d3f/d81/db0/dbe/d123/d14d 0 2023-12-05T09:26:35.859 INFO:tasks.workunit.client.1.smithi134.stdout:5/985: truncate d0/dd/d37/f13f 548615 0 2023-12-05T09:26:35.859 INFO:tasks.workunit.client.1.smithi134.stdout:5/986: stat d0/d11/d61/d112 0 2023-12-05T09:26:35.862 INFO:tasks.workunit.client.1.smithi134.stdout:5/987: creat d0/d11/d5c/f14e x:0 0 0 2023-12-05T09:26:35.862 INFO:tasks.workunit.client.1.smithi134.stdout:5/988: dread - d0/dd/d37/f100 zero size 2023-12-05T09:26:35.862 INFO:tasks.workunit.client.1.smithi134.stdout:5/989: fdatasync d0/d11/f1b 0 2023-12-05T09:26:35.864 INFO:tasks.workunit.client.1.smithi134.stdout:5/990: symlink d0/d1a/d1c/d3f/d81/db0/dbe/d123/l14f 0 2023-12-05T09:26:35.864 INFO:tasks.workunit.client.1.smithi134.stdout:5/991: truncate d0/dd/d37/d90/dfe/f125 1509770 0 2023-12-05T09:26:35.864 INFO:tasks.workunit.client.0.smithi067.stdout:7/640: dread d0/d9/d10/d37/d38/f51 [0,4194304] 0 2023-12-05T09:26:35.865 INFO:tasks.workunit.client.1.smithi134.stdout:6/972: dwrite d4/f12c [0,4194304] 0 2023-12-05T09:26:35.879 INFO:tasks.workunit.client.1.smithi134.stdout:6/973: link d4/d39/dfb/cbb d4/d39/d42/d4f/d6d/d3a/c13f 0 2023-12-05T09:26:35.879 INFO:tasks.workunit.client.1.smithi134.stdout:6/974: fdatasync d4/d39/d42/d4f/d6d/d3a/da/de3/f5f 0 2023-12-05T09:26:35.879 INFO:tasks.workunit.client.1.smithi134.stdout:6/975: readlink d4/d39/d42/d4f/d6d/d3a/da/d11c/d59/lc5 0 2023-12-05T09:26:35.882 INFO:tasks.workunit.client.1.smithi134.stdout:6/976: write d4/d39/d5c/fc2 [4259891,37636] 0 2023-12-05T09:26:35.887 INFO:tasks.workunit.client.0.smithi067.stdout:0/828: dwrite d3/ff9 [0,4194304] 0 2023-12-05T09:26:35.887 INFO:tasks.workunit.client.0.smithi067.stdout:0/829: creat d3/d7/d3c/d67/dd1/f12b x:0 0 0 2023-12-05T09:26:35.890 INFO:tasks.workunit.client.1.smithi134.stdout:6/977: rename d4/f12c to d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/dba/d114/d119/f140 0 2023-12-05T09:26:35.890 INFO:tasks.workunit.client.1.smithi134.stdout:6/978: readlink d4/d39/d42/d4f/d6d/d3a/da/lf3 0 2023-12-05T09:26:35.895 INFO:tasks.workunit.client.0.smithi067.stdout:0/830: unlink d3/d7/f8f 0 2023-12-05T09:26:35.898 INFO:tasks.workunit.client.0.smithi067.stdout:0/831: mknod d3/da2/c12c 0 2023-12-05T09:26:35.902 INFO:tasks.workunit.client.0.smithi067.stdout:0/832: rename d3/d7/d3c/d67/d59/d4e/d94/d116/l10d to d3/d7/d3c/d66/df8/d122/l12d 0 2023-12-05T09:26:35.903 INFO:tasks.workunit.client.0.smithi067.stdout:1/721: dwrite d2/d4f/d54/fe4 [0,4194304] 0 2023-12-05T09:26:35.903 INFO:tasks.workunit.client.0.smithi067.stdout:1/722: chown d2/d5/d7/ca1 258 1 2023-12-05T09:26:35.905 INFO:tasks.workunit.client.1.smithi134.stdout:3/991: write d4/fb [941637,65037] 0 2023-12-05T09:26:35.909 INFO:tasks.workunit.client.1.smithi134.stdout:3/992: mkdir d4/d5/d6f/dc2/d134 0 2023-12-05T09:26:35.909 INFO:tasks.workunit.client.0.smithi067.stdout:1/723: creat d2/d5/d7/de/d19/d8f/d98/ffc x:0 0 0 2023-12-05T09:26:35.911 INFO:tasks.workunit.client.1.smithi134.stdout:9/998: sync 2023-12-05T09:26:35.911 INFO:tasks.workunit.client.1.smithi134.stdout:3/993: mkdir d4/d135 0 2023-12-05T09:26:35.911 INFO:tasks.workunit.client.1.smithi134.stdout:3/994: stat d4/d5/d7c/d92/d111 0 2023-12-05T09:26:35.912 INFO:tasks.workunit.client.1.smithi134.stdout:9/999: rename d7/d8/d14/d26/d7f/d92/d53/f12b to d7/d8/d14/d26/d7f/d92/d53/dd4/f159 0 2023-12-05T09:26:35.913 INFO:tasks.workunit.client.1.smithi134.stdout:3/995: creat d4/d1f/d50/db4/d102/d99/f136 x:0 0 0 2023-12-05T09:26:35.920 INFO:tasks.workunit.client.0.smithi067.stdout:5/691: dwrite db/df/f50 [0,4194304] 0 2023-12-05T09:26:35.922 INFO:tasks.workunit.client.0.smithi067.stdout:5/692: rmdir db/df/d35/d63 39 2023-12-05T09:26:35.924 INFO:tasks.workunit.client.0.smithi067.stdout:5/693: mkdir db/df/d3f/df6 0 2023-12-05T09:26:35.941 INFO:tasks.workunit.client.0.smithi067.stdout:2/596: dwrite d0/d25/d9d/d53/d1e/d7f/fcc [0,4194304] 0 2023-12-05T09:26:35.942 INFO:tasks.workunit.client.0.smithi067.stdout:2/597: chown d0/d25/d9d/d53/d1e/f61 50524174 1 2023-12-05T09:26:35.942 INFO:tasks.workunit.client.0.smithi067.stdout:2/598: symlink d0/d25/d34/d4d/db0/dce/ld4 0 2023-12-05T09:26:35.942 INFO:tasks.workunit.client.0.smithi067.stdout:2/599: chown d0/f7a 1584255 1 2023-12-05T09:26:35.943 INFO:tasks.workunit.client.0.smithi067.stdout:2/600: rmdir d0/d25/d34/d4d/d72 39 2023-12-05T09:26:35.944 INFO:tasks.workunit.client.0.smithi067.stdout:2/601: rmdir d0/d25/d34/d4d/db0/dbf 39 2023-12-05T09:26:35.946 INFO:tasks.workunit.client.0.smithi067.stdout:2/602: stat d0/d25/d34/d4d/d54/d56/c57 0 2023-12-05T09:26:35.951 INFO:tasks.workunit.client.0.smithi067.stdout:1/724: dread d2/d5/d7/de/d1a/f44 [0,4194304] 0 2023-12-05T09:26:35.951 INFO:tasks.workunit.client.0.smithi067.stdout:1/725: fsync d2/d5/f6f 0 2023-12-05T09:26:35.951 INFO:tasks.workunit.client.0.smithi067.stdout:2/603: symlink d0/d25/d34/d4d/db0/dce/dd3/ld5 0 2023-12-05T09:26:35.951 INFO:tasks.workunit.client.0.smithi067.stdout:2/604: dread - d0/d25/d9d/d53/d1e/d8e/dd0/d84/fc0 zero size 2023-12-05T09:26:35.952 INFO:tasks.workunit.client.0.smithi067.stdout:2/605: unlink d0/d25/d3f/f9b 0 2023-12-05T09:26:35.952 INFO:tasks.workunit.client.0.smithi067.stdout:2/606: chown d0/d25/d9d/d53/d1e/c97 163474095 1 2023-12-05T09:26:35.953 INFO:tasks.workunit.client.1.smithi134.stdout:6/979: dread d4/d39/f51 [0,4194304] 0 2023-12-05T09:26:35.953 INFO:tasks.workunit.client.0.smithi067.stdout:2/607: truncate d0/d25/d9d/d53/f1d 7479449 0 2023-12-05T09:26:35.954 INFO:tasks.workunit.client.0.smithi067.stdout:2/608: write d0/d25/d34/d4a/fb3 [4364268,82533] 0 2023-12-05T09:26:35.958 INFO:tasks.workunit.client.1.smithi134.stdout:6/980: creat d4/f141 x:0 0 0 2023-12-05T09:26:35.958 INFO:tasks.workunit.client.0.smithi067.stdout:2/609: mknod d0/d25/d34/cd6 0 2023-12-05T09:26:35.959 INFO:tasks.workunit.client.0.smithi067.stdout:2/610: truncate d0/d25/d9d/d53/d1e/d8e/dd0/faf 578088 0 2023-12-05T09:26:35.963 INFO:tasks.workunit.client.1.smithi134.stdout:5/992: dwrite d0/d1a/d1c/d3f/d5b/fba [0,4194304] 0 2023-12-05T09:26:35.965 INFO:tasks.workunit.client.0.smithi067.stdout:0/833: dwrite d3/d7/d3c/d67/d59/d4e/db2/f113 [0,4194304] 0 2023-12-05T09:26:35.965 INFO:tasks.workunit.client.0.smithi067.stdout:0/834: fsync d3/d7/d3c/f47 0 2023-12-05T09:26:35.965 INFO:tasks.workunit.client.0.smithi067.stdout:9/897: dwrite d1b/d25/d5b/ffc [0,4194304] 0 2023-12-05T09:26:35.965 INFO:tasks.workunit.client.0.smithi067.stdout:6/617: dwrite da/d10/d1e/d17/d2f/d2c/d34/f3e [0,4194304] 0 2023-12-05T09:26:35.966 INFO:tasks.workunit.client.1.smithi134.stdout:7/988: dwrite d2/df/f139 [0,4194304] 0 2023-12-05T09:26:35.966 INFO:tasks.workunit.client.1.smithi134.stdout:7/989: truncate d2/dd/f11a 584447 0 2023-12-05T09:26:35.967 INFO:tasks.workunit.client.0.smithi067.stdout:4/676: dwrite d0/d1d/d24/f7f [0,4194304] 0 2023-12-05T09:26:35.968 INFO:tasks.workunit.client.1.smithi134.stdout:5/993: getdents d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/d145 0 2023-12-05T09:26:35.968 INFO:tasks.workunit.client.1.smithi134.stdout:6/981: dread d4/d39/d42/d4f/d6d/d3a/da/da0/fdf [0,4194304] 0 2023-12-05T09:26:35.972 INFO:tasks.workunit.client.1.smithi134.stdout:7/990: rmdir d2/d7/d93/dcf/d116 39 2023-12-05T09:26:35.972 INFO:tasks.workunit.client.1.smithi134.stdout:7/991: truncate d2/d7/dc/d2e/d3a/fe2 579824 0 2023-12-05T09:26:35.972 INFO:tasks.workunit.client.1.smithi134.stdout:5/994: rename d0/dd/d37/d7d/cfc to d0/d66/d135/c150 0 2023-12-05T09:26:35.973 INFO:tasks.workunit.client.1.smithi134.stdout:5/995: write d0/d1a/d1c/f65 [77914,125477] 0 2023-12-05T09:26:35.973 INFO:tasks.workunit.client.1.smithi134.stdout:5/996: chown d0/d1a/d1c/d3f/d5b/d5d/d78/db3/f120 562 1 2023-12-05T09:26:35.978 INFO:tasks.workunit.client.1.smithi134.stdout:5/997: rename d0/d1a/d1c/d25/d4d/d9e/f124 to d0/d1a/d1c/d3f/d81/db0/f151 0 2023-12-05T09:26:35.979 INFO:tasks.workunit.client.1.smithi134.stdout:7/992: mkdir d2/d7/dc/d145 0 2023-12-05T09:26:35.981 INFO:tasks.workunit.client.1.smithi134.stdout:5/998: creat d0/d10e/f152 x:0 0 0 2023-12-05T09:26:35.984 INFO:tasks.workunit.client.0.smithi067.stdout:2/611: rmdir d0/d25/d9d/d53/d1e/d8e 39 2023-12-05T09:26:35.984 INFO:tasks.workunit.client.0.smithi067.stdout:2/612: dread - d0/d25/d9d/d53/d1e/d8e/fb6 zero size 2023-12-05T09:26:35.984 INFO:tasks.workunit.client.0.smithi067.stdout:2/613: chown d0/d25/d9d/d53/lbe 725 1 2023-12-05T09:26:35.984 INFO:tasks.workunit.client.0.smithi067.stdout:2/614: readlink d0/d25/d34/d4d/d78/l94 0 2023-12-05T09:26:35.984 INFO:tasks.workunit.client.0.smithi067.stdout:2/615: write d0/fe [4785822,121522] 0 2023-12-05T09:26:35.984 INFO:tasks.workunit.client.1.smithi134.stdout:6/982: link d4/fa6 d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/f142 0 2023-12-05T09:26:35.985 INFO:tasks.workunit.client.1.smithi134.stdout:6/983: truncate d4/d39/d42/d4f/d6d/d3a/da/d11c/d59/f102 350972 0 2023-12-05T09:26:35.985 INFO:tasks.workunit.client.1.smithi134.stdout:7/993: mkdir d2/d70/d12f/d146 0 2023-12-05T09:26:35.985 INFO:tasks.workunit.client.1.smithi134.stdout:5/999: creat d0/d1a/d1c/d3f/d5b/d5d/d78/d7b/d9b/f153 x:0 0 0 2023-12-05T09:26:35.985 INFO:tasks.workunit.client.0.smithi067.stdout:2/616: write d0/d25/d9d/d53/d1e/d8e/dd0/d39/f86 [716257,55725] 0 2023-12-05T09:26:35.987 INFO:tasks.workunit.client.1.smithi134.stdout:3/996: dwrite d4/d5/f95 [0,4194304] 0 2023-12-05T09:26:35.987 INFO:tasks.workunit.client.1.smithi134.stdout:7/994: rename d2/d7/dc/c30 to d2/d70/d12f/c147 0 2023-12-05T09:26:35.987 INFO:tasks.workunit.client.0.smithi067.stdout:9/898: mknod d1b/d25/d35/d56/dee/c12d 0 2023-12-05T09:26:35.987 INFO:tasks.workunit.client.0.smithi067.stdout:9/899: truncate d1b/f10f 410852 0 2023-12-05T09:26:35.991 INFO:tasks.workunit.client.1.smithi134.stdout:7/995: write d2/d7/d6f/feb [742427,39710] 0 2023-12-05T09:26:35.992 INFO:tasks.workunit.client.0.smithi067.stdout:4/677: rename d0/d1d/d4d/fb2 to d0/d1d/d25/d32/ff3 0 2023-12-05T09:26:35.992 INFO:tasks.workunit.client.0.smithi067.stdout:4/678: chown d0/d1d/d2b/dd6/fc7 126909 1 2023-12-05T09:26:35.992 INFO:tasks.workunit.client.0.smithi067.stdout:4/679: creat d0/d1d/d24/ff4 x:0 0 0 2023-12-05T09:26:35.992 INFO:tasks.workunit.client.0.smithi067.stdout:4/680: chown d0/fc 55956125 1 2023-12-05T09:26:35.992 INFO:tasks.workunit.client.0.smithi067.stdout:4/681: fsync d0/d9/f2f 0 2023-12-05T09:26:35.994 INFO:tasks.workunit.client.1.smithi134.stdout:7/996: read d2/d7/dc/d2e/d3a/d6d/d9e/f109 [90021,65882] 0 2023-12-05T09:26:35.994 INFO:tasks.workunit.client.1.smithi134.stdout:7/997: write d2/d118/f127 [638526,110803] 0 2023-12-05T09:26:35.994 INFO:tasks.workunit.client.1.smithi134.stdout:7/998: getdents d2/dd/d113 0 2023-12-05T09:26:35.995 INFO:tasks.workunit.client.1.smithi134.stdout:7/999: write d2/d7/d2b/d94/fb2 [916868,7443] 0 2023-12-05T09:26:35.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/962: sync 2023-12-05T09:26:35.996 INFO:tasks.workunit.client.1.smithi134.stdout:6/984: mkdir d4/d39/d42/d4f/d6d/d3a/d80/d143 0 2023-12-05T09:26:35.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/963: truncate d13/d14/d15/d67/d73/d100/f135 1175146 0 2023-12-05T09:26:35.999 INFO:tasks.workunit.client.0.smithi067.stdout:5/694: dwrite db/df/d1a/d1d/d20/f51 [0,4194304] 0 2023-12-05T09:26:35.999 INFO:tasks.workunit.client.0.smithi067.stdout:5/695: fsync db/df/d1a/d1d/d20/f42 0 2023-12-05T09:26:35.999 INFO:tasks.workunit.client.0.smithi067.stdout:5/696: fsync db/df/d1a/d1d/d20/f51 0 2023-12-05T09:26:35.999 INFO:tasks.workunit.client.0.smithi067.stdout:5/697: dread - db/df/d35/d63/d75/fdc zero size 2023-12-05T09:26:36.000 INFO:tasks.workunit.client.0.smithi067.stdout:2/617: link d0/d25/d3f/d83/fa0 d0/d25/d34/d4d/d78/fd7 0 2023-12-05T09:26:36.003 INFO:tasks.workunit.client.1.smithi134.stdout:0/964: symlink d13/d14/d15/l145 0 2023-12-05T09:26:36.004 INFO:tasks.workunit.client.1.smithi134.stdout:6/985: dread d4/d39/fb1 [0,4194304] 0 2023-12-05T09:26:36.004 INFO:tasks.workunit.client.1.smithi134.stdout:6/986: dread - d4/f124 zero size 2023-12-05T09:26:36.005 INFO:tasks.workunit.client.1.smithi134.stdout:6/987: creat d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/f144 x:0 0 0 2023-12-05T09:26:36.008 INFO:tasks.workunit.client.0.smithi067.stdout:7/641: dwrite d0/f27 [0,4194304] 0 2023-12-05T09:26:36.008 INFO:tasks.workunit.client.1.smithi134.stdout:0/965: mknod d13/d139/c146 0 2023-12-05T09:26:36.054 INFO:tasks.workunit.client.0.smithi067.stdout:4/682: truncate d0/d1d/f58 1107868 0 2023-12-05T09:26:36.064 INFO:tasks.workunit.client.1.smithi134.stdout:0/966: write d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/d8c/fbb [6874334,114247] 0 2023-12-05T09:26:36.064 INFO:tasks.workunit.client.0.smithi067.stdout:2/618: creat d0/d25/d34/d4d/d54/d90/dcf/fd8 x:0 0 0 2023-12-05T09:26:36.073 INFO:tasks.workunit.client.0.smithi067.stdout:1/726: dwrite d2/d5/d7/d6a/fba [0,4194304] 0 2023-12-05T09:26:36.073 INFO:tasks.workunit.client.0.smithi067.stdout:6/618: dread da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/fcf [0,4194304] 0 2023-12-05T09:26:36.075 INFO:tasks.workunit.client.1.smithi134.stdout:0/967: dread d13/d14/d30/d4b/d66/da0/da2/df2/d127/f110 [0,4194304] 0 2023-12-05T09:26:36.088 INFO:tasks.workunit.client.1.smithi134.stdout:6/988: dwrite d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/f111 [0,4194304] 0 2023-12-05T09:26:36.090 INFO:tasks.workunit.client.1.smithi134.stdout:3/997: dwrite d4/d5/d6f/f5e [0,4194304] 0 2023-12-05T09:26:36.090 INFO:tasks.workunit.client.1.smithi134.stdout:3/998: dread - d4/d1f/d50/db4/d102/dab/ddc/fe7 zero size 2023-12-05T09:26:36.090 INFO:tasks.workunit.client.1.smithi134.stdout:3/999: write d4/d1f/d4e/d6a/f118 [806601,49479] 0 2023-12-05T09:26:36.091 INFO:tasks.workunit.client.0.smithi067.stdout:7/642: dwrite d0/f4c [0,4194304] 0 2023-12-05T09:26:36.093 INFO:tasks.workunit.client.0.smithi067.stdout:9/900: dwrite d1b/d25/d5b/d62/fdc [0,4194304] 0 2023-12-05T09:26:36.094 INFO:tasks.workunit.client.0.smithi067.stdout:9/901: fdatasync d1b/d25/d54/d5c/d81/d96/fe6 0 2023-12-05T09:26:36.094 INFO:tasks.workunit.client.0.smithi067.stdout:9/902: stat d1b/d25/fd9 0 2023-12-05T09:26:36.094 INFO:tasks.workunit.client.0.smithi067.stdout:9/903: stat d1b/d25/df6 0 2023-12-05T09:26:36.098 INFO:tasks.workunit.client.1.smithi134.stdout:0/968: rmdir d13/d14/d30/d4b 39 2023-12-05T09:26:36.101 INFO:tasks.workunit.client.1.smithi134.stdout:0/969: write d13/d14/d30/f88 [1676741,87574] 0 2023-12-05T09:26:36.101 INFO:tasks.workunit.client.1.smithi134.stdout:0/970: chown d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/l6d 6897145 1 2023-12-05T09:26:36.166 INFO:tasks.workunit.client.0.smithi067.stdout:4/683: mknod d0/d1d/d53/da8/da9/d15/dd0/cf5 0 2023-12-05T09:26:36.166 INFO:tasks.workunit.client.0.smithi067.stdout:4/684: chown d0/f4 1 1 2023-12-05T09:26:36.168 INFO:tasks.workunit.client.0.smithi067.stdout:2/619: truncate d0/d25/d9d/f73 4471871 0 2023-12-05T09:26:36.168 INFO:tasks.workunit.client.0.smithi067.stdout:2/620: fdatasync d0/f41 0 2023-12-05T09:26:36.172 INFO:tasks.workunit.client.0.smithi067.stdout:6/619: creat da/d7d/dd7/fdb x:0 0 0 2023-12-05T09:26:36.173 INFO:tasks.workunit.client.0.smithi067.stdout:1/727: mknod d2/d4f/d15/cfd 0 2023-12-05T09:26:36.173 INFO:tasks.workunit.client.1.smithi134.stdout:0/971: dwrite d13/d14/d30/d4b/dc1/f126 [0,4194304] 0 2023-12-05T09:26:36.179 INFO:tasks.workunit.client.1.smithi134.stdout:0/972: symlink d13/d14/d30/d4b/dc1/df8/l147 0 2023-12-05T09:26:36.180 INFO:tasks.workunit.client.0.smithi067.stdout:4/685: mkdir d0/d1d/d2b/df6 0 2023-12-05T09:26:36.182 INFO:tasks.workunit.client.0.smithi067.stdout:2/621: creat d0/d25/d9d/d53/d1e/d8e/fd9 x:0 0 0 2023-12-05T09:26:36.185 INFO:tasks.workunit.client.0.smithi067.stdout:6/620: link da/d10/f5e da/d10/d1e/d69/dcb/fdc 0 2023-12-05T09:26:36.185 INFO:tasks.workunit.client.0.smithi067.stdout:6/621: fdatasync da/d10/f5e 0 2023-12-05T09:26:36.186 INFO:tasks.workunit.client.0.smithi067.stdout:1/728: unlink d2/d3/l1f 0 2023-12-05T09:26:36.188 INFO:tasks.workunit.client.0.smithi067.stdout:7/643: rmdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da9 39 2023-12-05T09:26:36.194 INFO:tasks.workunit.client.0.smithi067.stdout:4/686: creat d0/ff7 x:0 0 0 2023-12-05T09:26:36.194 INFO:tasks.workunit.client.0.smithi067.stdout:6/622: getdents da/d10/d1e/d7f 0 2023-12-05T09:26:36.195 INFO:tasks.workunit.client.0.smithi067.stdout:1/729: write d2/d5/d7/de/d1a/f99 [344492,38984] 0 2023-12-05T09:26:36.198 INFO:tasks.workunit.client.0.smithi067.stdout:7/644: creat d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/dd1/fd5 x:0 0 0 2023-12-05T09:26:36.203 INFO:tasks.workunit.client.0.smithi067.stdout:4/687: creat d0/d1d/d53/da8/da9/d15/dd0/ff8 x:0 0 0 2023-12-05T09:26:36.204 INFO:tasks.workunit.client.0.smithi067.stdout:6/623: mkdir da/d10/d1e/d17/d2f/d2c/d34/d3b/ddd 0 2023-12-05T09:26:36.206 INFO:tasks.workunit.client.0.smithi067.stdout:7/645: rename d0/d9/d40/d7a/dad/fb2 to d0/d9/d10/d37/d38/d64/d34/d67/d72/fd6 0 2023-12-05T09:26:36.210 INFO:tasks.workunit.client.0.smithi067.stdout:6/624: getdents da/d10/d1e/d51/d7b 0 2023-12-05T09:26:36.229 INFO:tasks.workunit.client.0.smithi067.stdout:9/904: creat d1b/d3e/f12e x:0 0 0 2023-12-05T09:26:36.236 INFO:tasks.workunit.client.1.smithi134.stdout:0/973: dwrite d13/d14/d15/fa8 [0,4194304] 0 2023-12-05T09:26:36.248 INFO:tasks.workunit.client.0.smithi067.stdout:2/622: dwrite d0/d25/f59 [0,4194304] 0 2023-12-05T09:26:36.248 INFO:tasks.workunit.client.0.smithi067.stdout:2/623: write d0/d25/d34/d4a/f8d [1042395,75573] 0 2023-12-05T09:26:36.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/624: fdatasync d0/d25/d9d/d53/d1e/d8e/dd0/d39/f75 0 2023-12-05T09:26:36.253 INFO:tasks.workunit.client.0.smithi067.stdout:2/625: creat d0/d25/d9d/d53/d92/fda x:0 0 0 2023-12-05T09:26:36.257 INFO:tasks.workunit.client.0.smithi067.stdout:9/905: dread d1b/dd3/d6c/fa5 [0,4194304] 0 2023-12-05T09:26:36.260 INFO:tasks.workunit.client.1.smithi134.stdout:6/989: sync 2023-12-05T09:26:36.265 INFO:tasks.workunit.client.0.smithi067.stdout:9/906: dread d1b/fa2 [0,4194304] 0 2023-12-05T09:26:36.265 INFO:tasks.workunit.client.0.smithi067.stdout:9/907: chown d1b/dd3/d82/fb2 1254203 1 2023-12-05T09:26:36.267 INFO:tasks.workunit.client.0.smithi067.stdout:2/626: link d0/d25/d9d/d53/d1e/d7f/c9f d0/cdb 0 2023-12-05T09:26:36.271 INFO:tasks.workunit.client.0.smithi067.stdout:2/627: link d0/d25/d9d/d53/d1e/d8e/dd0/d84/fa2 d0/d25/d3a/fdc 0 2023-12-05T09:26:36.273 INFO:tasks.workunit.client.0.smithi067.stdout:2/628: symlink d0/d25/d34/d4d/d78/ldd 0 2023-12-05T09:26:36.276 INFO:tasks.workunit.client.0.smithi067.stdout:5/698: symlink db/df/d1a/d1d/lf7 0 2023-12-05T09:26:36.278 INFO:tasks.workunit.client.0.smithi067.stdout:1/730: dwrite d2/d4f/d54/f8c [0,4194304] 0 2023-12-05T09:26:36.285 INFO:tasks.workunit.client.0.smithi067.stdout:5/699: rmdir db/df/d3f/d88/d8d/dd4 0 2023-12-05T09:26:36.289 INFO:tasks.workunit.client.0.smithi067.stdout:9/908: dread d1b/d25/d54/d5c/d81/d96/f9c [0,4194304] 0 2023-12-05T09:26:36.289 INFO:tasks.workunit.client.0.smithi067.stdout:1/731: link d2/d5/d7/de/d19/d49/d5f/ff5 d2/d4f/d14/ffe 0 2023-12-05T09:26:36.294 INFO:tasks.workunit.client.0.smithi067.stdout:6/625: rename da/d10/d1e/d17/d2f/d2c/d34 to da/dde 0 2023-12-05T09:26:36.295 INFO:tasks.workunit.client.0.smithi067.stdout:5/700: mknod db/df/d82/cf8 0 2023-12-05T09:26:36.295 INFO:tasks.workunit.client.0.smithi067.stdout:5/701: chown db/df/d35/d63/d75/fb2 12789211 1 2023-12-05T09:26:36.297 INFO:tasks.workunit.client.0.smithi067.stdout:9/909: dread d1b/d25/d5b/d62/fb0 [0,4194304] 0 2023-12-05T09:26:36.305 INFO:tasks.workunit.client.0.smithi067.stdout:3/638: sync 2023-12-05T09:26:36.305 INFO:tasks.workunit.client.0.smithi067.stdout:2/629: rename d0/d25/d3f/d83/l9c to d0/d25/d9d/lde 0 2023-12-05T09:26:36.305 INFO:tasks.workunit.client.0.smithi067.stdout:2/630: chown d0/d25/d9d/d53/c13 4067927 1 2023-12-05T09:26:36.305 INFO:tasks.workunit.client.0.smithi067.stdout:0/835: sync 2023-12-05T09:26:36.305 INFO:tasks.workunit.client.0.smithi067.stdout:8/710: sync 2023-12-05T09:26:36.305 INFO:tasks.workunit.client.0.smithi067.stdout:8/711: getdents d5/dc/d1a/d20/d2d/d41/db2/dc1 0 2023-12-05T09:26:36.311 INFO:tasks.workunit.client.0.smithi067.stdout:7/646: dread d0/d9/d10/f32 [0,4194304] 0 2023-12-05T09:26:36.311 INFO:tasks.workunit.client.0.smithi067.stdout:0/836: mkdir d3/d7/d3c/d6c/d76/da7/dec/d12e 0 2023-12-05T09:26:36.311 INFO:tasks.workunit.client.0.smithi067.stdout:7/647: stat d0/d9/d40/d7a/dad/dc2/f66 0 2023-12-05T09:26:36.311 INFO:tasks.workunit.client.0.smithi067.stdout:7/648: truncate d0/d9/d40/d7a/dad/fcd 615094 0 2023-12-05T09:26:36.311 INFO:tasks.workunit.client.0.smithi067.stdout:7/649: stat d0/f76 0 2023-12-05T09:26:36.311 INFO:tasks.workunit.client.0.smithi067.stdout:7/650: fdatasync d0/d9/d40/d7a/dad/fb9 0 2023-12-05T09:26:36.312 INFO:tasks.workunit.client.0.smithi067.stdout:8/712: unlink d5/dc/d1a/d20/d58/d90/dba/cc2 0 2023-12-05T09:26:36.321 INFO:tasks.workunit.client.0.smithi067.stdout:6/626: dread da/d10/d1e/d17/d2f/d72/f85 [0,4194304] 0 2023-12-05T09:26:36.324 INFO:tasks.workunit.client.0.smithi067.stdout:3/639: dread d9/da/d15/d17/d1a/d51/d66/fd9 [0,4194304] 0 2023-12-05T09:26:36.324 INFO:tasks.workunit.client.0.smithi067.stdout:3/640: fsync f4 0 2023-12-05T09:26:36.325 INFO:tasks.workunit.client.0.smithi067.stdout:7/651: symlink d0/d9/d10/d1d/ld7 0 2023-12-05T09:26:36.325 INFO:tasks.workunit.client.0.smithi067.stdout:0/837: truncate d3/d7/fc 3643683 0 2023-12-05T09:26:36.328 INFO:tasks.workunit.client.0.smithi067.stdout:6/627: rename da/d10/d1e/d69/l96 to da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/ldf 0 2023-12-05T09:26:36.330 INFO:tasks.workunit.client.0.smithi067.stdout:7/652: creat d0/d9/d10/d37/d38/db7/fd8 x:0 0 0 2023-12-05T09:26:36.331 INFO:tasks.workunit.client.0.smithi067.stdout:7/653: rmdir d0/d9/d40/d7a 39 2023-12-05T09:26:36.334 INFO:tasks.workunit.client.0.smithi067.stdout:6/628: read da/d10/d1e/d17/d2f/d3f/d92/fa2 [148213,125585] 0 2023-12-05T09:26:36.335 INFO:tasks.workunit.client.0.smithi067.stdout:3/641: rename d9/fe to d9/da/d15/d17/d1a/d51/dcd/fe3 0 2023-12-05T09:26:36.335 INFO:tasks.workunit.client.0.smithi067.stdout:4/688: dwrite d0/d1d/d53/da8/da9/d15/f9c [0,4194304] 0 2023-12-05T09:26:36.336 INFO:tasks.workunit.client.0.smithi067.stdout:7/654: unlink d0/d9/d40/d7a/c7d 0 2023-12-05T09:26:36.338 INFO:tasks.workunit.client.1.smithi134.stdout:6/990: dwrite d4/d39/d42/d4f/d6d/d3a/f3d [0,4194304] 0 2023-12-05T09:26:36.340 INFO:tasks.workunit.client.0.smithi067.stdout:3/642: creat d9/da/d15/d17/fe4 x:0 0 0 2023-12-05T09:26:36.340 INFO:tasks.workunit.client.0.smithi067.stdout:6/629: creat da/d10/d1e/d17/fe0 x:0 0 0 2023-12-05T09:26:36.344 INFO:tasks.workunit.client.0.smithi067.stdout:3/643: creat d9/d24/db8/fe5 x:0 0 0 2023-12-05T09:26:36.344 INFO:tasks.workunit.client.0.smithi067.stdout:3/644: fdatasync d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/f8d 0 2023-12-05T09:26:36.344 INFO:tasks.workunit.client.1.smithi134.stdout:6/991: creat d4/d39/d42/d4f/d6d/d3a/da/df9/f145 x:0 0 0 2023-12-05T09:26:36.345 INFO:tasks.workunit.client.0.smithi067.stdout:6/630: symlink da/d10/d1e/d17/d2f/d59/le1 0 2023-12-05T09:26:36.345 INFO:tasks.workunit.client.0.smithi067.stdout:6/631: readlink da/d10/d1e/d17/d2f/l60 0 2023-12-05T09:26:36.345 INFO:tasks.workunit.client.0.smithi067.stdout:6/632: stat da/dde/d3b/c4e 0 2023-12-05T09:26:36.348 INFO:tasks.workunit.client.0.smithi067.stdout:3/645: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/fe6 x:0 0 0 2023-12-05T09:26:36.348 INFO:tasks.workunit.client.0.smithi067.stdout:3/646: dread - d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/fc9 zero size 2023-12-05T09:26:36.354 INFO:tasks.workunit.client.1.smithi134.stdout:6/992: rename d4/d39/d42/d4f/d6d/d3a/da/de3 to d4/d39/d42/d4f/d6d/d9f/dc4/d146 0 2023-12-05T09:26:36.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/993: mkdir d4/d39/d42/d4f/d6d/d3a/da/d11c/d59/d147 0 2023-12-05T09:26:36.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/994: write d4/d39/f34 [277126,98877] 0 2023-12-05T09:26:36.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/995: dread - d4/fa6 zero size 2023-12-05T09:26:36.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/996: read - d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/f142 zero size 2023-12-05T09:26:36.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/997: write d4/d39/d42/d4f/d6d/d3a/da/da4/ddb/de8/f10e [525433,61673] 0 2023-12-05T09:26:36.358 INFO:tasks.workunit.client.1.smithi134.stdout:6/998: rename d4/d39/d42/d4f/d6d/d3a/da/lf3 to d4/d39/d42/d4f/d6d/d3a/da/d11c/dbc/d112/dba/d114/d119/d11d/l148 0 2023-12-05T09:26:36.361 INFO:tasks.workunit.client.0.smithi067.stdout:4/689: read d0/d9/f91 [232429,7122] 0 2023-12-05T09:26:36.361 INFO:tasks.workunit.client.0.smithi067.stdout:4/690: write d0/d1d/d25/d2c/d34/d4e/d5a/d88/fb8 [278777,41225] 0 2023-12-05T09:26:36.361 INFO:tasks.workunit.client.0.smithi067.stdout:8/713: dread d5/d9d/dab/f7b [0,4194304] 0 2023-12-05T09:26:36.361 INFO:tasks.workunit.client.0.smithi067.stdout:8/714: write d5/dc/d1a/d20/fbd [3139528,23182] 0 2023-12-05T09:26:36.361 INFO:tasks.workunit.client.0.smithi067.stdout:8/715: read - d5/dc/d1a/d62/fc7 zero size 2023-12-05T09:26:36.362 INFO:tasks.workunit.client.0.smithi067.stdout:8/716: creat d5/da/fd2 x:0 0 0 2023-12-05T09:26:36.362 INFO:tasks.workunit.client.1.smithi134.stdout:6/999: link d4/d39/d42/d4f/d6d/d137/cd6 d4/d39/d42/d4f/d6d/c149 0 2023-12-05T09:26:36.362 INFO:tasks.workunit.client.0.smithi067.stdout:8/717: creat d5/dc/d1a/d20/d58/fd3 x:0 0 0 2023-12-05T09:26:36.363 INFO:tasks.workunit.client.0.smithi067.stdout:4/691: mkdir d0/d1d/d2a/df9 0 2023-12-05T09:26:36.368 INFO:tasks.workunit.client.0.smithi067.stdout:8/718: creat d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/fd4 x:0 0 0 2023-12-05T09:26:36.368 INFO:tasks.workunit.client.0.smithi067.stdout:8/719: fdatasync d5/dc/f96 0 2023-12-05T09:26:36.368 INFO:tasks.workunit.client.0.smithi067.stdout:8/720: chown d5/dc/d1a/d20/d2d/d8a/db5 36289670 1 2023-12-05T09:26:36.368 INFO:tasks.workunit.client.0.smithi067.stdout:8/721: write d5/dc/d1a/d20/f22 [8211522,75295] 0 2023-12-05T09:26:36.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:35 smithi067 ceph-mon[107174]: pgmap v33: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 154 MiB/s rd, 200 MiB/s wr, 295 op/s 2023-12-05T09:26:36.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:35 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:26:36.374 INFO:tasks.workunit.client.0.smithi067.stdout:4/692: unlink d0/d1d/d3c/d51/c7a 0 2023-12-05T09:26:36.374 INFO:tasks.workunit.client.0.smithi067.stdout:4/693: stat d0/d1d/d25/d2c/d34/d4e/ce1 0 2023-12-05T09:26:36.374 INFO:tasks.workunit.client.0.smithi067.stdout:1/732: dwrite d2/d3/da6/dbb/fbc [0,4194304] 0 2023-12-05T09:26:36.374 INFO:tasks.workunit.client.0.smithi067.stdout:8/722: creat d5/dc/d1a/d20/d2d/d7f/fd5 x:0 0 0 2023-12-05T09:26:36.374 INFO:tasks.workunit.client.0.smithi067.stdout:8/723: read d5/dc/f6c [5200,92325] 0 2023-12-05T09:26:36.375 INFO:tasks.workunit.client.0.smithi067.stdout:1/733: mknod d2/d4f/d15/d74/cff 0 2023-12-05T09:26:36.377 INFO:tasks.workunit.client.0.smithi067.stdout:8/724: unlink d5/da/d30/d7c/fbb 0 2023-12-05T09:26:36.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:35 smithi134 ceph-mon[116304]: pgmap v33: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 154 MiB/s rd, 200 MiB/s wr, 295 op/s 2023-12-05T09:26:36.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:35 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:26:36.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/725: getdents d5/d3b/db3 0 2023-12-05T09:26:36.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/726: chown d5/dc/d1a/d62/d7e/l8e 56 1 2023-12-05T09:26:36.378 INFO:tasks.workunit.client.0.smithi067.stdout:5/702: dwrite db/df/d1a/f6a [0,4194304] 0 2023-12-05T09:26:36.379 INFO:tasks.workunit.client.1.smithi134.stdout:0/974: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/f44 [0,4194304] 0 2023-12-05T09:26:36.382 INFO:tasks.workunit.client.0.smithi067.stdout:8/727: mknod d5/dc/d1a/d20/d2d/d8a/cd6 0 2023-12-05T09:26:36.393 INFO:tasks.workunit.client.0.smithi067.stdout:8/728: mknod d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/cd7 0 2023-12-05T09:26:36.395 INFO:tasks.workunit.client.1.smithi134.stdout:0/975: link d13/d14/d30/d4b/d66/da0/daf/dde/da9/lb7 d13/d14/d30/d4b/d66/da0/da2/l148 0 2023-12-05T09:26:36.398 INFO:tasks.workunit.client.0.smithi067.stdout:8/729: write d5/dc/d1a/d20/f72 [1447141,117201] 0 2023-12-05T09:26:36.398 INFO:tasks.workunit.client.0.smithi067.stdout:8/730: stat d5/dc/d1a/d20/l8c 0 2023-12-05T09:26:36.398 INFO:tasks.workunit.client.0.smithi067.stdout:8/731: truncate d5/dc/d1a/d20/fbd 3464389 0 2023-12-05T09:26:36.398 INFO:tasks.workunit.client.0.smithi067.stdout:8/732: chown d5/da/fcd 1282900 1 2023-12-05T09:26:36.401 INFO:tasks.workunit.client.0.smithi067.stdout:4/694: dread d0/d1d/d25/d32/f8f [0,4194304] 0 2023-12-05T09:26:36.401 INFO:tasks.workunit.client.0.smithi067.stdout:0/838: dwrite d3/d7/d3c/d67/d59/d4e/db2/f113 [4194304,4194304] 0 2023-12-05T09:26:36.401 INFO:tasks.workunit.client.0.smithi067.stdout:0/839: fdatasync d3/d7/d3c/d66/fa9 0 2023-12-05T09:26:36.403 INFO:tasks.workunit.client.0.smithi067.stdout:8/733: stat d5/dc/d1a/d20/l34 0 2023-12-05T09:26:36.406 INFO:tasks.workunit.client.0.smithi067.stdout:4/695: symlink d0/d1d/d4d/d8d/lfa 0 2023-12-05T09:26:36.410 INFO:tasks.workunit.client.0.smithi067.stdout:8/734: link d5/da/c43 d5/da/cd8 0 2023-12-05T09:26:36.416 INFO:tasks.workunit.client.0.smithi067.stdout:4/696: mknod d0/d1d/d2b/dd6/cfb 0 2023-12-05T09:26:36.416 INFO:tasks.workunit.client.0.smithi067.stdout:8/735: mkdir d5/d9d/dd9 0 2023-12-05T09:26:36.416 INFO:tasks.workunit.client.0.smithi067.stdout:8/736: readlink d5/dc/d1a/d20/lbe 0 2023-12-05T09:26:36.416 INFO:tasks.workunit.client.0.smithi067.stdout:8/737: readlink d5/dc/d1a/l4a 0 2023-12-05T09:26:36.416 INFO:tasks.workunit.client.0.smithi067.stdout:8/738: fsync d5/dc/d1a/d20/d2d/d41/db2/fb7 0 2023-12-05T09:26:36.416 INFO:tasks.workunit.client.0.smithi067.stdout:3/647: dread d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/fde [0,4194304] 0 2023-12-05T09:26:36.420 INFO:tasks.workunit.client.0.smithi067.stdout:8/739: rename d5/dc/c1e to d5/dc/d1a/d62/cda 0 2023-12-05T09:26:36.421 INFO:tasks.workunit.client.0.smithi067.stdout:8/740: readlink d5/l99 0 2023-12-05T09:26:36.422 INFO:tasks.workunit.client.0.smithi067.stdout:3/648: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/fe7 x:0 0 0 2023-12-05T09:26:36.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/741: creat d5/d6a/dc3/fdb x:0 0 0 2023-12-05T09:26:36.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/742: dread - d5/dc/d1a/d20/d3e/dbf/fc4 zero size 2023-12-05T09:26:36.426 INFO:tasks.workunit.client.0.smithi067.stdout:8/743: mknod d5/dc/d1a/cdc 0 2023-12-05T09:26:36.435 INFO:tasks.workunit.client.0.smithi067.stdout:8/744: dread d5/dc/d1a/fcf [0,4194304] 0 2023-12-05T09:26:36.440 INFO:tasks.workunit.client.0.smithi067.stdout:7/655: dwrite d0/d9/d10/d37/f2a [0,4194304] 0 2023-12-05T09:26:36.441 INFO:tasks.workunit.client.0.smithi067.stdout:6/633: dwrite da/d10/d1e/d17/d2f/d1f/fd0 [0,4194304] 0 2023-12-05T09:26:36.445 INFO:tasks.workunit.client.0.smithi067.stdout:6/634: symlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/le2 0 2023-12-05T09:26:36.446 INFO:tasks.workunit.client.0.smithi067.stdout:1/734: dread d2/d4f/d54/fe4 [0,4194304] 0 2023-12-05T09:26:36.446 INFO:tasks.workunit.client.0.smithi067.stdout:1/735: truncate d2/d5/d7/de/d19/d71/fb5 5156075 0 2023-12-05T09:26:36.447 INFO:tasks.workunit.client.0.smithi067.stdout:6/635: symlink da/d10/d1e/d69/dcb/le3 0 2023-12-05T09:26:36.448 INFO:tasks.workunit.client.0.smithi067.stdout:0/840: write d3/d7/d3c/f47 [712679,2830] 0 2023-12-05T09:26:36.448 INFO:tasks.workunit.client.0.smithi067.stdout:0/841: fsync d3/f31 0 2023-12-05T09:26:36.448 INFO:tasks.workunit.client.0.smithi067.stdout:1/736: mkdir d2/d3/da6/dbd/dd8/d100 0 2023-12-05T09:26:36.450 INFO:tasks.workunit.client.0.smithi067.stdout:6/636: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/fe4 x:0 0 0 2023-12-05T09:26:36.450 INFO:tasks.workunit.client.0.smithi067.stdout:2/631: dwrite d0/fd [0,4194304] 0 2023-12-05T09:26:36.451 INFO:tasks.workunit.client.1.smithi134.stdout:0/976: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/da9/f133 [0,4194304] 0 2023-12-05T09:26:36.453 INFO:tasks.workunit.client.0.smithi067.stdout:0/842: link d3/d6b/f120 d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/db4/f12f 0 2023-12-05T09:26:36.458 INFO:tasks.workunit.client.0.smithi067.stdout:5/703: dwrite db/df/d36/d57/f9c [0,4194304] 0 2023-12-05T09:26:36.459 INFO:tasks.workunit.client.0.smithi067.stdout:0/843: rename d3/d7/d3c/d67/d59/l104 to d3/d7/d3c/ddb/de5/l130 0 2023-12-05T09:26:36.470 INFO:tasks.workunit.client.0.smithi067.stdout:7/656: dread d0/f4c [0,4194304] 0 2023-12-05T09:26:36.475 INFO:tasks.workunit.client.0.smithi067.stdout:5/704: fsync db/df/d3f/d88/fc5 0 2023-12-05T09:26:36.477 INFO:tasks.workunit.client.0.smithi067.stdout:0/844: unlink d3/d7/d3c/d6c/d76/da7/f127 0 2023-12-05T09:26:36.479 INFO:tasks.workunit.client.0.smithi067.stdout:2/632: write d0/d25/d34/d4d/f81 [511798,82706] 0 2023-12-05T09:26:36.479 INFO:tasks.workunit.client.0.smithi067.stdout:2/633: write d0/f7a [947729,127489] 0 2023-12-05T09:26:36.484 INFO:tasks.workunit.client.0.smithi067.stdout:4/697: dwrite d0/d1d/d2b/fca [0,4194304] 0 2023-12-05T09:26:36.485 INFO:tasks.workunit.client.0.smithi067.stdout:0/845: creat d3/d7/d3c/d67/d59/d4e/f131 x:0 0 0 2023-12-05T09:26:36.490 INFO:tasks.workunit.client.0.smithi067.stdout:2/634: symlink d0/d25/d3a/ldf 0 2023-12-05T09:26:36.494 INFO:tasks.workunit.client.0.smithi067.stdout:5/705: dread db/df/db5/fe0 [0,4194304] 0 2023-12-05T09:26:36.494 INFO:tasks.workunit.client.0.smithi067.stdout:5/706: getdents db/df/d3f/df6 0 2023-12-05T09:26:36.497 INFO:tasks.workunit.client.0.smithi067.stdout:4/698: truncate d0/d1d/d25/f9a 2806312 0 2023-12-05T09:26:36.506 INFO:tasks.workunit.client.0.smithi067.stdout:0/846: rename d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/c9e to d3/d7/d3c/d67/d59/d4e/d94/c132 0 2023-12-05T09:26:36.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/649: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/fdd [0,4194304] 0 2023-12-05T09:26:36.516 INFO:tasks.workunit.client.0.smithi067.stdout:4/699: symlink d0/d1d/d53/d82/lfc 0 2023-12-05T09:26:36.518 INFO:tasks.workunit.client.0.smithi067.stdout:4/700: getdents d0/d1d/d53/da8 0 2023-12-05T09:26:36.520 INFO:tasks.workunit.client.0.smithi067.stdout:2/635: dread d0/fe [0,4194304] 0 2023-12-05T09:26:36.520 INFO:tasks.workunit.client.0.smithi067.stdout:2/636: getdents d0/d25/d9d/d53/d1e/d8e/dd0/da3 0 2023-12-05T09:26:36.521 INFO:tasks.workunit.client.0.smithi067.stdout:8/745: fdatasync d5/dc/d1a/d20/fbd 0 2023-12-05T09:26:36.523 INFO:tasks.workunit.client.0.smithi067.stdout:5/707: dread db/df/d1a/d1d/d20/f2a [0,4194304] 0 2023-12-05T09:26:36.524 INFO:tasks.workunit.client.0.smithi067.stdout:5/708: chown db/df/d3f/d88 5464 1 2023-12-05T09:26:36.524 INFO:tasks.workunit.client.0.smithi067.stdout:5/709: truncate db/df/d1a/d1d/d20/f2d 6644925 0 2023-12-05T09:26:36.525 INFO:tasks.workunit.client.0.smithi067.stdout:7/657: dwrite d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/fc8 [0,4194304] 0 2023-12-05T09:26:36.526 INFO:tasks.workunit.client.0.smithi067.stdout:4/701: creat d0/d1d/d25/ffd x:0 0 0 2023-12-05T09:26:36.526 INFO:tasks.workunit.client.0.smithi067.stdout:4/702: chown d0/d1d/d2a/df9 232 1 2023-12-05T09:26:36.528 INFO:tasks.workunit.client.0.smithi067.stdout:2/637: creat d0/d25/d34/d4d/d72/fe0 x:0 0 0 2023-12-05T09:26:36.531 INFO:tasks.workunit.client.0.smithi067.stdout:1/737: dwrite d2/d3/f21 [0,4194304] 0 2023-12-05T09:26:36.531 INFO:tasks.workunit.client.0.smithi067.stdout:1/738: stat d2/d5/d7/de/d19/d8f/d98/ffc 0 2023-12-05T09:26:36.531 INFO:tasks.workunit.client.0.smithi067.stdout:1/739: write d2/d3/f3d [3223928,126117] 0 2023-12-05T09:26:36.531 INFO:tasks.workunit.client.0.smithi067.stdout:8/746: creat d5/d3b/fdd x:0 0 0 2023-12-05T09:26:36.534 INFO:tasks.workunit.client.0.smithi067.stdout:6/637: dwrite da/d10/d1e/d17/d2f/d72/f85 [4194304,4194304] 0 2023-12-05T09:26:36.538 INFO:tasks.workunit.client.0.smithi067.stdout:0/847: dread d3/d7/d3c/f47 [0,4194304] 0 2023-12-05T09:26:36.539 INFO:tasks.workunit.client.0.smithi067.stdout:1/740: write d2/d5/f6f [1425013,112414] 0 2023-12-05T09:26:36.539 INFO:tasks.workunit.client.0.smithi067.stdout:1/741: fsync d2/d3/fc0 0 2023-12-05T09:26:36.545 INFO:tasks.workunit.client.1.smithi134.stdout:0/977: sync 2023-12-05T09:26:36.597 INFO:tasks.workunit.client.0.smithi067.stdout:7/658: unlink d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/fc8 0 2023-12-05T09:26:36.599 INFO:tasks.workunit.client.0.smithi067.stdout:1/742: dread d2/d5/d50/f7f [0,4194304] 0 2023-12-05T09:26:36.601 INFO:tasks.workunit.client.0.smithi067.stdout:4/703: truncate d0/f4 1174829 0 2023-12-05T09:26:36.601 INFO:tasks.workunit.client.0.smithi067.stdout:4/704: creat d0/d1d/d2b/ffe x:0 0 0 2023-12-05T09:26:36.607 INFO:tasks.workunit.client.0.smithi067.stdout:2/638: creat d0/d25/d34/d4d/db0/dbf/fe1 x:0 0 0 2023-12-05T09:26:36.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/710: symlink db/df/d82/lf9 0 2023-12-05T09:26:36.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/711: write db/df/d36/f83 [803200,83918] 0 2023-12-05T09:26:36.609 INFO:tasks.workunit.client.0.smithi067.stdout:5/712: truncate db/df/d1a/d1d/fe8 296414 0 2023-12-05T09:26:36.609 INFO:tasks.workunit.client.0.smithi067.stdout:6/638: creat da/fe5 x:0 0 0 2023-12-05T09:26:36.613 INFO:tasks.workunit.client.0.smithi067.stdout:0/848: mknod d3/d7/dd7/c133 0 2023-12-05T09:26:36.615 INFO:tasks.workunit.client.0.smithi067.stdout:7/659: creat d0/d9/d10/d37/d38/d64/d34/fd9 x:0 0 0 2023-12-05T09:26:36.615 INFO:tasks.workunit.client.0.smithi067.stdout:7/660: read - d0/fbf zero size 2023-12-05T09:26:36.617 INFO:tasks.workunit.client.0.smithi067.stdout:1/743: rename d2/d3/l4a to d2/d4f/d14/d20/d83/l101 0 2023-12-05T09:26:36.617 INFO:tasks.workunit.client.0.smithi067.stdout:1/744: fdatasync d2/d4f/d54/d70/db4/fce 0 2023-12-05T09:26:36.618 INFO:tasks.workunit.client.0.smithi067.stdout:5/713: dread db/df/d35/f76 [0,4194304] 0 2023-12-05T09:26:36.627 INFO:tasks.workunit.client.0.smithi067.stdout:0/849: symlink d3/d7/d3c/d6c/l134 0 2023-12-05T09:26:36.627 INFO:tasks.workunit.client.0.smithi067.stdout:4/705: rename d0/d1d/d25/ffd to d0/d1d/d25/d2c/d34/d4e/d5a/d88/fff 0 2023-12-05T09:26:36.635 INFO:tasks.workunit.client.0.smithi067.stdout:1/745: symlink d2/d5/d7/de/d19/d49/l102 0 2023-12-05T09:26:36.636 INFO:tasks.workunit.client.0.smithi067.stdout:7/661: read d0/d9/d10/f35 [1807858,2910] 0 2023-12-05T09:26:36.644 INFO:tasks.workunit.client.0.smithi067.stdout:1/746: rename d2/d4f/d14/d48/ffb to d2/d4f/d15/f103 0 2023-12-05T09:26:36.644 INFO:tasks.workunit.client.0.smithi067.stdout:1/747: write d2/d4f/d14/d20/d4c/f65 [1249476,71273] 0 2023-12-05T09:26:36.650 INFO:tasks.workunit.client.0.smithi067.stdout:1/748: unlink d2/l6 0 2023-12-05T09:26:36.651 INFO:tasks.workunit.client.0.smithi067.stdout:1/749: chown d2/d4f/d14/d20/d83/cb6 192533014 1 2023-12-05T09:26:36.651 INFO:tasks.workunit.client.0.smithi067.stdout:1/750: fdatasync d2/d5/d7/de/d1a/f44 0 2023-12-05T09:26:36.651 INFO:tasks.workunit.client.0.smithi067.stdout:1/751: write d2/d3/fc0 [370384,108266] 0 2023-12-05T09:26:36.654 INFO:tasks.workunit.client.0.smithi067.stdout:4/706: dread d0/d1d/d25/d32/f65 [0,4194304] 0 2023-12-05T09:26:36.654 INFO:tasks.workunit.client.0.smithi067.stdout:4/707: chown d0/d1d/d25/d2c 47 1 2023-12-05T09:26:36.655 INFO:tasks.workunit.client.0.smithi067.stdout:1/752: creat d2/d4f/f104 x:0 0 0 2023-12-05T09:26:36.661 INFO:tasks.workunit.client.1.smithi134.stdout:0/978: dwrite f7 [0,4194304] 0 2023-12-05T09:26:36.664 INFO:tasks.workunit.client.1.smithi134.stdout:0/979: rename d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/ce5 to d13/d14/d30/c149 0 2023-12-05T09:26:36.664 INFO:tasks.workunit.client.1.smithi134.stdout:0/980: fdatasync d13/d14/d15/d67/d73/f81 0 2023-12-05T09:26:36.664 INFO:tasks.workunit.client.1.smithi134.stdout:0/981: readlink d13/d14/d15/d93/l13e 0 2023-12-05T09:26:36.676 INFO:tasks.workunit.client.0.smithi067.stdout:1/753: write d2/d3/da6/fb1 [3630927,3872] 0 2023-12-05T09:26:36.676 INFO:tasks.workunit.client.0.smithi067.stdout:1/754: chown d2/d5/d7/de/d19/d8f/f82 333 1 2023-12-05T09:26:36.676 INFO:tasks.workunit.client.0.smithi067.stdout:5/714: dwrite db/df/d1a/d59/dae/fef [0,4194304] 0 2023-12-05T09:26:36.679 INFO:tasks.workunit.client.1.smithi134.stdout:0/982: read d13/d14/d30/d4b/d66/da0/daf/dde/f44 [1120690,114115] 0 2023-12-05T09:26:36.681 INFO:tasks.workunit.client.1.smithi134.stdout:0/983: rmdir d13/d14/d30/d4b/d66/da0/da2/df2 39 2023-12-05T09:26:36.682 INFO:tasks.workunit.client.1.smithi134.stdout:0/984: write d13/d14/d30/d4b/d66/da0/daf/dce/d86/f10c [232774,116010] 0 2023-12-05T09:26:36.682 INFO:tasks.workunit.client.1.smithi134.stdout:0/985: fdatasync d13/d14/d15/d67/f7a 0 2023-12-05T09:26:36.683 INFO:tasks.workunit.client.0.smithi067.stdout:1/755: symlink d2/d4f/d14/l105 0 2023-12-05T09:26:36.683 INFO:tasks.workunit.client.0.smithi067.stdout:1/756: fdatasync d2/d4f/d15/d60/d68/f75 0 2023-12-05T09:26:36.684 INFO:tasks.workunit.client.0.smithi067.stdout:1/757: mknod d2/d5/d50/c106 0 2023-12-05T09:26:36.686 INFO:tasks.workunit.client.0.smithi067.stdout:1/758: mknod d2/d4f/d15/c107 0 2023-12-05T09:26:36.696 INFO:tasks.workunit.client.1.smithi134.stdout:0/986: dread d13/d14/d15/f21 [4194304,4194304] 0 2023-12-05T09:26:36.696 INFO:tasks.workunit.client.1.smithi134.stdout:0/987: creat d13/d14/d30/d4b/d66/da0/daf/f14a x:0 0 0 2023-12-05T09:26:36.699 INFO:tasks.workunit.client.0.smithi067.stdout:4/708: dwrite d0/d1d/d25/d32/f89 [0,4194304] 0 2023-12-05T09:26:36.702 INFO:tasks.workunit.client.0.smithi067.stdout:4/709: mkdir d0/d1d/d100 0 2023-12-05T09:26:36.702 INFO:tasks.workunit.client.0.smithi067.stdout:4/710: write d0/d1d/d25/d32/f44 [1927268,117933] 0 2023-12-05T09:26:36.712 INFO:tasks.workunit.client.1.smithi134.stdout:0/988: dread d13/d14/d30/d4b/dc1/f126 [0,4194304] 0 2023-12-05T09:26:36.717 INFO:tasks.workunit.client.0.smithi067.stdout:2/639: dwrite d0/d25/d34/d4a/f52 [0,4194304] 0 2023-12-05T09:26:36.742 INFO:tasks.workunit.client.0.smithi067.stdout:1/759: dwrite d2/d4f/d14/d20/d4c/f65 [0,4194304] 0 2023-12-05T09:26:36.742 INFO:tasks.workunit.client.0.smithi067.stdout:1/760: getdents d2/d3/da6/dbb/dd1/de3 0 2023-12-05T09:26:36.751 INFO:tasks.workunit.client.1.smithi134.stdout:0/989: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/d8c/ff0 [0,4194304] 0 2023-12-05T09:26:36.752 INFO:tasks.workunit.client.1.smithi134.stdout:0/990: truncate d13/d14/d30/d4b/dc1/f11a 2985259 0 2023-12-05T09:26:36.761 INFO:tasks.workunit.client.0.smithi067.stdout:1/761: write d2/d4f/d54/fe4 [3734981,117635] 0 2023-12-05T09:26:36.763 INFO:tasks.workunit.client.0.smithi067.stdout:1/762: mknod d2/d5/d7/d6a/db7/c108 0 2023-12-05T09:26:36.771 INFO:tasks.workunit.client.1.smithi134.stdout:0/991: dread d13/d14/d30/d4b/d66/da0/fa1 [0,4194304] 0 2023-12-05T09:26:36.772 INFO:tasks.workunit.client.1.smithi134.stdout:0/992: getdents d13/d14/d30/d4b/d66/da0/daf/dde 0 2023-12-05T09:26:36.801 INFO:tasks.workunit.client.0.smithi067.stdout:0/850: dwrite d3/d7/d3c/d67/fc6 [0,4194304] 0 2023-12-05T09:26:36.804 INFO:tasks.workunit.client.0.smithi067.stdout:6/639: dwrite da/d10/d1e/d17/fe0 [0,4194304] 0 2023-12-05T09:26:36.810 INFO:tasks.workunit.client.0.smithi067.stdout:1/763: dwrite d2/d5/d7/de/d19/d8f/d98/ff0 [0,4194304] 0 2023-12-05T09:26:36.812 INFO:tasks.workunit.client.0.smithi067.stdout:0/851: getdents d3/d7/d3c/d67/d59/d4e/d94/d116 0 2023-12-05T09:26:36.812 INFO:tasks.workunit.client.0.smithi067.stdout:0/852: readlink d3/d7/d3c/d6c/lb6 0 2023-12-05T09:26:36.822 INFO:tasks.workunit.client.1.smithi134.stdout:0/993: dwrite d13/d14/d30/d4b/dc1/dda/f124 [0,4194304] 0 2023-12-05T09:26:36.838 INFO:tasks.workunit.client.1.smithi134.stdout:0/994: dread d13/d14/d30/d4b/d66/da0/daf/dde/d9d/fdf [0,4194304] 0 2023-12-05T09:26:36.840 INFO:tasks.workunit.client.1.smithi134.stdout:0/995: mknod d13/d14/d30/d4b/d66/da0/daf/c14b 0 2023-12-05T09:26:36.842 INFO:tasks.workunit.client.1.smithi134.stdout:0/996: creat d13/d14/d30/d4b/d66/da0/daf/dde/df6/f14c x:0 0 0 2023-12-05T09:26:36.845 INFO:tasks.workunit.client.1.smithi134.stdout:0/997: write d13/d14/d15/d67/d73/d100/f135 [581776,99574] 0 2023-12-05T09:26:36.845 INFO:tasks.workunit.client.1.smithi134.stdout:0/998: write d13/d14/d30/d4b/d66/da0/daf/dde/d9d/d12e/d8c/f143 [722690,45403] 0 2023-12-05T09:26:36.849 INFO:tasks.workunit.client.0.smithi067.stdout:5/715: write db/df/d36/f8a [1581842,41503] 0 2023-12-05T09:26:36.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/662: dwrite d0/d9/d10/d1d/f6d [0,4194304] 0 2023-12-05T09:26:36.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/663: chown d0/d9/d10/d37/d38/d64/d54/l69 109 1 2023-12-05T09:26:36.855 INFO:tasks.workunit.client.0.smithi067.stdout:5/716: rename db/df/d1a/d59/cf1 to db/df/d35/d63/cfa 0 2023-12-05T09:26:36.856 INFO:tasks.workunit.client.0.smithi067.stdout:5/717: mknod db/df/d3f/dd9/de7/cfb 0 2023-12-05T09:26:36.861 INFO:tasks.workunit.client.0.smithi067.stdout:2/640: dwrite d0/d25/d9d/d53/d1e/f2d [4194304,4194304] 0 2023-12-05T09:26:36.862 INFO:tasks.workunit.client.0.smithi067.stdout:2/641: mkdir d0/d25/d9d/d53/d1e/d8e/dc4/de2 0 2023-12-05T09:26:36.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/642: creat d0/d25/d34/d4d/d54/fe3 x:0 0 0 2023-12-05T09:26:36.866 INFO:tasks.workunit.client.0.smithi067.stdout:2/643: getdents d0/d25/d9d/d63/d88 0 2023-12-05T09:26:36.866 INFO:tasks.workunit.client.0.smithi067.stdout:9/910: sync 2023-12-05T09:26:36.868 INFO:tasks.workunit.client.0.smithi067.stdout:9/911: symlink d1b/dd3/d6c/l12f 0 2023-12-05T09:26:36.872 INFO:tasks.workunit.client.0.smithi067.stdout:9/912: unlink d1b/dd3/d82/f11f 0 2023-12-05T09:26:36.873 INFO:tasks.workunit.client.0.smithi067.stdout:5/718: dread db/df/f6b [0,4194304] 0 2023-12-05T09:26:36.873 INFO:tasks.workunit.client.0.smithi067.stdout:5/719: fdatasync db/df/d36/f7b 0 2023-12-05T09:26:36.873 INFO:tasks.workunit.client.0.smithi067.stdout:5/720: stat db/df/d35/d63/c81 0 2023-12-05T09:26:36.876 INFO:tasks.workunit.client.0.smithi067.stdout:5/721: getdents db/df/d36/d6c 0 2023-12-05T09:26:36.883 INFO:tasks.workunit.client.0.smithi067.stdout:2/644: write d0/d25/f59 [1363974,11963] 0 2023-12-05T09:26:36.883 INFO:tasks.workunit.client.0.smithi067.stdout:2/645: creat d0/d25/d34/d4d/d54/d90/fe4 x:0 0 0 2023-12-05T09:26:36.884 INFO:tasks.workunit.client.0.smithi067.stdout:0/853: dwrite d3/d7/d3c/d67/d59/d5c/ff1 [0,4194304] 0 2023-12-05T09:26:36.911 INFO:tasks.workunit.client.1.smithi134.stdout:0/999: dwrite d13/d14/d30/d4b/d66/da0/daf/dde/d9d/f122 [4194304,4194304] 0 2023-12-05T09:26:36.911 INFO:tasks.workunit.client.0.smithi067.stdout:2/646: rename d0/d25/d34/fcd to d0/d25/d9d/d53/d92/fe5 0 2023-12-05T09:26:36.912 INFO:tasks.workunit.client.0.smithi067.stdout:0/854: unlink d3/d6b/d6e/c111 0 2023-12-05T09:26:36.912 INFO:tasks.workunit.client.0.smithi067.stdout:2/647: symlink d0/d25/d34/d4d/d78/le6 0 2023-12-05T09:26:36.916 INFO:tasks.workunit.client.0.smithi067.stdout:2/648: rename d0/d25/d34/fa4 to d0/d25/d9d/fe7 0 2023-12-05T09:26:36.917 INFO:tasks.workunit.client.0.smithi067.stdout:2/649: stat d0/d25/d9d/f1b 0 2023-12-05T09:26:36.918 INFO:tasks.workunit.client.0.smithi067.stdout:0/855: rmdir d3/d7/df0 39 2023-12-05T09:26:36.919 INFO:tasks.workunit.client.0.smithi067.stdout:7/664: dwrite d0/d9/f58 [0,4194304] 0 2023-12-05T09:26:36.921 INFO:tasks.workunit.client.0.smithi067.stdout:0/856: write d3/d7/dd7/ff2 [290195,16254] 0 2023-12-05T09:26:36.921 INFO:tasks.workunit.client.0.smithi067.stdout:0/857: dread - d3/d7/d3c/d67/da1/f10b zero size 2023-12-05T09:26:36.921 INFO:tasks.workunit.client.0.smithi067.stdout:0/858: read d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/fc5 [864097,7923] 0 2023-12-05T09:26:36.921 INFO:tasks.workunit.client.0.smithi067.stdout:0/859: creat d3/d6b/dae/f135 x:0 0 0 2023-12-05T09:26:36.921 INFO:tasks.workunit.client.0.smithi067.stdout:2/650: mkdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/de8 0 2023-12-05T09:26:36.921 INFO:tasks.workunit.client.0.smithi067.stdout:0/860: truncate d3/d7/d3c/d67/d59/d5c/ffb 976111 0 2023-12-05T09:26:36.921 INFO:tasks.workunit.client.0.smithi067.stdout:2/651: dread - d0/d25/d34/d4d/d72/fe0 zero size 2023-12-05T09:26:36.922 INFO:tasks.workunit.client.0.smithi067.stdout:0/861: fdatasync d3/d7/d3c/f47 0 2023-12-05T09:26:36.922 INFO:tasks.workunit.client.0.smithi067.stdout:0/862: chown d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/dcf 3 1 2023-12-05T09:26:36.925 INFO:tasks.workunit.client.0.smithi067.stdout:7/665: mkdir d0/d9/d40/d7a/dad/dc2/dda 0 2023-12-05T09:26:36.928 INFO:tasks.workunit.client.0.smithi067.stdout:2/652: mknod d0/d25/d9d/d53/d1e/d8e/dc4/ce9 0 2023-12-05T09:26:36.929 INFO:tasks.workunit.client.1.smithi134.stderr:+ rm -rf -- ./tmp.qjQSx5tmBi 2023-12-05T09:26:36.931 INFO:tasks.workunit.client.0.smithi067.stdout:0/863: symlink d3/d7/d3c/ddb/l136 0 2023-12-05T09:26:36.931 INFO:tasks.workunit.client.0.smithi067.stdout:0/864: readlink d3/d7/d3c/d66/l78 0 2023-12-05T09:26:36.931 INFO:tasks.workunit.client.0.smithi067.stdout:0/865: fsync d3/d7/d3c/d67/d59/d4e/db2/fd4 0 2023-12-05T09:26:36.947 INFO:tasks.workunit.client.0.smithi067.stdout:5/722: dwrite db/df/d1a/d1d/d20/f2d [0,4194304] 0 2023-12-05T09:26:36.951 INFO:tasks.workunit.client.0.smithi067.stdout:9/913: dwrite d1b/d25/d54/ff9 [0,4194304] 0 2023-12-05T09:26:36.952 INFO:tasks.workunit.client.0.smithi067.stdout:5/723: mknod db/df/d3f/cfc 0 2023-12-05T09:26:36.953 INFO:tasks.workunit.client.0.smithi067.stdout:0/866: dread d3/d7/d3c/d67/d59/d5c/ffa [0,4194304] 0 2023-12-05T09:26:36.953 INFO:tasks.workunit.client.0.smithi067.stdout:0/867: chown d3/d7/d3c/d67/d59/d5c/lbd 7 1 2023-12-05T09:26:36.956 INFO:tasks.workunit.client.0.smithi067.stdout:9/914: rmdir d1b/d25/d54/d5c/dc5 39 2023-12-05T09:26:36.958 INFO:tasks.workunit.client.0.smithi067.stdout:5/724: getdents db 0 2023-12-05T09:26:36.960 INFO:tasks.workunit.client.0.smithi067.stdout:9/915: unlink d1b/d25/c2a 0 2023-12-05T09:26:36.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/725: rmdir db/df/d38 39 2023-12-05T09:26:36.961 INFO:tasks.workunit.client.0.smithi067.stdout:5/726: fdatasync db/df/d36/d57/f5d 0 2023-12-05T09:26:36.966 INFO:tasks.workunit.client.0.smithi067.stdout:5/727: truncate db/df/d3f/d88/f62 142079 0 2023-12-05T09:26:36.966 INFO:tasks.workunit.client.0.smithi067.stdout:5/728: dread - db/df/d1a/fec zero size 2023-12-05T09:26:36.982 INFO:tasks.workunit.client.0.smithi067.stdout:5/729: read db/df/d1a/d1d/d20/f42 [1226346,98280] 0 2023-12-05T09:26:36.998 INFO:tasks.workunit.client.0.smithi067.stdout:5/730: write db/df/d1a/d1d/d20/f90 [2725781,118019] 0 2023-12-05T09:26:37.023 INFO:tasks.workunit.client.0.smithi067.stdout:7/666: dwrite d0/fbf [0,4194304] 0 2023-12-05T09:26:37.023 INFO:tasks.workunit.client.0.smithi067.stdout:7/667: write d0/d9/d10/d37/d38/d64/d5a/fa2 [625595,58850] 0 2023-12-05T09:26:37.026 INFO:tasks.workunit.client.0.smithi067.stdout:7/668: symlink d0/d9/d3f/ldb 0 2023-12-05T09:26:37.039 INFO:tasks.workunit.client.0.smithi067.stdout:2/653: dwrite d0/d25/d9d/f76 [0,4194304] 0 2023-12-05T09:26:37.040 INFO:tasks.workunit.client.0.smithi067.stdout:2/654: write d0/d25/d34/d4d/d54/d90/fe4 [294232,119303] 0 2023-12-05T09:26:37.040 INFO:tasks.workunit.client.0.smithi067.stdout:2/655: chown d0/d25/d34/d4d/d78/fd7 3745078 1 2023-12-05T09:26:37.042 INFO:tasks.workunit.client.0.smithi067.stdout:2/656: creat d0/d25/d34/d4d/d72/fea x:0 0 0 2023-12-05T09:26:37.042 INFO:tasks.workunit.client.0.smithi067.stdout:2/657: fdatasync d0/d25/d9d/d53/d1e/d8e/dd0/d39/f40 0 2023-12-05T09:26:37.042 INFO:tasks.workunit.client.0.smithi067.stdout:2/658: fdatasync d0/f7a 0 2023-12-05T09:26:37.043 INFO:tasks.workunit.client.0.smithi067.stdout:2/659: mknod d0/d25/d9d/d53/d1e/d8e/ceb 0 2023-12-05T09:26:37.057 INFO:tasks.workunit.client.0.smithi067.stdout:7/669: dread d0/f27 [0,4194304] 0 2023-12-05T09:26:37.058 INFO:tasks.workunit.client.0.smithi067.stdout:7/670: write d0/f27 [4908946,10332] 0 2023-12-05T09:26:37.059 INFO:tasks.workunit.client.0.smithi067.stdout:7/671: symlink d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/ldc 0 2023-12-05T09:26:37.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/672: write d0/d9/d10/d1d/f1f [3962010,34453] 0 2023-12-05T09:26:37.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/673: creat d0/d9/d10/d37/d38/db7/fdd x:0 0 0 2023-12-05T09:26:37.072 INFO:tasks.workunit.client.0.smithi067.stdout:7/674: mkdir d0/d9/d40/d7a/dde 0 2023-12-05T09:26:37.072 INFO:tasks.workunit.client.0.smithi067.stdout:7/675: read - d0/d9/d10/d37/d38/fab zero size 2023-12-05T09:26:37.075 INFO:tasks.workunit.client.0.smithi067.stdout:0/868: dwrite d3/d6b/dae/f135 [0,4194304] 0 2023-12-05T09:26:37.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/676: unlink d0/d9/d3f/l4d 0 2023-12-05T09:26:37.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/677: creat d0/d9/d10/d37/d38/d64/d54/fdf x:0 0 0 2023-12-05T09:26:37.078 INFO:tasks.workunit.client.0.smithi067.stdout:0/869: rmdir d3/d6b/dae 39 2023-12-05T09:26:37.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/916: dwrite d1b/d25/d35/d56/fbc [0,4194304] 0 2023-12-05T09:26:37.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/917: chown d1b/d25/d35/d56/dc7/f11e 252 1 2023-12-05T09:26:37.112 INFO:tasks.workunit.client.0.smithi067.stdout:9/918: dread - d1b/d25/d94/fe5 zero size 2023-12-05T09:26:37.116 INFO:tasks.workunit.client.0.smithi067.stdout:9/919: unlink d1b/l42 0 2023-12-05T09:26:37.116 INFO:tasks.workunit.client.0.smithi067.stdout:9/920: chown d1b/d25/d54/d5c/de2/led 0 1 2023-12-05T09:26:37.116 INFO:tasks.workunit.client.0.smithi067.stdout:9/921: chown d1b/l1e 49189 1 2023-12-05T09:26:37.117 INFO:tasks.workunit.client.0.smithi067.stdout:9/922: creat d1b/d25/d5b/d62/def/f130 x:0 0 0 2023-12-05T09:26:37.117 INFO:tasks.workunit.client.0.smithi067.stdout:9/923: fsync d1b/dd3/d6c/d76/f119 0 2023-12-05T09:26:37.119 INFO:tasks.workunit.client.0.smithi067.stdout:9/924: link d1b/d25/d94/laf d1b/l131 0 2023-12-05T09:26:37.121 INFO:tasks.workunit.client.0.smithi067.stdout:9/925: rename d1b/d3e/fdd to d1b/dd3/d82/f132 0 2023-12-05T09:26:37.122 INFO:tasks.workunit.client.0.smithi067.stdout:9/926: write d1b/d25/d54/fcc [4565996,100604] 0 2023-12-05T09:26:37.124 INFO:tasks.workunit.client.0.smithi067.stdout:9/927: rename d1b/d25/d35/l4e to d1b/dc2/l133 0 2023-12-05T09:26:37.128 INFO:tasks.workunit.client.0.smithi067.stdout:8/747: sync 2023-12-05T09:26:37.128 INFO:tasks.workunit.client.0.smithi067.stdout:4/711: sync 2023-12-05T09:26:37.129 INFO:tasks.workunit.client.0.smithi067.stdout:3/650: sync 2023-12-05T09:26:37.129 INFO:tasks.workunit.client.0.smithi067.stdout:8/748: chown d5/dc/d1a/d20/d2d/d8a/cd6 212960 1 2023-12-05T09:26:37.129 INFO:tasks.workunit.client.0.smithi067.stdout:3/651: rmdir d9/da/d15/d17/d2b 39 2023-12-05T09:26:37.129 INFO:tasks.workunit.client.0.smithi067.stdout:3/652: write d9/da/d15/d17/d1a/fdf [966944,123458] 0 2023-12-05T09:26:37.129 INFO:tasks.workunit.client.0.smithi067.stdout:3/653: read d9/da/d15/d17/d1a/d51/d66/fd9 [1340525,115792] 0 2023-12-05T09:26:37.130 INFO:tasks.workunit.client.0.smithi067.stdout:4/712: symlink d0/d1d/d25/d2c/d34/l101 0 2023-12-05T09:26:37.131 INFO:tasks.workunit.client.0.smithi067.stdout:3/654: truncate d9/d62/f88 3314808 0 2023-12-05T09:26:37.138 INFO:tasks.workunit.client.0.smithi067.stdout:0/870: read d3/d7/d3c/d67/d59/d4e/db2/f113 [3080431,118503] 0 2023-12-05T09:26:37.138 INFO:tasks.workunit.client.0.smithi067.stdout:0/871: write d3/d7/d3c/d67/d59/d4e/f5d [3286525,73279] 0 2023-12-05T09:26:37.138 INFO:tasks.workunit.client.0.smithi067.stdout:0/872: dread - d3/d7/d3c/d67/da1/f10b zero size 2023-12-05T09:26:37.138 INFO:tasks.workunit.client.0.smithi067.stdout:4/713: unlink d0/d9/f91 0 2023-12-05T09:26:37.139 INFO:tasks.workunit.client.0.smithi067.stdout:2/660: dwrite d0/fb4 [0,4194304] 0 2023-12-05T09:26:37.145 INFO:tasks.workunit.client.0.smithi067.stdout:4/714: creat d0/d1d/d4d/f102 x:0 0 0 2023-12-05T09:26:37.145 INFO:tasks.workunit.client.0.smithi067.stdout:4/715: stat d0/d1d/d25/d2c/f3a 0 2023-12-05T09:26:37.145 INFO:tasks.workunit.client.0.smithi067.stdout:9/928: write d1b/f75 [2628290,113573] 0 2023-12-05T09:26:37.149 INFO:tasks.workunit.client.0.smithi067.stdout:2/661: mkdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/dec 0 2023-12-05T09:26:37.149 INFO:tasks.workunit.client.0.smithi067.stdout:0/873: dread d3/d7/d3c/d67/f5b [0,4194304] 0 2023-12-05T09:26:37.150 INFO:tasks.workunit.client.0.smithi067.stdout:0/874: creat d3/d7/d3c/d67/d59/deb/f137 x:0 0 0 2023-12-05T09:26:37.157 INFO:tasks.workunit.client.0.smithi067.stdout:4/716: unlink d0/d1d/d53/f6e 0 2023-12-05T09:26:37.157 INFO:tasks.workunit.client.0.smithi067.stdout:4/717: dread - d0/d1d/d53/da8/da9/d15/fd7 zero size 2023-12-05T09:26:37.157 INFO:tasks.workunit.client.0.smithi067.stdout:4/718: creat d0/d1d/d2a/dba/f103 x:0 0 0 2023-12-05T09:26:37.160 INFO:tasks.workunit.client.0.smithi067.stdout:9/929: unlink f10 0 2023-12-05T09:26:37.160 INFO:tasks.workunit.client.0.smithi067.stdout:9/930: fdatasync d1b/d25/d54/d5c/f98 0 2023-12-05T09:26:37.164 INFO:tasks.workunit.client.0.smithi067.stdout:0/875: truncate d3/da2/fac 762508 0 2023-12-05T09:26:37.164 INFO:tasks.workunit.client.0.smithi067.stdout:0/876: stat d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99 0 2023-12-05T09:26:37.164 INFO:tasks.workunit.client.0.smithi067.stdout:0/877: readlink d3/d7/d30/l4c 0 2023-12-05T09:26:37.166 INFO:tasks.workunit.client.0.smithi067.stdout:1/764: sync 2023-12-05T09:26:37.167 INFO:tasks.workunit.client.0.smithi067.stdout:6/640: sync 2023-12-05T09:26:37.167 INFO:tasks.workunit.client.0.smithi067.stdout:6/641: truncate da/dde/fba 588153 0 2023-12-05T09:26:37.167 INFO:tasks.workunit.client.0.smithi067.stdout:6/642: chown da/d10/d1e/l1d 1601397291 1 2023-12-05T09:26:37.169 INFO:tasks.workunit.client.0.smithi067.stdout:1/765: creat d2/d5/d7/f109 x:0 0 0 2023-12-05T09:26:37.175 INFO:tasks.workunit.client.0.smithi067.stdout:0/878: dread d3/d7/d30/f8c [0,4194304] 0 2023-12-05T09:26:37.175 INFO:tasks.workunit.client.0.smithi067.stdout:0/879: chown d3/d7/d3c/d6c/d8a/daf 5 1 2023-12-05T09:26:37.175 INFO:tasks.workunit.client.0.smithi067.stdout:1/766: creat d2/d3/da6/dbd/dd8/f10a x:0 0 0 2023-12-05T09:26:37.175 INFO:tasks.workunit.client.0.smithi067.stdout:1/767: write d2/d5/d7/de/d1a/f7c [3371378,113818] 0 2023-12-05T09:26:37.179 INFO:tasks.workunit.client.0.smithi067.stdout:6/643: mkdir da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6 0 2023-12-05T09:26:37.180 INFO:tasks.workunit.client.0.smithi067.stdout:0/880: symlink d3/d7/d30/l138 0 2023-12-05T09:26:37.180 INFO:tasks.workunit.client.0.smithi067.stdout:0/881: creat d3/d7/d3c/d67/d59/deb/f139 x:0 0 0 2023-12-05T09:26:37.180 INFO:tasks.workunit.client.0.smithi067.stdout:2/662: write d0/d25/d9d/d53/d1e/d8e/dd0/fb9 [956237,109708] 0 2023-12-05T09:26:37.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/719: dread d0/d1d/d25/f6d [0,4194304] 0 2023-12-05T09:26:37.184 INFO:tasks.workunit.client.0.smithi067.stdout:2/663: mknod d0/d25/d9d/d53/d1e/d8e/dd0/d84/dec/ced 0 2023-12-05T09:26:37.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/931: write d1b/d25/d54/d5c/fa8 [1199795,156] 0 2023-12-05T09:26:37.184 INFO:tasks.workunit.client.0.smithi067.stdout:9/932: stat d1b/d25/d54/d5c/ff1 0 2023-12-05T09:26:37.192 INFO:tasks.workunit.client.0.smithi067.stdout:4/720: mkdir d0/d1d/d53/da8/da9/d15/dd0/dd9/de6/d104 0 2023-12-05T09:26:37.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/664: dread d0/d25/d9d/d53/d1e/f35 [0,4194304] 0 2023-12-05T09:26:37.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/665: dread - d0/d25/d9d/d53/d92/fe5 zero size 2023-12-05T09:26:37.230 INFO:tasks.workunit.client.0.smithi067.stdout:2/666: rename d0/d25/d9d/d53/f19 to d0/d25/d9d/d53/d1e/fee 0 2023-12-05T09:26:37.230 INFO:tasks.workunit.client.0.smithi067.stdout:2/667: fsync d0/d25/d9d/d53/d1e/d7f/fcc 0 2023-12-05T09:26:37.236 INFO:tasks.workunit.client.0.smithi067.stdout:0/882: dwrite d3/d7/d3c/d67/d59/d4e/d94/d116/f7b [0,4194304] 0 2023-12-05T09:26:37.239 INFO:tasks.workunit.client.0.smithi067.stdout:0/883: creat d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/f13a x:0 0 0 2023-12-05T09:26:37.243 INFO:tasks.workunit.client.0.smithi067.stdout:6/644: dwrite da/d10/d1e/d17/d2f/d72/f97 [0,4194304] 0 2023-12-05T09:26:37.247 INFO:tasks.workunit.client.0.smithi067.stdout:9/933: write d1b/d3e/d7f/f95 [2234290,39190] 0 2023-12-05T09:26:37.248 INFO:tasks.workunit.client.0.smithi067.stdout:1/768: dwrite d2/d3/da6/dbd/dd8/f10a [0,4194304] 0 2023-12-05T09:26:37.248 INFO:tasks.workunit.client.0.smithi067.stdout:6/645: creat da/d10/d1e/d17/d2f/d2c/dc3/fe7 x:0 0 0 2023-12-05T09:26:37.248 INFO:tasks.workunit.client.0.smithi067.stdout:0/884: dread d3/d7/d30/f8c [0,4194304] 0 2023-12-05T09:26:37.249 INFO:tasks.workunit.client.0.smithi067.stdout:6/646: creat da/d10/d1e/d17/d2f/d1f/d9e/fe8 x:0 0 0 2023-12-05T09:26:37.254 INFO:tasks.workunit.client.0.smithi067.stdout:9/934: mkdir d1b/d25/d5b/d62/d134 0 2023-12-05T09:26:37.255 INFO:tasks.workunit.client.0.smithi067.stdout:1/769: rmdir d2/d5/d7/de 39 2023-12-05T09:26:37.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/885: unlink d3/f4d 0 2023-12-05T09:26:37.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/886: stat d3/d7/d3c/d6c/d76/da7/fd8 0 2023-12-05T09:26:37.259 INFO:tasks.workunit.client.0.smithi067.stdout:0/887: fsync d3/d7/dd7/fdc 0 2023-12-05T09:26:37.260 INFO:tasks.workunit.client.0.smithi067.stdout:1/770: symlink d2/d4f/d14/d20/d4c/l10b 0 2023-12-05T09:26:37.260 INFO:tasks.workunit.client.0.smithi067.stdout:1/771: fdatasync d2/d4f/d54/d70/f9b 0 2023-12-05T09:26:37.262 INFO:tasks.workunit.client.0.smithi067.stdout:8/749: dwrite d5/dc/d1a/d62/f84 [0,4194304] 0 2023-12-05T09:26:37.262 INFO:tasks.workunit.client.0.smithi067.stdout:8/750: dread - d5/dc/d1a/d62/fae zero size 2023-12-05T09:26:37.262 INFO:tasks.workunit.client.0.smithi067.stdout:8/751: write d5/dc/d1a/d20/d2d/d41/db2/fc0 [822553,78072] 0 2023-12-05T09:26:37.264 INFO:tasks.workunit.client.0.smithi067.stdout:0/888: link d3/d7/d3c/d67/d59/d4e/d94/d116/caa d3/d6b/d10a/c13b 0 2023-12-05T09:26:37.266 INFO:tasks.workunit.client.0.smithi067.stdout:0/889: symlink d3/l13c 0 2023-12-05T09:26:37.268 INFO:tasks.workunit.client.0.smithi067.stdout:0/890: mkdir d3/d6b/d6e/d13d 0 2023-12-05T09:26:37.268 INFO:tasks.workunit.client.0.smithi067.stdout:0/891: chown d3/d7/d3c/d67/fcb 3411 1 2023-12-05T09:26:37.277 INFO:tasks.workunit.client.0.smithi067.stdout:9/935: dread d1b/d25/d54/d5c/f98 [0,4194304] 0 2023-12-05T09:26:37.278 INFO:tasks.workunit.client.0.smithi067.stdout:9/936: mkdir d1b/d25/d35/d56/d90/d135 0 2023-12-05T09:26:37.280 INFO:tasks.workunit.client.0.smithi067.stdout:6/647: dread da/dde/f74 [0,4194304] 0 2023-12-05T09:26:37.280 INFO:tasks.workunit.client.0.smithi067.stdout:6/648: chown da/d10/d1e/d69/dcb/fdc 0 1 2023-12-05T09:26:37.285 INFO:tasks.workunit.client.0.smithi067.stdout:9/937: rename d1b/dd3/d6c/d78/c9f to d1b/d25/d54/d5c/d81/c136 0 2023-12-05T09:26:37.286 INFO:tasks.workunit.client.0.smithi067.stdout:2/668: write d0/d25/d34/d4a/f52 [3457084,120593] 0 2023-12-05T09:26:37.286 INFO:tasks.workunit.client.0.smithi067.stdout:6/649: symlink da/d10/d1e/d7f/le9 0 2023-12-05T09:26:37.286 INFO:tasks.workunit.client.0.smithi067.stdout:4/721: dwrite d0/d1d/d2a/fae [0,4194304] 0 2023-12-05T09:26:37.289 INFO:tasks.workunit.client.0.smithi067.stdout:8/752: read d5/dc/d1a/d20/d2d/d41/f5b [4667344,70926] 0 2023-12-05T09:26:37.289 INFO:tasks.workunit.client.0.smithi067.stdout:8/753: getdents d5/d9d/dd9 0 2023-12-05T09:26:37.289 INFO:tasks.workunit.client.0.smithi067.stdout:2/669: mknod d0/d25/d9d/d53/d1e/d8e/dd0/da3/cef 0 2023-12-05T09:26:37.292 INFO:tasks.workunit.client.0.smithi067.stdout:8/754: truncate d5/dc/d1a/f5a 3129630 0 2023-12-05T09:26:37.297 INFO:tasks.workunit.client.0.smithi067.stdout:8/755: rename d5/dc/d1a/d20/d2d/caa to d5/dc/d1a/d20/d2d/d41/cde 0 2023-12-05T09:26:37.297 INFO:tasks.workunit.client.0.smithi067.stdout:8/756: write d5/d3b/f3d [1324705,47864] 0 2023-12-05T09:26:37.302 INFO:tasks.workunit.client.0.smithi067.stdout:8/757: creat d5/fdf x:0 0 0 2023-12-05T09:26:37.302 INFO:tasks.workunit.client.0.smithi067.stdout:8/758: fsync d5/dc/d1a/d20/d3e/f7a 0 2023-12-05T09:26:37.311 INFO:tasks.workunit.client.0.smithi067.stdout:8/759: link d5/d9d/dab/l8b d5/dc/d1a/d20/d2d/d41/db2/le0 0 2023-12-05T09:26:37.311 INFO:tasks.workunit.client.0.smithi067.stdout:8/760: creat d5/dc/d1a/d20/d2d/d8a/fe1 x:0 0 0 2023-12-05T09:26:37.313 INFO:tasks.workunit.client.0.smithi067.stdout:8/761: creat d5/dc/d1a/d62/fe2 x:0 0 0 2023-12-05T09:26:37.321 INFO:tasks.workunit.client.0.smithi067.stdout:1/772: dwrite d2/d4f/d54/f8c [0,4194304] 0 2023-12-05T09:26:37.366 INFO:tasks.workunit.client.0.smithi067.stdout:4/722: dwrite d0/d1d/f58 [0,4194304] 0 2023-12-05T09:26:37.366 INFO:tasks.workunit.client.0.smithi067.stdout:4/723: chown d0/d1d/d2a 28 1 2023-12-05T09:26:37.378 INFO:tasks.workunit.client.0.smithi067.stdout:4/724: write d0/d1d/d25/d32/f16 [348195,68404] 0 2023-12-05T09:26:37.378 INFO:tasks.workunit.client.0.smithi067.stdout:4/725: write d0/d1d/d53/da8/da9/d15/fa3 [195148,87652] 0 2023-12-05T09:26:37.380 INFO:tasks.workunit.client.0.smithi067.stdout:4/726: creat d0/d1d/d25/d2c/db5/f105 x:0 0 0 2023-12-05T09:26:37.385 INFO:tasks.workunit.client.0.smithi067.stdout:6/650: dwrite da/d10/d1e/d17/d2f/d3f/f64 [0,4194304] 0 2023-12-05T09:26:37.397 INFO:tasks.workunit.client.0.smithi067.stdout:6/651: dread da/d10/d1e/d69/f93 [0,4194304] 0 2023-12-05T09:26:37.398 INFO:tasks.workunit.client.0.smithi067.stdout:6/652: creat da/d10/d1e/d51/d7b/dd6/fea x:0 0 0 2023-12-05T09:26:37.401 INFO:tasks.workunit.client.0.smithi067.stdout:6/653: write da/d10/d1e/d17/d2f/d3f/d92/fcd [554318,84873] 0 2023-12-05T09:26:37.402 INFO:tasks.workunit.client.0.smithi067.stdout:6/654: truncate da/d10/d1e/d17/fe0 1482920 0 2023-12-05T09:26:37.408 INFO:tasks.workunit.client.0.smithi067.stdout:5/731: sync 2023-12-05T09:26:37.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/762: dwrite d5/dc/d1a/d20/f59 [0,4194304] 0 2023-12-05T09:26:37.426 INFO:tasks.workunit.client.0.smithi067.stdout:8/763: getdents d5/da/d30/d7c 0 2023-12-05T09:26:37.446 INFO:tasks.workunit.client.0.smithi067.stdout:5/732: write db/df/d35/d63/faf [4066502,124207] 0 2023-12-05T09:26:37.450 INFO:tasks.workunit.client.0.smithi067.stdout:8/764: dread d5/dc/d1a/d20/fbd [0,4194304] 0 2023-12-05T09:26:37.451 INFO:tasks.workunit.client.0.smithi067.stdout:5/733: rename db/df/d1a to db/df/d3f/dd9/de7/dfd 0 2023-12-05T09:26:37.455 INFO:tasks.workunit.client.0.smithi067.stdout:8/765: unlink d5/da/f80 0 2023-12-05T09:26:37.455 INFO:tasks.workunit.client.0.smithi067.stdout:8/766: write d5/dc/d1a/d20/d3e/f42 [3092347,110260] 0 2023-12-05T09:26:37.456 INFO:tasks.workunit.client.0.smithi067.stdout:6/655: dwrite da/d10/d1e/d51/d7b/dd6/fea [0,4194304] 0 2023-12-05T09:26:37.457 INFO:tasks.workunit.client.0.smithi067.stdout:8/767: read d5/dc/d1a/fcf [144735,27970] 0 2023-12-05T09:26:37.457 INFO:tasks.workunit.client.0.smithi067.stdout:8/768: fdatasync d5/fdf 0 2023-12-05T09:26:37.460 INFO:tasks.workunit.client.0.smithi067.stdout:4/727: dwrite d0/f41 [0,4194304] 0 2023-12-05T09:26:37.460 INFO:tasks.workunit.client.0.smithi067.stdout:4/728: fdatasync d0/d1d/d53/da8/da9/d15/fa3 0 2023-12-05T09:26:37.460 INFO:tasks.workunit.client.0.smithi067.stdout:4/729: stat d0/d1d/d25/d32/l68 0 2023-12-05T09:26:37.461 INFO:tasks.workunit.client.0.smithi067.stdout:4/730: chown d0/d1d/d53/da8/da9 0 1 2023-12-05T09:26:37.461 INFO:tasks.workunit.client.0.smithi067.stdout:8/769: rename d5/dc/d1a/d20/d2d/d41/c49 to d5/dc/d1a/d20/d58/d90/dba/ce3 0 2023-12-05T09:26:37.463 INFO:tasks.workunit.client.0.smithi067.stdout:4/731: mkdir d0/d1d/d25/d2c/d34/d4e/d5a/d88/d106 0 2023-12-05T09:26:37.466 INFO:tasks.workunit.client.0.smithi067.stdout:8/770: symlink d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/le4 0 2023-12-05T09:26:37.466 INFO:tasks.workunit.client.0.smithi067.stdout:8/771: creat d5/fe5 x:0 0 0 2023-12-05T09:26:37.466 INFO:tasks.workunit.client.0.smithi067.stdout:8/772: fdatasync d5/dc/d1a/f2f 0 2023-12-05T09:26:37.466 INFO:tasks.workunit.client.0.smithi067.stdout:8/773: write d5/fe5 [390423,62888] 0 2023-12-05T09:26:37.472 INFO:tasks.workunit.client.0.smithi067.stdout:5/734: write db/df/f6b [25891,128433] 0 2023-12-05T09:26:37.472 INFO:tasks.workunit.client.0.smithi067.stdout:5/735: fdatasync db/df/d35/dc8/fdf 0 2023-12-05T09:26:37.472 INFO:tasks.workunit.client.0.smithi067.stdout:5/736: rename db/df/d35/d63/d75/lbe to db/df/d35/d63/lfe 0 2023-12-05T09:26:37.479 INFO:tasks.workunit.client.0.smithi067.stdout:5/737: creat db/df/d3f/dd9/de7/dfd/d1d/d20/fff x:0 0 0 2023-12-05T09:26:37.481 INFO:tasks.workunit.client.0.smithi067.stdout:6/656: dread da/d10/d1e/d17/d2f/d1f/d27/daa/fc6 [0,4194304] 0 2023-12-05T09:26:37.481 INFO:tasks.workunit.client.0.smithi067.stdout:6/657: fdatasync da/d10/d1e/d17/f81 0 2023-12-05T09:26:37.481 INFO:tasks.workunit.client.0.smithi067.stdout:6/658: read da/d10/d1e/d69/dcb/fdc [867402,43364] 0 2023-12-05T09:26:37.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/732: dwrite d0/f80 [0,4194304] 0 2023-12-05T09:26:37.542 INFO:tasks.workunit.client.0.smithi067.stdout:6/659: read da/d10/d1e/d7f/fad [4334617,51641] 0 2023-12-05T09:26:37.542 INFO:tasks.workunit.client.0.smithi067.stdout:6/660: chown da/d10/d1e/l8d 319 1 2023-12-05T09:26:37.543 INFO:tasks.workunit.client.0.smithi067.stdout:8/774: dwrite d5/f28 [0,4194304] 0 2023-12-05T09:26:37.544 INFO:tasks.workunit.client.0.smithi067.stdout:4/733: getdents d0/d1d/d53/da8/da9/d15/dd0 0 2023-12-05T09:26:37.544 INFO:tasks.workunit.client.0.smithi067.stdout:4/734: truncate d0/d9/fb7 1412990 0 2023-12-05T09:26:37.548 INFO:tasks.workunit.client.0.smithi067.stdout:5/738: dwrite db/f14 [4194304,4194304] 0 2023-12-05T09:26:37.555 INFO:tasks.workunit.client.0.smithi067.stdout:8/775: rename d5/dc/d1a/d20/d58/d90/dba to d5/d3b/db3/de6 0 2023-12-05T09:26:37.555 INFO:tasks.workunit.client.0.smithi067.stdout:4/735: dread d0/d1d/d53/da8/da9/d15/fa3 [0,4194304] 0 2023-12-05T09:26:37.562 INFO:tasks.workunit.client.0.smithi067.stdout:6/661: dread da/d10/d1e/d17/f81 [0,4194304] 0 2023-12-05T09:26:37.562 INFO:tasks.workunit.client.0.smithi067.stdout:8/776: symlink d5/d3b/db3/le7 0 2023-12-05T09:26:37.562 INFO:tasks.workunit.client.0.smithi067.stdout:8/777: write d5/d9d/dab/f7b [5317162,71506] 0 2023-12-05T09:26:37.565 INFO:tasks.workunit.client.0.smithi067.stdout:6/662: mkdir da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/deb 0 2023-12-05T09:26:37.565 INFO:tasks.workunit.client.0.smithi067.stdout:6/663: fdatasync da/d10/d1e/d17/fe0 0 2023-12-05T09:26:37.565 INFO:tasks.workunit.client.0.smithi067.stdout:6/664: dread - da/fe5 zero size 2023-12-05T09:26:37.583 INFO:tasks.workunit.client.0.smithi067.stdout:8/778: dread d5/dc/d1a/d20/d2d/d41/f5b [8388608,4194304] 0 2023-12-05T09:26:37.584 INFO:tasks.workunit.client.0.smithi067.stdout:8/779: write d5/dc/d1a/d20/d2d/d8a/fb0 [754978,128056] 0 2023-12-05T09:26:37.588 INFO:tasks.workunit.client.0.smithi067.stdout:4/736: dread d0/d1d/d53/da8/da9/d15/f9c [0,4194304] 0 2023-12-05T09:26:37.608 INFO:tasks.workunit.client.0.smithi067.stdout:5/739: dwrite db/df/db5/fe1 [0,4194304] 0 2023-12-05T09:26:37.627 INFO:tasks.workunit.client.0.smithi067.stdout:7/678: sync 2023-12-05T09:26:37.628 INFO:tasks.workunit.client.0.smithi067.stdout:3/655: sync 2023-12-05T09:26:37.636 INFO:tasks.workunit.client.0.smithi067.stdout:3/656: rename d9/d24/fbc to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/fe8 0 2023-12-05T09:26:37.637 INFO:tasks.workunit.client.0.smithi067.stdout:9/938: sync 2023-12-05T09:26:37.637 INFO:tasks.workunit.client.0.smithi067.stdout:8/780: dwrite d5/dc/d1a/d62/d7e/f83 [0,4194304] 0 2023-12-05T09:26:37.638 INFO:tasks.workunit.client.0.smithi067.stdout:0/892: sync 2023-12-05T09:26:37.638 INFO:tasks.workunit.client.0.smithi067.stdout:1/773: sync 2023-12-05T09:26:37.638 INFO:tasks.workunit.client.0.smithi067.stdout:0/893: write d3/d7/d3c/d67/fcb [693146,38555] 0 2023-12-05T09:26:37.638 INFO:tasks.workunit.client.0.smithi067.stdout:0/894: fsync d3/d6b/dae/f126 0 2023-12-05T09:26:37.638 INFO:tasks.workunit.client.0.smithi067.stdout:9/939: creat d1b/d25/d5b/f137 x:0 0 0 2023-12-05T09:26:37.638 INFO:tasks.workunit.client.0.smithi067.stdout:6/665: dwrite da/d10/d1e/d17/d2f/d72/f82 [0,4194304] 0 2023-12-05T09:26:37.648 INFO:tasks.workunit.client.0.smithi067.stdout:8/781: truncate d5/f45 1197454 0 2023-12-05T09:26:37.648 INFO:tasks.workunit.client.0.smithi067.stdout:2/670: sync 2023-12-05T09:26:37.649 INFO:tasks.workunit.client.0.smithi067.stdout:3/657: link d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/fde d9/da/fe9 0 2023-12-05T09:26:37.666 INFO:tasks.workunit.client.0.smithi067.stdout:3/658: symlink d9/da/d3b/lea 0 2023-12-05T09:26:37.666 INFO:tasks.workunit.client.0.smithi067.stdout:3/659: chown d9/d49 1963764 1 2023-12-05T09:26:37.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/660: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/leb 0 2023-12-05T09:26:37.670 INFO:tasks.workunit.client.0.smithi067.stdout:3/661: mkdir d9/da/d3b/dec 0 2023-12-05T09:26:37.672 INFO:tasks.workunit.client.0.smithi067.stdout:3/662: mknod d9/d24/ced 0 2023-12-05T09:26:37.672 INFO:tasks.workunit.client.0.smithi067.stdout:3/663: chown d9/d62/dd0 1463 1 2023-12-05T09:26:37.674 INFO:tasks.workunit.client.0.smithi067.stdout:1/774: dread d2/d5/d7/de/d19/d49/f56 [0,4194304] 0 2023-12-05T09:26:37.679 INFO:tasks.workunit.client.0.smithi067.stdout:1/775: creat d2/d3/da6/dbb/dd1/f10c x:0 0 0 2023-12-05T09:26:37.682 INFO:tasks.workunit.client.0.smithi067.stdout:1/776: mkdir d2/d3/da6/dbb/dd1/d10d 0 2023-12-05T09:26:37.686 INFO:tasks.workunit.client.0.smithi067.stdout:1/777: link d2/d4f/d14/l88 d2/d4f/d15/dee/l10e 0 2023-12-05T09:26:37.696 INFO:tasks.workunit.client.0.smithi067.stdout:6/666: write da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a [432915,33794] 0 2023-12-05T09:26:37.696 INFO:tasks.workunit.client.0.smithi067.stdout:6/667: fdatasync f4 0 2023-12-05T09:26:37.696 INFO:tasks.workunit.client.0.smithi067.stdout:6/668: chown da/d10/d1e/d17/d2f/d3f/lbf 1 1 2023-12-05T09:26:37.699 INFO:tasks.workunit.client.0.smithi067.stdout:8/782: dwrite d5/fb6 [0,4194304] 0 2023-12-05T09:26:37.701 INFO:tasks.workunit.client.0.smithi067.stdout:5/740: dwrite db/df/d36/d57/fb7 [0,4194304] 0 2023-12-05T09:26:37.701 INFO:tasks.workunit.client.0.smithi067.stdout:5/741: chown db/df/d35/dc8 4065513 1 2023-12-05T09:26:37.701 INFO:tasks.workunit.client.0.smithi067.stdout:8/783: rmdir d5/dc/d1a/d20/d2d 39 2023-12-05T09:26:37.701 INFO:tasks.workunit.client.0.smithi067.stdout:8/784: chown d5/dc/d1a 385 1 2023-12-05T09:26:37.701 INFO:tasks.workunit.client.0.smithi067.stdout:8/785: chown d5/dc/d1a/d62/d7e/l8e 3494604 1 2023-12-05T09:26:37.703 INFO:tasks.workunit.client.0.smithi067.stdout:6/669: getdents da/d10/d1e/d51 0 2023-12-05T09:26:37.704 INFO:tasks.workunit.client.0.smithi067.stdout:6/670: truncate da/d10/d1e/d17/d2f/dbc/fb0 863132 0 2023-12-05T09:26:37.705 INFO:tasks.workunit.client.0.smithi067.stdout:5/742: mknod db/df/d3f/dd9/de7/dfd/d1d/c100 0 2023-12-05T09:26:37.717 INFO:tasks.workunit.client.0.smithi067.stdout:3/664: write d9/da/d3b/fc6 [920294,114011] 0 2023-12-05T09:26:37.719 INFO:tasks.workunit.client.0.smithi067.stdout:2/671: dwrite d0/d7c/faa [0,4194304] 0 2023-12-05T09:26:37.722 INFO:tasks.workunit.client.0.smithi067.stdout:3/665: unlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/la5 0 2023-12-05T09:26:37.722 INFO:tasks.workunit.client.0.smithi067.stdout:3/666: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/fee x:0 0 0 2023-12-05T09:26:37.726 INFO:tasks.workunit.client.0.smithi067.stdout:3/667: symlink d9/da/d3b/lef 0 2023-12-05T09:26:37.741 INFO:tasks.workunit.client.0.smithi067.stdout:3/668: dread f7 [0,4194304] 0 2023-12-05T09:26:37.741 INFO:tasks.workunit.client.0.smithi067.stdout:3/669: fsync d9/da/d15/d17/d1a/d51/d66/f93 0 2023-12-05T09:26:37.747 INFO:tasks.workunit.client.0.smithi067.stdout:7/679: dwrite d0/d9/d10/f5d [0,4194304] 0 2023-12-05T09:26:37.747 INFO:tasks.workunit.client.0.smithi067.stdout:7/680: truncate d0/d9/d40/d7a/fa3 834582 0 2023-12-05T09:26:37.747 INFO:tasks.workunit.client.0.smithi067.stdout:7/681: chown d0/d9/d56/d8e/f9f 1168 1 2023-12-05T09:26:37.747 INFO:tasks.workunit.client.0.smithi067.stdout:7/682: fsync d0/d45/f80 0 2023-12-05T09:26:37.747 INFO:tasks.workunit.client.0.smithi067.stdout:7/683: creat d0/d9/d10/d37/d38/d64/d54/fe0 x:0 0 0 2023-12-05T09:26:37.751 INFO:tasks.workunit.client.0.smithi067.stdout:7/684: mkdir d0/d9/d56/de1 0 2023-12-05T09:26:37.754 INFO:tasks.workunit.client.0.smithi067.stdout:7/685: creat d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/fe2 x:0 0 0 2023-12-05T09:26:37.786 INFO:tasks.workunit.client.0.smithi067.stdout:6/671: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/fb7 [0,4194304] 0 2023-12-05T09:26:37.786 INFO:tasks.workunit.client.0.smithi067.stdout:6/672: chown da/d10/d1e/d17/d2f/d3f/d92/f9d 74 1 2023-12-05T09:26:37.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/672: write d0/fb4 [695806,49485] 0 2023-12-05T09:26:37.789 INFO:tasks.workunit.client.0.smithi067.stdout:2/673: rename d0/dbd to d0/d25/d34/d4d/db0/dce/dd3/df0 0 2023-12-05T09:26:37.789 INFO:tasks.workunit.client.0.smithi067.stdout:0/895: dwrite d3/d7/d3c/d67/dd1/f12b [0,4194304] 0 2023-12-05T09:26:37.794 INFO:tasks.workunit.client.0.smithi067.stdout:2/674: creat d0/d25/d3f/ff1 x:0 0 0 2023-12-05T09:26:37.794 INFO:tasks.workunit.client.0.smithi067.stdout:0/896: mknod d3/d6b/c13e 0 2023-12-05T09:26:37.797 INFO:tasks.workunit.client.0.smithi067.stdout:3/670: dwrite d9/da/fca [0,4194304] 0 2023-12-05T09:26:37.797 INFO:tasks.workunit.client.0.smithi067.stdout:3/671: getdents d9/d62/dd0 0 2023-12-05T09:26:37.799 INFO:tasks.workunit.client.0.smithi067.stdout:0/897: creat d3/d7/f13f x:0 0 0 2023-12-05T09:26:37.801 INFO:tasks.workunit.client.0.smithi067.stdout:0/898: symlink d3/d6b/l140 0 2023-12-05T09:26:37.803 INFO:tasks.workunit.client.0.smithi067.stdout:2/675: mknod d0/d25/d34/d4d/db0/dce/cf2 0 2023-12-05T09:26:37.803 INFO:tasks.workunit.client.0.smithi067.stdout:2/676: write d0/d25/d34/d4d/db0/dbf/fe1 [2259,42777] 0 2023-12-05T09:26:37.803 INFO:tasks.workunit.client.0.smithi067.stdout:2/677: fdatasync d0/d25/d34/d4a/f52 0 2023-12-05T09:26:37.810 INFO:tasks.workunit.client.0.smithi067.stdout:0/899: creat d3/d7/d3c/f141 x:0 0 0 2023-12-05T09:26:37.810 INFO:tasks.workunit.client.0.smithi067.stdout:6/673: dread da/d10/d1e/d17/f23 [4194304,4194304] 0 2023-12-05T09:26:37.810 INFO:tasks.workunit.client.0.smithi067.stdout:6/674: truncate da/d10/d1e/d17/d2f/d2c/dc3/fe7 941938 0 2023-12-05T09:26:37.810 INFO:tasks.workunit.client.0.smithi067.stdout:8/786: write d5/dc/d1a/f64 [3009513,125451] 0 2023-12-05T09:26:37.810 INFO:tasks.workunit.client.0.smithi067.stdout:8/787: dread - d5/da/fcd zero size 2023-12-05T09:26:37.811 INFO:tasks.workunit.client.0.smithi067.stdout:8/788: chown d5/da/f4b 417601 1 2023-12-05T09:26:37.816 INFO:tasks.workunit.client.0.smithi067.stdout:8/789: link d5/dc/d1a/cd1 d5/dc/d1a/d20/d3e/d95/ce8 0 2023-12-05T09:26:37.816 INFO:tasks.workunit.client.0.smithi067.stdout:8/790: fdatasync d5/dc/d1a/d20/d2d/d7f/d94/da3/fa4 0 2023-12-05T09:26:37.830 INFO:tasks.workunit.client.0.smithi067.stdout:6/675: dread da/d10/d1e/d17/d2f/f2b [0,4194304] 0 2023-12-05T09:26:37.830 INFO:tasks.workunit.client.0.smithi067.stdout:6/676: fdatasync da/d10/d1e/d17/d2f/d1f/fd0 0 2023-12-05T09:26:37.831 INFO:tasks.workunit.client.0.smithi067.stdout:9/940: dwrite d1b/f5d [0,4194304] 0 2023-12-05T09:26:37.832 INFO:tasks.workunit.client.0.smithi067.stdout:7/686: dwrite d0/d45/f80 [0,4194304] 0 2023-12-05T09:26:37.834 INFO:tasks.workunit.client.0.smithi067.stdout:3/672: dread d9/da/d15/d17/f3a [0,4194304] 0 2023-12-05T09:26:37.843 INFO:tasks.workunit.client.0.smithi067.stdout:9/941: rename d1b/d25/d35/d56/d90/fea to d1b/d25/d5b/d62/def/dfa/f138 0 2023-12-05T09:26:37.843 INFO:tasks.workunit.client.0.smithi067.stdout:6/677: dread da/d10/d1e/d51/f65 [0,4194304] 0 2023-12-05T09:26:37.857 INFO:tasks.workunit.client.0.smithi067.stdout:6/678: symlink da/d10/d1e/d17/d2f/db2/lec 0 2023-12-05T09:26:37.862 INFO:tasks.workunit.client.0.smithi067.stdout:8/791: read d5/dc/f9b [2002987,2322] 0 2023-12-05T09:26:37.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/678: dwrite d0/d25/d3a/fdc [0,4194304] 0 2023-12-05T09:26:37.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/679: fdatasync d0/d25/d9d/d53/d1e/d8e/dd0/d39/f6f 0 2023-12-05T09:26:37.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/680: chown d0/d25/d34/d4d/d54/d90 2078771 1 2023-12-05T09:26:37.864 INFO:tasks.workunit.client.0.smithi067.stdout:2/681: chown d0/d25/d9d/d53/d1e/d8e/dd0/d39/f40 111812 1 2023-12-05T09:26:37.869 INFO:tasks.workunit.client.0.smithi067.stdout:8/792: symlink d5/d3b/db3/de6/le9 0 2023-12-05T09:26:37.869 INFO:tasks.workunit.client.0.smithi067.stdout:8/793: fdatasync d5/d6a/f74 0 2023-12-05T09:26:37.869 INFO:tasks.workunit.client.0.smithi067.stdout:8/794: dread - d5/da/fd2 zero size 2023-12-05T09:26:37.869 INFO:tasks.workunit.client.0.smithi067.stdout:8/795: creat d5/fea x:0 0 0 2023-12-05T09:26:37.874 INFO:tasks.workunit.client.0.smithi067.stdout:2/682: mkdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/de8/df3 0 2023-12-05T09:26:37.874 INFO:tasks.workunit.client.0.smithi067.stdout:2/683: truncate d0/d25/d9d/d53/d1e/d8e/fd9 503720 0 2023-12-05T09:26:37.875 INFO:tasks.workunit.client.0.smithi067.stdout:2/684: creat d0/d25/d34/d4d/d54/d90/dcf/ff4 x:0 0 0 2023-12-05T09:26:37.875 INFO:tasks.workunit.client.0.smithi067.stdout:8/796: getdents d5/dc/d1a/d20/d2d/d7f/d94 0 2023-12-05T09:26:37.879 INFO:tasks.workunit.client.0.smithi067.stdout:2/685: creat d0/d25/d9d/d53/d1e/d8e/dd0/d84/dec/ff5 x:0 0 0 2023-12-05T09:26:37.879 INFO:tasks.workunit.client.0.smithi067.stdout:2/686: chown d0/d25/d9d/d53/d1e/d8e/dd0/d39/lbc 1021627 1 2023-12-05T09:26:37.879 INFO:tasks.workunit.client.0.smithi067.stdout:2/687: readlink d0/d25/d9d/d53/d92/lc9 0 2023-12-05T09:26:37.888 INFO:tasks.workunit.client.0.smithi067.stdout:8/797: rename d5/dc/l4f to d5/dc/d1a/d20/d2d/d41/leb 0 2023-12-05T09:26:37.888 INFO:tasks.workunit.client.0.smithi067.stdout:8/798: fdatasync d5/d3b/f3d 0 2023-12-05T09:26:37.892 INFO:tasks.workunit.client.0.smithi067.stdout:8/799: rename d5/l9a to d5/dc/d1a/d20/d3e/dbf/lec 0 2023-12-05T09:26:37.892 INFO:tasks.workunit.client.0.smithi067.stdout:8/800: readlink d5/dc/d1a/d62/d7e/la8 0 2023-12-05T09:26:37.908 INFO:tasks.workunit.client.0.smithi067.stdout:7/687: dwrite d0/fcb [4194304,4194304] 0 2023-12-05T09:26:37.910 INFO:tasks.workunit.client.0.smithi067.stdout:7/688: symlink d0/d9/d10/d37/d38/d64/d34/d67/le3 0 2023-12-05T09:26:37.910 INFO:tasks.workunit.client.0.smithi067.stdout:7/689: readlink d0/d9/d40/d7a/dad/dc2/l74 0 2023-12-05T09:26:37.910 INFO:tasks.workunit.client.0.smithi067.stdout:7/690: chown d0/d9/d3f/dbd 90165 1 2023-12-05T09:26:37.916 INFO:tasks.workunit.client.0.smithi067.stdout:9/942: dwrite d1b/d25/d35/f4f [4194304,4194304] 0 2023-12-05T09:26:37.922 INFO:tasks.workunit.client.0.smithi067.stdout:7/691: mkdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/dc3/de4 0 2023-12-05T09:26:37.928 INFO:tasks.workunit.client.0.smithi067.stdout:8/801: dread d5/dc/d1a/d62/f84 [0,4194304] 0 2023-12-05T09:26:37.936 INFO:tasks.workunit.client.0.smithi067.stdout:8/802: symlink d5/d3b/db3/de6/led 0 2023-12-05T09:26:37.950 INFO:tasks.workunit.client.0.smithi067.stdout:3/673: dwrite f3 [4194304,4194304] 0 2023-12-05T09:26:37.950 INFO:tasks.workunit.client.0.smithi067.stdout:3/674: write d9/da/d15/d17/fe4 [908370,85191] 0 2023-12-05T09:26:37.950 INFO:tasks.workunit.client.0.smithi067.stdout:3/675: chown d9/da/d15/d17/d1a/d51/lbe 111 1 2023-12-05T09:26:37.953 INFO:tasks.workunit.client.0.smithi067.stdout:3/676: read d9/da/d15/d17/d1a/f77 [92549,35320] 0 2023-12-05T09:26:37.955 INFO:tasks.workunit.client.0.smithi067.stdout:3/677: rename d9/da/d15/d17/d1a/d51/d70/ldc to d9/d49/lf0 0 2023-12-05T09:26:37.955 INFO:tasks.workunit.client.0.smithi067.stdout:3/678: dread - d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/fee zero size 2023-12-05T09:26:37.995 INFO:tasks.workunit.client.0.smithi067.stdout:2/688: dwrite d0/d25/d3f/d83/fa0 [0,4194304] 0 2023-12-05T09:26:37.995 INFO:tasks.workunit.client.0.smithi067.stdout:2/689: dread - d0/d25/d9d/d53/d1e/d8e/fb6 zero size 2023-12-05T09:26:37.995 INFO:tasks.workunit.client.0.smithi067.stdout:2/690: fsync d0/d25/d9d/d53/d1e/d8e/dd0/faf 0 2023-12-05T09:26:37.995 INFO:tasks.workunit.client.0.smithi067.stdout:2/691: dread - d0/d7c/fd2 zero size 2023-12-05T09:26:37.995 INFO:tasks.workunit.client.0.smithi067.stdout:6/679: dwrite da/d10/d1e/d17/d2f/d3f/d92/fcd [0,4194304] 0 2023-12-05T09:26:38.008 INFO:tasks.workunit.client.0.smithi067.stdout:7/692: write d0/d9/d10/d37/d38/d64/d54/f65 [9623324,99976] 0 2023-12-05T09:26:38.008 INFO:tasks.workunit.client.0.smithi067.stdout:9/943: dwrite d1b/dc2/fd1 [0,4194304] 0 2023-12-05T09:26:38.016 INFO:tasks.workunit.client.0.smithi067.stdout:7/693: unlink d0/d9/d10/d37/d38/d64/d34/d67/f96 0 2023-12-05T09:26:38.018 INFO:tasks.workunit.client.0.smithi067.stdout:7/694: mkdir d0/d9/d40/d7a/de5 0 2023-12-05T09:26:38.018 INFO:tasks.workunit.client.0.smithi067.stdout:4/737: sync 2023-12-05T09:26:38.018 INFO:tasks.workunit.client.0.smithi067.stdout:8/803: dwrite d5/dc/f9b [0,4194304] 0 2023-12-05T09:26:38.023 INFO:tasks.workunit.client.0.smithi067.stdout:7/695: link d0/d9/d10/d37/d38/d64/d5a/fa1 d0/d9/d56/d8e/daa/fe6 0 2023-12-05T09:26:38.026 INFO:tasks.workunit.client.0.smithi067.stdout:7/696: creat d0/d9/d10/d37/d38/d64/d54/fe7 x:0 0 0 2023-12-05T09:26:38.026 INFO:tasks.workunit.client.0.smithi067.stdout:3/679: dwrite f7 [0,4194304] 0 2023-12-05T09:26:38.027 INFO:tasks.workunit.client.0.smithi067.stdout:8/804: mkdir d5/dc/d6e/dee 0 2023-12-05T09:26:38.030 INFO:tasks.workunit.client.0.smithi067.stdout:8/805: truncate d5/f18 3135424 0 2023-12-05T09:26:38.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/806: truncate d5/d3b/fa1 512726 0 2023-12-05T09:26:38.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/807: fsync d5/dc/d1a/d20/d2d/d8a/fb0 0 2023-12-05T09:26:38.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/808: chown d5/dc/d1a/d62/l82 1503 1 2023-12-05T09:26:38.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/809: fsync d5/dc/d1a/d20/d3e/f7a 0 2023-12-05T09:26:38.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/810: write d5/dc/d1a/d20/fa9 [4484774,50668] 0 2023-12-05T09:26:38.034 INFO:tasks.workunit.client.0.smithi067.stdout:8/811: stat d5/dc/f6c 0 2023-12-05T09:26:38.040 INFO:tasks.workunit.client.0.smithi067.stdout:8/812: mknod d5/da/d30/dce/cef 0 2023-12-05T09:26:38.044 INFO:tasks.workunit.client.0.smithi067.stdout:1/778: sync 2023-12-05T09:26:38.045 INFO:tasks.workunit.client.0.smithi067.stdout:4/738: write d0/d1d/d25/d2c/d34/d4e/d5a/d88/fb0 [544870,16111] 0 2023-12-05T09:26:38.048 INFO:tasks.workunit.client.0.smithi067.stdout:9/944: dread d1b/d25/d54/d5c/fb6 [0,4194304] 0 2023-12-05T09:26:38.049 INFO:tasks.workunit.client.0.smithi067.stdout:9/945: chown d1b/d25/d5b/d62/fba 7663204 1 2023-12-05T09:26:38.055 INFO:tasks.workunit.client.0.smithi067.stdout:1/779: creat d2/d3/da6/dbd/dd8/df8/f10f x:0 0 0 2023-12-05T09:26:38.055 INFO:tasks.workunit.client.0.smithi067.stdout:1/780: stat d2/d4f/d15/d60/d68/f75 0 2023-12-05T09:26:38.055 INFO:tasks.workunit.client.0.smithi067.stdout:9/946: getdents d1b/d25/d54/d5c/d81/d96 0 2023-12-05T09:26:38.055 INFO:tasks.workunit.client.0.smithi067.stdout:9/947: symlink d1b/d25/d54/d5c/de2/l139 0 2023-12-05T09:26:38.055 INFO:tasks.workunit.client.0.smithi067.stdout:9/948: chown d1b/d3e/f12e 108270618 1 2023-12-05T09:26:38.055 INFO:tasks.workunit.client.0.smithi067.stdout:9/949: chown d1b/dd3/d6c/d78/c7c 21333508 1 2023-12-05T09:26:38.056 INFO:tasks.workunit.client.0.smithi067.stdout:9/950: mkdir d1b/d25/d13a 0 2023-12-05T09:26:38.056 INFO:tasks.workunit.client.0.smithi067.stdout:9/951: creat d1b/dd3/d6c/d76/f13b x:0 0 0 2023-12-05T09:26:38.061 INFO:tasks.workunit.client.0.smithi067.stdout:1/781: dread d2/d5/d7/de/d19/d8f/d98/fc7 [0,4194304] 0 2023-12-05T09:26:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:38 smithi067 ceph-mon[107174]: pgmap v34: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 220 MiB/s rd, 289 MiB/s wr, 426 op/s 2023-12-05T09:26:38.070 INFO:tasks.workunit.client.0.smithi067.stdout:7/697: dread d0/f4c [0,4194304] 0 2023-12-05T09:26:38.072 INFO:tasks.workunit.client.0.smithi067.stdout:3/680: dwrite d9/da/d15/d17/fa6 [0,4194304] 0 2023-12-05T09:26:38.073 INFO:tasks.workunit.client.0.smithi067.stdout:7/698: creat d0/d9/d10/d1d/fe8 x:0 0 0 2023-12-05T09:26:38.073 INFO:tasks.workunit.client.0.smithi067.stdout:6/680: dwrite da/d10/d1e/d17/d2f/d1f/d27/fac [4194304,4194304] 0 2023-12-05T09:26:38.073 INFO:tasks.workunit.client.0.smithi067.stdout:4/739: dread d0/d1d/d2a/fae [0,4194304] 0 2023-12-05T09:26:38.073 INFO:tasks.workunit.client.0.smithi067.stdout:1/782: read d2/d5/d7/de/d19/d8f/d98/fc7 [605081,102444] 0 2023-12-05T09:26:38.073 INFO:tasks.workunit.client.0.smithi067.stdout:2/692: dwrite d0/d25/d9d/d53/d1e/d8e/dd0/d39/fa5 [0,4194304] 0 2023-12-05T09:26:38.073 INFO:tasks.workunit.client.0.smithi067.stdout:1/783: chown d2/d4f/d14/d20/d4c/f65 991807211 1 2023-12-05T09:26:38.084 INFO:tasks.workunit.client.0.smithi067.stdout:8/813: truncate d5/d3b/fa1 174317 0 2023-12-05T09:26:38.087 INFO:tasks.workunit.client.0.smithi067.stdout:3/681: rename d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/fde to d9/da/d3b/ff1 0 2023-12-05T09:26:38.091 INFO:tasks.workunit.client.0.smithi067.stdout:7/699: unlink d0/f76 0 2023-12-05T09:26:38.091 INFO:tasks.workunit.client.0.smithi067.stdout:7/700: truncate d0/d9/d10/d37/d38/d64/d34/fd9 303237 0 2023-12-05T09:26:38.091 INFO:tasks.workunit.client.0.smithi067.stdout:7/701: chown d0/d9/d10/d1d/c59 13528729 1 2023-12-05T09:26:38.091 INFO:tasks.workunit.client.0.smithi067.stdout:7/702: readlink d0/d9/d10/d37/d38/d64/d54/la8 0 2023-12-05T09:26:38.094 INFO:tasks.workunit.client.0.smithi067.stdout:6/681: unlink da/d10/d1e/d17/d2f/d72/f82 0 2023-12-05T09:26:38.094 INFO:tasks.workunit.client.0.smithi067.stdout:8/814: dread d5/f45 [0,4194304] 0 2023-12-05T09:26:38.094 INFO:tasks.workunit.client.0.smithi067.stdout:8/815: rename d5/dc/d1a/d20 to d5/dc/d1a/d20/d2d/d7f/d94/df0 22 2023-12-05T09:26:38.105 INFO:tasks.workunit.client.0.smithi067.stdout:1/784: mknod d2/d5/d50/c110 0 2023-12-05T09:26:38.105 INFO:tasks.workunit.client.0.smithi067.stdout:1/785: chown d2/d5/d7/de/d19/d8f/d98/cf6 1265570 1 2023-12-05T09:26:38.105 INFO:tasks.workunit.client.0.smithi067.stdout:4/740: rmdir d0/d1d/d2b 39 2023-12-05T09:26:38.105 INFO:tasks.workunit.client.0.smithi067.stdout:3/682: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/lf2 0 2023-12-05T09:26:38.105 INFO:tasks.workunit.client.0.smithi067.stdout:5/743: sync 2023-12-05T09:26:38.108 INFO:tasks.workunit.client.0.smithi067.stdout:0/900: sync 2023-12-05T09:26:38.108 INFO:tasks.workunit.client.0.smithi067.stdout:0/901: read - d3/d7/d30/ff4 zero size 2023-12-05T09:26:38.111 INFO:tasks.workunit.client.0.smithi067.stdout:4/741: mkdir d0/d1d/d25/d32/d107 0 2023-12-05T09:26:38.111 INFO:tasks.workunit.client.0.smithi067.stdout:4/742: readlink d0/d1d/d2a/d72/la7 0 2023-12-05T09:26:38.111 INFO:tasks.workunit.client.0.smithi067.stdout:4/743: creat d0/f108 x:0 0 0 2023-12-05T09:26:38.113 INFO:tasks.workunit.client.0.smithi067.stdout:6/682: dread da/d10/d1e/d17/d2f/d59/d6c/fc9 [0,4194304] 0 2023-12-05T09:26:38.113 INFO:tasks.workunit.client.0.smithi067.stdout:6/683: chown da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6 17903164 1 2023-12-05T09:26:38.113 INFO:tasks.workunit.client.0.smithi067.stdout:6/684: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/fed x:0 0 0 2023-12-05T09:26:38.120 INFO:tasks.workunit.client.0.smithi067.stdout:5/744: unlink db/df/f53 0 2023-12-05T09:26:38.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/744: mknod d0/d1d/d53/c109 0 2023-12-05T09:26:38.120 INFO:tasks.workunit.client.0.smithi067.stdout:4/745: write d0/d1d/d2a/dba/fc8 [913541,77943] 0 2023-12-05T09:26:38.123 INFO:tasks.workunit.client.0.smithi067.stdout:8/816: dread d5/dc/f3f [0,4194304] 0 2023-12-05T09:26:38.123 INFO:tasks.workunit.client.0.smithi067.stdout:8/817: creat d5/dc/d1a/d62/d7e/ff1 x:0 0 0 2023-12-05T09:26:38.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/685: rename da/dde/d3b/ddd to da/d10/d1e/d51/d7b/dee 0 2023-12-05T09:26:38.128 INFO:tasks.workunit.client.0.smithi067.stdout:8/818: mknod d5/dc/d1a/d20/d58/d90/cf2 0 2023-12-05T09:26:38.131 INFO:tasks.workunit.client.0.smithi067.stdout:6/686: symlink da/d10/d1e/d51/d7b/lef 0 2023-12-05T09:26:38.136 INFO:tasks.workunit.client.0.smithi067.stdout:4/746: getdents d0/d1d/d25/d38 0 2023-12-05T09:26:38.141 INFO:tasks.workunit.client.0.smithi067.stdout:5/745: link db/df/d3f/d88/f5c db/df/d82/f101 0 2023-12-05T09:26:38.146 INFO:tasks.workunit.client.0.smithi067.stdout:4/747: creat d0/d1d/d25/d38/f10a x:0 0 0 2023-12-05T09:26:38.148 INFO:tasks.workunit.client.0.smithi067.stdout:4/748: write d0/d1d/d2a/d93/ddc/fdf [1024349,122563] 0 2023-12-05T09:26:38.150 INFO:tasks.workunit.client.0.smithi067.stdout:4/749: symlink d0/d1d/d25/d2c/d34/d4e/daa/l10b 0 2023-12-05T09:26:38.153 INFO:tasks.workunit.client.0.smithi067.stdout:4/750: rename d0/d1d/d2a/dba/cdd to d0/d9/c10c 0 2023-12-05T09:26:38.158 INFO:tasks.workunit.client.0.smithi067.stdout:7/703: read d0/d9/d3f/f7e [3890276,36786] 0 2023-12-05T09:26:38.162 INFO:tasks.workunit.client.0.smithi067.stdout:2/693: dwrite d0/d25/d48/f6b [0,4194304] 0 2023-12-05T09:26:38.162 INFO:tasks.workunit.client.0.smithi067.stdout:2/694: read - d0/d25/d9d/d53/d1e/d8e/dd0/d84/fc0 zero size 2023-12-05T09:26:38.162 INFO:tasks.workunit.client.0.smithi067.stdout:7/704: rmdir d0/d9/d40/d7a/dad/dc2/dda 0 2023-12-05T09:26:38.167 INFO:tasks.workunit.client.0.smithi067.stdout:2/695: rename d0/d25/d9d/d53/d1e/d7f/f91 to d0/d25/d34/d4d/db0/dce/ff6 0 2023-12-05T09:26:38.170 INFO:tasks.workunit.client.0.smithi067.stdout:2/696: creat d0/d25/d34/d4d/db0/dce/dd3/df0/ff7 x:0 0 0 2023-12-05T09:26:38.173 INFO:tasks.workunit.client.0.smithi067.stdout:2/697: symlink d0/d7c/lf8 0 2023-12-05T09:26:38.173 INFO:tasks.workunit.client.0.smithi067.stdout:2/698: chown d0/d25/d34/d4d/f81 406037213 1 2023-12-05T09:26:38.175 INFO:tasks.workunit.client.0.smithi067.stdout:2/699: creat d0/d25/d34/d4d/d54/d56/ff9 x:0 0 0 2023-12-05T09:26:38.177 INFO:tasks.workunit.client.0.smithi067.stdout:7/705: dread d0/d9/f5f [0,4194304] 0 2023-12-05T09:26:38.177 INFO:tasks.workunit.client.0.smithi067.stdout:1/786: dwrite d2/d5/d7/de/d1a/f4b [0,4194304] 0 2023-12-05T09:26:38.179 INFO:tasks.workunit.client.0.smithi067.stdout:2/700: mknod d0/d25/d9d/d53/d1e/d8e/dd0/d84/cfa 0 2023-12-05T09:26:38.179 INFO:tasks.workunit.client.0.smithi067.stdout:2/701: stat d0/d25/d3f/l62 0 2023-12-05T09:26:38.183 INFO:tasks.workunit.client.0.smithi067.stdout:2/702: symlink d0/d25/d34/d4d/db0/dbf/lfb 0 2023-12-05T09:26:38.184 INFO:tasks.workunit.client.0.smithi067.stdout:3/683: dwrite d9/d24/db8/fe5 [0,4194304] 0 2023-12-05T09:26:38.186 INFO:tasks.workunit.client.0.smithi067.stdout:5/746: dread db/df/d3f/dd9/de7/dfd/d1d/d20/fd5 [0,4194304] 0 2023-12-05T09:26:38.194 INFO:tasks.workunit.client.0.smithi067.stdout:2/703: unlink d0/d25/d9d/d53/d1e/f35 0 2023-12-05T09:26:38.195 INFO:tasks.workunit.client.0.smithi067.stdout:2/704: fdatasync d0/d25/d9d/d53/d1e/d8e/dd0/faf 0 2023-12-05T09:26:38.195 INFO:tasks.workunit.client.0.smithi067.stdout:3/684: mkdir d9/da/d15/d17/d2b/df3 0 2023-12-05T09:26:38.208 INFO:tasks.workunit.client.0.smithi067.stdout:6/687: write da/d10/d1e/d17/d2f/d1f/d27/d4f/fb7 [2632200,32128] 0 2023-12-05T09:26:38.208 INFO:tasks.workunit.client.0.smithi067.stdout:6/688: stat da/d10/d1e/l1d 0 2023-12-05T09:26:38.208 INFO:tasks.workunit.client.0.smithi067.stdout:5/747: dread db/df/d35/f76 [0,4194304] 0 2023-12-05T09:26:38.208 INFO:tasks.workunit.client.0.smithi067.stdout:5/748: fdatasync db/df/f32 0 2023-12-05T09:26:38.208 INFO:tasks.workunit.client.0.smithi067.stdout:0/902: dwrite d3/d7/d3c/d67/d59/d4e/db2/f113 [0,4194304] 0 2023-12-05T09:26:38.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/705: dread d0/d25/d9d/d53/f7e [0,4194304] 0 2023-12-05T09:26:38.217 INFO:tasks.workunit.client.0.smithi067.stdout:5/749: symlink db/df/d52/l102 0 2023-12-05T09:26:38.220 INFO:tasks.workunit.client.0.smithi067.stdout:0/903: creat d3/d7/d3c/d66/f142 x:0 0 0 2023-12-05T09:26:38.225 INFO:tasks.workunit.client.0.smithi067.stdout:3/685: write d9/da/d15/d17/d1a/d51/d66/f93 [3634886,92500] 0 2023-12-05T09:26:38.225 INFO:tasks.workunit.client.0.smithi067.stdout:3/686: fsync d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/f8d 0 2023-12-05T09:26:38.228 INFO:tasks.workunit.client.0.smithi067.stdout:2/706: stat d0/d25/d34/d4d/d54/fe3 0 2023-12-05T09:26:38.231 INFO:tasks.workunit.client.0.smithi067.stdout:5/750: getdents db/df/d3f/dd9/de7/dfd/d1d 0 2023-12-05T09:26:38.236 INFO:tasks.workunit.client.0.smithi067.stdout:1/787: dwrite d2/d5/d7/de/d19/d49/d5f/f9f [0,4194304] 0 2023-12-05T09:26:38.240 INFO:tasks.workunit.client.0.smithi067.stdout:5/751: dread db/df/d3f/dd9/de7/dfd/d1d/d20/fd5 [0,4194304] 0 2023-12-05T09:26:38.242 INFO:tasks.workunit.client.0.smithi067.stdout:4/751: dwrite d0/d1d/d53/d62/f83 [0,4194304] 0 2023-12-05T09:26:38.245 INFO:tasks.workunit.client.0.smithi067.stdout:5/752: symlink db/df/d3f/l103 0 2023-12-05T09:26:38.249 INFO:tasks.workunit.client.0.smithi067.stdout:3/687: dread d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:38.254 INFO:tasks.workunit.client.0.smithi067.stdout:5/753: creat db/df/d38/f104 x:0 0 0 2023-12-05T09:26:38.259 INFO:tasks.workunit.client.0.smithi067.stdout:2/707: dread d0/d25/d48/f6b [0,4194304] 0 2023-12-05T09:26:38.260 INFO:tasks.workunit.client.0.smithi067.stdout:3/688: rename d9/da/d15/d17/d1a/d51/d66/d82/da1/fc4 to d9/da/ff4 0 2023-12-05T09:26:38.262 INFO:tasks.workunit.client.0.smithi067.stdout:5/754: creat db/df/d52/f105 x:0 0 0 2023-12-05T09:26:38.262 INFO:tasks.workunit.client.0.smithi067.stdout:5/755: write f9 [170378,79191] 0 2023-12-05T09:26:38.262 INFO:tasks.workunit.client.0.smithi067.stdout:4/752: dread d0/d1d/d2b/dd6/fc7 [0,4194304] 0 2023-12-05T09:26:38.262 INFO:tasks.workunit.client.0.smithi067.stdout:4/753: readlink d0/d1d/d53/da8/da9/d15/l3e 0 2023-12-05T09:26:38.262 INFO:tasks.workunit.client.0.smithi067.stdout:4/754: creat d0/f10d x:0 0 0 2023-12-05T09:26:38.264 INFO:tasks.workunit.client.0.smithi067.stdout:2/708: truncate d0/d25/d3f/f79 627306 0 2023-12-05T09:26:38.268 INFO:tasks.workunit.client.0.smithi067.stdout:2/709: write d0/d25/d34/d4d/d54/d90/dcf/fd8 [76738,38476] 0 2023-12-05T09:26:38.268 INFO:tasks.workunit.client.0.smithi067.stdout:2/710: chown d0/d25/d3f/d83/fa0 725171545 1 2023-12-05T09:26:38.268 INFO:tasks.workunit.client.0.smithi067.stdout:6/689: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/fcf [0,4194304] 0 2023-12-05T09:26:38.268 INFO:tasks.workunit.client.0.smithi067.stdout:3/689: rename d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/l81 to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d65/lf5 0 2023-12-05T09:26:38.274 INFO:tasks.workunit.client.0.smithi067.stdout:5/756: truncate db/df/d3f/dd9/de7/dfd/d1d/d20/f37 5602436 0 2023-12-05T09:26:38.277 INFO:tasks.workunit.client.0.smithi067.stdout:5/757: symlink db/df/d36/l106 0 2023-12-05T09:26:38.279 INFO:tasks.workunit.client.0.smithi067.stdout:5/758: creat db/df/d36/d6c/dc1/f107 x:0 0 0 2023-12-05T09:26:38.281 INFO:tasks.workunit.client.0.smithi067.stdout:5/759: symlink db/df/ddb/l108 0 2023-12-05T09:26:38.281 INFO:tasks.workunit.client.0.smithi067.stdout:5/760: write db/df/d3f/d88/d8d/fc4 [1437252,24635] 0 2023-12-05T09:26:38.329 INFO:tasks.workunit.client.0.smithi067.stdout:0/904: dwrite d3/d7/d30/f93 [0,4194304] 0 2023-12-05T09:26:38.332 INFO:tasks.workunit.client.0.smithi067.stdout:0/905: mknod d3/d6b/d6e/d13d/c143 0 2023-12-05T09:26:38.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/690: dwrite d9/da/d15/d17/d1a/d51/d66/fd9 [0,4194304] 0 2023-12-05T09:26:38.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/691: truncate d9/da/d15/d17/d1a/d51/d66/f98 1750117 0 2023-12-05T09:26:38.333 INFO:tasks.workunit.client.0.smithi067.stdout:3/692: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/f8d [138631,61813] 0 2023-12-05T09:26:38.334 INFO:tasks.workunit.client.0.smithi067.stdout:0/906: rmdir d3/d7/d3c/d67/da1 39 2023-12-05T09:26:38.334 INFO:tasks.workunit.client.0.smithi067.stdout:3/693: rmdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92 39 2023-12-05T09:26:38.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/907: stat d3/c34 0 2023-12-05T09:26:38.335 INFO:tasks.workunit.client.0.smithi067.stdout:0/908: creat d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/f144 x:0 0 0 2023-12-05T09:26:38.337 INFO:tasks.workunit.client.0.smithi067.stdout:3/694: rename d9/f43 to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/ff6 0 2023-12-05T09:26:38.337 INFO:tasks.workunit.client.0.smithi067.stdout:3/695: dread - d9/da/d15/d17/d1a/d51/d66/d82/da1/fb5 zero size 2023-12-05T09:26:38.340 INFO:tasks.workunit.client.0.smithi067.stdout:0/909: symlink d3/d7/d3c/d67/d59/deb/l145 0 2023-12-05T09:26:38.341 INFO:tasks.workunit.client.0.smithi067.stdout:0/910: creat d3/d7/d30/f146 x:0 0 0 2023-12-05T09:26:38.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/696: symlink d9/da/d15/d17/d2b/df3/lf7 0 2023-12-05T09:26:38.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/697: stat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d65 0 2023-12-05T09:26:38.341 INFO:tasks.workunit.client.0.smithi067.stdout:3/698: creat d9/da/ff8 x:0 0 0 2023-12-05T09:26:38.343 INFO:tasks.workunit.client.0.smithi067.stdout:0/911: symlink d3/d7/d3c/d67/l147 0 2023-12-05T09:26:38.350 INFO:tasks.workunit.client.0.smithi067.stdout:0/912: creat d3/d7/d3c/d8d/f148 x:0 0 0 2023-12-05T09:26:38.352 INFO:tasks.workunit.client.0.smithi067.stdout:0/913: creat d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/f149 x:0 0 0 2023-12-05T09:26:38.355 INFO:tasks.workunit.client.0.smithi067.stdout:6/690: dwrite da/dde/f58 [0,4194304] 0 2023-12-05T09:26:38.355 INFO:tasks.workunit.client.0.smithi067.stdout:0/914: mkdir d3/d6b/d10a/d14a 0 2023-12-05T09:26:38.362 INFO:tasks.workunit.client.0.smithi067.stdout:6/691: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/ff0 x:0 0 0 2023-12-05T09:26:38.363 INFO:tasks.workunit.client.0.smithi067.stdout:0/915: symlink d3/d7/d3c/d67/d59/d5c/l14b 0 2023-12-05T09:26:38.370 INFO:tasks.workunit.client.0.smithi067.stdout:5/761: dwrite db/df/d3f/fc3 [0,4194304] 0 2023-12-05T09:26:38.370 INFO:tasks.workunit.client.0.smithi067.stdout:5/762: chown db/df/d36/d57/fda 7483 1 2023-12-05T09:26:38.370 INFO:tasks.workunit.client.0.smithi067.stdout:5/763: truncate db/df/d3f/d88/d8d/fc4 1833711 0 2023-12-05T09:26:38.370 INFO:tasks.workunit.client.0.smithi067.stdout:5/764: write db/df/d36/d57/f9e [954603,85856] 0 2023-12-05T09:26:38.370 INFO:tasks.workunit.client.0.smithi067.stdout:5/765: fdatasync db/df/d36/d57/f73 0 2023-12-05T09:26:38.371 INFO:tasks.workunit.client.0.smithi067.stdout:5/766: write db/df/d3f/d88/fc5 [4646792,24877] 0 2023-12-05T09:26:38.371 INFO:tasks.workunit.client.0.smithi067.stdout:2/711: dwrite d0/d25/d9d/d53/d1e/d8e/dd0/f37 [0,4194304] 0 2023-12-05T09:26:38.371 INFO:tasks.workunit.client.0.smithi067.stdout:4/755: dwrite d0/d9/fb7 [0,4194304] 0 2023-12-05T09:26:38.377 INFO:tasks.workunit.client.0.smithi067.stdout:6/692: write da/d10/d1e/d17/d2f/d1f/fd0 [1010746,35078] 0 2023-12-05T09:26:38.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:38 smithi134 ceph-mon[116304]: pgmap v34: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 220 MiB/s rd, 289 MiB/s wr, 426 op/s 2023-12-05T09:26:38.402 INFO:tasks.workunit.client.0.smithi067.stdout:3/699: getdents d9/da 0 2023-12-05T09:26:38.402 INFO:tasks.workunit.client.0.smithi067.stdout:3/700: write d9/da/d15/d17/fc2 [833638,128468] 0 2023-12-05T09:26:38.408 INFO:tasks.workunit.client.0.smithi067.stdout:0/916: rename d3/d7/d3c/d6c/d76/da7/le0 to d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/l14c 0 2023-12-05T09:26:38.409 INFO:tasks.workunit.client.0.smithi067.stdout:0/917: fdatasync d3/da2/fb0 0 2023-12-05T09:26:38.409 INFO:tasks.workunit.client.0.smithi067.stdout:0/918: fsync d3/d7/d3c/d67/d59/d4e/f101 0 2023-12-05T09:26:38.416 INFO:tasks.workunit.client.0.smithi067.stdout:6/693: mknod da/d10/d1e/d17/d2f/d1f/d9e/cf1 0 2023-12-05T09:26:38.418 INFO:tasks.workunit.client.0.smithi067.stdout:3/701: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d65/lf9 0 2023-12-05T09:26:38.424 INFO:tasks.workunit.client.0.smithi067.stdout:0/919: unlink d3/d7/d3c/d6c/d76/da7/dec/f3e 0 2023-12-05T09:26:38.426 INFO:tasks.workunit.client.0.smithi067.stdout:6/694: getdents da/d10/d1e/d17/d2f 0 2023-12-05T09:26:38.427 INFO:tasks.workunit.client.0.smithi067.stdout:3/702: mkdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/dfa 0 2023-12-05T09:26:38.431 INFO:tasks.workunit.client.0.smithi067.stdout:2/712: dwrite d0/d25/d9d/d53/d1e/d8e/dd0/d84/fc0 [0,4194304] 0 2023-12-05T09:26:38.431 INFO:tasks.workunit.client.0.smithi067.stdout:0/920: mkdir d3/d7/d3c/d67/d59/d5c/d14d 0 2023-12-05T09:26:38.432 INFO:tasks.workunit.client.0.smithi067.stdout:5/767: rename db/df/c2f to db/df/d82/c109 0 2023-12-05T09:26:38.440 INFO:tasks.workunit.client.0.smithi067.stdout:2/713: symlink d0/d25/d9d/d53/d1e/d8e/dd0/da3/lfc 0 2023-12-05T09:26:38.441 INFO:tasks.workunit.client.0.smithi067.stdout:6/695: read da/d10/d1e/d17/d2f/d3f/d92/fcd [1145784,44330] 0 2023-12-05T09:26:38.441 INFO:tasks.workunit.client.0.smithi067.stdout:6/696: stat da/d10/d1e/d17/d2f 0 2023-12-05T09:26:38.441 INFO:tasks.workunit.client.0.smithi067.stdout:6/697: read - da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/fb4 zero size 2023-12-05T09:26:38.442 INFO:tasks.workunit.client.0.smithi067.stdout:5/768: mknod db/df/ddb/c10a 0 2023-12-05T09:26:38.443 INFO:tasks.workunit.client.0.smithi067.stdout:5/769: write db/df/fad [779801,14813] 0 2023-12-05T09:26:38.443 INFO:tasks.workunit.client.0.smithi067.stdout:2/714: symlink d0/d25/d9d/d53/d1e/d8e/dd0/d84/de8/df3/lfd 0 2023-12-05T09:26:38.444 INFO:tasks.workunit.client.0.smithi067.stdout:6/698: mknod da/d10/d1e/d17/d2f/d1f/d9e/cf2 0 2023-12-05T09:26:38.446 INFO:tasks.workunit.client.0.smithi067.stdout:0/921: getdents d3/d7/d3c/d67/d59/deb 0 2023-12-05T09:26:38.448 INFO:tasks.workunit.client.0.smithi067.stdout:2/715: rename d0/d25/d9d/d53/f7e to d0/d25/d34/d4d/d78/ffe 0 2023-12-05T09:26:38.450 INFO:tasks.workunit.client.0.smithi067.stdout:6/699: creat da/d10/d1e/d69/dcb/ff3 x:0 0 0 2023-12-05T09:26:38.452 INFO:tasks.workunit.client.0.smithi067.stdout:6/700: creat da/d10/d1e/d51/d7b/dd6/ff4 x:0 0 0 2023-12-05T09:26:38.452 INFO:tasks.workunit.client.0.smithi067.stdout:0/922: symlink d3/da2/l14e 0 2023-12-05T09:26:38.452 INFO:tasks.workunit.client.0.smithi067.stdout:0/923: fdatasync d3/d7/d3c/d67/d59/d4e/fde 0 2023-12-05T09:26:38.458 INFO:tasks.workunit.client.0.smithi067.stdout:0/924: unlink d3/l13c 0 2023-12-05T09:26:38.458 INFO:tasks.workunit.client.0.smithi067.stdout:0/925: readlink d3/d7/d3c/d66/l110 0 2023-12-05T09:26:38.493 INFO:tasks.workunit.client.0.smithi067.stdout:2/716: write d0/d25/d34/d4a/fb3 [3202305,87497] 0 2023-12-05T09:26:38.505 INFO:tasks.workunit.client.0.smithi067.stdout:5/770: dread db/df/d3f/dd9/de7/dfd/d1d/f23 [0,4194304] 0 2023-12-05T09:26:38.507 INFO:tasks.workunit.client.0.smithi067.stdout:5/771: link db/df/d36/d57/cd7 db/c10b 0 2023-12-05T09:26:38.507 INFO:tasks.workunit.client.0.smithi067.stdout:5/772: chown db/df/d3f/dd9/de7/dfd/d1d/d20/f2a 797585 1 2023-12-05T09:26:38.510 INFO:tasks.workunit.client.0.smithi067.stdout:6/701: dwrite da/d10/d1e/d51/d7b/dd6/ff4 [0,4194304] 0 2023-12-05T09:26:38.512 INFO:tasks.workunit.client.0.smithi067.stdout:9/952: sync 2023-12-05T09:26:38.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/703: dwrite d9/da/d15/d17/d1a/d51/dcd/fe3 [0,4194304] 0 2023-12-05T09:26:38.514 INFO:tasks.workunit.client.0.smithi067.stdout:2/717: write d0/d7c/faa [4162835,17062] 0 2023-12-05T09:26:38.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/704: dread - d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/fe6 zero size 2023-12-05T09:26:38.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/705: chown d9/da/fca 6378 1 2023-12-05T09:26:38.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/706: getdents d9/da 0 2023-12-05T09:26:38.514 INFO:tasks.workunit.client.0.smithi067.stdout:3/707: creat d9/d24/db6/ffb x:0 0 0 2023-12-05T09:26:38.515 INFO:tasks.workunit.client.0.smithi067.stdout:3/708: write d9/d24/db6/fdb [825029,34929] 0 2023-12-05T09:26:38.515 INFO:tasks.workunit.client.0.smithi067.stdout:3/709: stat d9/d62/f4c 0 2023-12-05T09:26:38.515 INFO:tasks.workunit.client.0.smithi067.stdout:3/710: readlink d9/lc5 0 2023-12-05T09:26:38.517 INFO:tasks.workunit.client.0.smithi067.stdout:0/926: dwrite d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/dcf/f11a [0,4194304] 0 2023-12-05T09:26:38.517 INFO:tasks.workunit.client.0.smithi067.stdout:2/718: symlink d0/d25/d3f/lff 0 2023-12-05T09:26:38.521 INFO:tasks.workunit.client.0.smithi067.stdout:2/719: read d0/d25/d34/d4d/d54/d90/dcf/fd8 [39459,130936] 0 2023-12-05T09:26:38.521 INFO:tasks.workunit.client.0.smithi067.stdout:2/720: truncate d0/d25/d9d/d53/d1e/d8e/dd0/d39/f89 4881100 0 2023-12-05T09:26:38.521 INFO:tasks.workunit.client.0.smithi067.stdout:9/953: dread d1b/d25/f50 [0,4194304] 0 2023-12-05T09:26:38.521 INFO:tasks.workunit.client.0.smithi067.stdout:9/954: write d1b/d25/d35/d56/dc7/f11e [298364,120829] 0 2023-12-05T09:26:38.529 INFO:tasks.workunit.client.0.smithi067.stdout:2/721: read d0/d25/f4e [44322,24151] 0 2023-12-05T09:26:38.533 INFO:tasks.workunit.client.0.smithi067.stdout:5/773: write db/df/d3f/dd9/de7/dfd/f6a [4142565,48265] 0 2023-12-05T09:26:38.533 INFO:tasks.workunit.client.0.smithi067.stdout:5/774: chown db/df/d35/d63/c81 1 1 2023-12-05T09:26:38.539 INFO:tasks.workunit.client.0.smithi067.stdout:3/711: dread d9/da/d3b/fc6 [0,4194304] 0 2023-12-05T09:26:38.539 INFO:tasks.workunit.client.0.smithi067.stdout:5/775: creat db/df/d36/f10c x:0 0 0 2023-12-05T09:26:38.539 INFO:tasks.workunit.client.0.smithi067.stdout:3/712: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/fe6 [912680,25716] 0 2023-12-05T09:26:38.539 INFO:tasks.workunit.client.0.smithi067.stdout:5/776: fdatasync db/df/d3f/dd9/de7/dfd/d1d/d20/f51 0 2023-12-05T09:26:38.541 INFO:tasks.workunit.client.0.smithi067.stdout:0/927: dread d3/d6b/f6f [0,4194304] 0 2023-12-05T09:26:38.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/702: write da/d10/d1e/d51/d7b/dd6/fea [3450883,64717] 0 2023-12-05T09:26:38.543 INFO:tasks.workunit.client.0.smithi067.stdout:6/703: fsync da/d10/d1e/d17/d2f/d1f/d9e/fce 0 2023-12-05T09:26:38.544 INFO:tasks.workunit.client.0.smithi067.stdout:3/713: symlink d9/da/d15/d17/d2b/lfc 0 2023-12-05T09:26:38.547 INFO:tasks.workunit.client.0.smithi067.stdout:2/722: write d0/d25/d9d/f76 [734341,11454] 0 2023-12-05T09:26:38.547 INFO:tasks.workunit.client.0.smithi067.stdout:5/777: rmdir db/df/d3f/dd9/de7/dfd/d59 39 2023-12-05T09:26:38.549 INFO:tasks.workunit.client.0.smithi067.stdout:0/928: symlink d3/d6b/d6e/d13d/l14f 0 2023-12-05T09:26:38.549 INFO:tasks.workunit.client.0.smithi067.stdout:6/704: mkdir da/d10/d1e/d17/d2f/df5 0 2023-12-05T09:26:38.550 INFO:tasks.workunit.client.0.smithi067.stdout:6/705: creat da/d10/d1e/d17/d2f/d1f/d9e/ff6 x:0 0 0 2023-12-05T09:26:38.554 INFO:tasks.workunit.client.0.smithi067.stdout:6/706: mkdir da/d10/d1e/d17/d2f/d2c/df7 0 2023-12-05T09:26:38.554 INFO:tasks.workunit.client.0.smithi067.stdout:0/929: unlink d3/d7/l1b 0 2023-12-05T09:26:38.554 INFO:tasks.workunit.client.0.smithi067.stdout:0/930: chown d3/d7/d3c/d66/l78 15 1 2023-12-05T09:26:38.556 INFO:tasks.workunit.client.0.smithi067.stdout:0/931: creat d3/d7/d3c/d6c/d76/da7/dec/f150 x:0 0 0 2023-12-05T09:26:38.557 INFO:tasks.workunit.client.0.smithi067.stdout:2/723: dread d0/d25/d34/d4d/d54/d90/fe4 [0,4194304] 0 2023-12-05T09:26:38.558 INFO:tasks.workunit.client.0.smithi067.stdout:6/707: rename da/dde/l48 to da/d10/d1e/d17/d2f/d1f/d27/daa/lf8 0 2023-12-05T09:26:38.558 INFO:tasks.workunit.client.0.smithi067.stdout:2/724: rename d0/d7c to d0/d7c/d100 22 2023-12-05T09:26:38.564 INFO:tasks.workunit.client.0.smithi067.stdout:6/708: creat da/d10/d1e/d17/d2f/df5/ff9 x:0 0 0 2023-12-05T09:26:38.565 INFO:tasks.workunit.client.0.smithi067.stdout:6/709: mknod da/d10/d1e/d17/d2f/d59/cfa 0 2023-12-05T09:26:38.568 INFO:tasks.workunit.client.0.smithi067.stdout:6/710: write da/d10/d1e/d17/f40 [1556209,11180] 0 2023-12-05T09:26:38.568 INFO:tasks.workunit.client.0.smithi067.stdout:6/711: chown da/d10/d1e/d17/d2f/d1f/d27/d4f/cab 2155 1 2023-12-05T09:26:38.573 INFO:tasks.workunit.client.0.smithi067.stdout:0/932: dread d3/d7/d3c/f50 [0,4194304] 0 2023-12-05T09:26:38.581 INFO:tasks.workunit.client.0.smithi067.stdout:0/933: dread d3/d7/d30/f8c [0,4194304] 0 2023-12-05T09:26:38.590 INFO:tasks.workunit.client.0.smithi067.stdout:6/712: write da/d10/d1e/f4b [2248780,122910] 0 2023-12-05T09:26:38.592 INFO:tasks.workunit.client.0.smithi067.stdout:6/713: getdents da/d10/d1e/d17/d2f/d1f/d27/d4f/d87 0 2023-12-05T09:26:38.592 INFO:tasks.workunit.client.0.smithi067.stdout:6/714: write da/d10/d1e/d17/d2f/d3f/d92/fcd [2064805,12564] 0 2023-12-05T09:26:38.592 INFO:tasks.workunit.client.0.smithi067.stdout:6/715: stat da/d10/d1e/d17/d2f/d1f/c55 0 2023-12-05T09:26:38.594 INFO:tasks.workunit.client.0.smithi067.stdout:6/716: rename da/dde/f58 to da/d10/d1e/d17/d2f/d59/d6c/ffb 0 2023-12-05T09:26:38.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/778: dwrite db/df/d36/f7b [0,4194304] 0 2023-12-05T09:26:38.600 INFO:tasks.workunit.client.0.smithi067.stdout:6/717: mknod da/d10/d1e/d17/d2f/d2c/dc3/cfc 0 2023-12-05T09:26:38.601 INFO:tasks.workunit.client.0.smithi067.stdout:9/955: dwrite d1b/d25/d35/f4f [0,4194304] 0 2023-12-05T09:26:38.606 INFO:tasks.workunit.client.0.smithi067.stdout:0/934: write d3/d7/d3c/d67/d59/d4e/d94/d116/f20 [164759,128551] 0 2023-12-05T09:26:38.608 INFO:tasks.workunit.client.0.smithi067.stdout:5/779: dread db/df/d3f/d88/d8d/fcc [0,4194304] 0 2023-12-05T09:26:38.623 INFO:tasks.workunit.client.0.smithi067.stdout:0/935: link d3/d7/d3c/d67/d59/d4e/f83 d3/d7/dd7/f151 0 2023-12-05T09:26:38.626 INFO:tasks.workunit.client.0.smithi067.stdout:6/718: rename da/d10/d1e/d69 to da/d10/d1e/d17/d2f/d1f/d9e/dfd 0 2023-12-05T09:26:38.626 INFO:tasks.workunit.client.0.smithi067.stdout:6/719: readlink da/d10/d1e/l8f 0 2023-12-05T09:26:38.626 INFO:tasks.workunit.client.0.smithi067.stdout:6/720: fdatasync da/d10/d1e/d51/f65 0 2023-12-05T09:26:38.626 INFO:tasks.workunit.client.0.smithi067.stdout:6/721: write da/d10/d1e/d17/f23 [7232460,34111] 0 2023-12-05T09:26:38.626 INFO:tasks.workunit.client.0.smithi067.stdout:6/722: dread - da/d10/d1e/fa9 zero size 2023-12-05T09:26:38.634 INFO:tasks.workunit.client.0.smithi067.stdout:0/936: mknod d3/d7/d3c/d66/c152 0 2023-12-05T09:26:38.634 INFO:tasks.workunit.client.0.smithi067.stdout:0/937: creat d3/d7/d3c/ddb/f153 x:0 0 0 2023-12-05T09:26:38.634 INFO:tasks.workunit.client.0.smithi067.stdout:0/938: chown d3/d7/d3c/d8d 5334071 1 2023-12-05T09:26:38.635 INFO:tasks.workunit.client.0.smithi067.stdout:0/939: creat d3/d7/d30/f154 x:0 0 0 2023-12-05T09:26:38.638 INFO:tasks.workunit.client.0.smithi067.stdout:5/780: rename db/df/d3f/dd9/de7/dfd/d1d/f23 to db/df/d82/f10d 0 2023-12-05T09:26:38.638 INFO:tasks.workunit.client.0.smithi067.stdout:5/781: fsync db/df/d3f/dd9/de7/dfd/f28 0 2023-12-05T09:26:38.638 INFO:tasks.workunit.client.0.smithi067.stdout:5/782: write db/df/d36/d57/f5d [6203458,98527] 0 2023-12-05T09:26:38.638 INFO:tasks.workunit.client.0.smithi067.stdout:5/783: write db/df/d3f/dd9/de7/dfd/d1d/d20/fff [1007520,108133] 0 2023-12-05T09:26:38.640 INFO:tasks.workunit.client.0.smithi067.stdout:0/940: rmdir d3/d7/d3c/d67 39 2023-12-05T09:26:38.642 INFO:tasks.workunit.client.0.smithi067.stdout:5/784: mkdir db/df/d3f/dd9/de7/d10e 0 2023-12-05T09:26:38.642 INFO:tasks.workunit.client.0.smithi067.stdout:5/785: stat db/df/d3f/dd9/de7/dfd/d1d/d20/f70 0 2023-12-05T09:26:38.642 INFO:tasks.workunit.client.0.smithi067.stdout:5/786: creat db/df/d36/d57/f10f x:0 0 0 2023-12-05T09:26:38.647 INFO:tasks.workunit.client.0.smithi067.stdout:0/941: getdents d3/d7/dd7 0 2023-12-05T09:26:38.647 INFO:tasks.workunit.client.0.smithi067.stdout:0/942: truncate d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/f13a 382269 0 2023-12-05T09:26:38.648 INFO:tasks.workunit.client.0.smithi067.stdout:0/943: creat d3/d7/f155 x:0 0 0 2023-12-05T09:26:38.648 INFO:tasks.workunit.client.0.smithi067.stdout:0/944: fsync d3/d7/d3c/d67/d59/d4e/db2/f113 0 2023-12-05T09:26:38.648 INFO:tasks.workunit.client.0.smithi067.stdout:0/945: chown d3/d7/cc3 518214484 1 2023-12-05T09:26:38.649 INFO:tasks.workunit.client.0.smithi067.stdout:0/946: dread - d3/d7/d30/f146 zero size 2023-12-05T09:26:38.649 INFO:tasks.workunit.client.0.smithi067.stdout:5/787: write db/df/fad [134992,37213] 0 2023-12-05T09:26:38.654 INFO:tasks.workunit.client.0.smithi067.stdout:0/947: stat d3/d7/d3c/d67/d59/d4e/d94/d116/c23 0 2023-12-05T09:26:38.654 INFO:tasks.workunit.client.0.smithi067.stdout:0/948: stat d3/d7/d3c/fa3 0 2023-12-05T09:26:38.656 INFO:tasks.workunit.client.0.smithi067.stdout:5/788: mkdir db/df/d3f/dd9/de7/dfd/d59/dae/d110 0 2023-12-05T09:26:38.663 INFO:tasks.workunit.client.0.smithi067.stdout:0/949: link d3/d7/d30/l45 d3/d7/d3c/d67/d59/d4e/d94/l156 0 2023-12-05T09:26:38.669 INFO:tasks.workunit.client.0.smithi067.stdout:5/789: mknod db/df/d3f/dd9/de7/dfd/d1d/d20/c111 0 2023-12-05T09:26:38.685 INFO:tasks.workunit.client.0.smithi067.stdout:0/950: dread d3/d7/f71 [0,4194304] 0 2023-12-05T09:26:38.685 INFO:tasks.workunit.client.0.smithi067.stdout:9/956: dwrite d1b/d25/d54/d5c/f69 [4194304,4194304] 0 2023-12-05T09:26:38.685 INFO:tasks.workunit.client.0.smithi067.stdout:0/951: creat d3/d7/d3c/d8d/f157 x:0 0 0 2023-12-05T09:26:38.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/957: mknod d1b/d25/d5b/c13c 0 2023-12-05T09:26:38.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/958: stat d1b/d25/f50 0 2023-12-05T09:26:38.688 INFO:tasks.workunit.client.0.smithi067.stdout:9/959: write d1b/d25/d35/d56/fe3 [956083,114087] 0 2023-12-05T09:26:38.691 INFO:tasks.workunit.client.0.smithi067.stdout:5/790: write db/df/d35/d63/d75/f7d [3352549,95900] 0 2023-12-05T09:26:38.697 INFO:tasks.workunit.client.0.smithi067.stdout:9/960: symlink d1b/d25/d35/d56/l13d 0 2023-12-05T09:26:38.704 INFO:tasks.workunit.client.0.smithi067.stdout:6/723: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/f4c [0,4194304] 0 2023-12-05T09:26:38.707 INFO:tasks.workunit.client.0.smithi067.stdout:5/791: write db/df/f50 [2205969,80833] 0 2023-12-05T09:26:38.707 INFO:tasks.workunit.client.0.smithi067.stdout:5/792: readlink db/df/db5/lf3 0 2023-12-05T09:26:38.715 INFO:tasks.workunit.client.0.smithi067.stdout:5/793: mknod db/df/d3f/dd9/de7/dfd/d59/dae/d110/c112 0 2023-12-05T09:26:38.715 INFO:tasks.workunit.client.0.smithi067.stdout:5/794: write db/df/d35/d63/d75/fb2 [134074,36184] 0 2023-12-05T09:26:38.715 INFO:tasks.workunit.client.0.smithi067.stdout:5/795: fdatasync db/df/d3f/d88/f5c 0 2023-12-05T09:26:38.721 INFO:tasks.workunit.client.0.smithi067.stdout:0/952: rename d3/d7/d3c/d67/d59/d4e/db2 to d3/d158 0 2023-12-05T09:26:38.721 INFO:tasks.workunit.client.0.smithi067.stdout:0/953: dread - d3/d7/d3c/d67/d59/d4e/d94/d116/d124/fe4 zero size 2023-12-05T09:26:38.721 INFO:tasks.workunit.client.0.smithi067.stdout:0/954: chown d3/d7/d3c/d6c/d76/da7 97510474 1 2023-12-05T09:26:38.722 INFO:tasks.workunit.client.0.smithi067.stdout:6/724: write da/d10/d1e/d17/d2f/d1f/d9e/dfd/f93 [3703182,116937] 0 2023-12-05T09:26:38.732 INFO:tasks.workunit.client.0.smithi067.stdout:5/796: truncate db/df/d82/f8c 2690943 0 2023-12-05T09:26:38.733 INFO:tasks.workunit.client.0.smithi067.stdout:0/955: unlink d3/d7/d3c/d67/dd1/lda 0 2023-12-05T09:26:38.739 INFO:tasks.workunit.client.0.smithi067.stdout:6/725: link da/d10/d1e/d17/d2f/d1f/c86 da/d10/d1e/d51/d7b/dd6/cfe 0 2023-12-05T09:26:38.739 INFO:tasks.workunit.client.0.smithi067.stdout:6/726: read da/d10/d1e/d17/d2f/d1f/f25 [6735368,124523] 0 2023-12-05T09:26:38.739 INFO:tasks.workunit.client.0.smithi067.stdout:5/797: rename db/df/d35/dc8/feb to db/df/d3f/dd9/de7/dfd/d1d/f113 0 2023-12-05T09:26:38.739 INFO:tasks.workunit.client.0.smithi067.stdout:5/798: chown db/df/d38/lf4 8238545 1 2023-12-05T09:26:38.742 INFO:tasks.workunit.client.0.smithi067.stdout:5/799: stat db/df/d35/ccd 0 2023-12-05T09:26:38.742 INFO:tasks.workunit.client.0.smithi067.stdout:5/800: dread - db/df/d82/fce zero size 2023-12-05T09:26:38.742 INFO:tasks.workunit.client.0.smithi067.stdout:5/801: write db/df/d3f/dd9/de7/dfd/d1d/d20/f90 [3747553,53906] 0 2023-12-05T09:26:38.748 INFO:tasks.workunit.client.0.smithi067.stdout:0/956: rename d3/d158/fe8 to d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/db4/f159 0 2023-12-05T09:26:38.748 INFO:tasks.workunit.client.0.smithi067.stdout:0/957: readlink d3/d7/d3c/d6c/d76/da7/dec/l60 0 2023-12-05T09:26:38.748 INFO:tasks.workunit.client.0.smithi067.stdout:0/958: chown d3/d7 32017 1 2023-12-05T09:26:38.760 INFO:tasks.workunit.client.0.smithi067.stdout:5/802: creat db/df/d3f/dd9/de7/dfd/d1d/f114 x:0 0 0 2023-12-05T09:26:38.761 INFO:tasks.workunit.client.0.smithi067.stdout:5/803: truncate db/df/d82/fb3 5033018 0 2023-12-05T09:26:38.761 INFO:tasks.workunit.client.0.smithi067.stdout:5/804: write db/df/d3f/dd9/de7/dfd/d1d/d20/f90 [5129754,122030] 0 2023-12-05T09:26:38.789 INFO:tasks.workunit.client.0.smithi067.stdout:9/961: dwrite d1b/d3e/f112 [0,4194304] 0 2023-12-05T09:26:38.789 INFO:tasks.workunit.client.0.smithi067.stdout:9/962: write d1b/d25/d5b/f137 [125437,8311] 0 2023-12-05T09:26:38.794 INFO:tasks.workunit.client.0.smithi067.stdout:9/963: getdents d1b 0 2023-12-05T09:26:38.799 INFO:tasks.workunit.client.0.smithi067.stdout:9/964: rename d1b/d25/d54/d5c/f72 to d1b/d25/d54/d5c/d81/d96/f13e 0 2023-12-05T09:26:38.802 INFO:tasks.workunit.client.0.smithi067.stdout:9/965: write d1b/d25/d35/d56/f8c [202641,129555] 0 2023-12-05T09:26:38.802 INFO:tasks.workunit.client.0.smithi067.stdout:9/966: readlink d1b/dd3/lf8 0 2023-12-05T09:26:38.802 INFO:tasks.workunit.client.0.smithi067.stdout:9/967: truncate d1b/d25/d5b/d62/fb0 727229 0 2023-12-05T09:26:38.826 INFO:tasks.workunit.client.0.smithi067.stdout:0/959: dwrite d3/d7/d3c/d67/d59/d4e/d94/d116/f1a [0,4194304] 0 2023-12-05T09:26:38.832 INFO:tasks.workunit.client.0.smithi067.stdout:0/960: mkdir d3/d15a 0 2023-12-05T09:26:38.832 INFO:tasks.workunit.client.0.smithi067.stdout:0/961: stat d3/d7/d3c/d6c/f86 0 2023-12-05T09:26:38.836 INFO:tasks.workunit.client.0.smithi067.stdout:6/727: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/fcf [0,4194304] 0 2023-12-05T09:26:38.838 INFO:tasks.workunit.client.0.smithi067.stdout:6/728: getdents da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6 0 2023-12-05T09:26:38.840 INFO:tasks.workunit.client.0.smithi067.stdout:6/729: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d79/fff x:0 0 0 2023-12-05T09:26:38.843 INFO:tasks.workunit.client.0.smithi067.stdout:6/730: unlink da/d10/c30 0 2023-12-05T09:26:38.843 INFO:tasks.workunit.client.0.smithi067.stdout:6/731: chown da/d10/d1e/d17/d2f/l13 0 1 2023-12-05T09:26:38.844 INFO:tasks.workunit.client.0.smithi067.stdout:0/962: write d3/d7/d3c/d67/f5b [636307,89061] 0 2023-12-05T09:26:38.844 INFO:tasks.workunit.client.0.smithi067.stdout:6/732: creat da/d10/f100 x:0 0 0 2023-12-05T09:26:38.847 INFO:tasks.workunit.client.0.smithi067.stdout:9/968: dwrite d1b/d25/d54/d5c/de2/f11d [0,4194304] 0 2023-12-05T09:26:38.847 INFO:tasks.workunit.client.0.smithi067.stdout:9/969: readlink d1b/l8b 0 2023-12-05T09:26:38.853 INFO:tasks.workunit.client.0.smithi067.stdout:9/970: mknod d1b/d25/d5b/d62/d134/c13f 0 2023-12-05T09:26:38.854 INFO:tasks.workunit.client.0.smithi067.stdout:0/963: link d3/d6b/l140 d3/d7/d3c/ddb/l15b 0 2023-12-05T09:26:38.854 INFO:tasks.workunit.client.0.smithi067.stdout:0/964: dread - d3/d7/f118 zero size 2023-12-05T09:26:38.854 INFO:tasks.workunit.client.0.smithi067.stdout:0/965: stat d3/d7/d3c/d6c/d76/da7/dec/l5f 0 2023-12-05T09:26:38.855 INFO:tasks.workunit.client.0.smithi067.stdout:5/805: dwrite db/df/d36/f83 [4194304,4194304] 0 2023-12-05T09:26:38.858 INFO:tasks.workunit.client.0.smithi067.stdout:5/806: link db/df/d3f/dd9/de7/dfd/d1d/d20/fa5 db/df/d3f/dd9/de7/dfd/d59/dae/f115 0 2023-12-05T09:26:38.858 INFO:tasks.workunit.client.0.smithi067.stdout:5/807: write db/df/d3f/dd9/de7/dfd/d1d/d20/fff [1520764,25220] 0 2023-12-05T09:26:38.859 INFO:tasks.workunit.client.0.smithi067.stdout:5/808: read db/df/d3f/dd9/de7/dfd/d1d/d20/fd5 [181804,89855] 0 2023-12-05T09:26:38.861 INFO:tasks.workunit.client.0.smithi067.stdout:9/971: rmdir d1b/dd3/d6c 39 2023-12-05T09:26:38.864 INFO:tasks.workunit.client.0.smithi067.stdout:8/819: sync 2023-12-05T09:26:38.865 INFO:tasks.workunit.client.0.smithi067.stdout:9/972: rmdir d1b/d25/d5b/d62/def 39 2023-12-05T09:26:38.865 INFO:tasks.workunit.client.0.smithi067.stdout:9/973: dread - d1b/dd3/d82/ff2 zero size 2023-12-05T09:26:38.865 INFO:tasks.workunit.client.0.smithi067.stdout:9/974: stat d1b/d25/d5b/d62/l10c 0 2023-12-05T09:26:38.871 INFO:tasks.workunit.client.0.smithi067.stdout:8/820: truncate d5/dc/d1a/d20/fa9 1399755 0 2023-12-05T09:26:38.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/975: rename d1b/d25/lb1 to d1b/d25/d5b/l140 0 2023-12-05T09:26:38.873 INFO:tasks.workunit.client.0.smithi067.stdout:9/976: readlink d1b/d25/d54/d5c/d81/d96/lae 0 2023-12-05T09:26:38.877 INFO:tasks.workunit.client.0.smithi067.stdout:8/821: symlink d5/dc/d1a/d20/d3e/dbf/lf3 0 2023-12-05T09:26:38.877 INFO:tasks.workunit.client.0.smithi067.stdout:0/966: dread d3/d6b/f6f [0,4194304] 0 2023-12-05T09:26:38.877 INFO:tasks.workunit.client.0.smithi067.stdout:0/967: readlink d3/d7/d3c/d66/df8/d122/l12d 0 2023-12-05T09:26:38.880 INFO:tasks.workunit.client.0.smithi067.stdout:8/822: mknod d5/d3b/db3/de6/cf4 0 2023-12-05T09:26:38.884 INFO:tasks.workunit.client.0.smithi067.stdout:8/823: rmdir d5/dc/d1a/d20/d2d/d7f/d94/da3 39 2023-12-05T09:26:38.884 INFO:tasks.workunit.client.0.smithi067.stdout:0/968: creat d3/d158/f15c x:0 0 0 2023-12-05T09:26:38.885 INFO:tasks.workunit.client.0.smithi067.stdout:0/969: write d3/da2/f79 [4550634,2670] 0 2023-12-05T09:26:38.885 INFO:tasks.workunit.client.0.smithi067.stdout:0/970: chown d3/da2/l89 23472027 1 2023-12-05T09:26:38.889 INFO:tasks.workunit.client.0.smithi067.stdout:8/824: mkdir d5/dc/d1a/d20/d58/df5 0 2023-12-05T09:26:38.903 INFO:tasks.workunit.client.0.smithi067.stdout:5/809: write db/df/d36/f7b [764598,41182] 0 2023-12-05T09:26:38.903 INFO:tasks.workunit.client.0.smithi067.stdout:5/810: write db/df/d35/f76 [766348,26101] 0 2023-12-05T09:26:38.917 INFO:tasks.workunit.client.0.smithi067.stdout:5/811: rmdir db/df/d3f/d88 39 2023-12-05T09:26:38.917 INFO:tasks.workunit.client.0.smithi067.stdout:5/812: read db/df/d36/d57/f73 [457060,76028] 0 2023-12-05T09:26:38.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/977: write d1b/f1c [1649742,36197] 0 2023-12-05T09:26:38.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/978: chown d1b/d25/d35/cbe 0 1 2023-12-05T09:26:38.935 INFO:tasks.workunit.client.0.smithi067.stdout:9/979: chown d1b/dd3/d6c/c10a 1729 1 2023-12-05T09:26:38.937 INFO:tasks.workunit.client.0.smithi067.stdout:9/980: rmdir d1b/d25/d5b/d62/def/dca 39 2023-12-05T09:26:38.937 INFO:tasks.workunit.client.0.smithi067.stdout:9/981: chown d1b/d25/f6d 111531880 1 2023-12-05T09:26:38.942 INFO:tasks.workunit.client.0.smithi067.stdout:9/982: unlink d1b/f1c 0 2023-12-05T09:26:38.944 INFO:tasks.workunit.client.0.smithi067.stdout:9/983: symlink d1b/dd3/d6c/d76/l141 0 2023-12-05T09:26:38.946 INFO:tasks.workunit.client.0.smithi067.stdout:9/984: link d1b/d25/d35/d56/c8e d1b/d25/d54/d5c/d81/c142 0 2023-12-05T09:26:38.946 INFO:tasks.workunit.client.0.smithi067.stdout:9/985: creat d1b/dc2/f143 x:0 0 0 2023-12-05T09:26:38.950 INFO:tasks.workunit.client.0.smithi067.stdout:9/986: mknod d1b/d25/d35/c144 0 2023-12-05T09:26:38.951 INFO:tasks.workunit.client.0.smithi067.stdout:9/987: write d1b/d25/d54/d5c/fa8 [4610656,115612] 0 2023-12-05T09:26:38.963 INFO:tasks.workunit.client.0.smithi067.stdout:6/733: dwrite da/d10/f5e [0,4194304] 0 2023-12-05T09:26:38.963 INFO:tasks.workunit.client.0.smithi067.stdout:6/734: chown da/d10/d1e/l8d 1 1 2023-12-05T09:26:38.963 INFO:tasks.workunit.client.0.smithi067.stdout:6/735: truncate da/d10/d1e/d17/d2f/d2c/dc3/fe7 1483142 0 2023-12-05T09:26:38.963 INFO:tasks.workunit.client.0.smithi067.stdout:6/736: write da/d10/d1e/d17/d2f/d72/f85 [7247967,130110] 0 2023-12-05T09:26:38.979 INFO:tasks.workunit.client.0.smithi067.stdout:5/813: dread db/df/d36/d57/fb7 [0,4194304] 0 2023-12-05T09:26:38.984 INFO:tasks.workunit.client.0.smithi067.stdout:0/971: dwrite d3/d7/d3c/d67/d59/d5c/f65 [0,4194304] 0 2023-12-05T09:26:38.984 INFO:tasks.workunit.client.0.smithi067.stdout:0/972: chown d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/dcf/f11a 35981902 1 2023-12-05T09:26:38.984 INFO:tasks.workunit.client.0.smithi067.stdout:0/973: chown d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/f11d 7 1 2023-12-05T09:26:38.985 INFO:tasks.workunit.client.0.smithi067.stdout:9/988: write d1b/d3e/f66 [3374657,113576] 0 2023-12-05T09:26:38.985 INFO:tasks.workunit.client.0.smithi067.stdout:9/989: readlink d1b/d25/l29 0 2023-12-05T09:26:38.986 INFO:tasks.workunit.client.0.smithi067.stdout:9/990: stat d1b/dd3/d6c/d78/f102 0 2023-12-05T09:26:38.990 INFO:tasks.workunit.client.0.smithi067.stdout:8/825: dwrite d5/fea [0,4194304] 0 2023-12-05T09:26:38.991 INFO:tasks.workunit.client.0.smithi067.stdout:8/826: write d5/dc/d1a/d20/f22 [1670860,95152] 0 2023-12-05T09:26:38.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/737: unlink da/d10/d1e/d17/d2f/d3f/d92/f9d 0 2023-12-05T09:26:39.001 INFO:tasks.workunit.client.0.smithi067.stdout:5/814: getdents db/df/d3f/dd9 0 2023-12-05T09:26:39.001 INFO:tasks.workunit.client.0.smithi067.stdout:5/815: fsync db/df/d3f/d88/f62 0 2023-12-05T09:26:39.006 INFO:tasks.workunit.client.0.smithi067.stdout:0/974: fsync d3/ff9 0 2023-12-05T09:26:39.006 INFO:tasks.workunit.client.0.smithi067.stdout:0/975: dread - d3/d7/d3c/d67/d59/d4e/fde zero size 2023-12-05T09:26:39.014 INFO:tasks.workunit.client.0.smithi067.stdout:7/706: sync 2023-12-05T09:26:39.021 INFO:tasks.workunit.client.0.smithi067.stdout:8/827: link d5/d3b/c6d d5/dc/d1a/d20/d2d/d41/db2/cf6 0 2023-12-05T09:26:39.022 INFO:tasks.workunit.client.0.smithi067.stdout:6/738: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f101 x:0 0 0 2023-12-05T09:26:39.022 INFO:tasks.workunit.client.0.smithi067.stdout:1/788: sync 2023-12-05T09:26:39.027 INFO:tasks.workunit.client.0.smithi067.stdout:5/816: rename db/c10b to db/df/d36/c116 0 2023-12-05T09:26:39.035 INFO:tasks.workunit.client.0.smithi067.stdout:0/976: link d3/d7/d3c/d67/d59/d5c/ffb d3/d7/d3c/d67/da1/f15d 0 2023-12-05T09:26:39.041 INFO:tasks.workunit.client.0.smithi067.stdout:7/707: mknod d0/d9/d56/de1/ce9 0 2023-12-05T09:26:39.047 INFO:tasks.workunit.client.0.smithi067.stdout:6/739: symlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/l102 0 2023-12-05T09:26:39.047 INFO:tasks.workunit.client.0.smithi067.stdout:8/828: dread d5/dc/d1a/d20/d2d/d7f/d94/da3/fa4 [0,4194304] 0 2023-12-05T09:26:39.061 INFO:tasks.workunit.client.0.smithi067.stdout:1/789: rename d2/d3/da6/dbb/fe0 to d2/d4f/d15/d74/d76/f111 0 2023-12-05T09:26:39.061 INFO:tasks.workunit.client.0.smithi067.stdout:7/708: symlink d0/dd4/lea 0 2023-12-05T09:26:39.061 INFO:tasks.workunit.client.0.smithi067.stdout:3/714: sync 2023-12-05T09:26:39.061 INFO:tasks.workunit.client.0.smithi067.stdout:2/725: sync 2023-12-05T09:26:39.062 INFO:tasks.workunit.client.0.smithi067.stdout:4/756: sync 2023-12-05T09:26:39.062 INFO:tasks.workunit.client.0.smithi067.stdout:5/817: write db/df/d36/d57/fb7 [2755877,1492] 0 2023-12-05T09:26:39.062 INFO:tasks.workunit.client.0.smithi067.stdout:5/818: read db/f13 [2133981,6939] 0 2023-12-05T09:26:39.069 INFO:tasks.workunit.client.0.smithi067.stdout:3/715: creat d9/da/d3b/ffd x:0 0 0 2023-12-05T09:26:39.069 INFO:tasks.workunit.client.0.smithi067.stdout:8/829: mkdir d5/dc/d1a/d20/d2d/d7f/df7 0 2023-12-05T09:26:39.073 INFO:tasks.workunit.client.0.smithi067.stdout:4/757: creat d0/d1d/d3c/f10e x:0 0 0 2023-12-05T09:26:39.074 INFO:tasks.workunit.client.0.smithi067.stdout:5/819: rename db/c5f to db/df/d3f/c117 0 2023-12-05T09:26:39.074 INFO:tasks.workunit.client.0.smithi067.stdout:5/820: dread - db/df/d3f/d88/ff5 zero size 2023-12-05T09:26:39.074 INFO:tasks.workunit.client.0.smithi067.stdout:5/821: write db/df/d3f/d88/ff5 [84782,92371] 0 2023-12-05T09:26:39.075 INFO:tasks.workunit.client.0.smithi067.stdout:2/726: getdents d0/d25/d3a 0 2023-12-05T09:26:39.085 INFO:tasks.workunit.client.0.smithi067.stdout:8/830: unlink d5/dc/d1a/d62/fc7 0 2023-12-05T09:26:39.087 INFO:tasks.workunit.client.0.smithi067.stdout:2/727: link d0/d25/d9d/d53/d1e/d7f/c9f d0/d25/d9d/d53/d1e/d8e/dd0/da3/c101 0 2023-12-05T09:26:39.087 INFO:tasks.workunit.client.0.smithi067.stdout:5/822: rename db/df/d35/d63/c84 to db/df/d3f/dd9/de7/c118 0 2023-12-05T09:26:39.087 INFO:tasks.workunit.client.0.smithi067.stdout:5/823: fdatasync db/df/d3f/d88/f62 0 2023-12-05T09:26:39.087 INFO:tasks.workunit.client.0.smithi067.stdout:5/824: stat db/df/d35/d63/fa6 0 2023-12-05T09:26:39.087 INFO:tasks.workunit.client.0.smithi067.stdout:5/825: chown db/df/d3f/c61 18800704 1 2023-12-05T09:26:39.096 INFO:tasks.workunit.client.0.smithi067.stdout:2/728: symlink d0/d25/d9d/d53/d1e/d8e/dd0/d84/de8/l102 0 2023-12-05T09:26:39.099 INFO:tasks.workunit.client.0.smithi067.stdout:8/831: dread d5/dc/d1a/d20/d2d/d7f/d94/da3/fa4 [0,4194304] 0 2023-12-05T09:26:39.109 INFO:tasks.workunit.client.0.smithi067.stdout:8/832: rename d5/dc/d1a/d20/d2d/d41/db2/le0 to d5/d3b/db3/lf8 0 2023-12-05T09:26:39.133 INFO:tasks.workunit.client.0.smithi067.stdout:9/991: dwrite d1b/dd3/d6c/d76/f7b [0,4194304] 0 2023-12-05T09:26:39.133 INFO:tasks.workunit.client.0.smithi067.stdout:9/992: readlink d1b/d25/d5b/l6b 0 2023-12-05T09:26:39.139 INFO:tasks.workunit.client.0.smithi067.stdout:9/993: link d1b/d3e/d7f/lab d1b/d25/d35/d56/dee/l145 0 2023-12-05T09:26:39.146 INFO:tasks.workunit.client.0.smithi067.stdout:9/994: rename d1b/d25/d5b/d62/def/f129 to d1b/d25/d5b/d62/def/dca/d12a/f146 0 2023-12-05T09:26:39.149 INFO:tasks.workunit.client.0.smithi067.stdout:0/977: dwrite d3/da2/f79 [0,4194304] 0 2023-12-05T09:26:39.149 INFO:tasks.workunit.client.0.smithi067.stdout:0/978: dread - d3/d7/d3c/d6c/d76/da7/dec/f128 zero size 2023-12-05T09:26:39.150 INFO:tasks.workunit.client.0.smithi067.stdout:1/790: dwrite d2/d3/f1d [0,4194304] 0 2023-12-05T09:26:39.150 INFO:tasks.workunit.client.0.smithi067.stdout:1/791: write d2/d4f/d15/d74/d76/f111 [1096271,35774] 0 2023-12-05T09:26:39.151 INFO:tasks.workunit.client.0.smithi067.stdout:1/792: stat d2/d3/da6/dbb/fbc 0 2023-12-05T09:26:39.153 INFO:tasks.workunit.client.0.smithi067.stdout:2/729: read d0/d25/d9d/d53/d1e/d8e/dd0/fb9 [355058,123230] 0 2023-12-05T09:26:39.153 INFO:tasks.workunit.client.0.smithi067.stdout:2/730: stat d0/d25/d34/d4a/l82 0 2023-12-05T09:26:39.154 INFO:tasks.workunit.client.0.smithi067.stdout:9/995: mknod d1b/dd3/d6c/d78/c147 0 2023-12-05T09:26:39.154 INFO:tasks.workunit.client.0.smithi067.stdout:9/996: fsync d1b/d25/d35/f4a 0 2023-12-05T09:26:39.158 INFO:tasks.workunit.client.0.smithi067.stdout:0/979: rename d3/d6b/f6f to d3/d7/d30/d103/f15e 0 2023-12-05T09:26:39.158 INFO:tasks.workunit.client.0.smithi067.stdout:0/980: creat d3/d7/d3c/d6c/d76/da7/dec/f15f x:0 0 0 2023-12-05T09:26:39.158 INFO:tasks.workunit.client.0.smithi067.stdout:0/981: readlink d3/d7/d3c/d6c/d76/l87 0 2023-12-05T09:26:39.158 INFO:tasks.workunit.client.0.smithi067.stdout:0/982: creat d3/d7/d3c/d8d/f160 x:0 0 0 2023-12-05T09:26:39.166 INFO:tasks.workunit.client.0.smithi067.stdout:1/793: truncate d2/d5/d7/de/d1a/f7c 3135775 0 2023-12-05T09:26:39.166 INFO:tasks.workunit.client.0.smithi067.stdout:1/794: readlink d2/d4f/d14/d20/d83/lea 0 2023-12-05T09:26:39.166 INFO:tasks.workunit.client.0.smithi067.stdout:2/731: mknod d0/d25/d34/d4d/d54/c103 0 2023-12-05T09:26:39.166 INFO:tasks.workunit.client.0.smithi067.stdout:2/732: stat d0/d25/d34/d4d/d54/d56/c57 0 2023-12-05T09:26:39.167 INFO:tasks.workunit.client.0.smithi067.stdout:9/997: link d1b/d25/fb5 d1b/dd3/d82/f148 0 2023-12-05T09:26:39.168 INFO:tasks.workunit.client.0.smithi067.stdout:0/983: unlink d3/d7/d3c/d67/d59/d4e/d94/f10e 0 2023-12-05T09:26:39.168 INFO:tasks.workunit.client.0.smithi067.stdout:0/984: write d3/d7/d3c/d67/d59/deb/f115 [663995,126815] 0 2023-12-05T09:26:39.169 INFO:tasks.workunit.client.0.smithi067.stdout:9/998: symlink d1b/d25/d54/l149 0 2023-12-05T09:26:39.169 INFO:tasks.workunit.client.0.smithi067.stdout:9/999: stat d1b/d25/d35/l48 0 2023-12-05T09:26:39.170 INFO:tasks.workunit.client.0.smithi067.stdout:0/985: creat d3/d6b/dae/f161 x:0 0 0 2023-12-05T09:26:39.171 INFO:tasks.workunit.client.0.smithi067.stdout:2/733: rmdir d0/d25/d34/d4d/d54/d90/dcf 39 2023-12-05T09:26:39.171 INFO:tasks.workunit.client.0.smithi067.stdout:2/734: chown d0/d25/d34/l3b 40 1 2023-12-05T09:26:39.171 INFO:tasks.workunit.client.0.smithi067.stdout:2/735: chown d0/d25/d34/d4d/d72/fea 153 1 2023-12-05T09:26:39.175 INFO:tasks.workunit.client.0.smithi067.stdout:0/986: truncate d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/fab 2663505 0 2023-12-05T09:26:39.177 INFO:tasks.workunit.client.0.smithi067.stdout:0/987: rename d3/d7/d3c/ddb/de5/c11b to d3/d7/d3c/d6c/c162 0 2023-12-05T09:26:39.178 INFO:tasks.workunit.client.0.smithi067.stdout:0/988: mknod d3/d6b/d10a/d14a/c163 0 2023-12-05T09:26:39.179 INFO:tasks.workunit.client.0.smithi067.stdout:0/989: stat d3/d7/d30/f93 0 2023-12-05T09:26:39.179 INFO:tasks.workunit.client.0.smithi067.stdout:0/990: chown d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/d99/f9f 490483 1 2023-12-05T09:26:39.184 INFO:tasks.workunit.client.0.smithi067.stdout:4/758: dwrite d0/d1d/d25/d2c/d34/d4e/daa/fdb [0,4194304] 0 2023-12-05T09:26:39.186 INFO:tasks.workunit.client.0.smithi067.stdout:3/716: dwrite d9/da/d15/d17/f16 [0,4194304] 0 2023-12-05T09:26:39.186 INFO:tasks.workunit.client.0.smithi067.stdout:3/717: chown d9/da/d15/d17/d1a/d51/d66/d82/da1/fb5 731548 1 2023-12-05T09:26:39.186 INFO:tasks.workunit.client.0.smithi067.stdout:3/718: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/ffe x:0 0 0 2023-12-05T09:26:39.186 INFO:tasks.workunit.client.0.smithi067.stdout:3/719: chown d9/da/d15/d17/d1a/d51/d70 93 1 2023-12-05T09:26:39.186 INFO:tasks.workunit.client.0.smithi067.stdout:3/720: chown d9/c5b 55 1 2023-12-05T09:26:39.186 INFO:tasks.workunit.client.0.smithi067.stdout:3/721: readlink d9/da/d15/d17/d1a/d51/d66/d82/da1/lba 0 2023-12-05T09:26:39.187 INFO:tasks.workunit.client.0.smithi067.stdout:7/709: dwrite d0/d45/f80 [0,4194304] 0 2023-12-05T09:26:39.191 INFO:tasks.workunit.client.0.smithi067.stdout:5/826: dwrite db/df/d3f/dd9/de7/dfd/f28 [4194304,4194304] 0 2023-12-05T09:26:39.192 INFO:tasks.workunit.client.0.smithi067.stdout:8/833: dwrite d5/dc/d1a/d20/d2d/d8a/fca [0,4194304] 0 2023-12-05T09:26:39.192 INFO:tasks.workunit.client.0.smithi067.stdout:2/736: read d0/d25/d34/d4d/d78/ffe [2015488,123372] 0 2023-12-05T09:26:39.192 INFO:tasks.workunit.client.0.smithi067.stdout:1/795: dread d2/d4f/d54/f8c [0,4194304] 0 2023-12-05T09:26:39.192 INFO:tasks.workunit.client.0.smithi067.stdout:1/796: read d2/d4f/d54/fe4 [1954755,89692] 0 2023-12-05T09:26:39.196 INFO:tasks.workunit.client.0.smithi067.stdout:3/722: creat d9/da/fff x:0 0 0 2023-12-05T09:26:39.212 INFO:tasks.workunit.client.0.smithi067.stdout:0/991: read d3/d7/d3c/d67/d59/d4e/d94/d116/f10c [3938724,68582] 0 2023-12-05T09:26:39.214 INFO:tasks.workunit.client.0.smithi067.stdout:5/827: link db/df/d36/l55 db/df/ddb/l119 0 2023-12-05T09:26:39.214 INFO:tasks.workunit.client.0.smithi067.stdout:5/828: readlink db/df/d3f/l9b 0 2023-12-05T09:26:39.214 INFO:tasks.workunit.client.0.smithi067.stdout:5/829: chown db/df/l92 65 1 2023-12-05T09:26:39.218 INFO:tasks.workunit.client.0.smithi067.stdout:1/797: dread d2/f5c [0,4194304] 0 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/737: mkdir d0/d25/d9d/d53/d1e/d7f/d104 0 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:3/723: getdents d9/d24/dce 0 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:2/738: write d0/d25/d34/d4d/d54/d90/dcf/ff4 [807941,19086] 0 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:3/724: dread - d9/d24/f5f zero size 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:3/725: fsync d9/d62/f4c 0 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:0/992: stat d3/f39 0 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:0/993: readlink d3/d7/d3c/d67/d59/d4e/l112 0 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:5/830: mknod db/df/d3f/c11a 0 2023-12-05T09:26:39.221 INFO:tasks.workunit.client.0.smithi067.stdout:5/831: stat db/df/d38/lf4 0 2023-12-05T09:26:39.223 INFO:tasks.workunit.client.0.smithi067.stdout:1/798: truncate d2/d3/f3d 2832566 0 2023-12-05T09:26:39.223 INFO:tasks.workunit.client.0.smithi067.stdout:1/799: readlink d2/d4f/d14/l105 0 2023-12-05T09:26:39.223 INFO:tasks.workunit.client.0.smithi067.stdout:1/800: chown d2/d5/d7/de/d19/d8f/d98/lb0 131949631 1 2023-12-05T09:26:39.227 INFO:tasks.workunit.client.0.smithi067.stdout:3/726: link d9/da/d15/d17/fab d9/d62/dd0/f100 0 2023-12-05T09:26:39.227 INFO:tasks.workunit.client.0.smithi067.stdout:3/727: stat d9/da/d15/f50 0 2023-12-05T09:26:39.227 INFO:tasks.workunit.client.0.smithi067.stdout:3/728: dread - d9/da/d15/d17/d2b/fd6 zero size 2023-12-05T09:26:39.232 INFO:tasks.workunit.client.0.smithi067.stdout:0/994: creat d3/d7/d3c/d67/d59/d4e/d94/d116/f164 x:0 0 0 2023-12-05T09:26:39.234 INFO:tasks.workunit.client.0.smithi067.stdout:5/832: mknod db/c11b 0 2023-12-05T09:26:39.236 INFO:tasks.workunit.client.0.smithi067.stdout:2/739: write d0/d25/d9d/d53/d1e/f74 [3285194,77276] 0 2023-12-05T09:26:39.239 INFO:tasks.workunit.client.0.smithi067.stdout:1/801: rename d2/f7e to d2/d4f/d15/f112 0 2023-12-05T09:26:39.242 INFO:tasks.workunit.client.0.smithi067.stdout:3/729: creat d9/d24/dce/f101 x:0 0 0 2023-12-05T09:26:39.244 INFO:tasks.workunit.client.0.smithi067.stdout:2/740: mknod d0/d25/d34/d4d/c105 0 2023-12-05T09:26:39.245 INFO:tasks.workunit.client.0.smithi067.stdout:3/730: symlink d9/da/d15/l102 0 2023-12-05T09:26:39.250 INFO:tasks.workunit.client.0.smithi067.stdout:4/759: dwrite d0/d1d/d53/d62/f83 [0,4194304] 0 2023-12-05T09:26:39.250 INFO:tasks.workunit.client.0.smithi067.stdout:3/731: write d9/da/d15/d17/d1a/fdf [117432,70919] 0 2023-12-05T09:26:39.250 INFO:tasks.workunit.client.0.smithi067.stdout:3/732: dread - d9/da/d15/fbb zero size 2023-12-05T09:26:39.252 INFO:tasks.workunit.client.0.smithi067.stdout:4/760: creat d0/d1d/d25/d2c/d34/d4e/daa/f10f x:0 0 0 2023-12-05T09:26:39.256 INFO:tasks.workunit.client.0.smithi067.stdout:0/995: write d3/d7/d30/f9b [2327280,105526] 0 2023-12-05T09:26:39.256 INFO:tasks.workunit.client.0.smithi067.stdout:0/996: stat d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/l70 0 2023-12-05T09:26:39.263 INFO:tasks.workunit.client.0.smithi067.stdout:3/733: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/f103 x:0 0 0 2023-12-05T09:26:39.263 INFO:tasks.workunit.client.0.smithi067.stdout:4/761: symlink d0/d1d/d2a/d93/l110 0 2023-12-05T09:26:39.263 INFO:tasks.workunit.client.0.smithi067.stdout:4/762: chown d0/f4 222186818 1 2023-12-05T09:26:39.269 INFO:tasks.workunit.client.0.smithi067.stdout:5/833: dread db/df/d35/d63/fa6 [0,4194304] 0 2023-12-05T09:26:39.269 INFO:tasks.workunit.client.0.smithi067.stdout:0/997: creat d3/d7/d3c/d67/d59/d5c/d14d/f165 x:0 0 0 2023-12-05T09:26:39.289 INFO:tasks.workunit.client.0.smithi067.stdout:0/998: dread d3/d7/d3c/d67/d59/d4e/d94/d116/f37 [0,4194304] 0 2023-12-05T09:26:39.292 INFO:tasks.workunit.client.0.smithi067.stdout:0/999: link d3/d7/d3c/d6c/d8a/lb3 d3/d7/d3c/d67/d59/d4e/d94/d116/dd2/dcf/l166 0 2023-12-05T09:26:39.303 INFO:tasks.workunit.client.0.smithi067.stdout:2/741: write d0/fd [1695628,36345] 0 2023-12-05T09:26:39.303 INFO:tasks.workunit.client.0.smithi067.stdout:2/742: stat d0/d25/d9d/d53/d1e/d8e/fb6 0 2023-12-05T09:26:39.304 INFO:tasks.workunit.client.0.smithi067.stdout:8/834: dwrite d5/dc/d1a/d62/d7e/ff1 [0,4194304] 0 2023-12-05T09:26:39.304 INFO:tasks.workunit.client.0.smithi067.stdout:8/835: readlink d5/dc/d1a/d62/d7e/l8e 0 2023-12-05T09:26:39.318 INFO:tasks.workunit.client.0.smithi067.stdout:8/836: creat d5/dc/d1a/d20/d2d/d41/db2/dc1/ff9 x:0 0 0 2023-12-05T09:26:39.319 INFO:tasks.workunit.client.0.smithi067.stdout:8/837: mkdir d5/dc/d6e/dee/dfa 0 2023-12-05T09:26:39.319 INFO:tasks.workunit.client.0.smithi067.stdout:8/838: dread - d5/dc/d1a/d20/d2d/d8a/fe1 zero size 2023-12-05T09:26:39.320 INFO:tasks.workunit.client.0.smithi067.stdout:8/839: rmdir d5/dc/d1a/d20/d58/d90 39 2023-12-05T09:26:39.322 INFO:tasks.workunit.client.0.smithi067.stdout:8/840: mkdir d5/dc/d1a/d20/d2d/d8a/dfb 0 2023-12-05T09:26:39.323 INFO:tasks.workunit.client.0.smithi067.stdout:8/841: symlink d5/dc/d1a/d62/lfc 0 2023-12-05T09:26:39.323 INFO:tasks.workunit.client.0.smithi067.stdout:8/842: stat d5/d9d/dab/d66/d91 0 2023-12-05T09:26:39.323 INFO:tasks.workunit.client.0.smithi067.stdout:8/843: readlink d5/dc/d1a/d20/d58/lc8 0 2023-12-05T09:26:39.326 INFO:tasks.workunit.client.0.smithi067.stdout:8/844: mkdir d5/d3b/db3/dfd 0 2023-12-05T09:26:39.326 INFO:tasks.workunit.client.0.smithi067.stdout:8/845: fsync d5/fdf 0 2023-12-05T09:26:39.326 INFO:tasks.workunit.client.0.smithi067.stdout:8/846: getdents d5/d3b/db3/dfd 0 2023-12-05T09:26:39.327 INFO:tasks.workunit.client.0.smithi067.stdout:8/847: mknod d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/cfe 0 2023-12-05T09:26:39.328 INFO:tasks.workunit.client.0.smithi067.stdout:8/848: getdents d5/dc/d1a/d20/d3e/d95 0 2023-12-05T09:26:39.330 INFO:tasks.workunit.client.0.smithi067.stdout:8/849: mknod d5/dc/d1a/d20/d2d/d41/db2/dc1/cff 0 2023-12-05T09:26:39.338 INFO:tasks.workunit.client.0.smithi067.stdout:3/734: dwrite f3 [4194304,4194304] 0 2023-12-05T09:26:39.338 INFO:tasks.workunit.client.0.smithi067.stdout:3/735: chown d9/da/f96 16691577 1 2023-12-05T09:26:39.338 INFO:tasks.workunit.client.0.smithi067.stdout:3/736: fdatasync d9/d62/f8f 0 2023-12-05T09:26:39.340 INFO:tasks.workunit.client.0.smithi067.stdout:3/737: mkdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104 0 2023-12-05T09:26:39.340 INFO:tasks.workunit.client.0.smithi067.stdout:3/738: chown d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/lf2 3546 1 2023-12-05T09:26:39.345 INFO:tasks.workunit.client.0.smithi067.stdout:3/739: creat d9/da/d15/d17/d1a/d51/d66/f105 x:0 0 0 2023-12-05T09:26:39.345 INFO:tasks.workunit.client.0.smithi067.stdout:3/740: dread - d9/da/ff8 zero size 2023-12-05T09:26:39.345 INFO:tasks.workunit.client.0.smithi067.stdout:3/741: fdatasync d9/d24/f33 0 2023-12-05T09:26:39.345 INFO:tasks.workunit.client.0.smithi067.stdout:3/742: chown d9/d24/la8 869169 1 2023-12-05T09:26:39.347 INFO:tasks.workunit.client.0.smithi067.stdout:3/743: rename d9/da/d3b/ld4 to d9/da/d15/d17/d1a/l106 0 2023-12-05T09:26:39.350 INFO:tasks.workunit.client.0.smithi067.stdout:3/744: rename d9/da/d15/d17/d2b/fd6 to d9/f107 0 2023-12-05T09:26:39.350 INFO:tasks.workunit.client.0.smithi067.stdout:3/745: chown d9/da/d15/d17/d1a/d51/d66/d82 46858 1 2023-12-05T09:26:39.351 INFO:tasks.workunit.client.0.smithi067.stdout:8/850: dread d5/da/f4b [0,4194304] 0 2023-12-05T09:26:39.351 INFO:tasks.workunit.client.0.smithi067.stdout:8/851: readlink d5/dc/d1a/d62/d7e/la8 0 2023-12-05T09:26:39.351 INFO:tasks.workunit.client.0.smithi067.stdout:8/852: creat d5/dc/d1a/d20/d2d/d41/db2/f100 x:0 0 0 2023-12-05T09:26:39.351 INFO:tasks.workunit.client.0.smithi067.stdout:8/853: chown d5/dc/d1a/d20/d2d/d41/leb 0 1 2023-12-05T09:26:39.353 INFO:tasks.workunit.client.0.smithi067.stdout:1/802: dwrite d2/d5/f6f [0,4194304] 0 2023-12-05T09:26:39.353 INFO:tasks.workunit.client.0.smithi067.stdout:8/854: creat d5/dc/d1a/d20/d2d/d7f/d94/da3/f101 x:0 0 0 2023-12-05T09:26:39.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/803: mkdir d2/d3/da6/dbd/dd8/d113 0 2023-12-05T09:26:39.355 INFO:tasks.workunit.client.0.smithi067.stdout:1/804: rmdir d2/d5/d7/de/d19/d49/d6d 39 2023-12-05T09:26:39.355 INFO:tasks.workunit.client.0.smithi067.stdout:1/805: dread - d2/d4f/d54/d70/db4/fc3 zero size 2023-12-05T09:26:39.355 INFO:tasks.workunit.client.0.smithi067.stdout:1/806: write d2/d3/da6/dbd/dd8/df8/f10f [363998,6190] 0 2023-12-05T09:26:39.356 INFO:tasks.workunit.client.0.smithi067.stdout:1/807: rmdir d2/d3/da6/dbd 39 2023-12-05T09:26:39.358 INFO:tasks.workunit.client.0.smithi067.stdout:1/808: rename d2/d5/d7/d6a/db7/ffa to d2/d4f/d54/f114 0 2023-12-05T09:26:39.359 INFO:tasks.workunit.client.0.smithi067.stdout:2/743: dread d0/d25/f8b [0,4194304] 0 2023-12-05T09:26:39.359 INFO:tasks.workunit.client.0.smithi067.stdout:4/763: dwrite d0/d1d/d25/d2c/d34/f86 [0,4194304] 0 2023-12-05T09:26:39.360 INFO:tasks.workunit.client.0.smithi067.stdout:2/744: read d0/d25/d9d/d53/d1e/d8e/fd9 [78867,49436] 0 2023-12-05T09:26:39.361 INFO:tasks.workunit.client.0.smithi067.stdout:1/809: creat d2/f115 x:0 0 0 2023-12-05T09:26:39.361 INFO:tasks.workunit.client.0.smithi067.stdout:1/810: readlink d2/d5/d7/de/d1a/ld5 0 2023-12-05T09:26:39.361 INFO:tasks.workunit.client.0.smithi067.stdout:1/811: write d2/d5/d7/de/d1a/f7c [1807002,125368] 0 2023-12-05T09:26:39.361 INFO:tasks.workunit.client.0.smithi067.stdout:1/812: chown d2/d4f/d14/d20/d4c/f65 0 1 2023-12-05T09:26:39.363 INFO:tasks.workunit.client.0.smithi067.stdout:4/764: link d0/d9/f2f d0/d1d/d25/d2c/f111 0 2023-12-05T09:26:39.364 INFO:tasks.workunit.client.0.smithi067.stdout:1/813: creat d2/ddb/f116 x:0 0 0 2023-12-05T09:26:39.366 INFO:tasks.workunit.client.0.smithi067.stdout:1/814: rename d2/d4f/d15/d60/d68/f75 to d2/d3/da6/dbd/dd8/df8/f117 0 2023-12-05T09:26:39.370 INFO:tasks.workunit.client.0.smithi067.stdout:3/746: dread d9/da/fe9 [0,4194304] 0 2023-12-05T09:26:39.373 INFO:tasks.workunit.client.0.smithi067.stdout:3/747: creat d9/da/d3b/f108 x:0 0 0 2023-12-05T09:26:39.374 INFO:tasks.workunit.client.0.smithi067.stdout:3/748: chown d9/da/d15/d17/d1a/d51 1736382 1 2023-12-05T09:26:39.374 INFO:tasks.workunit.client.0.smithi067.stdout:5/834: dwrite db/df/d36/f7b [4194304,4194304] 0 2023-12-05T09:26:39.375 INFO:tasks.workunit.client.0.smithi067.stdout:3/749: write d9/d24/db6/fdb [127559,106604] 0 2023-12-05T09:26:39.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/855: dread d5/dc/d1a/d20/f59 [0,4194304] 0 2023-12-05T09:26:39.378 INFO:tasks.workunit.client.0.smithi067.stdout:8/856: fdatasync d5/dc/d1a/d20/d2d/d41/db2/f100 0 2023-12-05T09:26:39.380 INFO:tasks.workunit.client.0.smithi067.stdout:5/835: truncate db/df/f6b 590185 0 2023-12-05T09:26:39.381 INFO:tasks.workunit.client.0.smithi067.stdout:5/836: fdatasync db/df/f32 0 2023-12-05T09:26:39.382 INFO:tasks.workunit.client.0.smithi067.stdout:2/745: read d0/d25/d3f/d83/fa0 [782522,59581] 0 2023-12-05T09:26:39.382 INFO:tasks.workunit.client.0.smithi067.stdout:4/765: dread d0/d1d/d25/d2c/d34/f86 [0,4194304] 0 2023-12-05T09:26:39.382 INFO:tasks.workunit.client.0.smithi067.stdout:4/766: write d0/f4 [67265,23486] 0 2023-12-05T09:26:39.390 INFO:tasks.workunit.client.0.smithi067.stdout:2/746: creat d0/f106 x:0 0 0 2023-12-05T09:26:39.394 INFO:tasks.workunit.client.0.smithi067.stdout:4/767: creat d0/d1d/d25/d2c/d34/d4e/d5a/d88/d106/f112 x:0 0 0 2023-12-05T09:26:39.394 INFO:tasks.workunit.client.0.smithi067.stdout:4/768: write d0/d1d/d53/da8/fbe [702891,59051] 0 2023-12-05T09:26:39.396 INFO:tasks.workunit.client.0.smithi067.stdout:3/750: getdents d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda 0 2023-12-05T09:26:39.398 INFO:tasks.workunit.client.0.smithi067.stdout:4/769: read d0/d1d/d25/d2c/d34/f43 [1246231,15734] 0 2023-12-05T09:26:39.402 INFO:tasks.workunit.client.0.smithi067.stdout:5/837: dread db/f14 [8388608,4194304] 0 2023-12-05T09:26:39.403 INFO:tasks.workunit.client.0.smithi067.stdout:3/751: link d9/da/d15/d17/l80 d9/da/d15/d17/d1a/d51/d70/l109 0 2023-12-05T09:26:39.403 INFO:tasks.workunit.client.0.smithi067.stdout:3/752: truncate d9/da/d15/f50 938455 0 2023-12-05T09:26:39.421 INFO:tasks.workunit.client.0.smithi067.stdout:5/838: read db/df/d3f/dd9/de7/dfd/d1d/d20/f51 [2580546,56854] 0 2023-12-05T09:26:39.423 INFO:tasks.workunit.client.0.smithi067.stdout:5/839: rmdir db/df/d35/dea 0 2023-12-05T09:26:39.425 INFO:tasks.workunit.client.0.smithi067.stdout:8/857: dwrite d5/dc/d1a/d20/d2d/d41/db2/fb7 [0,4194304] 0 2023-12-05T09:26:39.430 INFO:tasks.workunit.client.0.smithi067.stdout:8/858: link d5/da/fd2 d5/dc/d1a/d20/d2d/d41/db2/f102 0 2023-12-05T09:26:39.430 INFO:tasks.workunit.client.0.smithi067.stdout:3/753: write d9/da/d15/d17/d2b/fa9 [3944132,112488] 0 2023-12-05T09:26:39.430 INFO:tasks.workunit.client.0.smithi067.stdout:3/754: chown d9/da 8921067 1 2023-12-05T09:26:39.430 INFO:tasks.workunit.client.0.smithi067.stdout:8/859: write d5/da/fcd [1029655,32583] 0 2023-12-05T09:26:39.439 INFO:tasks.workunit.client.0.smithi067.stdout:3/755: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/l10a 0 2023-12-05T09:26:39.445 INFO:tasks.workunit.client.0.smithi067.stdout:5/840: dread db/f13 [0,4194304] 0 2023-12-05T09:26:39.445 INFO:tasks.workunit.client.0.smithi067.stdout:5/841: write db/df/d35/d63/d75/fdc [402905,17995] 0 2023-12-05T09:26:39.449 INFO:tasks.workunit.client.0.smithi067.stdout:3/756: dread d9/d20/fb1 [0,4194304] 0 2023-12-05T09:26:39.464 INFO:tasks.workunit.client.0.smithi067.stdout:8/860: read d5/dc/d1a/d20/d2d/d8a/fca [2643416,9250] 0 2023-12-05T09:26:39.464 INFO:tasks.workunit.client.0.smithi067.stdout:8/861: getdents d5/dc/d1a/d20/d3e/d79 0 2023-12-05T09:26:39.464 INFO:tasks.workunit.client.0.smithi067.stdout:2/747: dwrite d0/f106 [0,4194304] 0 2023-12-05T09:26:39.464 INFO:tasks.workunit.client.0.smithi067.stdout:2/748: creat d0/d25/d3f/d83/f107 x:0 0 0 2023-12-05T09:26:39.548 INFO:tasks.workunit.client.0.smithi067.stdout:5/842: mknod db/df/d82/c11c 0 2023-12-05T09:26:39.550 INFO:tasks.workunit.client.0.smithi067.stdout:2/749: link d0/d25/d9d/d53/d1e/d8e/fd9 d0/d25/d34/d4d/d72/f108 0 2023-12-05T09:26:39.551 INFO:tasks.workunit.client.0.smithi067.stdout:5/843: unlink db/df/d3f/dd9/de7/dfd/d1d/d20/cca 0 2023-12-05T09:26:39.555 INFO:tasks.workunit.client.0.smithi067.stdout:5/844: creat db/df/d3f/d88/d8d/f11d x:0 0 0 2023-12-05T09:26:39.555 INFO:tasks.workunit.client.0.smithi067.stdout:5/845: read db/df/d3f/d88/f62 [132662,95498] 0 2023-12-05T09:26:39.556 INFO:tasks.workunit.client.0.smithi067.stdout:2/750: mkdir d0/d109 0 2023-12-05T09:26:39.558 INFO:tasks.workunit.client.0.smithi067.stdout:5/846: truncate f9 7266340 0 2023-12-05T09:26:39.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/862: dwrite d5/dc/d1a/d62/d7e/ff1 [0,4194304] 0 2023-12-05T09:26:39.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/863: readlink d5/dc/d1a/d20/d2d/d41/l47 0 2023-12-05T09:26:39.560 INFO:tasks.workunit.client.0.smithi067.stdout:8/864: creat d5/d3b/f103 x:0 0 0 2023-12-05T09:26:39.561 INFO:tasks.workunit.client.0.smithi067.stdout:3/757: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/fdd [0,4194304] 0 2023-12-05T09:26:39.561 INFO:tasks.workunit.client.0.smithi067.stdout:5/847: creat db/df/d35/f11e x:0 0 0 2023-12-05T09:26:39.561 INFO:tasks.workunit.client.0.smithi067.stdout:5/848: write db/df/d82/fce [458773,15125] 0 2023-12-05T09:26:39.561 INFO:tasks.workunit.client.0.smithi067.stdout:5/849: fdatasync db/df/d82/f10d 0 2023-12-05T09:26:39.565 INFO:tasks.workunit.client.0.smithi067.stdout:8/865: mkdir d5/d9d/dab/d66/d104 0 2023-12-05T09:26:39.565 INFO:tasks.workunit.client.0.smithi067.stdout:8/866: stat d5/dc/f3f 0 2023-12-05T09:26:39.567 INFO:tasks.workunit.client.0.smithi067.stdout:3/758: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/l10b 0 2023-12-05T09:26:39.567 INFO:tasks.workunit.client.0.smithi067.stdout:3/759: chown d9/da/d15/d17/d1a/ccf 3 1 2023-12-05T09:26:39.569 INFO:tasks.workunit.client.0.smithi067.stdout:5/850: mkdir db/df/d35/d63/d11f 0 2023-12-05T09:26:39.571 INFO:tasks.workunit.client.0.smithi067.stdout:3/760: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/c10c 0 2023-12-05T09:26:39.573 INFO:tasks.workunit.client.0.smithi067.stdout:8/867: unlink d5/dc/d1a/d20/d3e/f42 0 2023-12-05T09:26:39.574 INFO:tasks.workunit.client.0.smithi067.stdout:5/851: getdents db/df/d52 0 2023-12-05T09:26:39.575 INFO:tasks.workunit.client.0.smithi067.stdout:5/852: dread - db/df/d3f/dd9/de7/dfd/d1d/d20/fa5 zero size 2023-12-05T09:26:39.576 INFO:tasks.workunit.client.0.smithi067.stdout:8/868: creat d5/dc/d1a/d20/f105 x:0 0 0 2023-12-05T09:26:39.576 INFO:tasks.workunit.client.0.smithi067.stdout:8/869: rename d5/dc/d1a/d20/d3e/d79 to d5/dc/d1a/d20/d3e/d79/d106 22 2023-12-05T09:26:39.576 INFO:tasks.workunit.client.0.smithi067.stdout:8/870: write d5/dc/d1a/d62/fae [342066,93526] 0 2023-12-05T09:26:39.577 INFO:tasks.workunit.client.0.smithi067.stdout:3/761: symlink d9/l10d 0 2023-12-05T09:26:39.578 INFO:tasks.workunit.client.0.smithi067.stdout:5/853: truncate db/df/d3f/dd9/de7/dfd/d1d/d20/f37 767407 0 2023-12-05T09:26:39.581 INFO:tasks.workunit.client.0.smithi067.stdout:8/871: rename d5/dc/d1a/d20/d3e/l52 to d5/da/d30/l107 0 2023-12-05T09:26:39.581 INFO:tasks.workunit.client.0.smithi067.stdout:8/872: readlink d5/dc/d1a/d20/d2d/d41/l47 0 2023-12-05T09:26:39.581 INFO:tasks.workunit.client.0.smithi067.stdout:8/873: read - d5/dc/d1a/d62/d7e/fcb zero size 2023-12-05T09:26:39.581 INFO:tasks.workunit.client.0.smithi067.stdout:8/874: creat d5/dc/d1a/d20/d2d/d41/f108 x:0 0 0 2023-12-05T09:26:39.581 INFO:tasks.workunit.client.0.smithi067.stdout:8/875: write d5/dc/d1a/d20/f105 [321495,6432] 0 2023-12-05T09:26:39.584 INFO:tasks.workunit.client.0.smithi067.stdout:3/762: unlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/ff6 0 2023-12-05T09:26:39.591 INFO:tasks.workunit.client.0.smithi067.stdout:3/763: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/l10e 0 2023-12-05T09:26:39.596 INFO:tasks.workunit.client.0.smithi067.stdout:3/764: mkdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/d10f 0 2023-12-05T09:26:39.661 INFO:tasks.workunit.client.0.smithi067.stdout:5/854: dwrite db/df/d38/f104 [0,4194304] 0 2023-12-05T09:26:39.662 INFO:tasks.workunit.client.0.smithi067.stdout:3/765: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/fe7 [0,4194304] 0 2023-12-05T09:26:39.664 INFO:tasks.workunit.client.0.smithi067.stdout:2/751: dwrite d0/d25/d9d/d53/d92/fe5 [0,4194304] 0 2023-12-05T09:26:39.664 INFO:tasks.workunit.client.0.smithi067.stdout:5/855: mkdir db/df/d3f/dd9/de7/dfd/d1d/d20/d120 0 2023-12-05T09:26:39.665 INFO:tasks.workunit.client.0.smithi067.stdout:5/856: write db/df/d3f/d88/ff5 [831315,87194] 0 2023-12-05T09:26:39.666 INFO:tasks.workunit.client.0.smithi067.stdout:8/876: dwrite d5/dc/d1a/d20/f25 [0,4194304] 0 2023-12-05T09:26:39.669 INFO:tasks.workunit.client.0.smithi067.stdout:3/766: mkdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/d110 0 2023-12-05T09:26:39.675 INFO:tasks.workunit.client.0.smithi067.stdout:5/857: rename db/df/d3f/dd9/de7/dfd/d1d/d20/fe2 to db/df/d35/d63/d75/f121 0 2023-12-05T09:26:39.676 INFO:tasks.workunit.client.0.smithi067.stdout:8/877: mknod d5/dc/d1a/d20/d2d/d41/db2/dc1/c109 0 2023-12-05T09:26:39.678 INFO:tasks.workunit.client.0.smithi067.stdout:3/767: truncate d9/f58 3256453 0 2023-12-05T09:26:39.680 INFO:tasks.workunit.client.0.smithi067.stdout:2/752: mknod d0/c10a 0 2023-12-05T09:26:39.680 INFO:tasks.workunit.client.0.smithi067.stdout:2/753: chown d0/d25/d9d/d53/d1e/d8e/dd0/f37 228 1 2023-12-05T09:26:39.680 INFO:tasks.workunit.client.0.smithi067.stdout:5/858: symlink db/df/d35/d63/d11f/l122 0 2023-12-05T09:26:39.681 INFO:tasks.workunit.client.0.smithi067.stdout:8/878: mkdir d5/dc/d1a/d20/d2d/d10a 0 2023-12-05T09:26:39.683 INFO:tasks.workunit.client.0.smithi067.stdout:3/768: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/f111 x:0 0 0 2023-12-05T09:26:39.683 INFO:tasks.workunit.client.0.smithi067.stdout:3/769: fdatasync d9/d24/db6/fdb 0 2023-12-05T09:26:39.684 INFO:tasks.workunit.client.0.smithi067.stdout:6/740: sync 2023-12-05T09:26:39.684 INFO:tasks.workunit.client.0.smithi067.stdout:2/754: link d0/d25/d9d/d53/d1e/d8e/dd0/fb9 d0/d25/d9d/d63/f10b 0 2023-12-05T09:26:39.685 INFO:tasks.workunit.client.0.smithi067.stdout:5/859: creat db/df/d36/d6c/f123 x:0 0 0 2023-12-05T09:26:39.687 INFO:tasks.workunit.client.0.smithi067.stdout:8/879: creat d5/d9d/dd9/f10b x:0 0 0 2023-12-05T09:26:39.688 INFO:tasks.workunit.client.0.smithi067.stdout:8/880: fdatasync d5/da/f56 0 2023-12-05T09:26:39.688 INFO:tasks.workunit.client.0.smithi067.stdout:8/881: chown d5/dc/d1a/d20/fbd 14166 1 2023-12-05T09:26:39.688 INFO:tasks.workunit.client.0.smithi067.stdout:8/882: getdents d5/dc/d1a/d20/d58/df5 0 2023-12-05T09:26:39.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/860: read db/df/d82/fb3 [4327930,24782] 0 2023-12-05T09:26:39.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/861: fsync db/df/d82/fab 0 2023-12-05T09:26:39.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/862: readlink db/df/d36/l106 0 2023-12-05T09:26:39.688 INFO:tasks.workunit.client.0.smithi067.stdout:5/863: write db/df/d3f/dd9/de7/dfd/f21 [330627,102467] 0 2023-12-05T09:26:39.690 INFO:tasks.workunit.client.0.smithi067.stdout:8/883: rmdir d5/dc/d1a/d20/d2d/d8a 39 2023-12-05T09:26:39.693 INFO:tasks.workunit.client.0.smithi067.stdout:8/884: rename d5/dc/d6e/c6f to d5/dc/d6e/dee/dfa/c10c 0 2023-12-05T09:26:39.697 INFO:tasks.workunit.client.0.smithi067.stdout:8/885: mkdir d5/dc/d6e/dee/d10d 0 2023-12-05T09:26:39.697 INFO:tasks.workunit.client.0.smithi067.stdout:8/886: fsync d5/dc/d1a/d62/d7e/ff1 0 2023-12-05T09:26:39.699 INFO:tasks.workunit.client.0.smithi067.stdout:8/887: creat d5/da/d30/dce/f10e x:0 0 0 2023-12-05T09:26:39.707 INFO:tasks.workunit.client.0.smithi067.stdout:6/741: dread da/d10/d1e/d17/d2f/d72/f97 [0,4194304] 0 2023-12-05T09:26:39.708 INFO:tasks.workunit.client.0.smithi067.stdout:5/864: write db/df/d36/f83 [7394901,11086] 0 2023-12-05T09:26:39.710 INFO:tasks.workunit.client.0.smithi067.stdout:6/742: creat da/d10/d1e/d51/d7b/dee/f103 x:0 0 0 2023-12-05T09:26:39.710 INFO:tasks.workunit.client.0.smithi067.stdout:6/743: fdatasync da/d10/d1e/d17/d2f/d59/d6c/ffb 0 2023-12-05T09:26:39.712 INFO:tasks.workunit.client.0.smithi067.stdout:6/744: link da/d10/d1e/d17/d2f/d1f/d9e/cf2 da/d10/d1e/d51/c104 0 2023-12-05T09:26:39.713 INFO:tasks.workunit.client.0.smithi067.stdout:3/770: dread d9/da/ff4 [0,4194304] 0 2023-12-05T09:26:39.714 INFO:tasks.workunit.client.0.smithi067.stdout:6/745: getdents da/d10/d1e/d17/d2f/d1f/d9e/dfd 0 2023-12-05T09:26:39.714 INFO:tasks.workunit.client.0.smithi067.stdout:6/746: chown da/d10/d1e/d17/d2f/d1f/d9e/dfd/dcb/fcc 8210946 1 2023-12-05T09:26:39.715 INFO:tasks.workunit.client.0.smithi067.stdout:3/771: getdents d9/d62 0 2023-12-05T09:26:39.716 INFO:tasks.workunit.client.0.smithi067.stdout:6/747: mkdir da/d10/d1e/d17/d2f/d1f/d27/d4f/d105 0 2023-12-05T09:26:39.718 INFO:tasks.workunit.client.0.smithi067.stdout:3/772: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/dfa/f112 x:0 0 0 2023-12-05T09:26:39.719 INFO:tasks.workunit.client.0.smithi067.stdout:6/748: mkdir da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d106 0 2023-12-05T09:26:39.720 INFO:tasks.workunit.client.0.smithi067.stdout:3/773: rmdir d9 39 2023-12-05T09:26:39.722 INFO:tasks.workunit.client.0.smithi067.stdout:6/749: rename da/d10/d1e/d17/d2f/d2c/c71 to da/dde/c107 0 2023-12-05T09:26:39.722 INFO:tasks.workunit.client.0.smithi067.stdout:6/750: chown da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fc7 3033 1 2023-12-05T09:26:39.725 INFO:tasks.workunit.client.0.smithi067.stdout:6/751: link da/d10/d1e/f4b da/d10/d1e/d17/d2f/d59/d6c/f108 0 2023-12-05T09:26:39.728 INFO:tasks.workunit.client.0.smithi067.stdout:6/752: link da/dde/l52 da/d10/d1e/d51/l109 0 2023-12-05T09:26:39.744 INFO:tasks.workunit.client.0.smithi067.stdout:3/774: dread d9/da/d15/d17/d1a/d51/d66/d82/fb4 [0,4194304] 0 2023-12-05T09:26:39.744 INFO:tasks.workunit.client.0.smithi067.stdout:3/775: write d9/da/d15/d17/d1a/d51/d66/d82/da1/f41 [1473523,102891] 0 2023-12-05T09:26:39.747 INFO:tasks.workunit.client.0.smithi067.stdout:3/776: getdents d9/d49 0 2023-12-05T09:26:39.764 INFO:tasks.workunit.client.0.smithi067.stdout:5/865: dwrite db/df/d82/f10d [0,4194304] 0 2023-12-05T09:26:39.765 INFO:tasks.workunit.client.0.smithi067.stdout:5/866: write db/df/d3f/dd9/de7/dfd/d1d/d20/fd5 [484188,67787] 0 2023-12-05T09:26:39.792 INFO:tasks.workunit.client.0.smithi067.stdout:8/888: dwrite d5/da/f56 [0,4194304] 0 2023-12-05T09:26:39.792 INFO:tasks.workunit.client.0.smithi067.stdout:5/867: write db/df/d3f/dd9/de7/dfd/d59/dae/fef [2184167,98099] 0 2023-12-05T09:26:39.794 INFO:tasks.workunit.client.0.smithi067.stdout:2/755: dwrite d0/d25/f4e [0,4194304] 0 2023-12-05T09:26:39.818 INFO:tasks.workunit.client.0.smithi067.stdout:3/777: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/fb7 [0,4194304] 0 2023-12-05T09:26:39.818 INFO:tasks.workunit.client.0.smithi067.stdout:2/756: dread d0/fb4 [0,4194304] 0 2023-12-05T09:26:39.836 INFO:tasks.workunit.client.0.smithi067.stdout:3/778: write d9/da/d15/d17/f55 [3310128,120557] 0 2023-12-05T09:26:39.847 INFO:tasks.workunit.client.0.smithi067.stdout:2/757: dread d0/f8a [0,4194304] 0 2023-12-05T09:26:39.851 INFO:tasks.workunit.client.0.smithi067.stdout:2/758: truncate d0/fd 82748 0 2023-12-05T09:26:39.852 INFO:tasks.workunit.client.0.smithi067.stdout:5/868: dwrite db/df/d3f/dd9/de7/dfd/fec [0,4194304] 0 2023-12-05T09:26:39.879 INFO:tasks.workunit.client.0.smithi067.stdout:2/759: write d0/d25/d34/d4d/d72/f8c [2745003,74635] 0 2023-12-05T09:26:39.884 INFO:tasks.workunit.client.0.smithi067.stdout:2/760: symlink d0/d25/d9d/d53/d1e/d8e/l10c 0 2023-12-05T09:26:39.886 INFO:tasks.workunit.client.0.smithi067.stdout:2/761: rename d0/d7c/fd2 to d0/d25/d34/d4d/db0/dbf/f10d 0 2023-12-05T09:26:39.887 INFO:tasks.workunit.client.0.smithi067.stdout:2/762: getdents d0/d25/d34 0 2023-12-05T09:26:39.890 INFO:tasks.workunit.client.0.smithi067.stdout:2/763: rename d0/d7c/l87 to d0/d25/d9d/d53/d1e/d8e/dc4/l10e 0 2023-12-05T09:26:39.894 INFO:tasks.workunit.client.0.smithi067.stdout:8/889: dwrite d5/dc/fac [0,4194304] 0 2023-12-05T09:26:39.895 INFO:tasks.workunit.client.0.smithi067.stdout:8/890: fdatasync d5/f40 0 2023-12-05T09:26:39.898 INFO:tasks.workunit.client.0.smithi067.stdout:8/891: write d5/dc/d1a/d20/d58/fd3 [503011,18855] 0 2023-12-05T09:26:39.898 INFO:tasks.workunit.client.0.smithi067.stdout:3/779: dwrite d9/da/d15/d17/d1a/d51/fc7 [4194304,4194304] 0 2023-12-05T09:26:39.899 INFO:tasks.workunit.client.0.smithi067.stdout:3/780: creat d9/da/d15/d17/f113 x:0 0 0 2023-12-05T09:26:39.906 INFO:tasks.workunit.client.0.smithi067.stdout:3/781: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/f114 x:0 0 0 2023-12-05T09:26:39.912 INFO:tasks.workunit.client.0.smithi067.stdout:1/815: sync 2023-12-05T09:26:39.912 INFO:tasks.workunit.client.0.smithi067.stdout:4/770: sync 2023-12-05T09:26:39.912 INFO:tasks.workunit.client.0.smithi067.stdout:7/710: sync 2023-12-05T09:26:39.915 INFO:tasks.workunit.client.0.smithi067.stdout:1/816: link d2/d4f/d54/d70/f92 d2/d5/d7/de/d19/df2/f118 0 2023-12-05T09:26:39.916 INFO:tasks.workunit.client.0.smithi067.stdout:7/711: symlink d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/leb 0 2023-12-05T09:26:39.916 INFO:tasks.workunit.client.0.smithi067.stdout:7/712: fdatasync d0/d9/f5f 0 2023-12-05T09:26:39.918 INFO:tasks.workunit.client.0.smithi067.stdout:1/817: rename d2/d5/d7/de/d19/d71 to d2/d4f/d15/dee/d119 0 2023-12-05T09:26:39.920 INFO:tasks.workunit.client.0.smithi067.stdout:7/713: creat d0/d9/d3f/dcc/fec x:0 0 0 2023-12-05T09:26:39.920 INFO:tasks.workunit.client.0.smithi067.stdout:7/714: chown d0/d9/d10/d37/d38/d64 40589 1 2023-12-05T09:26:39.922 INFO:tasks.workunit.client.0.smithi067.stdout:1/818: creat d2/d3/da6/dbb/dd1/de3/f11a x:0 0 0 2023-12-05T09:26:39.923 INFO:tasks.workunit.client.0.smithi067.stdout:1/819: creat d2/d3/da6/dbb/dd1/f11b x:0 0 0 2023-12-05T09:26:39.929 INFO:tasks.workunit.client.0.smithi067.stdout:4/771: dread d0/d1d/d2a/dba/fc8 [0,4194304] 0 2023-12-05T09:26:39.942 INFO:tasks.workunit.client.0.smithi067.stdout:1/820: dread d2/f24 [0,4194304] 0 2023-12-05T09:26:39.943 INFO:tasks.workunit.client.0.smithi067.stdout:1/821: chown d2/ddb/ce5 28 1 2023-12-05T09:26:39.945 INFO:tasks.workunit.client.0.smithi067.stdout:1/822: creat d2/d5/f11c x:0 0 0 2023-12-05T09:26:39.950 INFO:tasks.workunit.client.0.smithi067.stdout:2/764: write d0/d25/f4e [3862776,107598] 0 2023-12-05T09:26:39.956 INFO:tasks.workunit.client.0.smithi067.stdout:2/765: rmdir d0/d25/d34/d4d/d54/d56 39 2023-12-05T09:26:39.960 INFO:tasks.workunit.client.0.smithi067.stdout:2/766: symlink d0/d25/d34/d4a/l10f 0 2023-12-05T09:26:39.965 INFO:tasks.workunit.client.0.smithi067.stdout:7/715: dread d0/f11 [0,4194304] 0 2023-12-05T09:26:39.966 INFO:tasks.workunit.client.0.smithi067.stdout:7/716: chown d0/f11 57975431 1 2023-12-05T09:26:39.967 INFO:tasks.workunit.client.0.smithi067.stdout:7/717: mknod d0/d9/d10/d37/d38/d64/d54/ced 0 2023-12-05T09:26:39.968 INFO:tasks.workunit.client.0.smithi067.stdout:7/718: chown d0/d9/d3f/dcc/fec 7 1 2023-12-05T09:26:40.000 INFO:tasks.workunit.client.0.smithi067.stdout:8/892: dwrite d5/d6a/f74 [0,4194304] 0 2023-12-05T09:26:40.002 INFO:tasks.workunit.client.0.smithi067.stdout:3/782: dwrite d9/da/ff8 [0,4194304] 0 2023-12-05T09:26:40.002 INFO:tasks.workunit.client.0.smithi067.stdout:3/783: fsync d9/da/d3b/f6b 0 2023-12-05T09:26:40.002 INFO:tasks.workunit.client.0.smithi067.stdout:8/893: mkdir d5/d9d/dd9/d10f 0 2023-12-05T09:26:40.002 INFO:tasks.workunit.client.0.smithi067.stdout:8/894: fsync d5/dc/d1a/d20/d2d/d8a/fb0 0 2023-12-05T09:26:40.004 INFO:tasks.workunit.client.0.smithi067.stdout:4/772: dwrite d0/d1d/d25/d2c/d34/d4e/fa1 [0,4194304] 0 2023-12-05T09:26:40.005 INFO:tasks.workunit.client.0.smithi067.stdout:8/895: creat d5/d9d/f110 x:0 0 0 2023-12-05T09:26:40.014 INFO:tasks.workunit.client.0.smithi067.stdout:1/823: dwrite d2/d3/da6/dbd/dd8/df8/f10f [0,4194304] 0 2023-12-05T09:26:40.014 INFO:tasks.workunit.client.0.smithi067.stdout:1/824: write d2/d4f/d15/f112 [990226,69254] 0 2023-12-05T09:26:40.041 INFO:tasks.workunit.client.0.smithi067.stdout:8/896: dread d5/dc/d1a/d20/f25 [0,4194304] 0 2023-12-05T09:26:40.041 INFO:tasks.workunit.client.0.smithi067.stdout:8/897: stat d5/dc/d1a/d20/d58/df5 0 2023-12-05T09:26:40.048 INFO:tasks.workunit.client.0.smithi067.stdout:7/719: dwrite d0/f27 [0,4194304] 0 2023-12-05T09:26:40.048 INFO:tasks.workunit.client.0.smithi067.stdout:7/720: readlink d0/l7b 0 2023-12-05T09:26:40.053 INFO:tasks.workunit.client.0.smithi067.stdout:2/767: dwrite d0/d25/d9d/d53/d1e/d7f/fcc [0,4194304] 0 2023-12-05T09:26:40.057 INFO:tasks.workunit.client.0.smithi067.stdout:2/768: rmdir d0/d25/d9d/d53/d1e/d7f/d104 0 2023-12-05T09:26:40.066 INFO:tasks.workunit.client.0.smithi067.stdout:4/773: dread d0/d9/f4a [0,4194304] 0 2023-12-05T09:26:40.070 INFO:tasks.workunit.client.0.smithi067.stdout:1/825: dwrite d2/d5/d7/de/d19/d49/d5f/f9f [0,4194304] 0 2023-12-05T09:26:40.076 INFO:tasks.workunit.client.0.smithi067.stdout:7/721: read d0/d9/d40/fa0 [1670333,24911] 0 2023-12-05T09:26:40.088 INFO:tasks.workunit.client.0.smithi067.stdout:3/784: dwrite d9/d20/fac [0,4194304] 0 2023-12-05T09:26:40.088 INFO:tasks.workunit.client.0.smithi067.stdout:3/785: truncate d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/fa2 686950 0 2023-12-05T09:26:40.088 INFO:tasks.workunit.client.0.smithi067.stdout:3/786: stat d9/da/d15/d17/d1a/lb3 0 2023-12-05T09:26:40.088 INFO:tasks.workunit.client.0.smithi067.stdout:1/826: write d2/d5/f6f [3839180,37564] 0 2023-12-05T09:26:40.092 INFO:tasks.workunit.client.0.smithi067.stdout:3/787: creat d9/d62/f115 x:0 0 0 2023-12-05T09:26:40.096 INFO:tasks.workunit.client.0.smithi067.stdout:1/827: mknod d2/d4f/d14/d20/d83/d78/c11d 0 2023-12-05T09:26:40.097 INFO:tasks.workunit.client.0.smithi067.stdout:7/722: write d0/d9/d10/d37/f28 [899478,84497] 0 2023-12-05T09:26:40.106 INFO:tasks.workunit.client.0.smithi067.stdout:1/828: getdents d2/d5/d7/de 0 2023-12-05T09:26:40.106 INFO:tasks.workunit.client.0.smithi067.stdout:1/829: write d2/d3/da6/fde [873205,17334] 0 2023-12-05T09:26:40.106 INFO:tasks.workunit.client.0.smithi067.stdout:1/830: readlink d2/d3/da6/dbb/lb2 0 2023-12-05T09:26:40.117 INFO:tasks.workunit.client.0.smithi067.stdout:3/788: dread f4 [0,4194304] 0 2023-12-05T09:26:40.117 INFO:tasks.workunit.client.0.smithi067.stdout:3/789: chown d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/l7b 7755085 1 2023-12-05T09:26:40.119 INFO:tasks.workunit.client.0.smithi067.stdout:3/790: rmdir d9/da/d15/d17/d2b/df3 39 2023-12-05T09:26:40.120 INFO:tasks.workunit.client.0.smithi067.stdout:6/753: sync 2023-12-05T09:26:40.122 INFO:tasks.workunit.client.0.smithi067.stdout:8/898: dwrite d5/dc/d1a/d20/d3e/dbf/fc4 [0,4194304] 0 2023-12-05T09:26:40.123 INFO:tasks.workunit.client.0.smithi067.stdout:6/754: creat da/d10/d1e/d17/d2f/d3f/f10a x:0 0 0 2023-12-05T09:26:40.124 INFO:tasks.workunit.client.0.smithi067.stdout:7/723: write d0/d9/d10/f32 [7138970,23610] 0 2023-12-05T09:26:40.125 INFO:tasks.workunit.client.0.smithi067.stdout:8/899: getdents d5/dc/d6e/dee 0 2023-12-05T09:26:40.125 INFO:tasks.workunit.client.0.smithi067.stdout:6/755: creat da/d10/d1e/d17/d2f/db2/f10b x:0 0 0 2023-12-05T09:26:40.128 INFO:tasks.workunit.client.0.smithi067.stdout:8/900: mkdir d5/dc/d1a/d20/d58/d90/d111 0 2023-12-05T09:26:40.130 INFO:tasks.workunit.client.0.smithi067.stdout:6/756: mkdir da/d10/d1e/d17/d2f/d1f/d9e/dfd/dcb/d10c 0 2023-12-05T09:26:40.133 INFO:tasks.workunit.client.0.smithi067.stdout:6/757: symlink da/d10/d1e/d17/d2f/d2c/dc3/l10d 0 2023-12-05T09:26:40.134 INFO:tasks.workunit.client.0.smithi067.stdout:6/758: rmdir da/d10/d1e/d17/d2f/d1f/d9e/dfd/dcb 39 2023-12-05T09:26:40.136 INFO:tasks.workunit.client.0.smithi067.stdout:1/831: read d2/d4f/d15/f29 [424685,124798] 0 2023-12-05T09:26:40.136 INFO:tasks.workunit.client.0.smithi067.stdout:4/774: dwrite d0/f41 [4194304,4194304] 0 2023-12-05T09:26:40.137 INFO:tasks.workunit.client.0.smithi067.stdout:6/759: link da/d10/d1e/d51/f7a da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/f10e 0 2023-12-05T09:26:40.137 INFO:tasks.workunit.client.0.smithi067.stdout:2/769: dwrite d0/d25/d3f/d83/fa0 [0,4194304] 0 2023-12-05T09:26:40.146 INFO:tasks.workunit.client.0.smithi067.stdout:4/775: creat d0/d1d/d53/da8/da9/f113 x:0 0 0 2023-12-05T09:26:40.148 INFO:tasks.workunit.client.0.smithi067.stdout:6/760: rmdir da/d10/d1e/d51/d7b 39 2023-12-05T09:26:40.148 INFO:tasks.workunit.client.0.smithi067.stdout:6/761: readlink da/d10/d1e/d17/d2f/d1f/d27/lb1 0 2023-12-05T09:26:40.148 INFO:tasks.workunit.client.0.smithi067.stdout:1/832: rmdir d2/d4f/d14/d48 39 2023-12-05T09:26:40.148 INFO:tasks.workunit.client.0.smithi067.stdout:1/833: stat d2/d5/d50/c106 0 2023-12-05T09:26:40.152 INFO:tasks.workunit.client.0.smithi067.stdout:6/762: symlink da/d10/d1e/d17/d2f/d1f/l10f 0 2023-12-05T09:26:40.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/834: creat d2/d4f/d14/d20/d83/f11e x:0 0 0 2023-12-05T09:26:40.153 INFO:tasks.workunit.client.0.smithi067.stdout:1/835: stat d2/d4f/d14/ffe 0 2023-12-05T09:26:40.154 INFO:tasks.workunit.client.0.smithi067.stdout:4/776: dread d0/d1d/d25/d2c/d34/f55 [0,4194304] 0 2023-12-05T09:26:40.156 INFO:tasks.workunit.client.0.smithi067.stdout:6/763: rename da/d10/d1e/d17/d2f/d1f/d9e/dfd/dd3 to da/d10/d1e/d17/d2f/d5f/d110 0 2023-12-05T09:26:40.159 INFO:tasks.workunit.client.0.smithi067.stdout:1/836: link d2/d5/d7/de/d19/d8f/d98/ff0 d2/d3/da6/dbd/f11f 0 2023-12-05T09:26:40.162 INFO:tasks.workunit.client.0.smithi067.stdout:2/770: dread d0/d25/d9d/f66 [0,4194304] 0 2023-12-05T09:26:40.162 INFO:tasks.workunit.client.0.smithi067.stdout:4/777: rmdir d0/d1d/d2a/d93/da4 39 2023-12-05T09:26:40.162 INFO:tasks.workunit.client.0.smithi067.stdout:4/778: creat d0/d1d/d3c/d51/f114 x:0 0 0 2023-12-05T09:26:40.162 INFO:tasks.workunit.client.0.smithi067.stdout:4/779: chown d0/d1d/d2a/d93/da4/lac 8257231 1 2023-12-05T09:26:40.162 INFO:tasks.workunit.client.0.smithi067.stdout:5/869: sync 2023-12-05T09:26:40.162 INFO:tasks.workunit.client.0.smithi067.stdout:5/870: fsync db/df/d82/fab 0 2023-12-05T09:26:40.164 INFO:tasks.workunit.client.0.smithi067.stdout:6/764: truncate da/d10/d1e/d17/d2f/d1f/d9e/dfd/dcb/fcc 936002 0 2023-12-05T09:26:40.165 INFO:tasks.workunit.client.0.smithi067.stdout:6/765: dread - da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/ff0 zero size 2023-12-05T09:26:40.165 INFO:tasks.workunit.client.0.smithi067.stdout:2/771: mkdir d0/d25/d34/d4d/db0/dce/dd3/df0/d110 0 2023-12-05T09:26:40.167 INFO:tasks.workunit.client.0.smithi067.stdout:4/780: symlink d0/d1d/d25/d2c/df2/l115 0 2023-12-05T09:26:40.170 INFO:tasks.workunit.client.0.smithi067.stdout:6/766: creat da/d10/d1e/d51/d7b/f111 x:0 0 0 2023-12-05T09:26:40.170 INFO:tasks.workunit.client.0.smithi067.stdout:6/767: dread - da/d10/d1e/d51/d7b/f111 zero size 2023-12-05T09:26:40.170 INFO:tasks.workunit.client.0.smithi067.stdout:1/837: dread d2/d4f/d15/f112 [0,4194304] 0 2023-12-05T09:26:40.172 INFO:tasks.workunit.client.0.smithi067.stdout:2/772: rename d0/d25/d9d/d53/d1e/d8e/dd0/d39/f75 to d0/d25/d34/d4d/db0/f111 0 2023-12-05T09:26:40.174 INFO:tasks.workunit.client.0.smithi067.stdout:1/838: truncate d2/d4f/fc1 197992 0 2023-12-05T09:26:40.175 INFO:tasks.workunit.client.0.smithi067.stdout:2/773: symlink d0/d25/d9d/d63/d88/l112 0 2023-12-05T09:26:40.176 INFO:tasks.workunit.client.0.smithi067.stdout:6/768: rmdir da/d10/d1e/d17/d2f/d2c/dc3 39 2023-12-05T09:26:40.176 INFO:tasks.workunit.client.0.smithi067.stdout:6/769: write da/d10/d1e/f4b [3556330,51086] 0 2023-12-05T09:26:40.182 INFO:tasks.workunit.client.0.smithi067.stdout:2/774: mknod d0/d25/d34/d4d/d54/d56/c113 0 2023-12-05T09:26:40.189 INFO:tasks.workunit.client.0.smithi067.stdout:3/791: dread d9/da/d15/d17/d1a/d51/fc7 [0,4194304] 0 2023-12-05T09:26:40.189 INFO:tasks.workunit.client.0.smithi067.stdout:3/792: write d9/da/d15/d17/d1a/d51/d66/f105 [961218,48617] 0 2023-12-05T09:26:40.200 INFO:tasks.workunit.client.0.smithi067.stdout:6/770: unlink da/d10/d1e/d17/d2f/cd1 0 2023-12-05T09:26:40.201 INFO:tasks.workunit.client.0.smithi067.stdout:6/771: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f112 x:0 0 0 2023-12-05T09:26:40.206 INFO:tasks.workunit.client.0.smithi067.stdout:8/901: dwrite d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/fd4 [0,4194304] 0 2023-12-05T09:26:40.206 INFO:tasks.workunit.client.0.smithi067.stdout:8/902: truncate d5/dc/d1a/d20/d3e/f7a 536283 0 2023-12-05T09:26:40.206 INFO:tasks.workunit.client.0.smithi067.stdout:8/903: fsync d5/d6a/dc3/fdb 0 2023-12-05T09:26:40.209 INFO:tasks.workunit.client.0.smithi067.stdout:6/772: dread da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fc7 [4194304,4194304] 0 2023-12-05T09:26:40.210 INFO:tasks.workunit.client.0.smithi067.stdout:6/773: creat da/f113 x:0 0 0 2023-12-05T09:26:40.210 INFO:tasks.workunit.client.0.smithi067.stdout:6/774: chown da/d10/d1e/d17/d2f/d3f/lbf 496646787 1 2023-12-05T09:26:40.213 INFO:tasks.workunit.client.0.smithi067.stdout:1/839: rmdir d2 39 2023-12-05T09:26:40.214 INFO:tasks.workunit.client.0.smithi067.stdout:2/775: fdatasync d0/f41 0 2023-12-05T09:26:40.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/776: truncate d0/d25/d34/d4d/d78/fd7 4991985 0 2023-12-05T09:26:40.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/777: write d0/d25/d34/d4d/d54/d56/f80 [466155,22037] 0 2023-12-05T09:26:40.216 INFO:tasks.workunit.client.0.smithi067.stdout:2/778: chown d0/d25/d9d/d53/d1e/d8e/fd9 1 1 2023-12-05T09:26:40.217 INFO:tasks.workunit.client.0.smithi067.stdout:3/793: creat d9/f116 x:0 0 0 2023-12-05T09:26:40.229 INFO:tasks.workunit.client.0.smithi067.stdout:6/775: mknod da/d10/d1e/d17/d2f/d5f/c114 0 2023-12-05T09:26:40.229 INFO:tasks.workunit.client.0.smithi067.stdout:6/776: chown da/d10/d1e/d51/f7a 226671 1 2023-12-05T09:26:40.234 INFO:tasks.workunit.client.0.smithi067.stdout:5/871: dwrite db/df/f16 [4194304,4194304] 0 2023-12-05T09:26:40.237 INFO:tasks.workunit.client.0.smithi067.stdout:5/872: creat db/df/d3f/dd9/de7/dfd/d1d/d20/f124 x:0 0 0 2023-12-05T09:26:40.237 INFO:tasks.workunit.client.0.smithi067.stdout:5/873: write db/df/d35/d63/faf [153313,108328] 0 2023-12-05T09:26:40.237 INFO:tasks.workunit.client.0.smithi067.stdout:2/779: dread d0/d25/d9d/d53/d1e/d8e/dd0/d39/fa5 [0,4194304] 0 2023-12-05T09:26:40.238 INFO:tasks.workunit.client.0.smithi067.stdout:2/780: dread - d0/d25/d3f/d83/f107 zero size 2023-12-05T09:26:40.238 INFO:tasks.workunit.client.0.smithi067.stdout:3/794: unlink d9/da/ld2 0 2023-12-05T09:26:40.238 INFO:tasks.workunit.client.0.smithi067.stdout:3/795: write d9/d62/f4c [2309529,3508] 0 2023-12-05T09:26:40.238 INFO:tasks.workunit.client.0.smithi067.stdout:8/904: write d5/d3b/fa1 [29510,18049] 0 2023-12-05T09:26:40.238 INFO:tasks.workunit.client.0.smithi067.stdout:8/905: fdatasync d5/fb6 0 2023-12-05T09:26:40.240 INFO:tasks.workunit.client.0.smithi067.stdout:2/781: truncate d0/d25/d34/d4a/fb3 2844228 0 2023-12-05T09:26:40.240 INFO:tasks.workunit.client.0.smithi067.stdout:2/782: fsync d0/d25/d34/d4d/d78/ffe 0 2023-12-05T09:26:40.240 INFO:tasks.workunit.client.0.smithi067.stdout:3/796: mknod d9/da/d15/d17/d1a/c117 0 2023-12-05T09:26:40.241 INFO:tasks.workunit.client.0.smithi067.stdout:2/783: write d0/d25/d34/d4d/d72/fea [135614,25605] 0 2023-12-05T09:26:40.247 INFO:tasks.workunit.client.0.smithi067.stdout:2/784: link d0/d25/d9d/d53/d1e/d8e/fd9 d0/d25/d34/d4d/d54/d90/f114 0 2023-12-05T09:26:40.251 INFO:tasks.workunit.client.0.smithi067.stdout:6/777: write da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/fcf [397871,23686] 0 2023-12-05T09:26:40.260 INFO:tasks.workunit.client.0.smithi067.stdout:2/785: read d0/d25/d9d/d53/d1e/f3e [3547793,1519] 0 2023-12-05T09:26:40.264 INFO:tasks.workunit.client.0.smithi067.stdout:1/840: dread d2/d5/d7/de/f37 [0,4194304] 0 2023-12-05T09:26:40.270 INFO:tasks.workunit.client.0.smithi067.stdout:8/906: write d5/da/f56 [538742,16980] 0 2023-12-05T09:26:40.270 INFO:tasks.workunit.client.0.smithi067.stdout:8/907: creat d5/dc/d1a/d20/d2d/d41/db2/f112 x:0 0 0 2023-12-05T09:26:40.281 INFO:tasks.workunit.client.0.smithi067.stdout:1/841: mknod d2/d5/d7/de/d19/c120 0 2023-12-05T09:26:40.281 INFO:tasks.workunit.client.0.smithi067.stdout:8/908: creat d5/d6a/f113 x:0 0 0 2023-12-05T09:26:40.283 INFO:tasks.workunit.client.0.smithi067.stdout:1/842: creat d2/d4f/d54/d70/db4/f121 x:0 0 0 2023-12-05T09:26:40.286 INFO:tasks.workunit.client.0.smithi067.stdout:8/909: creat d5/dc/d1a/d20/d3e/d79/f114 x:0 0 0 2023-12-05T09:26:40.286 INFO:tasks.workunit.client.0.smithi067.stdout:1/843: creat d2/d4f/d15/d74/f122 x:0 0 0 2023-12-05T09:26:40.287 INFO:tasks.workunit.client.0.smithi067.stdout:1/844: truncate d2/d5/d7/de/d1a/fbf 62213 0 2023-12-05T09:26:40.292 INFO:tasks.workunit.client.0.smithi067.stdout:5/874: dwrite db/df/d82/f10d [0,4194304] 0 2023-12-05T09:26:40.293 INFO:tasks.workunit.client.0.smithi067.stdout:2/786: write d0/d25/d34/d4a/f9a [478479,110584] 0 2023-12-05T09:26:40.293 INFO:tasks.workunit.client.0.smithi067.stdout:5/875: rmdir db/df/d3f/dd9/de7/dfd/d59 39 2023-12-05T09:26:40.298 INFO:tasks.workunit.client.0.smithi067.stdout:2/787: unlink d0/d25/d9d/d53/d92/fe5 0 2023-12-05T09:26:40.298 INFO:tasks.workunit.client.0.smithi067.stdout:2/788: chown d0/d25/d9d/d53/d1e/d8e/dd0/d84/de8 307849 1 2023-12-05T09:26:40.300 INFO:tasks.workunit.client.0.smithi067.stdout:2/789: unlink d0/d25/d9d/d53/d1e/d8e/dd0/d84/c93 0 2023-12-05T09:26:40.303 INFO:tasks.workunit.client.0.smithi067.stdout:2/790: rename d0/d25/d9d/d53/d1e/f3e to d0/d25/d34/d4d/db0/dbf/f115 0 2023-12-05T09:26:40.305 INFO:tasks.workunit.client.0.smithi067.stdout:2/791: creat d0/d7c/f116 x:0 0 0 2023-12-05T09:26:40.310 INFO:tasks.workunit.client.0.smithi067.stdout:8/910: write d5/dc/d1a/d20/d3e/dbf/fc4 [3793180,52492] 0 2023-12-05T09:26:40.313 INFO:tasks.workunit.client.0.smithi067.stdout:8/911: rmdir d5/dc/d1a/d20/d2d/d8a 39 2023-12-05T09:26:40.316 INFO:tasks.workunit.client.0.smithi067.stdout:8/912: link d5/dc/d1a/cdc d5/dc/d1a/c115 0 2023-12-05T09:26:40.316 INFO:tasks.workunit.client.0.smithi067.stdout:8/913: chown d5/dc/d1a/d20/d58/d90/d111 73784 1 2023-12-05T09:26:40.317 INFO:tasks.workunit.client.0.smithi067.stdout:8/914: write d5/dc/d1a/d20/d2d/d8a/fca [2478538,46243] 0 2023-12-05T09:26:40.318 INFO:tasks.workunit.client.0.smithi067.stdout:8/915: creat d5/dc/d1a/d20/d2d/d7f/d94/da3/f116 x:0 0 0 2023-12-05T09:26:40.328 INFO:tasks.workunit.client.0.smithi067.stdout:3/797: dwrite d9/d62/f88 [0,4194304] 0 2023-12-05T09:26:40.329 INFO:tasks.workunit.client.0.smithi067.stdout:3/798: write d9/f107 [401078,83353] 0 2023-12-05T09:26:40.335 INFO:tasks.workunit.client.0.smithi067.stdout:3/799: rename d9/da/d15/d17/d1a/f35 to d9/da/d15/d17/d2b/f118 0 2023-12-05T09:26:40.338 INFO:tasks.workunit.client.0.smithi067.stdout:3/800: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/f119 x:0 0 0 2023-12-05T09:26:40.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/845: dwrite d2/d4f/d54/f8c [0,4194304] 0 2023-12-05T09:26:40.354 INFO:tasks.workunit.client.0.smithi067.stdout:1/846: chown d2/d4f/d15/d74/f122 0 1 2023-12-05T09:26:40.355 INFO:tasks.workunit.client.0.smithi067.stdout:1/847: creat d2/d3/da6/dbd/dd8/f123 x:0 0 0 2023-12-05T09:26:40.356 INFO:tasks.workunit.client.0.smithi067.stdout:1/848: mknod d2/d4f/d14/d20/d83/d78/c124 0 2023-12-05T09:26:40.356 INFO:tasks.workunit.client.0.smithi067.stdout:1/849: rmdir d2/d4f/d54/d70 39 2023-12-05T09:26:40.363 INFO:tasks.workunit.client.0.smithi067.stdout:8/916: dread d5/dc/d1a/d20/f59 [0,4194304] 0 2023-12-05T09:26:40.364 INFO:tasks.workunit.client.0.smithi067.stdout:3/801: write d9/d20/fac [940681,80383] 0 2023-12-05T09:26:40.365 INFO:tasks.workunit.client.0.smithi067.stdout:8/917: getdents d5/dc/d6e 0 2023-12-05T09:26:40.371 INFO:tasks.workunit.client.0.smithi067.stdout:3/802: rename d9/da/d15/d17/fe4 to d9/da/d15/d17/d1a/d51/d70/f11a 0 2023-12-05T09:26:40.371 INFO:tasks.workunit.client.0.smithi067.stdout:8/918: symlink d5/dc/d1a/d20/d58/d90/l117 0 2023-12-05T09:26:40.371 INFO:tasks.workunit.client.0.smithi067.stdout:8/919: fsync d5/f18 0 2023-12-05T09:26:40.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:40 smithi067 ceph-mon[107174]: pgmap v35: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 140 MiB/s rd, 185 MiB/s wr, 277 op/s 2023-12-05T09:26:40.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:40 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:40.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:40 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:40.377 INFO:tasks.workunit.client.0.smithi067.stdout:6/778: dwrite da/d10/f100 [0,4194304] 0 2023-12-05T09:26:40.377 INFO:tasks.workunit.client.0.smithi067.stdout:6/779: fsync da/d10/d1e/d17/d2f/d59/d6c/f108 0 2023-12-05T09:26:40.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:40 smithi134 ceph-mon[116304]: pgmap v35: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 140 MiB/s rd, 185 MiB/s wr, 277 op/s 2023-12-05T09:26:40.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:40 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:40.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:40 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:40.379 INFO:tasks.workunit.client.0.smithi067.stdout:3/803: dread d9/da/d15/d17/d1a/d51/d66/d82/da1/f41 [0,4194304] 0 2023-12-05T09:26:40.379 INFO:tasks.workunit.client.0.smithi067.stdout:5/876: dwrite db/f13 [0,4194304] 0 2023-12-05T09:26:40.380 INFO:tasks.workunit.client.0.smithi067.stdout:6/780: getdents da/d10/d1e/d17/d2f/d1f/d9e 0 2023-12-05T09:26:40.380 INFO:tasks.workunit.client.0.smithi067.stdout:6/781: chown da/d10/d1e/d17/d2f/d1f/f25 5 1 2023-12-05T09:26:40.380 INFO:tasks.workunit.client.0.smithi067.stdout:2/792: dwrite d0/d25/d34/d4d/d54/d90/dcf/ff4 [0,4194304] 0 2023-12-05T09:26:40.383 INFO:tasks.workunit.client.0.smithi067.stdout:3/804: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/f11b x:0 0 0 2023-12-05T09:26:40.383 INFO:tasks.workunit.client.0.smithi067.stdout:3/805: write d9/da/d15/d17/d1a/d51/f75 [5194846,96420] 0 2023-12-05T09:26:40.384 INFO:tasks.workunit.client.0.smithi067.stdout:5/877: creat db/df/d35/d63/f125 x:0 0 0 2023-12-05T09:26:40.391 INFO:tasks.workunit.client.0.smithi067.stdout:6/782: rename da/d10/d1e/d17/d2f/d1f/d9e/dfd/dcb to da/d10/d1e/d17/d2f/d5f/d115 0 2023-12-05T09:26:40.391 INFO:tasks.workunit.client.0.smithi067.stdout:6/783: fsync da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f112 0 2023-12-05T09:26:40.391 INFO:tasks.workunit.client.0.smithi067.stdout:6/784: readlink da/d10/d1e/d17/d2f/d1f/d27/d4f/l88 0 2023-12-05T09:26:40.391 INFO:tasks.workunit.client.0.smithi067.stdout:8/920: read d5/dc/d1a/d62/d7e/ff1 [292834,21542] 0 2023-12-05T09:26:40.393 INFO:tasks.workunit.client.0.smithi067.stdout:3/806: symlink d9/d24/db6/l11c 0 2023-12-05T09:26:40.393 INFO:tasks.workunit.client.0.smithi067.stdout:3/807: dread - d9/f9e zero size 2023-12-05T09:26:40.393 INFO:tasks.workunit.client.0.smithi067.stdout:2/793: write d0/d25/d9d/d53/d1e/d8e/dd0/d39/fa5 [242847,55610] 0 2023-12-05T09:26:40.397 INFO:tasks.workunit.client.0.smithi067.stdout:3/808: mkdir d9/d62/dd0/d11d 0 2023-12-05T09:26:40.400 INFO:tasks.workunit.client.0.smithi067.stdout:2/794: creat d0/d25/d9d/d53/d1e/d8e/dd0/d39/f117 x:0 0 0 2023-12-05T09:26:40.400 INFO:tasks.workunit.client.0.smithi067.stdout:2/795: chown d0/fb4 9092 1 2023-12-05T09:26:40.401 INFO:tasks.workunit.client.0.smithi067.stdout:3/809: mkdir d9/d24/db8/d11e 0 2023-12-05T09:26:40.401 INFO:tasks.workunit.client.0.smithi067.stdout:3/810: fsync d9/da/d15/d17/fab 0 2023-12-05T09:26:40.404 INFO:tasks.workunit.client.0.smithi067.stdout:6/785: read da/d10/d1e/d17/d2f/d2c/dc3/fe7 [321607,16570] 0 2023-12-05T09:26:40.404 INFO:tasks.workunit.client.0.smithi067.stdout:2/796: truncate d0/d25/d9d/d53/d1e/d8e/dd0/d84/fa2 909010 0 2023-12-05T09:26:40.404 INFO:tasks.workunit.client.0.smithi067.stdout:5/878: read db/df/db5/fe1 [3244995,106760] 0 2023-12-05T09:26:40.405 INFO:tasks.workunit.client.0.smithi067.stdout:5/879: dread - db/df/d3f/dd9/de7/dfd/d1d/d20/fa5 zero size 2023-12-05T09:26:40.407 INFO:tasks.workunit.client.0.smithi067.stdout:6/786: mknod da/d10/d1e/d17/d2f/d1f/d27/c116 0 2023-12-05T09:26:40.408 INFO:tasks.workunit.client.0.smithi067.stdout:2/797: symlink d0/d109/l118 0 2023-12-05T09:26:40.413 INFO:tasks.workunit.client.0.smithi067.stdout:5/880: creat db/df/d35/d63/d11f/f126 x:0 0 0 2023-12-05T09:26:40.414 INFO:tasks.workunit.client.0.smithi067.stdout:3/811: getdents d9/d62 0 2023-12-05T09:26:40.414 INFO:tasks.workunit.client.0.smithi067.stdout:3/812: truncate d9/d62/f4c 4459182 0 2023-12-05T09:26:40.418 INFO:tasks.workunit.client.0.smithi067.stdout:6/787: mknod da/d10/d1e/d17/d2f/c117 0 2023-12-05T09:26:40.418 INFO:tasks.workunit.client.0.smithi067.stdout:6/788: chown da/d10/d1e/d17/d2f/d59/le1 9 1 2023-12-05T09:26:40.421 INFO:tasks.workunit.client.0.smithi067.stdout:8/921: stat d5/f18 0 2023-12-05T09:26:40.421 INFO:tasks.workunit.client.0.smithi067.stdout:8/922: fdatasync d5/dc/d1a/d20/f22 0 2023-12-05T09:26:40.421 INFO:tasks.workunit.client.0.smithi067.stdout:8/923: fdatasync d5/dc/d1a/d20/f59 0 2023-12-05T09:26:40.421 INFO:tasks.workunit.client.0.smithi067.stdout:8/924: stat d5/dc/d1a/d20/d2d/d8a/fe1 0 2023-12-05T09:26:40.428 INFO:tasks.workunit.client.0.smithi067.stdout:8/925: mknod d5/dc/d1a/d20/d2d/d8a/c118 0 2023-12-05T09:26:40.429 INFO:tasks.workunit.client.0.smithi067.stdout:1/850: dwrite d2/d4f/d15/d74/de7/ff1 [0,4194304] 0 2023-12-05T09:26:40.434 INFO:tasks.workunit.client.0.smithi067.stdout:6/789: dread da/d10/d1e/d51/f7a [0,4194304] 0 2023-12-05T09:26:40.435 INFO:tasks.workunit.client.0.smithi067.stdout:3/813: read d9/da/d3b/ff1 [2351128,57463] 0 2023-12-05T09:26:40.435 INFO:tasks.workunit.client.0.smithi067.stdout:3/814: truncate d9/da/f6c 970691 0 2023-12-05T09:26:40.450 INFO:tasks.workunit.client.0.smithi067.stdout:3/815: write d9/da/d15/d17/d1a/d51/d66/fd9 [1015655,9649] 0 2023-12-05T09:26:40.451 INFO:tasks.workunit.client.0.smithi067.stdout:6/790: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d105/f118 x:0 0 0 2023-12-05T09:26:40.452 INFO:tasks.workunit.client.0.smithi067.stdout:3/816: chown d9/l10d 0 1 2023-12-05T09:26:40.453 INFO:tasks.workunit.client.0.smithi067.stdout:6/791: mknod da/d10/d1e/d17/d2f/d5f/d115/c119 0 2023-12-05T09:26:40.456 INFO:tasks.workunit.client.0.smithi067.stdout:6/792: creat da/d10/d1e/d17/d2f/d2c/df7/f11a x:0 0 0 2023-12-05T09:26:40.460 INFO:tasks.workunit.client.0.smithi067.stdout:6/793: mkdir da/d10/d1e/d11b 0 2023-12-05T09:26:40.460 INFO:tasks.workunit.client.0.smithi067.stdout:6/794: fsync da/d10/d1e/d7f/fad 0 2023-12-05T09:26:40.460 INFO:tasks.workunit.client.0.smithi067.stdout:4/781: sync 2023-12-05T09:26:40.460 INFO:tasks.workunit.client.0.smithi067.stdout:7/724: sync 2023-12-05T09:26:40.463 INFO:tasks.workunit.client.0.smithi067.stdout:4/782: symlink d0/d1d/d53/da8/da9/d15/dd0/dd9/de6/d104/l116 0 2023-12-05T09:26:40.464 INFO:tasks.workunit.client.0.smithi067.stdout:4/783: creat d0/d1d/d25/d32/f117 x:0 0 0 2023-12-05T09:26:40.466 INFO:tasks.workunit.client.0.smithi067.stdout:7/725: creat d0/d9/d56/fee x:0 0 0 2023-12-05T09:26:40.466 INFO:tasks.workunit.client.0.smithi067.stdout:7/726: creat d0/d9/d10/d37/d38/d64/d34/d67/d72/da4/fef x:0 0 0 2023-12-05T09:26:40.468 INFO:tasks.workunit.client.0.smithi067.stdout:6/795: getdents da/d7d/dd7 0 2023-12-05T09:26:40.468 INFO:tasks.workunit.client.0.smithi067.stdout:6/796: write da/d10/d1e/d51/d7b/dee/f103 [349692,130170] 0 2023-12-05T09:26:40.471 INFO:tasks.workunit.client.0.smithi067.stdout:4/784: mkdir d0/d1d/d118 0 2023-12-05T09:26:40.475 INFO:tasks.workunit.client.0.smithi067.stdout:7/727: mknod d0/d9/d10/cf0 0 2023-12-05T09:26:40.475 INFO:tasks.workunit.client.0.smithi067.stdout:6/797: symlink da/d10/d1e/d17/d2f/d1f/d27/daa/l11c 0 2023-12-05T09:26:40.481 INFO:tasks.workunit.client.0.smithi067.stdout:7/728: rename d0/d9/d10/f2f to d0/d9/d56/ff1 0 2023-12-05T09:26:40.483 INFO:tasks.workunit.client.0.smithi067.stdout:7/729: mkdir d0/d9/d56/df2 0 2023-12-05T09:26:40.484 INFO:tasks.workunit.client.0.smithi067.stdout:7/730: getdents d0/d9/d10/d37/d38 0 2023-12-05T09:26:40.484 INFO:tasks.workunit.client.0.smithi067.stdout:7/731: write d0/d9/d40/f97 [664939,110148] 0 2023-12-05T09:26:40.485 INFO:tasks.workunit.client.0.smithi067.stdout:7/732: fdatasync d0/d9/d10/d37/d38/db7/fdd 0 2023-12-05T09:26:40.486 INFO:tasks.workunit.client.0.smithi067.stdout:1/851: dwrite d2/fa7 [0,4194304] 0 2023-12-05T09:26:40.488 INFO:tasks.workunit.client.0.smithi067.stdout:7/733: rename d0/d9/d10/d37/d38/d64/d5a/f7c to d0/d45/ff3 0 2023-12-05T09:26:40.489 INFO:tasks.workunit.client.0.smithi067.stdout:7/734: fdatasync d0/d9/d56/d8e/daa/fe6 0 2023-12-05T09:26:40.526 INFO:tasks.workunit.client.0.smithi067.stdout:8/926: dwrite d5/dc/d1a/d20/d3e/d79/f114 [0,4194304] 0 2023-12-05T09:26:40.526 INFO:tasks.workunit.client.0.smithi067.stdout:3/817: dread d9/d24/f33 [0,4194304] 0 2023-12-05T09:26:40.531 INFO:tasks.workunit.client.0.smithi067.stdout:8/927: mknod d5/da/c119 0 2023-12-05T09:26:40.531 INFO:tasks.workunit.client.0.smithi067.stdout:8/928: creat d5/dc/d1a/d20/d2d/d41/f11a x:0 0 0 2023-12-05T09:26:40.534 INFO:tasks.workunit.client.0.smithi067.stdout:8/929: creat d5/dc/d1a/d20/d2d/d7f/d94/da3/f11b x:0 0 0 2023-12-05T09:26:40.535 INFO:tasks.workunit.client.0.smithi067.stdout:7/735: dwrite d0/d9/d10/d37/d38/f75 [4194304,4194304] 0 2023-12-05T09:26:40.543 INFO:tasks.workunit.client.0.smithi067.stdout:3/818: write f7 [1298935,30738] 0 2023-12-05T09:26:40.545 INFO:tasks.workunit.client.0.smithi067.stdout:3/819: rename d9/da/d15/d17/d1a/la0 to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/d110/l11f 0 2023-12-05T09:26:40.545 INFO:tasks.workunit.client.0.smithi067.stdout:3/820: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/fe8 [749053,73581] 0 2023-12-05T09:26:40.546 INFO:tasks.workunit.client.0.smithi067.stdout:3/821: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/c120 0 2023-12-05T09:26:40.549 INFO:tasks.workunit.client.0.smithi067.stdout:4/785: dwrite d0/d1d/d25/d38/fbf [4194304,4194304] 0 2023-12-05T09:26:40.549 INFO:tasks.workunit.client.0.smithi067.stdout:4/786: dread - d0/d1d/d53/da8/da9/f113 zero size 2023-12-05T09:26:40.550 INFO:tasks.workunit.client.0.smithi067.stdout:4/787: write d0/ff7 [13464,105570] 0 2023-12-05T09:26:40.550 INFO:tasks.workunit.client.0.smithi067.stdout:4/788: stat d0/d9/c75 0 2023-12-05T09:26:40.552 INFO:tasks.workunit.client.0.smithi067.stdout:4/789: creat d0/d1d/d25/d32/d107/f119 x:0 0 0 2023-12-05T09:26:40.561 INFO:tasks.workunit.client.0.smithi067.stdout:3/822: dread d9/d62/f4c [0,4194304] 0 2023-12-05T09:26:40.562 INFO:tasks.workunit.client.0.smithi067.stdout:3/823: symlink d9/da/d15/l121 0 2023-12-05T09:26:40.563 INFO:tasks.workunit.client.0.smithi067.stdout:3/824: rmdir d9/da/d15/d17/d2b 39 2023-12-05T09:26:40.565 INFO:tasks.workunit.client.0.smithi067.stdout:3/825: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/l122 0 2023-12-05T09:26:40.565 INFO:tasks.workunit.client.0.smithi067.stdout:3/826: dread - d9/da/d15/d17/d1a/d51/dcd/fd8 zero size 2023-12-05T09:26:40.565 INFO:tasks.workunit.client.0.smithi067.stdout:3/827: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/f123 x:0 0 0 2023-12-05T09:26:40.592 INFO:tasks.workunit.client.0.smithi067.stdout:1/852: write d2/d3/f21 [3522230,87949] 0 2023-12-05T09:26:40.592 INFO:tasks.workunit.client.0.smithi067.stdout:6/798: dwrite da/d10/d1e/d17/d2f/d1f/d27/daa/faf [0,4194304] 0 2023-12-05T09:26:40.599 INFO:tasks.workunit.client.0.smithi067.stdout:1/853: mkdir d2/d3/da6/dbd/dd8/d125 0 2023-12-05T09:26:40.602 INFO:tasks.workunit.client.0.smithi067.stdout:1/854: rename d2/d5/d7/c87 to d2/d4f/d14/d20/d83/c126 0 2023-12-05T09:26:40.604 INFO:tasks.workunit.client.0.smithi067.stdout:1/855: stat d2/d4f/l93 0 2023-12-05T09:26:40.604 INFO:tasks.workunit.client.0.smithi067.stdout:1/856: read - d2/d4f/d54/d70/db4/fc3 zero size 2023-12-05T09:26:40.606 INFO:tasks.workunit.client.0.smithi067.stdout:1/857: creat d2/d5/f127 x:0 0 0 2023-12-05T09:26:40.608 INFO:tasks.workunit.client.0.smithi067.stdout:1/858: symlink d2/d4f/d54/d70/db4/l128 0 2023-12-05T09:26:40.610 INFO:tasks.workunit.client.0.smithi067.stdout:8/930: dwrite d5/d9d/f110 [0,4194304] 0 2023-12-05T09:26:40.610 INFO:tasks.workunit.client.0.smithi067.stdout:8/931: write d5/dc/d1a/d20/d2d/d7f/d94/da3/f11b [799055,55053] 0 2023-12-05T09:26:40.610 INFO:tasks.workunit.client.0.smithi067.stdout:7/736: dread d0/d9/d10/d37/d38/d64/d34/d67/fc7 [0,4194304] 0 2023-12-05T09:26:40.611 INFO:tasks.workunit.client.0.smithi067.stdout:7/737: chown d0/c13 30 1 2023-12-05T09:26:40.614 INFO:tasks.workunit.client.0.smithi067.stdout:1/859: creat d2/d5/d50/f129 x:0 0 0 2023-12-05T09:26:40.614 INFO:tasks.workunit.client.0.smithi067.stdout:4/790: dwrite d0/d1d/d25/d2c/d34/f86 [0,4194304] 0 2023-12-05T09:26:40.614 INFO:tasks.workunit.client.0.smithi067.stdout:4/791: fsync d0/d1d/d25/d2c/d34/d4e/fa1 0 2023-12-05T09:26:40.614 INFO:tasks.workunit.client.0.smithi067.stdout:4/792: fdatasync d0/d1d/d53/d62/fc2 0 2023-12-05T09:26:40.622 INFO:tasks.workunit.client.0.smithi067.stdout:8/932: link d5/dc/d1a/d20/d3e/dbf/lec d5/dc/d1a/d20/d58/d90/l11c 0 2023-12-05T09:26:40.622 INFO:tasks.workunit.client.0.smithi067.stdout:8/933: write d5/dc/d6e/f78 [526585,59885] 0 2023-12-05T09:26:40.629 INFO:tasks.workunit.client.0.smithi067.stdout:8/934: write d5/dc/d1a/d20/d58/fd3 [430514,70973] 0 2023-12-05T09:26:40.645 INFO:tasks.workunit.client.0.smithi067.stdout:1/860: dwrite d2/ddb/f116 [0,4194304] 0 2023-12-05T09:26:40.646 INFO:tasks.workunit.client.0.smithi067.stdout:1/861: rmdir d2/d4f/d14/d48 39 2023-12-05T09:26:40.648 INFO:tasks.workunit.client.0.smithi067.stdout:1/862: chown d2/d5/d7/de/d1a/c43 143467 1 2023-12-05T09:26:40.649 INFO:tasks.workunit.client.0.smithi067.stdout:1/863: rmdir d2/d4f 39 2023-12-05T09:26:40.656 INFO:tasks.workunit.client.0.smithi067.stdout:6/799: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/fb4 [0,4194304] 0 2023-12-05T09:26:40.658 INFO:tasks.workunit.client.0.smithi067.stdout:6/800: mknod da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/c11d 0 2023-12-05T09:26:40.658 INFO:tasks.workunit.client.0.smithi067.stdout:6/801: fsync da/d10/d1e/d17/d2f/f2b 0 2023-12-05T09:26:40.659 INFO:tasks.workunit.client.0.smithi067.stdout:6/802: dread - da/d10/d1e/d17/d2f/d1f/d9e/fe8 zero size 2023-12-05T09:26:40.659 INFO:tasks.workunit.client.0.smithi067.stdout:6/803: dread - da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/fe4 zero size 2023-12-05T09:26:40.659 INFO:tasks.workunit.client.0.smithi067.stdout:6/804: readlink da/d10/d1e/d17/d2f/d2c/dc3/l10d 0 2023-12-05T09:26:40.659 INFO:tasks.workunit.client.0.smithi067.stdout:6/805: fdatasync da/d10/d1e/d17/f23 0 2023-12-05T09:26:40.659 INFO:tasks.workunit.client.0.smithi067.stdout:6/806: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d105/f11e x:0 0 0 2023-12-05T09:26:40.661 INFO:tasks.workunit.client.0.smithi067.stdout:6/807: mkdir da/d10/d1e/d17/d2f/d72/d11f 0 2023-12-05T09:26:40.662 INFO:tasks.workunit.client.0.smithi067.stdout:6/808: fsync da/d10/d1e/d51/d7b/dd6/fea 0 2023-12-05T09:26:40.662 INFO:tasks.workunit.client.0.smithi067.stdout:6/809: creat da/d10/d1e/d17/d2f/df5/f120 x:0 0 0 2023-12-05T09:26:40.662 INFO:tasks.workunit.client.0.smithi067.stdout:6/810: truncate da/d10/d1e/d51/d7b/f111 366466 0 2023-12-05T09:26:40.662 INFO:tasks.workunit.client.0.smithi067.stdout:6/811: write da/d10/d1e/d51/d7b/f111 [889659,82523] 0 2023-12-05T09:26:40.684 INFO:tasks.workunit.client.0.smithi067.stdout:8/935: dread d5/dc/d1a/d20/d2d/d7f/d94/da3/fa4 [0,4194304] 0 2023-12-05T09:26:40.684 INFO:tasks.workunit.client.0.smithi067.stdout:4/793: dwrite d0/d1d/d53/da8/da9/d15/f33 [4194304,4194304] 0 2023-12-05T09:26:40.686 INFO:tasks.workunit.client.0.smithi067.stdout:8/936: symlink d5/dc/d1a/d62/d7e/l11d 0 2023-12-05T09:26:40.691 INFO:tasks.workunit.client.0.smithi067.stdout:8/937: chown d5/d9d/dab 551 1 2023-12-05T09:26:40.691 INFO:tasks.workunit.client.0.smithi067.stdout:4/794: rename d0/d1d/d25/d32/c18 to d0/d1d/d2b/dd6/c11a 0 2023-12-05T09:26:40.691 INFO:tasks.workunit.client.0.smithi067.stdout:4/795: chown d0/d1d/d25/d2c/d34/d4e/d5a/d88/l8a 681139 1 2023-12-05T09:26:40.691 INFO:tasks.workunit.client.0.smithi067.stdout:4/796: creat d0/d9/f11b x:0 0 0 2023-12-05T09:26:40.697 INFO:tasks.workunit.client.0.smithi067.stdout:7/738: dwrite d0/d9/d10/fb8 [0,4194304] 0 2023-12-05T09:26:40.701 INFO:tasks.workunit.client.0.smithi067.stdout:7/739: link d0/c13 d0/d9/d10/d37/d38/d64/d34/d67/d72/cf4 0 2023-12-05T09:26:40.701 INFO:tasks.workunit.client.0.smithi067.stdout:7/740: chown d0/d9/d40/d7a/dad/fcf 1100857 1 2023-12-05T09:26:40.704 INFO:tasks.workunit.client.0.smithi067.stdout:7/741: creat d0/d9/d56/df2/ff5 x:0 0 0 2023-12-05T09:26:40.706 INFO:tasks.workunit.client.0.smithi067.stdout:7/742: creat d0/dd4/ff6 x:0 0 0 2023-12-05T09:26:40.707 INFO:tasks.workunit.client.0.smithi067.stdout:7/743: creat d0/d9/d10/d37/d38/d64/d34/ff7 x:0 0 0 2023-12-05T09:26:40.707 INFO:tasks.workunit.client.0.smithi067.stdout:7/744: truncate d0/d9/d3f/dcc/fec 1005052 0 2023-12-05T09:26:40.726 INFO:tasks.workunit.client.0.smithi067.stdout:1/864: dwrite d2/d5/d7/de/d19/d49/f56 [0,4194304] 0 2023-12-05T09:26:40.726 INFO:tasks.workunit.client.0.smithi067.stdout:1/865: stat d2/d4f/d14/d20/d83/f6e 0 2023-12-05T09:26:40.727 INFO:tasks.workunit.client.0.smithi067.stdout:1/866: write d2/d4f/d14/d20/fcb [208290,117610] 0 2023-12-05T09:26:40.730 INFO:tasks.workunit.client.0.smithi067.stdout:1/867: truncate d2/d4f/d14/d48/f6b 990489 0 2023-12-05T09:26:40.730 INFO:tasks.workunit.client.0.smithi067.stdout:6/812: dwrite da/d10/d1e/d17/d2f/df5/ff9 [0,4194304] 0 2023-12-05T09:26:40.733 INFO:tasks.workunit.client.0.smithi067.stdout:6/813: link da/d10/d1e/l8d da/d10/d1e/d7f/l121 0 2023-12-05T09:26:40.736 INFO:tasks.workunit.client.0.smithi067.stdout:6/814: link da/d10/d1e/d17/d2f/c1b da/d10/d1e/d17/d2f/d1f/d27/d4f/d105/c122 0 2023-12-05T09:26:40.739 INFO:tasks.workunit.client.0.smithi067.stdout:6/815: mknod da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d5d/c123 0 2023-12-05T09:26:40.739 INFO:tasks.workunit.client.0.smithi067.stdout:6/816: truncate da/d10/d1e/d51/f7a 548872 0 2023-12-05T09:26:40.743 INFO:tasks.workunit.client.0.smithi067.stdout:6/817: creat da/d10/d1e/d17/d2f/d5f/d115/d10c/f124 x:0 0 0 2023-12-05T09:26:40.744 INFO:tasks.workunit.client.0.smithi067.stdout:6/818: write da/d10/d1e/d17/d2f/d2c/dc3/fe7 [2017800,5527] 0 2023-12-05T09:26:40.744 INFO:tasks.workunit.client.0.smithi067.stdout:2/798: sync 2023-12-05T09:26:40.744 INFO:tasks.workunit.client.0.smithi067.stdout:5/881: sync 2023-12-05T09:26:40.744 INFO:tasks.workunit.client.0.smithi067.stdout:5/882: fsync db/df/d82/fed 0 2023-12-05T09:26:40.744 INFO:tasks.workunit.client.0.smithi067.stdout:5/883: truncate db/df/d3f/fc3 4683530 0 2023-12-05T09:26:40.746 INFO:tasks.workunit.client.0.smithi067.stdout:5/884: creat db/df/f127 x:0 0 0 2023-12-05T09:26:40.746 INFO:tasks.workunit.client.0.smithi067.stdout:5/885: dread - db/df/d35/d63/d75/fac zero size 2023-12-05T09:26:40.746 INFO:tasks.workunit.client.0.smithi067.stdout:5/886: readlink db/df/db5/lf3 0 2023-12-05T09:26:40.746 INFO:tasks.workunit.client.0.smithi067.stdout:5/887: creat db/df/d38/f128 x:0 0 0 2023-12-05T09:26:40.751 INFO:tasks.workunit.client.0.smithi067.stdout:5/888: truncate db/df/d3f/dd9/de7/dfd/d1d/d20/f51 1239686 0 2023-12-05T09:26:40.751 INFO:tasks.workunit.client.0.smithi067.stdout:5/889: write db/df/d3f/d88/d8d/f11d [852549,2037] 0 2023-12-05T09:26:40.752 INFO:tasks.workunit.client.0.smithi067.stdout:5/890: mknod db/df/d38/c129 0 2023-12-05T09:26:40.755 INFO:tasks.workunit.client.0.smithi067.stdout:8/938: dwrite d5/dc/d1a/d20/d58/f8f [0,4194304] 0 2023-12-05T09:26:40.757 INFO:tasks.workunit.client.0.smithi067.stdout:6/819: dread da/d10/d1e/d51/d7b/f111 [0,4194304] 0 2023-12-05T09:26:40.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/820: unlink da/d10/d1e/c32 0 2023-12-05T09:26:40.764 INFO:tasks.workunit.client.0.smithi067.stdout:6/821: truncate da/d10/d1e/d17/d2f/d1f/d27/d4f/fb5 4631581 0 2023-12-05T09:26:40.770 INFO:tasks.workunit.client.0.smithi067.stdout:6/822: unlink da/d10/d1e/d17/d2f/d3f/lbf 0 2023-12-05T09:26:40.778 INFO:tasks.workunit.client.0.smithi067.stdout:8/939: write d5/dc/d1a/d20/d2d/d41/db2/fb7 [1270050,108277] 0 2023-12-05T09:26:40.780 INFO:tasks.workunit.client.0.smithi067.stdout:8/940: mkdir d5/dc/d1a/d20/d3e/d11e 0 2023-12-05T09:26:40.791 INFO:tasks.workunit.client.0.smithi067.stdout:2/799: dwrite d0/d25/d9d/d53/d1e/d8e/dd0/d39/f117 [0,4194304] 0 2023-12-05T09:26:40.792 INFO:tasks.workunit.client.0.smithi067.stdout:2/800: chown d0/d25/d9d/f76 265227 1 2023-12-05T09:26:40.802 INFO:tasks.workunit.client.0.smithi067.stdout:1/868: dwrite d2/d5/fad [0,4194304] 0 2023-12-05T09:26:40.803 INFO:tasks.workunit.client.0.smithi067.stdout:1/869: rmdir d2/d4f/d14/d48 39 2023-12-05T09:26:40.816 INFO:tasks.workunit.client.0.smithi067.stdout:8/941: dread d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/fd4 [0,4194304] 0 2023-12-05T09:26:40.817 INFO:tasks.workunit.client.0.smithi067.stdout:8/942: write d5/dc/d1a/f5a [1020066,32557] 0 2023-12-05T09:26:40.818 INFO:tasks.workunit.client.0.smithi067.stdout:6/823: dwrite da/d10/d1e/d51/d7b/dd6/ff4 [0,4194304] 0 2023-12-05T09:26:40.818 INFO:tasks.workunit.client.0.smithi067.stdout:6/824: creat da/d10/d1e/d17/d2f/d1f/d27/daa/f125 x:0 0 0 2023-12-05T09:26:40.826 INFO:tasks.workunit.client.0.smithi067.stdout:6/825: write da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fc0 [940238,130570] 0 2023-12-05T09:26:40.826 INFO:tasks.workunit.client.0.smithi067.stdout:6/826: truncate da/d10/d1e/d17/d2f/d5f/d115/d10c/f124 817933 0 2023-12-05T09:26:40.826 INFO:tasks.workunit.client.0.smithi067.stdout:6/827: fsync da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/fb4 0 2023-12-05T09:26:40.827 INFO:tasks.workunit.client.0.smithi067.stdout:6/828: write da/dde/d3b/fbb [3139534,4749] 0 2023-12-05T09:26:40.827 INFO:tasks.workunit.client.0.smithi067.stdout:6/829: dread - da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/fe4 zero size 2023-12-05T09:26:40.828 INFO:tasks.workunit.client.0.smithi067.stdout:6/830: mkdir da/d10/d1e/d17/d2f/d126 0 2023-12-05T09:26:40.866 INFO:tasks.workunit.client.0.smithi067.stdout:8/943: dwrite d5/dc/d1a/d20/d2d/d41/f11a [0,4194304] 0 2023-12-05T09:26:40.872 INFO:tasks.workunit.client.0.smithi067.stdout:2/801: dwrite d0/d25/d34/d4d/db0/dbf/f10d [0,4194304] 0 2023-12-05T09:26:40.872 INFO:tasks.workunit.client.0.smithi067.stdout:2/802: chown d0/d25/d9d/d53/d1e/d8e/dd0/d39/f40 130234398 1 2023-12-05T09:26:40.874 INFO:tasks.workunit.client.0.smithi067.stdout:2/803: link d0/d25/d34/l3b d0/d25/d3a/l119 0 2023-12-05T09:26:40.875 INFO:tasks.workunit.client.0.smithi067.stdout:2/804: write d0/d25/d9d/d53/d1e/d8e/dd0/f37 [4800574,104046] 0 2023-12-05T09:26:40.896 INFO:tasks.workunit.client.0.smithi067.stdout:6/831: dwrite da/d10/d1e/d17/d2f/d59/d6c/f108 [0,4194304] 0 2023-12-05T09:26:40.898 INFO:tasks.workunit.client.0.smithi067.stdout:6/832: link da/d10/d1e/d17/f81 da/d7d/f127 0 2023-12-05T09:26:40.930 INFO:tasks.workunit.client.0.smithi067.stdout:2/805: dwrite d0/d25/d9d/d53/d1e/d8e/dc4/fb2 [0,4194304] 0 2023-12-05T09:26:40.930 INFO:tasks.workunit.client.0.smithi067.stdout:2/806: fsync d0/d25/d34/d4d/d54/d90/dcf/fd8 0 2023-12-05T09:26:40.930 INFO:tasks.workunit.client.0.smithi067.stdout:2/807: read - d0/d25/d34/d4d/d72/fe0 zero size 2023-12-05T09:26:40.932 INFO:tasks.workunit.client.0.smithi067.stdout:8/944: dwrite d5/f40 [4194304,4194304] 0 2023-12-05T09:26:40.938 INFO:tasks.workunit.client.0.smithi067.stdout:8/945: write d5/dc/d1a/d20/d2d/d7f/d94/da3/f11b [31845,97393] 0 2023-12-05T09:26:40.950 INFO:tasks.workunit.client.0.smithi067.stdout:6/833: dwrite da/d10/f5e [0,4194304] 0 2023-12-05T09:26:40.950 INFO:tasks.workunit.client.0.smithi067.stdout:6/834: fsync da/d10/d1e/d17/d2f/d1f/d9e/dfd/f93 0 2023-12-05T09:26:40.953 INFO:tasks.workunit.client.0.smithi067.stdout:6/835: creat da/d10/d1e/d17/d2f/d5f/d110/f128 x:0 0 0 2023-12-05T09:26:40.953 INFO:tasks.workunit.client.0.smithi067.stdout:6/836: write da/d10/d1e/d17/d2f/d5f/d115/ff3 [112257,38208] 0 2023-12-05T09:26:40.954 INFO:tasks.workunit.client.0.smithi067.stdout:6/837: truncate da/d10/d1e/d17/d2f/d1f/d9e/ff6 790837 0 2023-12-05T09:26:40.956 INFO:tasks.workunit.client.0.smithi067.stdout:6/838: mknod da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d79/c129 0 2023-12-05T09:26:40.956 INFO:tasks.workunit.client.0.smithi067.stdout:6/839: readlink da/d10/d1e/d7f/lc4 0 2023-12-05T09:26:40.956 INFO:tasks.workunit.client.0.smithi067.stdout:6/840: fdatasync da/d7d/dd7/fdb 0 2023-12-05T09:26:40.956 INFO:tasks.workunit.client.0.smithi067.stdout:6/841: write da/d10/d1e/d17/f40 [49438,126243] 0 2023-12-05T09:26:40.957 INFO:tasks.workunit.client.0.smithi067.stdout:6/842: truncate da/d10/d1e/d17/d2f/d72/f97 4068164 0 2023-12-05T09:26:40.957 INFO:tasks.workunit.client.0.smithi067.stdout:6/843: chown da/d10/d1e/d51/fb6 694 1 2023-12-05T09:26:41.006 INFO:tasks.workunit.client.0.smithi067.stdout:6/844: dread da/d10/d1e/d17/d2f/d3f/d92/fcd [0,4194304] 0 2023-12-05T09:26:41.006 INFO:tasks.workunit.client.0.smithi067.stdout:6/845: read da/d10/d1e/d17/d2f/d1f/f25 [5999476,107416] 0 2023-12-05T09:26:41.006 INFO:tasks.workunit.client.0.smithi067.stdout:6/846: truncate da/d10/d1e/d51/d7b/f111 1374213 0 2023-12-05T09:26:41.006 INFO:tasks.workunit.client.0.smithi067.stdout:6/847: write da/d10/d1e/d17/d2f/d1f/d9e/fe8 [1020395,68282] 0 2023-12-05T09:26:41.014 INFO:tasks.workunit.client.0.smithi067.stdout:2/808: dwrite d0/d25/d34/d4d/db0/dbf/f115 [0,4194304] 0 2023-12-05T09:26:41.018 INFO:tasks.workunit.client.0.smithi067.stdout:8/946: dwrite d5/da/fcd [0,4194304] 0 2023-12-05T09:26:41.018 INFO:tasks.workunit.client.0.smithi067.stdout:8/947: chown d5/dc/d1a/d20 370143788 1 2023-12-05T09:26:41.018 INFO:tasks.workunit.client.0.smithi067.stdout:8/948: readlink d5/dc/d1a/d20/d58/lc8 0 2023-12-05T09:26:41.018 INFO:tasks.workunit.client.0.smithi067.stdout:3/828: sync 2023-12-05T09:26:41.067 INFO:tasks.workunit.client.0.smithi067.stdout:2/809: mkdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a 0 2023-12-05T09:26:41.096 INFO:tasks.workunit.client.0.smithi067.stdout:8/949: rename d5/dc/d1a/f64 to d5/dc/d1a/d20/d58/df5/f11f 0 2023-12-05T09:26:41.098 INFO:tasks.workunit.client.0.smithi067.stdout:6/848: dwrite da/d7d/f127 [0,4194304] 0 2023-12-05T09:26:41.102 INFO:tasks.workunit.client.0.smithi067.stdout:3/829: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/f9b [0,4194304] 0 2023-12-05T09:26:41.116 INFO:tasks.workunit.client.0.smithi067.stdout:6/849: dread da/d10/d1e/d17/f40 [0,4194304] 0 2023-12-05T09:26:41.116 INFO:tasks.workunit.client.0.smithi067.stdout:6/850: rename da/d10/d1e/d17/d2f to da/d10/d1e/d17/d2f/d5f/d12a 22 2023-12-05T09:26:41.124 INFO:tasks.workunit.client.0.smithi067.stdout:8/950: dread d5/dc/d1a/d62/f84 [0,4194304] 0 2023-12-05T09:26:41.133 INFO:tasks.workunit.client.0.smithi067.stdout:3/830: mknod d9/d62/c124 0 2023-12-05T09:26:41.135 INFO:tasks.workunit.client.0.smithi067.stdout:6/851: mknod da/d10/d1e/d17/d2f/d59/d6c/dbe/c12b 0 2023-12-05T09:26:41.137 INFO:tasks.workunit.client.0.smithi067.stdout:2/810: rmdir d0/d25/d34/d4d/d78 39 2023-12-05T09:26:41.140 INFO:tasks.workunit.client.0.smithi067.stdout:6/852: link da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f112 da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f12c 0 2023-12-05T09:26:41.141 INFO:tasks.workunit.client.0.smithi067.stdout:6/853: chown da/d10/d1e/d17/d2f/d3f/d92/fcd 7 1 2023-12-05T09:26:41.141 INFO:tasks.workunit.client.0.smithi067.stdout:6/854: readlink da/d10/d1e/d7f/lc4 0 2023-12-05T09:26:41.142 INFO:tasks.workunit.client.0.smithi067.stdout:6/855: read da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/f66 [1006423,11444] 0 2023-12-05T09:26:41.174 INFO:tasks.workunit.client.0.smithi067.stdout:8/951: dwrite d5/dc/d6e/f76 [0,4194304] 0 2023-12-05T09:26:41.174 INFO:tasks.workunit.client.0.smithi067.stdout:8/952: chown d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/cfe 0 1 2023-12-05T09:26:41.182 INFO:tasks.workunit.client.0.smithi067.stdout:4/797: sync 2023-12-05T09:26:41.183 INFO:tasks.workunit.client.0.smithi067.stdout:4/798: dread - d0/d1d/d25/d2c/d34/d4e/d5a/d88/d106/f112 zero size 2023-12-05T09:26:41.189 INFO:tasks.workunit.client.0.smithi067.stdout:8/953: read d5/f14 [3067287,61884] 0 2023-12-05T09:26:41.189 INFO:tasks.workunit.client.0.smithi067.stdout:4/799: dread d0/d1d/d53/da8/da9/d15/fa3 [0,4194304] 0 2023-12-05T09:26:41.189 INFO:tasks.workunit.client.0.smithi067.stdout:4/800: chown d0/d1d/d53/da8/da9/d15/dd0/cf5 147450 1 2023-12-05T09:26:41.191 INFO:tasks.workunit.client.0.smithi067.stdout:3/831: rename d9/d24 to d9/da/d15/d17/d125 0 2023-12-05T09:26:41.191 INFO:tasks.workunit.client.0.smithi067.stdout:3/832: write d9/da/d15/d17/d125/f5f [994815,52785] 0 2023-12-05T09:26:41.195 INFO:tasks.workunit.client.0.smithi067.stdout:2/811: rename d0/d25/d3f/d83/f107 to d0/d25/d9d/d53/d1e/d8e/dd0/d84/dec/f11b 0 2023-12-05T09:26:41.196 INFO:tasks.workunit.client.0.smithi067.stdout:2/812: creat d0/d25/d3f/d83/f11c x:0 0 0 2023-12-05T09:26:41.196 INFO:tasks.workunit.client.0.smithi067.stdout:2/813: truncate d0/d25/d9d/d53/d1e/d8e/dd0/d39/fa5 4323139 0 2023-12-05T09:26:41.196 INFO:tasks.workunit.client.0.smithi067.stdout:6/856: dwrite da/d10/d1e/d17/f40 [0,4194304] 0 2023-12-05T09:26:41.197 INFO:tasks.workunit.client.0.smithi067.stdout:8/954: rmdir d5/dc/d1a/d20/d2d/d41/db2/dc1 39 2023-12-05T09:26:41.201 INFO:tasks.workunit.client.0.smithi067.stdout:2/814: mknod d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/c11d 0 2023-12-05T09:26:41.202 INFO:tasks.workunit.client.0.smithi067.stdout:6/857: creat da/d7d/dd7/f12d x:0 0 0 2023-12-05T09:26:41.204 INFO:tasks.workunit.client.0.smithi067.stdout:8/955: rmdir d5/d9d 39 2023-12-05T09:26:41.206 INFO:tasks.workunit.client.0.smithi067.stdout:1/870: sync 2023-12-05T09:26:41.206 INFO:tasks.workunit.client.0.smithi067.stdout:7/745: sync 2023-12-05T09:26:41.206 INFO:tasks.workunit.client.0.smithi067.stdout:7/746: fsync d0/d9/d56/fee 0 2023-12-05T09:26:41.208 INFO:tasks.workunit.client.0.smithi067.stdout:4/801: rename d0/d1d/d25/d2c/d34 to d0/d1d/d53/da8/da9/d15/d11c 0 2023-12-05T09:26:41.209 INFO:tasks.workunit.client.0.smithi067.stdout:2/815: rmdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/de8 39 2023-12-05T09:26:41.210 INFO:tasks.workunit.client.0.smithi067.stdout:5/891: sync 2023-12-05T09:26:41.210 INFO:tasks.workunit.client.0.smithi067.stdout:5/892: truncate db/df/d36/d57/f10f 191685 0 2023-12-05T09:26:41.210 INFO:tasks.workunit.client.0.smithi067.stdout:5/893: creat db/df/d38/f12a x:0 0 0 2023-12-05T09:26:41.210 INFO:tasks.workunit.client.0.smithi067.stdout:6/858: getdents da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d5d 0 2023-12-05T09:26:41.213 INFO:tasks.workunit.client.0.smithi067.stdout:8/956: unlink d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/cd7 0 2023-12-05T09:26:41.215 INFO:tasks.workunit.client.0.smithi067.stdout:4/802: mknod d0/d1d/d2a/dba/c11d 0 2023-12-05T09:26:41.216 INFO:tasks.workunit.client.0.smithi067.stdout:4/803: creat d0/d9/f11e x:0 0 0 2023-12-05T09:26:41.217 INFO:tasks.workunit.client.0.smithi067.stdout:1/871: creat d2/d5/d7/de/d1a/f12a x:0 0 0 2023-12-05T09:26:41.217 INFO:tasks.workunit.client.0.smithi067.stdout:2/816: symlink d0/d25/d34/d4d/d54/d56/l11e 0 2023-12-05T09:26:41.217 INFO:tasks.workunit.client.0.smithi067.stdout:1/872: write d2/d3/da6/fb1 [4071067,119037] 0 2023-12-05T09:26:41.217 INFO:tasks.workunit.client.0.smithi067.stdout:2/817: read d0/d25/d34/d4d/d54/d90/fe4 [394579,9753] 0 2023-12-05T09:26:41.217 INFO:tasks.workunit.client.0.smithi067.stdout:2/818: write d0/d25/d3f/d83/fad [1369052,125405] 0 2023-12-05T09:26:41.218 INFO:tasks.workunit.client.0.smithi067.stdout:3/833: read d9/f67 [3452480,81000] 0 2023-12-05T09:26:41.218 INFO:tasks.workunit.client.0.smithi067.stdout:3/834: fsync d9/d20/f4f 0 2023-12-05T09:26:41.218 INFO:tasks.workunit.client.0.smithi067.stdout:3/835: chown d9/da/d15/d17/d125/la8 3916442 1 2023-12-05T09:26:41.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/957: symlink d5/d9d/dd9/d10f/l120 0 2023-12-05T09:26:41.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/958: fdatasync d5/dc/d1a/d20/d2d/d41/db2/fc0 0 2023-12-05T09:26:41.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/959: dread - d5/dc/d1a/d20/d2d/d7f/d94/da3/f101 zero size 2023-12-05T09:26:41.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/960: fdatasync d5/d6a/dc3/fdb 0 2023-12-05T09:26:41.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/961: write d5/d3b/fa1 [1041394,83044] 0 2023-12-05T09:26:41.219 INFO:tasks.workunit.client.0.smithi067.stdout:8/962: fdatasync d5/dc/d1a/d20/fa9 0 2023-12-05T09:26:41.220 INFO:tasks.workunit.client.0.smithi067.stdout:8/963: truncate d5/fdf 3893 0 2023-12-05T09:26:41.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/747: dread d0/d9/d40/f97 [0,4194304] 0 2023-12-05T09:26:41.222 INFO:tasks.workunit.client.0.smithi067.stdout:7/748: readlink d0/d9/lc1 0 2023-12-05T09:26:41.223 INFO:tasks.workunit.client.0.smithi067.stdout:2/819: link d0/d25/d3f/d83/fad d0/d25/d9d/d63/f11f 0 2023-12-05T09:26:41.225 INFO:tasks.workunit.client.0.smithi067.stdout:4/804: rename d0/d1d/d53/da8/da9/d15/f9c to d0/d1d/d2a/d72/f11f 0 2023-12-05T09:26:41.226 INFO:tasks.workunit.client.0.smithi067.stdout:3/836: symlink d9/da/d15/d17/d125/db8/d11e/l126 0 2023-12-05T09:26:41.228 INFO:tasks.workunit.client.0.smithi067.stdout:5/894: getdents db/df/d35/d63/d75 0 2023-12-05T09:26:41.233 INFO:tasks.workunit.client.0.smithi067.stdout:4/805: mkdir d0/d1d/d53/d120 0 2023-12-05T09:26:41.233 INFO:tasks.workunit.client.0.smithi067.stdout:4/806: stat d0/d1d/d53/da8/da9/d15/d11c/d4e/ld4 0 2023-12-05T09:26:41.235 INFO:tasks.workunit.client.0.smithi067.stdout:1/873: mknod d2/d3/c12b 0 2023-12-05T09:26:41.242 INFO:tasks.workunit.client.0.smithi067.stdout:4/807: symlink d0/l121 0 2023-12-05T09:26:41.248 INFO:tasks.workunit.client.0.smithi067.stdout:2/820: write d0/d25/d34/f3d [220798,122753] 0 2023-12-05T09:26:41.248 INFO:tasks.workunit.client.0.smithi067.stdout:7/749: dread d0/d9/d10/d37/d38/d64/d34/f36 [0,4194304] 0 2023-12-05T09:26:41.255 INFO:tasks.workunit.client.0.smithi067.stdout:4/808: link d0/d1d/d4d/f9b d0/d1d/d2a/d93/da4/f122 0 2023-12-05T09:26:41.255 INFO:tasks.workunit.client.0.smithi067.stdout:4/809: getdents d0/d1d/d53/da8/da9/de0 0 2023-12-05T09:26:41.263 INFO:tasks.workunit.client.0.smithi067.stdout:4/810: mknod d0/d9/c123 0 2023-12-05T09:26:41.264 INFO:tasks.workunit.client.0.smithi067.stdout:2/821: rmdir d0/d25/d9d/d53/d1e 39 2023-12-05T09:26:41.264 INFO:tasks.workunit.client.0.smithi067.stdout:2/822: chown d0/d25/d34/d4d/d54/d56/ff9 96914600 1 2023-12-05T09:26:41.268 INFO:tasks.workunit.client.0.smithi067.stdout:1/874: write d2/d3/da6/dbd/dd8/f10a [692171,45406] 0 2023-12-05T09:26:41.277 INFO:tasks.workunit.client.0.smithi067.stdout:2/823: rmdir d0/d25/d3f 39 2023-12-05T09:26:41.286 INFO:tasks.workunit.client.0.smithi067.stdout:8/964: dread d5/dc/d1a/d20/fbd [0,4194304] 0 2023-12-05T09:26:41.286 INFO:tasks.workunit.client.0.smithi067.stdout:8/965: truncate d5/dc/d1a/d62/fae 1299050 0 2023-12-05T09:26:41.287 INFO:tasks.workunit.client.0.smithi067.stdout:8/966: link d5/dc/d1a/d20/f25 d5/d6a/dc3/f121 0 2023-12-05T09:26:41.288 INFO:tasks.workunit.client.0.smithi067.stdout:8/967: rmdir d5/dc/d6e/dee/dfa 39 2023-12-05T09:26:41.291 INFO:tasks.workunit.client.0.smithi067.stdout:5/895: dwrite db/df/d3f/dd9/de7/dfd/f28 [4194304,4194304] 0 2023-12-05T09:26:41.291 INFO:tasks.workunit.client.0.smithi067.stdout:8/968: unlink d5/fe5 0 2023-12-05T09:26:41.294 INFO:tasks.workunit.client.0.smithi067.stdout:5/896: getdents db/df/d3f/dd9/de7/dfd 0 2023-12-05T09:26:41.295 INFO:tasks.workunit.client.0.smithi067.stdout:5/897: chown db/df/d3f/dd9/de7/dfd/d59/c93 1601 1 2023-12-05T09:26:41.295 INFO:tasks.workunit.client.0.smithi067.stdout:5/898: chown db/df/d3f/l49 285465 1 2023-12-05T09:26:41.297 INFO:tasks.workunit.client.0.smithi067.stdout:8/969: rmdir d5/dc/d1a/d20/d2d/d7f/d94/da3/db9 39 2023-12-05T09:26:41.299 INFO:tasks.workunit.client.0.smithi067.stdout:6/859: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d105/f11e [0,4194304] 0 2023-12-05T09:26:41.300 INFO:tasks.workunit.client.0.smithi067.stdout:6/860: chown da/d10/d1e/d17/d2f/d72/f90 3236336 1 2023-12-05T09:26:41.301 INFO:tasks.workunit.client.0.smithi067.stdout:8/970: mkdir d5/dc/d1a/d20/d3e/dbf/d122 0 2023-12-05T09:26:41.307 INFO:tasks.workunit.client.0.smithi067.stdout:6/861: creat da/d10/d1e/d17/d2f/d5f/d110/f12e x:0 0 0 2023-12-05T09:26:41.307 INFO:tasks.workunit.client.0.smithi067.stdout:7/750: dwrite d0/d9/d10/d37/d38/d64/d34/fd9 [0,4194304] 0 2023-12-05T09:26:41.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/837: dwrite d9/f14 [4194304,4194304] 0 2023-12-05T09:26:41.307 INFO:tasks.workunit.client.0.smithi067.stdout:3/838: dread - d9/da/d15/d17/d2b/f4d zero size 2023-12-05T09:26:41.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/839: write d9/da/d3b/f108 [1027317,105265] 0 2023-12-05T09:26:41.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/840: truncate d9/da/d15/d17/d1a/d51/d66/f105 1205517 0 2023-12-05T09:26:41.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/841: truncate d9/da/d15/d17/d125/db6/fdb 1099313 0 2023-12-05T09:26:41.308 INFO:tasks.workunit.client.0.smithi067.stdout:3/842: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/f103 [577932,119346] 0 2023-12-05T09:26:41.311 INFO:tasks.workunit.client.0.smithi067.stdout:2/824: dread d0/d25/d3f/d83/fad [0,4194304] 0 2023-12-05T09:26:41.311 INFO:tasks.workunit.client.0.smithi067.stdout:2/825: truncate d0/d25/d9d/d53/d92/fda 110825 0 2023-12-05T09:26:41.315 INFO:tasks.workunit.client.0.smithi067.stdout:8/971: truncate d5/da/f69 1700543 0 2023-12-05T09:26:41.315 INFO:tasks.workunit.client.0.smithi067.stdout:7/751: stat d0/d9/d10/d1d/l6e 0 2023-12-05T09:26:41.321 INFO:tasks.workunit.client.0.smithi067.stdout:3/843: rmdir d9/d49 39 2023-12-05T09:26:41.323 INFO:tasks.workunit.client.0.smithi067.stdout:8/972: rename d5/dc/d1a/d20/d2d/caf to d5/da/d30/d7c/c123 0 2023-12-05T09:26:41.323 INFO:tasks.workunit.client.0.smithi067.stdout:7/752: symlink d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/lf8 0 2023-12-05T09:26:41.323 INFO:tasks.workunit.client.0.smithi067.stdout:7/753: truncate d0/d9/d10/d37/d38/d64/d34/d67/d72/da4/fc6 398891 0 2023-12-05T09:26:41.329 INFO:tasks.workunit.client.0.smithi067.stdout:3/844: creat d9/da/d15/d17/d1a/d51/d70/f127 x:0 0 0 2023-12-05T09:26:41.331 INFO:tasks.workunit.client.0.smithi067.stdout:7/754: symlink d0/d9/lf9 0 2023-12-05T09:26:41.331 INFO:tasks.workunit.client.0.smithi067.stdout:7/755: write d0/d9/d10/d37/f28 [9112740,7003] 0 2023-12-05T09:26:41.339 INFO:tasks.workunit.client.0.smithi067.stdout:8/973: mkdir d5/dc/d1a/d20/d3e/d11e/d124 0 2023-12-05T09:26:41.339 INFO:tasks.workunit.client.0.smithi067.stdout:3/845: mknod d9/da/d15/c128 0 2023-12-05T09:26:41.348 INFO:tasks.workunit.client.0.smithi067.stdout:7/756: rename d0/d9/d10/f32 to d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/ffa 0 2023-12-05T09:26:41.348 INFO:tasks.workunit.client.0.smithi067.stdout:8/974: mknod d5/dc/d1a/d20/d3e/d79/c125 0 2023-12-05T09:26:41.349 INFO:tasks.workunit.client.0.smithi067.stdout:7/757: creat d0/d9/d10/d37/ffb x:0 0 0 2023-12-05T09:26:41.354 INFO:tasks.workunit.client.0.smithi067.stdout:8/975: mknod d5/dc/d1a/d20/d2d/d7f/d94/da3/db9/c126 0 2023-12-05T09:26:41.357 INFO:tasks.workunit.client.0.smithi067.stdout:6/862: dwrite da/d10/d1e/d17/f23 [4194304,4194304] 0 2023-12-05T09:26:41.357 INFO:tasks.workunit.client.0.smithi067.stdout:6/863: write da/d10/d1e/d17/d2f/d2c/df7/f11a [1031835,45268] 0 2023-12-05T09:26:41.357 INFO:tasks.workunit.client.0.smithi067.stdout:4/811: dwrite d0/d1d/d25/d32/f117 [0,4194304] 0 2023-12-05T09:26:41.357 INFO:tasks.workunit.client.0.smithi067.stdout:4/812: stat d0/d1d/d53/da8/da9/d15/l3b 0 2023-12-05T09:26:41.358 INFO:tasks.workunit.client.0.smithi067.stdout:4/813: chown d0/d1d/d53/da8/da9/d15/d11c/fcd 1774593989 1 2023-12-05T09:26:41.362 INFO:tasks.workunit.client.0.smithi067.stdout:6/864: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d5d/f12f x:0 0 0 2023-12-05T09:26:41.363 INFO:tasks.workunit.client.0.smithi067.stdout:4/814: symlink d0/d1d/d2a/d93/da4/l124 0 2023-12-05T09:26:41.368 INFO:tasks.workunit.client.0.smithi067.stdout:6/865: mknod da/d10/d1e/d17/d2f/db2/c130 0 2023-12-05T09:26:41.369 INFO:tasks.workunit.client.0.smithi067.stdout:3/846: dread d9/da/d3b/f6b [0,4194304] 0 2023-12-05T09:26:41.370 INFO:tasks.workunit.client.0.smithi067.stdout:6/866: symlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/l131 0 2023-12-05T09:26:41.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:41 smithi067 ceph-mon[107174]: Reconfiguring node-exporter.smithi134 (dependencies changed)... 2023-12-05T09:26:41.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:41 smithi067 ceph-mon[107174]: Reconfiguring daemon node-exporter.smithi134 on smithi134 2023-12-05T09:26:41.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:41 smithi134 ceph-mon[116304]: Reconfiguring node-exporter.smithi134 (dependencies changed)... 2023-12-05T09:26:41.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:41 smithi134 ceph-mon[116304]: Reconfiguring daemon node-exporter.smithi134 on smithi134 2023-12-05T09:26:41.380 INFO:tasks.workunit.client.0.smithi067.stdout:8/976: dread d5/dc/d6e/f76 [0,4194304] 0 2023-12-05T09:26:41.380 INFO:tasks.workunit.client.0.smithi067.stdout:8/977: dread - d5/dc/d1a/d20/d2d/d7f/d94/da3/f116 zero size 2023-12-05T09:26:41.385 INFO:tasks.workunit.client.0.smithi067.stdout:1/875: dwrite d2/d5/d7/de/d1a/f1b [0,4194304] 0 2023-12-05T09:26:41.385 INFO:tasks.workunit.client.0.smithi067.stdout:8/978: getdents d5/d3b 0 2023-12-05T09:26:41.385 INFO:tasks.workunit.client.0.smithi067.stdout:8/979: truncate d5/dc/d1a/d62/f84 247199 0 2023-12-05T09:26:41.419 INFO:tasks.workunit.client.0.smithi067.stdout:2/826: dwrite d0/d25/d34/d4d/d54/d90/dcf/ff4 [0,4194304] 0 2023-12-05T09:26:41.424 INFO:tasks.workunit.client.0.smithi067.stdout:2/827: creat d0/d25/d34/d4d/db0/dbf/f120 x:0 0 0 2023-12-05T09:26:41.433 INFO:tasks.workunit.client.0.smithi067.stdout:1/876: dwrite d2/d4f/d54/d70/f92 [0,4194304] 0 2023-12-05T09:26:41.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/877: mknod d2/d4f/d15/dee/c12c 0 2023-12-05T09:26:41.438 INFO:tasks.workunit.client.0.smithi067.stdout:5/899: dwrite db/df/d82/f8c [0,4194304] 0 2023-12-05T09:26:41.438 INFO:tasks.workunit.client.0.smithi067.stdout:5/900: readlink db/df/d3f/l103 0 2023-12-05T09:26:41.439 INFO:tasks.workunit.client.0.smithi067.stdout:1/878: rename d2/d5/d7/de/d19/d49/d6d/f5b to d2/d5/d7/de/f12d 0 2023-12-05T09:26:41.439 INFO:tasks.workunit.client.0.smithi067.stdout:8/980: dread d5/da/f8d [0,4194304] 0 2023-12-05T09:26:41.440 INFO:tasks.workunit.client.0.smithi067.stdout:8/981: dread - d5/d9d/dd9/f10b zero size 2023-12-05T09:26:41.440 INFO:tasks.workunit.client.0.smithi067.stdout:8/982: fsync d5/d6a/dc3/f121 0 2023-12-05T09:26:41.442 INFO:tasks.workunit.client.0.smithi067.stdout:1/879: getdents d2/d4f/d54 0 2023-12-05T09:26:41.443 INFO:tasks.workunit.client.0.smithi067.stdout:6/867: dread da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/f4c [0,4194304] 0 2023-12-05T09:26:41.443 INFO:tasks.workunit.client.0.smithi067.stdout:8/983: rmdir d5/d3b 39 2023-12-05T09:26:41.444 INFO:tasks.workunit.client.0.smithi067.stdout:1/880: creat d2/d5/d7/de/d1a/f12e x:0 0 0 2023-12-05T09:26:41.446 INFO:tasks.workunit.client.0.smithi067.stdout:6/868: symlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/l132 0 2023-12-05T09:26:41.447 INFO:tasks.workunit.client.0.smithi067.stdout:4/815: dread d0/d1d/d24/f66 [0,4194304] 0 2023-12-05T09:26:41.451 INFO:tasks.workunit.client.0.smithi067.stdout:4/816: rename d0/d1d/d4d/fd1 to d0/d1d/d53/da8/de3/f125 0 2023-12-05T09:26:41.451 INFO:tasks.workunit.client.0.smithi067.stdout:4/817: creat d0/d1d/d53/d62/f126 x:0 0 0 2023-12-05T09:26:41.466 INFO:tasks.workunit.client.0.smithi067.stdout:3/847: dwrite d9/da/d15/f50 [0,4194304] 0 2023-12-05T09:26:41.466 INFO:tasks.workunit.client.0.smithi067.stdout:5/901: read db/df/d3f/dd9/de7/dfd/d1d/d20/f8f [2023057,45031] 0 2023-12-05T09:26:41.466 INFO:tasks.workunit.client.0.smithi067.stdout:2/828: write d0/d25/d9d/d53/d1e/d8e/dd0/f37 [1253702,19482] 0 2023-12-05T09:26:41.467 INFO:tasks.workunit.client.0.smithi067.stdout:4/818: dread d0/d1d/d25/d2c/f3a [0,4194304] 0 2023-12-05T09:26:41.467 INFO:tasks.workunit.client.0.smithi067.stdout:4/819: write d0/d1d/d25/d32/f16 [1261405,68463] 0 2023-12-05T09:26:41.467 INFO:tasks.workunit.client.0.smithi067.stdout:4/820: fsync d0/d1d/d53/da8/da9/d15/d11c/d4e/daa/f9d 0 2023-12-05T09:26:41.471 INFO:tasks.workunit.client.0.smithi067.stdout:4/821: creat d0/d1d/d118/f127 x:0 0 0 2023-12-05T09:26:41.499 INFO:tasks.workunit.client.0.smithi067.stdout:7/758: dwrite d0/d9/d10/d37/d38/d64/d34/f36 [0,4194304] 0 2023-12-05T09:26:41.503 INFO:tasks.workunit.client.0.smithi067.stdout:7/759: symlink d0/d9/d10/d37/d38/d64/d34/d67/lfc 0 2023-12-05T09:26:41.503 INFO:tasks.workunit.client.0.smithi067.stdout:7/760: symlink d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/dc3/lfd 0 2023-12-05T09:26:41.504 INFO:tasks.workunit.client.0.smithi067.stdout:7/761: mkdir d0/d9/d56/dc4/dfe 0 2023-12-05T09:26:41.504 INFO:tasks.workunit.client.0.smithi067.stdout:7/762: dread - d0/d9/d10/d37/d38/d64/d5a/f99 zero size 2023-12-05T09:26:41.505 INFO:tasks.workunit.client.0.smithi067.stdout:8/984: dread d5/da/f4b [0,4194304] 0 2023-12-05T09:26:41.507 INFO:tasks.workunit.client.0.smithi067.stdout:8/985: creat d5/dc/d1a/d20/d2d/d41/f127 x:0 0 0 2023-12-05T09:26:41.508 INFO:tasks.workunit.client.0.smithi067.stdout:7/763: rmdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/dd1 39 2023-12-05T09:26:41.510 INFO:tasks.workunit.client.0.smithi067.stdout:8/986: mknod d5/dc/d1a/d20/d3e/d95/c128 0 2023-12-05T09:26:41.510 INFO:tasks.workunit.client.0.smithi067.stdout:8/987: dread - d5/dc/d1a/d20/d2d/d41/db2/f112 zero size 2023-12-05T09:26:41.510 INFO:tasks.workunit.client.0.smithi067.stdout:8/988: dread - d5/dc/d1a/d20/d2d/d7f/d94/da3/f101 zero size 2023-12-05T09:26:41.510 INFO:tasks.workunit.client.0.smithi067.stdout:8/989: getdents d5/dc/d6e/dee/d10d 0 2023-12-05T09:26:41.510 INFO:tasks.workunit.client.0.smithi067.stdout:8/990: readlink d5/dc/d1a/l9e 0 2023-12-05T09:26:41.511 INFO:tasks.workunit.client.0.smithi067.stdout:7/764: creat d0/d9/d3f/fff x:0 0 0 2023-12-05T09:26:41.512 INFO:tasks.workunit.client.0.smithi067.stdout:7/765: dread - d0/d9/d10/d37/d38/db7/fd8 zero size 2023-12-05T09:26:41.512 INFO:tasks.workunit.client.0.smithi067.stdout:8/991: mknod d5/dc/d1a/d20/d3e/dbf/c129 0 2023-12-05T09:26:41.513 INFO:tasks.workunit.client.0.smithi067.stdout:4/822: dwrite d0/d1d/d53/da8/da9/d15/fa3 [0,4194304] 0 2023-12-05T09:26:41.513 INFO:tasks.workunit.client.0.smithi067.stdout:7/766: creat d0/d9/d10/d37/d38/d64/d34/d67/d72/f100 x:0 0 0 2023-12-05T09:26:41.524 INFO:tasks.workunit.client.0.smithi067.stdout:8/992: getdents d5/dc/d1a/d20/d3e/d79 0 2023-12-05T09:26:41.527 INFO:tasks.workunit.client.0.smithi067.stdout:8/993: symlink d5/d9d/dab/d66/l12a 0 2023-12-05T09:26:41.531 INFO:tasks.workunit.client.0.smithi067.stdout:4/823: write d0/d1d/d25/d32/f8f [1655475,108684] 0 2023-12-05T09:26:41.532 INFO:tasks.workunit.client.0.smithi067.stdout:5/902: write db/df/d3f/f4a [2174857,353] 0 2023-12-05T09:26:41.533 INFO:tasks.workunit.client.0.smithi067.stdout:4/824: mkdir d0/d1d/d2a/d72/d128 0 2023-12-05T09:26:41.537 INFO:tasks.workunit.client.0.smithi067.stdout:5/903: truncate db/df/d3f/d88/d8d/fcc 1037443 0 2023-12-05T09:26:41.537 INFO:tasks.workunit.client.0.smithi067.stdout:3/848: dread d9/da/fca [0,4194304] 0 2023-12-05T09:26:41.538 INFO:tasks.workunit.client.0.smithi067.stdout:4/825: mkdir d0/d1d/d2a/df9/d129 0 2023-12-05T09:26:41.538 INFO:tasks.workunit.client.0.smithi067.stdout:1/881: dwrite d2/d3/da6/dbd/dd8/f123 [0,4194304] 0 2023-12-05T09:26:41.538 INFO:tasks.workunit.client.0.smithi067.stdout:1/882: stat d2/d5/d7/de/d19/d8f/d98/ffc 0 2023-12-05T09:26:41.539 INFO:tasks.workunit.client.0.smithi067.stdout:5/904: mkdir db/df/d35/d12b 0 2023-12-05T09:26:41.542 INFO:tasks.workunit.client.0.smithi067.stdout:8/994: dread d5/dc/d1a/d20/f59 [0,4194304] 0 2023-12-05T09:26:41.543 INFO:tasks.workunit.client.0.smithi067.stdout:3/849: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d65/f129 x:0 0 0 2023-12-05T09:26:41.543 INFO:tasks.workunit.client.0.smithi067.stdout:3/850: stat d9/da/d15/l21 0 2023-12-05T09:26:41.547 INFO:tasks.workunit.client.0.smithi067.stdout:1/883: creat d2/d3/da6/f12f x:0 0 0 2023-12-05T09:26:41.547 INFO:tasks.workunit.client.0.smithi067.stdout:1/884: stat d2/d3/da6/dbd/dd8 0 2023-12-05T09:26:41.548 INFO:tasks.workunit.client.0.smithi067.stdout:8/995: symlink d5/d9d/l12b 0 2023-12-05T09:26:41.550 INFO:tasks.workunit.client.0.smithi067.stdout:3/851: dread d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/fe6 [0,4194304] 0 2023-12-05T09:26:41.552 INFO:tasks.workunit.client.0.smithi067.stdout:4/826: rename d0/d1d/d53 to d0/d1d/d25/d12a 0 2023-12-05T09:26:41.554 INFO:tasks.workunit.client.0.smithi067.stdout:1/885: creat d2/d4f/d14/d20/f130 x:0 0 0 2023-12-05T09:26:41.556 INFO:tasks.workunit.client.0.smithi067.stdout:4/827: unlink d0/d1d/d25/d32/c46 0 2023-12-05T09:26:41.559 INFO:tasks.workunit.client.0.smithi067.stdout:5/905: rename db/df/d36/d57/cd7 to db/df/d3f/dd9/de7/dfd/d1d/d20/d120/c12c 0 2023-12-05T09:26:41.561 INFO:tasks.workunit.client.0.smithi067.stdout:1/886: symlink d2/d3/da6/dbd/l131 0 2023-12-05T09:26:41.565 INFO:tasks.workunit.client.0.smithi067.stdout:8/996: rename d5/dc/d1a/d20/d58/c65 to d5/d3b/c12c 0 2023-12-05T09:26:41.566 INFO:tasks.workunit.client.0.smithi067.stdout:8/997: chown d5/dc/d1a/d20/d58/d90/l11c 0 1 2023-12-05T09:26:41.566 INFO:tasks.workunit.client.0.smithi067.stdout:8/998: dread - d5/dc/d1a/d20/d2d/d41/f108 zero size 2023-12-05T09:26:41.566 INFO:tasks.workunit.client.0.smithi067.stdout:1/887: symlink d2/d5/d7/de/l132 0 2023-12-05T09:26:41.566 INFO:tasks.workunit.client.0.smithi067.stdout:3/852: dread d9/da/d3b/ff1 [0,4194304] 0 2023-12-05T09:26:41.567 INFO:tasks.workunit.client.0.smithi067.stdout:1/888: fdatasync d2/d5/d7/de/d1a/faf 0 2023-12-05T09:26:41.568 INFO:tasks.workunit.client.0.smithi067.stdout:8/999: rename d5/dc/d1a/d20/d2d/d41/f108 to d5/d9d/dab/d66/d91/f12d 0 2023-12-05T09:26:41.570 INFO:tasks.workunit.client.0.smithi067.stdout:5/906: write db/df/d36/d57/f9e [88266,12458] 0 2023-12-05T09:26:41.570 INFO:tasks.workunit.client.0.smithi067.stdout:4/828: rename d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/daa/f10f to d0/d1d/d2a/d93/dbd/f12b 0 2023-12-05T09:26:41.570 INFO:tasks.workunit.client.0.smithi067.stdout:5/907: creat db/df/d38/f12d x:0 0 0 2023-12-05T09:26:41.570 INFO:tasks.workunit.client.0.smithi067.stdout:5/908: creat db/df/db5/f12e x:0 0 0 2023-12-05T09:26:41.570 INFO:tasks.workunit.client.0.smithi067.stdout:5/909: chown db/df/d3f/dd9/de7/dfd/d1d/c100 0 1 2023-12-05T09:26:41.583 INFO:tasks.workunit.client.0.smithi067.stdout:1/889: rename d2/d5/d7/de/d1a to d2/d3/da6/dbb/dd1/de3/d133 0 2023-12-05T09:26:41.589 INFO:tasks.workunit.client.0.smithi067.stdout:5/910: rename db/df/d38/f12a to db/df/d3f/dd9/de7/dfd/d59/dae/f12f 0 2023-12-05T09:26:41.592 INFO:tasks.workunit.client.0.smithi067.stdout:5/911: getdents db/df/d3f 0 2023-12-05T09:26:41.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/912: symlink db/df/d35/d12b/l130 0 2023-12-05T09:26:41.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/913: chown db/df/d38/f12d 3419 1 2023-12-05T09:26:41.600 INFO:tasks.workunit.client.0.smithi067.stdout:5/914: dread - db/df/d52/f105 zero size 2023-12-05T09:26:41.607 INFO:tasks.workunit.client.0.smithi067.stdout:5/915: mkdir db/df/d36/d6c/dc1/d131 0 2023-12-05T09:26:41.607 INFO:tasks.workunit.client.0.smithi067.stdout:5/916: chown db/df/d3f/dd9/de7/dfd/c65 15 1 2023-12-05T09:26:41.608 INFO:tasks.workunit.client.0.smithi067.stdout:5/917: write db/df/d35/d63/d75/f7d [1767866,106092] 0 2023-12-05T09:26:41.635 INFO:tasks.workunit.client.0.smithi067.stdout:5/918: dread db/df/d3f/d88/f5c [0,4194304] 0 2023-12-05T09:26:41.635 INFO:tasks.workunit.client.0.smithi067.stdout:7/767: dwrite d0/d9/d40/d7a/fb3 [0,4194304] 0 2023-12-05T09:26:41.648 INFO:tasks.workunit.client.0.smithi067.stdout:3/853: dwrite d9/da/d15/d17/d125/f5f [0,4194304] 0 2023-12-05T09:26:41.648 INFO:tasks.workunit.client.0.smithi067.stdout:3/854: chown d9/da/d15/l121 861387733 1 2023-12-05T09:26:41.651 INFO:tasks.workunit.client.0.smithi067.stdout:3/855: creat d9/d49/f12a x:0 0 0 2023-12-05T09:26:41.652 INFO:tasks.workunit.client.0.smithi067.stdout:3/856: write d9/da/d15/d17/d1a/d51/d66/d82/da1/f41 [1965486,110088] 0 2023-12-05T09:26:41.659 INFO:tasks.workunit.client.0.smithi067.stdout:7/768: write d0/d9/d10/d37/d38/f51 [3503523,89661] 0 2023-12-05T09:26:41.661 INFO:tasks.workunit.client.0.smithi067.stdout:5/919: dread db/df/f50 [0,4194304] 0 2023-12-05T09:26:41.661 INFO:tasks.workunit.client.0.smithi067.stdout:5/920: chown db/df/d3f/dd9/de7/dfd/d1d/ce9 16502584 1 2023-12-05T09:26:41.662 INFO:tasks.workunit.client.0.smithi067.stdout:4/829: dwrite d0/d1d/d2a/dba/fc8 [0,4194304] 0 2023-12-05T09:26:41.664 INFO:tasks.workunit.client.0.smithi067.stdout:1/890: dwrite d2/d4f/d15/f112 [0,4194304] 0 2023-12-05T09:26:41.664 INFO:tasks.workunit.client.0.smithi067.stdout:5/921: mknod db/df/d3f/dd9/de7/c132 0 2023-12-05T09:26:41.720 INFO:tasks.workunit.client.0.smithi067.stdout:1/891: dwrite d2/d5/d7/de/d19/d49/d5f/f9f [0,4194304] 0 2023-12-05T09:26:41.721 INFO:tasks.workunit.client.0.smithi067.stdout:1/892: readlink d2/d5/d7/l2d 0 2023-12-05T09:26:41.733 INFO:tasks.workunit.client.0.smithi067.stdout:5/922: dwrite db/df/d3f/d88/f62 [0,4194304] 0 2023-12-05T09:26:41.734 INFO:tasks.workunit.client.0.smithi067.stdout:1/893: unlink d2/d5/d7/de/d19/c120 0 2023-12-05T09:26:41.738 INFO:tasks.workunit.client.0.smithi067.stdout:1/894: creat d2/d4f/d54/f134 x:0 0 0 2023-12-05T09:26:41.745 INFO:tasks.workunit.client.0.smithi067.stdout:1/895: rename d2/d3/da6/dbb/dd1/de3/d133/f1b to d2/d4f/d15/d74/d76/f135 0 2023-12-05T09:26:41.747 INFO:tasks.workunit.client.0.smithi067.stdout:1/896: getdents d2/d4f/d14/d20 0 2023-12-05T09:26:41.779 INFO:tasks.workunit.client.0.smithi067.stdout:3/857: dwrite d9/da/d15/d17/d1a/d51/d70/f11a [0,4194304] 0 2023-12-05T09:26:41.790 INFO:tasks.workunit.client.0.smithi067.stdout:3/858: dread d9/da/d3b/f6b [0,4194304] 0 2023-12-05T09:26:41.793 INFO:tasks.workunit.client.0.smithi067.stdout:3/859: mknod d9/da/d15/d17/d1a/d51/d66/d82/c12b 0 2023-12-05T09:26:41.796 INFO:tasks.workunit.client.0.smithi067.stdout:3/860: rename d9/da/d15/d17/d1a/d51/fc7 to d9/da/d15/d17/f12c 0 2023-12-05T09:26:41.800 INFO:tasks.workunit.client.0.smithi067.stdout:3/861: rename d9/da/d15/d17/d1a/d51/lbe to d9/da/d15/d17/d2b/l12d 0 2023-12-05T09:26:41.802 INFO:tasks.workunit.client.0.smithi067.stdout:3/862: creat d9/da/d15/d17/d2b/f12e x:0 0 0 2023-12-05T09:26:41.804 INFO:tasks.workunit.client.0.smithi067.stdout:3/863: symlink d9/da/d15/d17/d125/db6/l12f 0 2023-12-05T09:26:41.807 INFO:tasks.workunit.client.0.smithi067.stdout:3/864: symlink d9/d20/l130 0 2023-12-05T09:26:41.808 INFO:tasks.workunit.client.0.smithi067.stdout:3/865: getdents d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/d110 0 2023-12-05T09:26:41.808 INFO:tasks.workunit.client.0.smithi067.stdout:3/866: write d9/da/d15/d17/f55 [2237675,87533] 0 2023-12-05T09:26:41.812 INFO:tasks.workunit.client.0.smithi067.stdout:3/867: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/d110/f131 x:0 0 0 2023-12-05T09:26:41.857 INFO:tasks.workunit.client.0.smithi067.stdout:3/868: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/fae [0,4194304] 0 2023-12-05T09:26:41.857 INFO:tasks.workunit.client.0.smithi067.stdout:3/869: chown d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47 11 1 2023-12-05T09:26:41.857 INFO:tasks.workunit.client.0.smithi067.stdout:3/870: read - d9/da/d15/d17/f113 zero size 2023-12-05T09:26:41.859 INFO:tasks.workunit.client.0.smithi067.stdout:3/871: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/f132 x:0 0 0 2023-12-05T09:26:41.859 INFO:tasks.workunit.client.0.smithi067.stdout:3/872: chown d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d65/lf5 406196 1 2023-12-05T09:26:41.867 INFO:tasks.workunit.client.0.smithi067.stdout:3/873: dread d9/da/d15/d17/d125/db6/fdb [0,4194304] 0 2023-12-05T09:26:41.869 INFO:tasks.workunit.client.0.smithi067.stdout:3/874: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/l133 0 2023-12-05T09:26:41.883 INFO:tasks.workunit.client.0.smithi067.stdout:7/769: dwrite d0/d9/f6f [4194304,4194304] 0 2023-12-05T09:26:41.883 INFO:tasks.workunit.client.0.smithi067.stdout:7/770: fsync d0/d45/ff3 0 2023-12-05T09:26:41.885 INFO:tasks.workunit.client.0.smithi067.stdout:5/923: dwrite db/df/d36/f8a [0,4194304] 0 2023-12-05T09:26:41.888 INFO:tasks.workunit.client.0.smithi067.stdout:5/924: mknod db/df/db5/c133 0 2023-12-05T09:26:41.891 INFO:tasks.workunit.client.0.smithi067.stdout:3/875: write d9/da/d15/d17/fa6 [749919,53850] 0 2023-12-05T09:26:41.894 INFO:tasks.workunit.client.0.smithi067.stdout:5/925: creat db/df/d82/f134 x:0 0 0 2023-12-05T09:26:41.895 INFO:tasks.workunit.client.0.smithi067.stdout:7/771: dread d0/d9/f71 [0,4194304] 0 2023-12-05T09:26:41.898 INFO:tasks.workunit.client.0.smithi067.stdout:1/897: dwrite d2/d5/f127 [0,4194304] 0 2023-12-05T09:26:41.906 INFO:tasks.workunit.client.0.smithi067.stdout:1/898: creat d2/d4f/d15/d60/d68/f136 x:0 0 0 2023-12-05T09:26:41.906 INFO:tasks.workunit.client.0.smithi067.stdout:1/899: stat d2/d3/da6/dbb/dd1/de3/d133/f4b 0 2023-12-05T09:26:41.906 INFO:tasks.workunit.client.0.smithi067.stdout:1/900: write d2/d3/fc0 [480872,53752] 0 2023-12-05T09:26:41.907 INFO:tasks.workunit.client.0.smithi067.stdout:7/772: getdents d0/d9/d3f/dcc 0 2023-12-05T09:26:41.907 INFO:tasks.workunit.client.0.smithi067.stdout:7/773: chown d0/d9/d40/d7a/dad/dc2/l74 368 1 2023-12-05T09:26:41.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/901: creat d2/d3/da6/dbd/dd8/df8/f137 x:0 0 0 2023-12-05T09:26:41.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/902: write d2/d5/f6f [4844995,92301] 0 2023-12-05T09:26:41.912 INFO:tasks.workunit.client.0.smithi067.stdout:1/903: unlink d2/d3/da6/dbb/dd1/de3/d133/f12e 0 2023-12-05T09:26:41.914 INFO:tasks.workunit.client.0.smithi067.stdout:1/904: symlink d2/d4f/d15/d74/d76/l138 0 2023-12-05T09:26:41.919 INFO:tasks.workunit.client.0.smithi067.stdout:1/905: creat d2/d4f/d54/d70/f139 x:0 0 0 2023-12-05T09:26:41.935 INFO:tasks.workunit.client.0.smithi067.stdout:3/876: write d9/da/d15/d17/d125/f33 [1928338,6004] 0 2023-12-05T09:26:41.935 INFO:tasks.workunit.client.0.smithi067.stdout:3/877: truncate d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/f11b 527897 0 2023-12-05T09:26:41.937 INFO:tasks.workunit.client.0.smithi067.stdout:7/774: dread d0/d9/d3f/f7e [0,4194304] 0 2023-12-05T09:26:41.937 INFO:tasks.workunit.client.0.smithi067.stdout:1/906: dread d2/d5/d7/de/d19/d49/d5f/f9f [0,4194304] 0 2023-12-05T09:26:41.939 INFO:tasks.workunit.client.0.smithi067.stdout:3/878: mkdir d9/da/d15/d17/d125/db8/d134 0 2023-12-05T09:26:41.942 INFO:tasks.workunit.client.0.smithi067.stdout:7/775: creat d0/d9/d3f/dcc/f101 x:0 0 0 2023-12-05T09:26:41.942 INFO:tasks.workunit.client.0.smithi067.stdout:7/776: chown d0/d9/d56/de1 98712 1 2023-12-05T09:26:41.942 INFO:tasks.workunit.client.0.smithi067.stdout:7/777: chown d0/d9/d10/d37/d38/d64/d5a 169672988 1 2023-12-05T09:26:41.945 INFO:tasks.workunit.client.0.smithi067.stdout:1/907: rename d2/d3/da6/dbb/dd1/de3/d133/fbf to d2/d4f/f13a 0 2023-12-05T09:26:41.950 INFO:tasks.workunit.client.0.smithi067.stdout:3/879: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/l135 0 2023-12-05T09:26:41.951 INFO:tasks.workunit.client.0.smithi067.stdout:7/778: mknod d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/dc3/de4/c102 0 2023-12-05T09:26:41.953 INFO:tasks.workunit.client.0.smithi067.stdout:5/926: dwrite db/f14 [0,4194304] 0 2023-12-05T09:26:41.961 INFO:tasks.workunit.client.0.smithi067.stdout:1/908: getdents d2/d5/d7/de/d19 0 2023-12-05T09:26:41.961 INFO:tasks.workunit.client.0.smithi067.stdout:1/909: fsync d2/d5/d7/de/d19/d49/f56 0 2023-12-05T09:26:41.961 INFO:tasks.workunit.client.0.smithi067.stdout:7/779: creat d0/d9/d56/dc4/dfe/f103 x:0 0 0 2023-12-05T09:26:41.976 INFO:tasks.workunit.client.0.smithi067.stdout:5/927: mknod db/c135 0 2023-12-05T09:26:41.977 INFO:tasks.workunit.client.0.smithi067.stdout:7/780: mkdir d0/d104 0 2023-12-05T09:26:41.990 INFO:tasks.workunit.client.0.smithi067.stdout:2/829: sync 2023-12-05T09:26:41.990 INFO:tasks.workunit.client.0.smithi067.stdout:4/830: sync 2023-12-05T09:26:41.990 INFO:tasks.workunit.client.0.smithi067.stdout:6/869: sync 2023-12-05T09:26:41.990 INFO:tasks.workunit.client.0.smithi067.stdout:4/831: fsync d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/d88/fff 0 2023-12-05T09:26:41.992 INFO:tasks.workunit.client.0.smithi067.stdout:6/870: rmdir da/dde 39 2023-12-05T09:26:41.996 INFO:tasks.workunit.client.0.smithi067.stdout:2/830: symlink d0/d25/d34/d4d/db0/dce/l121 0 2023-12-05T09:26:42.003 INFO:tasks.workunit.client.0.smithi067.stdout:4/832: rename d0/d1d/d4d/f9b to d0/d1d/d25/d32/f12c 0 2023-12-05T09:26:42.011 INFO:tasks.workunit.client.0.smithi067.stdout:6/871: creat da/d10/d1e/d17/d2f/d59/d6c/dbe/f133 x:0 0 0 2023-12-05T09:26:42.011 INFO:tasks.workunit.client.0.smithi067.stdout:6/872: chown da/d10/d1e/d17/d2f/d2c/df7 15117 1 2023-12-05T09:26:42.013 INFO:tasks.workunit.client.0.smithi067.stdout:2/831: readlink d0/lb 0 2023-12-05T09:26:42.015 INFO:tasks.workunit.client.0.smithi067.stdout:6/873: symlink da/d10/d1e/d17/d2f/d72/l134 0 2023-12-05T09:26:42.019 INFO:tasks.workunit.client.0.smithi067.stdout:6/874: mkdir da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/d135 0 2023-12-05T09:26:42.019 INFO:tasks.workunit.client.0.smithi067.stdout:6/875: rename da/d10/d1e/d17/d2f/d1f to da/d10/d1e/d17/d2f/d1f/d27/d4f/d105/d136 22 2023-12-05T09:26:42.019 INFO:tasks.workunit.client.0.smithi067.stdout:6/876: write da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a [1758873,93185] 0 2023-12-05T09:26:42.021 INFO:tasks.workunit.client.0.smithi067.stdout:1/910: dwrite d2/d4f/d14/d20/d83/d78/fd3 [0,4194304] 0 2023-12-05T09:26:42.021 INFO:tasks.workunit.client.0.smithi067.stdout:1/911: fdatasync d2/d5/d7/de/d19/d49/fe2 0 2023-12-05T09:26:42.026 INFO:tasks.workunit.client.0.smithi067.stdout:6/877: mkdir da/d10/d1e/d7f/d137 0 2023-12-05T09:26:42.028 INFO:tasks.workunit.client.0.smithi067.stdout:4/833: dread d0/d1d/d25/d38/fbf [0,4194304] 0 2023-12-05T09:26:42.034 INFO:tasks.workunit.client.0.smithi067.stdout:7/781: dwrite d0/d9/d3f/f47 [4194304,4194304] 0 2023-12-05T09:26:42.034 INFO:tasks.workunit.client.0.smithi067.stdout:7/782: truncate d0/dd4/ff6 553315 0 2023-12-05T09:26:42.043 INFO:tasks.workunit.client.0.smithi067.stdout:6/878: symlink da/d10/d1e/d11b/l138 0 2023-12-05T09:26:42.047 INFO:tasks.workunit.client.0.smithi067.stdout:6/879: mkdir da/d10/d1e/d17/d2f/dbc/db9/d139 0 2023-12-05T09:26:42.054 INFO:tasks.workunit.client.0.smithi067.stdout:6/880: mkdir da/dde/d3b/d13a 0 2023-12-05T09:26:42.065 INFO:tasks.workunit.client.0.smithi067.stdout:6/881: creat da/d10/d1e/d17/d2f/d1f/d9e/f13b x:0 0 0 2023-12-05T09:26:42.065 INFO:tasks.workunit.client.0.smithi067.stdout:6/882: creat da/d10/d1e/d17/d2f/d1f/d9e/f13c x:0 0 0 2023-12-05T09:26:42.066 INFO:tasks.workunit.client.0.smithi067.stdout:6/883: dread - da/d10/d1e/d17/d2f/d5f/d110/f128 zero size 2023-12-05T09:26:42.077 INFO:tasks.workunit.client.0.smithi067.stdout:6/884: rename da/d10/d1e/d17/d2f/f2b to da/d7d/f13d 0 2023-12-05T09:26:42.078 INFO:tasks.workunit.client.0.smithi067.stdout:4/834: dwrite d0/f10d [0,4194304] 0 2023-12-05T09:26:42.078 INFO:tasks.workunit.client.0.smithi067.stdout:4/835: read d0/d1d/d25/d32/f8f [649881,96373] 0 2023-12-05T09:26:42.078 INFO:tasks.workunit.client.0.smithi067.stdout:6/885: link da/d10/d1e/d51/f7a da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d5d/f13e 0 2023-12-05T09:26:42.079 INFO:tasks.workunit.client.0.smithi067.stdout:6/886: write da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d5d/f13e [723158,85322] 0 2023-12-05T09:26:42.085 INFO:tasks.workunit.client.0.smithi067.stdout:4/836: symlink d0/d1d/d25/d2c/l12d 0 2023-12-05T09:26:42.085 INFO:tasks.workunit.client.0.smithi067.stdout:4/837: creat d0/f12e x:0 0 0 2023-12-05T09:26:42.090 INFO:tasks.workunit.client.0.smithi067.stdout:6/887: mkdir da/d10/d1e/d17/d2f/d1f/d27/d4f/d13f 0 2023-12-05T09:26:42.091 INFO:tasks.workunit.client.0.smithi067.stdout:4/838: mknod d0/d1d/d2a/d72/d128/c12f 0 2023-12-05T09:26:42.092 INFO:tasks.workunit.client.0.smithi067.stdout:4/839: write d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/d88/fff [847589,121864] 0 2023-12-05T09:26:42.093 INFO:tasks.workunit.client.0.smithi067.stdout:6/888: link da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/f4c da/d10/d1e/d17/d2f/d1f/d27/d4f/d13f/f140 0 2023-12-05T09:26:42.101 INFO:tasks.workunit.client.0.smithi067.stdout:6/889: rename da/d10/d1e/d17/d2f/d72/cd2 to da/dde/d3b/c141 0 2023-12-05T09:26:42.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/783: dwrite d0/dd4/ff6 [0,4194304] 0 2023-12-05T09:26:42.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/784: write d0/d9/d40/d7a/dad/fcf [153117,126925] 0 2023-12-05T09:26:42.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/785: creat d0/d9/d3f/dbd/f105 x:0 0 0 2023-12-05T09:26:42.101 INFO:tasks.workunit.client.0.smithi067.stdout:7/786: read - d0/d9/d10/d37/d38/d64/d5a/fa1 zero size 2023-12-05T09:26:42.107 INFO:tasks.workunit.client.0.smithi067.stdout:7/787: mkdir d0/d9/d10/d37/d38/d64/d34/d67/d72/da9/dc3/de4/d106 0 2023-12-05T09:26:42.123 INFO:tasks.workunit.client.0.smithi067.stdout:7/788: read d0/d9/d40/d7a/dad/dc2/f91 [2114864,60586] 0 2023-12-05T09:26:42.127 INFO:tasks.workunit.client.0.smithi067.stdout:7/789: truncate d0/d9/d10/d1d/f6b 2460857 0 2023-12-05T09:26:42.136 INFO:tasks.workunit.client.0.smithi067.stdout:7/790: unlink d0/d9/d56/fee 0 2023-12-05T09:26:42.138 INFO:tasks.workunit.client.0.smithi067.stdout:7/791: symlink d0/d9/d10/d37/d38/d64/d34/d67/d72/l107 0 2023-12-05T09:26:42.138 INFO:tasks.workunit.client.0.smithi067.stdout:4/840: dwrite d0/f80 [0,4194304] 0 2023-12-05T09:26:42.138 INFO:tasks.workunit.client.0.smithi067.stdout:4/841: dread - d0/d1d/d24/ff4 zero size 2023-12-05T09:26:42.141 INFO:tasks.workunit.client.0.smithi067.stdout:4/842: rename d0/d1d/d25/d2c/db5/cd5 to d0/d1d/d2a/d93/c130 0 2023-12-05T09:26:42.141 INFO:tasks.workunit.client.0.smithi067.stdout:4/843: readlink d0/d1d/d25/d12a/d62/l7c 0 2023-12-05T09:26:42.143 INFO:tasks.workunit.client.0.smithi067.stdout:4/844: mknod d0/d1d/d25/d32/d107/c131 0 2023-12-05T09:26:42.143 INFO:tasks.workunit.client.0.smithi067.stdout:4/845: chown d0/f80 2329 1 2023-12-05T09:26:42.143 INFO:tasks.workunit.client.0.smithi067.stdout:4/846: chown d0/d1d/d25/d12a/d82/lfc 954694 1 2023-12-05T09:26:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/847: mknod d0/d1d/d2a/d93/dbd/dcf/c132 0 2023-12-05T09:26:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/848: chown d0/d1d/d2b 16161 1 2023-12-05T09:26:42.144 INFO:tasks.workunit.client.0.smithi067.stdout:4/849: chown d0/d1d/d2b/ffe 54 1 2023-12-05T09:26:42.146 INFO:tasks.workunit.client.0.smithi067.stdout:4/850: mknod d0/d1d/d25/d12a/da8/da9/d15/dd0/dd9/c133 0 2023-12-05T09:26:42.148 INFO:tasks.workunit.client.0.smithi067.stdout:4/851: symlink d0/d1d/d25/d12a/d120/l134 0 2023-12-05T09:26:42.150 INFO:tasks.workunit.client.0.smithi067.stdout:4/852: mknod d0/d1d/d25/d32/c135 0 2023-12-05T09:26:42.153 INFO:tasks.workunit.client.0.smithi067.stdout:4/853: truncate d0/d1d/d25/d32/f16 2482918 0 2023-12-05T09:26:42.176 INFO:tasks.workunit.client.0.smithi067.stdout:4/854: dread d0/d1d/d25/d12a/da8/da9/d15/f20 [0,4194304] 0 2023-12-05T09:26:42.180 INFO:tasks.workunit.client.0.smithi067.stdout:6/890: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/f10e [0,4194304] 0 2023-12-05T09:26:42.181 INFO:tasks.workunit.client.0.smithi067.stdout:6/891: fdatasync da/d10/d1e/d17/d2f/d5f/d115/d10c/f124 0 2023-12-05T09:26:42.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/855: creat d0/d1d/d25/d12a/d82/f136 x:0 0 0 2023-12-05T09:26:42.181 INFO:tasks.workunit.client.0.smithi067.stdout:4/856: stat d0/d1d/d25/d12a/da8/da9/d15/ce5 0 2023-12-05T09:26:42.186 INFO:tasks.workunit.client.0.smithi067.stdout:6/892: symlink da/d10/d1e/d17/d2f/d5f/l142 0 2023-12-05T09:26:42.188 INFO:tasks.workunit.client.0.smithi067.stdout:4/857: mknod d0/d1d/d2a/d72/d128/c137 0 2023-12-05T09:26:42.188 INFO:tasks.workunit.client.0.smithi067.stdout:4/858: fsync d0/d1d/d2a/fae 0 2023-12-05T09:26:42.192 INFO:tasks.workunit.client.0.smithi067.stdout:6/893: rename da/dde/d3b/c4e to da/d10/d1e/d7f/c143 0 2023-12-05T09:26:42.192 INFO:tasks.workunit.client.0.smithi067.stdout:6/894: chown da/d10/d1e/l8f 2352463 1 2023-12-05T09:26:42.205 INFO:tasks.workunit.client.0.smithi067.stdout:6/895: read da/d10/d1e/d17/d2f/df5/ff9 [3023669,28150] 0 2023-12-05T09:26:42.206 INFO:tasks.workunit.client.0.smithi067.stdout:4/859: write d0/f10d [1326284,114819] 0 2023-12-05T09:26:42.206 INFO:tasks.workunit.client.0.smithi067.stdout:4/860: dread - d0/d1d/d118/f127 zero size 2023-12-05T09:26:42.207 INFO:tasks.workunit.client.0.smithi067.stdout:7/792: dwrite d0/d9/d10/d37/d38/d64/d54/f65 [4194304,4194304] 0 2023-12-05T09:26:42.208 INFO:tasks.workunit.client.0.smithi067.stdout:6/896: creat da/d7d/f144 x:0 0 0 2023-12-05T09:26:42.210 INFO:tasks.workunit.client.0.smithi067.stdout:4/861: mknod d0/d1d/d4d/c138 0 2023-12-05T09:26:42.211 INFO:tasks.workunit.client.0.smithi067.stdout:6/897: unlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/ff0 0 2023-12-05T09:26:42.211 INFO:tasks.workunit.client.0.smithi067.stdout:6/898: chown da/d10/f5e 12464 1 2023-12-05T09:26:42.213 INFO:tasks.workunit.client.0.smithi067.stdout:4/862: link d0/d1d/d2b/dd6/c11a d0/d1d/d3c/c139 0 2023-12-05T09:26:42.213 INFO:tasks.workunit.client.0.smithi067.stdout:4/863: chown d0/d1d/d25/d12a/da8/da9/d15/d11c/f5e 33 1 2023-12-05T09:26:42.215 INFO:tasks.workunit.client.0.smithi067.stdout:4/864: mkdir d0/d1d/d25/d2c/d13a 0 2023-12-05T09:26:42.215 INFO:tasks.workunit.client.0.smithi067.stdout:4/865: chown d0/d1d/d25/d12a/da8/da9/d15/c26 7654434 1 2023-12-05T09:26:42.275 INFO:tasks.workunit.client.0.smithi067.stdout:7/793: dwrite d0/d9/d3f/f7e [0,4194304] 0 2023-12-05T09:26:42.276 INFO:tasks.workunit.client.0.smithi067.stdout:4/866: dwrite d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/daa/fdb [0,4194304] 0 2023-12-05T09:26:42.277 INFO:tasks.workunit.client.0.smithi067.stdout:4/867: chown d0/d1d/d25/d12a/d62/c90 3986 1 2023-12-05T09:26:42.286 INFO:tasks.workunit.client.0.smithi067.stdout:4/868: mkdir d0/d1d/d2a/df9/d13b 0 2023-12-05T09:26:42.286 INFO:tasks.workunit.client.0.smithi067.stdout:4/869: fsync d0/d1d/d25/d12a/d62/f126 0 2023-12-05T09:26:42.286 INFO:tasks.workunit.client.0.smithi067.stdout:6/899: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d5d/f12f [0,4194304] 0 2023-12-05T09:26:42.286 INFO:tasks.workunit.client.0.smithi067.stdout:6/900: stat da/d10/d1e/d17/d2f/dbc/db9/d139 0 2023-12-05T09:26:42.288 INFO:tasks.workunit.client.0.smithi067.stdout:4/870: getdents d0/d1d/d2a/d72/d128 0 2023-12-05T09:26:42.288 INFO:tasks.workunit.client.0.smithi067.stdout:4/871: write d0/d1d/d25/d12a/f6c [5152097,2449] 0 2023-12-05T09:26:42.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/794: rmdir d0/d9/d56/d8e 39 2023-12-05T09:26:42.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/795: chown d0/d9/d3f/f7e 1854311 1 2023-12-05T09:26:42.288 INFO:tasks.workunit.client.0.smithi067.stdout:7/796: chown d0/d9/d3f/dbd 20 1 2023-12-05T09:26:42.290 INFO:tasks.workunit.client.0.smithi067.stdout:4/872: truncate d0/d1d/d25/d32/f8f 3403633 0 2023-12-05T09:26:42.292 INFO:tasks.workunit.client.0.smithi067.stdout:6/901: dread da/d10/d1e/d51/d7b/f111 [0,4194304] 0 2023-12-05T09:26:42.292 INFO:tasks.workunit.client.0.smithi067.stdout:7/797: mknod d0/d9/d56/dc4/dfe/c108 0 2023-12-05T09:26:42.297 INFO:tasks.workunit.client.0.smithi067.stdout:7/798: rmdir d0/d9/d3f/dbd 39 2023-12-05T09:26:42.304 INFO:tasks.workunit.client.0.smithi067.stdout:4/873: write d0/d1d/d25/d38/f49 [919853,94509] 0 2023-12-05T09:26:42.304 INFO:tasks.workunit.client.0.smithi067.stdout:4/874: truncate d0/d1d/d25/d12a/da8/da9/d15/fd7 577381 0 2023-12-05T09:26:42.307 INFO:tasks.workunit.client.0.smithi067.stdout:6/902: write da/d10/d1e/d17/d2f/d1f/f25 [7002644,58419] 0 2023-12-05T09:26:42.312 INFO:tasks.workunit.client.0.smithi067.stdout:4/875: creat d0/d1d/d25/d12a/da8/da9/d15/dd0/f13c x:0 0 0 2023-12-05T09:26:42.313 INFO:tasks.workunit.client.0.smithi067.stdout:6/903: mknod da/d10/d1e/d17/d2f/d72/c145 0 2023-12-05T09:26:42.313 INFO:tasks.workunit.client.0.smithi067.stdout:6/904: chown da/d7d 148991516 1 2023-12-05T09:26:42.313 INFO:tasks.workunit.client.0.smithi067.stdout:6/905: chown da/dde/d3b/cae 425504497 1 2023-12-05T09:26:42.316 INFO:tasks.workunit.client.0.smithi067.stdout:4/876: creat d0/d1d/d2a/d72/f13d x:0 0 0 2023-12-05T09:26:42.316 INFO:tasks.workunit.client.0.smithi067.stdout:4/877: truncate d0/d1d/d25/d32/f44 5895815 0 2023-12-05T09:26:42.317 INFO:tasks.workunit.client.0.smithi067.stdout:4/878: creat d0/d1d/d2a/d93/dbd/dcf/f13e x:0 0 0 2023-12-05T09:26:42.319 INFO:tasks.workunit.client.0.smithi067.stdout:4/879: mkdir d0/d1d/d2a/d72/d128/d13f 0 2023-12-05T09:26:42.319 INFO:tasks.workunit.client.0.smithi067.stdout:4/880: write d0/d1d/d4d/d8d/fd3 [5159570,37320] 0 2023-12-05T09:26:42.321 INFO:tasks.workunit.client.0.smithi067.stdout:4/881: rename d0/d1d/d2a/d93/dbd/dcf/f13e to d0/d1d/d4d/f140 0 2023-12-05T09:26:42.323 INFO:tasks.workunit.client.0.smithi067.stdout:4/882: link d0/d1d/d25/d32/d107/c131 d0/d1d/d2a/d72/d128/c141 0 2023-12-05T09:26:42.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:42 smithi067 ceph-mon[107174]: pgmap v36: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 140 MiB/s rd, 185 MiB/s wr, 277 op/s 2023-12-05T09:26:42.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:42 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:42.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:42 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:42.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:42 smithi134 ceph-mon[116304]: pgmap v36: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 140 MiB/s rd, 185 MiB/s wr, 277 op/s 2023-12-05T09:26:42.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:42 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:42.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:42 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:42.388 INFO:tasks.workunit.client.0.smithi067.stdout:7/799: dwrite d0/d9/d56/ff1 [0,4194304] 0 2023-12-05T09:26:42.388 INFO:tasks.workunit.client.0.smithi067.stdout:7/800: fdatasync d0/d9/d10/d37/d38/fab 0 2023-12-05T09:26:42.391 INFO:tasks.workunit.client.0.smithi067.stdout:7/801: creat d0/d9/d10/d37/d38/f109 x:0 0 0 2023-12-05T09:26:42.405 INFO:tasks.workunit.client.0.smithi067.stdout:6/906: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d5d/f12f [0,4194304] 0 2023-12-05T09:26:42.408 INFO:tasks.workunit.client.0.smithi067.stdout:6/907: mkdir da/d10/d1e/d17/d2f/d1f/d146 0 2023-12-05T09:26:42.408 INFO:tasks.workunit.client.0.smithi067.stdout:6/908: stat da/d10/f5e 0 2023-12-05T09:26:42.409 INFO:tasks.workunit.client.0.smithi067.stdout:6/909: symlink da/dde/d3b/d13a/l147 0 2023-12-05T09:26:42.411 INFO:tasks.workunit.client.0.smithi067.stdout:6/910: rename da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/c50 to da/dde/c148 0 2023-12-05T09:26:42.415 INFO:tasks.workunit.client.0.smithi067.stdout:7/802: dread d0/d9/d40/d7a/f87 [0,4194304] 0 2023-12-05T09:26:42.415 INFO:tasks.workunit.client.0.smithi067.stdout:7/803: chown d0/d9/d10/d37/d38/d64/d54/fe7 127560923 1 2023-12-05T09:26:42.420 INFO:tasks.workunit.client.0.smithi067.stdout:7/804: link d0/d9/f5f d0/d9/f10a 0 2023-12-05T09:26:42.420 INFO:tasks.workunit.client.0.smithi067.stdout:7/805: dread - d0/d9/d10/d37/d38/d64/d34/fbe zero size 2023-12-05T09:26:42.420 INFO:tasks.workunit.client.0.smithi067.stdout:6/911: dread da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fa4 [0,4194304] 0 2023-12-05T09:26:42.420 INFO:tasks.workunit.client.0.smithi067.stdout:7/806: dread - d0/d9/d10/d37/d38/d64/d34/fbe zero size 2023-12-05T09:26:42.420 INFO:tasks.workunit.client.0.smithi067.stdout:7/807: readlink d0/d9/l1c 0 2023-12-05T09:26:42.420 INFO:tasks.workunit.client.0.smithi067.stdout:6/912: creat da/d10/d1e/d17/d2f/df5/f149 x:0 0 0 2023-12-05T09:26:42.420 INFO:tasks.workunit.client.0.smithi067.stdout:7/808: chown d0/d9/d10/d37/d38/d64/d34/d67/fc7 0 1 2023-12-05T09:26:42.420 INFO:tasks.workunit.client.0.smithi067.stdout:7/809: write d0/d9/f10a [2037191,72661] 0 2023-12-05T09:26:42.424 INFO:tasks.workunit.client.0.smithi067.stdout:6/913: rmdir da/d10/d1e/d17/d2f/d1f/d27/d4f 39 2023-12-05T09:26:42.425 INFO:tasks.workunit.client.0.smithi067.stdout:7/810: mkdir d0/d9/d10b 0 2023-12-05T09:26:42.428 INFO:tasks.workunit.client.0.smithi067.stdout:7/811: symlink d0/d9/d3f/dcc/l10c 0 2023-12-05T09:26:42.437 INFO:tasks.workunit.client.0.smithi067.stdout:6/914: rmdir da/d10/d1e/d17/d2f/d3f 39 2023-12-05T09:26:42.452 INFO:tasks.workunit.client.0.smithi067.stdout:7/812: dread d0/d9/d10/d37/d38/d64/d34/fd9 [0,4194304] 0 2023-12-05T09:26:42.506 INFO:tasks.workunit.client.0.smithi067.stdout:7/813: dwrite d0/d9/d10/d37/d82/f9b [0,4194304] 0 2023-12-05T09:26:42.509 INFO:tasks.workunit.client.0.smithi067.stdout:7/814: write d0/d9/d10/d37/d38/d64/d5a/fa2 [85465,129828] 0 2023-12-05T09:26:42.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/815: creat d0/d9/d56/d8e/f10d x:0 0 0 2023-12-05T09:26:42.586 INFO:tasks.workunit.client.0.smithi067.stdout:3/880: sync 2023-12-05T09:26:42.586 INFO:tasks.workunit.client.0.smithi067.stdout:3/881: chown d9/d20/fac 136521386 1 2023-12-05T09:26:42.586 INFO:tasks.workunit.client.0.smithi067.stdout:3/882: write d9/da/d15/d17/d1a/d51/d66/d82/da1/fb5 [719514,96495] 0 2023-12-05T09:26:42.587 INFO:tasks.workunit.client.0.smithi067.stdout:3/883: chown d9/da/d15/d17/l5d 34580 1 2023-12-05T09:26:42.588 INFO:tasks.workunit.client.0.smithi067.stdout:3/884: creat d9/d62/f136 x:0 0 0 2023-12-05T09:26:42.598 INFO:tasks.workunit.client.0.smithi067.stdout:7/816: dread d0/d9/d10/d37/f2a [0,4194304] 0 2023-12-05T09:26:42.600 INFO:tasks.workunit.client.0.smithi067.stdout:7/817: mkdir d0/d9/d56/de1/d10e 0 2023-12-05T09:26:42.603 INFO:tasks.workunit.client.0.smithi067.stdout:3/885: read d9/d62/f88 [47597,64055] 0 2023-12-05T09:26:42.603 INFO:tasks.workunit.client.0.smithi067.stdout:3/886: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/f137 x:0 0 0 2023-12-05T09:26:42.606 INFO:tasks.workunit.client.0.smithi067.stdout:3/887: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/l138 0 2023-12-05T09:26:42.659 INFO:tasks.workunit.client.0.smithi067.stdout:3/888: dread d9/da/f6c [0,4194304] 0 2023-12-05T09:26:42.661 INFO:tasks.workunit.client.0.smithi067.stdout:3/889: link d9/d62/c45 d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/c139 0 2023-12-05T09:26:42.663 INFO:tasks.workunit.client.0.smithi067.stdout:3/890: truncate d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/f11b 255304 0 2023-12-05T09:26:42.663 INFO:tasks.workunit.client.0.smithi067.stdout:3/891: fsync f4 0 2023-12-05T09:26:42.667 INFO:tasks.workunit.client.0.smithi067.stdout:7/818: dwrite d0/d45/f49 [0,4194304] 0 2023-12-05T09:26:42.668 INFO:tasks.workunit.client.0.smithi067.stdout:3/892: rename d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/fe8 to d9/da/d15/d17/f13a 0 2023-12-05T09:26:42.673 INFO:tasks.workunit.client.0.smithi067.stdout:7/819: mknod d0/d9/d56/dc4/c10f 0 2023-12-05T09:26:42.676 INFO:tasks.workunit.client.0.smithi067.stdout:7/820: unlink d0/d9/d3f/dcc/f101 0 2023-12-05T09:26:42.680 INFO:tasks.workunit.client.0.smithi067.stdout:3/893: write d9/da/d15/d17/d1a/d51/d66/f97 [618316,9070] 0 2023-12-05T09:26:42.680 INFO:tasks.workunit.client.0.smithi067.stdout:3/894: write d9/da/d15/d17/d125/db6/fdb [1831960,88548] 0 2023-12-05T09:26:42.681 INFO:tasks.workunit.client.0.smithi067.stdout:3/895: chown d9/da/d15/d17/d1a/d51/d70/f11a 1195 1 2023-12-05T09:26:42.681 INFO:tasks.workunit.client.0.smithi067.stdout:3/896: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/c13b 0 2023-12-05T09:26:42.684 INFO:tasks.workunit.client.0.smithi067.stdout:3/897: symlink d9/da/d15/d17/d125/db8/d134/l13c 0 2023-12-05T09:26:42.684 INFO:tasks.workunit.client.0.smithi067.stdout:3/898: dread - d9/d62/f136 zero size 2023-12-05T09:26:42.684 INFO:tasks.workunit.client.0.smithi067.stdout:3/899: stat d9/d49 0 2023-12-05T09:26:42.684 INFO:tasks.workunit.client.0.smithi067.stdout:3/900: write d9/d20/f4f [1009588,7888] 0 2023-12-05T09:26:42.686 INFO:tasks.workunit.client.0.smithi067.stdout:3/901: mkdir d9/da/d15/d17/d1a/d51/d66/d82/d13d 0 2023-12-05T09:26:42.686 INFO:tasks.workunit.client.0.smithi067.stdout:3/902: read - d9/da/d15/d17/d1a/d51/d70/f127 zero size 2023-12-05T09:26:42.689 INFO:tasks.workunit.client.0.smithi067.stdout:7/821: read d0/d9/f6f [1359510,4192] 0 2023-12-05T09:26:42.690 INFO:tasks.workunit.client.0.smithi067.stdout:7/822: symlink d0/d9/d10/d37/d38/d64/d5a/l110 0 2023-12-05T09:26:42.701 INFO:tasks.workunit.client.0.smithi067.stdout:7/823: rename d0/d9/d10/d37/d38/d64 to d0/d9/d56/de1/d111 0 2023-12-05T09:26:42.701 INFO:tasks.workunit.client.0.smithi067.stdout:7/824: truncate d0/d9/d56/dc4/dfe/f103 964939 0 2023-12-05T09:26:42.762 INFO:tasks.workunit.client.0.smithi067.stdout:7/825: dwrite d0/d9/d56/de1/d111/d34/d67/d72/da4/fc6 [0,4194304] 0 2023-12-05T09:26:42.767 INFO:tasks.workunit.client.0.smithi067.stdout:3/903: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/f119 [0,4194304] 0 2023-12-05T09:26:42.790 INFO:tasks.workunit.client.0.smithi067.stdout:7/826: rename d0/d9/d3f/dcc to d0/d9/d56/de1/d111/d54/d112 0 2023-12-05T09:26:42.797 INFO:tasks.workunit.client.0.smithi067.stdout:7/827: mkdir d0/d9/d3f/d113 0 2023-12-05T09:26:42.797 INFO:tasks.workunit.client.0.smithi067.stdout:7/828: dread - d0/d9/d3f/dbd/f105 zero size 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:2/832: sync 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:2/833: chown d0/d25/d9d/d53/l1c 131613407 1 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:1/912: sync 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:1/913: chown d2/d4f/d14/d20/f9a 2639078 1 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:2/834: write d0/d25/d34/d4d/db0/dce/ff6 [4450945,66260] 0 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:5/928: sync 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:2/835: write d0/d7c/faa [2952859,119238] 0 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:5/929: truncate db/df/d35/f11e 465487 0 2023-12-05T09:26:42.808 INFO:tasks.workunit.client.0.smithi067.stdout:5/930: read db/df/d3f/f4a [448666,22932] 0 2023-12-05T09:26:42.809 INFO:tasks.workunit.client.0.smithi067.stdout:4/883: sync 2023-12-05T09:26:42.809 INFO:tasks.workunit.client.0.smithi067.stdout:6/915: sync 2023-12-05T09:26:42.825 INFO:tasks.workunit.client.0.smithi067.stdout:5/931: symlink db/df/d36/d6c/l136 0 2023-12-05T09:26:42.826 INFO:tasks.workunit.client.0.smithi067.stdout:4/884: symlink d0/d1d/d25/d12a/da8/de3/l142 0 2023-12-05T09:26:42.828 INFO:tasks.workunit.client.0.smithi067.stdout:2/836: mkdir d0/d25/d34/d4d/d72/d122 0 2023-12-05T09:26:42.829 INFO:tasks.workunit.client.0.smithi067.stdout:5/932: mknod db/df/d38/c137 0 2023-12-05T09:26:42.832 INFO:tasks.workunit.client.0.smithi067.stdout:4/885: link d0/d1d/d2b/fca d0/d1d/f143 0 2023-12-05T09:26:42.833 INFO:tasks.workunit.client.0.smithi067.stdout:5/933: mknod db/df/d35/dc8/c138 0 2023-12-05T09:26:42.842 INFO:tasks.workunit.client.0.smithi067.stdout:5/934: write db/df/d3f/d88/d8d/fc4 [370656,122707] 0 2023-12-05T09:26:42.843 INFO:tasks.workunit.client.0.smithi067.stdout:5/935: readlink db/df/d3f/d88/l72 0 2023-12-05T09:26:42.846 INFO:tasks.workunit.client.0.smithi067.stdout:5/936: symlink db/df/d35/d63/l139 0 2023-12-05T09:26:42.850 INFO:tasks.workunit.client.0.smithi067.stdout:3/904: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/f123 [0,4194304] 0 2023-12-05T09:26:42.850 INFO:tasks.workunit.client.0.smithi067.stdout:7/829: dread d0/d9/d56/ff1 [0,4194304] 0 2023-12-05T09:26:42.850 INFO:tasks.workunit.client.0.smithi067.stdout:7/830: write d0/d9/d56/de1/d111/d34/d67/d72/da4/fef [834374,120914] 0 2023-12-05T09:26:42.869 INFO:tasks.workunit.client.0.smithi067.stdout:5/937: dread db/df/d82/f101 [0,4194304] 0 2023-12-05T09:26:42.869 INFO:tasks.workunit.client.0.smithi067.stdout:5/938: chown db/df/c10 26 1 2023-12-05T09:26:42.872 INFO:tasks.workunit.client.0.smithi067.stdout:5/939: creat db/df/d3f/dd9/de7/dfd/d59/f13a x:0 0 0 2023-12-05T09:26:42.873 INFO:tasks.workunit.client.0.smithi067.stdout:4/886: dwrite d0/d1d/d2b/fca [0,4194304] 0 2023-12-05T09:26:42.874 INFO:tasks.workunit.client.0.smithi067.stdout:5/940: mknod db/df/d82/c13b 0 2023-12-05T09:26:42.887 INFO:tasks.workunit.client.0.smithi067.stdout:1/914: dwrite d2/d5/d7/de/fe6 [0,4194304] 0 2023-12-05T09:26:42.889 INFO:tasks.workunit.client.0.smithi067.stdout:1/915: creat d2/d5/d7/d6a/db7/f13b x:0 0 0 2023-12-05T09:26:42.909 INFO:tasks.workunit.client.0.smithi067.stdout:1/916: dread d2/d3/da6/fde [0,4194304] 0 2023-12-05T09:26:42.909 INFO:tasks.workunit.client.0.smithi067.stdout:1/917: truncate d2/d5/d7/de/d19/f38 4868746 0 2023-12-05T09:26:42.910 INFO:tasks.workunit.client.0.smithi067.stdout:1/918: mkdir d2/d5/d50/d13c 0 2023-12-05T09:26:42.911 INFO:tasks.workunit.client.0.smithi067.stdout:3/905: write d9/da/d15/d17/d1a/f4b [538774,105136] 0 2023-12-05T09:26:42.919 INFO:tasks.workunit.client.0.smithi067.stdout:2/837: dread d0/d25/d9d/d53/d1e/d8e/dd0/d39/f40 [0,4194304] 0 2023-12-05T09:26:42.919 INFO:tasks.workunit.client.0.smithi067.stdout:6/916: dwrite da/d10/d1e/d51/f7a [0,4194304] 0 2023-12-05T09:26:42.919 INFO:tasks.workunit.client.0.smithi067.stdout:6/917: write da/fe5 [721045,9553] 0 2023-12-05T09:26:42.924 INFO:tasks.workunit.client.0.smithi067.stdout:2/838: rename d0/d25/d9d/d53/d1e/d8e/dd0/da3 to d0/d25/d9d/d53/d92/d123 0 2023-12-05T09:26:42.924 INFO:tasks.workunit.client.0.smithi067.stdout:3/906: dread d9/da/d15/d17/f32 [0,4194304] 0 2023-12-05T09:26:42.927 INFO:tasks.workunit.client.0.smithi067.stdout:6/918: creat da/d10/d1e/d17/d2f/d1f/d9e/dfd/f14a x:0 0 0 2023-12-05T09:26:42.929 INFO:tasks.workunit.client.0.smithi067.stdout:2/839: creat d0/d25/d34/d4d/db0/f124 x:0 0 0 2023-12-05T09:26:42.929 INFO:tasks.workunit.client.0.smithi067.stdout:4/887: dwrite d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/daa/fdb [0,4194304] 0 2023-12-05T09:26:42.930 INFO:tasks.workunit.client.0.smithi067.stdout:7/831: dwrite d0/d9/d56/de1/d111/d34/d67/fd3 [0,4194304] 0 2023-12-05T09:26:42.933 INFO:tasks.workunit.client.0.smithi067.stdout:2/840: mkdir d0/d25/d34/d4d/d54/d56/d125 0 2023-12-05T09:26:42.936 INFO:tasks.workunit.client.0.smithi067.stdout:1/919: dread d2/d4f/d54/f114 [0,4194304] 0 2023-12-05T09:26:42.936 INFO:tasks.workunit.client.0.smithi067.stdout:1/920: truncate d2/d5/d7/de/d19/d8f/d98/fc7 1432425 0 2023-12-05T09:26:42.938 INFO:tasks.workunit.client.0.smithi067.stdout:3/907: dread d9/da/f6c [0,4194304] 0 2023-12-05T09:26:42.941 INFO:tasks.workunit.client.0.smithi067.stdout:2/841: link d0/d25/d34/d4d/d78/fc6 d0/d25/d9d/d63/d88/f126 0 2023-12-05T09:26:42.946 INFO:tasks.workunit.client.0.smithi067.stdout:1/921: mkdir d2/d4f/d15/d13d 0 2023-12-05T09:26:42.953 INFO:tasks.workunit.client.0.smithi067.stdout:1/922: creat d2/d3/da6/dbd/f13e x:0 0 0 2023-12-05T09:26:42.953 INFO:tasks.workunit.client.0.smithi067.stdout:1/923: stat d2/d3/da6/dbb/dd1/d10d 0 2023-12-05T09:26:42.953 INFO:tasks.workunit.client.0.smithi067.stdout:1/924: stat d2/d5/d7/de/d19/d49/l95 0 2023-12-05T09:26:42.953 INFO:tasks.workunit.client.0.smithi067.stdout:1/925: read - d2/d3/da6/dbb/dd1/de3/d133/f12a zero size 2023-12-05T09:26:42.956 INFO:tasks.workunit.client.0.smithi067.stdout:1/926: symlink d2/d4f/d14/d48/l13f 0 2023-12-05T09:26:42.958 INFO:tasks.workunit.client.0.smithi067.stdout:1/927: symlink d2/d4f/d15/d60/l140 0 2023-12-05T09:26:42.958 INFO:tasks.workunit.client.0.smithi067.stdout:1/928: read - d2/d4f/d54/d70/db4/fc3 zero size 2023-12-05T09:26:42.960 INFO:tasks.workunit.client.0.smithi067.stdout:3/908: dread d9/f27 [4194304,4194304] 0 2023-12-05T09:26:42.961 INFO:tasks.workunit.client.0.smithi067.stdout:3/909: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d65/f13e x:0 0 0 2023-12-05T09:26:42.966 INFO:tasks.workunit.client.0.smithi067.stdout:2/842: dread d0/f7a [0,4194304] 0 2023-12-05T09:26:42.966 INFO:tasks.workunit.client.0.smithi067.stdout:2/843: write d0/d25/d34/d4a/f9a [2675138,16799] 0 2023-12-05T09:26:42.968 INFO:tasks.workunit.client.0.smithi067.stdout:4/888: write d0/d1d/d25/d12a/da8/da9/d15/fd7 [804323,29740] 0 2023-12-05T09:26:42.969 INFO:tasks.workunit.client.0.smithi067.stdout:3/910: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/f13f x:0 0 0 2023-12-05T09:26:42.969 INFO:tasks.workunit.client.0.smithi067.stdout:3/911: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/f8d [695218,48876] 0 2023-12-05T09:26:42.971 INFO:tasks.workunit.client.0.smithi067.stdout:2/844: mkdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/d127 0 2023-12-05T09:26:42.973 INFO:tasks.workunit.client.0.smithi067.stdout:2/845: link d0/d25/d34/d4a/fb3 d0/d25/d34/d4d/db0/f128 0 2023-12-05T09:26:42.973 INFO:tasks.workunit.client.0.smithi067.stdout:2/846: chown d0/d25/d3f/d83/fad 460 1 2023-12-05T09:26:42.977 INFO:tasks.workunit.client.0.smithi067.stdout:2/847: rename d0/d25/d34/d4d/db0/dce/dd3/ld5 to d0/d25/d9d/d53/d1e/d8e/dc4/l129 0 2023-12-05T09:26:42.979 INFO:tasks.workunit.client.0.smithi067.stdout:2/848: creat d0/d25/d34/d4a/db8/f12a x:0 0 0 2023-12-05T09:26:42.979 INFO:tasks.workunit.client.0.smithi067.stdout:2/849: fdatasync d0/d25/d9d/d53/d1e/d8e/dd0/d39/f89 0 2023-12-05T09:26:42.982 INFO:tasks.workunit.client.0.smithi067.stdout:2/850: mkdir d0/d25/d34/d12b 0 2023-12-05T09:26:42.985 INFO:tasks.workunit.client.0.smithi067.stdout:2/851: symlink d0/d25/d9d/d53/d1e/d8e/dc4/l12c 0 2023-12-05T09:26:42.986 INFO:tasks.workunit.client.0.smithi067.stdout:2/852: write d0/d25/d9d/d63/f10b [1286555,47899] 0 2023-12-05T09:26:42.986 INFO:tasks.workunit.client.0.smithi067.stdout:2/853: dread - d0/d25/d9d/d63/fb7 zero size 2023-12-05T09:26:42.992 INFO:tasks.workunit.client.0.smithi067.stdout:4/889: write d0/d1d/d25/d32/f117 [3716730,45838] 0 2023-12-05T09:26:42.993 INFO:tasks.workunit.client.0.smithi067.stdout:3/912: dread d9/d62/f4c [0,4194304] 0 2023-12-05T09:26:42.996 INFO:tasks.workunit.client.0.smithi067.stdout:4/890: symlink d0/d1d/d25/d2c/d13a/l144 0 2023-12-05T09:26:42.996 INFO:tasks.workunit.client.0.smithi067.stdout:3/913: truncate d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/fd3 44553 0 2023-12-05T09:26:42.997 INFO:tasks.workunit.client.0.smithi067.stdout:6/919: dwrite f4 [0,4194304] 0 2023-12-05T09:26:43.002 INFO:tasks.workunit.client.0.smithi067.stdout:3/914: symlink d9/da/d15/d17/d125/db6/l140 0 2023-12-05T09:26:43.002 INFO:tasks.workunit.client.0.smithi067.stdout:3/915: chown d9/da/f19 700312030 1 2023-12-05T09:26:43.005 INFO:tasks.workunit.client.0.smithi067.stdout:6/920: mknod da/d10/d1e/d17/d2f/d1f/d146/c14b 0 2023-12-05T09:26:43.007 INFO:tasks.workunit.client.0.smithi067.stdout:3/916: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/l141 0 2023-12-05T09:26:43.007 INFO:tasks.workunit.client.0.smithi067.stdout:3/917: readlink d9/da/d3b/l3c 0 2023-12-05T09:26:43.009 INFO:tasks.workunit.client.0.smithi067.stdout:3/918: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/f142 x:0 0 0 2023-12-05T09:26:43.012 INFO:tasks.workunit.client.0.smithi067.stdout:3/919: mknod d9/da/d15/d17/d125/db8/c143 0 2023-12-05T09:26:43.013 INFO:tasks.workunit.client.0.smithi067.stdout:3/920: mkdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d144 0 2023-12-05T09:26:43.022 INFO:tasks.workunit.client.0.smithi067.stdout:7/832: dwrite d0/d9/d56/de1/d111/d5a/fa1 [0,4194304] 0 2023-12-05T09:26:43.022 INFO:tasks.workunit.client.0.smithi067.stdout:4/891: dread d0/d1d/d2b/dd6/fc7 [0,4194304] 0 2023-12-05T09:26:43.022 INFO:tasks.workunit.client.0.smithi067.stdout:4/892: fsync d0/d1d/d25/d38/f49 0 2023-12-05T09:26:43.025 INFO:tasks.workunit.client.0.smithi067.stdout:6/921: dread da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d19/fc7 [0,4194304] 0 2023-12-05T09:26:43.025 INFO:tasks.workunit.client.0.smithi067.stdout:6/922: dread - da/d10/d1e/d17/d2f/d1f/d9e/dfd/f14a zero size 2023-12-05T09:26:43.039 INFO:tasks.workunit.client.0.smithi067.stdout:1/929: dwrite d2/f5c [0,4194304] 0 2023-12-05T09:26:43.043 INFO:tasks.workunit.client.0.smithi067.stdout:1/930: creat d2/d5/d7/de/d19/f141 x:0 0 0 2023-12-05T09:26:43.046 INFO:tasks.workunit.client.0.smithi067.stdout:1/931: truncate d2/d4f/d15/f112 1419082 0 2023-12-05T09:26:43.046 INFO:tasks.workunit.client.0.smithi067.stdout:1/932: write d2/d5/d7/de/f3a [1548069,110191] 0 2023-12-05T09:26:43.053 INFO:tasks.workunit.client.0.smithi067.stdout:3/921: dwrite d9/d62/dd0/f100 [0,4194304] 0 2023-12-05T09:26:43.053 INFO:tasks.workunit.client.0.smithi067.stdout:3/922: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/dfa/f145 x:0 0 0 2023-12-05T09:26:43.070 INFO:tasks.workunit.client.0.smithi067.stdout:1/933: rename d2/d4f/d54/d70/db4 to d2/d3/da6/dbb/d142 0 2023-12-05T09:26:43.071 INFO:tasks.workunit.client.0.smithi067.stdout:1/934: fdatasync d2/d4f/d54/f114 0 2023-12-05T09:26:43.077 INFO:tasks.workunit.client.0.smithi067.stdout:3/923: dread d9/da/d3b/ff1 [0,4194304] 0 2023-12-05T09:26:43.077 INFO:tasks.workunit.client.0.smithi067.stdout:3/924: fdatasync d9/d49/f12a 0 2023-12-05T09:26:43.078 INFO:tasks.workunit.client.0.smithi067.stdout:1/935: rename d2/d4f/d14/d20/d83/l101 to d2/d4f/d14/d20/d83/l143 0 2023-12-05T09:26:43.097 INFO:tasks.workunit.client.0.smithi067.stdout:1/936: dread d2/d4f/fc1 [0,4194304] 0 2023-12-05T09:26:43.099 INFO:tasks.workunit.client.0.smithi067.stdout:6/923: dread da/d10/d1e/d17/d2f/d5f/d115/d10c/f124 [0,4194304] 0 2023-12-05T09:26:43.100 INFO:tasks.workunit.client.0.smithi067.stdout:2/854: dwrite d0/d25/d9d/d53/d1e/d8e/dd0/d39/f40 [0,4194304] 0 2023-12-05T09:26:43.100 INFO:tasks.workunit.client.0.smithi067.stdout:6/924: readlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/l132 0 2023-12-05T09:26:43.122 INFO:tasks.workunit.client.0.smithi067.stdout:1/937: write d2/f24 [4154517,79627] 0 2023-12-05T09:26:43.127 INFO:tasks.workunit.client.0.smithi067.stdout:6/925: dread da/d7d/f127 [0,4194304] 0 2023-12-05T09:26:43.129 INFO:tasks.workunit.client.0.smithi067.stdout:4/893: dwrite d0/d1d/d2a/dba/f103 [0,4194304] 0 2023-12-05T09:26:43.129 INFO:tasks.workunit.client.0.smithi067.stdout:3/925: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/fe6 [0,4194304] 0 2023-12-05T09:26:43.129 INFO:tasks.workunit.client.0.smithi067.stdout:3/926: chown d9/d20/c4a 1048 1 2023-12-05T09:26:43.130 INFO:tasks.workunit.client.0.smithi067.stdout:6/926: symlink da/d10/d1e/d17/d2f/db2/l14c 0 2023-12-05T09:26:43.138 INFO:tasks.workunit.client.0.smithi067.stdout:1/938: write d2/d4f/d14/d20/d83/fc2 [1273346,124620] 0 2023-12-05T09:26:43.162 INFO:tasks.workunit.client.0.smithi067.stdout:2/855: dwrite d0/d25/d34/d4d/d54/d90/fe4 [0,4194304] 0 2023-12-05T09:26:43.162 INFO:tasks.workunit.client.0.smithi067.stdout:2/856: write d0/d25/f4e [3294931,14140] 0 2023-12-05T09:26:43.162 INFO:tasks.workunit.client.0.smithi067.stdout:2/857: fsync d0/d25/d9d/d53/d92/fda 0 2023-12-05T09:26:43.172 INFO:tasks.workunit.client.0.smithi067.stdout:4/894: mknod d0/d1d/d2b/def/c145 0 2023-12-05T09:26:43.174 INFO:tasks.workunit.client.0.smithi067.stdout:3/927: link d9/da/d15/d17/d1a/lc8 d9/da/d3b/dec/l146 0 2023-12-05T09:26:43.174 INFO:tasks.workunit.client.0.smithi067.stdout:3/928: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/f114 [67802,69532] 0 2023-12-05T09:26:43.174 INFO:tasks.workunit.client.0.smithi067.stdout:3/929: truncate d9/da/d15/d17/d2b/f118 170642 0 2023-12-05T09:26:43.175 INFO:tasks.workunit.client.0.smithi067.stdout:6/927: truncate da/d10/d1e/d17/d2f/d5f/d115/fdc 3914876 0 2023-12-05T09:26:43.178 INFO:tasks.workunit.client.0.smithi067.stdout:1/939: truncate d2/d3/da6/dbb/dd1/de3/d133/f7c 2842638 0 2023-12-05T09:26:43.185 INFO:tasks.workunit.client.0.smithi067.stdout:4/895: symlink d0/d1d/d2a/d93/da4/l146 0 2023-12-05T09:26:43.190 INFO:tasks.workunit.client.0.smithi067.stdout:3/930: link d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/d110/l11f d9/da/d15/d17/l147 0 2023-12-05T09:26:43.192 INFO:tasks.workunit.client.0.smithi067.stdout:6/928: symlink da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d5d/l14d 0 2023-12-05T09:26:43.194 INFO:tasks.workunit.client.0.smithi067.stdout:2/858: truncate d0/d25/d9d/f73 1823573 0 2023-12-05T09:26:43.196 INFO:tasks.workunit.client.0.smithi067.stdout:3/931: rename d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/fe7 to d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/dfa/f148 0 2023-12-05T09:26:43.196 INFO:tasks.workunit.client.0.smithi067.stdout:3/932: stat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/ca3 0 2023-12-05T09:26:43.200 INFO:tasks.workunit.client.0.smithi067.stdout:2/859: creat d0/d25/d9d/d53/d1e/d8e/dd0/d84/f12d x:0 0 0 2023-12-05T09:26:43.204 INFO:tasks.workunit.client.0.smithi067.stdout:4/896: symlink d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/daf/l147 0 2023-12-05T09:26:43.207 INFO:tasks.workunit.client.0.smithi067.stdout:4/897: mkdir d0/d1d/d25/d2c/d13a/d148 0 2023-12-05T09:26:43.209 INFO:tasks.workunit.client.0.smithi067.stdout:4/898: unlink d0/d1d/d25/d12a/da8/da9/d15/dd0/dd9/c133 0 2023-12-05T09:26:43.215 INFO:tasks.workunit.client.0.smithi067.stdout:4/899: mknod d0/d1d/d2a/dba/c149 0 2023-12-05T09:26:43.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/940: dwrite d2/d4f/d54/d70/f92 [4194304,4194304] 0 2023-12-05T09:26:43.242 INFO:tasks.workunit.client.0.smithi067.stdout:1/941: rename d2/d3/da6 to d2/d5/d7/d6a/d144 0 2023-12-05T09:26:43.242 INFO:tasks.workunit.client.0.smithi067.stdout:1/942: stat d2/d4f/d14/ffe 0 2023-12-05T09:26:43.252 INFO:tasks.workunit.client.0.smithi067.stdout:6/929: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f112 [0,4194304] 0 2023-12-05T09:26:43.257 INFO:tasks.workunit.client.0.smithi067.stdout:6/930: mkdir da/d10/d1e/d17/d2f/df5/d14e 0 2023-12-05T09:26:43.257 INFO:tasks.workunit.client.0.smithi067.stdout:6/931: read - da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/fe4 zero size 2023-12-05T09:26:43.258 INFO:tasks.workunit.client.0.smithi067.stdout:4/900: dwrite d0/d1d/d25/d32/f65 [0,4194304] 0 2023-12-05T09:26:43.268 INFO:tasks.workunit.client.0.smithi067.stdout:2/860: dwrite d0/d25/d9d/d53/d1e/d8e/dd0/fb9 [0,4194304] 0 2023-12-05T09:26:43.275 INFO:tasks.workunit.client.0.smithi067.stdout:2/861: creat d0/d25/d34/d4d/db0/dce/f12e x:0 0 0 2023-12-05T09:26:43.281 INFO:tasks.workunit.client.0.smithi067.stdout:4/901: read d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/fa1 [627978,72156] 0 2023-12-05T09:26:43.297 INFO:tasks.workunit.client.0.smithi067.stdout:2/862: dread d0/d25/d9d/d53/d1e/f61 [0,4194304] 0 2023-12-05T09:26:43.319 INFO:tasks.workunit.client.0.smithi067.stdout:6/932: dwrite da/fe5 [0,4194304] 0 2023-12-05T09:26:43.324 INFO:tasks.workunit.client.0.smithi067.stdout:6/933: rmdir da/d10/d1e/d17/d2f/dbc/db9 39 2023-12-05T09:26:43.324 INFO:tasks.workunit.client.0.smithi067.stdout:6/934: readlink da/d10/d1e/d17/d2f/db2/lec 0 2023-12-05T09:26:43.328 INFO:tasks.workunit.client.0.smithi067.stdout:6/935: symlink da/d10/d1e/d7f/d137/l14f 0 2023-12-05T09:26:43.328 INFO:tasks.workunit.client.0.smithi067.stdout:6/936: dread - da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f101 zero size 2023-12-05T09:26:43.330 INFO:tasks.workunit.client.0.smithi067.stdout:6/937: link da/d10/d1e/d17/d2f/d1f/d9e/dfd/fd8 da/d10/d1e/d17/d2f/db2/f150 0 2023-12-05T09:26:43.334 INFO:tasks.workunit.client.0.smithi067.stdout:6/938: mkdir da/d10/d151 0 2023-12-05T09:26:43.340 INFO:tasks.workunit.client.0.smithi067.stdout:4/902: dwrite d0/d1d/d25/d32/ff3 [0,4194304] 0 2023-12-05T09:26:43.340 INFO:tasks.workunit.client.0.smithi067.stdout:4/903: creat d0/d1d/d2a/dba/f14a x:0 0 0 2023-12-05T09:26:43.341 INFO:tasks.workunit.client.0.smithi067.stdout:6/939: dread da/d10/d1e/d51/d7b/f111 [0,4194304] 0 2023-12-05T09:26:43.344 INFO:tasks.workunit.client.0.smithi067.stdout:2/863: dwrite d0/d25/d3f/d83/f11c [0,4194304] 0 2023-12-05T09:26:43.348 INFO:tasks.workunit.client.0.smithi067.stdout:5/941: sync 2023-12-05T09:26:43.348 INFO:tasks.workunit.client.0.smithi067.stdout:5/942: fdatasync db/df/d3f/dd9/de7/dfd/fec 0 2023-12-05T09:26:43.349 INFO:tasks.workunit.client.0.smithi067.stdout:5/943: write db/df/f127 [826548,1219] 0 2023-12-05T09:26:43.356 INFO:tasks.workunit.client.0.smithi067.stdout:2/864: mkdir d0/d25/d34/d4d/d54/d90/dcf/d12f 0 2023-12-05T09:26:43.356 INFO:tasks.workunit.client.0.smithi067.stdout:4/904: dread d0/d9/f2f [0,4194304] 0 2023-12-05T09:26:43.363 INFO:tasks.workunit.client.0.smithi067.stdout:5/944: dread db/df/d3f/d88/fc5 [0,4194304] 0 2023-12-05T09:26:43.365 INFO:tasks.workunit.client.0.smithi067.stdout:6/940: getdents da/d10/d1e/d17/d2f/d1f/d27/daa 0 2023-12-05T09:26:43.367 INFO:tasks.workunit.client.0.smithi067.stdout:2/865: rmdir d0/d109 39 2023-12-05T09:26:43.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:26:43.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:26:43.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:26:43.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:26:43.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:26:43.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:26:43.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:26:43.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: Upgrade: Need to upgrade myself (mgr.smithi134.yfqkak) 2023-12-05T09:26:43.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:43 smithi067 ceph-mon[107174]: Upgrade: Need to upgrade myself (mgr.smithi134.yfqkak) 2023-12-05T09:26:43.371 INFO:tasks.workunit.client.0.smithi067.stdout:2/866: write d0/d25/d9d/fe7 [587086,126895] 0 2023-12-05T09:26:43.371 INFO:tasks.workunit.client.0.smithi067.stdout:5/945: truncate db/df/d36/d57/f5d 3552953 0 2023-12-05T09:26:43.373 INFO:tasks.workunit.client.0.smithi067.stdout:6/941: link da/d10/d1e/d17/d2f/d1f/d27/d4f/fb7 da/d7d/dca/f152 0 2023-12-05T09:26:43.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/942: symlink da/dde/d3b/d13a/l153 0 2023-12-05T09:26:43.376 INFO:tasks.workunit.client.0.smithi067.stdout:6/943: chown da/d10/d1e/d17/d2f/d2c/dc3/fe7 28655 1 2023-12-05T09:26:43.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:26:43.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:26:43.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:26:43.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:26:43.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:26:43.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:26:43.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:26:43.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: Upgrade: Need to upgrade myself (mgr.smithi134.yfqkak) 2023-12-05T09:26:43.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:43 smithi134 ceph-mon[116304]: Upgrade: Need to upgrade myself (mgr.smithi134.yfqkak) 2023-12-05T09:26:43.378 INFO:tasks.workunit.client.0.smithi067.stdout:6/944: link da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6/d80/f10e da/d10/d1e/d17/d2f/d2c/f154 0 2023-12-05T09:26:43.392 INFO:tasks.workunit.client.0.smithi067.stdout:5/946: write db/df/f6b [4065489,43293] 0 2023-12-05T09:26:43.393 INFO:tasks.workunit.client.0.smithi067.stdout:5/947: chown db/df/d3f/d88/d8d/f11d 0 1 2023-12-05T09:26:43.401 INFO:tasks.workunit.client.0.smithi067.stdout:6/945: rename da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/da6 to da/d10/d1e/d17/d2f/df5/d155 0 2023-12-05T09:26:43.426 INFO:tasks.workunit.client.0.smithi067.stdout:6/946: dread da/d10/d1e/d17/d2f/d1f/d27/fac [0,4194304] 0 2023-12-05T09:26:43.426 INFO:tasks.workunit.client.0.smithi067.stdout:6/947: chown da/d10/d1e/d17/d2f/df5/d155/d19/fa4 409 1 2023-12-05T09:26:43.428 INFO:tasks.workunit.client.0.smithi067.stdout:4/905: dwrite d0/d1d/d25/d12a/da8/da9/d15/dd0/f13c [0,4194304] 0 2023-12-05T09:26:43.447 INFO:tasks.workunit.client.0.smithi067.stdout:5/948: dwrite db/df/d3f/dd9/de7/dfd/f28 [4194304,4194304] 0 2023-12-05T09:26:43.447 INFO:tasks.workunit.client.0.smithi067.stdout:5/949: truncate db/df/d36/d57/f5d 3626805 0 2023-12-05T09:26:43.451 INFO:tasks.workunit.client.0.smithi067.stdout:4/906: dread d0/d1d/d2a/d72/f11f [0,4194304] 0 2023-12-05T09:26:43.451 INFO:tasks.workunit.client.0.smithi067.stdout:4/907: fdatasync d0/d9/fb7 0 2023-12-05T09:26:43.456 INFO:tasks.workunit.client.0.smithi067.stdout:5/950: mknod db/df/d3f/dd9/de7/dfd/d59/dae/c13c 0 2023-12-05T09:26:43.467 INFO:tasks.workunit.client.0.smithi067.stdout:2/867: dwrite d0/d25/f4e [0,4194304] 0 2023-12-05T09:26:43.467 INFO:tasks.workunit.client.0.smithi067.stdout:2/868: chown d0/d25/d9d/d53/d1e/d7f/fcc 13 1 2023-12-05T09:26:43.467 INFO:tasks.workunit.client.0.smithi067.stdout:2/869: fdatasync d0/d25/d34/d4d/db0/dce/ff6 0 2023-12-05T09:26:43.469 INFO:tasks.workunit.client.0.smithi067.stdout:4/908: write d0/d1d/d25/d12a/da8/da9/d15/f20 [4851788,78342] 0 2023-12-05T09:26:43.479 INFO:tasks.workunit.client.0.smithi067.stdout:6/948: dwrite da/d10/d1e/d17/d2f/df5/d155/d79/fff [0,4194304] 0 2023-12-05T09:26:43.480 INFO:tasks.workunit.client.0.smithi067.stdout:2/870: creat d0/d25/d34/d4d/d72/f130 x:0 0 0 2023-12-05T09:26:43.483 INFO:tasks.workunit.client.0.smithi067.stdout:4/909: mknod d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/d88/d106/c14b 0 2023-12-05T09:26:43.483 INFO:tasks.workunit.client.0.smithi067.stdout:4/910: read - d0/f12e zero size 2023-12-05T09:26:43.490 INFO:tasks.workunit.client.0.smithi067.stdout:6/949: symlink da/d7d/dd7/l156 0 2023-12-05T09:26:43.492 INFO:tasks.workunit.client.0.smithi067.stdout:2/871: creat d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/f131 x:0 0 0 2023-12-05T09:26:43.495 INFO:tasks.workunit.client.0.smithi067.stdout:6/950: mkdir da/d10/d1e/d51/d7b/dee/d157 0 2023-12-05T09:26:43.498 INFO:tasks.workunit.client.0.smithi067.stdout:6/951: creat da/d10/d1e/d17/d2f/df5/d155/d79/f158 x:0 0 0 2023-12-05T09:26:43.498 INFO:tasks.workunit.client.0.smithi067.stdout:7/833: sync 2023-12-05T09:26:43.499 INFO:tasks.workunit.client.0.smithi067.stdout:7/834: chown d0/d9/d10/d37/d82/f9b 494252899 1 2023-12-05T09:26:43.499 INFO:tasks.workunit.client.0.smithi067.stdout:6/952: symlink da/d10/d1e/d17/d2f/df5/d14e/l159 0 2023-12-05T09:26:43.506 INFO:tasks.workunit.client.0.smithi067.stdout:7/835: mkdir d0/d9/d56/df2/d114 0 2023-12-05T09:26:43.507 INFO:tasks.workunit.client.0.smithi067.stdout:6/953: write da/d10/d1e/d17/d2f/d2c/df7/f11a [411792,34594] 0 2023-12-05T09:26:43.507 INFO:tasks.workunit.client.0.smithi067.stdout:7/836: creat d0/d9/d10/d1d/f115 x:0 0 0 2023-12-05T09:26:43.509 INFO:tasks.workunit.client.0.smithi067.stdout:6/954: mknod da/d10/d1e/d17/d2f/dbc/c15a 0 2023-12-05T09:26:43.509 INFO:tasks.workunit.client.0.smithi067.stdout:6/955: read - da/d10/d1e/d17/d2f/d1f/d9e/dfd/fd8 zero size 2023-12-05T09:26:43.509 INFO:tasks.workunit.client.0.smithi067.stdout:6/956: dread - da/d10/d1e/d17/d2f/d5f/d110/f128 zero size 2023-12-05T09:26:43.512 INFO:tasks.workunit.client.0.smithi067.stdout:6/957: mkdir da/d10/d1e/d17/d2f/db2/d15b 0 2023-12-05T09:26:43.515 INFO:tasks.workunit.client.0.smithi067.stdout:6/958: truncate da/d10/d1e/d51/d7b/dd6/fea 4049302 0 2023-12-05T09:26:43.516 INFO:tasks.workunit.client.0.smithi067.stdout:6/959: creat da/d10/d1e/d17/d2f/d72/f15c x:0 0 0 2023-12-05T09:26:43.530 INFO:tasks.workunit.client.0.smithi067.stdout:4/911: dwrite d0/f41 [8388608,4194304] 0 2023-12-05T09:26:43.531 INFO:tasks.workunit.client.0.smithi067.stdout:5/951: dwrite db/df/d3f/dd9/de7/dfd/d1d/d20/f2a [4194304,4194304] 0 2023-12-05T09:26:43.531 INFO:tasks.workunit.client.0.smithi067.stdout:5/952: chown db/df/d36/d57/f10f 2 1 2023-12-05T09:26:43.533 INFO:tasks.workunit.client.0.smithi067.stdout:5/953: write db/df/d3f/d88/d8d/fcc [58681,83779] 0 2023-12-05T09:26:43.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/912: rmdir d0/d1d/d25/d12a/da8/da9/de0 0 2023-12-05T09:26:43.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/913: chown d0/d1d/d25/d32/l19 0 1 2023-12-05T09:26:43.571 INFO:tasks.workunit.client.0.smithi067.stdout:7/837: dwrite d0/d9/d56/de1/d111/d34/d67/d72/da4/fef [0,4194304] 0 2023-12-05T09:26:43.574 INFO:tasks.workunit.client.0.smithi067.stdout:2/872: dwrite d0/d25/d34/d4d/d54/d56/ff9 [0,4194304] 0 2023-12-05T09:26:43.615 INFO:tasks.workunit.client.0.smithi067.stdout:4/914: read d0/d1d/d2b/dd6/fc7 [394007,49492] 0 2023-12-05T09:26:43.615 INFO:tasks.workunit.client.0.smithi067.stdout:6/960: dwrite da/d10/d1e/d17/d2f/d3f/f10a [0,4194304] 0 2023-12-05T09:26:43.625 INFO:tasks.workunit.client.0.smithi067.stdout:7/838: dwrite d0/d9/d56/de1/d111/d34/d67/fc7 [0,4194304] 0 2023-12-05T09:26:43.638 INFO:tasks.workunit.client.0.smithi067.stdout:7/839: dread d0/d9/d10/d37/f2a [0,4194304] 0 2023-12-05T09:26:43.638 INFO:tasks.workunit.client.0.smithi067.stdout:7/840: readlink d0/d9/d10/d37/l83 0 2023-12-05T09:26:43.719 INFO:tasks.workunit.client.0.smithi067.stdout:1/943: sync 2023-12-05T09:26:43.719 INFO:tasks.workunit.client.0.smithi067.stdout:3/933: sync 2023-12-05T09:26:43.727 INFO:tasks.workunit.client.0.smithi067.stdout:6/961: dwrite da/d10/d1e/d51/d7b/dd6/fea [0,4194304] 0 2023-12-05T09:26:43.729 INFO:tasks.workunit.client.0.smithi067.stdout:7/841: dwrite d0/d9/d56/de1/d111/d5a/fa1 [0,4194304] 0 2023-12-05T09:26:43.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/873: mknod d0/d25/d9d/d53/d92/d123/c132 0 2023-12-05T09:26:43.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/874: read - d0/d7c/fc8 zero size 2023-12-05T09:26:43.741 INFO:tasks.workunit.client.0.smithi067.stdout:4/915: symlink d0/d1d/d4d/d8d/l14c 0 2023-12-05T09:26:43.756 INFO:tasks.workunit.client.0.smithi067.stdout:7/842: rename d0/d45/f49 to d0/d9/d10/d37/f116 0 2023-12-05T09:26:43.756 INFO:tasks.workunit.client.0.smithi067.stdout:2/875: truncate d0/d25/d48/f6b 2121836 0 2023-12-05T09:26:43.765 INFO:tasks.workunit.client.0.smithi067.stdout:2/876: mkdir d0/d25/d3f/d83/d133 0 2023-12-05T09:26:43.766 INFO:tasks.workunit.client.0.smithi067.stdout:4/916: truncate d0/d1d/d25/d32/f8f 2478993 0 2023-12-05T09:26:43.767 INFO:tasks.workunit.client.0.smithi067.stdout:2/877: write d0/d25/d34/fae [34990,91959] 0 2023-12-05T09:26:43.787 INFO:tasks.workunit.client.0.smithi067.stdout:3/934: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d92/fc9 [0,4194304] 0 2023-12-05T09:26:43.787 INFO:tasks.workunit.client.0.smithi067.stdout:3/935: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/f5a [374008,14403] 0 2023-12-05T09:26:43.787 INFO:tasks.workunit.client.0.smithi067.stdout:3/936: chown d9/f58 3837209 1 2023-12-05T09:26:43.818 INFO:tasks.workunit.client.0.smithi067.stdout:7/843: dwrite d0/d9/d3f/dbd/fce [0,4194304] 0 2023-12-05T09:26:43.836 INFO:tasks.workunit.client.0.smithi067.stdout:7/844: rename d0/d9/d40/f8d to d0/d9/d40/f117 0 2023-12-05T09:26:43.836 INFO:tasks.workunit.client.0.smithi067.stdout:1/944: dwrite d2/d5/d7/de/d19/d49/f56 [0,4194304] 0 2023-12-05T09:26:43.836 INFO:tasks.workunit.client.0.smithi067.stdout:3/937: dwrite d9/da/f19 [0,4194304] 0 2023-12-05T09:26:43.842 INFO:tasks.workunit.client.0.smithi067.stdout:1/945: creat d2/d4f/d14/d20/f145 x:0 0 0 2023-12-05T09:26:43.842 INFO:tasks.workunit.client.0.smithi067.stdout:1/946: dread - d2/d5/d7/de/d19/d8f/d98/ffc zero size 2023-12-05T09:26:43.842 INFO:tasks.workunit.client.0.smithi067.stdout:1/947: truncate d2/d4f/d14/ffe 283800 0 2023-12-05T09:26:43.851 INFO:tasks.workunit.client.0.smithi067.stdout:3/938: truncate d9/da/d3b/f6b 370777 0 2023-12-05T09:26:43.851 INFO:tasks.workunit.client.0.smithi067.stdout:6/962: dwrite da/d10/d1e/d17/d2f/d1f/d27/d4f/f6a [4194304,4194304] 0 2023-12-05T09:26:43.851 INFO:tasks.workunit.client.0.smithi067.stdout:6/963: chown da/d10/d1e/d17/d2f/d1f/d9e/cf2 27255371 1 2023-12-05T09:26:43.851 INFO:tasks.workunit.client.0.smithi067.stdout:1/948: link d2/d5/d7/d6a/db7/cc4 d2/d4f/d14/d20/d4c/c146 0 2023-12-05T09:26:43.865 INFO:tasks.workunit.client.0.smithi067.stdout:3/939: stat d9/c1e 0 2023-12-05T09:26:43.865 INFO:tasks.workunit.client.0.smithi067.stdout:3/940: read d9/da/d15/d17/d125/db6/fdb [35298,106321] 0 2023-12-05T09:26:43.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/964: getdents da/dde/d3b 0 2023-12-05T09:26:43.868 INFO:tasks.workunit.client.0.smithi067.stdout:1/949: mkdir d2/d4f/d14/d48/d147 0 2023-12-05T09:26:43.868 INFO:tasks.workunit.client.0.smithi067.stdout:6/965: write da/d10/d1e/d17/d2f/d72/fd5 [43241,94959] 0 2023-12-05T09:26:43.869 INFO:tasks.workunit.client.0.smithi067.stdout:4/917: dwrite d0/d1d/d2a/fae [0,4194304] 0 2023-12-05T09:26:43.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/966: read da/d10/d1e/d17/d2f/df5/d155/d19/fa4 [294979,114386] 0 2023-12-05T09:26:43.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/967: dread - da/d10/d1e/d17/d2f/db2/f150 zero size 2023-12-05T09:26:43.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/968: fdatasync da/d10/d1e/d17/d2f/d72/f90 0 2023-12-05T09:26:43.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/969: creat da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f15d x:0 0 0 2023-12-05T09:26:43.872 INFO:tasks.workunit.client.0.smithi067.stdout:6/970: dread - da/f113 zero size 2023-12-05T09:26:43.873 INFO:tasks.workunit.client.0.smithi067.stdout:1/950: mknod d2/d5/d7/de/d19/df2/c148 0 2023-12-05T09:26:43.873 INFO:tasks.workunit.client.0.smithi067.stdout:1/951: fdatasync d2/d4f/d54/fe4 0 2023-12-05T09:26:43.875 INFO:tasks.workunit.client.0.smithi067.stdout:2/878: dwrite d0/d25/f4e [0,4194304] 0 2023-12-05T09:26:43.875 INFO:tasks.workunit.client.0.smithi067.stdout:4/918: mknod d0/d1d/d2b/def/c14d 0 2023-12-05T09:26:43.878 INFO:tasks.workunit.client.0.smithi067.stdout:6/971: creat da/d10/d1e/d17/d2f/d1f/d27/f15e x:0 0 0 2023-12-05T09:26:43.878 INFO:tasks.workunit.client.0.smithi067.stdout:6/972: chown da/d10/d1e/d17/d2f/c117 4817 1 2023-12-05T09:26:43.884 INFO:tasks.workunit.client.0.smithi067.stdout:4/919: link d0/d1d/d25/d12a/da8/da9/f113 d0/d1d/d2a/df9/d129/f14e 0 2023-12-05T09:26:43.885 INFO:tasks.workunit.client.0.smithi067.stdout:4/920: write d0/d1d/d3c/d51/fc6 [818345,115909] 0 2023-12-05T09:26:43.891 INFO:tasks.workunit.client.0.smithi067.stdout:4/921: rename d0/f108 to d0/d1d/d25/d12a/da8/de3/f14f 0 2023-12-05T09:26:43.894 INFO:tasks.workunit.client.0.smithi067.stdout:6/973: write da/d10/d1e/d17/d2f/d1f/f25 [2641138,125661] 0 2023-12-05T09:26:43.894 INFO:tasks.workunit.client.0.smithi067.stdout:6/974: fsync da/d10/d1e/d17/d2f/d1f/d27/d4f/fb5 0 2023-12-05T09:26:43.899 INFO:tasks.workunit.client.0.smithi067.stdout:6/975: mkdir da/d10/d1e/d51/d7b/d15f 0 2023-12-05T09:26:43.899 INFO:tasks.workunit.client.0.smithi067.stdout:6/976: creat da/d10/d1e/d51/d7b/f160 x:0 0 0 2023-12-05T09:26:43.914 INFO:tasks.workunit.client.0.smithi067.stdout:5/954: sync 2023-12-05T09:26:43.915 INFO:tasks.workunit.client.0.smithi067.stdout:5/955: write db/df/d52/f9d [5095551,117734] 0 2023-12-05T09:26:43.915 INFO:tasks.workunit.client.0.smithi067.stdout:5/956: stat db/ca4 0 2023-12-05T09:26:43.915 INFO:tasks.workunit.client.0.smithi067.stdout:5/957: fsync db/df/d82/fb3 0 2023-12-05T09:26:43.924 INFO:tasks.workunit.client.0.smithi067.stdout:5/958: dread db/df/d3f/dd9/de7/dfd/d1d/d20/fd5 [0,4194304] 0 2023-12-05T09:26:43.928 INFO:tasks.workunit.client.0.smithi067.stdout:5/959: read db/df/d3f/d88/d8d/f11d [7785,117973] 0 2023-12-05T09:26:43.928 INFO:tasks.workunit.client.0.smithi067.stdout:5/960: chown db/df/d36/d6c/l136 19087063 1 2023-12-05T09:26:43.928 INFO:tasks.workunit.client.0.smithi067.stdout:5/961: creat db/df/d36/f13d x:0 0 0 2023-12-05T09:26:43.932 INFO:tasks.workunit.client.0.smithi067.stdout:1/952: write d2/d4f/d54/d70/fa9 [40578,28557] 0 2023-12-05T09:26:43.938 INFO:tasks.workunit.client.0.smithi067.stdout:1/953: mknod d2/d5/d7/d6a/d144/dbd/dd8/d100/c149 0 2023-12-05T09:26:43.938 INFO:tasks.workunit.client.0.smithi067.stdout:1/954: creat d2/d5/d50/f14a x:0 0 0 2023-12-05T09:26:43.938 INFO:tasks.workunit.client.0.smithi067.stdout:1/955: dread - d2/d5/d7/d6a/d144/dbb/dd1/de3/d133/f12a zero size 2023-12-05T09:26:43.944 INFO:tasks.workunit.client.0.smithi067.stdout:1/956: rmdir d2/d5/d7/d6a/d144/dbd/dd8/df8 39 2023-12-05T09:26:43.969 INFO:tasks.workunit.client.0.smithi067.stdout:2/879: dwrite d0/d25/d34/d4d/d54/d90/fe4 [0,4194304] 0 2023-12-05T09:26:43.970 INFO:tasks.workunit.client.0.smithi067.stdout:2/880: readlink d0/d25/d34/d4d/d78/l94 0 2023-12-05T09:26:43.970 INFO:tasks.workunit.client.0.smithi067.stdout:6/977: dread da/d10/d1e/d17/d2f/dbc/fb0 [0,4194304] 0 2023-12-05T09:26:43.970 INFO:tasks.workunit.client.0.smithi067.stdout:6/978: truncate da/d10/d1e/d17/d2f/d1f/d27/d4f/d87/de6/f15d 686969 0 2023-12-05T09:26:43.995 INFO:tasks.workunit.client.0.smithi067.stdout:6/979: write da/d10/f11 [453288,54737] 0 2023-12-05T09:26:43.998 INFO:tasks.workunit.client.0.smithi067.stdout:6/980: mknod da/d10/d1e/d17/d2f/d59/d6c/dbe/c161 0 2023-12-05T09:26:44.000 INFO:tasks.workunit.client.0.smithi067.stdout:6/981: symlink da/d10/d1e/d17/d2f/df5/d14e/l162 0 2023-12-05T09:26:44.002 INFO:tasks.workunit.client.0.smithi067.stdout:5/962: dwrite db/df/d82/f101 [0,4194304] 0 2023-12-05T09:26:44.009 INFO:tasks.workunit.client.0.smithi067.stdout:5/963: unlink db/df/d3f/dd9/de7/dfd/d1d/d20/fd5 0 2023-12-05T09:26:44.011 INFO:tasks.workunit.client.0.smithi067.stdout:3/941: dwrite d9/da/d15/d17/d2b/f118 [0,4194304] 0 2023-12-05T09:26:44.012 INFO:tasks.workunit.client.0.smithi067.stdout:3/942: fsync d9/da/d15/d17/d1a/d51/d70/f127 0 2023-12-05T09:26:44.014 INFO:tasks.workunit.client.0.smithi067.stdout:1/957: dwrite d2/d3/f3d [0,4194304] 0 2023-12-05T09:26:44.015 INFO:tasks.workunit.client.0.smithi067.stdout:5/964: symlink db/df/d35/d63/l13e 0 2023-12-05T09:26:44.018 INFO:tasks.workunit.client.0.smithi067.stdout:3/943: dread d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/f11b [0,4194304] 0 2023-12-05T09:26:44.029 INFO:tasks.workunit.client.0.smithi067.stdout:5/965: unlink db/df/d35/d63/d75/f121 0 2023-12-05T09:26:44.029 INFO:tasks.workunit.client.0.smithi067.stdout:6/982: write da/d10/d1e/d17/d2f/df5/d155/d5d/f12f [37661,71857] 0 2023-12-05T09:26:44.029 INFO:tasks.workunit.client.0.smithi067.stdout:5/966: dread - db/df/d3f/dd9/de7/dfd/d1d/f113 zero size 2023-12-05T09:26:44.029 INFO:tasks.workunit.client.0.smithi067.stdout:1/958: symlink d2/d5/d50/d13c/l14b 0 2023-12-05T09:26:44.029 INFO:tasks.workunit.client.0.smithi067.stdout:2/881: dwrite d0/d25/d34/d4d/db0/dce/f12e [0,4194304] 0 2023-12-05T09:26:44.030 INFO:tasks.workunit.client.0.smithi067.stdout:3/944: rmdir d9/da 39 2023-12-05T09:26:44.030 INFO:tasks.workunit.client.0.smithi067.stdout:3/945: dread - d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/f111 zero size 2023-12-05T09:26:44.036 INFO:tasks.workunit.client.0.smithi067.stdout:5/967: write db/df/d36/d57/f5d [1062134,100480] 0 2023-12-05T09:26:44.050 INFO:tasks.workunit.client.0.smithi067.stdout:6/983: symlink da/d7d/dd7/l163 0 2023-12-05T09:26:44.066 INFO:tasks.workunit.client.0.smithi067.stdout:3/946: rename d9/da/d15/d17/d1a/d51/d66/d82/da1/fae to d9/da/d15/d17/d125/db8/d11e/f149 0 2023-12-05T09:26:44.067 INFO:tasks.workunit.client.0.smithi067.stdout:3/947: creat d9/d62/dd0/d11d/f14a x:0 0 0 2023-12-05T09:26:44.086 INFO:tasks.workunit.client.0.smithi067.stdout:3/948: write d9/da/d15/d17/d1a/d51/d66/f98 [1028870,4562] 0 2023-12-05T09:26:44.086 INFO:tasks.workunit.client.0.smithi067.stdout:3/949: write d9/da/d15/d17/f55 [998445,100199] 0 2023-12-05T09:26:44.086 INFO:tasks.workunit.client.0.smithi067.stdout:3/950: write d9/da/d15/d17/d1a/d51/d66/f98 [2540105,54097] 0 2023-12-05T09:26:44.088 INFO:tasks.workunit.client.0.smithi067.stdout:3/951: truncate d9/da/d15/d17/d125/f33 3312688 0 2023-12-05T09:26:44.088 INFO:tasks.workunit.client.0.smithi067.stdout:1/959: dwrite d2/d5/d7/d6a/d144/fb1 [4194304,4194304] 0 2023-12-05T09:26:44.092 INFO:tasks.workunit.client.0.smithi067.stdout:3/952: mknod d9/da/d15/c14b 0 2023-12-05T09:26:44.092 INFO:tasks.workunit.client.0.smithi067.stdout:3/953: fdatasync d9/d62/dd0/d11d/f14a 0 2023-12-05T09:26:44.092 INFO:tasks.workunit.client.0.smithi067.stdout:3/954: truncate d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d65/f7c 147667 0 2023-12-05T09:26:44.103 INFO:tasks.workunit.client.0.smithi067.stdout:1/960: getdents d2/d5/d7/d6a/db7 0 2023-12-05T09:26:44.103 INFO:tasks.workunit.client.0.smithi067.stdout:1/961: fsync d2/d5/d7/de/d19/d8f/f82 0 2023-12-05T09:26:44.106 INFO:tasks.workunit.client.0.smithi067.stdout:3/955: rename d9/d62/dd0 to d9/da/d15/d17/d125/db6/d14c 0 2023-12-05T09:26:44.112 INFO:tasks.workunit.client.0.smithi067.stdout:2/882: dwrite d0/d25/d34/d4d/db0/f128 [0,4194304] 0 2023-12-05T09:26:44.113 INFO:tasks.workunit.client.0.smithi067.stdout:1/962: symlink d2/d5/d7/d6a/d144/dbb/l14c 0 2023-12-05T09:26:44.116 INFO:tasks.workunit.client.0.smithi067.stdout:1/963: mknod d2/d5/d7/de/d19/d49/c14d 0 2023-12-05T09:26:44.119 INFO:tasks.workunit.client.0.smithi067.stdout:6/984: dwrite da/d10/d1e/d17/f23 [0,4194304] 0 2023-12-05T09:26:44.119 INFO:tasks.workunit.client.0.smithi067.stdout:6/985: fsync da/d10/d1e/d17/d2f/d1f/d27/daa/fc6 0 2023-12-05T09:26:44.119 INFO:tasks.workunit.client.0.smithi067.stdout:6/986: truncate da/d10/d1e/d17/f40 5156887 0 2023-12-05T09:26:44.125 INFO:tasks.workunit.client.0.smithi067.stdout:1/964: stat d2/d4f/d14/d20/d83/l143 0 2023-12-05T09:26:44.127 INFO:tasks.workunit.client.0.smithi067.stdout:1/965: symlink d2/d4f/d54/d70/l14e 0 2023-12-05T09:26:44.130 INFO:tasks.workunit.client.0.smithi067.stdout:1/966: symlink d2/d5/d7/d6a/d144/dbb/l14f 0 2023-12-05T09:26:44.130 INFO:tasks.workunit.client.0.smithi067.stdout:1/967: write d2/d4f/d14/d20/f145 [137575,51846] 0 2023-12-05T09:26:44.130 INFO:tasks.workunit.client.0.smithi067.stdout:2/883: dread d0/d25/d9d/d63/f10b [0,4194304] 0 2023-12-05T09:26:44.130 INFO:tasks.workunit.client.0.smithi067.stdout:2/884: chown d0/d25 724669 1 2023-12-05T09:26:44.136 INFO:tasks.workunit.client.0.smithi067.stdout:2/885: link d0/f106 d0/d7c/f134 0 2023-12-05T09:26:44.136 INFO:tasks.workunit.client.0.smithi067.stdout:2/886: write d0/d7c/fc8 [753388,38248] 0 2023-12-05T09:26:44.136 INFO:tasks.workunit.client.0.smithi067.stdout:2/887: readlink d0/d25/d9d/d53/d1e/d8e/l10c 0 2023-12-05T09:26:44.137 INFO:tasks.workunit.client.0.smithi067.stdout:6/987: dread da/d10/d1e/d17/d2f/d3f/f10a [0,4194304] 0 2023-12-05T09:26:44.137 INFO:tasks.workunit.client.0.smithi067.stdout:6/988: fsync da/d10/d1e/d17/d2f/d1f/d27/d4f/d13f/f140 0 2023-12-05T09:26:44.140 INFO:tasks.workunit.client.0.smithi067.stdout:6/989: rename da/dde/l52 to da/d10/d1e/d17/d2f/d1f/d27/d4f/d13f/l164 0 2023-12-05T09:26:44.144 INFO:tasks.workunit.client.0.smithi067.stdout:6/990: mknod da/d10/d1e/d17/d2f/df5/d155/d80/d135/c165 0 2023-12-05T09:26:44.146 INFO:tasks.workunit.client.0.smithi067.stdout:6/991: mkdir da/d10/d1e/d7f/d166 0 2023-12-05T09:26:44.146 INFO:tasks.workunit.client.0.smithi067.stdout:6/992: chown da/d10/d1e/d7f/lc4 24 1 2023-12-05T09:26:44.152 INFO:tasks.workunit.client.0.smithi067.stdout:2/888: dread d0/d25/d9d/d53/d1e/d7f/fcc [0,4194304] 0 2023-12-05T09:26:44.152 INFO:tasks.workunit.client.0.smithi067.stdout:6/993: rmdir da/d10/d1e/d17/d2f/d5f/d115/d10c 39 2023-12-05T09:26:44.157 INFO:tasks.workunit.client.0.smithi067.stdout:6/994: mknod da/d10/d1e/d17/d2f/df5/c167 0 2023-12-05T09:26:44.158 INFO:tasks.workunit.client.0.smithi067.stdout:6/995: stat da/d10/d1e/d17/d2f/lf 0 2023-12-05T09:26:44.158 INFO:tasks.workunit.client.0.smithi067.stdout:6/996: chown da/d10/d1e/d17/d2f/d5f/d115/c119 65 1 2023-12-05T09:26:44.161 INFO:tasks.workunit.client.0.smithi067.stdout:2/889: getdents d0/d25/d34/d4d/db0 0 2023-12-05T09:26:44.161 INFO:tasks.workunit.client.0.smithi067.stdout:2/890: write d0/d25/d34/d4d/db0/f124 [626693,115747] 0 2023-12-05T09:26:44.161 INFO:tasks.workunit.client.0.smithi067.stdout:2/891: chown d0/d25/d3f/l62 1 1 2023-12-05T09:26:44.162 INFO:tasks.workunit.client.0.smithi067.stdout:3/956: dwrite d9/da/d15/d17/f13a [0,4194304] 0 2023-12-05T09:26:44.162 INFO:tasks.workunit.client.0.smithi067.stdout:3/957: chown d9/d49/c54 4 1 2023-12-05T09:26:44.163 INFO:tasks.workunit.client.0.smithi067.stdout:3/958: read - d9/da/d15/d17/d1a/d51/f89 zero size 2023-12-05T09:26:44.163 INFO:tasks.workunit.client.0.smithi067.stdout:6/997: creat da/d10/d1e/d17/d2f/d2c/dc3/f168 x:0 0 0 2023-12-05T09:26:44.166 INFO:tasks.workunit.client.0.smithi067.stdout:2/892: mknod d0/d25/d9d/c135 0 2023-12-05T09:26:44.166 INFO:tasks.workunit.client.0.smithi067.stdout:2/893: readlink d0/d25/d34/d4d/db0/dce/l121 0 2023-12-05T09:26:44.168 INFO:tasks.workunit.client.0.smithi067.stdout:3/959: creat d9/da/d15/d17/d125/db8/d134/f14d x:0 0 0 2023-12-05T09:26:44.170 INFO:tasks.workunit.client.0.smithi067.stdout:2/894: mkdir d0/d7c/d136 0 2023-12-05T09:26:44.171 INFO:tasks.workunit.client.0.smithi067.stdout:2/895: creat d0/d25/d9d/d53/d1e/d8e/dd0/d84/f137 x:0 0 0 2023-12-05T09:26:44.171 INFO:tasks.workunit.client.0.smithi067.stdout:2/896: fsync d0/d25/d34/d4d/d72/f8c 0 2023-12-05T09:26:44.172 INFO:tasks.workunit.client.0.smithi067.stdout:6/998: dread da/d10/d1e/d17/d2f/d5f/d115/ff3 [0,4194304] 0 2023-12-05T09:26:44.174 INFO:tasks.workunit.client.0.smithi067.stdout:2/897: read d0/d25/d3a/fdc [647001,95399] 0 2023-12-05T09:26:44.175 INFO:tasks.workunit.client.0.smithi067.stdout:2/898: truncate d0/d25/d34/d4d/db0/f111 760595 0 2023-12-05T09:26:44.176 INFO:tasks.workunit.client.0.smithi067.stdout:6/999: rename da/d10/d1e/d17/d2f/df5/d155/d19/c2a to da/d10/d1e/d7f/d137/c169 0 2023-12-05T09:26:44.178 INFO:tasks.workunit.client.0.smithi067.stdout:2/899: unlink d0/d25/d9d/d53/c12 0 2023-12-05T09:26:44.180 INFO:tasks.workunit.client.0.smithi067.stdout:2/900: mknod d0/d25/d48/c138 0 2023-12-05T09:26:44.180 INFO:tasks.workunit.client.0.smithi067.stdout:2/901: fdatasync d0/d25/d34/d4d/db0/dce/dd3/df0/ff7 0 2023-12-05T09:26:44.180 INFO:tasks.workunit.client.0.smithi067.stdout:2/902: fdatasync d0/d25/d34/d4d/db0/f128 0 2023-12-05T09:26:44.181 INFO:tasks.workunit.client.0.smithi067.stdout:2/903: creat d0/f139 x:0 0 0 2023-12-05T09:26:44.181 INFO:tasks.workunit.client.0.smithi067.stdout:2/904: write d0/d25/d34/d4d/d54/d90/dcf/fd8 [230358,78860] 0 2023-12-05T09:26:44.184 INFO:tasks.workunit.client.0.smithi067.stdout:2/905: truncate d0/d25/d34/d4a/f52 2486560 0 2023-12-05T09:26:44.184 INFO:tasks.workunit.client.0.smithi067.stdout:2/906: creat d0/d25/d34/d4d/db0/dbf/f13a x:0 0 0 2023-12-05T09:26:44.187 INFO:tasks.workunit.client.0.smithi067.stdout:2/907: rename d0/d25/d34/d4d/d54/d56/l11e to d0/d25/d34/d4d/d54/d56/l13b 0 2023-12-05T09:26:44.195 INFO:tasks.workunit.client.0.smithi067.stdout:3/960: write d9/f58 [2663965,35840] 0 2023-12-05T09:26:44.195 INFO:tasks.workunit.client.0.smithi067.stdout:3/961: stat d9/d62/f8f 0 2023-12-05T09:26:44.198 INFO:tasks.workunit.client.0.smithi067.stdout:1/968: dwrite d2/d5/d7/de/d19/d49/d5f/ff5 [0,4194304] 0 2023-12-05T09:26:44.198 INFO:tasks.workunit.client.0.smithi067.stdout:1/969: dread - d2/d4f/d54/d70/f139 zero size 2023-12-05T09:26:44.198 INFO:tasks.workunit.client.0.smithi067.stdout:3/962: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/d144/c14e 0 2023-12-05T09:26:44.209 INFO:tasks.workunit.client.0.smithi067.stdout:1/970: symlink d2/d5/d50/d13c/l150 0 2023-12-05T09:26:44.209 INFO:tasks.workunit.client.0.smithi067.stdout:2/908: dread d0/d25/d34/d4d/db0/dbf/f10d [0,4194304] 0 2023-12-05T09:26:44.211 INFO:tasks.workunit.client.0.smithi067.stdout:3/963: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/c14f 0 2023-12-05T09:26:44.211 INFO:tasks.workunit.client.0.smithi067.stdout:2/909: truncate d0/d25/d3f/d83/f11c 5005973 0 2023-12-05T09:26:44.214 INFO:tasks.workunit.client.0.smithi067.stdout:1/971: creat d2/d4f/d14/d20/d4c/f151 x:0 0 0 2023-12-05T09:26:44.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/972: read d2/d4f/d14/f42 [434289,53926] 0 2023-12-05T09:26:44.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/973: truncate d2/d5/d7/d6a/d144/dbb/dd1/de3/f11a 833375 0 2023-12-05T09:26:44.231 INFO:tasks.workunit.client.0.smithi067.stdout:1/974: read - d2/d5/d7/d6a/d144/dbd/dd8/df8/f137 zero size 2023-12-05T09:26:44.232 INFO:tasks.workunit.client.0.smithi067.stdout:1/975: creat d2/d4f/d15/d13d/f152 x:0 0 0 2023-12-05T09:26:44.236 INFO:tasks.workunit.client.0.smithi067.stdout:1/976: symlink d2/d5/d7/de/d19/d8f/l153 0 2023-12-05T09:26:44.285 INFO:tasks.workunit.client.0.smithi067.stdout:2/910: dwrite d0/d25/d9d/d53/d1e/d8e/dc4/fb2 [0,4194304] 0 2023-12-05T09:26:44.285 INFO:tasks.workunit.client.0.smithi067.stdout:2/911: creat d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/f13c x:0 0 0 2023-12-05T09:26:44.287 INFO:tasks.workunit.client.0.smithi067.stdout:2/912: rmdir d0/d25/d34/d4d/d54/d90/dcf 39 2023-12-05T09:26:44.287 INFO:tasks.workunit.client.0.smithi067.stdout:2/913: write d0/d25/d9d/d63/f10b [5193093,62719] 0 2023-12-05T09:26:44.288 INFO:tasks.workunit.client.0.smithi067.stdout:2/914: truncate d0/d25/d9d/d53/d92/fc2 280940 0 2023-12-05T09:26:44.289 INFO:tasks.workunit.client.0.smithi067.stdout:2/915: mkdir d0/d13d 0 2023-12-05T09:26:44.290 INFO:tasks.workunit.client.0.smithi067.stdout:3/964: dwrite d9/da/d15/d17/d125/f33 [0,4194304] 0 2023-12-05T09:26:44.291 INFO:tasks.workunit.client.0.smithi067.stdout:1/977: dwrite d2/d4f/d54/f114 [0,4194304] 0 2023-12-05T09:26:44.306 INFO:tasks.workunit.client.0.smithi067.stdout:1/978: creat d2/d5/d50/d13c/f154 x:0 0 0 2023-12-05T09:26:44.306 INFO:tasks.workunit.client.0.smithi067.stdout:1/979: fdatasync d2/d5/d7/d6a/d144/f12f 0 2023-12-05T09:26:44.308 INFO:tasks.workunit.client.0.smithi067.stdout:1/980: creat d2/d5/d7/d6a/d144/dbb/dd1/d10d/f155 x:0 0 0 2023-12-05T09:26:44.309 INFO:tasks.workunit.client.0.smithi067.stdout:3/965: dread d9/da/d15/d17/f55 [0,4194304] 0 2023-12-05T09:26:44.311 INFO:tasks.workunit.client.0.smithi067.stdout:1/981: symlink d2/l156 0 2023-12-05T09:26:44.315 INFO:tasks.workunit.client.0.smithi067.stdout:1/982: rename d2/d5/d7/de/d19/d8f/d98/cb8 to d2/d4f/d14/d48/d147/c157 0 2023-12-05T09:26:44.319 INFO:tasks.workunit.client.0.smithi067.stdout:1/983: rename d2/ddb/ce1 to d2/c158 0 2023-12-05T09:26:44.322 INFO:tasks.workunit.client.0.smithi067.stdout:1/984: mknod d2/d5/d7/de/d19/d49/d6d/c159 0 2023-12-05T09:26:44.325 INFO:tasks.workunit.client.0.smithi067.stdout:1/985: creat d2/d5/f15a x:0 0 0 2023-12-05T09:26:44.332 INFO:tasks.workunit.client.0.smithi067.stdout:3/966: write d9/da/d15/d17/d1a/d51/dcd/fe3 [2662992,33275] 0 2023-12-05T09:26:44.334 INFO:tasks.workunit.client.0.smithi067.stdout:7/845: sync 2023-12-05T09:26:44.334 INFO:tasks.workunit.client.0.smithi067.stdout:4/922: sync 2023-12-05T09:26:44.335 INFO:tasks.workunit.client.0.smithi067.stdout:3/967: mknod d9/da/d15/d17/d1a/d51/d70/c150 0 2023-12-05T09:26:44.338 INFO:tasks.workunit.client.0.smithi067.stdout:3/968: truncate d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/fee 559314 0 2023-12-05T09:26:44.339 INFO:tasks.workunit.client.0.smithi067.stdout:3/969: fdatasync d9/da/fe9 0 2023-12-05T09:26:44.343 INFO:tasks.workunit.client.0.smithi067.stdout:2/916: dwrite d0/d7c/fc8 [0,4194304] 0 2023-12-05T09:26:44.343 INFO:tasks.workunit.client.0.smithi067.stdout:4/923: creat d0/d1d/d25/d12a/da8/da9/d15/dd0/dd9/de6/d104/f150 x:0 0 0 2023-12-05T09:26:44.343 INFO:tasks.workunit.client.0.smithi067.stdout:3/970: creat d9/da/d15/d17/d125/db6/f151 x:0 0 0 2023-12-05T09:26:44.344 INFO:tasks.workunit.client.0.smithi067.stdout:1/986: dread d2/d4f/d14/d20/d83/f84 [4194304,4194304] 0 2023-12-05T09:26:44.346 INFO:tasks.workunit.client.0.smithi067.stdout:4/924: mknod d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/d88/d106/c151 0 2023-12-05T09:26:44.346 INFO:tasks.workunit.client.0.smithi067.stdout:4/925: chown d0/d1d/d2b/dd6/c11a 47454267 1 2023-12-05T09:26:44.346 INFO:tasks.workunit.client.0.smithi067.stdout:4/926: fsync d0/d1d/d2b/dd6/fc7 0 2023-12-05T09:26:44.346 INFO:tasks.workunit.client.0.smithi067.stdout:4/927: fsync d0/d1d/d25/d32/f8f 0 2023-12-05T09:26:44.346 INFO:tasks.workunit.client.0.smithi067.stdout:7/846: dread d0/d9/d40/f117 [0,4194304] 0 2023-12-05T09:26:44.346 INFO:tasks.workunit.client.0.smithi067.stdout:7/847: fdatasync d0/d9/d40/fa0 0 2023-12-05T09:26:44.346 INFO:tasks.workunit.client.0.smithi067.stdout:7/848: fsync d0/d9/d40/d7a/dad/fcd 0 2023-12-05T09:26:44.347 INFO:tasks.workunit.client.0.smithi067.stdout:1/987: creat d2/d5/d7/d6a/d144/dbd/dd8/d100/f15b x:0 0 0 2023-12-05T09:26:44.351 INFO:tasks.workunit.client.0.smithi067.stdout:7/849: rmdir d0/d9/d56/df2 39 2023-12-05T09:26:44.351 INFO:tasks.workunit.client.0.smithi067.stdout:7/850: mknod d0/d9/d56/de1/d111/d9c/c118 0 2023-12-05T09:26:44.357 INFO:tasks.workunit.client.0.smithi067.stdout:7/851: chown d0/d9/d56/de1/d111/d54/la8 36 1 2023-12-05T09:26:44.362 INFO:tasks.workunit.client.0.smithi067.stdout:2/917: dread d0/d25/d34/f3d [0,4194304] 0 2023-12-05T09:26:44.366 INFO:tasks.workunit.client.0.smithi067.stdout:2/918: mkdir d0/d25/d34/d4d/db0/dce/dd3/df0/d110/d13e 0 2023-12-05T09:26:44.381 INFO:tasks.workunit.client.0.smithi067.stdout:2/919: write d0/d25/d9d/d53/d1e/d8e/dd0/d39/f89 [3828972,52625] 0 2023-12-05T09:26:44.383 INFO:tasks.workunit.client.0.smithi067.stdout:2/920: creat d0/d25/d34/d4d/d54/d56/d125/f13f x:0 0 0 2023-12-05T09:26:44.383 INFO:tasks.workunit.client.0.smithi067.stdout:2/921: readlink d0/d25/d9d/d53/d92/d123/lfc 0 2023-12-05T09:26:44.384 INFO:tasks.workunit.client.0.smithi067.stdout:2/922: symlink d0/d25/d34/d4d/db0/dce/dd3/df0/d110/d13e/l140 0 2023-12-05T09:26:44.386 INFO:tasks.workunit.client.0.smithi067.stdout:2/923: creat d0/d25/d3f/d83/f141 x:0 0 0 2023-12-05T09:26:44.407 INFO:tasks.workunit.client.0.smithi067.stdout:2/924: write d0/d25/d9d/d53/d1e/d8e/dd0/d39/f40 [1113040,91477] 0 2023-12-05T09:26:44.409 INFO:tasks.workunit.client.0.smithi067.stdout:3/971: dwrite d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/dfa/f148 [4194304,4194304] 0 2023-12-05T09:26:44.410 INFO:tasks.workunit.client.0.smithi067.stdout:2/925: rename d0/d25/d9d/d63/f10b to d0/d7c/f142 0 2023-12-05T09:26:44.415 INFO:tasks.workunit.client.0.smithi067.stdout:3/972: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/c152 0 2023-12-05T09:26:44.415 INFO:tasks.workunit.client.0.smithi067.stdout:3/973: creat d9/d20/f153 x:0 0 0 2023-12-05T09:26:44.416 INFO:tasks.workunit.client.0.smithi067.stdout:2/926: creat d0/d25/d34/d4d/db0/dce/dd3/df0/d110/f143 x:0 0 0 2023-12-05T09:26:44.416 INFO:tasks.workunit.client.0.smithi067.stdout:2/927: write d0/d7c/fc8 [4709311,82363] 0 2023-12-05T09:26:44.418 INFO:tasks.workunit.client.0.smithi067.stdout:3/974: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/c154 0 2023-12-05T09:26:44.420 INFO:tasks.workunit.client.0.smithi067.stdout:2/928: truncate d0/d25/d34/d4d/d54/d56/ff9 216866 0 2023-12-05T09:26:44.421 INFO:tasks.workunit.client.0.smithi067.stdout:2/929: chown d0/d25/d9d/d53/d1e/d8e/dd0/c5d 1449138 1 2023-12-05T09:26:44.421 INFO:tasks.workunit.client.0.smithi067.stdout:2/930: write d0/d25/d9d/d53/d1e/d8e/dd0/d84/fa2 [1857002,41535] 0 2023-12-05T09:26:44.421 INFO:tasks.workunit.client.0.smithi067.stdout:3/975: getdents d9/da/d15/d17/d125/dce 0 2023-12-05T09:26:44.424 INFO:tasks.workunit.client.0.smithi067.stdout:2/931: rename d0/d25/d9d/d53/d1e/d8e/dd0/d39/f6f to d0/d25/d3f/f144 0 2023-12-05T09:26:44.425 INFO:tasks.workunit.client.0.smithi067.stdout:4/928: dread d0/d1d/d25/d12a/da8/da9/f14 [0,4194304] 0 2023-12-05T09:26:44.429 INFO:tasks.workunit.client.0.smithi067.stdout:3/976: symlink d9/da/d15/d17/d1a/d51/d66/d82/l155 0 2023-12-05T09:26:44.430 INFO:tasks.workunit.client.0.smithi067.stdout:2/932: rename d0/d25/d9d/d63/d88/lba to d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/l145 0 2023-12-05T09:26:44.430 INFO:tasks.workunit.client.0.smithi067.stdout:2/933: read d0/d25/d9d/d53/d1e/f74 [3857142,43062] 0 2023-12-05T09:26:44.431 INFO:tasks.workunit.client.0.smithi067.stdout:4/929: mkdir d0/d1d/d25/d2c/d13a/d148/d152 0 2023-12-05T09:26:44.435 INFO:tasks.workunit.client.0.smithi067.stdout:3/977: link d9/f27 d9/da/d15/d17/d1a/d51/d66/d82/d13d/f156 0 2023-12-05T09:26:44.435 INFO:tasks.workunit.client.0.smithi067.stdout:1/988: dwrite d2/d4f/d15/d74/d76/ff9 [0,4194304] 0 2023-12-05T09:26:44.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/989: chown d2/d4f/d14/d48/d147/c157 3 1 2023-12-05T09:26:44.436 INFO:tasks.workunit.client.0.smithi067.stdout:1/990: creat d2/d5/f15c x:0 0 0 2023-12-05T09:26:44.440 INFO:tasks.workunit.client.0.smithi067.stdout:7/852: dwrite d0/d9/d3f/fff [0,4194304] 0 2023-12-05T09:26:44.441 INFO:tasks.workunit.client.0.smithi067.stdout:3/978: mkdir d9/da/d15/d17/d125/dce/d157 0 2023-12-05T09:26:44.442 INFO:tasks.workunit.client.0.smithi067.stdout:3/979: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/f158 x:0 0 0 2023-12-05T09:26:44.445 INFO:tasks.workunit.client.0.smithi067.stdout:1/991: mknod d2/d5/d7/de/d19/d49/dec/c15d 0 2023-12-05T09:26:44.451 INFO:tasks.workunit.client.0.smithi067.stdout:2/934: dread d0/d25/d34/d4d/f81 [0,4194304] 0 2023-12-05T09:26:44.452 INFO:tasks.workunit.client.0.smithi067.stdout:2/935: write d0/d25/d9d/d53/d1e/d8e/dd0/d84/dec/f11b [127333,48491] 0 2023-12-05T09:26:44.452 INFO:tasks.workunit.client.0.smithi067.stdout:2/936: dread - d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/f13c zero size 2023-12-05T09:26:44.452 INFO:tasks.workunit.client.0.smithi067.stdout:4/930: dread d0/d1d/d25/d12a/da8/da9/d15/f33 [4194304,4194304] 0 2023-12-05T09:26:44.457 INFO:tasks.workunit.client.0.smithi067.stdout:3/980: mkdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/d159 0 2023-12-05T09:26:44.458 INFO:tasks.workunit.client.0.smithi067.stdout:1/992: getdents d2/d4f/d14/d20/d83/d78 0 2023-12-05T09:26:44.460 INFO:tasks.workunit.client.0.smithi067.stdout:2/937: unlink d0/d25/d9d/d53/lbe 0 2023-12-05T09:26:44.460 INFO:tasks.workunit.client.0.smithi067.stdout:2/938: chown d0/d25/d34/d4d/db0/f111 3 1 2023-12-05T09:26:44.461 INFO:tasks.workunit.client.0.smithi067.stdout:7/853: dread d0/d9/d3f/f47 [0,4194304] 0 2023-12-05T09:26:44.463 INFO:tasks.workunit.client.0.smithi067.stdout:1/993: truncate d2/d5/d7/de/d19/df2/f118 8251026 0 2023-12-05T09:26:44.464 INFO:tasks.workunit.client.0.smithi067.stdout:7/854: link d0/d9/d56/de1/d111/d34/d67/d72/l107 d0/d9/d56/de1/d111/d54/l119 0 2023-12-05T09:26:44.465 INFO:tasks.workunit.client.0.smithi067.stdout:5/968: sync 2023-12-05T09:26:44.465 INFO:tasks.workunit.client.0.smithi067.stdout:7/855: write d0/d9/d56/de1/d111/d5a/fa2 [479215,87960] 0 2023-12-05T09:26:44.466 INFO:tasks.workunit.client.0.smithi067.stdout:3/981: rmdir d9/da/d15/d17/d125/dce/d157 0 2023-12-05T09:26:44.469 INFO:tasks.workunit.client.0.smithi067.stdout:4/931: rename d0/d1d/d25/d38/l99 to d0/d1d/d2b/l153 0 2023-12-05T09:26:44.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/994: creat d2/d5/d7/d6a/f15e x:0 0 0 2023-12-05T09:26:44.471 INFO:tasks.workunit.client.0.smithi067.stdout:1/995: chown d2/d5/f15a 273492 1 2023-12-05T09:26:44.473 INFO:tasks.workunit.client.0.smithi067.stdout:5/969: link db/df/d36/d57/fb7 db/df/d3f/f13f 0 2023-12-05T09:26:44.477 INFO:tasks.workunit.client.0.smithi067.stdout:7/856: mkdir d0/d9/d56/de1/d10e/d11a 0 2023-12-05T09:26:44.477 INFO:tasks.workunit.client.0.smithi067.stdout:7/857: fsync d0/d9/d40/d7a/f87 0 2023-12-05T09:26:44.477 INFO:tasks.workunit.client.0.smithi067.stdout:3/982: mknod d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/d64/c15a 0 2023-12-05T09:26:44.477 INFO:tasks.workunit.client.0.smithi067.stdout:3/983: read - d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/f137 zero size 2023-12-05T09:26:44.484 INFO:tasks.workunit.client.0.smithi067.stdout:1/996: symlink d2/d4f/d15/d60/d68/l15f 0 2023-12-05T09:26:44.488 INFO:tasks.workunit.client.0.smithi067.stdout:7/858: unlink d0/dd4/lea 0 2023-12-05T09:26:44.498 INFO:tasks.workunit.client.0.smithi067.stdout:3/984: dread d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/fb7 [0,4194304] 0 2023-12-05T09:26:44.498 INFO:tasks.workunit.client.0.smithi067.stdout:3/985: dread - d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/f158 zero size 2023-12-05T09:26:44.499 INFO:tasks.workunit.client.0.smithi067.stdout:7/859: rename d0/d9/d56/de1/d111/d34/d67/lb1 to d0/d9/d40/d7a/dad/dc2/l11b 0 2023-12-05T09:26:44.499 INFO:tasks.workunit.client.0.smithi067.stdout:7/860: stat d0/f7 0 2023-12-05T09:26:44.502 INFO:tasks.workunit.client.0.smithi067.stdout:1/997: symlink d2/d4f/d15/d60/d68/l160 0 2023-12-05T09:26:44.506 INFO:tasks.workunit.client.0.smithi067.stdout:3/986: rmdir d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/d104/d159 0 2023-12-05T09:26:44.508 INFO:tasks.workunit.client.0.smithi067.stdout:7/861: symlink d0/d9/d56/de1/l11c 0 2023-12-05T09:26:44.509 INFO:tasks.workunit.client.0.smithi067.stdout:7/862: stat d0/d9/d56/d8e/daa/cc5 0 2023-12-05T09:26:44.512 INFO:tasks.workunit.client.0.smithi067.stdout:3/987: mkdir d9/da/d15/d17/d125/db6/d14c/d11d/d15b 0 2023-12-05T09:26:44.512 INFO:tasks.workunit.client.0.smithi067.stdout:3/988: write d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d47/f119 [4968575,54101] 0 2023-12-05T09:26:44.512 INFO:tasks.workunit.client.0.smithi067.stdout:3/989: truncate d9/da/d15/d17/d1a/d51/dcd/fe3 4814854 0 2023-12-05T09:26:44.513 INFO:tasks.workunit.client.0.smithi067.stdout:2/939: dwrite d0/f8a [8388608,4194304] 0 2023-12-05T09:26:44.513 INFO:tasks.workunit.client.0.smithi067.stdout:2/940: readlink d0/d25/d9d/d53/d1e/d8e/dc4/l129 0 2023-12-05T09:26:44.514 INFO:tasks.workunit.client.0.smithi067.stdout:7/863: mkdir d0/d9/d56/de1/d11d 0 2023-12-05T09:26:44.517 INFO:tasks.workunit.client.0.smithi067.stdout:2/941: symlink d0/d25/d9d/d53/d1e/d8e/dd0/d84/d127/l146 0 2023-12-05T09:26:44.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/864: symlink d0/d9/d10/l11e 0 2023-12-05T09:26:44.517 INFO:tasks.workunit.client.0.smithi067.stdout:2/942: unlink d0/d25/d9d/d53/d92/d123/lfc 0 2023-12-05T09:26:44.520 INFO:tasks.workunit.client.0.smithi067.stdout:7/865: unlink d0/d9/d56/de1/d111/d9c/ld0 0 2023-12-05T09:26:44.523 INFO:tasks.workunit.client.0.smithi067.stdout:7/866: creat d0/d9/d56/de1/d111/d34/d67/d72/da9/dd1/f11f x:0 0 0 2023-12-05T09:26:44.524 INFO:tasks.workunit.client.0.smithi067.stdout:2/943: mkdir d0/d147 0 2023-12-05T09:26:44.526 INFO:tasks.workunit.client.0.smithi067.stdout:7/867: creat d0/f120 x:0 0 0 2023-12-05T09:26:44.527 INFO:tasks.workunit.client.0.smithi067.stdout:2/944: mkdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/de8/d148 0 2023-12-05T09:26:44.529 INFO:tasks.workunit.client.0.smithi067.stdout:2/945: mkdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/d149 0 2023-12-05T09:26:44.533 INFO:tasks.workunit.client.0.smithi067.stdout:2/946: rename d0/d25/d9d/f73 to d0/d25/d9d/d53/d1e/f14a 0 2023-12-05T09:26:44.548 INFO:tasks.workunit.client.0.smithi067.stdout:4/932: dwrite d0/d1d/d25/d32/f117 [0,4194304] 0 2023-12-05T09:26:44.550 INFO:tasks.workunit.client.0.smithi067.stdout:4/933: rename d0/d1d/d25/l6a to d0/d1d/d25/d12a/da8/da9/l154 0 2023-12-05T09:26:44.552 INFO:tasks.workunit.client.0.smithi067.stdout:4/934: rename d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/daa/fdb to d0/d1d/d4d/d8d/f155 0 2023-12-05T09:26:44.553 INFO:tasks.workunit.client.0.smithi067.stdout:4/935: write d0/d9/f78 [194235,93921] 0 2023-12-05T09:26:44.554 INFO:tasks.workunit.client.0.smithi067.stdout:4/936: truncate d0/d1d/d25/d12a/da8/da9/d15/d11c/f43 820154 0 2023-12-05T09:26:44.554 INFO:tasks.workunit.client.0.smithi067.stdout:4/937: dread - d0/d1d/d24/f6f zero size 2023-12-05T09:26:44.554 INFO:tasks.workunit.client.0.smithi067.stdout:4/938: write d0/d1d/d25/d12a/da8/da9/d15/d11c/f5e [1117035,69336] 0 2023-12-05T09:26:44.555 INFO:tasks.workunit.client.0.smithi067.stdout:4/939: symlink d0/d1d/d25/l156 0 2023-12-05T09:26:44.555 INFO:tasks.workunit.client.0.smithi067.stdout:4/940: readlink d0/d1d/d25/d2c/db5/deb/led 0 2023-12-05T09:26:44.573 INFO:tasks.workunit.client.0.smithi067.stdout:3/990: dwrite d9/f107 [0,4194304] 0 2023-12-05T09:26:44.573 INFO:tasks.workunit.client.0.smithi067.stdout:3/991: chown d9/da/c13 2246 1 2023-12-05T09:26:44.579 INFO:tasks.workunit.client.0.smithi067.stdout:5/970: dwrite db/df/d35/f11e [0,4194304] 0 2023-12-05T09:26:44.579 INFO:tasks.workunit.client.0.smithi067.stdout:5/971: chown db/df/d36/d6c/dc1/d131 1090 1 2023-12-05T09:26:44.592 INFO:tasks.workunit.client.0.smithi067.stdout:4/941: truncate d0/d1d/d25/d12a/da8/da9/d15/d11c/f43 456489 0 2023-12-05T09:26:44.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/942: rename d0/d1d/d25/d32/l1b to d0/d1d/d2b/l157 0 2023-12-05T09:26:44.594 INFO:tasks.workunit.client.0.smithi067.stdout:4/943: chown d0/d1d/d25/d12a/da8/da9/d15/ce5 3845702 1 2023-12-05T09:26:44.595 INFO:tasks.workunit.client.0.smithi067.stdout:3/992: write d9/d49/f9f [3795384,129197] 0 2023-12-05T09:26:44.596 INFO:tasks.workunit.client.0.smithi067.stdout:3/993: creat d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d65/f15c x:0 0 0 2023-12-05T09:26:44.597 INFO:tasks.workunit.client.0.smithi067.stdout:7/868: dwrite d0/d9/d10/f5d [0,4194304] 0 2023-12-05T09:26:44.598 INFO:tasks.workunit.client.0.smithi067.stdout:3/994: symlink d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/d87/db2/l15d 0 2023-12-05T09:26:44.598 INFO:tasks.workunit.client.0.smithi067.stdout:3/995: dread - d9/da/d15/d17/d1a/d51/d66/d82/da1/d29/d7e/dda/dfa/f145 zero size 2023-12-05T09:26:44.598 INFO:tasks.workunit.client.0.smithi067.stdout:3/996: stat d9/da/d15/d17/d1a/d51/d66/d82/d13d 0 2023-12-05T09:26:44.598 INFO:tasks.workunit.client.0.smithi067.stdout:7/869: write d0/d9/d56/de1/d111/d34/fbe [385345,116912] 0 2023-12-05T09:26:44.600 INFO:tasks.workunit.client.0.smithi067.stdout:7/870: unlink d0/l3d 0 2023-12-05T09:26:44.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:44 smithi067 ceph-mon[107174]: pgmap v37: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 196 MiB/s rd, 247 MiB/s wr, 396 op/s 2023-12-05T09:26:44.620 INFO:tasks.workunit.client.0.smithi067.stdout:7/871: write d0/d9/d56/de1/d111/d34/fa6 [1955949,99264] 0 2023-12-05T09:26:44.622 INFO:tasks.workunit.client.0.smithi067.stdout:7/872: mkdir d0/d121 0 2023-12-05T09:26:44.622 INFO:tasks.workunit.client.0.smithi067.stdout:7/873: fsync d0/d9/d3f/dbd/f105 0 2023-12-05T09:26:44.626 INFO:tasks.workunit.client.0.smithi067.stdout:7/874: unlink d0/d9/l1c 0 2023-12-05T09:26:44.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:44 smithi134 ceph-mon[116304]: pgmap v37: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 196 MiB/s rd, 247 MiB/s wr, 396 op/s 2023-12-05T09:26:44.643 INFO:tasks.workunit.client.0.smithi067.stdout:5/972: dwrite db/df/d3f/dd9/de7/dfd/f21 [0,4194304] 0 2023-12-05T09:26:44.644 INFO:tasks.workunit.client.0.smithi067.stdout:5/973: chown db/df/f31 577 1 2023-12-05T09:26:44.645 INFO:tasks.workunit.client.0.smithi067.stdout:4/944: dwrite d0/d1d/d3c/d51/f114 [0,4194304] 0 2023-12-05T09:26:44.652 INFO:tasks.workunit.client.0.smithi067.stdout:4/945: rmdir d0/d1d/d2a/d93/da4 39 2023-12-05T09:26:44.656 INFO:tasks.workunit.client.0.smithi067.stdout:3/997: dwrite d9/da/fff [0,4194304] 0 2023-12-05T09:26:44.656 INFO:tasks.workunit.client.0.smithi067.stdout:3/998: chown d9/da/d15/d17/d1a/d51/d66/f105 462083 1 2023-12-05T09:26:44.657 INFO:tasks.workunit.client.0.smithi067.stdout:3/999: write d9/d62/f4c [5422877,130850] 0 2023-12-05T09:26:44.694 INFO:tasks.workunit.client.0.smithi067.stdout:5/974: dwrite db/df/d3f/dd9/de7/dfd/d1d/f114 [0,4194304] 0 2023-12-05T09:26:44.694 INFO:tasks.workunit.client.0.smithi067.stdout:4/946: dwrite d0/d9/f11b [0,4194304] 0 2023-12-05T09:26:44.694 INFO:tasks.workunit.client.0.smithi067.stdout:4/947: readlink d0/l87 0 2023-12-05T09:26:44.697 INFO:tasks.workunit.client.0.smithi067.stdout:5/975: mkdir db/df/d3f/d88/d140 0 2023-12-05T09:26:44.703 INFO:tasks.workunit.client.0.smithi067.stdout:4/948: rename d0/d1d/f58 to d0/d1d/d25/d38/f158 0 2023-12-05T09:26:44.703 INFO:tasks.workunit.client.0.smithi067.stdout:4/949: write d0/d1d/d2a/dba/f14a [853558,126696] 0 2023-12-05T09:26:44.703 INFO:tasks.workunit.client.0.smithi067.stdout:5/976: rename db/df/d3f/dd9/de7/dfd/l2b to db/df/d35/d63/d11f/l141 0 2023-12-05T09:26:44.704 INFO:tasks.workunit.client.0.smithi067.stdout:5/977: truncate db/df/d3f/dd9/de7/dfd/d1d/d20/fff 1111829 0 2023-12-05T09:26:44.706 INFO:tasks.workunit.client.0.smithi067.stdout:5/978: unlink db/df/d82/f8c 0 2023-12-05T09:26:44.706 INFO:tasks.workunit.client.0.smithi067.stdout:5/979: creat db/df/d3f/dd9/de7/dfd/d1d/f142 x:0 0 0 2023-12-05T09:26:44.706 INFO:tasks.workunit.client.0.smithi067.stdout:5/980: fdatasync db/df/d82/fb3 0 2023-12-05T09:26:44.710 INFO:tasks.workunit.client.0.smithi067.stdout:5/981: rename db/df/d36/f8a to db/df/f143 0 2023-12-05T09:26:44.710 INFO:tasks.workunit.client.0.smithi067.stdout:5/982: fsync db/df/d36/d57/fb7 0 2023-12-05T09:26:44.713 INFO:tasks.workunit.client.0.smithi067.stdout:5/983: unlink db/df/d82/c11c 0 2023-12-05T09:26:44.713 INFO:tasks.workunit.client.0.smithi067.stdout:5/984: fsync db/df/d82/f10d 0 2023-12-05T09:26:44.713 INFO:tasks.workunit.client.0.smithi067.stdout:5/985: write db/df/d3f/d88/d8d/fcc [1894519,59496] 0 2023-12-05T09:26:44.714 INFO:tasks.workunit.client.0.smithi067.stdout:5/986: rmdir db/df/ddb 39 2023-12-05T09:26:44.725 INFO:tasks.workunit.client.0.smithi067.stdout:5/987: rename db/df/d82/cf8 to db/df/d36/d6c/dc1/d131/c144 0 2023-12-05T09:26:44.726 INFO:tasks.workunit.client.0.smithi067.stdout:5/988: fdatasync db/df/d35/d63/faf 0 2023-12-05T09:26:44.791 INFO:tasks.workunit.client.0.smithi067.stdout:4/950: dwrite d0/d1d/d25/d12a/f6c [0,4194304] 0 2023-12-05T09:26:44.791 INFO:tasks.workunit.client.0.smithi067.stdout:5/989: dread db/df/f15 [0,4194304] 0 2023-12-05T09:26:44.791 INFO:tasks.workunit.client.0.smithi067.stdout:4/951: creat d0/d1d/d2a/dba/f159 x:0 0 0 2023-12-05T09:26:44.791 INFO:tasks.workunit.client.0.smithi067.stdout:4/952: fdatasync d0/d1d/d4d/d8d/fd3 0 2023-12-05T09:26:45.103 INFO:tasks.workunit.client.0.smithi067.stdout:1/998: sync 2023-12-05T09:26:45.105 INFO:tasks.workunit.client.0.smithi067.stdout:1/999: unlink d2/d4f/d15/l52 0 2023-12-05T09:26:45.333 INFO:tasks.workunit.client.0.smithi067.stdout:2/947: sync 2023-12-05T09:26:45.337 INFO:tasks.workunit.client.0.smithi067.stdout:2/948: truncate d0/fe 995073 0 2023-12-05T09:26:45.337 INFO:tasks.workunit.client.0.smithi067.stdout:2/949: write d0/d25/d34/d4d/d72/fea [905645,72212] 0 2023-12-05T09:26:45.339 INFO:tasks.workunit.client.0.smithi067.stdout:2/950: mkdir d0/d25/d34/d4d/d72/d122/d14b 0 2023-12-05T09:26:45.339 INFO:tasks.workunit.client.0.smithi067.stdout:2/951: write d0/d25/d9d/d53/d1e/d8e/dd0/d84/f12d [40297,126005] 0 2023-12-05T09:26:45.384 INFO:tasks.workunit.client.0.smithi067.stdout:4/953: sync 2023-12-05T09:26:45.385 INFO:tasks.workunit.client.0.smithi067.stdout:7/875: sync 2023-12-05T09:26:45.385 INFO:tasks.workunit.client.0.smithi067.stdout:5/990: sync 2023-12-05T09:26:45.385 INFO:tasks.workunit.client.0.smithi067.stdout:4/954: chown d0/d1d/d25/d12a/da8/da9/cea 424 1 2023-12-05T09:26:45.386 INFO:tasks.workunit.client.0.smithi067.stdout:5/991: rename db/df/ddb/l119 to db/df/ddb/l145 0 2023-12-05T09:26:45.388 INFO:tasks.workunit.client.0.smithi067.stdout:4/955: symlink d0/d1d/d24/l15a 0 2023-12-05T09:26:45.388 INFO:tasks.workunit.client.0.smithi067.stdout:7/876: symlink d0/d9/d56/de1/d111/d34/d67/d72/da9/dc3/de4/d106/l122 0 2023-12-05T09:26:45.389 INFO:tasks.workunit.client.0.smithi067.stdout:4/956: creat d0/d1d/d25/d38/f15b x:0 0 0 2023-12-05T09:26:45.390 INFO:tasks.workunit.client.0.smithi067.stdout:7/877: symlink d0/d9/d40/d7a/dde/l123 0 2023-12-05T09:26:45.395 INFO:tasks.workunit.client.0.smithi067.stdout:4/957: rename d0/d1d/d2a/fae to d0/d1d/d2a/df9/d129/f15c 0 2023-12-05T09:26:45.396 INFO:tasks.workunit.client.0.smithi067.stdout:7/878: creat d0/d9/d3f/d113/f124 x:0 0 0 2023-12-05T09:26:45.423 INFO:tasks.workunit.client.0.smithi067.stdout:5/992: dwrite db/df/f7e [0,4194304] 0 2023-12-05T09:26:45.425 INFO:tasks.workunit.client.0.smithi067.stdout:5/993: symlink db/df/d36/d6c/l146 0 2023-12-05T09:26:45.425 INFO:tasks.workunit.client.0.smithi067.stdout:5/994: fdatasync db/df/d35/dc8/fdf 0 2023-12-05T09:26:45.425 INFO:tasks.workunit.client.0.smithi067.stdout:5/995: fsync db/df/d3f/dd9/de7/dfd/d59/dae/fef 0 2023-12-05T09:26:45.426 INFO:tasks.workunit.client.0.smithi067.stdout:5/996: link db/df/d3f/ccf db/df/d36/d6c/c147 0 2023-12-05T09:26:45.427 INFO:tasks.workunit.client.0.smithi067.stdout:5/997: write db/df/d3f/dd9/de7/dfd/d1d/d20/f8f [411202,120589] 0 2023-12-05T09:26:45.427 INFO:tasks.workunit.client.0.smithi067.stdout:5/998: creat db/df/d35/dc8/f148 x:0 0 0 2023-12-05T09:26:45.427 INFO:tasks.workunit.client.0.smithi067.stdout:5/999: fsync db/df/d3f/d88/d8d/fcc 0 2023-12-05T09:26:45.463 INFO:tasks.workunit.client.0.smithi067.stdout:7/879: dwrite d0/d9/d40/d7a/fa3 [0,4194304] 0 2023-12-05T09:26:45.479 INFO:tasks.workunit.client.0.smithi067.stdout:4/958: dwrite d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/daa/f9d [0,4194304] 0 2023-12-05T09:26:45.480 INFO:tasks.workunit.client.0.smithi067.stdout:4/959: chown d0/d1d/d118 24218944 1 2023-12-05T09:26:45.481 INFO:tasks.workunit.client.0.smithi067.stdout:4/960: unlink d0/d1d/d25/d38/fbf 0 2023-12-05T09:26:45.481 INFO:tasks.workunit.client.0.smithi067.stdout:4/961: fsync d0/d1d/d2a/d72/f13d 0 2023-12-05T09:26:45.481 INFO:tasks.workunit.client.0.smithi067.stdout:4/962: dread - d0/f12e zero size 2023-12-05T09:26:45.481 INFO:tasks.workunit.client.0.smithi067.stdout:4/963: stat d0/d1d/d24/fc5 0 2023-12-05T09:26:45.481 INFO:tasks.workunit.client.0.smithi067.stdout:4/964: chown d0/d1d/d24/l15a 1 1 2023-12-05T09:26:45.481 INFO:tasks.workunit.client.0.smithi067.stdout:4/965: stat d0/d1d/d25/d12a/da8/da9/d15/dd0/dd9/de6/d104/l116 0 2023-12-05T09:26:45.482 INFO:tasks.workunit.client.0.smithi067.stdout:4/966: mknod d0/d1d/d25/d12a/da8/da9/d15/c15d 0 2023-12-05T09:26:45.557 INFO:tasks.workunit.client.0.smithi067.stdout:4/967: dwrite d0/d1d/d25/d12a/da8/de3/f14f [0,4194304] 0 2023-12-05T09:26:45.561 INFO:tasks.workunit.client.0.smithi067.stdout:4/968: rename d0/d1d/d25/d12a/da8/da9/d15/dd0/dd9/de6/d104 to d0/d1d/d25/d2c/db5/deb/d15e 0 2023-12-05T09:26:45.578 INFO:tasks.workunit.client.0.smithi067.stdout:4/969: dread d0/d1d/d4d/d8d/f155 [0,4194304] 0 2023-12-05T09:26:45.581 INFO:tasks.workunit.client.0.smithi067.stdout:4/970: rename d0/d1d/d25/d2c/db5/f105 to d0/f15f 0 2023-12-05T09:26:45.724 INFO:tasks.workunit.client.0.smithi067.stdout:2/952: sync 2023-12-05T09:26:45.724 INFO:tasks.workunit.client.0.smithi067.stdout:2/953: creat d0/d25/d34/d4d/d54/f14c x:0 0 0 2023-12-05T09:26:45.728 INFO:tasks.workunit.client.0.smithi067.stdout:2/954: creat d0/d25/d9d/d53/d1e/d8e/dc4/de2/f14d x:0 0 0 2023-12-05T09:26:45.730 INFO:tasks.workunit.client.0.smithi067.stdout:2/955: creat d0/d25/d34/d4d/f14e x:0 0 0 2023-12-05T09:26:45.741 INFO:tasks.workunit.client.0.smithi067.stdout:2/956: dread d0/d25/d9d/d53/d1e/d8e/dd0/d84/fa2 [0,4194304] 0 2023-12-05T09:26:45.757 INFO:tasks.workunit.client.0.smithi067.stdout:2/957: dread d0/d25/d9d/d53/d1e/f61 [0,4194304] 0 2023-12-05T09:26:45.757 INFO:tasks.workunit.client.0.smithi067.stdout:2/958: dread - d0/d25/d9d/d63/d88/f126 zero size 2023-12-05T09:26:45.757 INFO:tasks.workunit.client.0.smithi067.stdout:2/959: fsync d0/d25/d3f/f79 0 2023-12-05T09:26:45.956 INFO:tasks.workunit.client.0.smithi067.stdout:7/880: sync 2023-12-05T09:26:45.956 INFO:tasks.workunit.client.0.smithi067.stdout:7/881: stat d0/d9/d10/d37/lb5 0 2023-12-05T09:26:46.002 INFO:tasks.workunit.client.0.smithi067.stdout:7/882: dwrite d0/d9/f58 [0,4194304] 0 2023-12-05T09:26:46.002 INFO:tasks.workunit.client.0.smithi067.stdout:7/883: readlink d0/d9/d56/de1/d111/d34/ld2 0 2023-12-05T09:26:46.002 INFO:tasks.workunit.client.0.smithi067.stdout:7/884: stat d0/d9/d56/de1/d10e 0 2023-12-05T09:26:46.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/885: dread d0/d9/d40/fbc [8388608,4194304] 0 2023-12-05T09:26:46.017 INFO:tasks.workunit.client.0.smithi067.stdout:7/886: fsync d0/d9/d56/de1/d111/d34/d67/fc7 0 2023-12-05T09:26:46.224 INFO:tasks.workunit.client.0.smithi067.stdout:7/887: rename d0/d9/d40/d7a/de5 to d0/d9/d56/de1/d125 0 2023-12-05T09:26:46.225 INFO:tasks.workunit.client.0.smithi067.stdout:7/888: write d0/d9/d40/d7a/dad/fcd [897605,86739] 0 2023-12-05T09:26:46.225 INFO:tasks.workunit.client.0.smithi067.stdout:7/889: stat d0/d9/d56/de1/d111 0 2023-12-05T09:26:46.225 INFO:tasks.workunit.client.0.smithi067.stdout:7/890: read d0/d9/d40/d7a/fb3 [6921121,17608] 0 2023-12-05T09:26:46.227 INFO:tasks.workunit.client.0.smithi067.stdout:7/891: rename d0/d9/d10/d37/f28 to d0/d9/d10b/f126 0 2023-12-05T09:26:46.232 INFO:tasks.workunit.client.0.smithi067.stdout:7/892: rename d0/f27 to d0/d9/d56/de1/d111/d54/d112/f127 0 2023-12-05T09:26:46.233 INFO:tasks.workunit.client.0.smithi067.stdout:7/893: creat d0/d9/d10b/f128 x:0 0 0 2023-12-05T09:26:46.237 INFO:tasks.workunit.client.0.smithi067.stdout:7/894: creat d0/d9/d10/d37/d82/f129 x:0 0 0 2023-12-05T09:26:46.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/960: sync 2023-12-05T09:26:46.249 INFO:tasks.workunit.client.0.smithi067.stdout:4/971: sync 2023-12-05T09:26:46.249 INFO:tasks.workunit.client.0.smithi067.stdout:4/972: chown d0/d1d/c31 172712574 1 2023-12-05T09:26:46.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/961: chown d0/d25/d34/d4d/db0/dce/cf2 3 1 2023-12-05T09:26:46.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/962: readlink d0/d25/d9d/d53/d1e/d8e/dd0/d39/lbc 0 2023-12-05T09:26:46.249 INFO:tasks.workunit.client.0.smithi067.stdout:4/973: dread - d0/d1d/d2b/f69 zero size 2023-12-05T09:26:46.249 INFO:tasks.workunit.client.0.smithi067.stdout:2/963: fdatasync d0/d25/d9d/f76 0 2023-12-05T09:26:46.281 INFO:tasks.workunit.client.0.smithi067.stdout:2/964: write d0/d25/d34/d4d/d78/fd7 [3356305,120587] 0 2023-12-05T09:26:46.300 INFO:tasks.workunit.client.0.smithi067.stdout:7/895: dwrite d0/d9/f10a [0,4194304] 0 2023-12-05T09:26:46.300 INFO:tasks.workunit.client.0.smithi067.stdout:7/896: write d0/d9/d40/d7a/dad/fcd [1530774,46884] 0 2023-12-05T09:26:46.301 INFO:tasks.workunit.client.0.smithi067.stdout:7/897: write d0/d9/d56/d8e/f9f [269906,67086] 0 2023-12-05T09:26:46.311 INFO:tasks.workunit.client.0.smithi067.stdout:4/974: dwrite d0/d1d/d2b/ffe [0,4194304] 0 2023-12-05T09:26:46.353 INFO:tasks.workunit.client.0.smithi067.stdout:2/965: unlink d0/d25/d34/d4d/d54/fe3 0 2023-12-05T09:26:46.353 INFO:tasks.workunit.client.0.smithi067.stdout:4/975: read d0/d1d/f143 [3380001,51594] 0 2023-12-05T09:26:46.364 INFO:tasks.workunit.client.0.smithi067.stdout:2/966: dread d0/d25/d34/d4d/db0/f124 [0,4194304] 0 2023-12-05T09:26:46.364 INFO:tasks.workunit.client.0.smithi067.stdout:2/967: creat d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/f14f x:0 0 0 2023-12-05T09:26:46.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:46 smithi067 ceph-mon[107174]: pgmap v38: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 122 MiB/s rd, 151 MiB/s wr, 250 op/s 2023-12-05T09:26:46.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:46 smithi067 ceph-mon[107174]: Upgrade: Updating mgr.smithi067.alxtvv 2023-12-05T09:26:46.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:46 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:46.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:46 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.alxtvv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:26:46.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:46 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.alxtvv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:26:46.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:46 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:26:46.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:46 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:26:46.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:46 smithi067 ceph-mon[107174]: Deploying daemon mgr.smithi067.alxtvv on smithi067 2023-12-05T09:26:46.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/968: unlink d0/d25/d9d/d53/d1e/d8e/dd0/d84/fa2 0 2023-12-05T09:26:46.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/969: chown d0/d25/d9d/d53/d1e/c31 3342 1 2023-12-05T09:26:46.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/970: read d0/d25/d34/d4d/d78/fd7 [1450363,129611] 0 2023-12-05T09:26:46.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/971: creat d0/d7c/f150 x:0 0 0 2023-12-05T09:26:46.374 INFO:tasks.workunit.client.0.smithi067.stdout:2/972: fsync d0/f7a 0 2023-12-05T09:26:46.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:46 smithi134 ceph-mon[116304]: pgmap v38: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 122 MiB/s rd, 151 MiB/s wr, 250 op/s 2023-12-05T09:26:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:46 smithi134 ceph-mon[116304]: Upgrade: Updating mgr.smithi067.alxtvv 2023-12-05T09:26:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:46 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:46 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.alxtvv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:26:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:46 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.alxtvv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:26:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:46 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:26:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:46 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:26:46.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:46 smithi134 ceph-mon[116304]: Deploying daemon mgr.smithi067.alxtvv on smithi067 2023-12-05T09:26:46.379 INFO:tasks.workunit.client.0.smithi067.stdout:7/898: dwrite d0/d9/d56/de1/d111/d34/d67/d72/da9/fe2 [0,4194304] 0 2023-12-05T09:26:46.402 INFO:tasks.workunit.client.0.smithi067.stdout:7/899: write d0/d9/f5f [13207,24225] 0 2023-12-05T09:26:46.402 INFO:tasks.workunit.client.0.smithi067.stdout:4/976: dwrite d0/d1d/d4d/d8d/fda [0,4194304] 0 2023-12-05T09:26:46.423 INFO:tasks.workunit.client.0.smithi067.stdout:4/977: dread d0/d1d/d2a/dba/fc8 [0,4194304] 0 2023-12-05T09:26:46.435 INFO:tasks.workunit.client.0.smithi067.stdout:4/978: dread d0/d1d/d2a/d93/ddc/fdf [0,4194304] 0 2023-12-05T09:26:46.441 INFO:tasks.workunit.client.0.smithi067.stdout:4/979: write d0/d1d/d25/d12a/da8/da9/d15/d11c/f5e [907100,16741] 0 2023-12-05T09:26:46.448 INFO:tasks.workunit.client.0.smithi067.stdout:2/973: dwrite d0/d25/d34/d4d/d54/d90/dcf/ff4 [0,4194304] 0 2023-12-05T09:26:46.454 INFO:tasks.workunit.client.0.smithi067.stdout:7/900: mknod d0/d121/c12a 0 2023-12-05T09:26:46.458 INFO:tasks.workunit.client.0.smithi067.stdout:4/980: rename d0/d1d/d2a/f7e to d0/d1d/d25/f160 0 2023-12-05T09:26:46.459 INFO:tasks.workunit.client.0.smithi067.stdout:2/974: mkdir d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/d151 0 2023-12-05T09:26:46.461 INFO:tasks.workunit.client.0.smithi067.stdout:4/981: rmdir d0/d1d/d2a/df9 39 2023-12-05T09:26:46.479 INFO:tasks.workunit.client.0.smithi067.stdout:7/901: write d0/f4c [1310678,14738] 0 2023-12-05T09:26:46.479 INFO:tasks.workunit.client.0.smithi067.stdout:7/902: creat d0/dd4/f12b x:0 0 0 2023-12-05T09:26:46.510 INFO:tasks.workunit.client.0.smithi067.stdout:7/903: truncate d0/d9/d10b/f126 7425577 0 2023-12-05T09:26:46.517 INFO:tasks.workunit.client.0.smithi067.stdout:4/982: dwrite d0/d1d/d25/d32/f12c [0,4194304] 0 2023-12-05T09:26:46.517 INFO:tasks.workunit.client.0.smithi067.stdout:7/904: rename d0/d9/d56/de1/d111/d34/d67/d72/da9/dd1 to d0/d9/d56/df2/d114/d12c 0 2023-12-05T09:26:46.521 INFO:tasks.workunit.client.0.smithi067.stdout:2/975: unlink d0/d25/d34/d4d/d78/le6 0 2023-12-05T09:26:46.521 INFO:tasks.workunit.client.0.smithi067.stdout:4/983: getdents d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/daf 0 2023-12-05T09:26:46.525 INFO:tasks.workunit.client.0.smithi067.stdout:2/976: mkdir d0/d25/d9d/d53/d1e/d7f/d152 0 2023-12-05T09:26:46.527 INFO:tasks.workunit.client.0.smithi067.stdout:4/984: mkdir d0/d1d/d25/d12a/da8/da9/d15/dd0/dd9/de6/d161 0 2023-12-05T09:26:46.528 INFO:tasks.workunit.client.0.smithi067.stdout:4/985: fdatasync d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/fb3 0 2023-12-05T09:26:46.531 INFO:tasks.workunit.client.0.smithi067.stdout:4/986: rename d0/d9/f6b to d0/d1d/d25/d2c/d13a/d148/f162 0 2023-12-05T09:26:46.532 INFO:tasks.workunit.client.0.smithi067.stdout:7/905: read d0/d9/d40/fbc [4233650,19923] 0 2023-12-05T09:26:46.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/987: rename d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/daf/l147 to d0/d1d/d25/d2c/l163 0 2023-12-05T09:26:46.539 INFO:tasks.workunit.client.0.smithi067.stdout:4/988: truncate d0/d1d/d4d/f102 201620 0 2023-12-05T09:26:46.543 INFO:tasks.workunit.client.0.smithi067.stdout:2/977: dread d0/d25/d3a/fdc [0,4194304] 0 2023-12-05T09:26:46.545 INFO:tasks.workunit.client.0.smithi067.stdout:2/978: mkdir d0/d25/d3f/d83/d133/d153 0 2023-12-05T09:26:46.547 INFO:tasks.workunit.client.0.smithi067.stdout:2/979: symlink d0/d25/d9d/d53/d1e/d8e/dd0/d84/d11a/l154 0 2023-12-05T09:26:46.580 INFO:tasks.workunit.client.0.smithi067.stdout:2/980: write d0/d25/d9d/d53/f1d [1987871,51407] 0 2023-12-05T09:26:46.588 INFO:tasks.workunit.client.0.smithi067.stdout:4/989: write d0/d1d/d25/d32/f3f [4126852,100943] 0 2023-12-05T09:26:46.588 INFO:tasks.workunit.client.0.smithi067.stdout:4/990: fdatasync d0/d1d/d25/d12a/da8/da9/d15/d11c/d4e/d5a/fb3 0 2023-12-05T09:26:46.589 INFO:tasks.workunit.client.0.smithi067.stdout:4/991: rmdir d0/d1d/d4d/d8d 39 2023-12-05T09:26:46.591 INFO:tasks.workunit.client.0.smithi067.stdout:4/992: rename d0/d1d/d25/d12a/da8/da9/d15/l3d to d0/d1d/d25/d2c/d13a/l164 0 2023-12-05T09:26:46.592 INFO:tasks.workunit.client.0.smithi067.stdout:7/906: dwrite d0/d9/d40/d7a/f87 [0,4194304] 0 2023-12-05T09:26:46.592 INFO:tasks.workunit.client.0.smithi067.stdout:4/993: mkdir d0/d9/d165 0 2023-12-05T09:26:46.592 INFO:tasks.workunit.client.0.smithi067.stdout:4/994: truncate d0/d1d/d4d/d8d/fd3 5659278 0 2023-12-05T09:26:46.593 INFO:tasks.workunit.client.0.smithi067.stdout:7/907: mknod d0/d9/d10/d37/c12d 0 2023-12-05T09:26:46.593 INFO:tasks.workunit.client.0.smithi067.stdout:7/908: stat d0/d9/d56/de1/d111 0 2023-12-05T09:26:46.593 INFO:tasks.workunit.client.0.smithi067.stdout:7/909: write d0/d9/d56/dc4/dfe/f103 [1933254,14342] 0 2023-12-05T09:26:46.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/910: dread d0/d9/d56/d8e/f9f [0,4194304] 0 2023-12-05T09:26:46.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/911: fsync d0/dd4/f12b 0 2023-12-05T09:26:46.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/912: stat d0/d9/d56/de1/d125 0 2023-12-05T09:26:46.639 INFO:tasks.workunit.client.0.smithi067.stdout:7/913: symlink d0/d9/d10/d37/l12e 0 2023-12-05T09:26:46.640 INFO:tasks.workunit.client.0.smithi067.stdout:7/914: creat d0/d9/d56/df2/d114/f12f x:0 0 0 2023-12-05T09:26:46.656 INFO:tasks.workunit.client.0.smithi067.stdout:7/915: write d0/d9/d10/d37/d82/f9b [3100904,118198] 0 2023-12-05T09:26:46.657 INFO:tasks.workunit.client.0.smithi067.stdout:7/916: truncate d0/d9/d10/d1d/fe8 808833 0 2023-12-05T09:26:46.657 INFO:tasks.workunit.client.0.smithi067.stdout:2/981: dwrite d0/d25/d9d/d53/d1e/d8e/dd0/d84/dec/f11b [0,4194304] 0 2023-12-05T09:26:46.658 INFO:tasks.workunit.client.0.smithi067.stdout:4/995: dwrite d0/d1d/d25/d32/f8f [0,4194304] 0 2023-12-05T09:26:46.658 INFO:tasks.workunit.client.0.smithi067.stdout:4/996: fdatasync d0/d1d/d24/f7f 0 2023-12-05T09:26:46.658 INFO:tasks.workunit.client.0.smithi067.stdout:4/997: chown d0/d1d/f21 709 1 2023-12-05T09:26:46.658 INFO:tasks.workunit.client.0.smithi067.stdout:4/998: creat d0/d1d/d118/f166 x:0 0 0 2023-12-05T09:26:46.659 INFO:tasks.workunit.client.0.smithi067.stdout:7/917: rename d0/d9/d56/d8e/daa to d0/d9/d130 0 2023-12-05T09:26:46.659 INFO:tasks.workunit.client.0.smithi067.stdout:7/918: read d0/d9/d56/de1/d111/d34/d67/d72/da9/ffa [7592709,103176] 0 2023-12-05T09:26:46.663 INFO:tasks.workunit.client.0.smithi067.stdout:2/982: link d0/d25/d9d/d53/d1e/d8e/dd0/faf d0/d25/d34/d4d/f155 0 2023-12-05T09:26:46.663 INFO:tasks.workunit.client.0.smithi067.stdout:2/983: stat d0/d25/d9d/c5c 0 2023-12-05T09:26:46.665 INFO:tasks.workunit.client.0.smithi067.stdout:4/999: link d0/d1d/d25/d12a/d62/f83 d0/d1d/d25/d2c/d13a/d148/d152/f167 0 2023-12-05T09:26:46.667 INFO:tasks.workunit.client.0.smithi067.stdout:2/984: mknod d0/d25/d9d/d53/d1e/d8e/dd0/d39/c156 0 2023-12-05T09:26:46.671 INFO:tasks.workunit.client.0.smithi067.stdout:2/985: creat d0/d25/d34/d4d/d54/f157 x:0 0 0 2023-12-05T09:26:46.681 INFO:tasks.workunit.client.0.smithi067.stdout:7/919: dread d0/d9/d10/f35 [0,4194304] 0 2023-12-05T09:26:46.699 INFO:tasks.workunit.client.0.smithi067.stdout:7/920: dread d0/d9/f6f [0,4194304] 0 2023-12-05T09:26:46.699 INFO:tasks.workunit.client.0.smithi067.stdout:7/921: read d0/d9/d10/d37/d38/f51 [2983111,127413] 0 2023-12-05T09:26:46.701 INFO:tasks.workunit.client.0.smithi067.stdout:7/922: creat d0/d9/d56/de1/d111/d9c/f131 x:0 0 0 2023-12-05T09:26:46.703 INFO:tasks.workunit.client.0.smithi067.stdout:7/923: symlink d0/d9/d56/l132 0 2023-12-05T09:26:46.721 INFO:tasks.workunit.client.0.smithi067.stdout:7/924: dread d0/d45/ff3 [0,4194304] 0 2023-12-05T09:26:46.721 INFO:tasks.workunit.client.0.smithi067.stdout:7/925: chown d0/d9/d56 0 1 2023-12-05T09:26:46.722 INFO:tasks.workunit.client.0.smithi067.stdout:7/926: creat d0/d9/d56/de1/d125/f133 x:0 0 0 2023-12-05T09:26:46.759 INFO:tasks.workunit.client.0.smithi067.stdout:7/927: dwrite d0/d9/f58 [0,4194304] 0 2023-12-05T09:26:46.760 INFO:tasks.workunit.client.0.smithi067.stdout:7/928: symlink d0/d9/d56/de1/d111/d9c/l134 0 2023-12-05T09:26:46.760 INFO:tasks.workunit.client.0.smithi067.stdout:7/929: write d0/d9/d56/df2/d114/d12c/fd5 [1029101,54022] 0 2023-12-05T09:26:46.763 INFO:tasks.workunit.client.0.smithi067.stdout:7/930: rename d0/d121/c12a to d0/d9/d56/c135 0 2023-12-05T09:26:46.764 INFO:tasks.workunit.client.0.smithi067.stdout:7/931: rmdir d0/d9/d56 39 2023-12-05T09:26:46.765 INFO:tasks.workunit.client.0.smithi067.stdout:7/932: mknod d0/d9/d10/c136 0 2023-12-05T09:26:46.780 INFO:tasks.workunit.client.0.smithi067.stdout:7/933: write d0/d9/d56/de1/d111/d34/d67/d72/da9/ffa [706963,13741] 0 2023-12-05T09:26:46.780 INFO:tasks.workunit.client.0.smithi067.stdout:7/934: chown d0/d9/lc1 4 1 2023-12-05T09:26:46.795 INFO:tasks.workunit.client.0.smithi067.stdout:7/935: write d0/d9/d10/f44 [7103589,1906] 0 2023-12-05T09:26:46.798 INFO:tasks.workunit.client.0.smithi067.stdout:7/936: write d0/d9/d56/de1/d111/d34/ff7 [151801,16491] 0 2023-12-05T09:26:46.846 INFO:tasks.workunit.client.0.smithi067.stdout:7/937: dwrite d0/d9/d56/de1/d111/d34/f36 [0,4194304] 0 2023-12-05T09:26:46.849 INFO:tasks.workunit.client.0.smithi067.stdout:7/938: write d0/d9/d10/d1d/f1f [4731522,90540] 0 2023-12-05T09:26:46.850 INFO:tasks.workunit.client.0.smithi067.stdout:7/939: creat d0/d9/d56/df2/d114/d12c/f137 x:0 0 0 2023-12-05T09:26:46.850 INFO:tasks.workunit.client.0.smithi067.stdout:7/940: readlink d0/d9/d56/l84 0 2023-12-05T09:26:46.885 INFO:tasks.workunit.client.0.smithi067.stdout:7/941: dwrite d0/d9/d56/de1/d111/d34/fa6 [0,4194304] 0 2023-12-05T09:26:46.901 INFO:tasks.workunit.client.0.smithi067.stdout:7/942: write d0/d9/d3f/fff [344966,121530] 0 2023-12-05T09:26:46.903 INFO:tasks.workunit.client.0.smithi067.stdout:7/943: creat d0/d9/d10/d37/d38/f138 x:0 0 0 2023-12-05T09:26:46.903 INFO:tasks.workunit.client.0.smithi067.stdout:7/944: write d0/d9/d56/de1/d111/d54/f5e [4676933,94160] 0 2023-12-05T09:26:46.903 INFO:tasks.workunit.client.0.smithi067.stdout:7/945: chown d0/d45/f80 25266 1 2023-12-05T09:26:46.911 INFO:tasks.workunit.client.0.smithi067.stdout:7/946: read d0/d9/d56/dc4/dfe/f103 [1413245,70682] 0 2023-12-05T09:26:46.926 INFO:tasks.workunit.client.0.smithi067.stdout:7/947: dread d0/d9/d3f/dbd/fce [0,4194304] 0 2023-12-05T09:26:46.972 INFO:tasks.workunit.client.0.smithi067.stdout:7/948: dwrite d0/d9/d10b/f128 [0,4194304] 0 2023-12-05T09:26:46.974 INFO:tasks.workunit.client.0.smithi067.stdout:7/949: rename d0/f120 to d0/d9/f139 0 2023-12-05T09:26:46.974 INFO:tasks.workunit.client.0.smithi067.stdout:7/950: fsync d0/d9/d3f/d113/f124 0 2023-12-05T09:26:47.014 INFO:tasks.workunit.client.0.smithi067.stdout:7/951: dwrite d0/fbf [0,4194304] 0 2023-12-05T09:26:47.025 INFO:tasks.workunit.client.0.smithi067.stdout:7/952: dread d0/d9/d10/f35 [0,4194304] 0 2023-12-05T09:26:47.025 INFO:tasks.workunit.client.0.smithi067.stdout:7/953: stat d0/d9/d10/d1d 0 2023-12-05T09:26:47.026 INFO:tasks.workunit.client.0.smithi067.stdout:7/954: rmdir d0/d45 39 2023-12-05T09:26:47.026 INFO:tasks.workunit.client.0.smithi067.stdout:7/955: getdents d0/d9/d56/de1/d111/d34/d67/d72/da9/dc3 0 2023-12-05T09:26:47.028 INFO:tasks.workunit.client.0.smithi067.stdout:7/956: link d0/d9/d10b/f128 d0/d9/d56/de1/d11d/f13a 0 2023-12-05T09:26:47.028 INFO:tasks.workunit.client.0.smithi067.stdout:7/957: chown d0/d9/d56/de1/d111/d34/d67/d72/da4/fef 498482298 1 2023-12-05T09:26:47.028 INFO:tasks.workunit.client.0.smithi067.stdout:7/958: truncate d0/d9/d56/de1/d111/d5a/f99 767227 0 2023-12-05T09:26:47.030 INFO:tasks.workunit.client.0.smithi067.stdout:7/959: creat d0/d9/d56/de1/d11d/f13b x:0 0 0 2023-12-05T09:26:47.033 INFO:tasks.workunit.client.0.smithi067.stdout:7/960: unlink d0/d9/d40/d7a/dad/dc2/l74 0 2023-12-05T09:26:47.110 INFO:tasks.workunit.client.0.smithi067.stdout:7/961: dwrite d0/d9/d56/de1/d111/d34/d67/d72/da9/fe2 [0,4194304] 0 2023-12-05T09:26:47.145 INFO:tasks.workunit.client.0.smithi067.stdout:7/962: dwrite d0/d9/d56/de1/d11d/f13b [0,4194304] 0 2023-12-05T09:26:47.705 INFO:tasks.workunit.client.0.smithi067.stdout:2/986: sync 2023-12-05T09:26:47.705 INFO:tasks.workunit.client.0.smithi067.stdout:2/987: creat d0/d25/d3f/d83/f158 x:0 0 0 2023-12-05T09:26:47.778 INFO:tasks.workunit.client.0.smithi067.stdout:2/988: dwrite d0/d25/d9d/d53/d1e/d8e/dd0/f37 [0,4194304] 0 2023-12-05T09:26:47.779 INFO:tasks.workunit.client.0.smithi067.stdout:2/989: chown d0/d25/d48/c138 1 1 2023-12-05T09:26:47.782 INFO:tasks.workunit.client.0.smithi067.stdout:2/990: rename d0/d25/d9d/d53/l71 to d0/d25/d9d/d53/d1e/d8e/dd0/d84/de8/l159 0 2023-12-05T09:26:47.785 INFO:tasks.workunit.client.0.smithi067.stdout:2/991: rename d0/d25/d9d/d53/d1e/d8e/l10c to d0/d25/d34/d12b/l15a 0 2023-12-05T09:26:47.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/992: mknod d0/d147/c15b 0 2023-12-05T09:26:47.786 INFO:tasks.workunit.client.0.smithi067.stdout:2/993: write d0/d25/d3f/f79 [721284,14629] 0 2023-12-05T09:26:47.788 INFO:tasks.workunit.client.0.smithi067.stdout:2/994: write d0/d25/d34/d4d/db0/dce/ff6 [4229545,14100] 0 2023-12-05T09:26:47.793 INFO:tasks.workunit.client.0.smithi067.stdout:2/995: dread d0/d25/d34/d4d/db0/dbf/fe1 [0,4194304] 0 2023-12-05T09:26:47.793 INFO:tasks.workunit.client.0.smithi067.stdout:2/996: creat d0/d25/d3f/d83/f15c x:0 0 0 2023-12-05T09:26:47.806 INFO:tasks.workunit.client.0.smithi067.stdout:2/997: dread d0/fe [0,4194304] 0 2023-12-05T09:26:47.809 INFO:tasks.workunit.client.0.smithi067.stdout:2/998: mknod d0/d25/d34/d4d/db0/dbf/c15d 0 2023-12-05T09:26:47.809 INFO:tasks.workunit.client.0.smithi067.stdout:2/999: fsync d0/d25/d34/d4d/d72/fea 0 2023-12-05T09:26:47.817 INFO:tasks.workunit.client.0.smithi067.stdout:7/963: sync 2023-12-05T09:26:47.861 INFO:tasks.workunit.client.0.smithi067.stdout:7/964: dwrite d0/d9/d40/f97 [0,4194304] 0 2023-12-05T09:26:47.903 INFO:tasks.workunit.client.0.smithi067.stdout:7/965: dwrite d0/d9/d40/d7a/f87 [0,4194304] 0 2023-12-05T09:26:47.907 INFO:tasks.workunit.client.0.smithi067.stdout:7/966: mknod d0/d9/d56/de1/d10e/d11a/c13c 0 2023-12-05T09:26:47.978 INFO:tasks.workunit.client.0.smithi067.stdout:7/967: dwrite d0/d9/d56/df2/d114/d12c/f137 [0,4194304] 0 2023-12-05T09:26:48.160 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:48 smithi067 ceph-mon[107174]: pgmap v39: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 153 MiB/s rd, 191 MiB/s wr, 360 op/s 2023-12-05T09:26:48.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:48 smithi134 ceph-mon[116304]: pgmap v39: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 153 MiB/s rd, 191 MiB/s wr, 360 op/s 2023-12-05T09:26:48.412 INFO:tasks.workunit.client.0.smithi067.stdout:7/968: sync 2023-12-05T09:26:48.421 INFO:tasks.workunit.client.0.smithi067.stdout:7/969: dread d0/d9/d56/d8e/f9f [0,4194304] 0 2023-12-05T09:26:48.423 INFO:tasks.workunit.client.0.smithi067.stdout:7/970: truncate d0/d9/d10/d1d/fe8 927874 0 2023-12-05T09:26:48.423 INFO:tasks.workunit.client.0.smithi067.stdout:7/971: read - d0/d9/d56/df2/d114/f12f zero size 2023-12-05T09:26:48.443 INFO:tasks.workunit.client.0.smithi067.stdout:7/972: dread d0/d9/d56/de1/d11d/f13b [0,4194304] 0 2023-12-05T09:26:48.443 INFO:tasks.workunit.client.0.smithi067.stdout:7/973: chown d0/d9/d56/de1/d111/d34/d67/c78 21489 1 2023-12-05T09:26:48.444 INFO:tasks.workunit.client.0.smithi067.stdout:7/974: creat d0/d9/d40/d7a/f13d x:0 0 0 2023-12-05T09:26:48.484 INFO:tasks.workunit.client.0.smithi067.stdout:7/975: dwrite d0/d9/d56/ff1 [4194304,4194304] 0 2023-12-05T09:26:48.485 INFO:tasks.workunit.client.0.smithi067.stdout:7/976: mkdir d0/d9/d56/de1/d111/d54/d112/d13e 0 2023-12-05T09:26:48.486 INFO:tasks.workunit.client.0.smithi067.stdout:7/977: mknod d0/d9/d56/df2/c13f 0 2023-12-05T09:26:48.487 INFO:tasks.workunit.client.0.smithi067.stdout:7/978: symlink d0/d9/d56/de1/d111/d34/d67/d72/da4/l140 0 2023-12-05T09:26:48.500 INFO:tasks.workunit.client.0.smithi067.stdout:7/979: dread d0/d9/d56/de1/d11d/f13a [0,4194304] 0 2023-12-05T09:26:48.500 INFO:tasks.workunit.client.0.smithi067.stdout:7/980: fsync d0/d9/d56/df2/d114/d12c/fd5 0 2023-12-05T09:26:48.501 INFO:tasks.workunit.client.0.smithi067.stdout:7/981: creat d0/d9/d56/de1/d111/d34/d67/f141 x:0 0 0 2023-12-05T09:26:48.501 INFO:tasks.workunit.client.0.smithi067.stdout:7/982: mkdir d0/d142 0 2023-12-05T09:26:48.571 INFO:tasks.workunit.client.0.smithi067.stdout:7/983: dwrite d0/d9/d56/d8e/f10d [0,4194304] 0 2023-12-05T09:26:48.574 INFO:tasks.workunit.client.0.smithi067.stdout:7/984: symlink d0/d9/d10/l143 0 2023-12-05T09:26:48.574 INFO:tasks.workunit.client.0.smithi067.stdout:7/985: chown d0/d9/d56/de1/d111/d5a/fa2 0 1 2023-12-05T09:26:48.575 INFO:tasks.workunit.client.0.smithi067.stdout:7/986: rmdir d0 39 2023-12-05T09:26:48.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/987: mknod d0/d9/d56/de1/d111/d34/d8c/c144 0 2023-12-05T09:26:48.579 INFO:tasks.workunit.client.0.smithi067.stdout:7/988: read d0/d9/d10b/f126 [3918424,108097] 0 2023-12-05T09:26:48.960 INFO:tasks.workunit.client.0.smithi067.stdout:7/989: sync 2023-12-05T09:26:48.960 INFO:tasks.workunit.client.0.smithi067.stdout:7/990: readlink d0/d45/l8b 0 2023-12-05T09:26:48.960 INFO:tasks.workunit.client.0.smithi067.stdout:7/991: write d0/d9/d10/d37/d38/f109 [432331,27710] 0 2023-12-05T09:26:48.980 INFO:tasks.workunit.client.0.smithi067.stdout:7/992: dread d0/d9/d40/fbc [0,4194304] 0 2023-12-05T09:26:48.980 INFO:tasks.workunit.client.0.smithi067.stdout:7/993: stat d0/d9/d56/de1/d111/d9c/c118 0 2023-12-05T09:26:49.075 INFO:tasks.workunit.client.0.smithi067.stdout:7/994: dwrite d0/d9/d40/f77 [0,4194304] 0 2023-12-05T09:26:49.078 INFO:tasks.workunit.client.0.smithi067.stdout:7/995: creat d0/d9/d10/d37/f145 x:0 0 0 2023-12-05T09:26:49.079 INFO:tasks.workunit.client.0.smithi067.stdout:7/996: mknod d0/d9/d56/de1/d111/d54/d112/d13e/c146 0 2023-12-05T09:26:49.080 INFO:tasks.workunit.client.0.smithi067.stdout:7/997: write d0/d9/d10/d1d/f115 [970877,45029] 0 2023-12-05T09:26:49.082 INFO:tasks.workunit.client.0.smithi067.stdout:7/998: creat d0/d9/d130/f147 x:0 0 0 2023-12-05T09:26:49.082 INFO:tasks.workunit.client.0.smithi067.stdout:7/999: chown d0/d9/d56/de1/d111/d34 8284 1 2023-12-05T09:26:49.090 INFO:tasks.workunit.client.0.smithi067.stderr:+ rm -rf -- ./tmp.ORNZR6WClK 2023-12-05T09:26:50.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:50 smithi067 ceph-mon[107174]: pgmap v40: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 87 MiB/s rd, 101 MiB/s wr, 229 op/s 2023-12-05T09:26:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:50 smithi134 ceph-mon[116304]: pgmap v40: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 87 MiB/s rd, 101 MiB/s wr, 229 op/s 2023-12-05T09:26:51.223 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:51 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:26:51.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:51 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:26:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:52 smithi067 ceph-mon[107174]: pgmap v41: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 87 MiB/s rd, 101 MiB/s wr, 229 op/s 2023-12-05T09:26:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:52 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:52 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:52.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:52 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:26:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:52 smithi134 ceph-mon[116304]: pgmap v41: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 87 MiB/s rd, 101 MiB/s wr, 229 op/s 2023-12-05T09:26:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:52 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:52 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:52 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:26:54.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:54 smithi067 ceph-mon[107174]: pgmap v42: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 93 MiB/s rd, 109 MiB/s wr, 309 op/s 2023-12-05T09:26:54.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:54 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:54.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:54 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:54.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:54 smithi134 ceph-mon[116304]: pgmap v42: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 93 MiB/s rd, 109 MiB/s wr, 309 op/s 2023-12-05T09:26:54.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:54 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:54.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:54 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:55.741 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-05T09:26:55.742 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-05T09:26:56.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:56 smithi067 ceph-mon[107174]: pgmap v43: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 37 MiB/s rd, 48 MiB/s wr, 190 op/s 2023-12-05T09:26:56.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:56 smithi134 ceph-mon[116304]: pgmap v43: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 37 MiB/s rd, 48 MiB/s wr, 190 op/s 2023-12-05T09:26:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:58 smithi067 ceph-mon[107174]: pgmap v44: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 37 MiB/s rd, 48 MiB/s wr, 263 op/s 2023-12-05T09:26:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:58 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:58.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:26:58 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:58.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:58 smithi134 ceph-mon[116304]: pgmap v44: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 37 MiB/s rd, 48 MiB/s wr, 263 op/s 2023-12-05T09:26:58.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:58 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:26:58.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:26:58 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:00.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:00 smithi067 ceph-mon[107174]: pgmap v45: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 6.4 MiB/s rd, 8.5 MiB/s wr, 153 op/s 2023-12-05T09:27:00.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:00 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:00.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:00 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:00.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:00 smithi134 ceph-mon[116304]: pgmap v45: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 6.4 MiB/s rd, 8.5 MiB/s wr, 153 op/s 2023-12-05T09:27:00.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:00 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:00.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:00 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:02.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:02 smithi067 ceph-mon[107174]: pgmap v46: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 6.4 MiB/s rd, 8.5 MiB/s wr, 153 op/s 2023-12-05T09:27:02.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:02 smithi134 ceph-mon[116304]: pgmap v46: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 6.4 MiB/s rd, 8.5 MiB/s wr, 153 op/s 2023-12-05T09:27:03.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.118+0000 7f9765178700 1 -- 172.21.15.67:0/473452519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97600fbaf0 msgr2=0x7f97600fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:03.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.118+0000 7f9765178700 1 --2- 172.21.15.67:0/473452519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97600fbaf0 0x7f97600fbf00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9758009ce0 tx=0x7f9758004d10 comp rx=0 tx=0).stop 2023-12-05T09:27:03.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.118+0000 7f9765178700 1 -- 172.21.15.67:0/473452519 shutdown_connections 2023-12-05T09:27:03.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.118+0000 7f9765178700 1 --2- 172.21.15.67:0/473452519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97600fcd00 0x7f97600fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.118+0000 7f9765178700 1 --2- 172.21.15.67:0/473452519 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97600fbaf0 0x7f97600fbf00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.118+0000 7f9765178700 1 -- 172.21.15.67:0/473452519 >> 172.21.15.67:0/473452519 conn(0x7f97600f7190 msgr2=0x7f97600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:03.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.120+0000 7f9765178700 1 -- 172.21.15.67:0/473452519 shutdown_connections 2023-12-05T09:27:03.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.120+0000 7f9765178700 1 -- 172.21.15.67:0/473452519 wait complete. 2023-12-05T09:27:03.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.121+0000 7f9765178700 1 Processor -- start 2023-12-05T09:27:03.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.123+0000 7f9765178700 1 -- start start 2023-12-05T09:27:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.123+0000 7f9765178700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97600fbaf0 0x7f976010d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.123+0000 7f9765178700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97600fcd00 0x7f976010dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.123+0000 7f9765178700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976010e280 con 0x7f97600fbaf0 2023-12-05T09:27:03.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.123+0000 7f9765178700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976010eb20 con 0x7f97600fcd00 2023-12-05T09:27:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.124+0000 7f975e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97600fcd00 0x7f976010dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.125+0000 7f975e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97600fcd00 0x7f976010dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:50620/0 (socket says 172.21.15.67:50620) 2023-12-05T09:27:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.125+0000 7f975e59c700 1 -- 172.21.15.67:0/3927672992 learned_addr learned my addr 172.21.15.67:0/3927672992 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:03.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.125+0000 7f975ed9d700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97600fbaf0 0x7f976010d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.126+0000 7f975e59c700 1 -- 172.21.15.67:0/3927672992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97600fbaf0 msgr2=0x7f976010d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.126+0000 7f975e59c700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97600fbaf0 0x7f976010d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.126 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.126+0000 7f975e59c700 1 -- 172.21.15.67:0/3927672992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758009940 con 0x7f97600fcd00 2023-12-05T09:27:03.127 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.127+0000 7f975e59c700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97600fcd00 0x7f976010dc80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9750002a50 tx=0x7f97500046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:03.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.127+0000 7f97477fe700 1 -- 172.21.15.67:0/3927672992 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9750007cc0 con 0x7f97600fcd00 2023-12-05T09:27:03.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.128+0000 7f97477fe700 1 -- 172.21.15.67:0/3927672992 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f975000f040 con 0x7f97600fcd00 2023-12-05T09:27:03.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.128+0000 7f97477fe700 1 -- 172.21.15.67:0/3927672992 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9750009540 con 0x7f97600fcd00 2023-12-05T09:27:03.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.128+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976010eda0 con 0x7f97600fcd00 2023-12-05T09:27:03.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.129+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976010f2e0 con 0x7f97600fcd00 2023-12-05T09:27:03.131 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.131+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976004bb80 con 0x7f97600fcd00 2023-12-05T09:27:03.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.134+0000 7f97477fe700 1 -- 172.21.15.67:0/3927672992 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f97500096a0 con 0x7f97600fcd00 2023-12-05T09:27:03.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.135+0000 7f97477fe700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f974806f360 0x7f9748071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:03.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.135+0000 7f97477fe700 1 -- 172.21.15.67:0/3927672992 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9750088e80 con 0x7f97600fcd00 2023-12-05T09:27:03.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.138+0000 7f975ed9d700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f974806f360 0x7f9748071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:03.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.140+0000 7f975ed9d700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f974806f360 0x7f9748071810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9758009cb0 tx=0x7f9758004d10 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:03.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.144+0000 7f97477fe700 1 -- 172.21.15.67:0/3927672992 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f975004dce0 con 0x7f97600fcd00 2023-12-05T09:27:03.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.616+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f976005e080 con 0x7f974806f360 2023-12-05T09:27:03.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.618+0000 7f97477fe700 1 -- 172.21.15.67:0/3927672992 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f976005e080 con 0x7f974806f360 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f974806f360 msgr2=0x7f9748071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f974806f360 0x7f9748071810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9758009cb0 tx=0x7f9758004d10 comp rx=0 tx=0).stop 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97600fcd00 msgr2=0x7f976010dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97600fcd00 0x7f976010dc80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9750002a50 tx=0x7f97500046b0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 shutdown_connections 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f974806f360 0x7f9748071810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97600fbaf0 0x7f976010d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 --2- 172.21.15.67:0/3927672992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97600fcd00 0x7f976010dc80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.621+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 >> 172.21.15.67:0/3927672992 conn(0x7f97600f7190 msgr2=0x7f97600f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:03.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.622+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 shutdown_connections 2023-12-05T09:27:03.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.622+0000 7f9765178700 1 -- 172.21.15.67:0/3927672992 wait complete. 2023-12-05T09:27:03.647 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:27:03.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.836+0000 7f6ced52a700 1 -- 172.21.15.67:0/3129992772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 msgr2=0x7f6ce80709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.836+0000 7f6ced52a700 1 --2- 172.21.15.67:0/3129992772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 0x7f6ce80709c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc004940 tx=0x7f6cdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.836+0000 7f6ced52a700 1 -- 172.21.15.67:0/3129992772 shutdown_connections 2023-12-05T09:27:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.836+0000 7f6ced52a700 1 --2- 172.21.15.67:0/3129992772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 0x7f6ce80709c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.836+0000 7f6ced52a700 1 --2- 172.21.15.67:0/3129992772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ce8071bc0 0x7f6ce8070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.836+0000 7f6ced52a700 1 -- 172.21.15.67:0/3129992772 >> 172.21.15.67:0/3129992772 conn(0x7f6ce80f82d0 msgr2=0x7f6ce80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.836+0000 7f6ced52a700 1 -- 172.21.15.67:0/3129992772 shutdown_connections 2023-12-05T09:27:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.836+0000 7f6ced52a700 1 -- 172.21.15.67:0/3129992772 wait complete. 2023-12-05T09:27:03.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.838+0000 7f6ced52a700 1 Processor -- start 2023-12-05T09:27:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.838+0000 7f6ced52a700 1 -- start start 2023-12-05T09:27:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.838+0000 7f6ced52a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 0x7f6ce8113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:03.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.838+0000 7f6ced52a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ce8071bc0 0x7f6ce8114030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:03.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.838+0000 7f6ced52a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8114630 con 0x7f6ce8071bc0 2023-12-05T09:27:03.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.838+0000 7f6ced52a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce8114ed0 con 0x7f6ce8070570 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.839+0000 7f6ce6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 0x7f6ce8113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.839+0000 7f6ce6ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 0x7f6ce8113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:50636/0 (socket says 172.21.15.67:50636) 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.839+0000 7f6ce6ffd700 1 -- 172.21.15.67:0/3529446570 learned_addr learned my addr 172.21.15.67:0/3529446570 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.839+0000 7f6ce67fc700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ce8071bc0 0x7f6ce8114030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.839+0000 7f6ce6ffd700 1 -- 172.21.15.67:0/3529446570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ce8071bc0 msgr2=0x7f6ce8114030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.839+0000 7f6ce6ffd700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ce8071bc0 0x7f6ce8114030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.839+0000 7f6ce6ffd700 1 -- 172.21.15.67:0/3529446570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc005040 con 0x7f6ce8070570 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.839+0000 7f6ce67fc700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ce8071bc0 0x7f6ce8114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:27:03.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.840+0000 7f6ce6ffd700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 0x7f6ce8113af0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c830 tx=0x7f6cd8004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.840+0000 7f6ccf7fe700 1 -- 172.21.15.67:0/3529446570 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd800a760 con 0x7f6ce8070570 2023-12-05T09:27:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.840+0000 7f6ccf7fe700 1 -- 172.21.15.67:0/3529446570 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6cd800ad70 con 0x7f6ce8070570 2023-12-05T09:27:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.840+0000 7f6ccf7fe700 1 -- 172.21.15.67:0/3529446570 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cd80113a0 con 0x7f6ce8070570 2023-12-05T09:27:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.840+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce81151b0 con 0x7f6ce8070570 2023-12-05T09:27:03.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.841+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce8115690 con 0x7f6ce8070570 2023-12-05T09:27:03.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.842+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce804bb80 con 0x7f6ce8070570 2023-12-05T09:27:03.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.845+0000 7f6ccf7fe700 1 -- 172.21.15.67:0/3529446570 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f6cd8012400 con 0x7f6ce8070570 2023-12-05T09:27:03.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.848+0000 7f6ccf7fe700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f6cd006af10 0x7f6cd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:03.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.848+0000 7f6ccf7fe700 1 -- 172.21.15.67:0/3529446570 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6cd8089960 con 0x7f6ce8070570 2023-12-05T09:27:03.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.848+0000 7f6ce67fc700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f6cd006af10 0x7f6cd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:03.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.849+0000 7f6ccf7fe700 1 -- 172.21.15.67:0/3529446570 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6cd8057820 con 0x7f6ce8070570 2023-12-05T09:27:03.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:03.850+0000 7f6ce67fc700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f6cd006af10 0x7f6cd006d3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00b3b0 tx=0x7f6cdc009e30 comp rx=0 tx=0).ready entity=mgr.24431 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:04.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.278+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 --> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ce80ffdc0 con 0x7f6cd006af10 2023-12-05T09:27:04.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.281+0000 7f6ccf7fe700 1 -- 172.21.15.67:0/3529446570 <== mgr.24431 v2:172.21.15.134:6828/1604582340 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f6ce80ffdc0 con 0x7f6cd006af10 2023-12-05T09:27:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f6cd006af10 msgr2=0x7f6cd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f6cd006af10 0x7f6cd006d3c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00b3b0 tx=0x7f6cdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 msgr2=0x7f6ce8113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 0x7f6ce8113af0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c830 tx=0x7f6cd8004470 comp rx=0 tx=0).stop 2023-12-05T09:27:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 shutdown_connections 2023-12-05T09:27:04.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ce8070570 0x7f6ce8113af0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:04.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.134:6828/1604582340,v1:172.21.15.134:6829/1604582340] conn(0x7f6cd006af10 0x7f6cd006d3c0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00b3b0 tx=0x7f6cdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:04.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 --2- 172.21.15.67:0/3529446570 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6ce8071bc0 0x7f6ce8114030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:04.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 >> 172.21.15.67:0/3529446570 conn(0x7f6ce80f82d0 msgr2=0x7f6ce80fa610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:04.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 shutdown_connections 2023-12-05T09:27:04.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.285+0000 7f6ced52a700 1 -- 172.21.15.67:0/3529446570 wait complete. 2023-12-05T09:27:04.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:04 smithi067 ceph-mon[107174]: pgmap v47: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 6.4 MiB/s rd, 9.1 MiB/s wr, 254 op/s 2023-12-05T09:27:04.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:04 smithi134 ceph-mon[116304]: pgmap v47: 65 pgs: 65 active+clean; 1.2 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 6.4 MiB/s rd, 9.1 MiB/s wr, 254 op/s 2023-12-05T09:27:04.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.493+0000 7f2b082b0700 1 -- 172.21.15.67:0/2911241671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00070570 msgr2=0x7f2b000709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:04.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.493+0000 7f2b082b0700 1 --2- 172.21.15.67:0/2911241671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00070570 0x7f2b000709c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2af4004940 tx=0x7f2af4009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:04.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.493+0000 7f2b082b0700 1 -- 172.21.15.67:0/2911241671 shutdown_connections 2023-12-05T09:27:04.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.493+0000 7f2b082b0700 1 --2- 172.21.15.67:0/2911241671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00070570 0x7f2b000709c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:04.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.493+0000 7f2b082b0700 1 --2- 172.21.15.67:0/2911241671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b00071bc0 0x7f2b00070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:04.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.493+0000 7f2b082b0700 1 -- 172.21.15.67:0/2911241671 >> 172.21.15.67:0/2911241671 conn(0x7f2b000f82d0 msgr2=0x7f2b000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:04.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.494+0000 7f2b082b0700 1 -- 172.21.15.67:0/2911241671 shutdown_connections 2023-12-05T09:27:04.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.494+0000 7f2b082b0700 1 -- 172.21.15.67:0/2911241671 wait complete. 2023-12-05T09:27:04.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.495+0000 7f2b082b0700 1 Processor -- start 2023-12-05T09:27:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.495+0000 7f2b082b0700 1 -- start start 2023-12-05T09:27:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.496+0000 7f2b082b0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b00070570 0x7f2b00113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.496+0000 7f2b082b0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00071bc0 0x7f2b00114050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.496+0000 7f2b082b0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00114650 con 0x7f2b00070570 2023-12-05T09:27:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.496+0000 7f2b082b0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00114ef0 con 0x7f2b00071bc0 2023-12-05T09:27:04.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.496+0000 7f2b0584b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00071bc0 0x7f2b00114050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.496+0000 7f2b0584b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00071bc0 0x7f2b00114050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:50644/0 (socket says 172.21.15.67:50644) 2023-12-05T09:27:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.496+0000 7f2b0584b700 1 -- 172.21.15.67:0/627819598 learned_addr learned my addr 172.21.15.67:0/627819598 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.497+0000 7f2b0584b700 1 -- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b00070570 msgr2=0x7f2b00113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.497+0000 7f2b0584b700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b00070570 0x7f2b00113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.497+0000 7f2b0584b700 1 -- 172.21.15.67:0/627819598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af4005040 con 0x7f2b00071bc0 2023-12-05T09:27:04.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.497+0000 7f2b0584b700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00071bc0 0x7f2b00114050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2af400b3b0 tx=0x7f2af4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.501+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af400e030 con 0x7f2b00071bc0 2023-12-05T09:27:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.501+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2af4004290 con 0x7f2b00071bc0 2023-12-05T09:27:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.501+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af401c400 con 0x7f2b00071bc0 2023-12-05T09:27:04.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.501+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b001150f0 con 0x7f2b00071bc0 2023-12-05T09:27:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.501+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b001155d0 con 0x7f2b00071bc0 2023-12-05T09:27:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.503+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0004bb80 con 0x7f2b00071bc0 2023-12-05T09:27:04.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.504+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 27) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f2af4013790 con 0x7f2b00071bc0 2023-12-05T09:27:04.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.504+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2af404d250 con 0x7f2b00071bc0 2023-12-05T09:27:04.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:04.511+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2af4011960 con 0x7f2b00071bc0 2023-12-05T09:27:05.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:05.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:05.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr fail", "who": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr fail", "who": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: osdmap e49: 6 total, 6 up, 6 in 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd='[{"prefix": "mgr fail", "who": "smithi134.yfqkak"}]': finished 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: mgrmap e26: smithi067.alxtvv(active, starting, since 0.00982648s) 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: Active manager daemon smithi067.alxtvv restarted 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.alxtvv/crt"}]: dispatch 2023-12-05T09:27:05.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: osdmap e50: 6 total, 6 up, 6 in 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: mgrmap e27: smithi067.alxtvv(active, starting, since 0.0219464s) 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.kyspon"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.qaibsa"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vmnpaq"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:27:05.371 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.alxtvv/key"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:27:05.372 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:05 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 172.21.15.134:0/3505921648' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr fail", "who": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "mgr fail", "who": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: osdmap e49: 6 total, 6 up, 6 in 2023-12-05T09:27:05.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.24431 ' entity='mgr.smithi134.yfqkak' cmd='[{"prefix": "mgr fail", "who": "smithi134.yfqkak"}]': finished 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: mgrmap e26: smithi067.alxtvv(active, starting, since 0.00982648s) 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: Active manager daemon smithi067.alxtvv restarted 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.alxtvv/crt"}]: dispatch 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: osdmap e50: 6 total, 6 up, 6 in 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: mgrmap e27: smithi067.alxtvv(active, starting, since 0.0219464s) 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.kyspon"}]: dispatch 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.qaibsa"}]: dispatch 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vmnpaq"}]: dispatch 2023-12-05T09:27:05.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.alxtvv/key"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:05.380 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:27:05.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:27:05.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:27:05.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:27:05.381 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:05 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:27:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.507+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f2af40265f0 con 0x7f2b00071bc0 2023-12-05T09:27:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.507+0000 7f2af2ffd700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f2aec03d780 0x7f2aec03fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:05.509 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.507+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2aec0400a0 con 0x7f2aec03d780 2023-12-05T09:27:05.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.520+0000 7f2b0604c700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f2aec03d780 0x7f2aec03fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:05.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.524+0000 7f2b0604c700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f2aec03d780 0x7f2aec03fb60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2afc004d00 tx=0x7f2afc009ce0 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:05.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.547+0000 7f2af2ffd700 1 -- 172.21.15.67:0/627819598 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f2aec0400a0 con 0x7f2aec03d780 2023-12-05T09:27:05.548 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:27:05.548 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (46s) 8s ago 8m 15.8M - 0.25.0 c8568f914cd2 2984231be6c0 2023-12-05T09:27:05.548 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (8m) 8s ago 8m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (7m) 11s ago 7m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (37s) 8s ago 7m 76.3M - 9.4.7 2c41d148cca3 1ec402b5237f 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (3m) 8s ago 3m 3320M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (3m) 8s ago 3m 2728M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (3m) 11s ago 3m 13.4M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (3m) 11s ago 3m 13.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (14s) 8s ago 9m 55.7M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283 running (100s) 11s ago 7m 508M - 19.0.0-11-g3fe8d441 56dea28e5206 86a20ad48d27 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (9m) 8s ago 9m 88.1M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (7m) 11s ago 7m 58.3M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (57s) 8s ago 8m 7918k - 1.5.0 0da6a335fe13 679ffe8a73ff 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (23s) 11s ago 7m 7692k - 1.5.0 0da6a335fe13 83a517ef1242 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (6m) 8s ago 6m 496M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (6m) 8s ago 6m 567M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:27:05.549 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (5m) 8s ago 5m 410M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:27:05.550 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (5m) 11s ago 5m 650M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:27:05.550 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (5m) 11s ago 5m 509M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:27:05.550 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (4m) 11s ago 4m 589M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:27:05.550 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (27s) 8s ago 7m 38.7M - 2.43.0 a07b618ecd1d 855d0c57cbce 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f2aec03d780 msgr2=0x7f2aec03fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f2aec03d780 0x7f2aec03fb60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2afc004d00 tx=0x7f2afc009ce0 comp rx=0 tx=0).stop 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00071bc0 msgr2=0x7f2b00114050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00071bc0 0x7f2b00114050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2af400b3b0 tx=0x7f2af4009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 shutdown_connections 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f2aec03d780 0x7f2aec03fb60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2b00070570 0x7f2b00113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 --2- 172.21.15.67:0/627819598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b00071bc0 0x7f2b00114050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.552+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 >> 172.21.15.67:0/627819598 conn(0x7f2b000f82d0 msgr2=0x7f2b000fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:05.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.553+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 shutdown_connections 2023-12-05T09:27:05.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.553+0000 7f2b082b0700 1 -- 172.21.15.67:0/627819598 wait complete. 2023-12-05T09:27:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.765+0000 7f85d7927700 1 -- 172.21.15.67:0/2067616154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0071bc0 msgr2=0x7f85d0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.765+0000 7f85d7927700 1 --2- 172.21.15.67:0/2067616154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0071bc0 0x7f85d0070030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85cc004940 tx=0x7f85cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.765+0000 7f85d7927700 1 -- 172.21.15.67:0/2067616154 shutdown_connections 2023-12-05T09:27:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.765+0000 7f85d7927700 1 --2- 172.21.15.67:0/2067616154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d0070570 0x7f85d00709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.765+0000 7f85d7927700 1 --2- 172.21.15.67:0/2067616154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0071bc0 0x7f85d0070030 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.765+0000 7f85d7927700 1 -- 172.21.15.67:0/2067616154 >> 172.21.15.67:0/2067616154 conn(0x7f85d00f82d0 msgr2=0x7f85d00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.766+0000 7f85d7927700 1 -- 172.21.15.67:0/2067616154 shutdown_connections 2023-12-05T09:27:05.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.766+0000 7f85d7927700 1 -- 172.21.15.67:0/2067616154 wait complete. 2023-12-05T09:27:05.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.767+0000 7f85d7927700 1 Processor -- start 2023-12-05T09:27:05.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.767+0000 7f85d7927700 1 -- start start 2023-12-05T09:27:05.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.768+0000 7f85d7927700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0070570 0x7f85d010b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:05.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.768+0000 7f85d7927700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d0071bc0 0x7f85d010b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:05.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.768+0000 7f85d7927700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d010bd80 con 0x7f85d0071bc0 2023-12-05T09:27:05.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.768+0000 7f85d7927700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d010f870 con 0x7f85d0070570 2023-12-05T09:27:05.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.768+0000 7f85d56c3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0070570 0x7f85d010b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:05.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.768+0000 7f85d56c3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0070570 0x7f85d010b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:50744/0 (socket says 172.21.15.67:50744) 2023-12-05T09:27:05.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.768+0000 7f85d56c3700 1 -- 172.21.15.67:0/1423292507 learned_addr learned my addr 172.21.15.67:0/1423292507 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:05.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.769+0000 7f85d4ec2700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d0071bc0 0x7f85d010b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:05.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.769+0000 7f85d56c3700 1 -- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d0071bc0 msgr2=0x7f85d010b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:05.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.769+0000 7f85d56c3700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d0071bc0 0x7f85d010b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:05.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.770+0000 7f85d56c3700 1 -- 172.21.15.67:0/1423292507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc005040 con 0x7f85d0070570 2023-12-05T09:27:05.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.770+0000 7f85d4ec2700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d0071bc0 0x7f85d010b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:27:05.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.770+0000 7f85d56c3700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0070570 0x7f85d010b1f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f85cc000c00 tx=0x7f85cc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:05.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.770+0000 7f85c5ffb700 1 -- 172.21.15.67:0/1423292507 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85cc021070 con 0x7f85d0070570 2023-12-05T09:27:05.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.770+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d010fa70 con 0x7f85d0070570 2023-12-05T09:27:05.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.770+0000 7f85c5ffb700 1 -- 172.21.15.67:0/1423292507 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85cc01c400 con 0x7f85d0070570 2023-12-05T09:27:05.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.770+0000 7f85c5ffb700 1 -- 172.21.15.67:0/1423292507 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85cc00e070 con 0x7f85d0070570 2023-12-05T09:27:05.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.770+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d010ff20 con 0x7f85d0070570 2023-12-05T09:27:05.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.772+0000 7f85c5ffb700 1 -- 172.21.15.67:0/1423292507 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f85cc013a80 con 0x7f85d0070570 2023-12-05T09:27:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.772+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d004bb80 con 0x7f85d0070570 2023-12-05T09:27:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.773+0000 7f85c5ffb700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f85bc0383a0 0x7f85bc03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:05.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.773+0000 7f85c5ffb700 1 -- 172.21.15.67:0/1423292507 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f85cc011d00 con 0x7f85d0070570 2023-12-05T09:27:05.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.773+0000 7f85d4ec2700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f85bc0383a0 0x7f85bc03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:05.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.774+0000 7f85d4ec2700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f85bc0383a0 0x7f85bc03a850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f85c0004600 tx=0x7f85c000b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:05.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:05.779+0000 7f85c5ffb700 1 -- 172.21.15.67:0/1423292507 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f85cc00be70 con 0x7f85d0070570 2023-12-05T09:27:06.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.360+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f85d01105d0 con 0x7f85d0070570 2023-12-05T09:27:06.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.361+0000 7f85c5ffb700 1 -- 172.21.15.67:0/1423292507 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f85cc026410 con 0x7f85d0070570 2023-12-05T09:27:06.360 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:27:06.360 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:27:06.361 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:27:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.363+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f85bc0383a0 msgr2=0x7f85bc03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.363+0000 7f85d7927700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f85bc0383a0 0x7f85bc03a850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f85c0004600 tx=0x7f85c000b040 comp rx=0 tx=0).stop 2023-12-05T09:27:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.363+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0070570 msgr2=0x7f85d010b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.363+0000 7f85d7927700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0070570 0x7f85d010b1f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f85cc000c00 tx=0x7f85cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.365+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 shutdown_connections 2023-12-05T09:27:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.365+0000 7f85d7927700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f85bc0383a0 0x7f85bc03a850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.365+0000 7f85d7927700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85d0070570 0x7f85d010b1f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.365+0000 7f85d7927700 1 --2- 172.21.15.67:0/1423292507 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f85d0071bc0 0x7f85d010b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.365+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 >> 172.21.15.67:0/1423292507 conn(0x7f85d00f82d0 msgr2=0x7f85d00fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.365+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 shutdown_connections 2023-12-05T09:27:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.365+0000 7f85d7927700 1 -- 172.21.15.67:0/1423292507 wait complete. 2023-12-05T09:27:06.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.594+0000 7fb20d635700 1 -- 172.21.15.67:0/1897740640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 msgr2=0x7fb20806e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:06.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.594+0000 7fb20d635700 1 --2- 172.21.15.67:0/1897740640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 0x7fb20806e620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc004940 tx=0x7fb1fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:06.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.594+0000 7fb20d635700 1 -- 172.21.15.67:0/1897740640 shutdown_connections 2023-12-05T09:27:06.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.594+0000 7fb20d635700 1 --2- 172.21.15.67:0/1897740640 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb20806eb60 0x7fb20810ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:06.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.594+0000 7fb20d635700 1 --2- 172.21.15.67:0/1897740640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 0x7fb20806e620 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:06.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.594+0000 7fb20d635700 1 -- 172.21.15.67:0/1897740640 >> 172.21.15.67:0/1897740640 conn(0x7fb208069b20 msgr2=0x7fb20806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:06.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.594+0000 7fb20d635700 1 -- 172.21.15.67:0/1897740640 shutdown_connections 2023-12-05T09:27:06.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.594+0000 7fb20d635700 1 -- 172.21.15.67:0/1897740640 wait complete. 2023-12-05T09:27:06.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.595+0000 7fb20d635700 1 Processor -- start 2023-12-05T09:27:06.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.595+0000 7fb20d635700 1 -- start start 2023-12-05T09:27:06.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.596+0000 7fb20d635700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 0x7fb208117f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:06.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.596+0000 7fb20d635700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb20806eb60 0x7fb208118440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:06.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.596+0000 7fb20d635700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb208118a40 con 0x7fb20806eb60 2023-12-05T09:27:06.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.596+0000 7fb20d635700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2081192e0 con 0x7fb20806e210 2023-12-05T09:27:06.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.596+0000 7fb206ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 0x7fb208117f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:06.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.596+0000 7fb206ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 0x7fb208117f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:56316/0 (socket says 172.21.15.67:56316) 2023-12-05T09:27:06.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.596+0000 7fb206ffd700 1 -- 172.21.15.67:0/3362835925 learned_addr learned my addr 172.21.15.67:0/3362835925 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:06.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.597+0000 7fb206ffd700 1 -- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb20806eb60 msgr2=0x7fb208118440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:06.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.597+0000 7fb206ffd700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb20806eb60 0x7fb208118440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:06.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.597+0000 7fb206ffd700 1 -- 172.21.15.67:0/3362835925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc005040 con 0x7fb20806e210 2023-12-05T09:27:06.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.597+0000 7fb206ffd700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 0x7fb208117f00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009fd0 tx=0x7fb1fc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:06.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.597+0000 7fb1ef7fe700 1 -- 172.21.15.67:0/3362835925 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1fc021070 con 0x7fb20806e210 2023-12-05T09:27:06.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.598+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb208119560 con 0x7fb20806e210 2023-12-05T09:27:06.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.598+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb208119aa0 con 0x7fb20806e210 2023-12-05T09:27:06.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.598+0000 7fb1ef7fe700 1 -- 172.21.15.67:0/3362835925 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1fc01c400 con 0x7fb20806e210 2023-12-05T09:27:06.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.598+0000 7fb1ef7fe700 1 -- 172.21.15.67:0/3362835925 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1fc00e070 con 0x7fb20806e210 2023-12-05T09:27:06.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.599+0000 7fb1ef7fe700 1 -- 172.21.15.67:0/3362835925 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7fb1fc01ca00 con 0x7fb20806e210 2023-12-05T09:27:06.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.600+0000 7fb1ef7fe700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1f0038350 0x7fb1f003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:06.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.600+0000 7fb1ef7fe700 1 -- 172.21.15.67:0/3362835925 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb1fc04ce70 con 0x7fb20806e210 2023-12-05T09:27:06.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.600+0000 7fb2067fc700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1f0038350 0x7fb1f003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:06.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.601+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f40052e0 con 0x7fb20806e210 2023-12-05T09:27:06.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.602+0000 7fb2067fc700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1f0038350 0x7fb1f003a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb20806f690 tx=0x7fb1f800b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:06.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:06.611+0000 7fb1ef7fe700 1 -- 172.21.15.67:0/3362835925 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb1fc011b70 con 0x7fb20806e210 2023-12-05T09:27:06.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:06 smithi134 ceph-mon[116304]: mgrmap e28: smithi067.alxtvv(active, since 1.01931s) 2023-12-05T09:27:06.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:06 smithi134 ceph-mon[116304]: from='client.24507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:06.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:06 smithi134 ceph-mon[116304]: pgmap v3: 65 pgs: 65 active+clean; 703 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-05T09:27:06.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:06 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/1423292507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:27:06.866 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:06 smithi067 ceph-mon[107174]: mgrmap e28: smithi067.alxtvv(active, since 1.01931s) 2023-12-05T09:27:06.866 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:06 smithi067 ceph-mon[107174]: from='client.24507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:06.866 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:06 smithi067 ceph-mon[107174]: pgmap v3: 65 pgs: 65 active+clean; 703 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-05T09:27:06.866 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:06 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1423292507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:27:07.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.014+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1f4000bf0 con 0x7fb1f0038350 2023-12-05T09:27:07.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.017+0000 7fb1ef7fe700 1 -- 172.21.15.67:0/3362835925 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fb1f4000bf0 con 0x7fb1f0038350 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:27:07.020 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:27:07.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.023+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1f0038350 msgr2=0x7fb1f003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:07.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.023+0000 7fb20d635700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1f0038350 0x7fb1f003a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb20806f690 tx=0x7fb1f800b040 comp rx=0 tx=0).stop 2023-12-05T09:27:07.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.023+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 msgr2=0x7fb208117f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.023+0000 7fb20d635700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 0x7fb208117f00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009fd0 tx=0x7fb1fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.024+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 shutdown_connections 2023-12-05T09:27:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.024+0000 7fb20d635700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1f0038350 0x7fb1f003a800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.024+0000 7fb20d635700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb20806e210 0x7fb208117f00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.024+0000 7fb20d635700 1 --2- 172.21.15.67:0/3362835925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb20806eb60 0x7fb208118440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.024+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 >> 172.21.15.67:0/3362835925 conn(0x7fb208069b20 msgr2=0x7fb2081076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:07.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.024+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 shutdown_connections 2023-12-05T09:27:07.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:07.024+0000 7fb20d635700 1 -- 172.21.15.67:0/3362835925 wait complete. 2023-12-05T09:27:07.494 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-05T09:27:07.494 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-05T09:27:07.622 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:07 smithi134 ceph-mon[116304]: pgmap v4: 65 pgs: 65 active+clean; 703 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-05T09:27:07.622 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:07 smithi134 ceph-mon[116304]: mgrmap e29: smithi067.alxtvv(active, since 2s) 2023-12-05T09:27:07.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:07 smithi067 ceph-mon[107174]: pgmap v4: 65 pgs: 65 active+clean; 703 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-05T09:27:07.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:07 smithi067 ceph-mon[107174]: mgrmap e29: smithi067.alxtvv(active, since 2s) 2023-12-05T09:27:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:08 smithi067 ceph-mon[107174]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:08 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:08 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:08 smithi134 ceph-mon[116304]: from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:08 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:08 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:09.770 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:09 smithi134 ceph-mon[116304]: [05/Dec/2023:09:27:08] ENGINE Bus STARTING 2023-12-05T09:27:09.770 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:09 smithi134 ceph-mon[116304]: [05/Dec/2023:09:27:08] ENGINE Serving on https://172.21.15.67:7150 2023-12-05T09:27:09.770 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:09 smithi134 ceph-mon[116304]: [05/Dec/2023:09:27:08] ENGINE Serving on http://172.21.15.67:8765 2023-12-05T09:27:09.770 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:09 smithi134 ceph-mon[116304]: [05/Dec/2023:09:27:08] ENGINE Bus STARTED 2023-12-05T09:27:09.770 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:09 smithi134 ceph-mon[116304]: pgmap v5: 65 pgs: 65 active+clean; 703 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-05T09:27:09.770 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:09 smithi134 ceph-mon[116304]: mgrmap e30: smithi067.alxtvv(active, since 4s) 2023-12-05T09:27:09.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:09 smithi067 ceph-mon[107174]: [05/Dec/2023:09:27:08] ENGINE Bus STARTING 2023-12-05T09:27:09.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:09 smithi067 ceph-mon[107174]: [05/Dec/2023:09:27:08] ENGINE Serving on https://172.21.15.67:7150 2023-12-05T09:27:09.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:09 smithi067 ceph-mon[107174]: [05/Dec/2023:09:27:08] ENGINE Serving on http://172.21.15.67:8765 2023-12-05T09:27:09.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:09 smithi067 ceph-mon[107174]: [05/Dec/2023:09:27:08] ENGINE Bus STARTED 2023-12-05T09:27:09.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:09 smithi067 ceph-mon[107174]: pgmap v5: 65 pgs: 65 active+clean; 703 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-05T09:27:09.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:09 smithi067 ceph-mon[107174]: mgrmap e30: smithi067.alxtvv(active, since 4s) 2023-12-05T09:27:11.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:10 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:11.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:10 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:11.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:10 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:11.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:10 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:12.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:11 smithi067 ceph-mon[107174]: pgmap v6: 65 pgs: 65 active+clean; 640 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 7.0 KiB/s rd, 7.0 KiB/s wr, 38 op/s 2023-12-05T09:27:12.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:11 smithi134 ceph-mon[116304]: pgmap v6: 65 pgs: 65 active+clean; 640 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 7.0 KiB/s rd, 7.0 KiB/s wr, 38 op/s 2023-12-05T09:27:14.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:13 smithi067 ceph-mon[107174]: pgmap v7: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.8 MiB/s wr, 193 op/s 2023-12-05T09:27:14.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:13 smithi134 ceph-mon[116304]: pgmap v7: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.8 MiB/s wr, 193 op/s 2023-12-05T09:27:14.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:14 smithi134 ceph-mon[116304]: Standby manager daemon smithi134.yfqkak started 2023-12-05T09:27:14.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:14 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/701816101' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:27:14.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:14 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/701816101' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:27:14.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:14 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/701816101' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:27:14.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:14 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/701816101' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:27:15.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:14 smithi067 ceph-mon[107174]: Standby manager daemon smithi134.yfqkak started 2023-12-05T09:27:15.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:14 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/701816101' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:27:15.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:14 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/701816101' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:27:15.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:14 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/701816101' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:27:15.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:14 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/701816101' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:27:16.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:15 smithi067 ceph-mon[107174]: pgmap v8: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.4 MiB/s wr, 150 op/s 2023-12-05T09:27:16.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:15 smithi067 ceph-mon[107174]: mgrmap e31: smithi067.alxtvv(active, since 10s), standbys: smithi134.yfqkak 2023-12-05T09:27:16.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:15 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.yfqkak", "id": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:27:16.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:15 smithi134 ceph-mon[116304]: pgmap v8: 65 pgs: 65 active+clean; 324 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.4 MiB/s wr, 150 op/s 2023-12-05T09:27:16.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:15 smithi134 ceph-mon[116304]: mgrmap e31: smithi067.alxtvv(active, since 10s), standbys: smithi134.yfqkak 2023-12-05T09:27:16.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:15 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.yfqkak", "id": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:27:17.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:17 smithi067 ceph-mon[107174]: pgmap v9: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 2.3 MiB/s wr, 349 op/s 2023-12-05T09:27:17.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:17 smithi134 ceph-mon[116304]: pgmap v9: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 2.3 MiB/s wr, 349 op/s 2023-12-05T09:27:19.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:19 smithi067 ceph-mon[107174]: pgmap v10: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.1 MiB/s wr, 319 op/s 2023-12-05T09:27:19.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:19 smithi134 ceph-mon[116304]: pgmap v10: 65 pgs: 65 active+clean; 332 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.1 MiB/s wr, 319 op/s 2023-12-05T09:27:20.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:20 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:27:20.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:20 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:27:21.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:21 smithi067 ceph-mon[107174]: pgmap v11: 65 pgs: 65 active+clean; 331 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.1 MiB/s wr, 346 op/s 2023-12-05T09:27:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:21 smithi134 ceph-mon[116304]: pgmap v11: 65 pgs: 65 active+clean; 331 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.1 MiB/s wr, 346 op/s 2023-12-05T09:27:23.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:23 smithi067 ceph-mon[107174]: pgmap v12: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 63 KiB/s rd, 3.3 MiB/s wr, 471 op/s 2023-12-05T09:27:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:23 smithi134 ceph-mon[116304]: pgmap v12: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 63 KiB/s rd, 3.3 MiB/s wr, 471 op/s 2023-12-05T09:27:26.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:25 smithi067 ceph-mon[107174]: pgmap v13: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.3 MiB/s wr, 374 op/s 2023-12-05T09:27:26.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:25 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:26.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:25 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:26.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:25 smithi134 ceph-mon[116304]: pgmap v13: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 2.3 MiB/s wr, 374 op/s 2023-12-05T09:27:26.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:25 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:26.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:25 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:28.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:27 smithi067 ceph-mon[107174]: pgmap v14: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 583 op/s 2023-12-05T09:27:28.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:27 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:28.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:27 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:28.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:27 smithi134 ceph-mon[116304]: pgmap v14: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 3.3 MiB/s wr, 583 op/s 2023-12-05T09:27:28.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:27 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:28.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:27 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:30.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:29 smithi067 ceph-mon[107174]: pgmap v15: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.3 MiB/s wr, 375 op/s 2023-12-05T09:27:30.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:29 smithi134 ceph-mon[116304]: pgmap v15: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.3 MiB/s wr, 375 op/s 2023-12-05T09:27:32.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:31 smithi067 ceph-mon[107174]: pgmap v16: 65 pgs: 65 active+clean; 337 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 410 op/s 2023-12-05T09:27:32.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:31 smithi134 ceph-mon[116304]: pgmap v16: 65 pgs: 65 active+clean; 337 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.3 MiB/s wr, 410 op/s 2023-12-05T09:27:34.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:33 smithi067 ceph-mon[107174]: pgmap v17: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 3.1 MiB/s wr, 545 op/s 2023-12-05T09:27:34.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:33 smithi134 ceph-mon[116304]: pgmap v17: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 3.1 MiB/s wr, 545 op/s 2023-12-05T09:27:35.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:34 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:27:35.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:34 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:27:36.211 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:35 smithi067 ceph-mon[107174]: pgmap v18: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 405 op/s 2023-12-05T09:27:36.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:35 smithi134 ceph-mon[116304]: pgmap v18: 65 pgs: 65 active+clean; 336 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 405 op/s 2023-12-05T09:27:37.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.214+0000 7ffba6bf9700 1 -- 172.21.15.67:0/1953188789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fcbf0 msgr2=0x7ffba00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:37.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.214+0000 7ffba6bf9700 1 --2- 172.21.15.67:0/1953188789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fcbf0 0x7ffba00fd000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffb94004940 tx=0x7ffb94009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:37.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.214+0000 7ffba6bf9700 1 -- 172.21.15.67:0/1953188789 shutdown_connections 2023-12-05T09:27:37.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.214+0000 7ffba6bf9700 1 --2- 172.21.15.67:0/1953188789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba00fde00 0x7ffba00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:37.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.214+0000 7ffba6bf9700 1 --2- 172.21.15.67:0/1953188789 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fcbf0 0x7ffba00fd000 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:37.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.214+0000 7ffba6bf9700 1 -- 172.21.15.67:0/1953188789 >> 172.21.15.67:0/1953188789 conn(0x7ffba00f82d0 msgr2=0x7ffba00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:37.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.214+0000 7ffba6bf9700 1 -- 172.21.15.67:0/1953188789 shutdown_connections 2023-12-05T09:27:37.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.214+0000 7ffba6bf9700 1 -- 172.21.15.67:0/1953188789 wait complete. 2023-12-05T09:27:37.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.215+0000 7ffba6bf9700 1 Processor -- start 2023-12-05T09:27:37.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.215+0000 7ffba6bf9700 1 -- start start 2023-12-05T09:27:37.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.216+0000 7ffba6bf9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba00fcbf0 0x7ffba010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:37.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.216+0000 7ffba6bf9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fde00 0x7ffba010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:37.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.216+0000 7ffba6bf9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba010e010 con 0x7ffba00fde00 2023-12-05T09:27:37.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.216+0000 7ffba6bf9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba010e8b0 con 0x7ffba00fcbf0 2023-12-05T09:27:37.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.216+0000 7ffba4995700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba00fcbf0 0x7ffba010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:37.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.216+0000 7ffb9ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fde00 0x7ffba010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:37.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.216+0000 7ffba4995700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba00fcbf0 0x7ffba010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:50406/0 (socket says 172.21.15.67:50406) 2023-12-05T09:27:37.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.216+0000 7ffba4995700 1 -- 172.21.15.67:0/3621601989 learned_addr learned my addr 172.21.15.67:0/3621601989 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:37.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.217+0000 7ffb9ffff700 1 -- 172.21.15.67:0/3621601989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba00fcbf0 msgr2=0x7ffba010d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:37.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.217+0000 7ffb9ffff700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba00fcbf0 0x7ffba010d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:37.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.217+0000 7ffb9ffff700 1 -- 172.21.15.67:0/3621601989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb94005040 con 0x7ffba00fde00 2023-12-05T09:27:37.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.217+0000 7ffba4995700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba00fcbf0 0x7ffba010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:27:37.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.217+0000 7ffb9ffff700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fde00 0x7ffba010da10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009fd0 tx=0x7ffb8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:37.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.218+0000 7ffb9d7fa700 1 -- 172.21.15.67:0/3621601989 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb8c015070 con 0x7ffba00fde00 2023-12-05T09:27:37.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.218+0000 7ffb9d7fa700 1 -- 172.21.15.67:0/3621601989 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb8c010e50 con 0x7ffba00fde00 2023-12-05T09:27:37.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.218+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba010eb30 con 0x7ffba00fde00 2023-12-05T09:27:37.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.218+0000 7ffb9d7fa700 1 -- 172.21.15.67:0/3621601989 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb8c009970 con 0x7ffba00fde00 2023-12-05T09:27:37.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.218+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba010f070 con 0x7ffba00fde00 2023-12-05T09:27:37.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.219+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba004bb80 con 0x7ffba00fde00 2023-12-05T09:27:37.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.222+0000 7ffb9d7fa700 1 -- 172.21.15.67:0/3621601989 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7ffb8c00b930 con 0x7ffba00fde00 2023-12-05T09:27:37.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.222+0000 7ffb9d7fa700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffb9006cc00 0x7ffb9006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:37.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.223+0000 7ffb9d7fa700 1 -- 172.21.15.67:0/3621601989 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ffb8c090250 con 0x7ffba00fde00 2023-12-05T09:27:37.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.223+0000 7ffba4995700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffb9006cc00 0x7ffb9006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:37.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.224+0000 7ffba4995700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffb9006cc00 0x7ffb9006f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffb94013680 tx=0x7ffb94009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:37.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.232+0000 7ffb9d7fa700 1 -- 172.21.15.67:0/3621601989 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ffb8c05dea0 con 0x7ffba00fde00 2023-12-05T09:27:37.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:37 smithi067 ceph-mon[107174]: pgmap v19: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 59 KiB/s rd, 2.8 MiB/s wr, 535 op/s 2023-12-05T09:27:37.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:37 smithi134 ceph-mon[116304]: pgmap v19: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 59 KiB/s rd, 2.8 MiB/s wr, 535 op/s 2023-12-05T09:27:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.544+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffba010f590 con 0x7ffb9006cc00 2023-12-05T09:27:37.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.546+0000 7ffb9d7fa700 1 -- 172.21.15.67:0/3621601989 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7ffba010f590 con 0x7ffb9006cc00 2023-12-05T09:27:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffb9006cc00 msgr2=0x7ffb9006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffb9006cc00 0x7ffb9006f0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffb94013680 tx=0x7ffb94009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fde00 msgr2=0x7ffba010da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fde00 0x7ffba010da10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009fd0 tx=0x7ffb8c00b040 comp rx=0 tx=0).stop 2023-12-05T09:27:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 shutdown_connections 2023-12-05T09:27:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffb9006cc00 0x7ffb9006f0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffba00fcbf0 0x7ffba010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 --2- 172.21.15.67:0/3621601989 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffba00fde00 0x7ffba010da10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.548+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 >> 172.21.15.67:0/3621601989 conn(0x7ffba00f82d0 msgr2=0x7ffba0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.549+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 shutdown_connections 2023-12-05T09:27:37.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.549+0000 7ffba6bf9700 1 -- 172.21.15.67:0/3621601989 wait complete. 2023-12-05T09:27:37.569 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:27:37.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.772+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2748901136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fca50 msgr2=0x7f4ae40fce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:37.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.772+0000 7f4ae3fff700 1 --2- 172.21.15.67:0/2748901136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fca50 0x7f4ae40fce60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4004940 tx=0x7f4ad4009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:37.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.772+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2748901136 shutdown_connections 2023-12-05T09:27:37.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.773+0000 7f4ae3fff700 1 --2- 172.21.15.67:0/2748901136 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae40fdc60 0x7f4ae40fe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:37.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.773+0000 7f4ae3fff700 1 --2- 172.21.15.67:0/2748901136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fca50 0x7f4ae40fce60 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4004940 tx=0x7f4ad4009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:37.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.773+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2748901136 >> 172.21.15.67:0/2748901136 conn(0x7f4ae40f80f0 msgr2=0x7f4ae40fa540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:37.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.773+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2748901136 shutdown_connections 2023-12-05T09:27:37.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.773+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2748901136 wait complete. 2023-12-05T09:27:37.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.775+0000 7f4ae3fff700 1 Processor -- start 2023-12-05T09:27:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.776+0000 7f4ae3fff700 1 -- start start 2023-12-05T09:27:37.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.778+0000 7f4ae3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fdc60 0x7f4ae410b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:37.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.778+0000 7f4ae3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae410b800 0x7f4ae410c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:37.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.778+0000 7f4ae3fff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae410bd50 con 0x7f4ae410b800 2023-12-05T09:27:37.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.778+0000 7f4ae3fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae410bec0 con 0x7f4ae40fdc60 2023-12-05T09:27:37.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.778+0000 7f4ae2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fdc60 0x7f4ae410b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:37.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.779+0000 7f4ae2ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fdc60 0x7f4ae410b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:50422/0 (socket says 172.21.15.67:50422) 2023-12-05T09:27:37.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.779+0000 7f4ae2ffd700 1 -- 172.21.15.67:0/2706550086 learned_addr learned my addr 172.21.15.67:0/2706550086 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:37.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.780+0000 7f4ae2ffd700 1 -- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae410b800 msgr2=0x7f4ae410c6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:27:37.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.780+0000 7f4adbfff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae410b800 0x7f4ae410c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:37.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.781+0000 7f4ae2ffd700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae410b800 0x7f4ae410c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:37.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.781+0000 7f4ae2ffd700 1 -- 172.21.15.67:0/2706550086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad4005040 con 0x7f4ae40fdc60 2023-12-05T09:27:37.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.781+0000 7f4adbfff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae410b800 0x7f4ae410c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:27:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.783+0000 7f4ae2ffd700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fdc60 0x7f4ae410b2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000c00 tx=0x7f4ad4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.784+0000 7f4adb7fe700 1 -- 172.21.15.67:0/2706550086 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad400e030 con 0x7f4ae40fdc60 2023-12-05T09:27:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.784+0000 7f4adb7fe700 1 -- 172.21.15.67:0/2706550086 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ad4013420 con 0x7f4ae40fdc60 2023-12-05T09:27:37.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.784+0000 7f4adb7fe700 1 -- 172.21.15.67:0/2706550086 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad401c640 con 0x7f4ae40fdc60 2023-12-05T09:27:37.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.784+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae410cd70 con 0x7f4ae40fdc60 2023-12-05T09:27:37.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.786+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae410d2b0 con 0x7f4ae40fdc60 2023-12-05T09:27:37.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.787+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae405f270 con 0x7f4ae40fdc60 2023-12-05T09:27:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.789+0000 7f4adb7fe700 1 -- 172.21.15.67:0/2706550086 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f4ad40139e0 con 0x7f4ae40fdc60 2023-12-05T09:27:37.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.791+0000 7f4adb7fe700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4ad006cc50 0x7f4ad006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:37.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.792+0000 7f4adb7fe700 1 -- 172.21.15.67:0/2706550086 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f4ad408d4d0 con 0x7f4ae40fdc60 2023-12-05T09:27:37.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.792+0000 7f4adbfff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4ad006cc50 0x7f4ad006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:37.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.794+0000 7f4adbfff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4ad006cc50 0x7f4ad006f100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006fd0 tx=0x7f4acc008040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:37.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:37.797+0000 7f4adb7fe700 1 -- 172.21.15.67:0/2706550086 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4ad4057670 con 0x7f4ae40fdc60 2023-12-05T09:27:38.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.176+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ae41025b0 con 0x7f4ad006cc50 2023-12-05T09:27:38.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.177+0000 7f4adb7fe700 1 -- 172.21.15.67:0/2706550086 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f4ae41025b0 con 0x7f4ad006cc50 2023-12-05T09:27:38.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4ad006cc50 msgr2=0x7f4ad006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:38.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4ad006cc50 0x7f4ad006f100 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006fd0 tx=0x7f4acc008040 comp rx=0 tx=0).stop 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fdc60 msgr2=0x7f4ae410b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fdc60 0x7f4ae410b2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000c00 tx=0x7f4ad4009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 shutdown_connections 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4ad006cc50 0x7f4ad006f100 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ae40fdc60 0x7f4ae410b2c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 --2- 172.21.15.67:0/2706550086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4ae410b800 0x7f4ae410c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 >> 172.21.15.67:0/2706550086 conn(0x7f4ae40f80f0 msgr2=0x7f4ae4100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 shutdown_connections 2023-12-05T09:27:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.180+0000 7f4ae3fff700 1 -- 172.21.15.67:0/2706550086 wait complete. 2023-12-05T09:27:38.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.357+0000 7fa5f759e700 1 -- 172.21.15.67:0/3423864657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5f80fc9f0 msgr2=0x7fa5f80fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.357+0000 7fa5f759e700 1 --2- 172.21.15.67:0/3423864657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5f80fc9f0 0x7fa5f80fce00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8004940 tx=0x7fa5e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.357+0000 7fa5f759e700 1 -- 172.21.15.67:0/3423864657 shutdown_connections 2023-12-05T09:27:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.357+0000 7fa5f759e700 1 --2- 172.21.15.67:0/3423864657 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f80fdc00 0x7fa5f80fe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.357+0000 7fa5f759e700 1 --2- 172.21.15.67:0/3423864657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5f80fc9f0 0x7fa5f80fce00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.357+0000 7fa5f759e700 1 -- 172.21.15.67:0/3423864657 >> 172.21.15.67:0/3423864657 conn(0x7fa5f80f8090 msgr2=0x7fa5f80fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.357+0000 7fa5f759e700 1 -- 172.21.15.67:0/3423864657 shutdown_connections 2023-12-05T09:27:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.358+0000 7fa5f759e700 1 -- 172.21.15.67:0/3423864657 wait complete. 2023-12-05T09:27:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.359+0000 7fa5f759e700 1 Processor -- start 2023-12-05T09:27:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.359+0000 7fa5f759e700 1 -- start start 2023-12-05T09:27:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.360+0000 7fa5f759e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f80fc9f0 0x7fa5f810f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.360+0000 7fa5f759e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5f80fdc00 0x7fa5f810fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.360+0000 7fa5f759e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f81100c0 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.360+0000 7fa5f759e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8110960 con 0x7fa5f80fdc00 2023-12-05T09:27:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.360+0000 7fa5f659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f80fc9f0 0x7fa5f810f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.360+0000 7fa5f659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f80fc9f0 0x7fa5f810f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41564/0 (socket says 172.21.15.67:41564) 2023-12-05T09:27:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.360+0000 7fa5f659c700 1 -- 172.21.15.67:0/3803279441 learned_addr learned my addr 172.21.15.67:0/3803279441 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.361+0000 7fa5f659c700 1 -- 172.21.15.67:0/3803279441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5f80fdc00 msgr2=0x7fa5f810fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.361+0000 7fa5f659c700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5f80fdc00 0x7fa5f810fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.361+0000 7fa5f659c700 1 -- 172.21.15.67:0/3803279441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8005040 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.361+0000 7fa5f659c700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f80fc9f0 0x7fa5f810f580 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8000c00 tx=0x7fa5e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.362+0000 7fa5e6ffd700 1 -- 172.21.15.67:0/3803279441 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e800e040 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.362+0000 7fa5e6ffd700 1 -- 172.21.15.67:0/3803279441 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa5e800bc50 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.362+0000 7fa5e6ffd700 1 -- 172.21.15.67:0/3803279441 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e801c630 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.362+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f8110b60 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.363+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f8110fe0 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.365+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f804bb80 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.367+0000 7fa5e6ffd700 1 -- 172.21.15.67:0/3803279441 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fa5e8013420 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.368+0000 7fa5e6ffd700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa5e006cc00 0x7fa5e006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.368+0000 7fa5e6ffd700 1 -- 172.21.15.67:0/3803279441 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa5e808d2f0 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.369+0000 7fa5f5d9b700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa5e006cc00 0x7fa5e006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:38.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:38 smithi067 ceph-mon[107174]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:38.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.370+0000 7fa5f5d9b700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa5e006cc00 0x7fa5e006f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec004d00 tx=0x7fa5ec009ce0 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:38.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.377+0000 7fa5e6ffd700 1 -- 172.21.15.67:0/3803279441 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa5e805af40 con 0x7fa5f80fc9f0 2023-12-05T09:27:38.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:38 smithi134 ceph-mon[116304]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:38.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.687+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5f8111750 con 0x7fa5e006cc00 2023-12-05T09:27:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.709+0000 7fa5e6ffd700 1 -- 172.21.15.67:0/3803279441 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa5f8111750 con 0x7fa5e006cc00 2023-12-05T09:27:38.709 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (80s) 13s ago 8m 15.8M - 0.25.0 c8568f914cd2 2984231be6c0 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (9m) 13s ago 9m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (8m) 30s ago 8m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (70s) 13s ago 8m 79.0M - 9.4.7 2c41d148cca3 1ec402b5237f 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (4m) 13s ago 4m 3648M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (4m) 13s ago 4m 3337M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (3m) 30s ago 3m 13.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (4m) 30s ago 4m 13.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (48s) 13s ago 10m 480M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283 running (2m) 30s ago 7m 97.9M - 19.0.0-11-g3fe8d441 56dea28e5206 86a20ad48d27 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (10m) 13s ago 10m 91.7M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (7m) 30s ago 7m 62.1M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:27:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (90s) 13s ago 8m 7948k - 1.5.0 0da6a335fe13 679ffe8a73ff 2023-12-05T09:27:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (56s) 30s ago 7m 7952k - 1.5.0 0da6a335fe13 83a517ef1242 2023-12-05T09:27:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (7m) 13s ago 7m 550M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:27:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (6m) 13s ago 6m 608M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:27:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (6m) 13s ago 6m 445M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:27:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (6m) 30s ago 6m 701M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:27:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (5m) 30s ago 5m 544M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:27:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (5m) 30s ago 5m 617M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:27:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (60s) 13s ago 8m 41.9M - 2.43.0 a07b618ecd1d 855d0c57cbce 2023-12-05T09:27:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa5e006cc00 msgr2=0x7fa5e006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa5e006cc00 0x7fa5e006f0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec004d00 tx=0x7fa5ec009ce0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f80fc9f0 msgr2=0x7fa5f810f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f80fc9f0 0x7fa5f810f580 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8000c00 tx=0x7fa5e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 shutdown_connections 2023-12-05T09:27:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa5e006cc00 0x7fa5e006f0b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa5f80fc9f0 0x7fa5f810f580 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 --2- 172.21.15.67:0/3803279441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5f80fdc00 0x7fa5f810fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.714+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 >> 172.21.15.67:0/3803279441 conn(0x7fa5f80f8090 msgr2=0x7fa5f8100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:38.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.715+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 shutdown_connections 2023-12-05T09:27:38.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.715+0000 7fa5f759e700 1 -- 172.21.15.67:0/3803279441 wait complete. 2023-12-05T09:27:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.926+0000 7fb4286e1700 1 -- 172.21.15.67:0/2531761793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fde00 msgr2=0x7fb4200fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.926+0000 7fb4286e1700 1 --2- 172.21.15.67:0/2531761793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fde00 0x7fb4200fe250 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb41c004940 tx=0x7fb41c009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.926+0000 7fb4286e1700 1 -- 172.21.15.67:0/2531761793 shutdown_connections 2023-12-05T09:27:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.926+0000 7fb4286e1700 1 --2- 172.21.15.67:0/2531761793 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fde00 0x7fb4200fe250 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.926+0000 7fb4286e1700 1 --2- 172.21.15.67:0/2531761793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4200fcbf0 0x7fb4200fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.926+0000 7fb4286e1700 1 -- 172.21.15.67:0/2531761793 >> 172.21.15.67:0/2531761793 conn(0x7fb4200f82d0 msgr2=0x7fb4200fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.927+0000 7fb4286e1700 1 -- 172.21.15.67:0/2531761793 shutdown_connections 2023-12-05T09:27:38.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.927+0000 7fb4286e1700 1 -- 172.21.15.67:0/2531761793 wait complete. 2023-12-05T09:27:38.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.928+0000 7fb4286e1700 1 Processor -- start 2023-12-05T09:27:38.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.928+0000 7fb4286e1700 1 -- start start 2023-12-05T09:27:38.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.929+0000 7fb4286e1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fcbf0 0x7fb42010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:38.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.929+0000 7fb4286e1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4200fde00 0x7fb42010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.929+0000 7fb4286e1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42010e030 con 0x7fb4200fcbf0 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.929+0000 7fb4286e1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42010e8d0 con 0x7fb4200fde00 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.929+0000 7fb42647d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fcbf0 0x7fb42010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.929+0000 7fb42647d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fcbf0 0x7fb42010d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41594/0 (socket says 172.21.15.67:41594) 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.929+0000 7fb42647d700 1 -- 172.21.15.67:0/2740183654 learned_addr learned my addr 172.21.15.67:0/2740183654 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.929+0000 7fb425c7c700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4200fde00 0x7fb42010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.930+0000 7fb425c7c700 1 -- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fcbf0 msgr2=0x7fb42010d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.930+0000 7fb425c7c700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fcbf0 0x7fb42010d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:38.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.930+0000 7fb425c7c700 1 -- 172.21.15.67:0/2740183654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410005040 con 0x7fb4200fde00 2023-12-05T09:27:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.930+0000 7fb42647d700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fcbf0 0x7fb42010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:27:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.930+0000 7fb425c7c700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4200fde00 0x7fb42010da30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009fd0 tx=0x7fb41c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.931+0000 7fb416ffd700 1 -- 172.21.15.67:0/2740183654 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb41c00e070 con 0x7fb4200fde00 2023-12-05T09:27:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.931+0000 7fb416ffd700 1 -- 172.21.15.67:0/2740183654 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb41c01c400 con 0x7fb4200fde00 2023-12-05T09:27:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.931+0000 7fb416ffd700 1 -- 172.21.15.67:0/2740183654 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb41c00b650 con 0x7fb4200fde00 2023-12-05T09:27:38.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.931+0000 7fb4286e1700 1 -- 172.21.15.67:0/2740183654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c005040 con 0x7fb4200fde00 2023-12-05T09:27:38.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.931+0000 7fb4286e1700 1 -- 172.21.15.67:0/2740183654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42010ee50 con 0x7fb4200fde00 2023-12-05T09:27:38.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.933+0000 7fb414ff9700 1 -- 172.21.15.67:0/2740183654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42004bb80 con 0x7fb4200fde00 2023-12-05T09:27:38.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.934+0000 7fb416ffd700 1 -- 172.21.15.67:0/2740183654 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fb41c01c570 con 0x7fb4200fde00 2023-12-05T09:27:38.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.935+0000 7fb416ffd700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb40c06cc00 0x7fb40c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:38.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.935+0000 7fb416ffd700 1 -- 172.21.15.67:0/2740183654 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb41c08d610 con 0x7fb4200fde00 2023-12-05T09:27:38.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.936+0000 7fb42647d700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb40c06cc00 0x7fb40c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:38.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.936+0000 7fb42647d700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb40c06cc00 0x7fb40c06f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb4100041d0 tx=0x7fb41000b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:38.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:38.940+0000 7fb416ffd700 1 -- 172.21.15.67:0/2740183654 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb41c05b240 con 0x7fb4200fde00 2023-12-05T09:27:39.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:39 smithi067 ceph-mon[107174]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:39.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:39 smithi067 ceph-mon[107174]: pgmap v20: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 327 op/s 2023-12-05T09:27:39.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:39 smithi067 ceph-mon[107174]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:39.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:39 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:39.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:39 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:39.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:39 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:27:39.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:39 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:27:39.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:39 smithi134 ceph-mon[116304]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:39.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:39 smithi134 ceph-mon[116304]: pgmap v20: 65 pgs: 65 active+clean; 334 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.7 MiB/s wr, 327 op/s 2023-12-05T09:27:39.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:39 smithi134 ceph-mon[116304]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:39.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:39 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:39.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:39 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:39.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:39 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:27:39.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:39 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:27:39.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.409+0000 7fb414ff9700 1 -- 172.21.15.67:0/2740183654 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4201153b0 con 0x7fb4200fde00 2023-12-05T09:27:39.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.410+0000 7fb416ffd700 1 -- 172.21.15.67:0/2740183654 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fb41c05add0 con 0x7fb4200fde00 2023-12-05T09:27:39.409 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:27:39.410 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T09:27:39.411 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:27:39.411 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:27:39.411 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.413+0000 7fb414ff9700 1 -- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb40c06cc00 msgr2=0x7fb40c06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.413+0000 7fb414ff9700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb40c06cc00 0x7fb40c06f0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb4100041d0 tx=0x7fb41000b040 comp rx=0 tx=0).stop 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.413+0000 7fb414ff9700 1 -- 172.21.15.67:0/2740183654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4200fde00 msgr2=0x7fb42010da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.413+0000 7fb414ff9700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4200fde00 0x7fb42010da30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009fd0 tx=0x7fb41c009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.414+0000 7fb414ff9700 1 -- 172.21.15.67:0/2740183654 shutdown_connections 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.414+0000 7fb414ff9700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb40c06cc00 0x7fb40c06f0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.414+0000 7fb414ff9700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4200fcbf0 0x7fb42010d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.414+0000 7fb414ff9700 1 --2- 172.21.15.67:0/2740183654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4200fde00 0x7fb42010da30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:39.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.414+0000 7fb414ff9700 1 -- 172.21.15.67:0/2740183654 >> 172.21.15.67:0/2740183654 conn(0x7fb4200f82d0 msgr2=0x7fb420101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.414+0000 7fb414ff9700 1 -- 172.21.15.67:0/2740183654 shutdown_connections 2023-12-05T09:27:39.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.414+0000 7fb414ff9700 1 -- 172.21.15.67:0/2740183654 wait complete. 2023-12-05T09:27:39.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.639+0000 7fde84e86700 1 -- 172.21.15.67:0/3770437860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 msgr2=0x7fde800fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:39.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.639+0000 7fde84e86700 1 --2- 172.21.15.67:0/3770437860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 0x7fde800fbf00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde78009ce0 tx=0x7fde78004d10 comp rx=0 tx=0).stop 2023-12-05T09:27:39.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.639+0000 7fde84e86700 1 -- 172.21.15.67:0/3770437860 shutdown_connections 2023-12-05T09:27:39.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.639+0000 7fde84e86700 1 --2- 172.21.15.67:0/3770437860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde800fcd00 0x7fde800fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:39.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.639+0000 7fde84e86700 1 --2- 172.21.15.67:0/3770437860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 0x7fde800fbf00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:39.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.639+0000 7fde84e86700 1 -- 172.21.15.67:0/3770437860 >> 172.21.15.67:0/3770437860 conn(0x7fde800f7190 msgr2=0x7fde800f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:39.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.639+0000 7fde84e86700 1 -- 172.21.15.67:0/3770437860 shutdown_connections 2023-12-05T09:27:39.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.639+0000 7fde84e86700 1 -- 172.21.15.67:0/3770437860 wait complete. 2023-12-05T09:27:39.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.641+0000 7fde84e86700 1 Processor -- start 2023-12-05T09:27:39.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.641+0000 7fde84e86700 1 -- start start 2023-12-05T09:27:39.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.642+0000 7fde84e86700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 0x7fde80103be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:39.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.642+0000 7fde84e86700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde800fcd00 0x7fde80102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:39.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.642+0000 7fde84e86700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde80102660 con 0x7fde800fcd00 2023-12-05T09:27:39.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.642+0000 7fde84e86700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde801027d0 con 0x7fde800fbaf0 2023-12-05T09:27:39.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.643+0000 7fde7e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 0x7fde80103be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:39.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.643+0000 7fde7e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 0x7fde80103be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:50474/0 (socket says 172.21.15.67:50474) 2023-12-05T09:27:39.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.643+0000 7fde7e59c700 1 -- 172.21.15.67:0/3243647232 learned_addr learned my addr 172.21.15.67:0/3243647232 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:27:39.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.643+0000 7fde7dd9b700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde800fcd00 0x7fde80102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:39.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.644+0000 7fde7e59c700 1 -- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde800fcd00 msgr2=0x7fde80102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:39.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.644+0000 7fde7e59c700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde800fcd00 0x7fde80102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:39.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.644+0000 7fde7e59c700 1 -- 172.21.15.67:0/3243647232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70005040 con 0x7fde800fbaf0 2023-12-05T09:27:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.645+0000 7fde7e59c700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 0x7fde80103be0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde78009390 tx=0x7fde78004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:39.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.645+0000 7fde6effd700 1 -- 172.21.15.67:0/3243647232 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde7800e040 con 0x7fde800fbaf0 2023-12-05T09:27:39.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.646+0000 7fde6effd700 1 -- 172.21.15.67:0/3243647232 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde78004610 con 0x7fde800fbaf0 2023-12-05T09:27:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.646+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde78009940 con 0x7fde800fbaf0 2023-12-05T09:27:39.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.646+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde80102e00 con 0x7fde800fbaf0 2023-12-05T09:27:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.646+0000 7fde6effd700 1 -- 172.21.15.67:0/3243647232 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde78012ae0 con 0x7fde800fbaf0 2023-12-05T09:27:39.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.648+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600052e0 con 0x7fde800fbaf0 2023-12-05T09:27:39.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.650+0000 7fde6effd700 1 -- 172.21.15.67:0/3243647232 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fde78012d20 con 0x7fde800fbaf0 2023-12-05T09:27:39.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.652+0000 7fde6effd700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fde6806cc00 0x7fde6806f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:27:39.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.653+0000 7fde6effd700 1 -- 172.21.15.67:0/3243647232 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fde7808e230 con 0x7fde800fbaf0 2023-12-05T09:27:39.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.653+0000 7fde7dd9b700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fde6806cc00 0x7fde6806f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:27:39.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.654+0000 7fde7dd9b700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fde6806cc00 0x7fde6806f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fde70009fd0 tx=0x7fde70009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:27:39.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:39.657+0000 7fde6effd700 1 -- 172.21.15.67:0/3243647232 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fde7805be80 con 0x7fde800fbaf0 2023-12-05T09:27:40.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.030+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde60000bf0 con 0x7fde6806cc00 2023-12-05T09:27:40.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.031+0000 7fde6effd700 1 -- 172.21.15.67:0/3243647232 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fde60000bf0 con 0x7fde6806cc00 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "", 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:27:40.032 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:27:40.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fde6806cc00 msgr2=0x7fde6806f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:40.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fde6806cc00 0x7fde6806f0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fde70009fd0 tx=0x7fde70009e30 comp rx=0 tx=0).stop 2023-12-05T09:27:40.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 msgr2=0x7fde80103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:27:40.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 0x7fde80103be0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde78009390 tx=0x7fde78004d10 comp rx=0 tx=0).stop 2023-12-05T09:27:40.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 shutdown_connections 2023-12-05T09:27:40.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fde6806cc00 0x7fde6806f0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:40.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde800fbaf0 0x7fde80103be0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:40.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 --2- 172.21.15.67:0/3243647232 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fde800fcd00 0x7fde80102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:27:40.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 >> 172.21.15.67:0/3243647232 conn(0x7fde800f7190 msgr2=0x7fde800f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:27:40.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 shutdown_connections 2023-12-05T09:27:40.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:27:40.034+0000 7fde84e86700 1 -- 172.21.15.67:0/3243647232 wait complete. 2023-12-05T09:27:40.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:40 smithi067 ceph-mon[107174]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:27:40.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:40 smithi067 ceph-mon[107174]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:27:40.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:40 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2740183654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:27:40.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:40 smithi067 ceph-mon[107174]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:27:40.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:40 smithi067 ceph-mon[107174]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:27:40.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:40 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:27:40.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:40 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:27:40.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:40 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2740183654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:27:40.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:40 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:27:40.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:40 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:27:41.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:41 smithi067 ceph-mon[107174]: from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:41.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:41 smithi067 ceph-mon[107174]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:27:41.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:41 smithi067 ceph-mon[107174]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:27:41.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:41 smithi067 ceph-mon[107174]: pgmap v21: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 377 op/s 2023-12-05T09:27:41.370 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:41 smithi067 ceph-mon[107174]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:27:41.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:41 smithi134 ceph-mon[116304]: from='client.24557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:27:41.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:41 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:27:41.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:41 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:27:41.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:41 smithi134 ceph-mon[116304]: pgmap v21: 65 pgs: 65 active+clean; 333 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 377 op/s 2023-12-05T09:27:41.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:41 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:27:42.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:42 smithi067 ceph-mon[107174]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:27:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:42 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:42 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:42 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:42 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:42 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:42 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:27:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:42 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:42 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:42 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:42 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:42 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:43.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:43 smithi067 ceph-mon[107174]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2023-12-05T09:27:43.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:43 smithi067 ceph-mon[107174]: pgmap v22: 65 pgs: 65 active+clean; 335 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.3 MiB/s wr, 457 op/s 2023-12-05T09:27:43.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:43 smithi067 ceph-mon[107174]: Reconfiguring daemon prometheus.smithi067 on smithi067 2023-12-05T09:27:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:43 smithi134 ceph-mon[116304]: Reconfiguring prometheus.smithi067 (dependencies changed)... 2023-12-05T09:27:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:43 smithi134 ceph-mon[116304]: pgmap v22: 65 pgs: 65 active+clean; 335 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 2.3 MiB/s wr, 457 op/s 2023-12-05T09:27:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:43 smithi134 ceph-mon[116304]: Reconfiguring daemon prometheus.smithi067 on smithi067 2023-12-05T09:27:45.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:45 smithi067 ceph-mon[107174]: pgmap v23: 65 pgs: 65 active+clean; 335 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 295 op/s 2023-12-05T09:27:45.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:45 smithi134 ceph-mon[116304]: pgmap v23: 65 pgs: 65 active+clean; 335 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 295 op/s 2023-12-05T09:27:47.943 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:47 smithi134 ceph-mon[116304]: pgmap v24: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.1 MiB/s wr, 414 op/s 2023-12-05T09:27:47.943 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:47 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:47.943 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:47 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:47.943 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:27:47.943 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:47 smithi134 ceph-mon[116304]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:27:47.944 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:47 smithi067 ceph-mon[107174]: pgmap v24: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.1 MiB/s wr, 414 op/s 2023-12-05T09:27:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:47 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:47 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:27:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:47 smithi067 ceph-mon[107174]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:27:48.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:49.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:48 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:27:49.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:48 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:27:49.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:48 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:27:49.183 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:48 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:27:49.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:48 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:27:49.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:48 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:27:49.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:48 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:27:49.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:48 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:27:50.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:49 smithi067 ceph-mon[107174]: Upgrade: Updating mgr.smithi134.yfqkak 2023-12-05T09:27:50.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:49 smithi067 ceph-mon[107174]: Deploying daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:27:50.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:49 smithi067 ceph-mon[107174]: pgmap v25: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 284 op/s 2023-12-05T09:27:50.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:49 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:27:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:49 smithi134 ceph-mon[116304]: Upgrade: Updating mgr.smithi134.yfqkak 2023-12-05T09:27:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:49 smithi134 ceph-mon[116304]: Deploying daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:27:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:49 smithi134 ceph-mon[116304]: pgmap v25: 65 pgs: 65 active+clean; 338 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 284 op/s 2023-12-05T09:27:50.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:49 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:27:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:51 smithi134 ceph-mon[116304]: pgmap v26: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 390 op/s 2023-12-05T09:27:52.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:51 smithi067 ceph-mon[107174]: pgmap v26: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 390 op/s 2023-12-05T09:27:53.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:52 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:53.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:52 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:53.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:52 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:53.266 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:52 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:53.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:52 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:53.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:52 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:27:54.325 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:53 smithi134 ceph-mon[116304]: pgmap v27: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 2.1 MiB/s wr, 427 op/s 2023-12-05T09:27:54.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:53 smithi067 ceph-mon[107174]: pgmap v27: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 2.1 MiB/s wr, 427 op/s 2023-12-05T09:27:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:55 smithi067 ceph-mon[107174]: pgmap v28: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 313 op/s 2023-12-05T09:27:56.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:55 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:56.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:55 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:56.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:55 smithi134 ceph-mon[116304]: pgmap v28: 65 pgs: 65 active+clean; 341 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 313 op/s 2023-12-05T09:27:56.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:55 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:56.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:55 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:58.054 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:57 smithi134 ceph-mon[116304]: pgmap v29: 65 pgs: 65 active+clean; 340 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.4 MiB/s wr, 506 op/s 2023-12-05T09:27:58.054 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:57 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:58.055 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:57 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:58.055 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:57 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:58.055 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:57 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:58.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:57 smithi067 ceph-mon[107174]: pgmap v29: 65 pgs: 65 active+clean; 340 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.4 MiB/s wr, 506 op/s 2023-12-05T09:27:58.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:57 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:58.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:57 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:58.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:57 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:27:58.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:57 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:00.076 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:27:59 smithi134 ceph-mon[116304]: pgmap v30: 65 pgs: 65 active+clean; 340 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.8 MiB/s wr, 386 op/s 2023-12-05T09:28:00.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:27:59 smithi067 ceph-mon[107174]: pgmap v30: 65 pgs: 65 active+clean; 340 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.8 MiB/s wr, 386 op/s 2023-12-05T09:28:01.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:28:01.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:28:01.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: pgmap v31: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 2.5 MiB/s wr, 500 op/s 2023-12-05T09:28:01.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:01.590 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all mgr 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.alxtvv"}]: dispatch 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.alxtvv"}]: dispatch 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.alxtvv"}]': finished 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.yfqkak"}]: dispatch 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.yfqkak"}]: dispatch 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.yfqkak"}]': finished 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all rgw 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all rbd-mirror 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.591 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all ceph-exporter 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all iscsi 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all nfs 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all nvmeof 2023-12-05T09:28:01.592 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: pgmap v31: 65 pgs: 65 active+clean; 342 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 2.5 MiB/s wr, 500 op/s 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all mgr 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.alxtvv"}]: dispatch 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.alxtvv"}]: dispatch 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.alxtvv"}]': finished 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.yfqkak"}]: dispatch 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.yfqkak"}]: dispatch 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.yfqkak"}]': finished 2023-12-05T09:28:01.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all rgw 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all rbd-mirror 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all cephfs-mirror 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all ceph-exporter 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all iscsi 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all nfs 2023-12-05T09:28:01.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:01.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:01.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all nvmeof 2023-12-05T09:28:01.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:02.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:02 smithi134 ceph-mon[116304]: Standby manager daemon smithi134.yfqkak restarted 2023-12-05T09:28:02.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:02 smithi134 ceph-mon[116304]: Standby manager daemon smithi134.yfqkak started 2023-12-05T09:28:02.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:02 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/3557102691' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:28:02.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:02 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/3557102691' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:28:02.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:02 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/3557102691' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:28:02.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:02 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/3557102691' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:28:02.707 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-05T09:28:02.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-05T09:28:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:02 smithi067 ceph-mon[107174]: Standby manager daemon smithi134.yfqkak restarted 2023-12-05T09:28:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:02 smithi067 ceph-mon[107174]: Standby manager daemon smithi134.yfqkak started 2023-12-05T09:28:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:02 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/3557102691' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:28:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:02 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/3557102691' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:28:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:02 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/3557102691' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:28:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:02 smithi067 ceph-mon[107174]: from='mgr.? 172.21.15.134:0/3557102691' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:28:03.758 DEBUG:teuthology.parallel:result is None 2023-12-05T09:28:03.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:03 smithi067 ceph-mon[107174]: mgrmap e32: smithi067.alxtvv(active, since 58s), standbys: smithi134.yfqkak 2023-12-05T09:28:03.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:03 smithi067 ceph-mon[107174]: Upgrade: Updating node-exporter.smithi067 (1/2) 2023-12-05T09:28:03.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:03 smithi067 ceph-mon[107174]: Deploying daemon node-exporter.smithi067 on smithi067 2023-12-05T09:28:03.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:03 smithi067 ceph-mon[107174]: pgmap v32: 65 pgs: 65 active+clean; 338 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 461 op/s 2023-12-05T09:28:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:03 smithi134 ceph-mon[116304]: mgrmap e32: smithi067.alxtvv(active, since 58s), standbys: smithi134.yfqkak 2023-12-05T09:28:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:03 smithi134 ceph-mon[116304]: Upgrade: Updating node-exporter.smithi067 (1/2) 2023-12-05T09:28:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:03 smithi134 ceph-mon[116304]: Deploying daemon node-exporter.smithi067 on smithi067 2023-12-05T09:28:03.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:03 smithi134 ceph-mon[116304]: pgmap v32: 65 pgs: 65 active+clean; 338 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.9 MiB/s wr, 461 op/s 2023-12-05T09:28:05.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:05 smithi067 ceph-mon[107174]: pgmap v33: 65 pgs: 65 active+clean; 338 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 373 op/s 2023-12-05T09:28:05.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:28:05.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:05 smithi134 ceph-mon[116304]: pgmap v33: 65 pgs: 65 active+clean; 338 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 373 op/s 2023-12-05T09:28:05.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:28:07.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:07 smithi067 ceph-mon[107174]: pgmap v34: 65 pgs: 65 active+clean; 333 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 523 op/s 2023-12-05T09:28:07.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:07 smithi134 ceph-mon[116304]: pgmap v34: 65 pgs: 65 active+clean; 333 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 523 op/s 2023-12-05T09:28:07.451 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-05T09:28:07.451 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-05T09:28:08.465 DEBUG:teuthology.parallel:result is None 2023-12-05T09:28:08.466 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-05T09:28:08.552 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-05T09:28:08.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-05T09:28:08.633 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-05T09:28:08.633 DEBUG:teuthology.parallel:result is None 2023-12-05T09:28:09.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:09 smithi067 ceph-mon[107174]: pgmap v35: 65 pgs: 65 active+clean; 333 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 330 op/s 2023-12-05T09:28:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:09 smithi134 ceph-mon[116304]: pgmap v35: 65 pgs: 65 active+clean; 333 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 330 op/s 2023-12-05T09:28:10.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.200+0000 7fb207f07700 1 -- 172.21.15.67:0/1046567407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fcbf0 msgr2=0x7fb2000fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.200+0000 7fb207f07700 1 --2- 172.21.15.67:0/1046567407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fcbf0 0x7fb2000fd000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc004940 tx=0x7fb1fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:10.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.201+0000 7fb207f07700 1 -- 172.21.15.67:0/1046567407 shutdown_connections 2023-12-05T09:28:10.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.201+0000 7fb207f07700 1 --2- 172.21.15.67:0/1046567407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2000fde00 0x7fb2000fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.201+0000 7fb207f07700 1 --2- 172.21.15.67:0/1046567407 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fcbf0 0x7fb2000fd000 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.201+0000 7fb207f07700 1 -- 172.21.15.67:0/1046567407 >> 172.21.15.67:0/1046567407 conn(0x7fb2000f82d0 msgr2=0x7fb2000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:10.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.201+0000 7fb207f07700 1 -- 172.21.15.67:0/1046567407 shutdown_connections 2023-12-05T09:28:10.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.201+0000 7fb207f07700 1 -- 172.21.15.67:0/1046567407 wait complete. 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.201+0000 7fb207f07700 1 Processor -- start 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.202+0000 7fb207f07700 1 -- start start 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.202+0000 7fb207f07700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2000fcbf0 0x7fb20010f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.202+0000 7fb207f07700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fde00 0x7fb20010fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.202+0000 7fb207f07700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200110310 con 0x7fb2000fde00 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.202+0000 7fb207f07700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200110b50 con 0x7fb2000fcbf0 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.202+0000 7fb2054a2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fde00 0x7fb20010fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.202+0000 7fb2054a2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fde00 0x7fb20010fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56400/0 (socket says 172.21.15.67:56400) 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.202+0000 7fb2054a2700 1 -- 172.21.15.67:0/2167777693 learned_addr learned my addr 172.21.15.67:0/2167777693 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb205ca3700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2000fcbf0 0x7fb20010f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb2054a2700 1 -- 172.21.15.67:0/2167777693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2000fcbf0 msgr2=0x7fb20010f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb2054a2700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2000fcbf0 0x7fb20010f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb2054a2700 1 -- 172.21.15.67:0/2167777693 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc005040 con 0x7fb2000fde00 2023-12-05T09:28:10.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb205ca3700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2000fcbf0 0x7fb20010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:28:10.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb2054a2700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fde00 0x7fb20010fc80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000b790 tx=0x7fb1f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:10.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb1f67fc700 1 -- 172.21.15.67:0/2167777693 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1f000f770 con 0x7fb2000fde00 2023-12-05T09:28:10.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb1f67fc700 1 -- 172.21.15.67:0/2167777693 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1f000fd80 con 0x7fb2000fde00 2023-12-05T09:28:10.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb1f67fc700 1 -- 172.21.15.67:0/2167777693 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1f000d310 con 0x7fb2000fde00 2023-12-05T09:28:10.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.203+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb200110e30 con 0x7fb2000fde00 2023-12-05T09:28:10.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.204+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb200111370 con 0x7fb2000fde00 2023-12-05T09:28:10.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.205+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb200101ea0 con 0x7fb2000fde00 2023-12-05T09:28:10.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.207+0000 7fb1f67fc700 1 -- 172.21.15.67:0/2167777693 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fb1f0010420 con 0x7fb2000fde00 2023-12-05T09:28:10.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.208+0000 7fb1f67fc700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1ec06cc00 0x7fb1ec06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.208+0000 7fb1f67fc700 1 -- 172.21.15.67:0/2167777693 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb1f008beb0 con 0x7fb2000fde00 2023-12-05T09:28:10.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.208+0000 7fb205ca3700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1ec06cc00 0x7fb1ec06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.209+0000 7fb205ca3700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1ec06cc00 0x7fb1ec06f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00b3b0 tx=0x7fb1fc009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:10.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.213+0000 7fb1f67fc700 1 -- 172.21.15.67:0/2167777693 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb1f0059bf0 con 0x7fb2000fde00 2023-12-05T09:28:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.449+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb200111750 con 0x7fb1ec06cc00 2023-12-05T09:28:10.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.450+0000 7fb1f67fc700 1 -- 172.21.15.67:0/2167777693 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fb200111750 con 0x7fb1ec06cc00 2023-12-05T09:28:10.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1ec06cc00 msgr2=0x7fb1ec06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1ec06cc00 0x7fb1ec06f0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00b3b0 tx=0x7fb1fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:10.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fde00 msgr2=0x7fb20010fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fde00 0x7fb20010fc80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000b790 tx=0x7fb1f0009250 comp rx=0 tx=0).stop 2023-12-05T09:28:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 shutdown_connections 2023-12-05T09:28:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb1ec06cc00 0x7fb1ec06f0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2000fcbf0 0x7fb20010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 --2- 172.21.15.67:0/2167777693 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb2000fde00 0x7fb20010fc80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 >> 172.21.15.67:0/2167777693 conn(0x7fb2000f82d0 msgr2=0x7fb2000ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.452+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 shutdown_connections 2023-12-05T09:28:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.453+0000 7fb207f07700 1 -- 172.21.15.67:0/2167777693 wait complete. 2023-12-05T09:28:10.466 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:28:10.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.594+0000 7fe43ba16700 1 -- 172.21.15.67:0/1662848973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434070570 msgr2=0x7fe4340709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.594+0000 7fe43ba16700 1 --2- 172.21.15.67:0/1662848973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434070570 0x7fe4340709c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe424004940 tx=0x7fe424009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:10.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.594+0000 7fe43ba16700 1 -- 172.21.15.67:0/1662848973 shutdown_connections 2023-12-05T09:28:10.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.594+0000 7fe43ba16700 1 --2- 172.21.15.67:0/1662848973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434070570 0x7fe4340709c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.594+0000 7fe43ba16700 1 --2- 172.21.15.67:0/1662848973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe434071bc0 0x7fe434070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.594+0000 7fe43ba16700 1 -- 172.21.15.67:0/1662848973 >> 172.21.15.67:0/1662848973 conn(0x7fe4340f82d0 msgr2=0x7fe4340fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:10.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.594+0000 7fe43ba16700 1 -- 172.21.15.67:0/1662848973 shutdown_connections 2023-12-05T09:28:10.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.595+0000 7fe43ba16700 1 -- 172.21.15.67:0/1662848973 wait complete. 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.595+0000 7fe43ba16700 1 Processor -- start 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.595+0000 7fe43ba16700 1 -- start start 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe43ba16700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe434070570 0x7fe43410f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe43ba16700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434071bc0 0x7fe43410fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe43ba16700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434110240 con 0x7fe434071bc0 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe43ba16700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434110ae0 con 0x7fe434070570 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe438fb1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434071bc0 0x7fe43410fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe438fb1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434071bc0 0x7fe43410fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56424/0 (socket says 172.21.15.67:56424) 2023-12-05T09:28:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe438fb1700 1 -- 172.21.15.67:0/1585979256 learned_addr learned my addr 172.21.15.67:0/1585979256 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe4397b2700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe434070570 0x7fe43410f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.596+0000 7fe438fb1700 1 -- 172.21.15.67:0/1585979256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe434070570 msgr2=0x7fe43410f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.597+0000 7fe438fb1700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe434070570 0x7fe43410f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.597+0000 7fe438fb1700 1 -- 172.21.15.67:0/1585979256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424005040 con 0x7fe434071bc0 2023-12-05T09:28:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.597+0000 7fe438fb1700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434071bc0 0x7fe43410fc40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe424004890 tx=0x7fe424009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.597+0000 7fe429ffb700 1 -- 172.21.15.67:0/1585979256 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe424021070 con 0x7fe434071bc0 2023-12-05T09:28:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.597+0000 7fe429ffb700 1 -- 172.21.15.67:0/1585979256 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe424004290 con 0x7fe434071bc0 2023-12-05T09:28:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.597+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe434110d60 con 0x7fe434071bc0 2023-12-05T09:28:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.597+0000 7fe429ffb700 1 -- 172.21.15.67:0/1585979256 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42400e070 con 0x7fe434071bc0 2023-12-05T09:28:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.597+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe434111240 con 0x7fe434071bc0 2023-12-05T09:28:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.599+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43404bb80 con 0x7fe434071bc0 2023-12-05T09:28:10.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.599+0000 7fe429ffb700 1 -- 172.21.15.67:0/1585979256 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7fe42401c690 con 0x7fe434071bc0 2023-12-05T09:28:10.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.600+0000 7fe429ffb700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fe42006cc00 0x7fe42006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.600+0000 7fe429ffb700 1 -- 172.21.15.67:0/1585979256 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe42408d050 con 0x7fe434071bc0 2023-12-05T09:28:10.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.601+0000 7fe4397b2700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fe42006cc00 0x7fe42006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.601+0000 7fe4397b2700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fe42006cc00 0x7fe42006f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe430009b80 tx=0x7fe43000b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:10.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.605+0000 7fe429ffb700 1 -- 172.21.15.67:0/1585979256 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe42405ad40 con 0x7fe434071bc0 2023-12-05T09:28:10.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.833+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4341116e0 con 0x7fe42006cc00 2023-12-05T09:28:10.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.835+0000 7fe429ffb700 1 -- 172.21.15.67:0/1585979256 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fe4341116e0 con 0x7fe42006cc00 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fe42006cc00 msgr2=0x7fe42006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fe42006cc00 0x7fe42006f0b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe430009b80 tx=0x7fe43000b040 comp rx=0 tx=0).stop 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434071bc0 msgr2=0x7fe43410fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434071bc0 0x7fe43410fc40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe424004890 tx=0x7fe424009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 shutdown_connections 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fe42006cc00 0x7fe42006f0b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe434070570 0x7fe43410f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 --2- 172.21.15.67:0/1585979256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe434071bc0 0x7fe43410fc40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 >> 172.21.15.67:0/1585979256 conn(0x7fe4340f82d0 msgr2=0x7fe434102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:10.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 shutdown_connections 2023-12-05T09:28:10.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.837+0000 7fe43ba16700 1 -- 172.21.15.67:0/1585979256 wait complete. 2023-12-05T09:28:10.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.990+0000 7f36f9db0700 1 -- 172.21.15.67:0/2111765365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4070570 msgr2=0x7f36f40709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.990+0000 7f36f9db0700 1 --2- 172.21.15.67:0/2111765365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4070570 0x7f36f40709c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f36e0004940 tx=0x7f36e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:10.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.990+0000 7f36f9db0700 1 -- 172.21.15.67:0/2111765365 shutdown_connections 2023-12-05T09:28:10.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.990+0000 7f36f9db0700 1 --2- 172.21.15.67:0/2111765365 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4070570 0x7f36f40709c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.990+0000 7f36f9db0700 1 --2- 172.21.15.67:0/2111765365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f4071bc0 0x7f36f4070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.990+0000 7f36f9db0700 1 -- 172.21.15.67:0/2111765365 >> 172.21.15.67:0/2111765365 conn(0x7f36f40f8090 msgr2=0x7f36f40fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:10.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.991+0000 7f36f9db0700 1 -- 172.21.15.67:0/2111765365 shutdown_connections 2023-12-05T09:28:10.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.991+0000 7f36f9db0700 1 -- 172.21.15.67:0/2111765365 wait complete. 2023-12-05T09:28:10.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.991+0000 7f36f9db0700 1 Processor -- start 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.991+0000 7f36f9db0700 1 -- start start 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f9db0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f4070570 0x7f36f410f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f9db0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4071bc0 0x7f36f410fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f9db0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4110070 con 0x7f36f4071bc0 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f9db0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f4110910 con 0x7f36f4070570 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4071bc0 0x7f36f410fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4071bc0 0x7f36f410fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56438/0 (socket says 172.21.15.67:56438) 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f3fff700 1 -- 172.21.15.67:0/3671076921 learned_addr learned my addr 172.21.15.67:0/3671076921 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f8dae700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f4070570 0x7f36f410f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f3fff700 1 -- 172.21.15.67:0/3671076921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f4070570 msgr2=0x7f36f410f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f3fff700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f4070570 0x7f36f410f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:10.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.992+0000 7f36f3fff700 1 -- 172.21.15.67:0/3671076921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0005040 con 0x7f36f4071bc0 2023-12-05T09:28:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.993+0000 7f36f3fff700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4071bc0 0x7f36f410fa70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f36e0000c00 tx=0x7f36e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.993+0000 7f36f17fa700 1 -- 172.21.15.67:0/3671076921 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36e000e040 con 0x7f36f4071bc0 2023-12-05T09:28:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.993+0000 7f36f17fa700 1 -- 172.21.15.67:0/3671076921 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36e0004290 con 0x7f36f4071bc0 2023-12-05T09:28:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.993+0000 7f36f17fa700 1 -- 172.21.15.67:0/3671076921 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36e001c3f0 con 0x7f36f4071bc0 2023-12-05T09:28:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.993+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f4110b90 con 0x7f36f4071bc0 2023-12-05T09:28:10.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.993+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f41110d0 con 0x7f36f4071bc0 2023-12-05T09:28:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.994+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f404bb80 con 0x7f36f4071bc0 2023-12-05T09:28:10.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.995+0000 7f36f17fa700 1 -- 172.21.15.67:0/3671076921 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f36e000bbf0 con 0x7f36f4071bc0 2023-12-05T09:28:10.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.996+0000 7f36f17fa700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f36e406cc00 0x7f36e406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:10.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.996+0000 7f36f17fa700 1 -- 172.21.15.67:0/3671076921 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f36e008d3f0 con 0x7f36f4071bc0 2023-12-05T09:28:10.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.996+0000 7f36f8dae700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f36e406cc00 0x7f36e406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:10.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:10.997+0000 7f36f8dae700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f36e406cc00 0x7f36e406f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f36e8004d60 tx=0x7f36e800b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.001+0000 7f36f17fa700 1 -- 172.21.15.67:0/3671076921 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f36e005b0d0 con 0x7f36f4071bc0 2023-12-05T09:28:11.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.223+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f36f4103fa0 con 0x7f36e406cc00 2023-12-05T09:28:11.390 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:28:11.390 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (112s) 13s ago 9m 15.8M - 0.25.0 c8568f914cd2 2984231be6c0 2023-12-05T09:28:11.390 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (9m) 13s ago 9m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (8m) 16s ago 8m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (103s) 13s ago 9m 81.7M - 9.4.7 2c41d148cca3 1ec402b5237f 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (4m) 13s ago 4m 5707M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (4m) 13s ago 4m 4816M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (4m) 16s ago 4m 13.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (4m) 16s ago 4m 14.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (80s) 13s ago 10m 501M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (19s) 16s ago 8m 54.5M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (10m) 13s ago 10m 93.2M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (8m) 16s ago 8m 64.7M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (2m) 13s ago 9m 8048k - 1.5.0 0da6a335fe13 679ffe8a73ff 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (89s) 16s ago 8m 7810k - 1.5.0 0da6a335fe13 83a517ef1242 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (7m) 13s ago 7m 718M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (7m) 13s ago 7m 785M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:28:11.391 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (6m) 13s ago 6m 598M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:28:11.392 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (6m) 16s ago 6m 925M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:28:11.392 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (6m) 16s ago 6m 710M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:28:11.392 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (5m) 16s ago 5m 805M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:28:11.392 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (24s) 13s ago 8m 34.5M - 2.43.0 a07b618ecd1d 7457e72f767f 2023-12-05T09:28:11.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.234+0000 7f36f17fa700 1 -- 172.21.15.67:0/3671076921 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f36f4103fa0 con 0x7f36e406cc00 2023-12-05T09:28:11.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f36e406cc00 msgr2=0x7f36e406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:11.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f36e406cc00 0x7f36e406f0b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f36e8004d60 tx=0x7f36e800b040 comp rx=0 tx=0).stop 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4071bc0 msgr2=0x7f36f410fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4071bc0 0x7f36f410fa70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f36e0000c00 tx=0x7f36e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 shutdown_connections 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f36e406cc00 0x7f36e406f0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36f4070570 0x7f36f410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 --2- 172.21.15.67:0/3671076921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36f4071bc0 0x7f36f410fa70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 >> 172.21.15.67:0/3671076921 conn(0x7f36f40f8090 msgr2=0x7f36f4102880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 shutdown_connections 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.236+0000 7f36f9db0700 1 -- 172.21.15.67:0/3671076921 wait complete. 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.373+0000 7f1590547700 1 -- 172.21.15.67:0/2821590440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 msgr2=0x7f15880fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.373+0000 7f1590547700 1 --2- 172.21.15.67:0/2821590440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 0x7f15880fd000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1584004940 tx=0x7f1584009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.373+0000 7f1590547700 1 -- 172.21.15.67:0/2821590440 shutdown_connections 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.373+0000 7f1590547700 1 --2- 172.21.15.67:0/2821590440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15880fde00 0x7f15880fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.373+0000 7f1590547700 1 --2- 172.21.15.67:0/2821590440 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 0x7f15880fd000 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.373+0000 7f1590547700 1 -- 172.21.15.67:0/2821590440 >> 172.21.15.67:0/2821590440 conn(0x7f15880f82d0 msgr2=0x7f15880fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.373+0000 7f1590547700 1 -- 172.21.15.67:0/2821590440 shutdown_connections 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.373+0000 7f1590547700 1 -- 172.21.15.67:0/2821590440 wait complete. 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.374+0000 7f1590547700 1 Processor -- start 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.374+0000 7f1590547700 1 -- start start 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.374+0000 7f1590547700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 0x7f1588071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f1590547700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15880fde00 0x7f158806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f1590547700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588070590 con 0x7f15880fcbf0 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f1590547700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588070700 con 0x7f15880fde00 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f158e2e3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 0x7f1588071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f158e2e3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 0x7f1588071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56452/0 (socket says 172.21.15.67:56452) 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f158e2e3700 1 -- 172.21.15.67:0/396308966 learned_addr learned my addr 172.21.15.67:0/396308966 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f158dae2700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15880fde00 0x7f158806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:11.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f158e2e3700 1 -- 172.21.15.67:0/396308966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15880fde00 msgr2=0x7f158806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f158e2e3700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15880fde00 0x7f158806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f158e2e3700 1 -- 172.21.15.67:0/396308966 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1584005040 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.375+0000 7f158e2e3700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 0x7f1588071b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1584009fd0 tx=0x7f1584009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.376+0000 7f157effd700 1 -- 172.21.15.67:0/396308966 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1584021070 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.376+0000 7f157effd700 1 -- 172.21.15.67:0/396308966 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f158401c400 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.376+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1588070980 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.376+0000 7f157effd700 1 -- 172.21.15.67:0/396308966 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f158400e070 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.376+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1588115520 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.377+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158804bb80 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.378+0000 7f157effd700 1 -- 172.21.15.67:0/396308966 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f158401c9c0 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.379+0000 7f157effd700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f157406cc00 0x7f157406f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.379+0000 7f157effd700 1 -- 172.21.15.67:0/396308966 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f158408d1c0 con 0x7f15880fcbf0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.379+0000 7f158dae2700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f157406cc00 0x7f157406f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.380+0000 7f158dae2700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f157406cc00 0x7f157406f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1578004600 tx=0x7f157800b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:11.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.383+0000 7f157effd700 1 -- 172.21.15.67:0/396308966 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f158405aeb0 con 0x7f15880fcbf0 2023-12-05T09:28:11.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.698+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f15881055b0 con 0x7f15880fcbf0 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.699+0000 7f157effd700 1 -- 172.21.15.67:0/396308966 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f158405aa40 con 0x7f15880fcbf0 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:28:11.698 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:28:11.699 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:28:11.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.701+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f157406cc00 msgr2=0x7f157406f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.701+0000 7f1590547700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f157406cc00 0x7f157406f0b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1578004600 tx=0x7f157800b040 comp rx=0 tx=0).stop 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.701+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 msgr2=0x7f1588071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.701+0000 7f1590547700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 0x7f1588071b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1584009fd0 tx=0x7f1584009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.702+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 shutdown_connections 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.702+0000 7f1590547700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f157406cc00 0x7f157406f0b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.702+0000 7f1590547700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15880fcbf0 0x7f1588071b10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.702+0000 7f1590547700 1 --2- 172.21.15.67:0/396308966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15880fde00 0x7f158806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.702+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 >> 172.21.15.67:0/396308966 conn(0x7f15880f82d0 msgr2=0x7f1588101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.702+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 shutdown_connections 2023-12-05T09:28:11.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.702+0000 7f1590547700 1 -- 172.21.15.67:0/396308966 wait complete. 2023-12-05T09:28:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.841+0000 7f06b6b78700 1 -- 172.21.15.67:0/2913549178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 msgr2=0x7f06b00fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.841+0000 7f06b6b78700 1 --2- 172.21.15.67:0/2913549178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 0x7f06b00fe250 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f069c004940 tx=0x7f069c009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.841+0000 7f06b6b78700 1 -- 172.21.15.67:0/2913549178 shutdown_connections 2023-12-05T09:28:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.841+0000 7f06b6b78700 1 --2- 172.21.15.67:0/2913549178 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 0x7f06b00fe250 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.841+0000 7f06b6b78700 1 --2- 172.21.15.67:0/2913549178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b00fcbf0 0x7f06b00fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.841+0000 7f06b6b78700 1 -- 172.21.15.67:0/2913549178 >> 172.21.15.67:0/2913549178 conn(0x7f06b00f82d0 msgr2=0x7f06b00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.841+0000 7f06b6b78700 1 -- 172.21.15.67:0/2913549178 shutdown_connections 2023-12-05T09:28:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.841+0000 7f06b6b78700 1 -- 172.21.15.67:0/2913549178 wait complete. 2023-12-05T09:28:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.842+0000 7f06b6b78700 1 Processor -- start 2023-12-05T09:28:11.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.842+0000 7f06b6b78700 1 -- start start 2023-12-05T09:28:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.842+0000 7f06b6b78700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b00fcbf0 0x7f06b010f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.842+0000 7f06b6b78700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 0x7f06b010fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.842+0000 7f06b6b78700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b0110310 con 0x7f06b00fde00 2023-12-05T09:28:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.842+0000 7f06b6b78700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b0110b60 con 0x7f06b00fcbf0 2023-12-05T09:28:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06affff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 0x7f06b010fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06affff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 0x7f06b010fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:56460/0 (socket says 172.21.15.67:56460) 2023-12-05T09:28:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06affff700 1 -- 172.21.15.67:0/1928839362 learned_addr learned my addr 172.21.15.67:0/1928839362 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:11.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06b4914700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b00fcbf0 0x7f06b010f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06affff700 1 -- 172.21.15.67:0/1928839362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b00fcbf0 msgr2=0x7f06b010f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06affff700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b00fcbf0 0x7f06b010f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06affff700 1 -- 172.21.15.67:0/1928839362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c005040 con 0x7f06b00fde00 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06affff700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 0x7f06b010fd10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f069c00b3b0 tx=0x7f069c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06ad7fa700 1 -- 172.21.15.67:0/1928839362 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f069c00e040 con 0x7f06b00fde00 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06ad7fa700 1 -- 172.21.15.67:0/1928839362 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f069c00bc50 con 0x7f06b00fde00 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b0110de0 con 0x7f06b00fde00 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.843+0000 7f06ad7fa700 1 -- 172.21.15.67:0/1928839362 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f069c01c630 con 0x7f06b00fde00 2023-12-05T09:28:11.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.844+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b0111320 con 0x7f06b00fde00 2023-12-05T09:28:11.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.845+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b0101ea0 con 0x7f06b00fde00 2023-12-05T09:28:11.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.846+0000 7f06ad7fa700 1 -- 172.21.15.67:0/1928839362 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 32) v1 ==== 90899+0+0 (secure 0 0 0) 0x7f069c013420 con 0x7f06b00fde00 2023-12-05T09:28:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.847+0000 7f06ad7fa700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f06a006cc00 0x7f06a006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.847+0000 7f06ad7fa700 1 -- 172.21.15.67:0/1928839362 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f069c08d470 con 0x7f06b00fde00 2023-12-05T09:28:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.847+0000 7f06b4914700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f06a006cc00 0x7f06a006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:11.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.848+0000 7f06b4914700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f06a006cc00 0x7f06a006f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f06b00fdc60 tx=0x7f06a400b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:11.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:11.851+0000 7f06ad7fa700 1 -- 172.21.15.67:0/1928839362 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f069c05b0a0 con 0x7f06b00fde00 2023-12-05T09:28:11.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:11 smithi067 ceph-mon[107174]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:11.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:11 smithi067 ceph-mon[107174]: pgmap v36: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 358 op/s 2023-12-05T09:28:11.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:11 smithi067 ceph-mon[107174]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:11.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:11 smithi134 ceph-mon[116304]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:11.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:11 smithi134 ceph-mon[116304]: pgmap v36: 65 pgs: 65 active+clean; 332 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 358 op/s 2023-12-05T09:28:11.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:11 smithi134 ceph-mon[116304]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:12.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.094+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06b0111650 con 0x7f06a006cc00 2023-12-05T09:28:12.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.096+0000 7f06ad7fa700 1 -- 172.21.15.67:0/1928839362 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f06b0111650 con 0x7f06a006cc00 2023-12-05T09:28:12.094 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading node-exporter daemons", 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:28:12.095 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f06a006cc00 msgr2=0x7f06a006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f06a006cc00 0x7f06a006f0b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f06b00fdc60 tx=0x7f06a400b040 comp rx=0 tx=0).stop 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 msgr2=0x7f06b010fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 0x7f06b010fd10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f069c00b3b0 tx=0x7f069c009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 shutdown_connections 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f06a006cc00 0x7f06a006f0b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b00fcbf0 0x7f06b010f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 --2- 172.21.15.67:0/1928839362 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b00fde00 0x7f06b010fd10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:12.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 >> 172.21.15.67:0/1928839362 conn(0x7f06b00f82d0 msgr2=0x7f06b00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:12.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 shutdown_connections 2023-12-05T09:28:12.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:12.098+0000 7f06b6b78700 1 -- 172.21.15.67:0/1928839362 wait complete. 2023-12-05T09:28:12.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:12 smithi067 ceph-mon[107174]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:12.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:12 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/396308966' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:12.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:12 smithi134 ceph-mon[116304]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:12.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:12 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/396308966' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:13.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:13 smithi067 ceph-mon[107174]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:13.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:13 smithi067 ceph-mon[107174]: pgmap v37: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 868 KiB/s wr, 280 op/s 2023-12-05T09:28:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:13 smithi134 ceph-mon[116304]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:13 smithi134 ceph-mon[116304]: pgmap v37: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 868 KiB/s wr, 280 op/s 2023-12-05T09:28:15.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:15 smithi067 ceph-mon[107174]: pgmap v38: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 866 KiB/s wr, 213 op/s 2023-12-05T09:28:15.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:15 smithi134 ceph-mon[116304]: pgmap v38: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 866 KiB/s wr, 213 op/s 2023-12-05T09:28:17.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:17 smithi067 ceph-mon[107174]: pgmap v39: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 869 KiB/s wr, 216 op/s 2023-12-05T09:28:17.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:17 smithi134 ceph-mon[116304]: pgmap v39: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 869 KiB/s wr, 216 op/s 2023-12-05T09:28:18.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:18 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:18.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:18 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:18.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:18 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:18.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:18 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:19.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:19 smithi134 ceph-mon[116304]: Upgrade: Updating node-exporter.smithi134 (2/2) 2023-12-05T09:28:19.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:19 smithi134 ceph-mon[116304]: Deploying daemon node-exporter.smithi134 on smithi134 2023-12-05T09:28:19.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:19 smithi134 ceph-mon[116304]: pgmap v40: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 240 KiB/s wr, 66 op/s 2023-12-05T09:28:19.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:19 smithi067 ceph-mon[107174]: Upgrade: Updating node-exporter.smithi134 (2/2) 2023-12-05T09:28:19.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:19 smithi067 ceph-mon[107174]: Deploying daemon node-exporter.smithi134 on smithi134 2023-12-05T09:28:19.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:19 smithi067 ceph-mon[107174]: pgmap v40: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 240 KiB/s wr, 66 op/s 2023-12-05T09:28:20.291 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:20 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:28:20.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:20 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:28:22.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:21 smithi134 ceph-mon[116304]: pgmap v41: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 241 KiB/s wr, 66 op/s 2023-12-05T09:28:22.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:21 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:22.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:21 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:22.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:21 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:22.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:21 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:22.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:21 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:22.354 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:21 smithi067 ceph-mon[107174]: pgmap v41: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 7.2 KiB/s rd, 241 KiB/s wr, 66 op/s 2023-12-05T09:28:22.355 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:21 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:22.355 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:21 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:22.355 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:21 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:22.355 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:21 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:22.355 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:21 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:24.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:23 smithi067 ceph-mon[107174]: pgmap v42: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s rd, 204 KiB/s wr, 39 op/s 2023-12-05T09:28:24.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:23 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:24.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:23 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:24.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:23 smithi134 ceph-mon[116304]: pgmap v42: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s rd, 204 KiB/s wr, 39 op/s 2023-12-05T09:28:24.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:23 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:24.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:23 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:25 smithi067 ceph-mon[107174]: pgmap v43: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s rd, 4.4 KiB/s wr, 3 op/s 2023-12-05T09:28:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:25 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:25 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:25 smithi134 ceph-mon[116304]: pgmap v43: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s rd, 4.4 KiB/s wr, 3 op/s 2023-12-05T09:28:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:25 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:26.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:25 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:27.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:26 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:27.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:26 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:27.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:26 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:27.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:26 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:28.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:27 smithi067 ceph-mon[107174]: pgmap v44: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s rd, 4.4 KiB/s wr, 3 op/s 2023-12-05T09:28:28.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:27 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:28.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:27 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:28.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:27 smithi134 ceph-mon[116304]: pgmap v44: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 426 B/s rd, 4.4 KiB/s wr, 3 op/s 2023-12-05T09:28:28.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:27 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:28.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:27 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:29.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:28 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:29.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:28 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:29.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:28 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:29.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:28 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:30.233 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:29 smithi067 ceph-mon[107174]: pgmap v45: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s wr, 0 op/s 2023-12-05T09:28:30.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:29 smithi134 ceph-mon[116304]: pgmap v45: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s wr, 0 op/s 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: pgmap v46: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s wr, 0 op/s 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:31.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:31.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:31.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:31.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:31.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:31.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:31.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:31.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:31 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: pgmap v46: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s wr, 0 op/s 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:32.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:31 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:33.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:33 smithi067 ceph-mon[107174]: Upgrade: Updating prometheus.smithi067 2023-12-05T09:28:33.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:33 smithi067 ceph-mon[107174]: Deploying daemon prometheus.smithi067 on smithi067 2023-12-05T09:28:33.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:33 smithi067 ceph-mon[107174]: pgmap v47: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-05T09:28:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:33 smithi134 ceph-mon[116304]: Upgrade: Updating prometheus.smithi067 2023-12-05T09:28:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:33 smithi134 ceph-mon[116304]: Deploying daemon prometheus.smithi067 on smithi067 2023-12-05T09:28:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:33 smithi134 ceph-mon[116304]: pgmap v47: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2023-12-05T09:28:35.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:35 smithi067 ceph-mon[107174]: pgmap v48: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:35.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:35 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:28:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:35 smithi134 ceph-mon[116304]: pgmap v48: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:36.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:35 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:28:37.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:37 smithi067 ceph-mon[107174]: pgmap v49: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:37.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:37 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:37.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:37 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:37.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:37 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:37.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:37 smithi134 ceph-mon[116304]: pgmap v49: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:37.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:37 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:37.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:37 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:37.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:37 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:38.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:38 smithi067 ceph-mon[107174]: mgrmap e33: smithi067.alxtvv(active, since 92s), standbys: smithi134.yfqkak 2023-12-05T09:28:38.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:38 smithi134 ceph-mon[116304]: mgrmap e33: smithi067.alxtvv(active, since 92s), standbys: smithi134.yfqkak 2023-12-05T09:28:39.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:39 smithi067 ceph-mon[107174]: pgmap v50: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:39.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:39 smithi134 ceph-mon[116304]: pgmap v50: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:41.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:41 smithi067 ceph-mon[107174]: pgmap v51: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:41.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:41 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:41.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:41 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:41.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:41 smithi134 ceph-mon[116304]: pgmap v51: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:41.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:41 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:41.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:41 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.244+0000 7fa2badc0700 1 -- 172.21.15.67:0/2645456890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 msgr2=0x7fa2b4070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.244+0000 7fa2badc0700 1 --2- 172.21.15.67:0/2645456890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 0x7fa2b4070030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8004940 tx=0x7fa2a8009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.245+0000 7fa2badc0700 1 -- 172.21.15.67:0/2645456890 shutdown_connections 2023-12-05T09:28:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.245+0000 7fa2badc0700 1 --2- 172.21.15.67:0/2645456890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2b4070570 0x7fa2b40709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.245+0000 7fa2badc0700 1 --2- 172.21.15.67:0/2645456890 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 0x7fa2b4070030 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.245+0000 7fa2badc0700 1 -- 172.21.15.67:0/2645456890 >> 172.21.15.67:0/2645456890 conn(0x7fa2b40f82d0 msgr2=0x7fa2b40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:42.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.245+0000 7fa2badc0700 1 -- 172.21.15.67:0/2645456890 shutdown_connections 2023-12-05T09:28:42.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.245+0000 7fa2badc0700 1 -- 172.21.15.67:0/2645456890 wait complete. 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.246+0000 7fa2badc0700 1 Processor -- start 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.246+0000 7fa2badc0700 1 -- start start 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.246+0000 7fa2badc0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2b4070570 0x7fa2b410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.246+0000 7fa2badc0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 0x7fa2b410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.246+0000 7fa2badc0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4110420 con 0x7fa2b4071bc0 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.246+0000 7fa2badc0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b4110cc0 con 0x7fa2b4070570 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.246+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 0x7fa2b410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.246+0000 7fa2b3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 0x7fa2b410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41118/0 (socket says 172.21.15.67:41118) 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.247+0000 7fa2b3fff700 1 -- 172.21.15.67:0/355338436 learned_addr learned my addr 172.21.15.67:0/355338436 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.247+0000 7fa2b8b5c700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2b4070570 0x7fa2b410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:42.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.247+0000 7fa2b3fff700 1 -- 172.21.15.67:0/355338436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2b4070570 msgr2=0x7fa2b410f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.247+0000 7fa2b3fff700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2b4070570 0x7fa2b410f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.247+0000 7fa2b3fff700 1 -- 172.21.15.67:0/355338436 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8005040 con 0x7fa2b4071bc0 2023-12-05T09:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.247+0000 7fa2b3fff700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 0x7fa2b410fe20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c8c0 tx=0x7fa2a00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.247+0000 7fa2b17fa700 1 -- 172.21.15.67:0/355338436 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2a000a760 con 0x7fa2b4071bc0 2023-12-05T09:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.248+0000 7fa2b17fa700 1 -- 172.21.15.67:0/355338436 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2a000ad70 con 0x7fa2b4071bc0 2023-12-05T09:28:42.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.248+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b4110fa0 con 0x7fa2b4071bc0 2023-12-05T09:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.248+0000 7fa2b17fa700 1 -- 172.21.15.67:0/355338436 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2a00113a0 con 0x7fa2b4071bc0 2023-12-05T09:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.248+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b41114e0 con 0x7fa2b4071bc0 2023-12-05T09:28:42.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.249+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b41096f0 con 0x7fa2b4071bc0 2023-12-05T09:28:42.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.250+0000 7fa2b17fa700 1 -- 172.21.15.67:0/355338436 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7fa2a0012400 con 0x7fa2b4071bc0 2023-12-05T09:28:42.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.251+0000 7fa2b17fa700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa2a406caf0 0x7fa2a406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:42.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.251+0000 7fa2b17fa700 1 -- 172.21.15.67:0/355338436 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa2a008be90 con 0x7fa2b4071bc0 2023-12-05T09:28:42.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.251+0000 7fa2b8b5c700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa2a406caf0 0x7fa2a406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:42.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.252+0000 7fa2b8b5c700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa2a406caf0 0x7fa2a406efa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009fd0 tx=0x7fa2a8009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:42.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.256+0000 7fa2b17fa700 1 -- 172.21.15.67:0/355338436 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa2a0059c60 con 0x7fa2b4071bc0 2023-12-05T09:28:42.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.487+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2b4111760 con 0x7fa2a406caf0 2023-12-05T09:28:42.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.489+0000 7fa2b17fa700 1 -- 172.21.15.67:0/355338436 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fa2b4111760 con 0x7fa2a406caf0 2023-12-05T09:28:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.491+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa2a406caf0 msgr2=0x7fa2a406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.491+0000 7fa2badc0700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa2a406caf0 0x7fa2a406efa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009fd0 tx=0x7fa2a8009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:42.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.491+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 msgr2=0x7fa2b410fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.491+0000 7fa2badc0700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 0x7fa2b410fe20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000c8c0 tx=0x7fa2a00044c0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.492+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 shutdown_connections 2023-12-05T09:28:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.492+0000 7fa2badc0700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa2a406caf0 0x7fa2a406efa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.492+0000 7fa2badc0700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2b4070570 0x7fa2b410f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.492+0000 7fa2badc0700 1 --2- 172.21.15.67:0/355338436 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa2b4071bc0 0x7fa2b410fe20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.492+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 >> 172.21.15.67:0/355338436 conn(0x7fa2b40f82d0 msgr2=0x7fa2b4103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.492+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 shutdown_connections 2023-12-05T09:28:42.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.492+0000 7fa2badc0700 1 -- 172.21.15.67:0/355338436 wait complete. 2023-12-05T09:28:42.506 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:28:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.639+0000 7f70988fc700 1 -- 172.21.15.67:0/3515882862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 msgr2=0x7f7094070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.639+0000 7f70988fc700 1 --2- 172.21.15.67:0/3515882862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 0x7f7094070030 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7084004940 tx=0x7f7084009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.639+0000 7f70988fc700 1 -- 172.21.15.67:0/3515882862 shutdown_connections 2023-12-05T09:28:42.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.639+0000 7f70988fc700 1 --2- 172.21.15.67:0/3515882862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094070570 0x7f70940709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.639+0000 7f70988fc700 1 --2- 172.21.15.67:0/3515882862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 0x7f7094070030 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.639+0000 7f70988fc700 1 -- 172.21.15.67:0/3515882862 >> 172.21.15.67:0/3515882862 conn(0x7f70940f82d0 msgr2=0x7f70940fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.639+0000 7f70988fc700 1 -- 172.21.15.67:0/3515882862 shutdown_connections 2023-12-05T09:28:42.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.639+0000 7f70988fc700 1 -- 172.21.15.67:0/3515882862 wait complete. 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.640+0000 7f70988fc700 1 Processor -- start 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.640+0000 7f70988fc700 1 -- start start 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.640+0000 7f70988fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094070570 0x7f709410f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.640+0000 7f70988fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 0x7f709410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.640+0000 7f70988fc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7094110420 con 0x7f7094071bc0 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.641+0000 7f70988fc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7094110cc0 con 0x7f7094070570 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.641+0000 7f7091d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 0x7f709410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.641+0000 7f7091d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 0x7f709410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41124/0 (socket says 172.21.15.67:41124) 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.641+0000 7f7091d9b700 1 -- 172.21.15.67:0/923089420 learned_addr learned my addr 172.21.15.67:0/923089420 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:42.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.641+0000 7f709259c700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094070570 0x7f709410f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:42.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.641+0000 7f7091d9b700 1 -- 172.21.15.67:0/923089420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094070570 msgr2=0x7f709410f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:42.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.641+0000 7f7091d9b700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094070570 0x7f709410f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.641+0000 7f7091d9b700 1 -- 172.21.15.67:0/923089420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7084005040 con 0x7f7094071bc0 2023-12-05T09:28:42.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.642+0000 7f7091d9b700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 0x7f709410fe20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7088002a50 tx=0x7f70880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:42.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.642+0000 7f7082ffd700 1 -- 172.21.15.67:0/923089420 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7088007cc0 con 0x7f7094071bc0 2023-12-05T09:28:42.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.642+0000 7f7082ffd700 1 -- 172.21.15.67:0/923089420 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f708800f040 con 0x7f7094071bc0 2023-12-05T09:28:42.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.642+0000 7f7082ffd700 1 -- 172.21.15.67:0/923089420 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f708800d9c0 con 0x7f7094071bc0 2023-12-05T09:28:42.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.642+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7094110fa0 con 0x7f7094071bc0 2023-12-05T09:28:42.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.642+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70941114e0 con 0x7f7094071bc0 2023-12-05T09:28:42.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.643+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70941096f0 con 0x7f7094071bc0 2023-12-05T09:28:42.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.644+0000 7f7082ffd700 1 -- 172.21.15.67:0/923089420 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f708800db20 con 0x7f7094071bc0 2023-12-05T09:28:42.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.645+0000 7f7082ffd700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f707c06caf0 0x7f707c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:42.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.646+0000 7f7082ffd700 1 -- 172.21.15.67:0/923089420 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f708808ba00 con 0x7f7094071bc0 2023-12-05T09:28:42.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.646+0000 7f709259c700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f707c06caf0 0x7f707c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:42.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.647+0000 7f709259c700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f707c06caf0 0x7f707c06efa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7084009fd0 tx=0x7f7084009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:42.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.650+0000 7f7082ffd700 1 -- 172.21.15.67:0/923089420 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7088059870 con 0x7f7094071bc0 2023-12-05T09:28:42.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.887+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7094111750 con 0x7f707c06caf0 2023-12-05T09:28:42.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.888+0000 7f7082ffd700 1 -- 172.21.15.67:0/923089420 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f7094111750 con 0x7f707c06caf0 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f707c06caf0 msgr2=0x7f707c06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f707c06caf0 0x7f707c06efa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7084009fd0 tx=0x7f7084009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 msgr2=0x7f709410fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 0x7f709410fe20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7088002a50 tx=0x7f70880046b0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 shutdown_connections 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f707c06caf0 0x7f707c06efa0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7094070570 0x7f709410f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 --2- 172.21.15.67:0/923089420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7094071bc0 0x7f709410fe20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 >> 172.21.15.67:0/923089420 conn(0x7f70940f82d0 msgr2=0x7f7094103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 shutdown_connections 2023-12-05T09:28:42.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:42.891+0000 7f70988fc700 1 -- 172.21.15.67:0/923089420 wait complete. 2023-12-05T09:28:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.044+0000 7fb6aaff9700 1 -- 172.21.15.67:0/2344526922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4070510 msgr2=0x7fb6a4070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.044+0000 7fb6aaff9700 1 --2- 172.21.15.67:0/2344526922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4070510 0x7fb6a4070980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb690004940 tx=0x7fb690009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.044+0000 7fb6aaff9700 1 -- 172.21.15.67:0/2344526922 shutdown_connections 2023-12-05T09:28:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.044+0000 7fb6aaff9700 1 --2- 172.21.15.67:0/2344526922 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4070510 0x7fb6a4070980 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.044+0000 7fb6aaff9700 1 --2- 172.21.15.67:0/2344526922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a4071b60 0x7fb6a406ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.044+0000 7fb6aaff9700 1 -- 172.21.15.67:0/2344526922 >> 172.21.15.67:0/2344526922 conn(0x7fb6a40f82d0 msgr2=0x7fb6a40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.044+0000 7fb6aaff9700 1 -- 172.21.15.67:0/2344526922 shutdown_connections 2023-12-05T09:28:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.044+0000 7fb6aaff9700 1 -- 172.21.15.67:0/2344526922 wait complete. 2023-12-05T09:28:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.045+0000 7fb6aaff9700 1 Processor -- start 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.045+0000 7fb6aaff9700 1 -- start start 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.045+0000 7fb6aaff9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a4070510 0x7fb6a410f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.045+0000 7fb6aaff9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4071b60 0x7fb6a410fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.045+0000 7fb6aaff9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a41102e0 con 0x7fb6a4071b60 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.045+0000 7fb6aaff9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4110b80 con 0x7fb6a4070510 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.046+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4071b60 0x7fb6a410fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.046+0000 7fb6a3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4071b60 0x7fb6a410fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41146/0 (socket says 172.21.15.67:41146) 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.046+0000 7fb6a3fff700 1 -- 172.21.15.67:0/7521100 learned_addr learned my addr 172.21.15.67:0/7521100 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:43.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.046+0000 7fb6a8d95700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a4070510 0x7fb6a410f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.046+0000 7fb6a3fff700 1 -- 172.21.15.67:0/7521100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a4070510 msgr2=0x7fb6a410f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.046+0000 7fb6a3fff700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a4070510 0x7fb6a410f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.046+0000 7fb6a3fff700 1 -- 172.21.15.67:0/7521100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690005040 con 0x7fb6a4071b60 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.047+0000 7fb6a3fff700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4071b60 0x7fb6a410fce0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb690009fd0 tx=0x7fb690009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.047+0000 7fb6a17fa700 1 -- 172.21.15.67:0/7521100 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb69000e040 con 0x7fb6a4071b60 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.047+0000 7fb6a17fa700 1 -- 172.21.15.67:0/7521100 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb690004290 con 0x7fb6a4071b60 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.047+0000 7fb6a17fa700 1 -- 172.21.15.67:0/7521100 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb69001c3f0 con 0x7fb6a4071b60 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.047+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a4110e00 con 0x7fb6a4071b60 2023-12-05T09:28:43.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.047+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a4111340 con 0x7fb6a4071b60 2023-12-05T09:28:43.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.048+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a41096f0 con 0x7fb6a4071b60 2023-12-05T09:28:43.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.049+0000 7fb6a17fa700 1 -- 172.21.15.67:0/7521100 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7fb69000bc50 con 0x7fb6a4071b60 2023-12-05T09:28:43.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.051+0000 7fb6a17fa700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb69406caf0 0x7fb69406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.051+0000 7fb6a17fa700 1 -- 172.21.15.67:0/7521100 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb69008d050 con 0x7fb6a4071b60 2023-12-05T09:28:43.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.051+0000 7fb6a8d95700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb69406caf0 0x7fb69406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.052+0000 7fb6a8d95700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb69406caf0 0x7fb69406efa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb698004f40 tx=0x7fb69800b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.058+0000 7fb6a17fa700 1 -- 172.21.15.67:0/7521100 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb69005af60 con 0x7fb6a4071b60 2023-12-05T09:28:43.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.311+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6a41115b0 con 0x7fb69406caf0 2023-12-05T09:28:43.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.321+0000 7fb6a17fa700 1 -- 172.21.15.67:0/7521100 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb6a41115b0 con 0x7fb69406caf0 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (2m) 2s ago 9m 16.1M - 0.25.0 c8568f914cd2 2984231be6c0 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (10m) 2s ago 10m 7818k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (9m) 19s ago 9m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (2m) 2s ago 9m 82.0M - 9.4.7 2c41d148cca3 1ec402b5237f 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (5m) 2s ago 5m 6294M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (5m) 2s ago 5m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (5m) 19s ago 5m 14.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (5m) 19s ago 5m 14.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (112s) 2s ago 11m 509M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (51s) 19s ago 8m 449M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:28:43.321 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (11m) 2s ago 11m 98.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (8m) 19s ago 8m 68.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (26s) 2s ago 10m 8414k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (22s) 19s ago 9m 3644k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (8m) 2s ago 8m 783M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (7m) 2s ago 7m 848M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (7m) 2s ago 7m 654M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (7m) 19s ago 7m 1025M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (6m) 19s ago 6m 771M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (6m) 19s ago 6m 867M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:28:43.322 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (6s) 2s ago 9m 37.3M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:28:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb69406caf0 msgr2=0x7fb69406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb69406caf0 0x7fb69406efa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb698004f40 tx=0x7fb69800b040 comp rx=0 tx=0).stop 2023-12-05T09:28:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4071b60 msgr2=0x7fb6a410fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4071b60 0x7fb6a410fce0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb690009fd0 tx=0x7fb690009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 shutdown_connections 2023-12-05T09:28:43.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fb69406caf0 0x7fb69406efa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6a4070510 0x7fb6a410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 --2- 172.21.15.67:0/7521100 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb6a4071b60 0x7fb6a410fce0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 >> 172.21.15.67:0/7521100 conn(0x7fb6a40f82d0 msgr2=0x7fb6a40fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 shutdown_connections 2023-12-05T09:28:43.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.324+0000 7fb6aaff9700 1 -- 172.21.15.67:0/7521100 wait complete. 2023-12-05T09:28:43.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.471+0000 7f4c466ae700 1 -- 172.21.15.67:0/543899988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 msgr2=0x7f4c400fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.471+0000 7f4c466ae700 1 --2- 172.21.15.67:0/543899988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 0x7f4c400fe250 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4c34004940 tx=0x7f4c34009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:43.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.471+0000 7f4c466ae700 1 -- 172.21.15.67:0/543899988 shutdown_connections 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.471+0000 7f4c466ae700 1 --2- 172.21.15.67:0/543899988 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 0x7f4c400fe250 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.471+0000 7f4c466ae700 1 --2- 172.21.15.67:0/543899988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c400fcbf0 0x7f4c400fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.471+0000 7f4c466ae700 1 -- 172.21.15.67:0/543899988 >> 172.21.15.67:0/543899988 conn(0x7f4c400f82d0 msgr2=0x7f4c400fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.471+0000 7f4c466ae700 1 -- 172.21.15.67:0/543899988 shutdown_connections 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.471+0000 7f4c466ae700 1 -- 172.21.15.67:0/543899988 wait complete. 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.472+0000 7f4c466ae700 1 Processor -- start 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.472+0000 7f4c466ae700 1 -- start start 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c466ae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c400fcbf0 0x7f4c4010f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c466ae700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 0x7f4c4010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c466ae700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c40110230 con 0x7f4c400fde00 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c466ae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c40110ad0 con 0x7f4c400fcbf0 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 0x7f4c4010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 0x7f4c4010fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41156/0 (socket says 172.21.15.67:41156) 2023-12-05T09:28:43.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3f7fe700 1 -- 172.21.15.67:0/2402092510 learned_addr learned my addr 172.21.15.67:0/2402092510 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3ffff700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c400fcbf0 0x7f4c4010f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3f7fe700 1 -- 172.21.15.67:0/2402092510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c400fcbf0 msgr2=0x7f4c4010f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3f7fe700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c400fcbf0 0x7f4c4010f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3f7fe700 1 -- 172.21.15.67:0/2402092510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34005040 con 0x7f4c400fde00 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3ffff700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c400fcbf0 0x7f4c4010f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.473+0000 7f4c3f7fe700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 0x7f4c4010fc30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009fd0 tx=0x7f4c34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.474+0000 7f4c3cff9700 1 -- 172.21.15.67:0/2402092510 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c3400e040 con 0x7f4c400fde00 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.474+0000 7f4c3cff9700 1 -- 172.21.15.67:0/2402092510 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c34004290 con 0x7f4c400fde00 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.474+0000 7f4c3cff9700 1 -- 172.21.15.67:0/2402092510 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c3401c3f0 con 0x7f4c400fde00 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.474+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c40110d50 con 0x7f4c400fde00 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.474+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c40111290 con 0x7f4c400fde00 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.475+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c40101ea0 con 0x7f4c400fde00 2023-12-05T09:28:43.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.476+0000 7f4c3cff9700 1 -- 172.21.15.67:0/2402092510 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f4c34013420 con 0x7f4c400fde00 2023-12-05T09:28:43.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.477+0000 7f4c3cff9700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4c2806caf0 0x7f4c2806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.477+0000 7f4c3cff9700 1 -- 172.21.15.67:0/2402092510 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f4c3408d180 con 0x7f4c400fde00 2023-12-05T09:28:43.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.477+0000 7f4c3ffff700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4c2806caf0 0x7f4c2806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.478+0000 7f4c3ffff700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4c2806caf0 0x7f4c2806efa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009b80 tx=0x7f4c3000b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:43.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.481+0000 7f4c3cff9700 1 -- 172.21.15.67:0/2402092510 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4c3405aff0 con 0x7f4c400fde00 2023-12-05T09:28:43.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.804+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4c4004bb80 con 0x7f4c400fde00 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.805+0000 7f4c3cff9700 1 -- 172.21.15.67:0/2402092510 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f4c3405ab80 con 0x7f4c400fde00 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:28:43.804 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:28:43.805 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:28:43.805 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:28:43.805 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:28:43.805 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:28:43.805 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T09:28:43.805 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:28:43.805 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:28:43.805 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:28:43.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.807+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4c2806caf0 msgr2=0x7f4c2806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.807+0000 7f4c466ae700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4c2806caf0 0x7f4c2806efa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009b80 tx=0x7f4c3000b040 comp rx=0 tx=0).stop 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.807+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 msgr2=0x7f4c4010fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.807+0000 7f4c466ae700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 0x7f4c4010fc30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009fd0 tx=0x7f4c34009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.808+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 shutdown_connections 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.808+0000 7f4c466ae700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f4c2806caf0 0x7f4c2806efa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.808+0000 7f4c466ae700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c400fcbf0 0x7f4c4010f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.808+0000 7f4c466ae700 1 --2- 172.21.15.67:0/2402092510 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4c400fde00 0x7f4c4010fc30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.808+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 >> 172.21.15.67:0/2402092510 conn(0x7f4c400f82d0 msgr2=0x7f4c400ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.808+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 shutdown_connections 2023-12-05T09:28:43.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.808+0000 7f4c466ae700 1 -- 172.21.15.67:0/2402092510 wait complete. 2023-12-05T09:28:43.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:43 smithi067 ceph-mon[107174]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:43.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:43 smithi067 ceph-mon[107174]: pgmap v52: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:43.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:43 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:43.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:43 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:43.841 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:43 smithi067 ceph-mon[107174]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:43 smithi134 ceph-mon[116304]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:43 smithi134 ceph-mon[116304]: pgmap v52: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:43 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:43 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:43 smithi134 ceph-mon[116304]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:43.949 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.950+0000 7fa927075700 1 -- 172.21.15.67:0/3661010646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920071b60 msgr2=0x7fa92006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.950+0000 7fa927075700 1 --2- 172.21.15.67:0/3661010646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920071b60 0x7fa92006ffd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa914004940 tx=0x7fa914009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:43.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.950+0000 7fa927075700 1 -- 172.21.15.67:0/3661010646 shutdown_connections 2023-12-05T09:28:43.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.950+0000 7fa927075700 1 --2- 172.21.15.67:0/3661010646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920070510 0x7fa920070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.950+0000 7fa927075700 1 --2- 172.21.15.67:0/3661010646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920071b60 0x7fa92006ffd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.950+0000 7fa927075700 1 -- 172.21.15.67:0/3661010646 >> 172.21.15.67:0/3661010646 conn(0x7fa9200f82d0 msgr2=0x7fa9200fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:43.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.951+0000 7fa927075700 1 -- 172.21.15.67:0/3661010646 shutdown_connections 2023-12-05T09:28:43.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.951+0000 7fa927075700 1 -- 172.21.15.67:0/3661010646 wait complete. 2023-12-05T09:28:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.951+0000 7fa927075700 1 Processor -- start 2023-12-05T09:28:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa927075700 1 -- start start 2023-12-05T09:28:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa927075700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920070510 0x7fa92010f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa927075700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920071b60 0x7fa92010fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa927075700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9201102d0 con 0x7fa920070510 2023-12-05T09:28:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa927075700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa920110b70 con 0x7fa920071b60 2023-12-05T09:28:43.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa924e11700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920070510 0x7fa92010f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa924e11700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920070510 0x7fa92010f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41164/0 (socket says 172.21.15.67:41164) 2023-12-05T09:28:43.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa924e11700 1 -- 172.21.15.67:0/2521625791 learned_addr learned my addr 172.21.15.67:0/2521625791 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:28:43.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.952+0000 7fa91ffff700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920071b60 0x7fa92010fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa924e11700 1 -- 172.21.15.67:0/2521625791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920071b60 msgr2=0x7fa92010fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:43.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa924e11700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920071b60 0x7fa92010fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:43.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa924e11700 1 -- 172.21.15.67:0/2521625791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914005040 con 0x7fa920070510 2023-12-05T09:28:43.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa924e11700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920070510 0x7fa92010f790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa914009fd0 tx=0x7fa914009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:43.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa91d7fa700 1 -- 172.21.15.67:0/2521625791 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa914021070 con 0x7fa920070510 2023-12-05T09:28:43.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa91d7fa700 1 -- 172.21.15.67:0/2521625791 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa91401c400 con 0x7fa920070510 2023-12-05T09:28:43.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa920110df0 con 0x7fa920070510 2023-12-05T09:28:43.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa91d7fa700 1 -- 172.21.15.67:0/2521625791 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa91400e070 con 0x7fa920070510 2023-12-05T09:28:43.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.953+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa920111330 con 0x7fa920070510 2023-12-05T09:28:43.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.955+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9201096f0 con 0x7fa920070510 2023-12-05T09:28:43.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.956+0000 7fa91d7fa700 1 -- 172.21.15.67:0/2521625791 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7fa91401c570 con 0x7fa920070510 2023-12-05T09:28:43.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.957+0000 7fa91d7fa700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa91006caf0 0x7fa91006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:28:43.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.957+0000 7fa91d7fa700 1 -- 172.21.15.67:0/2521625791 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa91408d010 con 0x7fa920070510 2023-12-05T09:28:43.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.958+0000 7fa91ffff700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa91006caf0 0x7fa91006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:28:43.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.958+0000 7fa91ffff700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa91006caf0 0x7fa91006efa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009b80 tx=0x7fa90c00b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:28:43.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:43.962+0000 7fa91d7fa700 1 -- 172.21.15.67:0/2521625791 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa91405ae80 con 0x7fa920070510 2023-12-05T09:28:44.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.232+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa920111550 con 0x7fa91006caf0 2023-12-05T09:28:44.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.233+0000 7fa91d7fa700 1 -- 172.21.15.67:0/2521625791 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fa920111550 con 0x7fa91006caf0 2023-12-05T09:28:44.232 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:28:44.232 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:28:44.232 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:28:44.232 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:28:44.232 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:28:44.232 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2023-12-05T09:28:44.233 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:28:44.233 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2023-12-05T09:28:44.233 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading prometheus daemons", 2023-12-05T09:28:44.233 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:28:44.233 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:28:44.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.235+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa91006caf0 msgr2=0x7fa91006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.235+0000 7fa927075700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa91006caf0 0x7fa91006efa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009b80 tx=0x7fa90c00b040 comp rx=0 tx=0).stop 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.235+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920070510 msgr2=0x7fa92010f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.235+0000 7fa927075700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920070510 0x7fa92010f790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa914009fd0 tx=0x7fa914009e30 comp rx=0 tx=0).stop 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.236+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 shutdown_connections 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.236+0000 7fa927075700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa91006caf0 0x7fa91006efa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.236+0000 7fa927075700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa920070510 0x7fa92010f790 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.236+0000 7fa927075700 1 --2- 172.21.15.67:0/2521625791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa920071b60 0x7fa92010fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.236+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 >> 172.21.15.67:0/2521625791 conn(0x7fa9200f82d0 msgr2=0x7fa920103370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.236+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 shutdown_connections 2023-12-05T09:28:44.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:28:44.236+0000 7fa927075700 1 -- 172.21.15.67:0/2521625791 wait complete. 2023-12-05T09:28:44.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:44 smithi067 ceph-mon[107174]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:44.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:44 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2402092510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:44.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:44 smithi134 ceph-mon[116304]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:44.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:44 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2402092510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:45.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:45 smithi067 ceph-mon[107174]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:45.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:45 smithi067 ceph-mon[107174]: pgmap v53: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:45.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:45 smithi134 ceph-mon[116304]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:28:45.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:45 smithi134 ceph-mon[116304]: pgmap v53: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:47.227 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:47.227 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:47.227 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:28:47.227 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:28:47.227 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.228 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:47 smithi067 ceph-mon[107174]: pgmap v54: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:28:47.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:47 smithi134 ceph-mon[116304]: pgmap v54: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2023-12-05T09:28:48.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:48 smithi067 ceph-mon[107174]: Upgrade: Updating alertmanager.smithi067 2023-12-05T09:28:48.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:48 smithi067 ceph-mon[107174]: Deploying daemon alertmanager.smithi067 on smithi067 2023-12-05T09:28:48.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:48 smithi134 ceph-mon[116304]: Upgrade: Updating alertmanager.smithi067 2023-12-05T09:28:48.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:48 smithi134 ceph-mon[116304]: Deploying daemon alertmanager.smithi067 on smithi067 2023-12-05T09:28:49.207 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:49 smithi067 ceph-mon[107174]: pgmap v55: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:49.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:49 smithi134 ceph-mon[116304]: pgmap v55: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:50.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:50 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:28:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:50 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:28:51.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:51 smithi067 ceph-mon[107174]: pgmap v56: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:51.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:51 smithi134 ceph-mon[116304]: pgmap v56: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:53.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:53 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:53 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:53 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:53.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:53 smithi067 ceph-mon[107174]: pgmap v57: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:53.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:53 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:53.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:53 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:53.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:53 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:28:53.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:53 smithi134 ceph-mon[116304]: pgmap v57: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:55.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:55 smithi067 ceph-mon[107174]: pgmap v58: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:55.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:55 smithi134 ceph-mon[116304]: pgmap v58: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:57 smithi067 ceph-mon[107174]: pgmap v59: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:57 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:57 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:57 smithi134 ceph-mon[116304]: pgmap v59: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:57 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:57 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:59.305 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:59 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:59.305 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:59 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:59.306 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:28:59 smithi067 ceph-mon[107174]: pgmap v60: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:28:59.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:59 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:59.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:59 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:28:59.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:28:59 smithi134 ceph-mon[116304]: pgmap v60: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:01 smithi067 ceph-mon[107174]: pgmap v61: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:29:01.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:01 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:29:01.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:01 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:01 smithi134 ceph-mon[116304]: pgmap v61: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:29:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:01 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:29:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:01 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.669 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.670 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.670 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.670 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.670 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:02 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:29:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-05T09:29:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:02.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:02 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:03.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:03 smithi067 ceph-mon[107174]: pgmap v62: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:03 smithi134 ceph-mon[116304]: pgmap v62: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:04 smithi067 ceph-mon[107174]: Upgrade: Updating grafana.smithi067 2023-12-05T09:29:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:04 smithi067 ceph-mon[107174]: Deploying daemon grafana.smithi067 on smithi067 2023-12-05T09:29:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:04 smithi134 ceph-mon[116304]: Upgrade: Updating grafana.smithi067 2023-12-05T09:29:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:04 smithi134 ceph-mon[116304]: Deploying daemon grafana.smithi067 on smithi067 2023-12-05T09:29:05.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:05 smithi067 ceph-mon[107174]: pgmap v63: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:05.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:29:05.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:05 smithi134 ceph-mon[116304]: pgmap v63: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:05.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:29:07.281 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:07 smithi067 ceph-mon[107174]: pgmap v64: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:07.281 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:07 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:07.281 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:07 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:07.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:07 smithi134 ceph-mon[116304]: pgmap v64: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:07.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:07 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:07.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:07 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:08.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:08 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:08.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:08 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:09.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:09 smithi067 ceph-mon[107174]: pgmap v65: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:09.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:09 smithi134 ceph-mon[116304]: pgmap v65: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:11.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:11 smithi067 ceph-mon[107174]: pgmap v66: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:11.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:11 smithi134 ceph-mon[116304]: pgmap v66: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:13.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:12 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:13.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:12 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:13.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:12 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:13.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:12 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:14.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:13 smithi067 ceph-mon[107174]: pgmap v67: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:14.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:13 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:14.053 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:13 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:14.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:13 smithi134 ceph-mon[116304]: pgmap v67: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:14.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:13 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:14.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:13 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.384+0000 7f0e512e1700 1 -- 172.21.15.67:0/666870767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 msgr2=0x7f0e4c0709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:14.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.384+0000 7f0e512e1700 1 --2- 172.21.15.67:0/666870767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 0x7f0e4c0709c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0e40004940 tx=0x7f0e40009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.384+0000 7f0e512e1700 1 -- 172.21.15.67:0/666870767 shutdown_connections 2023-12-05T09:29:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.384+0000 7f0e512e1700 1 --2- 172.21.15.67:0/666870767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 0x7f0e4c0709c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.384+0000 7f0e512e1700 1 --2- 172.21.15.67:0/666870767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e4c071bc0 0x7f0e4c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.384+0000 7f0e512e1700 1 -- 172.21.15.67:0/666870767 >> 172.21.15.67:0/666870767 conn(0x7f0e4c0f82d0 msgr2=0x7f0e4c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.384+0000 7f0e512e1700 1 -- 172.21.15.67:0/666870767 shutdown_connections 2023-12-05T09:29:14.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.384+0000 7f0e512e1700 1 -- 172.21.15.67:0/666870767 wait complete. 2023-12-05T09:29:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.386+0000 7f0e512e1700 1 Processor -- start 2023-12-05T09:29:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.386+0000 7f0e512e1700 1 -- start start 2023-12-05T09:29:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.386+0000 7f0e512e1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 0x7f0e4c10f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.386+0000 7f0e512e1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e4c071bc0 0x7f0e4c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.386+0000 7f0e512e1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c1103a0 con 0x7f0e4c070570 2023-12-05T09:29:14.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.386+0000 7f0e512e1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c110c40 con 0x7f0e4c071bc0 2023-12-05T09:29:14.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.386+0000 7f0e4affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 0x7f0e4c10f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:14.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.387+0000 7f0e4affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 0x7f0e4c10f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33600/0 (socket says 172.21.15.67:33600) 2023-12-05T09:29:14.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.387+0000 7f0e4affd700 1 -- 172.21.15.67:0/4118555841 learned_addr learned my addr 172.21.15.67:0/4118555841 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.387+0000 7f0e4a7fc700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e4c071bc0 0x7f0e4c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.387+0000 7f0e4affd700 1 -- 172.21.15.67:0/4118555841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e4c071bc0 msgr2=0x7f0e4c10fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.387+0000 7f0e4affd700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e4c071bc0 0x7f0e4c10fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.387+0000 7f0e4affd700 1 -- 172.21.15.67:0/4118555841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40005040 con 0x7f0e4c070570 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.387+0000 7f0e4affd700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 0x7f0e4c10f860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00eb40 tx=0x7f0e3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.388+0000 7f0e337fe700 1 -- 172.21.15.67:0/4118555841 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3c007cc0 con 0x7f0e4c070570 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.388+0000 7f0e337fe700 1 -- 172.21.15.67:0/4118555841 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e3c00f040 con 0x7f0e4c070570 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.388+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c110ec0 con 0x7f0e4c070570 2023-12-05T09:29:14.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.388+0000 7f0e337fe700 1 -- 172.21.15.67:0/4118555841 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3c00c990 con 0x7f0e4c070570 2023-12-05T09:29:14.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.388+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c111400 con 0x7f0e4c070570 2023-12-05T09:29:14.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.389+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c1096f0 con 0x7f0e4c070570 2023-12-05T09:29:14.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.390+0000 7f0e337fe700 1 -- 172.21.15.67:0/4118555841 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f0e3c00caf0 con 0x7f0e4c070570 2023-12-05T09:29:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.391+0000 7f0e337fe700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f0e3406caf0 0x7f0e3406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.391+0000 7f0e337fe700 1 -- 172.21.15.67:0/4118555841 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f0e3c08b980 con 0x7f0e4c070570 2023-12-05T09:29:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.391+0000 7f0e4a7fc700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f0e3406caf0 0x7f0e3406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:14.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.392+0000 7f0e4a7fc700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f0e3406caf0 0x7f0e3406efa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e40013600 tx=0x7f0e40009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:14.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.399+0000 7f0e337fe700 1 -- 172.21.15.67:0/4118555841 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0e3c059800 con 0x7f0e4c070570 2023-12-05T09:29:14.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.646+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e4c111670 con 0x7f0e3406caf0 2023-12-05T09:29:14.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.648+0000 7f0e337fe700 1 -- 172.21.15.67:0/4118555841 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f0e4c111670 con 0x7f0e3406caf0 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.650+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f0e3406caf0 msgr2=0x7f0e3406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.650+0000 7f0e512e1700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f0e3406caf0 0x7f0e3406efa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e40013600 tx=0x7f0e40009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.650+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 msgr2=0x7f0e4c10f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.650+0000 7f0e512e1700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 0x7f0e4c10f860 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00eb40 tx=0x7f0e3c00b040 comp rx=0 tx=0).stop 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.651+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 shutdown_connections 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.651+0000 7f0e512e1700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f0e3406caf0 0x7f0e3406efa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.651+0000 7f0e512e1700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0e4c070570 0x7f0e4c10f860 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.651+0000 7f0e512e1700 1 --2- 172.21.15.67:0/4118555841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e4c071bc0 0x7f0e4c10fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.651+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 >> 172.21.15.67:0/4118555841 conn(0x7f0e4c0f82d0 msgr2=0x7f0e4c103310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:14.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.651+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 shutdown_connections 2023-12-05T09:29:14.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.651+0000 7f0e512e1700 1 -- 172.21.15.67:0/4118555841 wait complete. 2023-12-05T09:29:14.665 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:29:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.796+0000 7f29a67f8700 1 -- 172.21.15.67:0/1713919004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 msgr2=0x7f29a0070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.796+0000 7f29a67f8700 1 --2- 172.21.15.67:0/1713919004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 0x7f29a0070030 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2990004940 tx=0x7f2990009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.796+0000 7f29a67f8700 1 -- 172.21.15.67:0/1713919004 shutdown_connections 2023-12-05T09:29:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.796+0000 7f29a67f8700 1 --2- 172.21.15.67:0/1713919004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a0070570 0x7f29a00709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.796+0000 7f29a67f8700 1 --2- 172.21.15.67:0/1713919004 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 0x7f29a0070030 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.796+0000 7f29a67f8700 1 -- 172.21.15.67:0/1713919004 >> 172.21.15.67:0/1713919004 conn(0x7f29a00f82d0 msgr2=0x7f29a00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.796+0000 7f29a67f8700 1 -- 172.21.15.67:0/1713919004 shutdown_connections 2023-12-05T09:29:14.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.796+0000 7f29a67f8700 1 -- 172.21.15.67:0/1713919004 wait complete. 2023-12-05T09:29:14.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.797+0000 7f29a67f8700 1 Processor -- start 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.797+0000 7f29a67f8700 1 -- start start 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.797+0000 7f29a67f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a0070570 0x7f29a0113aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.797+0000 7f29a67f8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 0x7f29a0113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.797+0000 7f29a67f8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a01145e0 con 0x7f29a0071bc0 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.797+0000 7f29a67f8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a0114e80 con 0x7f29a0070570 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.797+0000 7f299f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 0x7f29a0113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.798+0000 7f299f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 0x7f29a0113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33626/0 (socket says 172.21.15.67:33626) 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.798+0000 7f299f7fe700 1 -- 172.21.15.67:0/930209492 learned_addr learned my addr 172.21.15.67:0/930209492 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.798+0000 7f299ffff700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a0070570 0x7f29a0113aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.798+0000 7f299f7fe700 1 -- 172.21.15.67:0/930209492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a0070570 msgr2=0x7f29a0113aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.798+0000 7f299f7fe700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a0070570 0x7f29a0113aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:14.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.798+0000 7f299f7fe700 1 -- 172.21.15.67:0/930209492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990005040 con 0x7f29a0071bc0 2023-12-05T09:29:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.798+0000 7f299f7fe700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 0x7f29a0113fe0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f299400eb40 tx=0x7f299400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.798+0000 7f299cff9700 1 -- 172.21.15.67:0/930209492 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2994007cc0 con 0x7f29a0071bc0 2023-12-05T09:29:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.799+0000 7f299cff9700 1 -- 172.21.15.67:0/930209492 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f299400f040 con 0x7f29a0071bc0 2023-12-05T09:29:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.799+0000 7f299cff9700 1 -- 172.21.15.67:0/930209492 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299400c990 con 0x7f29a0071bc0 2023-12-05T09:29:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.799+0000 7f29a67f8700 1 -- 172.21.15.67:0/930209492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a0115100 con 0x7f29a0071bc0 2023-12-05T09:29:14.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.799+0000 7f29a67f8700 1 -- 172.21.15.67:0/930209492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a0115640 con 0x7f29a0071bc0 2023-12-05T09:29:14.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.800+0000 7f29867fc700 1 -- 172.21.15.67:0/930209492 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a004bb80 con 0x7f29a0071bc0 2023-12-05T09:29:14.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.801+0000 7f299cff9700 1 -- 172.21.15.67:0/930209492 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f299400caf0 con 0x7f29a0071bc0 2023-12-05T09:29:14.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.802+0000 7f299cff9700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f298806caf0 0x7f298806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:14.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.802+0000 7f299cff9700 1 -- 172.21.15.67:0/930209492 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f299408b8e0 con 0x7f29a0071bc0 2023-12-05T09:29:14.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.802+0000 7f299ffff700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f298806caf0 0x7f298806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:14.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.803+0000 7f299ffff700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f298806caf0 0x7f298806efa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2990013600 tx=0x7f2990009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:14.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:14.807+0000 7f299cff9700 1 -- 172.21.15.67:0/930209492 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f2994059800 con 0x7f29a0071bc0 2023-12-05T09:29:15.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.038+0000 7f29867fc700 1 -- 172.21.15.67:0/930209492 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29a010bb70 con 0x7f298806caf0 2023-12-05T09:29:15.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.039+0000 7f299cff9700 1 -- 172.21.15.67:0/930209492 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f29a010bb70 con 0x7f298806caf0 2023-12-05T09:29:15.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.041+0000 7f29867fc700 1 -- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f298806caf0 msgr2=0x7f298806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.041+0000 7f29867fc700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f298806caf0 0x7f298806efa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2990013600 tx=0x7f2990009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:15.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.041+0000 7f29867fc700 1 -- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 msgr2=0x7f29a0113fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.041+0000 7f29867fc700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 0x7f29a0113fe0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f299400eb40 tx=0x7f299400b040 comp rx=0 tx=0).stop 2023-12-05T09:29:15.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.041+0000 7f29867fc700 1 -- 172.21.15.67:0/930209492 shutdown_connections 2023-12-05T09:29:15.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.042+0000 7f29867fc700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f298806caf0 0x7f298806efa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.042+0000 7f29867fc700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a0070570 0x7f29a0113aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.042+0000 7f29867fc700 1 --2- 172.21.15.67:0/930209492 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f29a0071bc0 0x7f29a0113fe0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.042+0000 7f29867fc700 1 -- 172.21.15.67:0/930209492 >> 172.21.15.67:0/930209492 conn(0x7f29a00f82d0 msgr2=0x7f29a00fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:15.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.042+0000 7f29867fc700 1 -- 172.21.15.67:0/930209492 shutdown_connections 2023-12-05T09:29:15.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.042+0000 7f29867fc700 1 -- 172.21.15.67:0/930209492 wait complete. 2023-12-05T09:29:15.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.183+0000 7f04d6047700 1 -- 172.21.15.67:0/1116668262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 msgr2=0x7f04d00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.183+0000 7f04d6047700 1 --2- 172.21.15.67:0/1116668262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 0x7f04d00fd150 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f04c4004940 tx=0x7f04c4009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:15.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.183+0000 7f04d6047700 1 -- 172.21.15.67:0/1116668262 shutdown_connections 2023-12-05T09:29:15.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.183+0000 7f04d6047700 1 --2- 172.21.15.67:0/1116668262 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 0x7f04d00fd150 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.183+0000 7f04d6047700 1 --2- 172.21.15.67:0/1116668262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d00fbaf0 0x7f04d00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.183+0000 7f04d6047700 1 -- 172.21.15.67:0/1116668262 >> 172.21.15.67:0/1116668262 conn(0x7f04d00f7190 msgr2=0x7f04d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:15.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.183+0000 7f04d6047700 1 -- 172.21.15.67:0/1116668262 shutdown_connections 2023-12-05T09:29:15.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.183+0000 7f04d6047700 1 -- 172.21.15.67:0/1116668262 wait complete. 2023-12-05T09:29:15.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.184+0000 7f04d6047700 1 Processor -- start 2023-12-05T09:29:15.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.184+0000 7f04d6047700 1 -- start start 2023-12-05T09:29:15.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.185+0000 7f04d6047700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d00fbaf0 0x7f04d0110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:15.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.185+0000 7f04d6047700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 0x7f04d0112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:15.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.185+0000 7f04d6047700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0066110 con 0x7f04d00fcd00 2023-12-05T09:29:15.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.185+0000 7f04d6047700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0066250 con 0x7f04d00fbaf0 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.185+0000 7f04ceffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 0x7f04d0112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.185+0000 7f04ceffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 0x7f04d0112760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33648/0 (socket says 172.21.15.67:33648) 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.185+0000 7f04ceffd700 1 -- 172.21.15.67:0/3493229643 learned_addr learned my addr 172.21.15.67:0/3493229643 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.185+0000 7f04cf7fe700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d00fbaf0 0x7f04d0110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04ceffd700 1 -- 172.21.15.67:0/3493229643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d00fbaf0 msgr2=0x7f04d0110210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04ceffd700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d00fbaf0 0x7f04d0110210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04ceffd700 1 -- 172.21.15.67:0/3493229643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4005040 con 0x7f04d00fcd00 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04ceffd700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 0x7f04d0112760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009fd0 tx=0x7f04c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04b7fff700 1 -- 172.21.15.67:0/3493229643 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c4021070 con 0x7f04d00fcd00 2023-12-05T09:29:15.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04b7fff700 1 -- 172.21.15.67:0/3493229643 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04c401c400 con 0x7f04d00fcd00 2023-12-05T09:29:15.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04b7fff700 1 -- 172.21.15.67:0/3493229643 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04c400e070 con 0x7f04d00fcd00 2023-12-05T09:29:15.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d0112d60 con 0x7f04d00fcd00 2023-12-05T09:29:15.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.186+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d0113240 con 0x7f04d00fcd00 2023-12-05T09:29:15.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.187+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d004bb80 con 0x7f04d00fcd00 2023-12-05T09:29:15.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.189+0000 7f04b7fff700 1 -- 172.21.15.67:0/3493229643 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f04c401c570 con 0x7f04d00fcd00 2023-12-05T09:29:15.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.190+0000 7f04b7fff700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04b806caf0 0x7f04b806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:15.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.190+0000 7f04b7fff700 1 -- 172.21.15.67:0/3493229643 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f04c408cff0 con 0x7f04d00fcd00 2023-12-05T09:29:15.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.190+0000 7f04cf7fe700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04b806caf0 0x7f04b806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:15.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.191+0000 7f04cf7fe700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04b806caf0 0x7f04b806efa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f04d0065d90 tx=0x7f04c000b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:15.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.195+0000 7f04b7fff700 1 -- 172.21.15.67:0/3493229643 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f04c40bfce0 con 0x7f04d00fcd00 2023-12-05T09:29:15.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.422+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f04d0101650 con 0x7f04b806caf0 2023-12-05T09:29:15.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.432+0000 7f04b7fff700 1 -- 172.21.15.67:0/3493229643 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f04d0101650 con 0x7f04b806caf0 2023-12-05T09:29:15.431 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (23s) 3s ago 10m 15.5M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (10m) 3s ago 10m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (9m) 51s ago 9m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (8s) 3s ago 10m 49.2M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (5m) 3s ago 5m 6294M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (5m) 3s ago 5m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (5m) 51s ago 5m 14.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (5m) 51s ago 5m 14.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (2m) 3s ago 11m 511M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (83s) 51s ago 9m 449M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (11m) 3s ago 11m 100M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (9m) 51s ago 9m 68.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (58s) 3s ago 10m 8724k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:29:15.432 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (54s) 51s ago 9m 3644k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:29:15.433 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (8m) 3s ago 8m 786M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:29:15.433 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (8m) 3s ago 8m 850M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:29:15.433 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (8m) 3s ago 8m 656M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:29:15.433 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (7m) 51s ago 7m 1025M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:29:15.433 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (7m) 51s ago 7m 771M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:29:15.433 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (6m) 51s ago 6m 867M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:29:15.433 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (38s) 3s ago 9m 44.7M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04b806caf0 msgr2=0x7f04b806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04b806caf0 0x7f04b806efa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f04d0065d90 tx=0x7f04c000b040 comp rx=0 tx=0).stop 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 msgr2=0x7f04d0112760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 0x7f04d0112760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009fd0 tx=0x7f04c4009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 shutdown_connections 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04b806caf0 0x7f04b806efa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04d00fbaf0 0x7f04d0110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 --2- 172.21.15.67:0/3493229643 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04d00fcd00 0x7f04d0112760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 >> 172.21.15.67:0/3493229643 conn(0x7f04d00f7190 msgr2=0x7f04d00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 shutdown_connections 2023-12-05T09:29:15.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.436+0000 7f04d6047700 1 -- 172.21.15.67:0/3493229643 wait complete. 2023-12-05T09:29:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.601+0000 7fa3df59e700 1 -- 172.21.15.67:0/1552169354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fdc00 msgr2=0x7fa3e00fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.601+0000 7fa3df59e700 1 --2- 172.21.15.67:0/1552169354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fdc00 0x7fa3e00fe050 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4004940 tx=0x7fa3d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.601+0000 7fa3df59e700 1 -- 172.21.15.67:0/1552169354 shutdown_connections 2023-12-05T09:29:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.601+0000 7fa3df59e700 1 --2- 172.21.15.67:0/1552169354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fdc00 0x7fa3e00fe050 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.601+0000 7fa3df59e700 1 --2- 172.21.15.67:0/1552169354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e00fc9f0 0x7fa3e00fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.601+0000 7fa3df59e700 1 -- 172.21.15.67:0/1552169354 >> 172.21.15.67:0/1552169354 conn(0x7fa3e00f8090 msgr2=0x7fa3e00fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.601+0000 7fa3df59e700 1 -- 172.21.15.67:0/1552169354 shutdown_connections 2023-12-05T09:29:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.601+0000 7fa3df59e700 1 -- 172.21.15.67:0/1552169354 wait complete. 2023-12-05T09:29:15.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.602+0000 7fa3df59e700 1 Processor -- start 2023-12-05T09:29:15.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.602+0000 7fa3df59e700 1 -- start start 2023-12-05T09:29:15.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3df59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fc9f0 0x7fa3e010d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:15.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3df59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e00fdc00 0x7fa3e010d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:15.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3df59e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e010de30 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3df59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e010e6d0 con 0x7fa3e00fdc00 2023-12-05T09:29:15.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3de59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fc9f0 0x7fa3e010d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:15.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3de59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fc9f0 0x7fa3e010d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33674/0 (socket says 172.21.15.67:33674) 2023-12-05T09:29:15.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3de59c700 1 -- 172.21.15.67:0/2832994672 learned_addr learned my addr 172.21.15.67:0/2832994672 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3ddd9b700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e00fdc00 0x7fa3e010d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3de59c700 1 -- 172.21.15.67:0/2832994672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e00fdc00 msgr2=0x7fa3e010d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3de59c700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e00fdc00 0x7fa3e010d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.603+0000 7fa3de59c700 1 -- 172.21.15.67:0/2832994672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4005040 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.604+0000 7fa3de59c700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fc9f0 0x7fa3e010d2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0002a80 tx=0x7fa3d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.604+0000 7fa3ceffd700 1 -- 172.21.15.67:0/2832994672 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d0007cc0 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.604+0000 7fa3ceffd700 1 -- 172.21.15.67:0/2832994672 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa3d000f040 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.604+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e010e9b0 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.604+0000 7fa3ceffd700 1 -- 172.21.15.67:0/2832994672 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3d000da20 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.604+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e010eef0 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.605+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e004bb80 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.607+0000 7fa3ceffd700 1 -- 172.21.15.67:0/2832994672 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7fa3d000db80 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.608+0000 7fa3ceffd700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa3c806cba0 0x7fa3c806f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:15.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.608+0000 7fa3ceffd700 1 -- 172.21.15.67:0/2832994672 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fa3d008b9d0 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.609+0000 7fa3ddd9b700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa3c806cba0 0x7fa3c806f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:15.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.609+0000 7fa3ddd9b700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa3c806cba0 0x7fa3c806f050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4004f90 tx=0x7fa3d4009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:15.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.613+0000 7fa3ceffd700 1 -- 172.21.15.67:0/2832994672 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa3d00598e0 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.911+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3e0113910 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.911 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.912+0000 7fa3ceffd700 1 -- 172.21.15.67:0/2832994672 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fa3d0059470 con 0x7fa3e00fc9f0 2023-12-05T09:29:15.911 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:29:15.911 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:29:15.911 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:29:15.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:29:15.911 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:29:15.911 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:29:15.911 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:29:15.912 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:29:15.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.914+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa3c806cba0 msgr2=0x7fa3c806f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.914+0000 7fa3df59e700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa3c806cba0 0x7fa3c806f050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4004f90 tx=0x7fa3d4009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.914+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fc9f0 msgr2=0x7fa3e010d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.914+0000 7fa3df59e700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fc9f0 0x7fa3e010d2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0002a80 tx=0x7fa3d0004600 comp rx=0 tx=0).stop 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.915+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 shutdown_connections 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.915+0000 7fa3df59e700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fa3c806cba0 0x7fa3c806f050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.915+0000 7fa3df59e700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3e00fc9f0 0x7fa3e010d2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.915+0000 7fa3df59e700 1 --2- 172.21.15.67:0/2832994672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3e00fdc00 0x7fa3e010d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.915+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 >> 172.21.15.67:0/2832994672 conn(0x7fa3e00f8090 msgr2=0x7fa3e0100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.915+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 shutdown_connections 2023-12-05T09:29:15.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:15.915+0000 7fa3df59e700 1 -- 172.21.15.67:0/2832994672 wait complete. 2023-12-05T09:29:16.041 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:15 smithi067 ceph-mon[107174]: pgmap v68: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:16.041 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:15 smithi067 ceph-mon[107174]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:16.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.060+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1251838052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 msgr2=0x7f90bc06ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:16.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.060+0000 7f90c1dcb700 1 --2- 172.21.15.67:0/1251838052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 0x7f90bc06ffb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f90ac004940 tx=0x7f90ac009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:16.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.060+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1251838052 shutdown_connections 2023-12-05T09:29:16.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.060+0000 7f90c1dcb700 1 --2- 172.21.15.67:0/1251838052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc0704f0 0x7f90bc070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:16.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.060+0000 7f90c1dcb700 1 --2- 172.21.15.67:0/1251838052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 0x7f90bc06ffb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:16.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.060+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1251838052 >> 172.21.15.67:0/1251838052 conn(0x7f90bc0f82d0 msgr2=0x7f90bc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:16.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.060+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1251838052 shutdown_connections 2023-12-05T09:29:16.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.060+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1251838052 wait complete. 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.061+0000 7f90c1dcb700 1 Processor -- start 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.061+0000 7f90c1dcb700 1 -- start start 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.061+0000 7f90c1dcb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc0704f0 0x7f90bc10f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.061+0000 7f90c1dcb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 0x7f90bc10fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.061+0000 7f90c1dcb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc110340 con 0x7f90bc071b40 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.061+0000 7f90c1dcb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc110be0 con 0x7f90bc0704f0 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90baffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 0x7f90bc10fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90baffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 0x7f90bc10fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:32876/0 (socket says 172.21.15.67:32876) 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90baffd700 1 -- 172.21.15.67:0/1241022378 learned_addr learned my addr 172.21.15.67:0/1241022378 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90bb7fe700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc0704f0 0x7f90bc10f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:16.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90baffd700 1 -- 172.21.15.67:0/1241022378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc0704f0 msgr2=0x7f90bc10f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:16.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90baffd700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc0704f0 0x7f90bc10f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:16.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90baffd700 1 -- 172.21.15.67:0/1241022378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac005040 con 0x7f90bc071b40 2023-12-05T09:29:16.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90baffd700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 0x7f90bc10fd40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f90b000c830 tx=0x7f90b0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:16.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.062+0000 7f90a3fff700 1 -- 172.21.15.67:0/1241022378 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90b000a760 con 0x7f90bc071b40 2023-12-05T09:29:16.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.063+0000 7f90a3fff700 1 -- 172.21.15.67:0/1241022378 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f90b000ad70 con 0x7f90bc071b40 2023-12-05T09:29:16.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.063+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc110ec0 con 0x7f90bc071b40 2023-12-05T09:29:16.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.063+0000 7f90a3fff700 1 -- 172.21.15.67:0/1241022378 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90b00113a0 con 0x7f90bc071b40 2023-12-05T09:29:16.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.063+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc111400 con 0x7f90bc071b40 2023-12-05T09:29:16.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.064+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc1096e0 con 0x7f90bc071b40 2023-12-05T09:29:16.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.065+0000 7f90a3fff700 1 -- 172.21.15.67:0/1241022378 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f90b0012400 con 0x7f90bc071b40 2023-12-05T09:29:16.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.066+0000 7f90a3fff700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f90a406caf0 0x7f90a406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:16.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.066+0000 7f90a3fff700 1 -- 172.21.15.67:0/1241022378 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f90b008be00 con 0x7f90bc071b40 2023-12-05T09:29:16.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.067+0000 7f90bb7fe700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f90a406caf0 0x7f90a406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:16.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.067+0000 7f90bb7fe700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f90a406caf0 0x7f90a406efa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90ac004f90 tx=0x7f90ac009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:16.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.071+0000 7f90a3fff700 1 -- 172.21.15.67:0/1241022378 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f90b0059c70 con 0x7f90bc071b40 2023-12-05T09:29:16.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:15 smithi134 ceph-mon[116304]: pgmap v68: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:16.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:15 smithi134 ceph-mon[116304]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:16.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.307+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90bc111680 con 0x7f90a406caf0 2023-12-05T09:29:16.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.308+0000 7f90a3fff700 1 -- 172.21.15.67:0/1241022378 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f90bc111680 con 0x7f90a406caf0 2023-12-05T09:29:16.307 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:29:16.307 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:29:16.307 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:29:16.307 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading daemons of type(s) mgr", 2023-12-05T09:29:16.307 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:29:16.307 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2023-12-05T09:29:16.307 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:29:16.308 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/2 daemons upgraded", 2023-12-05T09:29:16.308 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading grafana daemons", 2023-12-05T09:29:16.308 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:29:16.308 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:29:16.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f90a406caf0 msgr2=0x7f90a406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:16.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f90a406caf0 0x7f90a406efa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f90ac004f90 tx=0x7f90ac009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:16.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 msgr2=0x7f90bc10fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:16.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 0x7f90bc10fd40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f90b000c830 tx=0x7f90b0004470 comp rx=0 tx=0).stop 2023-12-05T09:29:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 shutdown_connections 2023-12-05T09:29:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f90a406caf0 0x7f90a406efa0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90bc0704f0 0x7f90bc10f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 --2- 172.21.15.67:0/1241022378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90bc071b40 0x7f90bc10fd40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.310+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 >> 172.21.15.67:0/1241022378 conn(0x7f90bc0f82d0 msgr2=0x7f90bc103390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.311+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 shutdown_connections 2023-12-05T09:29:16.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:16.311+0000 7f90c1dcb700 1 -- 172.21.15.67:0/1241022378 wait complete. 2023-12-05T09:29:17.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:16 smithi067 ceph-mon[107174]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:17.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:16 smithi067 ceph-mon[107174]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:17.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:16 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2832994672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:17.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:16 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:17.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:16 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:17.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:16 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:29:17.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:16 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:29:17.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:16 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:16 smithi134 ceph-mon[116304]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:16 smithi134 ceph-mon[116304]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:16 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2832994672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:16 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:16 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:16 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:29:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:16 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:29:17.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:16 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:18.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:18.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: pgmap v69: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:18.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:29:18.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:29:18.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:18.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: Upgrade: Finalizing container_image settings 2023-12-05T09:29:18.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-05T09:29:18.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-05T09:29:18.122 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.123 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: Upgrade: Complete! 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:29:18.124 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: pgmap v69: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: Upgrade: Finalizing container_image settings 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2023-12-05T09:29:18.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.131 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: Upgrade: Complete! 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:29:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:29:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:29:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:29:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:29:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:20.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:19 smithi067 ceph-mon[107174]: pgmap v70: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:20.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:19 smithi134 ceph-mon[116304]: pgmap v70: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:21.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:20 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:21.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:20 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:29:21.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:20 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:29:21.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:20 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:29:22.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:21 smithi067 ceph-mon[107174]: pgmap v71: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:22.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:21 smithi134 ceph-mon[116304]: pgmap v71: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:23 smithi067 ceph-mon[107174]: pgmap v72: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:24.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:23 smithi134 ceph-mon[116304]: pgmap v72: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:25 smithi067 ceph-mon[107174]: pgmap v73: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:26.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:25 smithi134 ceph-mon[116304]: pgmap v73: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:27.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:27 smithi067 ceph-mon[107174]: pgmap v74: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:27.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:27 smithi134 ceph-mon[116304]: pgmap v74: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2023-12-05T09:29:29.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:29 smithi067 ceph-mon[107174]: pgmap v75: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:29.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:29 smithi134 ceph-mon[116304]: pgmap v75: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:31.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:31 smithi067 ceph-mon[107174]: pgmap v76: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:31.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:31 smithi134 ceph-mon[116304]: pgmap v76: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:33.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:33 smithi067 ceph-mon[107174]: pgmap v77: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:33.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:33 smithi134 ceph-mon[116304]: pgmap v77: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:35.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:35 smithi067 ceph-mon[107174]: pgmap v78: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:35.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:35 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:29:35.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:35 smithi134 ceph-mon[116304]: pgmap v78: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:35.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:35 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:29:37.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:37 smithi067 ceph-mon[107174]: pgmap v79: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:37.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:37 smithi134 ceph-mon[116304]: pgmap v79: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:39.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:39 smithi067 ceph-mon[107174]: pgmap v80: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:39.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:39 smithi134 ceph-mon[116304]: pgmap v80: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:41.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:41 smithi067 ceph-mon[107174]: pgmap v81: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:41.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:41 smithi134 ceph-mon[116304]: pgmap v81: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:43.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:43 smithi067 ceph-mon[107174]: pgmap v82: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:43.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:43 smithi134 ceph-mon[116304]: pgmap v82: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:45.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:45 smithi067 ceph-mon[107174]: pgmap v83: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:45.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:45 smithi134 ceph-mon[116304]: pgmap v83: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.466+0000 7f91c4420700 1 -- 172.21.15.67:0/2855270469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 msgr2=0x7f91bc0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.466+0000 7f91c4420700 1 --2- 172.21.15.67:0/2855270469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 0x7f91bc0fd000 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f91b8004940 tx=0x7f91b8009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.466+0000 7f91c4420700 1 -- 172.21.15.67:0/2855270469 shutdown_connections 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.466+0000 7f91c4420700 1 --2- 172.21.15.67:0/2855270469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc0fde00 0x7f91bc0fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.466+0000 7f91c4420700 1 --2- 172.21.15.67:0/2855270469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 0x7f91bc0fd000 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.466+0000 7f91c4420700 1 -- 172.21.15.67:0/2855270469 >> 172.21.15.67:0/2855270469 conn(0x7f91bc0f82d0 msgr2=0x7f91bc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.466+0000 7f91c4420700 1 -- 172.21.15.67:0/2855270469 shutdown_connections 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.466+0000 7f91c4420700 1 -- 172.21.15.67:0/2855270469 wait complete. 2023-12-05T09:29:46.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.467+0000 7f91c4420700 1 Processor -- start 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.467+0000 7f91c4420700 1 -- start start 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c4420700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 0x7f91bc10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c4420700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc0fde00 0x7f91bc10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c4420700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc10e0a0 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c4420700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc10e940 con 0x7f91bc0fde00 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c21bc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 0x7f91bc10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c21bc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 0x7f91bc10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38818/0 (socket says 172.21.15.67:38818) 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c21bc700 1 -- 172.21.15.67:0/1273508220 learned_addr learned my addr 172.21.15.67:0/1273508220 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c19bb700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc0fde00 0x7f91bc10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c21bc700 1 -- 172.21.15.67:0/1273508220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc0fde00 msgr2=0x7f91bc10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c21bc700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc0fde00 0x7f91bc10daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.468+0000 7f91c21bc700 1 -- 172.21.15.67:0/1273508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8005040 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.469+0000 7f91c21bc700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 0x7f91bc10d560 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009360 tx=0x7f91b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.469+0000 7f91b2ffd700 1 -- 172.21.15.67:0/1273508220 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b800e040 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.469+0000 7f91b2ffd700 1 -- 172.21.15.67:0/1273508220 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91b8004290 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.469+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc10ebc0 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.469+0000 7f91b2ffd700 1 -- 172.21.15.67:0/1273508220 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b801c630 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.469+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc10f100 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.470+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc04bb80 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.471+0000 7f91b2ffd700 1 -- 172.21.15.67:0/1273508220 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f91b8013960 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.472+0000 7f91b2ffd700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91a806caf0 0x7f91a806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.472+0000 7f91b2ffd700 1 -- 172.21.15.67:0/1273508220 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f91b808d1e0 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.472+0000 7f91c19bb700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91a806caf0 0x7f91a806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:46.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.473+0000 7f91c19bb700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91a806caf0 0x7f91a806efa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91ac004990 tx=0x7f91ac009ee0 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:46.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.477+0000 7f91b2ffd700 1 -- 172.21.15.67:0/1273508220 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f91b805b050 con 0x7f91bc0fcbf0 2023-12-05T09:29:46.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.705+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91bc10f510 con 0x7f91a806caf0 2023-12-05T09:29:46.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.706+0000 7f91b2ffd700 1 -- 172.21.15.67:0/1273508220 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f91bc10f510 con 0x7f91a806caf0 2023-12-05T09:29:46.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91a806caf0 msgr2=0x7f91a806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91a806caf0 0x7f91a806efa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f91ac004990 tx=0x7f91ac009ee0 comp rx=0 tx=0).stop 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 msgr2=0x7f91bc10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 0x7f91bc10d560 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009360 tx=0x7f91b8009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 shutdown_connections 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91a806caf0 0x7f91a806efa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91bc0fcbf0 0x7f91bc10d560 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 --2- 172.21.15.67:0/1273508220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc0fde00 0x7f91bc10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 >> 172.21.15.67:0/1273508220 conn(0x7f91bc0f82d0 msgr2=0x7f91bc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 shutdown_connections 2023-12-05T09:29:46.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:46.709+0000 7f91c4420700 1 -- 172.21.15.67:0/1273508220 wait complete. 2023-12-05T09:29:47.142 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2023-12-05T09:29:47.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:47 smithi067 ceph-mon[107174]: pgmap v84: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:47.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:47 smithi067 ceph-mon[107174]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:47 smithi134 ceph-mon[116304]: pgmap v84: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:47 smithi134 ceph-mon[116304]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:47.625 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:29:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.917+0000 7ffaac77f700 1 -- 172.21.15.67:0/875755073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 msgr2=0x7ffaa4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.917+0000 7ffaac77f700 1 --2- 172.21.15.67:0/875755073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 0x7ffaa4102fd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0004940 tx=0x7ffaa0009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.917+0000 7ffaac77f700 1 -- 172.21.15.67:0/875755073 shutdown_connections 2023-12-05T09:29:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.917+0000 7ffaac77f700 1 --2- 172.21.15.67:0/875755073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa41035a0 0x7ffaa40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.917+0000 7ffaac77f700 1 --2- 172.21.15.67:0/875755073 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 0x7ffaa4102fd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.917+0000 7ffaac77f700 1 -- 172.21.15.67:0/875755073 >> 172.21.15.67:0/875755073 conn(0x7ffaa40f8790 msgr2=0x7ffaa40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:48.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.917+0000 7ffaac77f700 1 -- 172.21.15.67:0/875755073 shutdown_connections 2023-12-05T09:29:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.917+0000 7ffaac77f700 1 -- 172.21.15.67:0/875755073 wait complete. 2023-12-05T09:29:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.918+0000 7ffaac77f700 1 Processor -- start 2023-12-05T09:29:48.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.918+0000 7ffaac77f700 1 -- start start 2023-12-05T09:29:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.918+0000 7ffaac77f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 0x7ffaa4115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.918+0000 7ffaac77f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa41035a0 0x7ffaa4115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaac77f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa41163b0 con 0x7ffaa4102c00 2023-12-05T09:29:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaac77f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa410f6e0 con 0x7ffaa41035a0 2023-12-05T09:29:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaaa51b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 0x7ffaa4115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaaa51b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 0x7ffaa4115820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38828/0 (socket says 172.21.15.67:38828) 2023-12-05T09:29:48.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaaa51b700 1 -- 172.21.15.67:0/2882985042 learned_addr learned my addr 172.21.15.67:0/2882985042 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaa9d1a700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa41035a0 0x7ffaa4115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaaa51b700 1 -- 172.21.15.67:0/2882985042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa41035a0 msgr2=0x7ffaa4115d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaaa51b700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa41035a0 0x7ffaa4115d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaaa51b700 1 -- 172.21.15.67:0/2882985042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0005040 con 0x7ffaa4102c00 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaa9d1a700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa41035a0 0x7ffaa4115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.919+0000 7ffaaa51b700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 0x7ffaa4115820 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009360 tx=0x7ffaa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.920+0000 7ffa9affd700 1 -- 172.21.15.67:0/2882985042 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa000e040 con 0x7ffaa4102c00 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.920+0000 7ffa9affd700 1 -- 172.21.15.67:0/2882985042 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffaa000bc50 con 0x7ffaa4102c00 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.920+0000 7ffa9affd700 1 -- 172.21.15.67:0/2882985042 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa001c630 con 0x7ffaa4102c00 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.920+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa410f960 con 0x7ffaa4102c00 2023-12-05T09:29:48.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.920+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa410fea0 con 0x7ffaa4102c00 2023-12-05T09:29:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.921+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa40fc390 con 0x7ffaa4102c00 2023-12-05T09:29:48.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.922+0000 7ffa9affd700 1 -- 172.21.15.67:0/2882985042 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7ffaa0013420 con 0x7ffaa4102c00 2023-12-05T09:29:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.923+0000 7ffa9affd700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffa9006caf0 0x7ffa9006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.923+0000 7ffa9affd700 1 -- 172.21.15.67:0/2882985042 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ffaa008cfa0 con 0x7ffaa4102c00 2023-12-05T09:29:48.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.923+0000 7ffaa9d1a700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffa9006caf0 0x7ffa9006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:48.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.924+0000 7ffaa9d1a700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffa9006caf0 0x7ffa9006efa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009fd0 tx=0x7ffa9400b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:48.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:48.927+0000 7ffa9affd700 1 -- 172.21.15.67:0/2882985042 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7ffaa005aeb0 con 0x7ffaa4102c00 2023-12-05T09:29:49.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.228+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffaa4110e00 con 0x7ffaa4102c00 2023-12-05T09:29:49.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.228+0000 7ffa9affd700 1 -- 172.21.15.67:0/2882985042 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7ffaa005aa40 con 0x7ffaa4102c00 2023-12-05T09:29:49.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffa9006caf0 msgr2=0x7ffa9006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffa9006caf0 0x7ffa9006efa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffa94009fd0 tx=0x7ffa9400b040 comp rx=0 tx=0).stop 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 msgr2=0x7ffaa4115820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 0x7ffaa4115820 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009360 tx=0x7ffaa0009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 shutdown_connections 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7ffa9006caf0 0x7ffa9006efa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffaa4102c00 0x7ffaa4115820 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 --2- 172.21.15.67:0/2882985042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffaa41035a0 0x7ffaa4115d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 >> 172.21.15.67:0/2882985042 conn(0x7ffaa40f8790 msgr2=0x7ffaa40fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 shutdown_connections 2023-12-05T09:29:49.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:49.231+0000 7ffaac77f700 1 -- 172.21.15.67:0/2882985042 wait complete. 2023-12-05T09:29:49.244 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:29:49.631 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2023-12-05T09:29:49.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:49 smithi067 ceph-mon[107174]: pgmap v85: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:49.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:49 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/2882985042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:49.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:49 smithi134 ceph-mon[116304]: pgmap v85: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:49.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:49 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/2882985042' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:50.071 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:29:50.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:50 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:29:50.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:50 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:29:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.441+0000 7f54db546700 1 -- 172.21.15.67:0/4061746530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 msgr2=0x7f54d40703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.441+0000 7f54db546700 1 --2- 172.21.15.67:0/4061746530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 0x7f54d40703b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f54d0004970 tx=0x7f54d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.442+0000 7f54db546700 1 -- 172.21.15.67:0/4061746530 shutdown_connections 2023-12-05T09:29:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.442+0000 7f54db546700 1 --2- 172.21.15.67:0/4061746530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d40708f0 0x7f54d4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.442+0000 7f54db546700 1 --2- 172.21.15.67:0/4061746530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 0x7f54d40703b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.442+0000 7f54db546700 1 -- 172.21.15.67:0/4061746530 >> 172.21.15.67:0/4061746530 conn(0x7f54d40f8790 msgr2=0x7f54d40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.442+0000 7f54db546700 1 -- 172.21.15.67:0/4061746530 shutdown_connections 2023-12-05T09:29:51.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.442+0000 7f54db546700 1 -- 172.21.15.67:0/4061746530 wait complete. 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54db546700 1 Processor -- start 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54db546700 1 -- start start 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54db546700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 0x7f54d4115780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54db546700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d40708f0 0x7f54d4115cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54db546700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4116310 con 0x7f54d406ffe0 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54db546700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d410f6b0 con 0x7f54d40708f0 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54d92e2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 0x7f54d4115780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54d92e2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 0x7f54d4115780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38840/0 (socket says 172.21.15.67:38840) 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.443+0000 7f54d92e2700 1 -- 172.21.15.67:0/1973870281 learned_addr learned my addr 172.21.15.67:0/1973870281 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54d8ae1700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d40708f0 0x7f54d4115cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54d92e2700 1 -- 172.21.15.67:0/1973870281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d40708f0 msgr2=0x7f54d4115cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54d92e2700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d40708f0 0x7f54d4115cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54d92e2700 1 -- 172.21.15.67:0/1973870281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d0005040 con 0x7f54d406ffe0 2023-12-05T09:29:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54d92e2700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 0x7f54d4115780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f54d0004f50 tx=0x7f54d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54c9ffb700 1 -- 172.21.15.67:0/1973870281 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d000e040 con 0x7f54d406ffe0 2023-12-05T09:29:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54c9ffb700 1 -- 172.21.15.67:0/1973870281 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54d000bc10 con 0x7f54d406ffe0 2023-12-05T09:29:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d410f930 con 0x7f54d406ffe0 2023-12-05T09:29:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.444+0000 7f54c9ffb700 1 -- 172.21.15.67:0/1973870281 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54d001c3f0 con 0x7f54d406ffe0 2023-12-05T09:29:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.445+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d410fe70 con 0x7f54d406ffe0 2023-12-05T09:29:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.446+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d41065d0 con 0x7f54d406ffe0 2023-12-05T09:29:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.447+0000 7f54c9ffb700 1 -- 172.21.15.67:0/1973870281 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f54d0013420 con 0x7f54d406ffe0 2023-12-05T09:29:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.448+0000 7f54c9ffb700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f54c006caf0 0x7f54c006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.448+0000 7f54c9ffb700 1 -- 172.21.15.67:0/1973870281 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f54d008d200 con 0x7f54d406ffe0 2023-12-05T09:29:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.448+0000 7f54d8ae1700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f54c006caf0 0x7f54c006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:51.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.448+0000 7f54d8ae1700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f54c006caf0 0x7f54c006efa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009fd0 tx=0x7f54c4009f20 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.453+0000 7f54c9ffb700 1 -- 172.21.15.67:0/1973870281 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f54d005afd0 con 0x7f54d406ffe0 2023-12-05T09:29:51.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.750+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f54d410fac0 con 0x7f54d406ffe0 2023-12-05T09:29:51.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.751+0000 7f54c9ffb700 1 -- 172.21.15.67:0/1973870281 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f54d410fac0 con 0x7f54d406ffe0 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f54c006caf0 msgr2=0x7f54c006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f54c006caf0 0x7f54c006efa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009fd0 tx=0x7f54c4009f20 comp rx=0 tx=0).stop 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 msgr2=0x7f54d4115780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 0x7f54d4115780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f54d0004f50 tx=0x7f54d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 shutdown_connections 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f54c006caf0 0x7f54c006efa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54d406ffe0 0x7f54d4115780 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 --2- 172.21.15.67:0/1973870281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54d40708f0 0x7f54d4115cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 >> 172.21.15.67:0/1973870281 conn(0x7f54d40f8790 msgr2=0x7f54d4103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 shutdown_connections 2023-12-05T09:29:51.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:51.753+0000 7f54db546700 1 -- 172.21.15.67:0/1973870281 wait complete. 2023-12-05T09:29:51.766 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)" 2023-12-05T09:29:51.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:51 smithi067 ceph-mon[107174]: pgmap v86: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:51.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:51 smithi134 ceph-mon[116304]: pgmap v86: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:52.240 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2023-12-05T09:29:52.679 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:29:52.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:52 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/1973870281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:52.905 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:52 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/1973870281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:53.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.884+0000 7f3c356e1700 1 -- 172.21.15.67:0/583514616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 msgr2=0x7f3c300fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:53.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.884+0000 7f3c356e1700 1 --2- 172.21.15.67:0/583514616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 0x7f3c300fcc10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3c18004940 tx=0x7f3c18009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:53.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.884+0000 7f3c356e1700 1 -- 172.21.15.67:0/583514616 shutdown_connections 2023-12-05T09:29:53.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.884+0000 7f3c356e1700 1 --2- 172.21.15.67:0/583514616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 0x7f3c300fcc10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.884+0000 7f3c356e1700 1 --2- 172.21.15.67:0/583514616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c30102c00 0x7f3c30102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.884+0000 7f3c356e1700 1 -- 172.21.15.67:0/583514616 >> 172.21.15.67:0/583514616 conn(0x7f3c300f8790 msgr2=0x7f3c300faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.884+0000 7f3c356e1700 1 -- 172.21.15.67:0/583514616 shutdown_connections 2023-12-05T09:29:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.884+0000 7f3c356e1700 1 -- 172.21.15.67:0/583514616 wait complete. 2023-12-05T09:29:53.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.885+0000 7f3c356e1700 1 Processor -- start 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.885+0000 7f3c356e1700 1 -- start start 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.885+0000 7f3c356e1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c30102c00 0x7f3c30115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.885+0000 7f3c356e1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 0x7f3c30115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.885+0000 7f3c356e1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301163d0 con 0x7f3c301035a0 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.885+0000 7f3c356e1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3010f700 con 0x7f3c30102c00 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.886+0000 7f3c27fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 0x7f3c30115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.886+0000 7f3c27fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 0x7f3c30115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:38860/0 (socket says 172.21.15.67:38860) 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.886+0000 7f3c27fff700 1 -- 172.21.15.67:0/3495551896 learned_addr learned my addr 172.21.15.67:0/3495551896 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.886+0000 7f3c2effd700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c30102c00 0x7f3c30115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.886+0000 7f3c27fff700 1 -- 172.21.15.67:0/3495551896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c30102c00 msgr2=0x7f3c30115840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.886+0000 7f3c27fff700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c30102c00 0x7f3c30115840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:53.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.886+0000 7f3c27fff700 1 -- 172.21.15.67:0/3495551896 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18005040 con 0x7f3c301035a0 2023-12-05T09:29:53.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.886+0000 7f3c27fff700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 0x7f3c30115d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009180 tx=0x7f3c18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:53.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.887+0000 7f3c277fe700 1 -- 172.21.15.67:0/3495551896 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c1800e040 con 0x7f3c301035a0 2023-12-05T09:29:53.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.887+0000 7f3c277fe700 1 -- 172.21.15.67:0/3495551896 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3c18004290 con 0x7f3c301035a0 2023-12-05T09:29:53.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.887+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3010f980 con 0x7f3c301035a0 2023-12-05T09:29:53.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.887+0000 7f3c277fe700 1 -- 172.21.15.67:0/3495551896 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c1801c3f0 con 0x7f3c301035a0 2023-12-05T09:29:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.887+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3010fec0 con 0x7f3c301035a0 2023-12-05T09:29:53.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.888+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c300fc390 con 0x7f3c301035a0 2023-12-05T09:29:53.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.889+0000 7f3c277fe700 1 -- 172.21.15.67:0/3495551896 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f3c1800bc50 con 0x7f3c301035a0 2023-12-05T09:29:53.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.890+0000 7f3c277fe700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f3c1c06caf0 0x7f3c1c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:53.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.890+0000 7f3c277fe700 1 -- 172.21.15.67:0/3495551896 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f3c1808d0a0 con 0x7f3c301035a0 2023-12-05T09:29:53.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.890+0000 7f3c2effd700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f3c1c06caf0 0x7f3c1c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:53.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.891+0000 7f3c2effd700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f3c1c06caf0 0x7f3c1c06efa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c20007fd0 tx=0x7f3c20009040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:53.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:53.894+0000 7f3c277fe700 1 -- 172.21.15.67:0/3495551896 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3c1805aef0 con 0x7f3c301035a0 2023-12-05T09:29:54.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:53 smithi067 ceph-mon[107174]: pgmap v87: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:54.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:53 smithi134 ceph-mon[116304]: pgmap v87: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:54.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.191+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c3010fb10 con 0x7f3c301035a0 2023-12-05T09:29:54.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.191+0000 7f3c277fe700 1 -- 172.21.15.67:0/3495551896 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f3c3010fb10 con 0x7f3c301035a0 2023-12-05T09:29:54.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.193+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f3c1c06caf0 msgr2=0x7f3c1c06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:54.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.193+0000 7f3c356e1700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f3c1c06caf0 0x7f3c1c06efa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c20007fd0 tx=0x7f3c20009040 comp rx=0 tx=0).stop 2023-12-05T09:29:54.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.193+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 msgr2=0x7f3c30115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:54.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.193+0000 7f3c356e1700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 0x7f3c30115d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009180 tx=0x7f3c18009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:54.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.194+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 shutdown_connections 2023-12-05T09:29:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.194+0000 7f3c356e1700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f3c1c06caf0 0x7f3c1c06efa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.194+0000 7f3c356e1700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c30102c00 0x7f3c30115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.194+0000 7f3c356e1700 1 --2- 172.21.15.67:0/3495551896 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3c301035a0 0x7f3c30115d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.194+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 >> 172.21.15.67:0/3495551896 conn(0x7f3c300f8790 msgr2=0x7f3c300fa190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.194+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 shutdown_connections 2023-12-05T09:29:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:54.194+0000 7f3c356e1700 1 -- 172.21.15.67:0/3495551896 wait complete. 2023-12-05T09:29:54.207 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:29:54.624 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2023-12-05T09:29:54.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:54 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3495551896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:55.064 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:29:55.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:54 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3495551896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:29:56.062 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:55 smithi067 ceph-mon[107174]: pgmap v88: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:55 smithi134 ceph-mon[116304]: pgmap v88: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.304+0000 7f50a1f6b700 1 -- 172.21.15.67:0/4037584948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c102c00 msgr2=0x7f509c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.304+0000 7f50a1f6b700 1 --2- 172.21.15.67:0/4037584948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c102c00 0x7f509c102fd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f508c004940 tx=0x7f508c009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:56.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.304+0000 7f50a1f6b700 1 -- 172.21.15.67:0/4037584948 shutdown_connections 2023-12-05T09:29:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.304+0000 7f50a1f6b700 1 --2- 172.21.15.67:0/4037584948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c1035a0 0x7f509c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.304+0000 7f50a1f6b700 1 --2- 172.21.15.67:0/4037584948 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c102c00 0x7f509c102fd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.304+0000 7f50a1f6b700 1 -- 172.21.15.67:0/4037584948 >> 172.21.15.67:0/4037584948 conn(0x7f509c0f8790 msgr2=0x7f509c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.304+0000 7f50a1f6b700 1 -- 172.21.15.67:0/4037584948 shutdown_connections 2023-12-05T09:29:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.304+0000 7f50a1f6b700 1 -- 172.21.15.67:0/4037584948 wait complete. 2023-12-05T09:29:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.305+0000 7f50a1f6b700 1 Processor -- start 2023-12-05T09:29:56.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.305+0000 7f50a1f6b700 1 -- start start 2023-12-05T09:29:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.306+0000 7f50a1f6b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102c00 0x7f509c113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.306+0000 7f50a1f6b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c1035a0 0x7f509c113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.306+0000 7f50a1f6b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c114210 con 0x7f509c1035a0 2023-12-05T09:29:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.306+0000 7f50a1f6b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c10d500 con 0x7f509c102c00 2023-12-05T09:29:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.306+0000 7f509affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c1035a0 0x7f509c113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:56.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.306+0000 7f509affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c1035a0 0x7f509c113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33384/0 (socket says 172.21.15.67:33384) 2023-12-05T09:29:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.306+0000 7f509affd700 1 -- 172.21.15.67:0/2553952159 learned_addr learned my addr 172.21.15.67:0/2553952159 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:29:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f509b7fe700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102c00 0x7f509c113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f509affd700 1 -- 172.21.15.67:0/2553952159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102c00 msgr2=0x7f509c113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f509affd700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102c00 0x7f509c113640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f509affd700 1 -- 172.21.15.67:0/2553952159 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c005040 con 0x7f509c1035a0 2023-12-05T09:29:56.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f509affd700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c1035a0 0x7f509c113bc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f509000eb40 tx=0x7f509000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f5083fff700 1 -- 172.21.15.67:0/2553952159 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5090007cc0 con 0x7f509c1035a0 2023-12-05T09:29:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f5083fff700 1 -- 172.21.15.67:0/2553952159 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f509000f040 con 0x7f509c1035a0 2023-12-05T09:29:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c10d730 con 0x7f509c1035a0 2023-12-05T09:29:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f5083fff700 1 -- 172.21.15.67:0/2553952159 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5090009570 con 0x7f509c1035a0 2023-12-05T09:29:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.307+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c10dc70 con 0x7f509c1035a0 2023-12-05T09:29:56.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.309+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c0fff10 con 0x7f509c1035a0 2023-12-05T09:29:56.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.309+0000 7f5083fff700 1 -- 172.21.15.67:0/2553952159 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f50900096d0 con 0x7f509c1035a0 2023-12-05T09:29:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.310+0000 7f5083fff700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f508406caf0 0x7f508406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:29:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.311+0000 7f5083fff700 1 -- 172.21.15.67:0/2553952159 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f509008b880 con 0x7f509c1035a0 2023-12-05T09:29:56.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.311+0000 7f509b7fe700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f508406caf0 0x7f508406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:29:56.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.311+0000 7f509b7fe700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f508406caf0 0x7f508406efa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f508c00b0d0 tx=0x7f508c009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:29:56.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.315+0000 7f5083fff700 1 -- 172.21.15.67:0/2553952159 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f5090059720 con 0x7f509c1035a0 2023-12-05T09:29:56.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:56.545+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}) v1 -- 0x7f509c10ec20 con 0x7f508406caf0 2023-12-05T09:29:57.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:57 smithi067 ceph-mon[107174]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:57.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:57 smithi067 ceph-mon[107174]: pgmap v89: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:57.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:57 smithi134 ceph-mon[116304]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:29:57.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:57 smithi134 ceph-mon[116304]: pgmap v89: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:58.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.365+0000 7f5083fff700 1 -- 172.21.15.67:0/2553952159 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5089 (secure 0 0 0) 0x7f509c10ec20 con 0x7f508406caf0 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f508406caf0 msgr2=0x7f508406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f508406caf0 0x7f508406efa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f508c00b0d0 tx=0x7f508c009e30 comp rx=0 tx=0).stop 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c1035a0 msgr2=0x7f509c113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c1035a0 0x7f509c113bc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f509000eb40 tx=0x7f509000b040 comp rx=0 tx=0).stop 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 shutdown_connections 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f508406caf0 0x7f508406efa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102c00 0x7f509c113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 --2- 172.21.15.67:0/2553952159 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f509c1035a0 0x7f509c113bc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 >> 172.21.15.67:0/2553952159 conn(0x7f509c0f8790 msgr2=0x7f509c0fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 shutdown_connections 2023-12-05T09:29:58.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:29:58.368+0000 7f50a1f6b700 1 -- 172.21.15.67:0/2553952159 wait complete. 2023-12-05T09:29:58.381 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:29:58.787 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch ps' 2023-12-05T09:29:59.220 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:29:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:29:59 smithi067 ceph-mon[107174]: pgmap v90: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:29:59.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:29:59 smithi134 ceph-mon[116304]: pgmap v90: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:00.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.408+0000 7f74f65e8700 1 -- 172.21.15.67:0/2100237395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f0102c00 msgr2=0x7f74f0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:00.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.408+0000 7f74f65e8700 1 --2- 172.21.15.67:0/2100237395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f0102c00 0x7f74f0102fd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f74e0004940 tx=0x7f74e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:00.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.408+0000 7f74f65e8700 1 -- 172.21.15.67:0/2100237395 shutdown_connections 2023-12-05T09:30:00.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.408+0000 7f74f65e8700 1 --2- 172.21.15.67:0/2100237395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f01035a0 0x7f74f00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:00.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.408+0000 7f74f65e8700 1 --2- 172.21.15.67:0/2100237395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f0102c00 0x7f74f0102fd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:00.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.408+0000 7f74f65e8700 1 -- 172.21.15.67:0/2100237395 >> 172.21.15.67:0/2100237395 conn(0x7f74f00f8790 msgr2=0x7f74f00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:00.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.408+0000 7f74f65e8700 1 -- 172.21.15.67:0/2100237395 shutdown_connections 2023-12-05T09:30:00.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.408+0000 7f74f65e8700 1 -- 172.21.15.67:0/2100237395 wait complete. 2023-12-05T09:30:00.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.409+0000 7f74f65e8700 1 Processor -- start 2023-12-05T09:30:00.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.409+0000 7f74f65e8700 1 -- start start 2023-12-05T09:30:00.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.409+0000 7f74f65e8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0102c00 0x7f74f0115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:00.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.409+0000 7f74f65e8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f01035a0 0x7f74f0115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.409+0000 7f74f65e8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f01163c0 con 0x7f74f01035a0 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.409+0000 7f74f65e8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f010f6f0 con 0x7f74f0102c00 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.410+0000 7f74ef7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f01035a0 0x7f74f0115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.410+0000 7f74ef7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f01035a0 0x7f74f0115d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33404/0 (socket says 172.21.15.67:33404) 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.410+0000 7f74ef7fe700 1 -- 172.21.15.67:0/1390017636 learned_addr learned my addr 172.21.15.67:0/1390017636 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.410+0000 7f74effff700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0102c00 0x7f74f0115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.410+0000 7f74ef7fe700 1 -- 172.21.15.67:0/1390017636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0102c00 msgr2=0x7f74f0115830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.410+0000 7f74ef7fe700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0102c00 0x7f74f0115830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.410+0000 7f74ef7fe700 1 -- 172.21.15.67:0/1390017636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0005040 con 0x7f74f01035a0 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.410+0000 7f74ef7fe700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f01035a0 0x7f74f0115d70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f74e4002a80 tx=0x7f74e4004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.411+0000 7f74ecff9700 1 -- 172.21.15.67:0/1390017636 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e4004e80 con 0x7f74f01035a0 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.411+0000 7f74ecff9700 1 -- 172.21.15.67:0/1390017636 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74e400f040 con 0x7f74f01035a0 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.411+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f010f9d0 con 0x7f74f01035a0 2023-12-05T09:30:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.411+0000 7f74ecff9700 1 -- 172.21.15.67:0/1390017636 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74e400d980 con 0x7f74f01035a0 2023-12-05T09:30:00.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.411+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f010ff10 con 0x7f74f01035a0 2023-12-05T09:30:00.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.412+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f00fc390 con 0x7f74f01035a0 2023-12-05T09:30:00.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.413+0000 7f74ecff9700 1 -- 172.21.15.67:0/1390017636 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f74e4007cc0 con 0x7f74f01035a0 2023-12-05T09:30:00.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.414+0000 7f74ecff9700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f74d806cb40 0x7f74d806eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:00.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.414+0000 7f74ecff9700 1 -- 172.21.15.67:0/1390017636 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f74e408b390 con 0x7f74f01035a0 2023-12-05T09:30:00.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.414+0000 7f74effff700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f74d806cb40 0x7f74d806eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:00.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.415+0000 7f74effff700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f74d806cb40 0x7f74d806eff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009fd0 tx=0x7f74e0009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:00.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.418+0000 7f74ecff9700 1 -- 172.21.15.67:0/1390017636 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f74e4059160 con 0x7f74f01035a0 2023-12-05T09:30:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.638+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74f0115500 con 0x7f74d806cb40 2023-12-05T09:30:00.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.648+0000 7f74ecff9700 1 -- 172.21.15.67:0/1390017636 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f74f0115500 con 0x7f74d806cb40 2023-12-05T09:30:00.647 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:30:00.647 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (68s) 48s ago 11m 15.5M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:30:00.647 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (11m) 48s ago 11m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:30:00.647 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (10m) 97s ago 10m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:30:00.647 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (53s) 48s ago 10m 49.2M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (6m) 48s ago 6m 6294M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (6m) 48s ago 6m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (6m) 97s ago 6m 14.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (6m) 97s ago 6m 14.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (3m) 48s ago 12m 511M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (2m) 97s ago 10m 449M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (12m) 48s ago 12m 100M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (10m) 97s ago 10m 68.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (103s) 48s ago 11m 8724k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (100s) 97s ago 10m 3644k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (9m) 48s ago 9m 786M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (9m) 48s ago 9m 850M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (8m) 48s ago 8m 656M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (8m) 97s ago 8m 1025M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:30:00.648 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (8m) 97s ago 8m 771M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:30:00.649 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (7m) 97s ago 7m 867M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:30:00.649 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (83s) 48s ago 10m 44.7M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:30:00.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.650+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f74d806cb40 msgr2=0x7f74d806eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:00.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.650+0000 7f74f65e8700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f74d806cb40 0x7f74d806eff0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74e0009fd0 tx=0x7f74e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:00.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f01035a0 msgr2=0x7f74f0115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:00.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f01035a0 0x7f74f0115d70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f74e4002a80 tx=0x7f74e4004630 comp rx=0 tx=0).stop 2023-12-05T09:30:00.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 shutdown_connections 2023-12-05T09:30:00.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f74d806cb40 0x7f74d806eff0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:00.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f0102c00 0x7f74f0115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:00.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 --2- 172.21.15.67:0/1390017636 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f74f01035a0 0x7f74f0115d70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:00.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 >> 172.21.15.67:0/1390017636 conn(0x7f74f00f8790 msgr2=0x7f74f00fa0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:00.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 shutdown_connections 2023-12-05T09:30:00.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:00.651+0000 7f74f65e8700 1 -- 172.21.15.67:0/1390017636 wait complete. 2023-12-05T09:30:00.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:00 smithi067 ceph-mon[107174]: overall HEALTH_OK 2023-12-05T09:30:00.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:00 smithi134 ceph-mon[116304]: overall HEALTH_OK 2023-12-05T09:30:01.061 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T09:30:01.062 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:30:01.062 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2023-12-05T09:30:01.500 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:30:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:01 smithi067 ceph-mon[107174]: pgmap v91: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:01 smithi067 ceph-mon[107174]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:01 smithi134 ceph-mon[116304]: pgmap v91: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:01 smithi134 ceph-mon[116304]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:02.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.785+0000 7f04f685f700 1 -- 172.21.15.67:0/1402194030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f0102c00 msgr2=0x7f04f0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.785+0000 7f04f685f700 1 --2- 172.21.15.67:0/1402194030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f0102c00 0x7f04f0102fd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f04e0004940 tx=0x7f04e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.785+0000 7f04f685f700 1 -- 172.21.15.67:0/1402194030 shutdown_connections 2023-12-05T09:30:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.785+0000 7f04f685f700 1 --2- 172.21.15.67:0/1402194030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f01035a0 0x7f04f00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.785+0000 7f04f685f700 1 --2- 172.21.15.67:0/1402194030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f0102c00 0x7f04f0102fd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.785+0000 7f04f685f700 1 -- 172.21.15.67:0/1402194030 >> 172.21.15.67:0/1402194030 conn(0x7f04f00f8790 msgr2=0x7f04f00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.786+0000 7f04f685f700 1 -- 172.21.15.67:0/1402194030 shutdown_connections 2023-12-05T09:30:02.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.786+0000 7f04f685f700 1 -- 172.21.15.67:0/1402194030 wait complete. 2023-12-05T09:30:02.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.786+0000 7f04f685f700 1 Processor -- start 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04f685f700 1 -- start start 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04f685f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0102c00 0x7f04f0113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04f685f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f01035a0 0x7f04f0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04f685f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01141e0 con 0x7f04f01035a0 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04f685f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f010d4d0 con 0x7f04f0102c00 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04ef7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f01035a0 0x7f04f0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04ef7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f01035a0 0x7f04f0113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33432/0 (socket says 172.21.15.67:33432) 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04ef7fe700 1 -- 172.21.15.67:0/562745665 learned_addr learned my addr 172.21.15.67:0/562745665 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.787+0000 7f04effff700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0102c00 0x7f04f0113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.788+0000 7f04ef7fe700 1 -- 172.21.15.67:0/562745665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0102c00 msgr2=0x7f04f0113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.788+0000 7f04ef7fe700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0102c00 0x7f04f0113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:02.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.788+0000 7f04ef7fe700 1 -- 172.21.15.67:0/562745665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0005040 con 0x7f04f01035a0 2023-12-05T09:30:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.788+0000 7f04ef7fe700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f01035a0 0x7f04f0113b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f04e4002a50 tx=0x7f04e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.788+0000 7f04ecff9700 1 -- 172.21.15.67:0/562745665 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e4007cc0 con 0x7f04f01035a0 2023-12-05T09:30:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.788+0000 7f04ecff9700 1 -- 172.21.15.67:0/562745665 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04e400f040 con 0x7f04f01035a0 2023-12-05T09:30:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.788+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f010d760 con 0x7f04f01035a0 2023-12-05T09:30:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.788+0000 7f04ecff9700 1 -- 172.21.15.67:0/562745665 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04e400d920 con 0x7f04f01035a0 2023-12-05T09:30:02.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.789+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f010dca0 con 0x7f04f01035a0 2023-12-05T09:30:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.790+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f00fff10 con 0x7f04f01035a0 2023-12-05T09:30:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.791+0000 7f04ecff9700 1 -- 172.21.15.67:0/562745665 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f04e4009680 con 0x7f04f01035a0 2023-12-05T09:30:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.792+0000 7f04ecff9700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04d806caf0 0x7f04d806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:02.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.792+0000 7f04ecff9700 1 -- 172.21.15.67:0/562745665 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f04e408b9f0 con 0x7f04f01035a0 2023-12-05T09:30:02.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.792+0000 7f04effff700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04d806caf0 0x7f04d806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:02.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.793+0000 7f04effff700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04d806caf0 0x7f04d806efa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f04e0000c00 tx=0x7f04e0009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:02.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:02.796+0000 7f04ecff9700 1 -- 172.21.15.67:0/562745665 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f04e408de60 con 0x7f04f01035a0 2023-12-05T09:30:03.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.004+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f04f010ebf0 con 0x7f04f01035a0 2023-12-05T09:30:03.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.009+0000 7f04ecff9700 1 -- 172.21.15.67:0/562745665 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f04e408b020 con 0x7f04f01035a0 2023-12-05T09:30:03.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.011+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04d806caf0 msgr2=0x7f04d806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:03.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.011+0000 7f04f685f700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04d806caf0 0x7f04d806efa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f04e0000c00 tx=0x7f04e0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.011+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f01035a0 msgr2=0x7f04f0113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.011+0000 7f04f685f700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f01035a0 0x7f04f0113b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f04e4002a50 tx=0x7f04e4004600 comp rx=0 tx=0).stop 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.011+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 shutdown_connections 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.011+0000 7f04f685f700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f04d806caf0 0x7f04d806efa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.011+0000 7f04f685f700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04f0102c00 0x7f04f0113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.011+0000 7f04f685f700 1 --2- 172.21.15.67:0/562745665 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04f01035a0 0x7f04f0113b90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.012+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 >> 172.21.15.67:0/562745665 conn(0x7f04f00f8790 msgr2=0x7f04f00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.012+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 shutdown_connections 2023-12-05T09:30:03.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:03.012+0000 7f04f685f700 1 -- 172.21.15.67:0/562745665 wait complete. 2023-12-05T09:30:03.431 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T09:30:03.432 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:30:03.432 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-05T09:30:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:03 smithi134 ceph-mon[116304]: pgmap v92: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:03 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/562745665' entity='client.admin' 2023-12-05T09:30:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:03 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:03 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:03 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:03.878 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:30:04.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:03 smithi067 ceph-mon[107174]: pgmap v92: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:04.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:03 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/562745665' entity='client.admin' 2023-12-05T09:30:04.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:03 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:04.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:03 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:04.043 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:03 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:04 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:04 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:30:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:04 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:04 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:04 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:30:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:04 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.202+0000 7f7bfb33c700 1 -- 172.21.15.67:0/832435616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf41035a0 msgr2=0x7f7bf40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.203+0000 7f7bfb33c700 1 --2- 172.21.15.67:0/832435616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf41035a0 0x7f7bf40fcc10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7be4004940 tx=0x7f7be4009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.203+0000 7f7bfb33c700 1 -- 172.21.15.67:0/832435616 shutdown_connections 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.203+0000 7f7bfb33c700 1 --2- 172.21.15.67:0/832435616 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf41035a0 0x7f7bf40fcc10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.203+0000 7f7bfb33c700 1 --2- 172.21.15.67:0/832435616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf4102c00 0x7f7bf4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.203+0000 7f7bfb33c700 1 -- 172.21.15.67:0/832435616 >> 172.21.15.67:0/832435616 conn(0x7f7bf40f8790 msgr2=0x7f7bf40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.203+0000 7f7bfb33c700 1 -- 172.21.15.67:0/832435616 shutdown_connections 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.203+0000 7f7bfb33c700 1 -- 172.21.15.67:0/832435616 wait complete. 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.204+0000 7f7bfb33c700 1 Processor -- start 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.204+0000 7f7bfb33c700 1 -- start start 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.204+0000 7f7bfb33c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4102c00 0x7f7bf41135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.204+0000 7f7bfb33c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf41035a0 0x7f7bf4113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.204+0000 7f7bfb33c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4114160 con 0x7f7bf4102c00 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.204+0000 7f7bfb33c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf410d490 con 0x7f7bf41035a0 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7bf90d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4102c00 0x7f7bf41135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7bf90d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4102c00 0x7f7bf41135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:33436/0 (socket says 172.21.15.67:33436) 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7bf90d8700 1 -- 172.21.15.67:0/1170515398 learned_addr learned my addr 172.21.15.67:0/1170515398 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7bf88d7700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf41035a0 0x7f7bf4113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7bf90d8700 1 -- 172.21.15.67:0/1170515398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf41035a0 msgr2=0x7f7bf4113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7bf90d8700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf41035a0 0x7f7bf4113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7bf90d8700 1 -- 172.21.15.67:0/1170515398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4005040 con 0x7f7bf4102c00 2023-12-05T09:30:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7bf90d8700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4102c00 0x7f7bf41135d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0002a80 tx=0x7f7bf00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.205+0000 7f7be9ffb700 1 -- 172.21.15.67:0/1170515398 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf0007cc0 con 0x7f7bf4102c00 2023-12-05T09:30:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.206+0000 7f7be9ffb700 1 -- 172.21.15.67:0/1170515398 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7bf000f040 con 0x7f7bf4102c00 2023-12-05T09:30:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.206+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf410d770 con 0x7f7bf4102c00 2023-12-05T09:30:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.206+0000 7f7be9ffb700 1 -- 172.21.15.67:0/1170515398 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bf000da60 con 0x7f7bf4102c00 2023-12-05T09:30:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.206+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf410dc80 con 0x7f7bf4102c00 2023-12-05T09:30:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.207+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf40fc390 con 0x7f7bf4102c00 2023-12-05T09:30:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.208+0000 7f7be9ffb700 1 -- 172.21.15.67:0/1170515398 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f7bf000dbc0 con 0x7f7bf4102c00 2023-12-05T09:30:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.209+0000 7f7be9ffb700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7be006cae0 0x7f7be006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:05.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.209+0000 7f7be9ffb700 1 -- 172.21.15.67:0/1170515398 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7bf008bac0 con 0x7f7bf4102c00 2023-12-05T09:30:05.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.209+0000 7f7bf88d7700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7be006cae0 0x7f7be006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:05.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.210+0000 7f7bf88d7700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7be006cae0 0x7f7be006ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7bf410e7c0 tx=0x7f7be4009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.214+0000 7f7be9ffb700 1 -- 172.21.15.67:0/1170515398 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7bf0059810 con 0x7f7bf4102c00 2023-12-05T09:30:05.427 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.427+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f7bf410ec50 con 0x7f7bf4102c00 2023-12-05T09:30:05.427 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.427+0000 7f7be9ffb700 1 -- 172.21.15.67:0/1170515398 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f7bf00593a0 con 0x7f7bf4102c00 2023-12-05T09:30:05.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.429+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7be006cae0 msgr2=0x7f7be006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:05.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.429+0000 7f7bfb33c700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7be006cae0 0x7f7be006ef90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7bf410e7c0 tx=0x7f7be4009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:05.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4102c00 msgr2=0x7f7bf41135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4102c00 0x7f7bf41135d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0002a80 tx=0x7f7bf00046b0 comp rx=0 tx=0).stop 2023-12-05T09:30:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 shutdown_connections 2023-12-05T09:30:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7be006cae0 0x7f7be006ef90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf4102c00 0x7f7bf41135d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 --2- 172.21.15.67:0/1170515398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bf41035a0 0x7f7bf4113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 >> 172.21.15.67:0/1170515398 conn(0x7f7bf40f8790 msgr2=0x7f7bf40fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 shutdown_connections 2023-12-05T09:30:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:05.430+0000 7f7bfb33c700 1 -- 172.21.15.67:0/1170515398 wait complete. 2023-12-05T09:30:05.708 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:05 smithi067 ceph-mon[107174]: pgmap v93: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:05.708 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:05 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:30:05.877 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-05T09:30:05.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:05 smithi134 ceph-mon[116304]: pgmap v93: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:05.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:05 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:30:06.315 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:30:07.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:07 smithi134 ceph-mon[116304]: pgmap v94: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.485+0000 7f91e6f71700 1 -- 172.21.15.67:0/171878081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e006ffe0 msgr2=0x7f91e00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.485+0000 7f91e6f71700 1 --2- 172.21.15.67:0/171878081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e006ffe0 0x7f91e00703b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f91dc004970 tx=0x7f91dc009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.485+0000 7f91e6f71700 1 -- 172.21.15.67:0/171878081 shutdown_connections 2023-12-05T09:30:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.485+0000 7f91e6f71700 1 --2- 172.21.15.67:0/171878081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91e00708f0 0x7f91e0108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.485+0000 7f91e6f71700 1 --2- 172.21.15.67:0/171878081 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e006ffe0 0x7f91e00703b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.485+0000 7f91e6f71700 1 -- 172.21.15.67:0/171878081 >> 172.21.15.67:0/171878081 conn(0x7f91e00f8560 msgr2=0x7f91e00fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.486+0000 7f91e6f71700 1 -- 172.21.15.67:0/171878081 shutdown_connections 2023-12-05T09:30:07.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.486+0000 7f91e6f71700 1 -- 172.21.15.67:0/171878081 wait complete. 2023-12-05T09:30:07.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.486+0000 7f91e6f71700 1 Processor -- start 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.487+0000 7f91e6f71700 1 -- start start 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.487+0000 7f91e6f71700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91e006ffe0 0x7f91e0115630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.487+0000 7f91e6f71700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e00708f0 0x7f91e0115bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.487+0000 7f91e6f71700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e010f4f0 con 0x7f91e00708f0 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.487+0000 7f91e6f71700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e010f660 con 0x7f91e006ffe0 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.487+0000 7f91e576e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e00708f0 0x7f91e0115bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.487+0000 7f91e576e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e00708f0 0x7f91e0115bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35756/0 (socket says 172.21.15.67:35756) 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.487+0000 7f91e576e700 1 -- 172.21.15.67:0/2183268674 learned_addr learned my addr 172.21.15.67:0/2183268674 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91e5f6f700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91e006ffe0 0x7f91e0115630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:07.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91e576e700 1 -- 172.21.15.67:0/2183268674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91e006ffe0 msgr2=0x7f91e0115630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91e576e700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91e006ffe0 0x7f91e0115630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91e576e700 1 -- 172.21.15.67:0/2183268674 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc005040 con 0x7f91e00708f0 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91e576e700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e00708f0 0x7f91e0115bb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b790 tx=0x7f91d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91d67fc700 1 -- 172.21.15.67:0/2183268674 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d000f6f0 con 0x7f91e00708f0 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e010f940 con 0x7f91e00708f0 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91d67fc700 1 -- 172.21.15.67:0/2183268674 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91d000fd00 con 0x7f91e00708f0 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91d67fc700 1 -- 172.21.15.67:0/2183268674 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91d00103a0 con 0x7f91e00708f0 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.488+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e010fe80 con 0x7f91e00708f0 2023-12-05T09:30:07.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.490+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e01063c0 con 0x7f91e00708f0 2023-12-05T09:30:07.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.491+0000 7f91d67fc700 1 -- 172.21.15.67:0/2183268674 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f91d000f850 con 0x7f91e00708f0 2023-12-05T09:30:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.491+0000 7f91d67fc700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91cc06caf0 0x7f91cc06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.492+0000 7f91d67fc700 1 -- 172.21.15.67:0/2183268674 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f91d008bb80 con 0x7f91e00708f0 2023-12-05T09:30:07.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.492+0000 7f91e5f6f700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91cc06caf0 0x7f91cc06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:07.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.492+0000 7f91e5f6f700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91cc06caf0 0x7f91cc06efa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91e00faf60 tx=0x7f91dc009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:07.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.496+0000 7f91d67fc700 1 -- 172.21.15.67:0/2183268674 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f91d00599d0 con 0x7f91e00708f0 2023-12-05T09:30:07.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:07 smithi067 ceph-mon[107174]: pgmap v94: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.716+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f91e004bb80 con 0x7f91e00708f0 2023-12-05T09:30:07.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.716+0000 7f91d67fc700 1 -- 172.21.15.67:0/2183268674 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f91d0059560 con 0x7f91e00708f0 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91cc06caf0 msgr2=0x7f91cc06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91cc06caf0 0x7f91cc06efa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91e00faf60 tx=0x7f91dc009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e00708f0 msgr2=0x7f91e0115bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e00708f0 0x7f91e0115bb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91d000b790 tx=0x7f91d0009250 comp rx=0 tx=0).stop 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 shutdown_connections 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f91cc06caf0 0x7f91cc06efa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91e006ffe0 0x7f91e0115630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 --2- 172.21.15.67:0/2183268674 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f91e00708f0 0x7f91e0115bb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 >> 172.21.15.67:0/2183268674 conn(0x7f91e00f8560 msgr2=0x7f91e0103540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 shutdown_connections 2023-12-05T09:30:07.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:07.719+0000 7f91e6f71700 1 -- 172.21.15.67:0/2183268674 wait complete. 2023-12-05T09:30:08.178 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-05T09:30:08.629 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:30:09.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:09 smithi067 ceph-mon[107174]: pgmap v95: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:09 smithi134 ceph-mon[116304]: pgmap v95: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:09.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.936+0000 7f09971c5700 1 -- 172.21.15.67:0/3579132062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 msgr2=0x7f0990102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:09.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.936+0000 7f09971c5700 1 --2- 172.21.15.67:0/3579132062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 0x7f0990102fd0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0984004940 tx=0x7f0984009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:09.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.936+0000 7f09971c5700 1 -- 172.21.15.67:0/3579132062 shutdown_connections 2023-12-05T09:30:09.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.936+0000 7f09971c5700 1 --2- 172.21.15.67:0/3579132062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09901035a0 0x7f09900fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:09.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.936+0000 7f09971c5700 1 --2- 172.21.15.67:0/3579132062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 0x7f0990102fd0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:09.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.936+0000 7f09971c5700 1 -- 172.21.15.67:0/3579132062 >> 172.21.15.67:0/3579132062 conn(0x7f09900f8790 msgr2=0x7f09900faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:09.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.936+0000 7f09971c5700 1 -- 172.21.15.67:0/3579132062 shutdown_connections 2023-12-05T09:30:09.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.936+0000 7f09971c5700 1 -- 172.21.15.67:0/3579132062 wait complete. 2023-12-05T09:30:09.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.937+0000 7f09971c5700 1 Processor -- start 2023-12-05T09:30:09.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.937+0000 7f09971c5700 1 -- start start 2023-12-05T09:30:09.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.937+0000 7f09971c5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 0x7f099006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:09.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f09971c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09901035a0 0x7f0990070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:09.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f09971c5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0990070a80 con 0x7f0990102c00 2023-12-05T09:30:09.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f09971c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0990070bf0 con 0x7f09901035a0 2023-12-05T09:30:09.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f0994f61700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 0x7f099006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:09.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f0994f61700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 0x7f099006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35772/0 (socket says 172.21.15.67:35772) 2023-12-05T09:30:09.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f0994f61700 1 -- 172.21.15.67:0/1185419156 learned_addr learned my addr 172.21.15.67:0/1185419156 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:09.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f098ffff700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09901035a0 0x7f0990070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f0994f61700 1 -- 172.21.15.67:0/1185419156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09901035a0 msgr2=0x7f0990070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f0994f61700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09901035a0 0x7f0990070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f0994f61700 1 -- 172.21.15.67:0/1185419156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984005040 con 0x7f0990102c00 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f098ffff700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09901035a0 0x7f0990070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.938+0000 7f0994f61700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 0x7f099006ff40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0984009180 tx=0x7f0984009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.939+0000 7f098d7fa700 1 -- 172.21.15.67:0/1185419156 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f098400e040 con 0x7f0990102c00 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.939+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0990119850 con 0x7f0990102c00 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.939+0000 7f098d7fa700 1 -- 172.21.15.67:0/1185419156 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0984013420 con 0x7f0990102c00 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.939+0000 7f098d7fa700 1 -- 172.21.15.67:0/1185419156 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f098401c630 con 0x7f0990102c00 2023-12-05T09:30:09.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.939+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0990119cb0 con 0x7f0990102c00 2023-12-05T09:30:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.940+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09900fff10 con 0x7f0990102c00 2023-12-05T09:30:09.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.941+0000 7f098d7fa700 1 -- 172.21.15.67:0/1185419156 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f09840139e0 con 0x7f0990102c00 2023-12-05T09:30:09.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.942+0000 7f098d7fa700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f098006cae0 0x7f098006ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.942+0000 7f098d7fa700 1 -- 172.21.15.67:0/1185419156 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f098408d130 con 0x7f0990102c00 2023-12-05T09:30:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.942+0000 7f098ffff700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f098006cae0 0x7f098006ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:09.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.943+0000 7f098ffff700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f098006cae0 0x7f098006ef90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f097c009fd0 tx=0x7f097c009ee0 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:09.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:09.946+0000 7f098d7fa700 1 -- 172.21.15.67:0/1185419156 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f09840574f0 con 0x7f0990102c00 2023-12-05T09:30:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.158+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f09900fc390 con 0x7f0990102c00 2023-12-05T09:30:10.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.158+0000 7f098d7fa700 1 -- 172.21.15.67:0/1185419156 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f098405ab10 con 0x7f0990102c00 2023-12-05T09:30:10.160 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f098006cae0 msgr2=0x7f098006ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f098006cae0 0x7f098006ef90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f097c009fd0 tx=0x7f097c009ee0 comp rx=0 tx=0).stop 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 msgr2=0x7f099006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 0x7f099006ff40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0984009180 tx=0x7f0984009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 shutdown_connections 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f098006cae0 0x7f098006ef90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0990102c00 0x7f099006ff40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 --2- 172.21.15.67:0/1185419156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09901035a0 0x7f0990070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 >> 172.21.15.67:0/1185419156 conn(0x7f09900f8790 msgr2=0x7f09900fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 shutdown_connections 2023-12-05T09:30:10.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:10.161+0000 7f09971c5700 1 -- 172.21.15.67:0/1185419156 wait complete. 2023-12-05T09:30:10.557 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-05T09:30:10.995 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:30:11.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:11 smithi067 ceph-mon[107174]: pgmap v96: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:11.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:11 smithi134 ceph-mon[116304]: pgmap v96: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.227+0000 7f51bdfc8700 1 -- 172.21.15.67:0/1422628321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b8102c00 msgr2=0x7f51b8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.227+0000 7f51bdfc8700 1 --2- 172.21.15.67:0/1422628321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b8102c00 0x7f51b8102fd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f51a8004940 tx=0x7f51a8009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.227+0000 7f51bdfc8700 1 -- 172.21.15.67:0/1422628321 shutdown_connections 2023-12-05T09:30:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.227+0000 7f51bdfc8700 1 --2- 172.21.15.67:0/1422628321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b81035a0 0x7f51b80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.227+0000 7f51bdfc8700 1 --2- 172.21.15.67:0/1422628321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b8102c00 0x7f51b8102fd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:12.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.227+0000 7f51bdfc8700 1 -- 172.21.15.67:0/1422628321 >> 172.21.15.67:0/1422628321 conn(0x7f51b80f8790 msgr2=0x7f51b80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.228+0000 7f51bdfc8700 1 -- 172.21.15.67:0/1422628321 shutdown_connections 2023-12-05T09:30:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.228+0000 7f51bdfc8700 1 -- 172.21.15.67:0/1422628321 wait complete. 2023-12-05T09:30:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.228+0000 7f51bdfc8700 1 Processor -- start 2023-12-05T09:30:12.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.229+0000 7f51bdfc8700 1 -- start start 2023-12-05T09:30:12.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.229+0000 7f51bdfc8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b8102c00 0x7f51b806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:12.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.229+0000 7f51bdfc8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b81035a0 0x7f51b8070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:12.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.229+0000 7f51bdfc8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8070a80 con 0x7f51b81035a0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.229+0000 7f51bdfc8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8070bf0 con 0x7f51b8102c00 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.229+0000 7f51b6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b81035a0 0x7f51b8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.229+0000 7f51b6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b81035a0 0x7f51b8070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35794/0 (socket says 172.21.15.67:35794) 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.229+0000 7f51b6ffd700 1 -- 172.21.15.67:0/608198602 learned_addr learned my addr 172.21.15.67:0/608198602 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f51b77fe700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b8102c00 0x7f51b806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f51b6ffd700 1 -- 172.21.15.67:0/608198602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b8102c00 msgr2=0x7f51b806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f51b6ffd700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b8102c00 0x7f51b806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f51b6ffd700 1 -- 172.21.15.67:0/608198602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8005040 con 0x7f51b81035a0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f51b6ffd700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b81035a0 0x7f51b8070480 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00eb40 tx=0x7f51ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f519ffff700 1 -- 172.21.15.67:0/608198602 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ac007cc0 con 0x7f51b81035a0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b8119830 con 0x7f51b81035a0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f519ffff700 1 -- 172.21.15.67:0/608198602 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51ac00f040 con 0x7f51b81035a0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f519ffff700 1 -- 172.21.15.67:0/608198602 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51ac009510 con 0x7f51b81035a0 2023-12-05T09:30:12.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.230+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b8119c90 con 0x7f51b81035a0 2023-12-05T09:30:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.231+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b80fc390 con 0x7f51b81035a0 2023-12-05T09:30:12.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.232+0000 7f519ffff700 1 -- 172.21.15.67:0/608198602 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f51ac009670 con 0x7f51b81035a0 2023-12-05T09:30:12.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.233+0000 7f519ffff700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f51a006caf0 0x7f51a006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:12.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.233+0000 7f519ffff700 1 -- 172.21.15.67:0/608198602 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f51ac08ba10 con 0x7f51b81035a0 2023-12-05T09:30:12.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.234+0000 7f51b77fe700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f51a006caf0 0x7f51a006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:12.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.234+0000 7f51b77fe700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f51a006caf0 0x7f51a006efa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f51a800b0d0 tx=0x7f51a8009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:12.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.238+0000 7f519ffff700 1 -- 172.21.15.67:0/608198602 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f51ac055d50 con 0x7f51b81035a0 2023-12-05T09:30:12.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.467+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}) v1 -- 0x7f51b80fa830 con 0x7f51a006caf0 2023-12-05T09:30:12.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.474+0000 7f519ffff700 1 -- 172.21.15.67:0/608198602 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f51b80fa830 con 0x7f51a006caf0 2023-12-05T09:30:12.473 INFO:teuthology.orchestra.run.smithi067.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f51a006caf0 msgr2=0x7f51a006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f51a006caf0 0x7f51a006efa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f51a800b0d0 tx=0x7f51a8009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b81035a0 msgr2=0x7f51b8070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b81035a0 0x7f51b8070480 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00eb40 tx=0x7f51ac00b040 comp rx=0 tx=0).stop 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 shutdown_connections 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f51a006caf0 0x7f51a006efa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51b8102c00 0x7f51b806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 --2- 172.21.15.67:0/608198602 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51b81035a0 0x7f51b8070480 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 >> 172.21.15.67:0/608198602 conn(0x7f51b80f8790 msgr2=0x7f51b80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 shutdown_connections 2023-12-05T09:30:12.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:12.477+0000 7f51bdfc8700 1 -- 172.21.15.67:0/608198602 wait complete. 2023-12-05T09:30:12.896 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-05T09:30:12.896 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:30:12.896 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-05T09:30:13.349 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:30:13.748 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:13.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:30:13.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:13.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:13.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:13.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:30:13.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:13.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: pgmap v97: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:13.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:13 smithi067 ceph-mon[107174]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:30:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:30:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:13.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:13.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:13.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:30:13.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:13.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: pgmap v97: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:13.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:13 smithi134 ceph-mon[116304]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 2023-12-05T09:30:14.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.835+0000 7f7c9d334700 1 -- 172.21.15.67:0/3944777270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98065390 msgr2=0x7f7c98065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.835+0000 7f7c9d334700 1 --2- 172.21.15.67:0/3944777270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98065390 0x7f7c98065800 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c004940 tx=0x7f7c8c009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.836+0000 7f7c9d334700 1 -- 172.21.15.67:0/3944777270 shutdown_connections 2023-12-05T09:30:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.836+0000 7f7c9d334700 1 --2- 172.21.15.67:0/3944777270 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98065390 0x7f7c98065800 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.836+0000 7f7c9d334700 1 --2- 172.21.15.67:0/3944777270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c98102c20 0x7f7c98102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.836+0000 7f7c9d334700 1 -- 172.21.15.67:0/3944777270 >> 172.21.15.67:0/3944777270 conn(0x7f7c980719b0 msgr2=0x7f7c98071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.836+0000 7f7c9d334700 1 -- 172.21.15.67:0/3944777270 shutdown_connections 2023-12-05T09:30:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.836+0000 7f7c9d334700 1 -- 172.21.15.67:0/3944777270 wait complete. 2023-12-05T09:30:14.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.837+0000 7f7c9d334700 1 Processor -- start 2023-12-05T09:30:14.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.837+0000 7f7c9d334700 1 -- start start 2023-12-05T09:30:14.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.837+0000 7f7c9d334700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c98065390 0x7f7c98115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:14.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.837+0000 7f7c9d334700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98102c20 0x7f7c98115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:14.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.837+0000 7f7c9d334700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98116390 con 0x7f7c98102c20 2023-12-05T09:30:14.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.837+0000 7f7c9d334700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9810f6c0 con 0x7f7c98065390 2023-12-05T09:30:14.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.838+0000 7f7c967fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98102c20 0x7f7c98115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:14.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.838+0000 7f7c967fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98102c20 0x7f7c98115d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35810/0 (socket says 172.21.15.67:35810) 2023-12-05T09:30:14.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.838+0000 7f7c967fc700 1 -- 172.21.15.67:0/3762206138 learned_addr learned my addr 172.21.15.67:0/3762206138 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:14.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.838+0000 7f7c96ffd700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c98065390 0x7f7c98115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.838+0000 7f7c967fc700 1 -- 172.21.15.67:0/3762206138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c98065390 msgr2=0x7f7c98115800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.838+0000 7f7c967fc700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c98065390 0x7f7c98115800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.838+0000 7f7c967fc700 1 -- 172.21.15.67:0/3762206138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c005040 con 0x7f7c98102c20 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.839+0000 7f7c967fc700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98102c20 0x7f7c98115d40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0040d0 tx=0x7f7c8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.839+0000 7f7c7f7fe700 1 -- 172.21.15.67:0/3762206138 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c8c021070 con 0x7f7c98102c20 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.839+0000 7f7c7f7fe700 1 -- 172.21.15.67:0/3762206138 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c8c0093b0 con 0x7f7c98102c20 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.839+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9810f940 con 0x7f7c98102c20 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.839+0000 7f7c7f7fe700 1 -- 172.21.15.67:0/3762206138 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c8c00e070 con 0x7f7c98102c20 2023-12-05T09:30:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.839+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9810fe20 con 0x7f7c98102c20 2023-12-05T09:30:14.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.840+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c980734d0 con 0x7f7c98102c20 2023-12-05T09:30:14.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.842+0000 7f7c7f7fe700 1 -- 172.21.15.67:0/3762206138 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f7c8c013a50 con 0x7f7c98102c20 2023-12-05T09:30:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.843+0000 7f7c7f7fe700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7c8006caf0 0x7f7c8006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.844+0000 7f7c7f7fe700 1 -- 172.21.15.67:0/3762206138 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7c8c08ce30 con 0x7f7c98102c20 2023-12-05T09:30:14.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.844+0000 7f7c96ffd700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7c8006caf0 0x7f7c8006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:14.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.845+0000 7f7c96ffd700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7c8006caf0 0x7f7c8006efa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009b80 tx=0x7f7c8800b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:14.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:14.849+0000 7f7c7f7fe700 1 -- 172.21.15.67:0/3762206138 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f7c8c05ad40 con 0x7f7c98102c20 2023-12-05T09:30:15.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.085+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c9804bb80 con 0x7f7c8006caf0 2023-12-05T09:30:15.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.086+0000 7f7c7f7fe700 1 -- 172.21.15.67:0/3762206138 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7c9804bb80 con 0x7f7c8006caf0 2023-12-05T09:30:15.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.088+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7c8006caf0 msgr2=0x7f7c8006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:15.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.088+0000 7f7c9d334700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7c8006caf0 0x7f7c8006efa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009b80 tx=0x7f7c8800b040 comp rx=0 tx=0).stop 2023-12-05T09:30:15.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.088+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98102c20 msgr2=0x7f7c98115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:15.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.088+0000 7f7c9d334700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98102c20 0x7f7c98115d40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0040d0 tx=0x7f7c8c009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:15.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.089+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 shutdown_connections 2023-12-05T09:30:15.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.089+0000 7f7c9d334700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f7c8006caf0 0x7f7c8006efa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.089+0000 7f7c9d334700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c98065390 0x7f7c98115800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.089+0000 7f7c9d334700 1 --2- 172.21.15.67:0/3762206138 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c98102c20 0x7f7c98115d40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.089+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 >> 172.21.15.67:0/3762206138 conn(0x7f7c980719b0 msgr2=0x7f7c980fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:15.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.089+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 shutdown_connections 2023-12-05T09:30:15.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.089+0000 7f7c9d334700 1 -- 172.21.15.67:0/3762206138 wait complete. 2023-12-05T09:30:15.102 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:30:15.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.235+0000 7f531359e700 1 -- 172.21.15.67:0/2983093206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 msgr2=0x7f53140fde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:15.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.235+0000 7f531359e700 1 --2- 172.21.15.67:0/2983093206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 0x7f53140fde70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5304004940 tx=0x7f5304009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:15.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.235+0000 7f531359e700 1 -- 172.21.15.67:0/2983093206 shutdown_connections 2023-12-05T09:30:15.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.235+0000 7f531359e700 1 --2- 172.21.15.67:0/2983093206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53140fe440 0x7f5314106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.235+0000 7f531359e700 1 --2- 172.21.15.67:0/2983093206 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 0x7f53140fde70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.235+0000 7f531359e700 1 -- 172.21.15.67:0/2983093206 >> 172.21.15.67:0/2983093206 conn(0x7f53140f74d0 msgr2=0x7f53140f98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:15.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.235+0000 7f531359e700 1 -- 172.21.15.67:0/2983093206 shutdown_connections 2023-12-05T09:30:15.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.235+0000 7f531359e700 1 -- 172.21.15.67:0/2983093206 wait complete. 2023-12-05T09:30:15.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.236+0000 7f531359e700 1 Processor -- start 2023-12-05T09:30:15.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.236+0000 7f531359e700 1 -- start start 2023-12-05T09:30:15.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.237+0000 7f531359e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 0x7f5314115500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:15.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.237+0000 7f531359e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53140fe440 0x7f5314115a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:15.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.237+0000 7f531359e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314116090 con 0x7f53140fdaa0 2023-12-05T09:30:15.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.237+0000 7f531359e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531410f3c0 con 0x7f53140fe440 2023-12-05T09:30:15.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.237+0000 7f531259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 0x7f5314115500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:15.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.237+0000 7f531259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 0x7f5314115500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35830/0 (socket says 172.21.15.67:35830) 2023-12-05T09:30:15.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.237+0000 7f531259c700 1 -- 172.21.15.67:0/3272362857 learned_addr learned my addr 172.21.15.67:0/3272362857 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:15.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.237+0000 7f5311d9b700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53140fe440 0x7f5314115a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f531259c700 1 -- 172.21.15.67:0/3272362857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53140fe440 msgr2=0x7f5314115a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f531259c700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53140fe440 0x7f5314115a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f531259c700 1 -- 172.21.15.67:0/3272362857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304005040 con 0x7f53140fdaa0 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f5311d9b700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53140fe440 0x7f5314115a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f531259c700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 0x7f5314115500 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5304009390 tx=0x7f5304009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f5302ffd700 1 -- 172.21.15.67:0/3272362857 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530400e040 con 0x7f53140fdaa0 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531410f6a0 con 0x7f53140fdaa0 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f5302ffd700 1 -- 172.21.15.67:0/3272362857 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5304004290 con 0x7f53140fdaa0 2023-12-05T09:30:15.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f5302ffd700 1 -- 172.21.15.67:0/3272362857 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530401c3f0 con 0x7f53140fdaa0 2023-12-05T09:30:15.238 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.238+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531410fbe0 con 0x7f53140fdaa0 2023-12-05T09:30:15.238 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.239+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53141064f0 con 0x7f53140fdaa0 2023-12-05T09:30:15.239 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.240+0000 7f5302ffd700 1 -- 172.21.15.67:0/3272362857 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f530400bc50 con 0x7f53140fdaa0 2023-12-05T09:30:15.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.241+0000 7f5302ffd700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f52fc06caf0 0x7f52fc06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:15.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.241+0000 7f5302ffd700 1 -- 172.21.15.67:0/3272362857 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f530408d1b0 con 0x7f53140fdaa0 2023-12-05T09:30:15.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.242+0000 7f5311d9b700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f52fc06caf0 0x7f52fc06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:15.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.242+0000 7f5311d9b700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f52fc06caf0 0x7f52fc06efa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5308009b80 tx=0x7f530800b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:15.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.249+0000 7f5302ffd700 1 -- 172.21.15.67:0/3272362857 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f530405b0d0 con 0x7f53140fdaa0 2023-12-05T09:30:15.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.503+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5314110ae0 con 0x7f52fc06caf0 2023-12-05T09:30:15.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.505+0000 7f5302ffd700 1 -- 172.21.15.67:0/3272362857 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f5314110ae0 con 0x7f52fc06caf0 2023-12-05T09:30:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.507+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f52fc06caf0 msgr2=0x7f52fc06efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.507+0000 7f531359e700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f52fc06caf0 0x7f52fc06efa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5308009b80 tx=0x7f530800b040 comp rx=0 tx=0).stop 2023-12-05T09:30:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.507+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 msgr2=0x7f5314115500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.507+0000 7f531359e700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 0x7f5314115500 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5304009390 tx=0x7f5304009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.508+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 shutdown_connections 2023-12-05T09:30:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.508+0000 7f531359e700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f52fc06caf0 0x7f52fc06efa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.508+0000 7f531359e700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53140fdaa0 0x7f5314115500 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.508 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.508+0000 7f531359e700 1 --2- 172.21.15.67:0/3272362857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53140fe440 0x7f5314115a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.508 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.508+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 >> 172.21.15.67:0/3272362857 conn(0x7f53140f74d0 msgr2=0x7f53140fc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:15.508 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.508+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 shutdown_connections 2023-12-05T09:30:15.508 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.508+0000 7f531359e700 1 -- 172.21.15.67:0/3272362857 wait complete. 2023-12-05T09:30:15.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.654+0000 7f27e565f700 1 -- 172.21.15.67:0/2802326493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 msgr2=0x7f27e00fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:15.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.654+0000 7f27e565f700 1 --2- 172.21.15.67:0/2802326493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 0x7f27e00fdfe0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f27d0004940 tx=0x7f27d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:15.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.654+0000 7f27e565f700 1 -- 172.21.15.67:0/2802326493 shutdown_connections 2023-12-05T09:30:15.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.654+0000 7f27e565f700 1 --2- 172.21.15.67:0/2802326493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e00fe5b0 0x7f27e0106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.654+0000 7f27e565f700 1 --2- 172.21.15.67:0/2802326493 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 0x7f27e00fdfe0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.654+0000 7f27e565f700 1 -- 172.21.15.67:0/2802326493 >> 172.21.15.67:0/2802326493 conn(0x7f27e00f76c0 msgr2=0x7f27e00f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:15.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.655+0000 7f27e565f700 1 -- 172.21.15.67:0/2802326493 shutdown_connections 2023-12-05T09:30:15.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.655+0000 7f27e565f700 1 -- 172.21.15.67:0/2802326493 wait complete. 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.655+0000 7f27e565f700 1 Processor -- start 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.656+0000 7f27e565f700 1 -- start start 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.656+0000 7f27e565f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 0x7f27e00fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.656+0000 7f27e565f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e00fe5b0 0x7f27e00fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.656+0000 7f27e565f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00fc580 con 0x7f27e00fdc10 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.656+0000 7f27e565f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00fc6f0 con 0x7f27e00fe5b0 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.656+0000 7f27deffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 0x7f27e00fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.656+0000 7f27deffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 0x7f27e00fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:35850/0 (socket says 172.21.15.67:35850) 2023-12-05T09:30:15.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.656+0000 7f27deffd700 1 -- 172.21.15.67:0/868100628 learned_addr learned my addr 172.21.15.67:0/868100628 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.657+0000 7f27de7fc700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e00fe5b0 0x7f27e00fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.657+0000 7f27deffd700 1 -- 172.21.15.67:0/868100628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e00fe5b0 msgr2=0x7f27e00fbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.657+0000 7f27deffd700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e00fe5b0 0x7f27e00fbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.657+0000 7f27deffd700 1 -- 172.21.15.67:0/868100628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d0005040 con 0x7f27e00fdc10 2023-12-05T09:30:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.657+0000 7f27deffd700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 0x7f27e00fba40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009390 tx=0x7f27d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.658+0000 7f27c77fe700 1 -- 172.21.15.67:0/868100628 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27d000e040 con 0x7f27e00fdc10 2023-12-05T09:30:15.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.658+0000 7f27c77fe700 1 -- 172.21.15.67:0/868100628 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27d0004290 con 0x7f27e00fdc10 2023-12-05T09:30:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.658+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e0119870 con 0x7f27e00fdc10 2023-12-05T09:30:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.658+0000 7f27c77fe700 1 -- 172.21.15.67:0/868100628 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27d001c630 con 0x7f27e00fdc10 2023-12-05T09:30:15.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.658+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e0119cd0 con 0x7f27e00fdc10 2023-12-05T09:30:15.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.660+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e0104200 con 0x7f27e00fdc10 2023-12-05T09:30:15.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.661+0000 7f27c77fe700 1 -- 172.21.15.67:0/868100628 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f27d000bc50 con 0x7f27e00fdc10 2023-12-05T09:30:15.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.662+0000 7f27c77fe700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f27c806cbc0 0x7f27c806f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:15.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.662+0000 7f27c77fe700 1 -- 172.21.15.67:0/868100628 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f27d008d150 con 0x7f27e00fdc10 2023-12-05T09:30:15.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.662+0000 7f27de7fc700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f27c806cbc0 0x7f27c806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:15.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.663+0000 7f27de7fc700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f27c806cbc0 0x7f27c806f070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27e00fd440 tx=0x7f27d4009ee0 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.667+0000 7f27c77fe700 1 -- 172.21.15.67:0/868100628 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f27d0057510 con 0x7f27e00fdc10 2023-12-05T09:30:15.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:15 smithi067 ceph-mon[107174]: pgmap v98: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:15.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:15 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:15.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:15 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:15.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:15 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:30:15.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:15 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:15.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:15 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T09:30:15.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:15 smithi134 ceph-mon[116304]: pgmap v98: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:15.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:15 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:15.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:15 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:15.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:15 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:30:15.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:15 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:15.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:15 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T09:30:15.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:15.893+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f27e00fd180 con 0x7f27c806cbc0 2023-12-05T09:30:16.190 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:30:16.190 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (84s) 64s ago 11m 15.5M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:30:16.190 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (11m) 64s ago 11m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:30:16.190 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (10m) 112s ago 10m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:30:16.190 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (69s) 64s ago 11m 49.2M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (6m) 64s ago 6m 6294M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (6m) 64s ago 6m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (6m) 112s ago 6m 14.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (6m) 112s ago 6m 14.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (3m) 64s ago 12m 511M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (2m) 112s ago 10m 449M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (12m) 64s ago 12m 100M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 1d8ca51c2546 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (10m) 112s ago 10m 68.0M 2048M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5969c837b156 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (119s) 64s ago 11m 8724k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (115s) 112s ago 10m 3644k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (9m) 64s ago 9m 786M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (9m) 64s ago 9m 850M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (9m) 64s ago 9m 656M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (8m) 112s ago 8m 1025M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (8m) 112s ago 8m 771M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:30:16.191 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (7m) 112s ago 7m 867M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:30:16.192 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (99s) 64s ago 10m 44.7M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:30:16.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.190+0000 7f27c77fe700 1 -- 172.21.15.67:0/868100628 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f27e00fd180 con 0x7f27c806cbc0 2023-12-05T09:30:16.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f27c806cbc0 msgr2=0x7f27c806f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f27c806cbc0 0x7f27c806f070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27e00fd440 tx=0x7f27d4009ee0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 msgr2=0x7f27e00fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 0x7f27e00fba40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009390 tx=0x7f27d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 shutdown_connections 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f27c806cbc0 0x7f27c806f070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f27e00fdc10 0x7f27e00fba40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 --2- 172.21.15.67:0/868100628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e00fe5b0 0x7f27e00fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 >> 172.21.15.67:0/868100628 conn(0x7f27e00f76c0 msgr2=0x7f27e0101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 shutdown_connections 2023-12-05T09:30:16.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.193+0000 7f27e565f700 1 -- 172.21.15.67:0/868100628 wait complete. 2023-12-05T09:30:16.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.334+0000 7f7916413700 1 -- 172.21.15.67:0/3066358595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 msgr2=0x7f7910108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:16.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.334+0000 7f7916413700 1 --2- 172.21.15.67:0/3066358595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 0x7f7910108f10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7904004970 tx=0x7f7904009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:16.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.334+0000 7f7916413700 1 -- 172.21.15.67:0/3066358595 shutdown_connections 2023-12-05T09:30:16.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.334+0000 7f7916413700 1 --2- 172.21.15.67:0/3066358595 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 0x7f7910108f10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.334+0000 7f7916413700 1 --2- 172.21.15.67:0/3066358595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791006ffe0 0x7f79100703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.334+0000 7f7916413700 1 -- 172.21.15.67:0/3066358595 >> 172.21.15.67:0/3066358595 conn(0x7f79100f8790 msgr2=0x7f79100faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:16.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.334+0000 7f7916413700 1 -- 172.21.15.67:0/3066358595 shutdown_connections 2023-12-05T09:30:16.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.334+0000 7f7916413700 1 -- 172.21.15.67:0/3066358595 wait complete. 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.335+0000 7f7916413700 1 Processor -- start 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.335+0000 7f7916413700 1 -- start start 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f7916413700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791006ffe0 0x7f7910115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f7916413700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 0x7f7910115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f7916413700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79101163a0 con 0x7f79100708f0 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f7916413700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791010f6d0 con 0x7f791006ffe0 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f790f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 0x7f7910115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f790f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 0x7f7910115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51278/0 (socket says 172.21.15.67:51278) 2023-12-05T09:30:16.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f790f7fe700 1 -- 172.21.15.67:0/3498838767 learned_addr learned my addr 172.21.15.67:0/3498838767 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:16.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f790ffff700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791006ffe0 0x7f7910115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:16.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f790f7fe700 1 -- 172.21.15.67:0/3498838767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791006ffe0 msgr2=0x7f7910115810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:16.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f790f7fe700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791006ffe0 0x7f7910115810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f790f7fe700 1 -- 172.21.15.67:0/3498838767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904005040 con 0x7f79100708f0 2023-12-05T09:30:16.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.336+0000 7f790ffff700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791006ffe0 0x7f7910115810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:30:16.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.337+0000 7f790f7fe700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 0x7f7910115d50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7904004f50 tx=0x7f7904009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:16.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.337+0000 7f790cff9700 1 -- 172.21.15.67:0/3498838767 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790400e040 con 0x7f79100708f0 2023-12-05T09:30:16.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.337+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791010f950 con 0x7f79100708f0 2023-12-05T09:30:16.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.337+0000 7f790cff9700 1 -- 172.21.15.67:0/3498838767 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f790400bc10 con 0x7f79100708f0 2023-12-05T09:30:16.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.337+0000 7f790cff9700 1 -- 172.21.15.67:0/3498838767 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f790401c3f0 con 0x7f79100708f0 2023-12-05T09:30:16.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.337+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791010fe90 con 0x7f79100708f0 2023-12-05T09:30:16.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.338+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79101065d0 con 0x7f79100708f0 2023-12-05T09:30:16.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.339+0000 7f790cff9700 1 -- 172.21.15.67:0/3498838767 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f7904013420 con 0x7f79100708f0 2023-12-05T09:30:16.339 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.340+0000 7f790cff9700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f78f806caf0 0x7f78f806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:16.339 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.340+0000 7f790cff9700 1 -- 172.21.15.67:0/3498838767 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f790408d160 con 0x7f79100708f0 2023-12-05T09:30:16.339 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.341+0000 7f790ffff700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f78f806caf0 0x7f78f806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:16.340 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.341+0000 7f790ffff700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f78f806caf0 0x7f78f806efa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7900009fd0 tx=0x7f790000b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:16.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.345+0000 7f790cff9700 1 -- 172.21.15.67:0/3498838767 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f790405afd0 con 0x7f79100708f0 2023-12-05T09:30:16.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.647+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7910110df0 con 0x7f79100708f0 2023-12-05T09:30:16.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.647+0000 7f790cff9700 1 -- 172.21.15.67:0/3498838767 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f790405ab60 con 0x7f79100708f0 2023-12-05T09:30:16.646 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:30:16.646 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 12, 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:30:16.647 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:30:16.648 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f78f806caf0 msgr2=0x7f78f806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f78f806caf0 0x7f78f806efa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7900009fd0 tx=0x7f790000b040 comp rx=0 tx=0).stop 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 msgr2=0x7f7910115d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 0x7f7910115d50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7904004f50 tx=0x7f7904009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 shutdown_connections 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f78f806caf0 0x7f78f806efa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791006ffe0 0x7f7910115810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 --2- 172.21.15.67:0/3498838767 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79100708f0 0x7f7910115d50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 >> 172.21.15.67:0/3498838767 conn(0x7f79100f8790 msgr2=0x7f7910103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 shutdown_connections 2023-12-05T09:30:16.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.650+0000 7f7916413700 1 -- 172.21.15.67:0/3498838767 wait complete. 2023-12-05T09:30:16.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.797+0000 7f95b2368700 1 -- 172.21.15.67:0/2494113275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac1035a0 msgr2=0x7f95ac0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:16.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.797+0000 7f95b2368700 1 --2- 172.21.15.67:0/2494113275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac1035a0 0x7f95ac0fcc10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f95a0004940 tx=0x7f95a0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:16.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.797+0000 7f95b2368700 1 -- 172.21.15.67:0/2494113275 shutdown_connections 2023-12-05T09:30:16.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.797+0000 7f95b2368700 1 --2- 172.21.15.67:0/2494113275 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac1035a0 0x7f95ac0fcc10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.797+0000 7f95b2368700 1 --2- 172.21.15.67:0/2494113275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ac102c00 0x7f95ac102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.797+0000 7f95b2368700 1 -- 172.21.15.67:0/2494113275 >> 172.21.15.67:0/2494113275 conn(0x7f95ac0f8790 msgr2=0x7f95ac0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:16.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.797+0000 7f95b2368700 1 -- 172.21.15.67:0/2494113275 shutdown_connections 2023-12-05T09:30:16.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.797+0000 7f95b2368700 1 -- 172.21.15.67:0/2494113275 wait complete. 2023-12-05T09:30:16.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.798+0000 7f95b2368700 1 Processor -- start 2023-12-05T09:30:16.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.798+0000 7f95b2368700 1 -- start start 2023-12-05T09:30:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.799+0000 7f95b2368700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac102c00 0x7f95ac06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.799+0000 7f95b2368700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ac1035a0 0x7f95ac070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.799+0000 7f95b2368700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac070a80 con 0x7f95ac102c00 2023-12-05T09:30:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.799+0000 7f95b2368700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac070bf0 con 0x7f95ac1035a0 2023-12-05T09:30:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.799+0000 7f95abfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac102c00 0x7f95ac06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.799+0000 7f95abfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac102c00 0x7f95ac06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51308/0 (socket says 172.21.15.67:51308) 2023-12-05T09:30:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.799+0000 7f95abfff700 1 -- 172.21.15.67:0/887350299 learned_addr learned my addr 172.21.15.67:0/887350299 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:16.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.799+0000 7f95ab7fe700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ac1035a0 0x7f95ac070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:16.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95abfff700 1 -- 172.21.15.67:0/887350299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ac1035a0 msgr2=0x7f95ac070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:16.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95abfff700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ac1035a0 0x7f95ac070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:16.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95abfff700 1 -- 172.21.15.67:0/887350299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0005040 con 0x7f95ac102c00 2023-12-05T09:30:16.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95abfff700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac102c00 0x7f95ac06ff40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f959c00eb70 tx=0x7f959c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:16.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95a8ff9700 1 -- 172.21.15.67:0/887350299 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c007cc0 con 0x7f95ac102c00 2023-12-05T09:30:16.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95a8ff9700 1 -- 172.21.15.67:0/887350299 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f959c00f040 con 0x7f95ac102c00 2023-12-05T09:30:16.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac1198c0 con 0x7f95ac102c00 2023-12-05T09:30:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95a8ff9700 1 -- 172.21.15.67:0/887350299 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c0095f0 con 0x7f95ac102c00 2023-12-05T09:30:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.800+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac119d20 con 0x7f95ac102c00 2023-12-05T09:30:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.801+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac1050d0 con 0x7f95ac102c00 2023-12-05T09:30:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.803+0000 7f95a8ff9700 1 -- 172.21.15.67:0/887350299 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f959c009750 con 0x7f95ac102c00 2023-12-05T09:30:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.804+0000 7f95a8ff9700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f959406caf0 0x7f959406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:16.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.804+0000 7f95a8ff9700 1 -- 172.21.15.67:0/887350299 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f959c08baf0 con 0x7f95ac102c00 2023-12-05T09:30:16.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.804+0000 7f95ab7fe700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f959406caf0 0x7f959406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:16.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.805+0000 7f95ab7fe700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f959406caf0 0x7f959406efa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f95a000b0d0 tx=0x7f95a0009e30 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:16.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:16.808+0000 7f95a8ff9700 1 -- 172.21.15.67:0/887350299 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f959c055db0 con 0x7f95ac102c00 2023-12-05T09:30:16.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:16 smithi067 ceph-mon[107174]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:16.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:16 smithi067 ceph-mon[107174]: Upgrade: Target is version 19.0.0-11-g3fe8d441 (unknown) 2023-12-05T09:30:16.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:16 smithi067 ceph-mon[107174]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459'] 2023-12-05T09:30:16.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:16 smithi067 ceph-mon[107174]: Upgrade: Setting container_image for all mgr 2023-12-05T09:30:16.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:16 smithi067 ceph-mon[107174]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:16.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:16 smithi067 ceph-mon[107174]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:16.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:16 smithi134 ceph-mon[116304]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:16.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:16 smithi134 ceph-mon[116304]: Upgrade: Target is version 19.0.0-11-g3fe8d441 (unknown) 2023-12-05T09:30:16.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:16 smithi134 ceph-mon[116304]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459'] 2023-12-05T09:30:16.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:16 smithi134 ceph-mon[116304]: Upgrade: Setting container_image for all mgr 2023-12-05T09:30:16.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:16 smithi134 ceph-mon[116304]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:16.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:16 smithi134 ceph-mon[116304]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:17.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.069+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f95ac071680 con 0x7f95ac102c00 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.070+0000 7f95a8ff9700 1 -- 172.21.15.67:0/887350299 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f959c0593d0 con 0x7f95ac102c00 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:e18 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 18 2023-12-05T09:30:17.069 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:26:12.146935+0000 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:30:17.070 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:30:17.071 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:17.072 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:17.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.072+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f959406caf0 msgr2=0x7f959406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.072+0000 7f95b2368700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f959406caf0 0x7f959406efa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f95a000b0d0 tx=0x7f95a0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:17.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.072+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac102c00 msgr2=0x7f95ac06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.072+0000 7f95b2368700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac102c00 0x7f95ac06ff40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f959c00eb70 tx=0x7f959c00b040 comp rx=0 tx=0).stop 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.073+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 shutdown_connections 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.073+0000 7f95b2368700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f959406caf0 0x7f959406efa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.073+0000 7f95b2368700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95ac102c00 0x7f95ac06ff40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.073+0000 7f95b2368700 1 --2- 172.21.15.67:0/887350299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ac1035a0 0x7f95ac070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.073+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 >> 172.21.15.67:0/887350299 conn(0x7f95ac0f8790 msgr2=0x7f95ac0fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.073+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 shutdown_connections 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.073+0000 7f95b2368700 1 -- 172.21.15.67:0/887350299 wait complete. 2023-12-05T09:30:17.073 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 18 2023-12-05T09:30:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.223+0000 7fd0c65c8700 1 -- 172.21.15.67:0/3094447143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 msgr2=0x7fd0c01051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.223+0000 7fd0c65c8700 1 --2- 172.21.15.67:0/3094447143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 0x7fd0c01051b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0004940 tx=0x7fd0b0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.223+0000 7fd0c65c8700 1 -- 172.21.15.67:0/3094447143 shutdown_connections 2023-12-05T09:30:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.223+0000 7fd0c65c8700 1 --2- 172.21.15.67:0/3094447143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0105780 0x7fd0c00fedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.223+0000 7fd0c65c8700 1 --2- 172.21.15.67:0/3094447143 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 0x7fd0c01051b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.223+0000 7fd0c65c8700 1 -- 172.21.15.67:0/3094447143 >> 172.21.15.67:0/3094447143 conn(0x7fd0c00fa9b0 msgr2=0x7fd0c00fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:17.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.223+0000 7fd0c65c8700 1 -- 172.21.15.67:0/3094447143 shutdown_connections 2023-12-05T09:30:17.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.223+0000 7fd0c65c8700 1 -- 172.21.15.67:0/3094447143 wait complete. 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.224+0000 7fd0c65c8700 1 Processor -- start 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.224+0000 7fd0c65c8700 1 -- start start 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.224+0000 7fd0c65c8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 0x7fd0c0115800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0c65c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0105780 0x7fd0c0115d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0c65c8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0116420 con 0x7fd0c0104de0 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0c65c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c010f6c0 con 0x7fd0c0105780 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0bffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 0x7fd0c0115800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0bffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 0x7fd0c0115800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51328/0 (socket says 172.21.15.67:51328) 2023-12-05T09:30:17.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0bffff700 1 -- 172.21.15.67:0/505086210 learned_addr learned my addr 172.21.15.67:0/505086210 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0bf7fe700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0105780 0x7fd0c0115d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0bffff700 1 -- 172.21.15.67:0/505086210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0105780 msgr2=0x7fd0c0115d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0bffff700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0105780 0x7fd0c0115d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.225+0000 7fd0bffff700 1 -- 172.21.15.67:0/505086210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0005040 con 0x7fd0c0104de0 2023-12-05T09:30:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.226+0000 7fd0bffff700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 0x7fd0c0115800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009180 tx=0x7fd0b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.226+0000 7fd0bcff9700 1 -- 172.21.15.67:0/505086210 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b000e040 con 0x7fd0c0104de0 2023-12-05T09:30:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.226+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c010f940 con 0x7fd0c0104de0 2023-12-05T09:30:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.226+0000 7fd0bcff9700 1 -- 172.21.15.67:0/505086210 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0b0013420 con 0x7fd0c0104de0 2023-12-05T09:30:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.226+0000 7fd0bcff9700 1 -- 172.21.15.67:0/505086210 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b001c630 con 0x7fd0c0104de0 2023-12-05T09:30:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.226+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c010fe80 con 0x7fd0c0104de0 2023-12-05T09:30:17.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.227+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c01020f0 con 0x7fd0c0104de0 2023-12-05T09:30:17.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.229+0000 7fd0bcff9700 1 -- 172.21.15.67:0/505086210 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7fd0b00139e0 con 0x7fd0c0104de0 2023-12-05T09:30:17.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.230+0000 7fd0bcff9700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fd0a806cae0 0x7fd0a806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:17.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.230+0000 7fd0bcff9700 1 -- 172.21.15.67:0/505086210 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fd0b008d0f0 con 0x7fd0c0104de0 2023-12-05T09:30:17.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.230+0000 7fd0bf7fe700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fd0a806cae0 0x7fd0a806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:17.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.231+0000 7fd0bf7fe700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fd0a806cae0 0x7fd0a806ef90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4006fd0 tx=0x7fd0b4008040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:17.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.234+0000 7fd0bcff9700 1 -- 172.21.15.67:0/505086210 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd0b005af60 con 0x7fd0c0104de0 2023-12-05T09:30:17.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.472+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 --> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0c0110de0 con 0x7fd0a806cae0 2023-12-05T09:30:17.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.474+0000 7fd0bcff9700 1 -- 172.21.15.67:0/505086210 <== mgr.14664 v2:172.21.15.67:6800/3637826020 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd0c0110de0 con 0x7fd0a806cae0 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "2/21 daemons upgraded", 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mon daemons", 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:30:17.473 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fd0a806cae0 msgr2=0x7fd0a806ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fd0a806cae0 0x7fd0a806ef90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4006fd0 tx=0x7fd0b4008040 comp rx=0 tx=0).stop 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 msgr2=0x7fd0c0115800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 0x7fd0c0115800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009180 tx=0x7fd0b0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 shutdown_connections 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7fd0a806cae0 0x7fd0a806ef90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0c0104de0 0x7fd0c0115800 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 --2- 172.21.15.67:0/505086210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0c0105780 0x7fd0c0115d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 >> 172.21.15.67:0/505086210 conn(0x7fd0c00fa9b0 msgr2=0x7fd0c00fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 shutdown_connections 2023-12-05T09:30:17.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.477+0000 7fd0c65c8700 1 -- 172.21.15.67:0/505086210 wait complete. 2023-12-05T09:30:17.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.620+0000 7f4410a9d700 1 -- 172.21.15.67:0/4168009405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 msgr2=0x7f440c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.620+0000 7f4410a9d700 1 --2- 172.21.15.67:0/4168009405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 0x7f440c102fd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f43fc004940 tx=0x7f43fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:17.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.620+0000 7f4410a9d700 1 -- 172.21.15.67:0/4168009405 shutdown_connections 2023-12-05T09:30:17.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.620+0000 7f4410a9d700 1 --2- 172.21.15.67:0/4168009405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c1035a0 0x7f440c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.620+0000 7f4410a9d700 1 --2- 172.21.15.67:0/4168009405 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 0x7f440c102fd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.620+0000 7f4410a9d700 1 -- 172.21.15.67:0/4168009405 >> 172.21.15.67:0/4168009405 conn(0x7f440c0f8790 msgr2=0x7f440c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.620+0000 7f4410a9d700 1 -- 172.21.15.67:0/4168009405 shutdown_connections 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.620+0000 7f4410a9d700 1 -- 172.21.15.67:0/4168009405 wait complete. 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.621+0000 7f4410a9d700 1 Processor -- start 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.621+0000 7f4410a9d700 1 -- start start 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f4410a9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 0x7f440c113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f4410a9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c1035a0 0x7f440c113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f4410a9d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c114210 con 0x7f440c102c00 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f4410a9d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440c10d500 con 0x7f440c1035a0 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f440a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 0x7f440c113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f440a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 0x7f440c113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:51352/0 (socket says 172.21.15.67:51352) 2023-12-05T09:30:17.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f440a59c700 1 -- 172.21.15.67:0/2316534042 learned_addr learned my addr 172.21.15.67:0/2316534042 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f4409d9b700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c1035a0 0x7f440c113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f440a59c700 1 -- 172.21.15.67:0/2316534042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c1035a0 msgr2=0x7f440c113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f440a59c700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c1035a0 0x7f440c113bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f440a59c700 1 -- 172.21.15.67:0/2316534042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc005040 con 0x7f440c102c00 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.622+0000 7f4409d9b700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c1035a0 0x7f440c113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.623+0000 7f440a59c700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 0x7f440c113640 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f43fc000c00 tx=0x7f43fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.623+0000 7f43faffd700 1 -- 172.21.15.67:0/2316534042 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43fc021070 con 0x7f440c102c00 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.623+0000 7f43faffd700 1 -- 172.21.15.67:0/2316534042 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43fc01c400 con 0x7f440c102c00 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.623+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440c10d730 con 0x7f440c102c00 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.623+0000 7f43faffd700 1 -- 172.21.15.67:0/2316534042 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43fc00e070 con 0x7f440c102c00 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.623+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440c10dbc0 con 0x7f440c102c00 2023-12-05T09:30:17.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.624+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440c0fff10 con 0x7f440c102c00 2023-12-05T09:30:17.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.625+0000 7f43faffd700 1 -- 172.21.15.67:0/2316534042 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 33) v1 ==== 90797+0+0 (secure 0 0 0) 0x7f43fc01c9e0 con 0x7f440c102c00 2023-12-05T09:30:17.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.626+0000 7f43faffd700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f43f406cae0 0x7f43f406ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:17.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.626+0000 7f43faffd700 1 -- 172.21.15.67:0/2316534042 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f43fc08cff0 con 0x7f440c102c00 2023-12-05T09:30:17.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.626+0000 7f4409d9b700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f43f406cae0 0x7f43f406ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:17.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.627+0000 7f4409d9b700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f43f406cae0 0x7f43f406ef90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4400004600 tx=0x7f440000b040 comp rx=0 tx=0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:17.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.631+0000 7f43faffd700 1 -- 172.21.15.67:0/2316534042 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f43fc05ae20 con 0x7f440c102c00 2023-12-05T09:30:17.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.930+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f440c0fc360 con 0x7f440c102c00 2023-12-05T09:30:17.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.930+0000 7f43faffd700 1 -- 172.21.15.67:0/2316534042 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f43fc05a9b0 con 0x7f440c102c00 2023-12-05T09:30:17.929 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_OK 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f43f406cae0 msgr2=0x7f43f406ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f43f406cae0 0x7f43f406ef90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4400004600 tx=0x7f440000b040 comp rx=0 tx=0).stop 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 msgr2=0x7f440c113640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 0x7f440c113640 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f43fc000c00 tx=0x7f43fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 shutdown_connections 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:6800/3637826020,v1:172.21.15.67:6801/3637826020] conn(0x7f43f406cae0 0x7f43f406ef90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f440c102c00 0x7f440c113640 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 --2- 172.21.15.67:0/2316534042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f440c1035a0 0x7f440c113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 >> 172.21.15.67:0/2316534042 conn(0x7f440c0f8790 msgr2=0x7f440c0fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 shutdown_connections 2023-12-05T09:30:17.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:17.933+0000 7f4410a9d700 1 -- 172.21.15.67:0/2316534042 wait complete. 2023-12-05T09:30:17.941 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: pgmap v99: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:17.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: Upgrade: Updating mon.smithi067 2023-12-05T09:30:17.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:17.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:30:17.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:30:17.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:17.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: Deploying daemon mon.smithi067 on smithi067 2023-12-05T09:30:17.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/3498838767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:30:17.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:17 smithi067 ceph-mon[107174]: from='client.? 172.21.15.67:0/887350299' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:30:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: pgmap v99: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: Upgrade: Updating mon.smithi067 2023-12-05T09:30:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:30:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:30:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: Deploying daemon mon.smithi067 on smithi067 2023-12-05T09:30:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/3498838767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:30:18.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:17 smithi134 ceph-mon[116304]: from='client.? 172.21.15.67:0/887350299' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:30:18.562 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:18 smithi067 systemd[1]: Stopping Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:30:18.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:18 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067[107151]: 2023-12-05T09:30:18.561+0000 7f6da16dc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi067 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:30:18.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:18 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067[107151]: 2023-12-05T09:30:18.562+0000 7f6da16dc700 -1 mon.smithi067@0(leader) e2 *** Got Signal Terminated *** 2023-12-05T09:30:19.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:19 smithi067 bash[210707]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067 2023-12-05T09:30:19.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:19 smithi067 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067.service: Succeeded. 2023-12-05T09:30:19.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:19 smithi067 systemd[1]: Stopped Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:30:20.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:19 smithi067 systemd[1]: Starting Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:30:20.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 bash[210857]: 25dffe125a4acfed3c30c7bea238cda631e30171e3ea01187b76af68f6678d67 2023-12-05T09:30:20.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 systemd[1]: Started Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:30:20.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T09:30:20.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev), process ceph-mon, pid 7 2023-12-05T09:30:20.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: pidfile_write: ignore empty --pid-file 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: load: jerasure load: lrc 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: RocksDB version: 7.9.2 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Git sha 0 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Compile date 2023-12-05 07:02:20 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: DB SUMMARY 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: DB Session ID: QMOIVYTJ8HHIQN6AY94R 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: CURRENT file: CURRENT 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1171 Bytes 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi067/store.db dir, Total Num: 1, files: 000033.sst 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi067/store.db: 000031.log size: 2696735 ; 2023-12-05T09:30:20.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.error_if_exists: 0 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.create_if_missing: 0 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.paranoid_checks: 1 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.env: 0x56504f303a60 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.fs: PosixFileSystem 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.info_log: 0x5650500dd640 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.statistics: (nil) 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.use_fsync: 0 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_log_file_size: 0 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T09:30:20.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.allow_fallocate: 1 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.use_direct_reads: 0 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.db_log_dir: 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.wal_dir: 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T09:30:20.622 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.write_buffer_manager: 0x565050093360 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.unordered_write: 0 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T09:30:20.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.row_cache: None 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.wal_filter: None 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.two_write_queues: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.wal_compression: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.atomic_flush: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.log_readahead_size: 0 2023-12-05T09:30:20.624 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T09:30:20.625 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T09:30:20.625 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_background_jobs: 2 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_background_compactions: -1 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_subcompactions: 1 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T09:30:20.626 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_open_files: -1 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_background_flushes: -1 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Compression algorithms supported: 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: kZSTD supported: 0 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: kXpressCompression supported: 0 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: kZlibCompression supported: 1 2023-12-05T09:30:20.627 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: kSnappyCompression supported: 1 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: kLZ4Compression supported: 1 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: kBZip2Compression supported: 0 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000015 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.merge_operator: 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_filter: None 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5650500dd740) 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: cache_index_and_filter_blocks: 1 2023-12-05T09:30:20.628 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: pin_top_level_index_and_filter: 1 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_type: 0 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_block_index_type: 0 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_shortening: 1 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: checksum: 4 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: no_block_cache: 0 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache: 0x565050133090 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_name: BinnedLRUCache 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_options: 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: capacity : 536870912 2023-12-05T09:30:20.629 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: num_shard_bits : 4 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: strict_capacity_limit : 0 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: high_pri_pool_ratio: 0.000 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_cache_compressed: (nil) 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: persistent_cache: (nil) 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_size: 4096 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_size_deviation: 10 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_restart_interval: 16 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: index_block_restart_interval: 1 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: metadata_block_size: 4096 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: partition_filters: 0 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: use_delta_encoding: 1 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: filter_policy: bloomfilter 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: whole_key_filtering: 1 2023-12-05T09:30:20.630 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: verify_compression: 0 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: read_amp_bytes_per_bit: 0 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: format_version: 5 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: enable_index_compression: 1 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: block_align: 0 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_auto_readahead_size: 262144 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: prepopulate_block_cache: 0 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: initial_auto_readahead_size: 8192 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: num_file_reads_for_auto_readahead: 2 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression: NoCompression 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.num_levels: 7 2023-12-05T09:30:20.631 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T09:30:20.632 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T09:30:20.633 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.arena_block_size: 1048576 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T09:30:20.634 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.table_properties_collectors: 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.inplace_update_support: 0 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.bloom_locality: 0 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.max_successive_merges: 0 2023-12-05T09:30:20.635 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.ttl: 2592000 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.enable_blob_files: false 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.min_blob_size: 0 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-05T09:30:20.636 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.blob_file_starting_level: 0 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12176, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: be185244-5e26-4327-a417-f7e6526f40c8 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701768620240603, "job": 1, "event": "recovery_started", "wal_files": [31]} 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701768620253433, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 2387834, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12164, "largest_seqno": 14631, "table_properties": {"data_size": 2378176, "index_size": 5693, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2949, "raw_key_size": 25870, "raw_average_key_size": 21, "raw_value_size": 2355650, "raw_average_value_size": 2003, "num_data_blocks": 260, "num_entries": 1176, "num_filter_entries": 1176, "num_deletions": 258, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701768620, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "be185244-5e26-4327-a417-f7e6526f40c8", "db_session_id": "QMOIVYTJ8HHIQN6AY94R", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701768620253590, "job": 1, "event": "recovery_finished"} 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T09:30:20.637 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi067/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5650501ce000 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: DB pointer 0x5650501ba000 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** DB Stats ** 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.638 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: L0 1/0 2.28 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 436.0 0.01 0.00 1 0.005 0 0 0.0 0.0 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: L6 1/0 5.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Sum 2/0 8.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 436.0 0.01 0.00 1 0.005 0 0 0.0 0.0 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 436.0 0.01 0.00 1 0.005 0 0 0.0 0.0 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** Compaction Stats [default] ** 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 436.0 0.01 0.00 1 0.005 0 0 0.0 0.0 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-05T09:30:20.639 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Cumulative compaction: 0.00 GB write, 112.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Interval compaction: 0.00 GB write, 112.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Block cache BinnedLRUCache@0x565050133090#7 capacity: 512.00 MB usage: 9.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,3.03 KB,0.000578165%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.640 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: starting mon.smithi067 rank 0 at public addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] at bind addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi067 fsid f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: mon.smithi067@-1(???) e2 preinit fsid f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: mon.smithi067@-1(???).mds e18 new map 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: mon.smithi067@-1(???).mds e18 print_map 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: e18 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: legacy client fscid: 1 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Filesystem 'cephfs' (1) 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: fs_name cephfs 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: epoch 18 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:30:20.641 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: modified 2023-12-05T09:26:12.146935+0000 2023-12-05T09:30:20.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: tableserver 0 2023-12-05T09:30:20.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: root 0 2023-12-05T09:30:20.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: session_timeout 60 2023-12-05T09:30:20.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: session_autoclose 300 2023-12-05T09:30:20.642 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_file_size 1099511627776 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_xattr_size 65536 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: required_client_features {} 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: last_failure 0 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: last_failure_osd_epoch 46 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: max_mds 2 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: in 0,1 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: up {0=14478,1=14494} 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: failed 2023-12-05T09:30:20.643 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: damaged 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: stopped 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: data_pools [3] 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: metadata_pool 2 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: inline_data disabled 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: balancer 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: bal_rank_mask -1 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: standby_count_wanted 1 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: [mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: [mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 export targets 0 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.644 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: Standby daemons: 2023-12-05T09:30:20.645 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: 2023-12-05T09:30:20.645 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: [mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:20.645 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout: [mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:20.645 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: mon.smithi067@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-05T09:30:20.645 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: mon.smithi067@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:30:20.645 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: mon.smithi067@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:30:20.645 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: mon.smithi067@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:30:20.645 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:20 smithi067 ceph-mon[210894]: mon.smithi067@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-05T09:30:22.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: pgmap v100: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:22.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:30:22.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: pgmap v101: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: mon.smithi067 calling monitor election 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: mon.smithi067 is new leader, mons smithi067,smithi134 in quorum (ranks 0,1) 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: monmap e2: 2 mons at {smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: osdmap e50: 6 total, 6 up, 6 in 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: mgrmap e33: smithi067.alxtvv(active, since 3m), standbys: smithi134.yfqkak 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: from='mgr.14664 ' entity='' 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: mgrmap e34: smithi067.alxtvv(active, since 3m), standbys: smithi134.yfqkak 2023-12-05T09:30:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:21 smithi067 ceph-mon[210894]: overall HEALTH_OK 2023-12-05T09:30:22.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: pgmap v100: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: from='mgr.14664 172.21.15.67:0/990574353' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: pgmap v101: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: mon.smithi067 calling monitor election 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: mon.smithi067 is new leader, mons smithi067,smithi134 in quorum (ranks 0,1) 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: monmap e2: 2 mons at {smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: osdmap e50: 6 total, 6 up, 6 in 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: mgrmap e33: smithi067.alxtvv(active, since 3m), standbys: smithi134.yfqkak 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: from='mgr.14664 ' entity='' 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: mgrmap e34: smithi067.alxtvv(active, since 3m), standbys: smithi134.yfqkak 2023-12-05T09:30:22.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:21 smithi134 ceph-mon[116304]: overall HEALTH_OK 2023-12-05T09:30:22.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:22 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:30:23.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:22 smithi067 ceph-mon[210894]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:30:27.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:27 smithi067 ceph-mon[210894]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:30:27.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:27 smithi134 ceph-mon[116304]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:30:30.981 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:30 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi134[116261]: 2023-12-05T09:30:30.720+0000 7fea41c4f700 -1 mon.smithi134@1(peon).osd e51 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: Standby manager daemon smithi134.yfqkak restarted 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: Standby manager daemon smithi134.yfqkak started 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.? 172.21.15.134:0/2299483412' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.? 172.21.15.134:0/2299483412' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.? 172.21.15.134:0/2299483412' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.? 172.21.15.134:0/2299483412' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: Active manager daemon smithi067.alxtvv restarted 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: osdmap e51: 6 total, 6 up, 6 in 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: mgrmap e35: smithi067.alxtvv(active, starting, since 0.00772279s), standbys: smithi134.yfqkak 2023-12-05T09:30:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: failed to encode map e51 with expected crc 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.kyspon"}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.qaibsa"}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vmnpaq"}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.yfqkak", "id": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:30:31.620 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:30:31.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:30:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: Standby manager daemon smithi134.yfqkak restarted 2023-12-05T09:30:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: Standby manager daemon smithi134.yfqkak started 2023-12-05T09:30:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/2299483412' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/crt"}]: dispatch 2023-12-05T09:30:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/2299483412' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-05T09:30:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/2299483412' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.yfqkak/key"}]: dispatch 2023-12-05T09:30:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.? 172.21.15.134:0/2299483412' entity='mgr.smithi134.yfqkak' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-05T09:30:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: Active manager daemon smithi067.alxtvv restarted 2023-12-05T09:30:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: Activating manager daemon smithi067.alxtvv 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: osdmap e51: 6 total, 6 up, 6 in 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: mgrmap e35: smithi067.alxtvv(active, starting, since 0.00772279s), standbys: smithi134.yfqkak 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: failed to encode map e51 with expected crc 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.kyspon"}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi067.qaibsa"}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vmnpaq"}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.vvbmln"}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi067.alxtvv", "id": "smithi067.alxtvv"}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr metadata", "who": "smithi134.yfqkak", "id": "smithi134.yfqkak"}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:30:31.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: Manager daemon smithi067.alxtvv is now available 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/mirror_snapshot_schedule"}]: dispatch 2023-12-05T09:30:31.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:31 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.alxtvv/trash_purge_schedule"}]: dispatch 2023-12-05T09:30:32.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:32 smithi134 ceph-mon[116304]: [05/Dec/2023:09:30:31] ENGINE Bus STARTING 2023-12-05T09:30:32.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:32 smithi134 ceph-mon[116304]: [05/Dec/2023:09:30:31] ENGINE Serving on http://172.21.15.67:8765 2023-12-05T09:30:32.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:32 smithi134 ceph-mon[116304]: [05/Dec/2023:09:30:31] ENGINE Serving on https://172.21.15.67:7150 2023-12-05T09:30:32.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:32 smithi134 ceph-mon[116304]: [05/Dec/2023:09:30:31] ENGINE Bus STARTED 2023-12-05T09:30:32.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:32 smithi134 ceph-mon[116304]: mgrmap e36: smithi067.alxtvv(active, since 1.01513s), standbys: smithi134.yfqkak 2023-12-05T09:30:32.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:32 smithi134 ceph-mon[116304]: pgmap v3: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:32 smithi067 ceph-mon[210894]: [05/Dec/2023:09:30:31] ENGINE Bus STARTING 2023-12-05T09:30:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:32 smithi067 ceph-mon[210894]: [05/Dec/2023:09:30:31] ENGINE Serving on http://172.21.15.67:8765 2023-12-05T09:30:33.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:32 smithi067 ceph-mon[210894]: [05/Dec/2023:09:30:31] ENGINE Serving on https://172.21.15.67:7150 2023-12-05T09:30:33.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:32 smithi067 ceph-mon[210894]: [05/Dec/2023:09:30:31] ENGINE Bus STARTED 2023-12-05T09:30:33.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:32 smithi067 ceph-mon[210894]: mgrmap e36: smithi067.alxtvv(active, since 1.01513s), standbys: smithi134.yfqkak 2023-12-05T09:30:33.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:32 smithi067 ceph-mon[210894]: pgmap v3: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:33 smithi067 ceph-mon[210894]: pgmap v4: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:33 smithi067 ceph-mon[210894]: mgrmap e37: smithi067.alxtvv(active, since 2s), standbys: smithi134.yfqkak 2023-12-05T09:30:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:33 smithi134 ceph-mon[116304]: pgmap v4: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:33 smithi134 ceph-mon[116304]: mgrmap e37: smithi067.alxtvv(active, since 2s), standbys: smithi134.yfqkak 2023-12-05T09:30:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:34 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:34 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:36.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:35 smithi067 ceph-mon[210894]: pgmap v5: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:35 smithi067 ceph-mon[210894]: mgrmap e38: smithi067.alxtvv(active, since 4s), standbys: smithi134.yfqkak 2023-12-05T09:30:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:35 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:35 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:35 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:35 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:35 smithi134 ceph-mon[116304]: pgmap v5: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:35 smithi134 ceph-mon[116304]: mgrmap e38: smithi067.alxtvv(active, since 4s), standbys: smithi134.yfqkak 2023-12-05T09:30:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:35 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:36.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:35 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:36.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:35 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:36.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:35 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:38.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:37 smithi067 ceph-mon[210894]: pgmap v6: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:38.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:37 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:38.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:37 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:38.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:37 smithi134 ceph-mon[116304]: pgmap v6: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:38.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:37 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:38.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:37 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:40.117 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:39 smithi067 ceph-mon[210894]: pgmap v7: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-05T09:30:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:39 smithi134 ceph-mon[116304]: pgmap v7: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2023-12-05T09:30:41.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:41 smithi067 ceph-mon[210894]: Detected new or changed devices on smithi067 2023-12-05T09:30:41.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:41 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:41.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:41 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:41.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:41 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:41.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:41 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:30:41.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:41 smithi067 ceph-mon[210894]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:30:41.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:41 smithi067 ceph-mon[210894]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:30:41.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:41 smithi067 ceph-mon[210894]: pgmap v8: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-05T09:30:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:41 smithi134 ceph-mon[116304]: Detected new or changed devices on smithi067 2023-12-05T09:30:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:41 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:41 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:41 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:41 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:30:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:41 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.conf 2023-12-05T09:30:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:41 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.conf 2023-12-05T09:30:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:41 smithi134 ceph-mon[116304]: pgmap v8: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2023-12-05T09:30:42.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:42 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:30:42.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:42 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:30:42.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:42 smithi134 ceph-mon[116304]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:30:42.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:42 smithi134 ceph-mon[116304]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:30:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:42 smithi067 ceph-mon[210894]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:30:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:42 smithi067 ceph-mon[210894]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-05T09:30:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:42 smithi067 ceph-mon[210894]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:30:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:42 smithi067 ceph-mon[210894]: Updating smithi067:/etc/ceph/ceph.client.admin.keyring 2023-12-05T09:30:43.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:30:43.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:30:43.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:43.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:43.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:43.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:43.798 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:43.799 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: pgmap v9: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2023-12-05T09:30:43.799 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:43.799 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:30:43.799 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:43 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T09:30:44.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: Updating smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:30:44.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: Updating smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-05T09:30:44.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:44.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:44.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:44.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:44.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:44.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: pgmap v9: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2023-12-05T09:30:44.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:44.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:30:44.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-05T09:30:45.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-mon[116304]: Upgrade: Updating mon.smithi134 2023-12-05T09:30:45.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:45.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:30:45.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:30:45.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-mon[116304]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:45.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-mon[116304]: Deploying daemon mon.smithi134 on smithi134 2023-12-05T09:30:45.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-mon[116304]: pgmap v10: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T09:30:45.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:45 smithi067 ceph-mon[210894]: Upgrade: Updating mon.smithi134 2023-12-05T09:30:45.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:45.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:30:45.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:30:45.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:45.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:45 smithi067 ceph-mon[210894]: Deploying daemon mon.smithi134 on smithi134 2023-12-05T09:30:45.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:45 smithi067 ceph-mon[210894]: pgmap v10: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T09:30:45.940 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:30:46.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi134[116261]: 2023-12-05T09:30:45.940+0000 7fea4745a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:30:46.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:45 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi134[116261]: 2023-12-05T09:30:45.940+0000 7fea4745a700 -1 mon.smithi134@1(peon) e2 *** Got Signal Terminated *** 2023-12-05T09:30:46.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:46 smithi134 bash[172706]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi134 2023-12-05T09:30:46.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:46 smithi134 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi134.service: Succeeded. 2023-12-05T09:30:46.708 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:46 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:30:47.109 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:46 smithi134 systemd[1]: Starting Ceph mon.smithi134 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 bash[172857]: c85edd1646d0f8f8ded8d8062ef29d0b84639365978155ca2bd34790e2d23b7d 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 systemd[1]: Started Ceph mon.smithi134 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: set uid:gid to 167:167 (ceph:ceph) 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev), process ceph-mon, pid 7 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: pidfile_write: ignore empty --pid-file 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: load: jerasure load: lrc 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: RocksDB version: 7.9.2 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Git sha 0 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Compile date 2023-12-05 07:02:20 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: DB SUMMARY 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: DB Session ID: ZBNY20190QG6P2GAQM38 2023-12-05T09:30:47.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: CURRENT file: CURRENT 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: IDENTITY file: IDENTITY 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1096 Bytes 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000027.sst 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000025.log size: 6620344 ; 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.error_if_exists: 0 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.create_if_missing: 0 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.paranoid_checks: 1 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-05T09:30:47.629 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.env: 0x556f3581ba60 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.fs: PosixFileSystem 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.info_log: 0x556f37541640 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_file_opening_threads: 16 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.statistics: (nil) 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.use_fsync: 0 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_log_file_size: 0 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.keep_log_file_num: 1000 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.recycle_log_file_num: 0 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.allow_fallocate: 1 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.allow_mmap_reads: 0 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.allow_mmap_writes: 0 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.use_direct_reads: 0 2023-12-05T09:30:47.630 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-05T09:30:47.631 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.create_missing_column_families: 0 2023-12-05T09:30:47.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.db_log_dir: 2023-12-05T09:30:47.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.wal_dir: 2023-12-05T09:30:47.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-05T09:30:47.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-05T09:30:47.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-05T09:30:47.632 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.advise_random_on_open: 1 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.db_write_buffer_size: 0 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.write_buffer_manager: 0x556f374f7360 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.rate_limiter: (nil) 2023-12-05T09:30:47.633 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-05T09:30:47.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.wal_recovery_mode: 2 2023-12-05T09:30:47.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.enable_thread_tracking: 0 2023-12-05T09:30:47.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.enable_pipelined_write: 0 2023-12-05T09:30:47.634 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.unordered_write: 0 2023-12-05T09:30:47.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-05T09:30:47.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-05T09:30:47.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-05T09:30:47.635 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-05T09:30:47.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.row_cache: None 2023-12-05T09:30:47.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.wal_filter: None 2023-12-05T09:30:47.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-05T09:30:47.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.allow_ingest_behind: 0 2023-12-05T09:30:47.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.two_write_queues: 0 2023-12-05T09:30:47.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.manual_wal_flush: 0 2023-12-05T09:30:47.636 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.wal_compression: 0 2023-12-05T09:30:47.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.atomic_flush: 0 2023-12-05T09:30:47.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-05T09:30:47.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-05T09:30:47.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-05T09:30:47.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.log_readahead_size: 0 2023-12-05T09:30:47.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-05T09:30:47.637 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.best_efforts_recovery: 0 2023-12-05T09:30:47.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-05T09:30:47.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-05T09:30:47.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.allow_data_in_errors: 0 2023-12-05T09:30:47.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.db_host_id: __hostname__ 2023-12-05T09:30:47.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-05T09:30:47.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_background_jobs: 2 2023-12-05T09:30:47.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_background_compactions: -1 2023-12-05T09:30:47.638 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_subcompactions: 1 2023-12-05T09:30:47.639 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-05T09:30:47.639 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-05T09:30:47.639 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-05T09:30:47.639 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_total_wal_size: 0 2023-12-05T09:30:47.639 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_open_files: -1 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bytes_per_sync: 0 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_readahead_size: 0 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_background_flushes: -1 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Compression algorithms supported: 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: kZSTD supported: 0 2023-12-05T09:30:47.640 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: kXpressCompression supported: 0 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: kLZ4HCCompression supported: 1 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: kZlibCompression supported: 1 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: kSnappyCompression supported: 1 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: kLZ4Compression supported: 1 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: kBZip2Compression supported: 0 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000009 2023-12-05T09:30:47.641 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.merge_operator: 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_filter: None 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_filter_factory: None 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.sst_partitioner_factory: None 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556f37541740) 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-05T09:30:47.642 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 4 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x556f37597090 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2023-12-05T09:30:47.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: bloomfilter 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 5 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2023-12-05T09:30:47.644 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_auto_readahead_size: 262144 2023-12-05T09:30:47.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: prepopulate_block_cache: 0 2023-12-05T09:30:47.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: initial_auto_readahead_size: 8192 2023-12-05T09:30:47.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2023-12-05T09:30:47.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.write_buffer_size: 33554432 2023-12-05T09:30:47.645 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_write_buffer_number: 2 2023-12-05T09:30:47.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression: NoCompression 2023-12-05T09:30:47.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression: Disabled 2023-12-05T09:30:47.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.prefix_extractor: nullptr 2023-12-05T09:30:47.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-05T09:30:47.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.num_levels: 7 2023-12-05T09:30:47.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-05T09:30:47.646 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-05T09:30:47.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-05T09:30:47.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-05T09:30:47.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-05T09:30:47.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-05T09:30:47.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-05T09:30:47.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:30:47.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-05T09:30:47.647 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.level: 32767 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.strategy: 0 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.enabled: false 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-05T09:30:47.648 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.target_file_size_base: 67108864 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-05T09:30:47.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-05T09:30:47.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.arena_block_size: 1048576 2023-12-05T09:30:47.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-05T09:30:47.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-05T09:30:47.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.disable_auto_compactions: 0 2023-12-05T09:30:47.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-05T09:30:47.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-05T09:30:47.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-05T09:30:47.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-05T09:30:47.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-05T09:30:47.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-05T09:30:47.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-05T09:30:47.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-05T09:30:47.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-05T09:30:47.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-05T09:30:47.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.table_properties_collectors: 2023-12-05T09:30:47.651 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.inplace_update_support: 0 2023-12-05T09:30:47.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-05T09:30:47.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-05T09:30:47.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-05T09:30:47.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-05T09:30:47.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.bloom_locality: 0 2023-12-05T09:30:47.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.max_successive_merges: 0 2023-12-05T09:30:47.652 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-05T09:30:47.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.paranoid_file_checks: 0 2023-12-05T09:30:47.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.force_consistency_checks: 1 2023-12-05T09:30:47.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.report_bg_io_stats: 0 2023-12-05T09:30:47.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.ttl: 2592000 2023-12-05T09:30:47.653 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.enable_blob_files: false 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.min_blob_size: 0 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.blob_file_size: 268435456 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-05T09:30:47.654 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-05T09:30:47.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-05T09:30:47.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.blob_file_starting_level: 0 2023-12-05T09:30:47.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-05T09:30:47.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-05T09:30:47.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T09:30:47.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12368, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-05T09:30:47.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-05T09:30:47.655 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca10c269-5413-4ba3-afb1-fa3b564fe00c 2023-12-05T09:30:47.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701768647208911, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-05T09:30:47.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-05T09:30:47.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701768647238787, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4001566, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12362, "largest_seqno": 15630, "table_properties": {"data_size": 3989804, "index_size": 7221, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3525, "raw_key_size": 30921, "raw_average_key_size": 22, "raw_value_size": 3962733, "raw_average_value_size": 2842, "num_data_blocks": 326, "num_entries": 1394, "num_filter_entries": 1394, "num_deletions": 258, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701768647, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ca10c269-5413-4ba3-afb1-fa3b564fe00c", "db_session_id": "ZBNY20190QG6P2GAQM38", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-05T09:30:47.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701768647238982, "job": 1, "event": "recovery_finished"} 2023-12-05T09:30:47.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-05T09:30:47.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-05T09:30:47.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-05T09:30:47.657 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556f37632000 2023-12-05T09:30:47.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: DB pointer 0x556f3761e000 2023-12-05T09:30:47.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-05T09:30:47.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-05T09:30:47.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2023-12-05T09:30:47.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:30:47.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-05T09:30:47.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:30:47.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 1/0 3.82 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 459.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L6 1/0 5.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 9.67 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 459.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 459.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2023-12-05T09:30:47.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-05T09:30:47.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-05T09:30:47.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 459.2 0.01 0.00 1 0.008 0 0 0.0 0.0 2023-12-05T09:30:47.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-05T09:30:47.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-05T09:30:47.660 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.004, interval 0.004 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 104.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 104.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache BinnedLRUCache@0x556f37597090#7 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: starting mon.smithi134 rank 1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:30:47.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: mon.smithi134@-1(???) e2 preinit fsid f6a41352-934e-11ee-95a2-87774f69a715 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: mon.smithi134@-1(???).mds e20 new map 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: mon.smithi134@-1(???).mds e20 print_map 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e20 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: 1 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Filesystem 'cephfs' (1) 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: fs_name cephfs 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: epoch 20 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: modified 2023-12-05T09:30:26.034169+0000 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: tableserver 0 2023-12-05T09:30:47.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: root 0 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_timeout 60 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_autoclose 300 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_file_size 1099511627776 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_xattr_size 65536 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: required_client_features {} 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure 0 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure_osd_epoch 46 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_mds 2 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: in 0,1 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: up {0=14478,1=14494} 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: failed 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: damaged 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: stopped 2023-12-05T09:30:47.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_pools [3] 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_pool 2 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: inline_data disabled 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: balancer 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: bal_rank_mask -1 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: standby_count_wanted 1 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Standby daemons: 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: mon.smithi134@-1(???).osd e51 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-05T09:30:47.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: mon.smithi134@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:30:47.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: mon.smithi134@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:30:47.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: mon.smithi134@-1(???).osd e51 crush map has features 288514051259236352, adjusting msgr requires 2023-12-05T09:30:47.665 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: mon.smithi134@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2023-12-05T09:30:48.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.093+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3776767340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c06ff80 msgr2=0x7f4e9c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:48.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.093+0000 7f4ea2cb0700 1 --2- 172.21.15.67:0/3776767340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c06ff80 0x7f4e9c070350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e90004970 tx=0x7f4e90009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:48.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.093+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3776767340 shutdown_connections 2023-12-05T09:30:48.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.094+0000 7f4ea2cb0700 1 --2- 172.21.15.67:0/3776767340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c070890 0x7f4e9c108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.094+0000 7f4ea2cb0700 1 --2- 172.21.15.67:0/3776767340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c06ff80 0x7f4e9c070350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.094+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3776767340 >> 172.21.15.67:0/3776767340 conn(0x7f4e9c0f8790 msgr2=0x7f4e9c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:48.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.094+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3776767340 shutdown_connections 2023-12-05T09:30:48.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.094+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3776767340 wait complete. 2023-12-05T09:30:48.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.094+0000 7f4ea2cb0700 1 Processor -- start 2023-12-05T09:30:48.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea2cb0700 1 -- start start 2023-12-05T09:30:48.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea2cb0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 0x7f4e9c1157e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea2cb0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c070890 0x7f4e9c115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea2cb0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c116370 con 0x7f4e9c070890 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea2cb0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c10f6a0 con 0x7f4e9c06ff80 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4e9bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c070890 0x7f4e9c115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4e9bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c070890 0x7f4e9c115d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42278/0 (socket says 172.21.15.67:42278) 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4e9bfff700 1 -- 172.21.15.67:0/3713245631 learned_addr learned my addr 172.21.15.67:0/3713245631 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea0a4c700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 0x7f4e9c1157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea0a4c700 1 -- 172.21.15.67:0/3713245631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 msgr2=0x7f4e9c1157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea0a4c700 1 -- 172.21.15.67:0/3713245631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 msgr2=0x7f4e9c1157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.095+0000 7f4ea0a4c700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 0x7f4e9c1157e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4ea0a4c700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 0x7f4e9c1157e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4e9bfff700 1 -- 172.21.15.67:0/3713245631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 msgr2=0x7f4e9c1157e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4e9bfff700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 0x7f4e9c1157e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4e9bfff700 1 -- 172.21.15.67:0/3713245631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90005040 con 0x7f4e9c070890 2023-12-05T09:30:48.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4e9bfff700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c070890 0x7f4e9c115d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e88002a50 tx=0x7f4e880046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:48.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4e997fa700 1 -- 172.21.15.67:0/3713245631 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e88007cc0 con 0x7f4e9c070890 2023-12-05T09:30:48.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4e997fa700 1 -- 172.21.15.67:0/3713245631 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e8800f040 con 0x7f4e9c070890 2023-12-05T09:30:48.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c10f980 con 0x7f4e9c070890 2023-12-05T09:30:48.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4e997fa700 1 -- 172.21.15.67:0/3713245631 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e88009540 con 0x7f4e9c070890 2023-12-05T09:30:48.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.096+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c10fec0 con 0x7f4e9c070890 2023-12-05T09:30:48.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.097+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c106630 con 0x7f4e9c070890 2023-12-05T09:30:48.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.099+0000 7f4e997fa700 1 -- 172.21.15.67:0/3713245631 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f4e880096a0 con 0x7f4e9c070890 2023-12-05T09:30:48.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.100+0000 7f4e997fa700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4e8c06cf80 0x7f4e8c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.100+0000 7f4e997fa700 1 -- 172.21.15.67:0/3713245631 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4e8808c410 con 0x7f4e9c070890 2023-12-05T09:30:48.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.100+0000 7f4ea0a4c700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4e8c06cf80 0x7f4e8c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.100+0000 7f4ea0a4c700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4e8c06cf80 0x7f4e8c06f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4e90004ee0 tx=0x7f4e90009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:48.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.106+0000 7f4e997fa700 1 -- 172.21.15.67:0/3713245631 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4e88059ac0 con 0x7f4e9c070890 2023-12-05T09:30:48.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:47 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:30:48.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:47 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:30:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.333+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e9c10be20 con 0x7f4e8c06cf80 2023-12-05T09:30:48.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.335+0000 7f4e997fa700 1 -- 172.21.15.67:0/3713245631 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f4e9c10be20 con 0x7f4e8c06cf80 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4e8c06cf80 msgr2=0x7f4e8c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4e8c06cf80 0x7f4e8c06f430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4e90004ee0 tx=0x7f4e90009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c070890 msgr2=0x7f4e9c115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c070890 0x7f4e9c115d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e88002a50 tx=0x7f4e880046b0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 shutdown_connections 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e9c06ff80 0x7f4e9c1157e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4e8c06cf80 0x7f4e8c06f430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 --2- 172.21.15.67:0/3713245631 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4e9c070890 0x7f4e9c115d20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 >> 172.21.15.67:0/3713245631 conn(0x7f4e9c0f8790 msgr2=0x7f4e9c1037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:48.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 shutdown_connections 2023-12-05T09:30:48.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.337+0000 7f4ea2cb0700 1 -- 172.21.15.67:0/3713245631 wait complete. 2023-12-05T09:30:48.350 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:30:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.476+0000 7f9a25289700 1 -- 172.21.15.67:0/3389473013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 msgr2=0x7f9a2006ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.476+0000 7f9a25289700 1 --2- 172.21.15.67:0/3389473013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 0x7f9a2006ffe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a10004970 tx=0x7f9a10009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.476+0000 7f9a25289700 1 -- 172.21.15.67:0/3389473013 shutdown_connections 2023-12-05T09:30:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.476+0000 7f9a25289700 1 --2- 172.21.15.67:0/3389473013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a20070520 0x7f9a20070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.476+0000 7f9a25289700 1 --2- 172.21.15.67:0/3389473013 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 0x7f9a2006ffe0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.476+0000 7f9a25289700 1 -- 172.21.15.67:0/3389473013 >> 172.21.15.67:0/3389473013 conn(0x7f9a200f8790 msgr2=0x7f9a200faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.476+0000 7f9a25289700 1 -- 172.21.15.67:0/3389473013 shutdown_connections 2023-12-05T09:30:48.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.476+0000 7f9a25289700 1 -- 172.21.15.67:0/3389473013 wait complete. 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.477+0000 7f9a25289700 1 Processor -- start 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.477+0000 7f9a25289700 1 -- start start 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.477+0000 7f9a25289700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a20070520 0x7f9a20119c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.477+0000 7f9a25289700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 0x7f9a2011a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.477+0000 7f9a25289700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2011a790 con 0x7f9a20071c10 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.477+0000 7f9a25289700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20113ac0 con 0x7f9a20070520 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.477+0000 7f9a1e7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 0x7f9a2011a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a1e7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 0x7f9a2011a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42306/0 (socket says 172.21.15.67:42306) 2023-12-05T09:30:48.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a1e7fc700 1 -- 172.21.15.67:0/1701707030 learned_addr learned my addr 172.21.15.67:0/1701707030 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a1effd700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a20070520 0x7f9a20119c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a1e7fc700 1 -- 172.21.15.67:0/1701707030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a20070520 msgr2=0x7f9a20119c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a1e7fc700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a20070520 0x7f9a20119c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a1e7fc700 1 -- 172.21.15.67:0/1701707030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10005040 con 0x7f9a20071c10 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a1e7fc700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 0x7f9a2011a140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9a14002a50 tx=0x7f9a140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a077fe700 1 -- 172.21.15.67:0/1701707030 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a14007cc0 con 0x7f9a20071c10 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a077fe700 1 -- 172.21.15.67:0/1701707030 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a1400f040 con 0x7f9a20071c10 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a077fe700 1 -- 172.21.15.67:0/1701707030 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a14009540 con 0x7f9a20071c10 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.478+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a20113da0 con 0x7f9a20071c10 2023-12-05T09:30:48.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.479+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a201142e0 con 0x7f9a20071c10 2023-12-05T09:30:48.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.480+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a200fe0b0 con 0x7f9a20071c10 2023-12-05T09:30:48.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.481+0000 7f9a077fe700 1 -- 172.21.15.67:0/1701707030 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f9a140096a0 con 0x7f9a20071c10 2023-12-05T09:30:48.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.482+0000 7f9a077fe700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f9a0806cf80 0x7f9a0806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.482+0000 7f9a077fe700 1 -- 172.21.15.67:0/1701707030 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9a1408c410 con 0x7f9a20071c10 2023-12-05T09:30:48.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.483+0000 7f9a1effd700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f9a0806cf80 0x7f9a0806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.483+0000 7f9a1effd700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f9a0806cf80 0x7f9a0806f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009fd0 tx=0x7f9a10009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:48.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.487+0000 7f9a077fe700 1 -- 172.21.15.67:0/1701707030 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9a14059ac0 con 0x7f9a20071c10 2023-12-05T09:30:48.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.717+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a201198d0 con 0x7f9a0806cf80 2023-12-05T09:30:48.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.718+0000 7f9a077fe700 1 -- 172.21.15.67:0/1701707030 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f9a201198d0 con 0x7f9a0806cf80 2023-12-05T09:30:48.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f9a0806cf80 msgr2=0x7f9a0806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f9a0806cf80 0x7f9a0806f430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009fd0 tx=0x7f9a10009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 msgr2=0x7f9a2011a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 0x7f9a2011a140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9a14002a50 tx=0x7f9a140046b0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 shutdown_connections 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a20070520 0x7f9a20119c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f9a0806cf80 0x7f9a0806f430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 --2- 172.21.15.67:0/1701707030 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9a20071c10 0x7f9a2011a140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 >> 172.21.15.67:0/1701707030 conn(0x7f9a200f8790 msgr2=0x7f9a200fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 shutdown_connections 2023-12-05T09:30:48.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.721+0000 7f9a25289700 1 -- 172.21.15.67:0/1701707030 wait complete. 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.859+0000 7f0d9fd16700 1 -- 172.21.15.67:0/1635310686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d98102c00 msgr2=0x7f0d98102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.859+0000 7f0d9fd16700 1 --2- 172.21.15.67:0/1635310686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d98102c00 0x7f0d98102fd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0d94004940 tx=0x7f0d94009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.859+0000 7f0d9fd16700 1 -- 172.21.15.67:0/1635310686 shutdown_connections 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.859+0000 7f0d9fd16700 1 --2- 172.21.15.67:0/1635310686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d981035a0 0x7f0d980fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.859+0000 7f0d9fd16700 1 --2- 172.21.15.67:0/1635310686 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d98102c00 0x7f0d98102fd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.859+0000 7f0d9fd16700 1 -- 172.21.15.67:0/1635310686 >> 172.21.15.67:0/1635310686 conn(0x7f0d980f8790 msgr2=0x7f0d980faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.859+0000 7f0d9fd16700 1 -- 172.21.15.67:0/1635310686 shutdown_connections 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.859+0000 7f0d9fd16700 1 -- 172.21.15.67:0/1635310686 wait complete. 2023-12-05T09:30:48.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.860+0000 7f0d9fd16700 1 Processor -- start 2023-12-05T09:30:48.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.860+0000 7f0d9fd16700 1 -- start start 2023-12-05T09:30:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9fd16700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 0x7f0d98115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9fd16700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d981035a0 0x7f0d98115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9fd16700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d981163b0 con 0x7f0d981035a0 2023-12-05T09:30:48.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9fd16700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9810f6e0 con 0x7f0d98102c00 2023-12-05T09:30:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9d2b1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d981035a0 0x7f0d98115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9d2b1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d981035a0 0x7f0d98115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42326/0 (socket says 172.21.15.67:42326) 2023-12-05T09:30:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9d2b1700 1 -- 172.21.15.67:0/585833909 learned_addr learned my addr 172.21.15.67:0/585833909 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9dab2700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 0x7f0d98115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9dab2700 1 -- 172.21.15.67:0/585833909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 msgr2=0x7f0d98115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-05T09:30:48.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9dab2700 1 -- 172.21.15.67:0/585833909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 msgr2=0x7f0d98115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:30:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9dab2700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 0x7f0d98115820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:30:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.861+0000 7f0d9dab2700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 0x7f0d98115820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:30:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d9d2b1700 1 -- 172.21.15.67:0/585833909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 msgr2=0x7f0d98115820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:30:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d9d2b1700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 0x7f0d98115820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d9d2b1700 1 -- 172.21.15.67:0/585833909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d94005040 con 0x7f0d981035a0 2023-12-05T09:30:48.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d9d2b1700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d981035a0 0x7f0d98115d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d88002a80 tx=0x7f0d88004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:48.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d8e7fc700 1 -- 172.21.15.67:0/585833909 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d88007cc0 con 0x7f0d981035a0 2023-12-05T09:30:48.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d8e7fc700 1 -- 172.21.15.67:0/585833909 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d8800f040 con 0x7f0d981035a0 2023-12-05T09:30:48.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9810f9c0 con 0x7f0d981035a0 2023-12-05T09:30:48.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d8e7fc700 1 -- 172.21.15.67:0/585833909 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d8800da30 con 0x7f0d981035a0 2023-12-05T09:30:48.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.862+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9810ff00 con 0x7f0d981035a0 2023-12-05T09:30:48.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.863+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d980fc390 con 0x7f0d981035a0 2023-12-05T09:30:48.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.864+0000 7f0d8e7fc700 1 -- 172.21.15.67:0/585833909 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f0d8800dbd0 con 0x7f0d981035a0 2023-12-05T09:30:48.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.865+0000 7f0d8e7fc700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f0d8406cf80 0x7f0d8406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:48.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.865+0000 7f0d8e7fc700 1 -- 172.21.15.67:0/585833909 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0d8808bd00 con 0x7f0d981035a0 2023-12-05T09:30:48.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.865+0000 7f0d9dab2700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f0d8406cf80 0x7f0d8406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:48.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.866+0000 7f0d9dab2700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f0d8406cf80 0x7f0d8406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400b3b0 tx=0x7f0d94009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:48.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:48.870+0000 7f0d8e7fc700 1 -- 172.21.15.67:0/585833909 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0d880593b0 con 0x7f0d981035a0 2023-12-05T09:30:49.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.092+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d981154f0 con 0x7f0d8406cf80 2023-12-05T09:30:49.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.103+0000 7f0d8e7fc700 1 -- 172.21.15.67:0/585833909 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0d981154f0 con 0x7f0d8406cf80 2023-12-05T09:30:49.102 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:30:49.102 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (117s) 13s ago 11m 15.9M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:30:49.102 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (12m) 13s ago 12m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 76ace55a50ec 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (11m) 15s ago 11m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (102s) 13s ago 11m 78.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (7m) 13s ago 7m 6295M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (7m) 13s ago 7m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (7m) 15s ago 7m 14.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (7m) 15s ago 7m 15.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (3m) 13s ago 13m 485M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (2m) 15s ago 11m 449M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (29s) 13s ago 13m 33.9M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 starting - - - 2048M 2023-12-05T09:30:49.103 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (2m) 13s ago 12m 8150k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:30:49.104 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 15s ago 11m 8363k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:30:49.104 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (10m) 13s ago 10m 790M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:30:49.104 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (9m) 13s ago 9m 855M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:30:49.104 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (9m) 13s ago 9m 660M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:30:49.104 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (9m) 15s ago 9m 1031M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:30:49.104 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (8m) 15s ago 8m 776M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:30:49.104 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (8m) 15s ago 8m 873M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:30:49.104 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (2m) 13s ago 11m 48.7M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f0d8406cf80 msgr2=0x7f0d8406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f0d8406cf80 0x7f0d8406f430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400b3b0 tx=0x7f0d94009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d981035a0 msgr2=0x7f0d98115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d981035a0 0x7f0d98115d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d88002a80 tx=0x7f0d88004630 comp rx=0 tx=0).stop 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 shutdown_connections 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d98102c00 0x7f0d98115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f0d8406cf80 0x7f0d8406f430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 --2- 172.21.15.67:0/585833909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0d981035a0 0x7f0d98115d60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.105+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 >> 172.21.15.67:0/585833909 conn(0x7f0d980f8790 msgr2=0x7f0d980fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:49.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.106+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 shutdown_connections 2023-12-05T09:30:49.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.106+0000 7f0d9fd16700 1 -- 172.21.15.67:0/585833909 wait complete. 2023-12-05T09:30:49.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: overall HEALTH_OK 2023-12-05T09:30:49.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:30:49.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: mon.smithi134 calling monitor election 2023-12-05T09:30:49.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: mon.smithi067 calling monitor election 2023-12-05T09:30:49.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:30:49.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: mon.smithi067 is new leader, mons smithi067,smithi134 in quorum (ranks 0,1) 2023-12-05T09:30:49.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: monmap e3: 2 mons at {smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:30:49.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:30:49.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: osdmap e51: 6 total, 6 up, 6 in 2023-12-05T09:30:49.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: mgrmap e38: smithi067.alxtvv(active, since 16s), standbys: smithi134.yfqkak 2023-12-05T09:30:49.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: overall HEALTH_OK 2023-12-05T09:30:49.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:49.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:49.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:48 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:49.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: overall HEALTH_OK 2023-12-05T09:30:49.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2023-12-05T09:30:49.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: mon.smithi134 calling monitor election 2023-12-05T09:30:49.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: mon.smithi067 calling monitor election 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: mon.smithi067 is new leader, mons smithi067,smithi134 in quorum (ranks 0,1) 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: monmap e3: 2 mons at {smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: fsmap cephfs:2 {0=cephfs.smithi067.kyspon=up:active,1=cephfs.smithi067.qaibsa=up:active} 2 up:standby 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: osdmap e51: 6 total, 6 up, 6 in 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: mgrmap e38: smithi067.alxtvv(active, since 16s), standbys: smithi134.yfqkak 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: overall HEALTH_OK 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:49.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:48 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:30:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.243+0000 7fc1e754e700 1 -- 172.21.15.67:0/770304941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e01035a0 msgr2=0x7fc1e00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.243+0000 7fc1e754e700 1 --2- 172.21.15.67:0/770304941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e01035a0 0x7fc1e00fcc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0004940 tx=0x7fc1d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.243+0000 7fc1e754e700 1 -- 172.21.15.67:0/770304941 shutdown_connections 2023-12-05T09:30:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.243+0000 7fc1e754e700 1 --2- 172.21.15.67:0/770304941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e01035a0 0x7fc1e00fcc10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.243+0000 7fc1e754e700 1 --2- 172.21.15.67:0/770304941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e0102c00 0x7fc1e0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.243+0000 7fc1e754e700 1 -- 172.21.15.67:0/770304941 >> 172.21.15.67:0/770304941 conn(0x7fc1e00f8790 msgr2=0x7fc1e00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:49.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.243+0000 7fc1e754e700 1 -- 172.21.15.67:0/770304941 shutdown_connections 2023-12-05T09:30:49.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.243+0000 7fc1e754e700 1 -- 172.21.15.67:0/770304941 wait complete. 2023-12-05T09:30:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.244+0000 7fc1e754e700 1 Processor -- start 2023-12-05T09:30:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.244+0000 7fc1e754e700 1 -- start start 2023-12-05T09:30:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.244+0000 7fc1e754e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e0102c00 0x7fc1e006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.244+0000 7fc1e754e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 0x7fc1e00704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.244+0000 7fc1e754e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0070af0 con 0x7fc1e0102c00 2023-12-05T09:30:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.244+0000 7fc1e754e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0070c60 con 0x7fc1e01035a0 2023-12-05T09:30:49.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e52ea700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e0102c00 0x7fc1e006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e52ea700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e0102c00 0x7fc1e006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42346/0 (socket says 172.21.15.67:42346) 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e52ea700 1 -- 172.21.15.67:0/761722012 learned_addr learned my addr 172.21.15.67:0/761722012 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e4ae9700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 0x7fc1e00704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e4ae9700 1 -- 172.21.15.67:0/761722012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 msgr2=0x7fc1e00704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e4ae9700 1 -- 172.21.15.67:0/761722012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 msgr2=0x7fc1e00704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e4ae9700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 0x7fc1e00704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e4ae9700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 0x7fc1e00704a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e52ea700 1 -- 172.21.15.67:0/761722012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 msgr2=0x7fc1e00704a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e52ea700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 0x7fc1e00704a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e52ea700 1 -- 172.21.15.67:0/761722012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0005040 con 0x7fc1e0102c00 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1e52ea700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e0102c00 0x7fc1e006ff40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc002a50 tx=0x7fc1dc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.245+0000 7fc1d5ffb700 1 -- 172.21.15.67:0/761722012 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc007cc0 con 0x7fc1e0102c00 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.246+0000 7fc1d5ffb700 1 -- 172.21.15.67:0/761722012 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1dc00f040 con 0x7fc1e0102c00 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.246+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e0119880 con 0x7fc1e0102c00 2023-12-05T09:30:49.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.246+0000 7fc1d5ffb700 1 -- 172.21.15.67:0/761722012 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1dc009540 con 0x7fc1e0102c00 2023-12-05T09:30:49.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.246+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e0119dc0 con 0x7fc1e0102c00 2023-12-05T09:30:49.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.247+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e01050d0 con 0x7fc1e0102c00 2023-12-05T09:30:49.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.248+0000 7fc1d5ffb700 1 -- 172.21.15.67:0/761722012 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fc1dc0096a0 con 0x7fc1e0102c00 2023-12-05T09:30:49.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.249+0000 7fc1d5ffb700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1cc06cf80 0x7fc1cc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:49.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.249+0000 7fc1d5ffb700 1 -- 172.21.15.67:0/761722012 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc1dc08c260 con 0x7fc1e0102c00 2023-12-05T09:30:49.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.249+0000 7fc1e4ae9700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1cc06cf80 0x7fc1cc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:49.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.250+0000 7fc1e4ae9700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1cc06cf80 0x7fc1cc06f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009fd0 tx=0x7fc1d0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:49.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.254+0000 7fc1d5ffb700 1 -- 172.21.15.67:0/761722012 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc1dc055fa0 con 0x7fc1e0102c00 2023-12-05T09:30:49.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.550+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc1e00fc390 con 0x7fc1e0102c00 2023-12-05T09:30:49.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.551+0000 7fc1d5ffb700 1 -- 172.21.15.67:0/761722012 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7fc1dc0595c0 con 0x7fc1e0102c00 2023-12-05T09:30:49.550 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:30:49.550 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:30:49.550 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:30:49.550 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:30:49.550 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:30:49.551 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:30:49.551 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:30:49.551 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:30:49.551 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:30:49.551 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:30:49.551 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:30:49.551 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:30:49.552 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:30:49.552 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:30:49.552 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 10, 2023-12-05T09:30:49.552 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 4 2023-12-05T09:30:49.552 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:30:49.552 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:30:49.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1cc06cf80 msgr2=0x7fc1cc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:49.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1cc06cf80 0x7fc1cc06f430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009fd0 tx=0x7fc1d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:49.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e0102c00 msgr2=0x7fc1e006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:49.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e0102c00 0x7fc1e006ff40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc002a50 tx=0x7fc1dc0046b0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 shutdown_connections 2023-12-05T09:30:49.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1cc06cf80 0x7fc1cc06f430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1e0102c00 0x7fc1e006ff40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 --2- 172.21.15.67:0/761722012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1e01035a0 0x7fc1e00704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 >> 172.21.15.67:0/761722012 conn(0x7fc1e00f8790 msgr2=0x7fc1e00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:49.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 shutdown_connections 2023-12-05T09:30:49.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.553+0000 7fc1e754e700 1 -- 172.21.15.67:0/761722012 wait complete. 2023-12-05T09:30:49.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.692+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2016226349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a4102c00 msgr2=0x7fc5a4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:49.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.692+0000 7fc5a8a2a700 1 --2- 172.21.15.67:0/2016226349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a4102c00 0x7fc5a4102fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc594004940 tx=0x7fc594009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:49.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.692+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2016226349 shutdown_connections 2023-12-05T09:30:49.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.692+0000 7fc5a8a2a700 1 --2- 172.21.15.67:0/2016226349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a41035a0 0x7fc5a40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.692+0000 7fc5a8a2a700 1 --2- 172.21.15.67:0/2016226349 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a4102c00 0x7fc5a4102fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.692+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2016226349 >> 172.21.15.67:0/2016226349 conn(0x7fc5a40f8790 msgr2=0x7fc5a40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:49.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.692+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2016226349 shutdown_connections 2023-12-05T09:30:49.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.692+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2016226349 wait complete. 2023-12-05T09:30:49.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.693+0000 7fc5a8a2a700 1 Processor -- start 2023-12-05T09:30:49.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.693+0000 7fc5a8a2a700 1 -- start start 2023-12-05T09:30:49.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a8a2a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 0x7fc5a4115820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:49.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a8a2a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a41035a0 0x7fc5a4115d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:49.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a8a2a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a41163b0 con 0x7fc5a41035a0 2023-12-05T09:30:49.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a8a2a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a410f6e0 con 0x7fc5a4102c00 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a1d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a41035a0 0x7fc5a4115d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 0x7fc5a4115820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a1d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a41035a0 0x7fc5a4115d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42356/0 (socket says 172.21.15.67:42356) 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a1d9b700 1 -- 172.21.15.67:0/2912100450 learned_addr learned my addr 172.21.15.67:0/2912100450 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a259c700 1 -- 172.21.15.67:0/2912100450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 msgr2=0x7fc5a4115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a259c700 1 -- 172.21.15.67:0/2912100450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 msgr2=0x7fc5a4115820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a259c700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 0x7fc5a4115820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a259c700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 0x7fc5a4115820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a1d9b700 1 -- 172.21.15.67:0/2912100450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 msgr2=0x7fc5a4115820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a1d9b700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 0x7fc5a4115820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.694+0000 7fc5a1d9b700 1 -- 172.21.15.67:0/2912100450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594005040 con 0x7fc5a41035a0 2023-12-05T09:30:49.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.695+0000 7fc5a1d9b700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a41035a0 0x7fc5a4115d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc598002a80 tx=0x7fc598004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:49.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.696+0000 7fc592ffd700 1 -- 172.21.15.67:0/2912100450 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc598007cc0 con 0x7fc5a41035a0 2023-12-05T09:30:49.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.696+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a410f9c0 con 0x7fc5a41035a0 2023-12-05T09:30:49.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.696+0000 7fc592ffd700 1 -- 172.21.15.67:0/2912100450 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc59800f040 con 0x7fc5a41035a0 2023-12-05T09:30:49.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.696+0000 7fc592ffd700 1 -- 172.21.15.67:0/2912100450 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc59800da60 con 0x7fc5a41035a0 2023-12-05T09:30:49.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.696+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a410ff00 con 0x7fc5a41035a0 2023-12-05T09:30:49.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.698+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a40fc390 con 0x7fc5a41035a0 2023-12-05T09:30:49.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.699+0000 7fc592ffd700 1 -- 172.21.15.67:0/2912100450 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fc59800dbc0 con 0x7fc5a41035a0 2023-12-05T09:30:49.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.699+0000 7fc592ffd700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc58c06cf80 0x7fc58c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:49.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.700+0000 7fc592ffd700 1 -- 172.21.15.67:0/2912100450 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc59808bbf0 con 0x7fc5a41035a0 2023-12-05T09:30:49.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.700+0000 7fc5a259c700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc58c06cf80 0x7fc58c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:49.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.700+0000 7fc5a259c700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc58c06cf80 0x7fc58c06f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc59400b3b0 tx=0x7fc594009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:49.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.705+0000 7fc592ffd700 1 -- 172.21.15.67:0/2912100450 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc598059320 con 0x7fc5a41035a0 2023-12-05T09:30:49.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.960+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc5a4110e00 con 0x7fc5a41035a0 2023-12-05T09:30:49.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.960+0000 7fc592ffd700 1 -- 172.21.15.67:0/2912100450 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1858 (secure 0 0 0) 0x7fc598017760 con 0x7fc5a41035a0 2023-12-05T09:30:49.959 INFO:teuthology.orchestra.run.smithi067.stdout:e20 2023-12-05T09:30:49.959 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 20 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:30:26.034169+0000 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:30:49.960 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:30:49.961 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:30:49.962 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:30:49.962 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2023-12-05T09:30:49.962 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:30:49.962 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:49.962 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:30:49.962 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:30:49.962 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:30:49.963 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:30:49.963 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:49.963 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:30:49.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc58c06cf80 msgr2=0x7fc58c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:49.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc58c06cf80 0x7fc58c06f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc59400b3b0 tx=0x7fc594009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:49.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a41035a0 msgr2=0x7fc5a4115d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:49.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a41035a0 0x7fc5a4115d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc598002a80 tx=0x7fc598004630 comp rx=0 tx=0).stop 2023-12-05T09:30:49.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 shutdown_connections 2023-12-05T09:30:49.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5a4102c00 0x7fc5a4115820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc58c06cf80 0x7fc58c06f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 --2- 172.21.15.67:0/2912100450 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc5a41035a0 0x7fc5a4115d60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:49.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 >> 172.21.15.67:0/2912100450 conn(0x7fc5a40f8790 msgr2=0x7fc5a40fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:49.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 shutdown_connections 2023-12-05T09:30:49.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:49.963+0000 7fc5a8a2a700 1 -- 172.21.15.67:0/2912100450 wait complete. 2023-12-05T09:30:49.965 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 20 2023-12-05T09:30:50.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.103+0000 7fe173fff700 1 -- 172.21.15.67:0/2530116968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 msgr2=0x7fe1740fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:50.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.103+0000 7fe173fff700 1 --2- 172.21.15.67:0/2530116968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 0x7fe1740fce70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe168004940 tx=0x7fe168009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:50.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.103+0000 7fe173fff700 1 -- 172.21.15.67:0/2530116968 shutdown_connections 2023-12-05T09:30:50.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.103+0000 7fe173fff700 1 --2- 172.21.15.67:0/2530116968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 0x7fe1740fce70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.103+0000 7fe173fff700 1 --2- 172.21.15.67:0/2530116968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 0x7fe174102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.103+0000 7fe173fff700 1 -- 172.21.15.67:0/2530116968 >> 172.21.15.67:0/2530116968 conn(0x7fe1740f8560 msgr2=0x7fe1740fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:50.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.103+0000 7fe173fff700 1 -- 172.21.15.67:0/2530116968 shutdown_connections 2023-12-05T09:30:50.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.103+0000 7fe173fff700 1 -- 172.21.15.67:0/2530116968 wait complete. 2023-12-05T09:30:50.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.104+0000 7fe173fff700 1 Processor -- start 2023-12-05T09:30:50.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.104+0000 7fe173fff700 1 -- start start 2023-12-05T09:30:50.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.104+0000 7fe173fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 0x7fe1741133e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:50.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.104+0000 7fe173fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 0x7fe174113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:50.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe173fff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174113f70 con 0x7fe1740fca00 2023-12-05T09:30:50.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe173fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17410d280 con 0x7fe174102a40 2023-12-05T09:30:50.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe172ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 0x7fe1741133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe172ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 0x7fe1741133e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42370/0 (socket says 172.21.15.67:42370) 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe172ffd700 1 -- 172.21.15.67:0/3141082985 learned_addr learned my addr 172.21.15.67:0/3141082985 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe1727fc700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 0x7fe174113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe1727fc700 1 -- 172.21.15.67:0/3141082985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 msgr2=0x7fe174113920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe1727fc700 1 -- 172.21.15.67:0/3141082985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 msgr2=0x7fe174113920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe1727fc700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 0x7fe174113920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe1727fc700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 0x7fe174113920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe172ffd700 1 -- 172.21.15.67:0/3141082985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 msgr2=0x7fe174113920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe172ffd700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 0x7fe174113920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe172ffd700 1 -- 172.21.15.67:0/3141082985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168005040 con 0x7fe1740fca00 2023-12-05T09:30:50.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.105+0000 7fe172ffd700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 0x7fe1741133e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe164002a50 tx=0x7fe1640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:50.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.106+0000 7fe15b7fe700 1 -- 172.21.15.67:0/3141082985 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe164007cc0 con 0x7fe1740fca00 2023-12-05T09:30:50.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.106+0000 7fe15b7fe700 1 -- 172.21.15.67:0/3141082985 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe16400f040 con 0x7fe1740fca00 2023-12-05T09:30:50.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.106+0000 7fe15b7fe700 1 -- 172.21.15.67:0/3141082985 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe164009540 con 0x7fe1740fca00 2023-12-05T09:30:50.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.106+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17410d560 con 0x7fe1740fca00 2023-12-05T09:30:50.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.106+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17410db20 con 0x7fe1740fca00 2023-12-05T09:30:50.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.107+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe174104ec0 con 0x7fe1740fca00 2023-12-05T09:30:50.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.108+0000 7fe15b7fe700 1 -- 172.21.15.67:0/3141082985 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fe1640096a0 con 0x7fe1740fca00 2023-12-05T09:30:50.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.109+0000 7fe15b7fe700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe15c06cf80 0x7fe15c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:50.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.109+0000 7fe15b7fe700 1 -- 172.21.15.67:0/3141082985 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe16408c260 con 0x7fe1740fca00 2023-12-05T09:30:50.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.109+0000 7fe1727fc700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe15c06cf80 0x7fe15c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:50.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.110+0000 7fe1727fc700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe15c06cf80 0x7fe15c06f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe17410ec80 tx=0x7fe168009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:50.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.113+0000 7fe15b7fe700 1 -- 172.21.15.67:0/3141082985 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe164059a30 con 0x7fe1740fca00 2023-12-05T09:30:50.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:49 smithi067 ceph-mon[210894]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:50.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:49 smithi067 ceph-mon[210894]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:50.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:49 smithi067 ceph-mon[210894]: pgmap v12: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T09:30:50.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:49 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/761722012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:30:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:49 smithi134 ceph-mon[172895]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:49 smithi134 ceph-mon[172895]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:49 smithi134 ceph-mon[172895]: pgmap v12: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2023-12-05T09:30:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:49 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/761722012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:30:50.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.343+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe17410e9c0 con 0x7fe15c06cf80 2023-12-05T09:30:50.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.344+0000 7fe15b7fe700 1 -- 172.21.15.67:0/3141082985 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fe17410e9c0 con 0x7fe15c06cf80 2023-12-05T09:30:50.343 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:30:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:30:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:30:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:30:50.343 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:30:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr" 2023-12-05T09:30:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:30:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "3/21 daemons upgraded", 2023-12-05T09:30:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading mon daemons", 2023-12-05T09:30:50.344 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:30:50.344 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:30:50.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.346+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe15c06cf80 msgr2=0x7fe15c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:50.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.346+0000 7fe173fff700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe15c06cf80 0x7fe15c06f430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe17410ec80 tx=0x7fe168009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:50.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.346+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 msgr2=0x7fe1741133e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:50.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.346+0000 7fe173fff700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 0x7fe1741133e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe164002a50 tx=0x7fe1640046b0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.347+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 shutdown_connections 2023-12-05T09:30:50.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.347+0000 7fe173fff700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe15c06cf80 0x7fe15c06f430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.347+0000 7fe173fff700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe1740fca00 0x7fe1741133e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.347+0000 7fe173fff700 1 --2- 172.21.15.67:0/3141082985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe174102a40 0x7fe174113920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.347+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 >> 172.21.15.67:0/3141082985 conn(0x7fe1740f8560 msgr2=0x7fe1740fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:50.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.347+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 shutdown_connections 2023-12-05T09:30:50.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.347+0000 7fe173fff700 1 -- 172.21.15.67:0/3141082985 wait complete. 2023-12-05T09:30:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.486+0000 7f9113b44700 1 -- 172.21.15.67:0/3509574813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 msgr2=0x7f910c108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.486+0000 7f9113b44700 1 --2- 172.21.15.67:0/3509574813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 0x7f910c108f10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f90fc004970 tx=0x7f90fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:50.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.486+0000 7f9113b44700 1 -- 172.21.15.67:0/3509574813 shutdown_connections 2023-12-05T09:30:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.486+0000 7f9113b44700 1 --2- 172.21.15.67:0/3509574813 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 0x7f910c108f10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.486+0000 7f9113b44700 1 --2- 172.21.15.67:0/3509574813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 0x7f910c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.486+0000 7f9113b44700 1 -- 172.21.15.67:0/3509574813 >> 172.21.15.67:0/3509574813 conn(0x7f910c0f8790 msgr2=0x7f910c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.487+0000 7f9113b44700 1 -- 172.21.15.67:0/3509574813 shutdown_connections 2023-12-05T09:30:50.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.487+0000 7f9113b44700 1 -- 172.21.15.67:0/3509574813 wait complete. 2023-12-05T09:30:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.487+0000 7f9113b44700 1 Processor -- start 2023-12-05T09:30:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f9113b44700 1 -- start start 2023-12-05T09:30:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f9113b44700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 0x7f910c115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:50.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f9113b44700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 0x7f910c115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f9113b44700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c1163e0 con 0x7f910c0708f0 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f9113b44700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c10f710 con 0x7f910c06ffe0 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f91110df700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 0x7f910c115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f91118e0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 0x7f910c115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f91110df700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 0x7f910c115d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42394/0 (socket says 172.21.15.67:42394) 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.488+0000 7f91110df700 1 -- 172.21.15.67:0/643377327 learned_addr learned my addr 172.21.15.67:0/643377327 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91118e0700 1 -- 172.21.15.67:0/643377327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 msgr2=0x7f910c115850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91118e0700 1 -- 172.21.15.67:0/643377327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 msgr2=0x7f910c115850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91118e0700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 0x7f910c115850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91118e0700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 0x7f910c115850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91110df700 1 -- 172.21.15.67:0/643377327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 msgr2=0x7f910c115850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91110df700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 0x7f910c115850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91110df700 1 -- 172.21.15.67:0/643377327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc005040 con 0x7f910c0708f0 2023-12-05T09:30:50.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91110df700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 0x7f910c115d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90fc004f50 tx=0x7f90fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91027fc700 1 -- 172.21.15.67:0/643377327 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90fc00e040 con 0x7f910c0708f0 2023-12-05T09:30:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91027fc700 1 -- 172.21.15.67:0/643377327 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f90fc00bc10 con 0x7f910c0708f0 2023-12-05T09:30:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c10f990 con 0x7f910c0708f0 2023-12-05T09:30:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f91027fc700 1 -- 172.21.15.67:0/643377327 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90fc01c3f0 con 0x7f910c0708f0 2023-12-05T09:30:50.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.489+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c10fed0 con 0x7f910c0708f0 2023-12-05T09:30:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.491+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910c1065d0 con 0x7f910c0708f0 2023-12-05T09:30:50.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.491+0000 7f91027fc700 1 -- 172.21.15.67:0/643377327 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f90fc013420 con 0x7f910c0708f0 2023-12-05T09:30:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.492+0000 7f91027fc700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f90f806cf80 0x7f90f806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:30:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.493+0000 7f91027fc700 1 -- 172.21.15.67:0/643377327 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f90fc08d9f0 con 0x7f910c0708f0 2023-12-05T09:30:50.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.493+0000 7f91118e0700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f90f806cf80 0x7f90f806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:30:50.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.494+0000 7f91118e0700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f90f806cf80 0x7f90f806f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9108009ce0 tx=0x7f9108009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:30:50.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.498+0000 7f91027fc700 1 -- 172.21.15.67:0/643377327 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f90fc08fe60 con 0x7f910c0708f0 2023-12-05T09:30:50.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.794+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f910c110e90 con 0x7f910c0708f0 2023-12-05T09:30:50.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.794+0000 7f91027fc700 1 -- 172.21.15.67:0/643377327 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f90fc08fe60 con 0x7f910c0708f0 2023-12-05T09:30:50.793 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_OK 2023-12-05T09:30:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f90f806cf80 msgr2=0x7f90f806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f90f806cf80 0x7f90f806f430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9108009ce0 tx=0x7f9108009f70 comp rx=0 tx=0).stop 2023-12-05T09:30:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 msgr2=0x7f910c115d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:30:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 0x7f910c115d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90fc004f50 tx=0x7f90fc009e30 comp rx=0 tx=0).stop 2023-12-05T09:30:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 shutdown_connections 2023-12-05T09:30:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f910c06ffe0 0x7f910c115850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f90f806cf80 0x7f90f806f430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 --2- 172.21.15.67:0/643377327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f910c0708f0 0x7f910c115d90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:30:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.796+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 >> 172.21.15.67:0/643377327 conn(0x7f910c0f8790 msgr2=0x7f910c103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:30:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.797+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 shutdown_connections 2023-12-05T09:30:50.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:30:50.797+0000 7f9113b44700 1 -- 172.21.15.67:0/643377327 wait complete. 2023-12-05T09:30:51.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:50 smithi067 ceph-mon[210894]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:51.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:50 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/2912100450' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:30:51.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:50 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:51.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:50 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:51.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:50 smithi134 ceph-mon[172895]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:51.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:50 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/2912100450' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:30:51.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:50 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:51.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:50 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:52.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:51 smithi067 ceph-mon[210894]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:52.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:51 smithi067 ceph-mon[210894]: pgmap v13: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:52.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:51 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/643377327' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:30:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:51 smithi134 ceph-mon[172895]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:30:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:51 smithi134 ceph-mon[172895]: pgmap v13: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:51 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/643377327' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:30:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:53.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:53 smithi134 ceph-mon[172895]: pgmap v14: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:53.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:53 smithi067 ceph-mon[210894]: pgmap v14: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: pgmap v15: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:56.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:30:56.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:56.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:30:56.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:30:56.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: pgmap v15: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:30:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:30:56.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:30:56.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:56 smithi067 ceph-mon[210894]: Detected new or changed devices on smithi134 2023-12-05T09:30:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:56 smithi067 ceph-mon[210894]: Reconfiguring mon.smithi067 (monmap changed)... 2023-12-05T09:30:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:56 smithi067 ceph-mon[210894]: Reconfiguring daemon mon.smithi067 on smithi067 2023-12-05T09:30:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:56 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:56 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:56 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.alxtvv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:30:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:56 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:30:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:56 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:56 smithi134 ceph-mon[172895]: Detected new or changed devices on smithi134 2023-12-05T09:30:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:56 smithi134 ceph-mon[172895]: Reconfiguring mon.smithi067 (monmap changed)... 2023-12-05T09:30:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:56 smithi134 ceph-mon[172895]: Reconfiguring daemon mon.smithi067 on smithi067 2023-12-05T09:30:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:56 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:56 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:56 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.alxtvv", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:30:57.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:56 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:30:57.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:56 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:57 smithi067 ceph-mon[210894]: Reconfiguring mgr.smithi067.alxtvv (monmap changed)... 2023-12-05T09:30:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:57 smithi067 ceph-mon[210894]: Reconfiguring daemon mgr.smithi067.alxtvv on smithi067 2023-12-05T09:30:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:57 smithi067 ceph-mon[210894]: pgmap v16: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:57 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:57 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:58.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:57 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:30:58.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:57 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:57 smithi134 ceph-mon[172895]: Reconfiguring mgr.smithi067.alxtvv (monmap changed)... 2023-12-05T09:30:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:57 smithi134 ceph-mon[172895]: Reconfiguring daemon mgr.smithi067.alxtvv on smithi067 2023-12-05T09:30:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:57 smithi134 ceph-mon[172895]: pgmap v16: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:30:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:57 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:58.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:57 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:58.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:57 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:30:58.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:57 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:30:58.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:58 smithi067 ceph-mon[210894]: Reconfiguring crash.smithi067 (monmap changed)... 2023-12-05T09:30:58.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:58 smithi067 ceph-mon[210894]: Reconfiguring daemon crash.smithi067 on smithi067 2023-12-05T09:30:58.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:58 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:30:59.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:58 smithi134 ceph-mon[172895]: Reconfiguring crash.smithi067 (monmap changed)... 2023-12-05T09:30:59.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:58 smithi134 ceph-mon[172895]: Reconfiguring daemon crash.smithi067 on smithi067 2023-12-05T09:30:59.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:58 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:00.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:59 smithi067 ceph-mon[210894]: pgmap v17: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:00.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:00.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:59 smithi067 ceph-mon[210894]: Reconfiguring osd.0 (monmap changed)... 2023-12-05T09:31:00.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:31:00.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:00.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:30:59 smithi067 ceph-mon[210894]: Reconfiguring daemon osd.0 on smithi067 2023-12-05T09:31:00.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:59 smithi134 ceph-mon[172895]: pgmap v17: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:00.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:00.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:59 smithi134 ceph-mon[172895]: Reconfiguring osd.0 (monmap changed)... 2023-12-05T09:31:00.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:31:00.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:00.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:30:59 smithi134 ceph-mon[172895]: Reconfiguring daemon osd.0 on smithi067 2023-12-05T09:31:01.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:01.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:01.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:01 smithi067 ceph-mon[210894]: Reconfiguring osd.1 (monmap changed)... 2023-12-05T09:31:01.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:31:01.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:01.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:01 smithi067 ceph-mon[210894]: Reconfiguring daemon osd.1 on smithi067 2023-12-05T09:31:01.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:01 smithi067 ceph-mon[210894]: pgmap v18: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:01.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:31:01.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:01.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:01.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:01 smithi134 ceph-mon[172895]: Reconfiguring osd.1 (monmap changed)... 2023-12-05T09:31:01.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:31:01.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:01.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:01 smithi134 ceph-mon[172895]: Reconfiguring daemon osd.1 on smithi067 2023-12-05T09:31:01.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:01 smithi134 ceph-mon[172895]: pgmap v18: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:01.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:31:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:02 smithi067 ceph-mon[210894]: Reconfiguring osd.2 (monmap changed)... 2023-12-05T09:31:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:31:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:02 smithi067 ceph-mon[210894]: Reconfiguring daemon osd.2 on smithi067 2023-12-05T09:31:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:02 smithi134 ceph-mon[172895]: Reconfiguring osd.2 (monmap changed)... 2023-12-05T09:31:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:31:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:02 smithi134 ceph-mon[172895]: Reconfiguring daemon osd.2 on smithi067 2023-12-05T09:31:04.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:03 smithi067 ceph-mon[210894]: pgmap v19: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:04.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:03 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:04.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:03 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:04.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:03 smithi067 ceph-mon[210894]: Reconfiguring mds.cephfs.smithi067.kyspon (monmap changed)... 2023-12-05T09:31:04.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:03 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.kyspon", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:31:04.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:03 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:04.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:03 smithi067 ceph-mon[210894]: Reconfiguring daemon mds.cephfs.smithi067.kyspon on smithi067 2023-12-05T09:31:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:03 smithi134 ceph-mon[172895]: pgmap v19: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:03 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:03 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:03 smithi134 ceph-mon[172895]: Reconfiguring mds.cephfs.smithi067.kyspon (monmap changed)... 2023-12-05T09:31:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:03 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.kyspon", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:31:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:03 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:03 smithi134 ceph-mon[172895]: Reconfiguring daemon mds.cephfs.smithi067.kyspon on smithi067 2023-12-05T09:31:05.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:04 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:05.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:04 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:05.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:04 smithi067 ceph-mon[210894]: Reconfiguring mds.cephfs.smithi067.qaibsa (monmap changed)... 2023-12-05T09:31:05.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:04 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.qaibsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:31:05.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:04 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:05.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:04 smithi067 ceph-mon[210894]: Reconfiguring daemon mds.cephfs.smithi067.qaibsa on smithi067 2023-12-05T09:31:05.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:04 smithi067 ceph-mon[210894]: pgmap v20: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:05.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:04 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:05.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:04 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:05.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:04 smithi134 ceph-mon[172895]: Reconfiguring mds.cephfs.smithi067.qaibsa (monmap changed)... 2023-12-05T09:31:05.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:04 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi067.qaibsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:31:05.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:04 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:05.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:04 smithi134 ceph-mon[172895]: Reconfiguring daemon mds.cephfs.smithi067.qaibsa on smithi067 2023-12-05T09:31:05.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:04 smithi134 ceph-mon[172895]: pgmap v20: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:06.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:06 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:06.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:06 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:06.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:06 smithi134 ceph-mon[172895]: Reconfiguring crash.smithi134 (monmap changed)... 2023-12-05T09:31:06.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:06 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:31:06.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:06 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:06.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:06 smithi134 ceph-mon[172895]: Reconfiguring daemon crash.smithi134 on smithi134 2023-12-05T09:31:06.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:06 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:06.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:06 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:06.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:06 smithi067 ceph-mon[210894]: Reconfiguring crash.smithi134 (monmap changed)... 2023-12-05T09:31:06.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:06 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:31:06.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:06 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:06.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:06 smithi067 ceph-mon[210894]: Reconfiguring daemon crash.smithi134 on smithi134 2023-12-05T09:31:07.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:07 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:07.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:07 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:07.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:07 smithi067 ceph-mon[210894]: Reconfiguring mgr.smithi134.yfqkak (monmap changed)... 2023-12-05T09:31:07.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:07 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:31:07.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:07 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:31:07.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:07 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:07.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:07 smithi067 ceph-mon[210894]: Reconfiguring daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:31:07.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:07 smithi067 ceph-mon[210894]: pgmap v21: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:07.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:07 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:07.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:07 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:07.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:07 smithi134 ceph-mon[172895]: Reconfiguring mgr.smithi134.yfqkak (monmap changed)... 2023-12-05T09:31:07.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:07 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.yfqkak", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-05T09:31:07.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:07 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-05T09:31:07.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:07 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:07.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:07 smithi134 ceph-mon[172895]: Reconfiguring daemon mgr.smithi134.yfqkak on smithi134 2023-12-05T09:31:07.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:07 smithi134 ceph-mon[172895]: pgmap v21: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:08.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:08 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:08 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:08 smithi067 ceph-mon[210894]: Reconfiguring mon.smithi134 (monmap changed)... 2023-12-05T09:31:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:08 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:31:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:08 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:31:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:08 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:08.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:08 smithi067 ceph-mon[210894]: Reconfiguring daemon mon.smithi134 on smithi134 2023-12-05T09:31:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:08 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:08 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:08 smithi134 ceph-mon[172895]: Reconfiguring mon.smithi134 (monmap changed)... 2023-12-05T09:31:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:08 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-05T09:31:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:08 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-05T09:31:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:08 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:08 smithi134 ceph-mon[172895]: Reconfiguring daemon mon.smithi134 on smithi134 2023-12-05T09:31:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:09 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:09 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:09 smithi134 ceph-mon[172895]: Reconfiguring osd.3 (monmap changed)... 2023-12-05T09:31:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:09 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:31:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:09 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:09 smithi134 ceph-mon[172895]: Reconfiguring daemon osd.3 on smithi134 2023-12-05T09:31:09.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:09 smithi134 ceph-mon[172895]: pgmap v22: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:10.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:09 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:10.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:09 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:10.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:09 smithi067 ceph-mon[210894]: Reconfiguring osd.3 (monmap changed)... 2023-12-05T09:31:10.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:09 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:31:10.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:09 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:10.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:09 smithi067 ceph-mon[210894]: Reconfiguring daemon osd.3 on smithi134 2023-12-05T09:31:10.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:09 smithi067 ceph-mon[210894]: pgmap v22: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:11.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:10 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:11.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:10 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:11.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:10 smithi067 ceph-mon[210894]: Reconfiguring osd.4 (monmap changed)... 2023-12-05T09:31:11.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:10 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:31:11.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:10 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:11.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:10 smithi067 ceph-mon[210894]: Reconfiguring daemon osd.4 on smithi134 2023-12-05T09:31:11.369 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:10 smithi067 ceph-mon[210894]: pgmap v23: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:11.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:10 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:11.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:10 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:11.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:10 smithi134 ceph-mon[172895]: Reconfiguring osd.4 (monmap changed)... 2023-12-05T09:31:11.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:10 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:31:11.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:10 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:11.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:10 smithi134 ceph-mon[172895]: Reconfiguring daemon osd.4 on smithi134 2023-12-05T09:31:11.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:10 smithi134 ceph-mon[172895]: pgmap v23: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:12 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:12 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:12 smithi067 ceph-mon[210894]: Reconfiguring osd.5 (monmap changed)... 2023-12-05T09:31:12.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:12 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:31:12.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:12 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:12.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:12 smithi067 ceph-mon[210894]: Reconfiguring daemon osd.5 on smithi134 2023-12-05T09:31:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:12 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:12 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:12 smithi134 ceph-mon[172895]: Reconfiguring osd.5 (monmap changed)... 2023-12-05T09:31:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:12 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:31:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:12 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:12 smithi134 ceph-mon[172895]: Reconfiguring daemon osd.5 on smithi134 2023-12-05T09:31:13.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:13 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:13.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:13 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:13.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:13 smithi067 ceph-mon[210894]: Reconfiguring mds.cephfs.smithi134.vvbmln (monmap changed)... 2023-12-05T09:31:13.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:13 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vvbmln", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:31:13.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:13 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:13.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:13 smithi067 ceph-mon[210894]: Reconfiguring daemon mds.cephfs.smithi134.vvbmln on smithi134 2023-12-05T09:31:13.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:13 smithi067 ceph-mon[210894]: pgmap v24: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:13 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:13 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:13 smithi134 ceph-mon[172895]: Reconfiguring mds.cephfs.smithi134.vvbmln (monmap changed)... 2023-12-05T09:31:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:13 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vvbmln", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:31:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:13 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:13 smithi134 ceph-mon[172895]: Reconfiguring daemon mds.cephfs.smithi134.vvbmln on smithi134 2023-12-05T09:31:13.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:13 smithi134 ceph-mon[172895]: pgmap v24: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:14.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:14 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:14.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:14 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:14.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:14 smithi134 ceph-mon[172895]: Reconfiguring mds.cephfs.smithi134.vmnpaq (monmap changed)... 2023-12-05T09:31:14.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:14 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vmnpaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:31:14.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:14 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:14.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:14 smithi134 ceph-mon[172895]: Reconfiguring daemon mds.cephfs.smithi134.vmnpaq on smithi134 2023-12-05T09:31:15.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:14 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:15.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:14 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:15.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:14 smithi067 ceph-mon[210894]: Reconfiguring mds.cephfs.smithi134.vmnpaq (monmap changed)... 2023-12-05T09:31:15.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:14 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.vmnpaq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-05T09:31:15.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:14 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:15.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:14 smithi067 ceph-mon[210894]: Reconfiguring daemon mds.cephfs.smithi134.vmnpaq on smithi134 2023-12-05T09:31:15.834 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: pgmap v25: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]: dispatch 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]': finished 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2023-12-05T09:31:15.835 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2023-12-05T09:31:16.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: pgmap v25: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:16.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:16.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:16.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:16.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:16.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:16.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:16.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]: dispatch 2023-12-05T09:31:16.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]': finished 2023-12-05T09:31:16.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2023-12-05T09:31:16.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2023-12-05T09:31:16.941 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:16 smithi067 ceph-mon[210894]: Upgrade: Setting container_image for all mon 2023-12-05T09:31:16.941 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:31:16.941 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:16.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:31:16.942 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:16 smithi134 ceph-mon[172895]: Upgrade: Setting container_image for all mon 2023-12-05T09:31:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:31:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:31:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:18.045 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:17 smithi067 ceph-mon[210894]: Upgrade: Updating crash.smithi067 (1/2) 2023-12-05T09:31:18.046 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:17 smithi067 ceph-mon[210894]: Deploying daemon crash.smithi067 on smithi067 2023-12-05T09:31:18.046 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:17 smithi067 ceph-mon[210894]: pgmap v26: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:17 smithi134 ceph-mon[172895]: Upgrade: Updating crash.smithi067 (1/2) 2023-12-05T09:31:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:17 smithi134 ceph-mon[172895]: Deploying daemon crash.smithi067 on smithi067 2023-12-05T09:31:18.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:17 smithi134 ceph-mon[172895]: pgmap v26: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:19.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:19 smithi067 ceph-mon[210894]: pgmap v27: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:19.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:19 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:19.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:19 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:20.075 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:19 smithi134 ceph-mon[172895]: pgmap v27: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:20.076 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:19 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:20.076 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:19 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.953+0000 7f4b41b46700 1 -- 172.21.15.67:0/3625049985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c102c00 msgr2=0x7f4b3c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.953+0000 7f4b41b46700 1 --2- 172.21.15.67:0/3625049985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c102c00 0x7f4b3c102fd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c004940 tx=0x7f4b2c009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.953+0000 7f4b41b46700 1 -- 172.21.15.67:0/3625049985 shutdown_connections 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.953+0000 7f4b41b46700 1 --2- 172.21.15.67:0/3625049985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b3c1035a0 0x7f4b3c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.953+0000 7f4b41b46700 1 --2- 172.21.15.67:0/3625049985 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c102c00 0x7f4b3c102fd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.953+0000 7f4b41b46700 1 -- 172.21.15.67:0/3625049985 >> 172.21.15.67:0/3625049985 conn(0x7f4b3c0f8790 msgr2=0x7f4b3c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.953+0000 7f4b41b46700 1 -- 172.21.15.67:0/3625049985 shutdown_connections 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.953+0000 7f4b41b46700 1 -- 172.21.15.67:0/3625049985 wait complete. 2023-12-05T09:31:20.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.954+0000 7f4b41b46700 1 Processor -- start 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.954+0000 7f4b41b46700 1 -- start start 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.954+0000 7f4b41b46700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b3c102c00 0x7f4b3c1135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.954+0000 7f4b41b46700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c1035a0 0x7f4b3c113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.954+0000 7f4b41b46700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c1141c0 con 0x7f4b3c1035a0 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.954+0000 7f4b41b46700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c10d4b0 con 0x7f4b3c102c00 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.954+0000 7f4b3affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c1035a0 0x7f4b3c113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b3affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c1035a0 0x7f4b3c113b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49786/0 (socket says 172.21.15.67:49786) 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b3b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b3c102c00 0x7f4b3c1135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:20.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b3affd700 1 -- 172.21.15.67:0/1288035171 learned_addr learned my addr 172.21.15.67:0/1288035171 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b3b7fe700 1 -- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c1035a0 msgr2=0x7f4b3c113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b3b7fe700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c1035a0 0x7f4b3c113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b3b7fe700 1 -- 172.21.15.67:0/1288035171 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c005040 con 0x7f4b3c102c00 2023-12-05T09:31:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b3affd700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c1035a0 0x7f4b3c113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-05T09:31:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b3b7fe700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b3c102c00 0x7f4b3c1135f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c000c00 tx=0x7f4b2c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.955+0000 7f4b23fff700 1 -- 172.21.15.67:0/1288035171 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b2c021070 con 0x7f4b3c102c00 2023-12-05T09:31:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.956+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c10d6e0 con 0x7f4b3c102c00 2023-12-05T09:31:20.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.956+0000 7f4b23fff700 1 -- 172.21.15.67:0/1288035171 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b2c01c400 con 0x7f4b3c102c00 2023-12-05T09:31:20.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.956+0000 7f4b23fff700 1 -- 172.21.15.67:0/1288035171 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b2c00e070 con 0x7f4b3c102c00 2023-12-05T09:31:20.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.956+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c10dbc0 con 0x7f4b3c102c00 2023-12-05T09:31:20.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.957+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c0fc390 con 0x7f4b3c102c00 2023-12-05T09:31:20.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.958+0000 7f4b23fff700 1 -- 172.21.15.67:0/1288035171 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f4b2c013a30 con 0x7f4b3c102c00 2023-12-05T09:31:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.959+0000 7f4b23fff700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4b2406cf80 0x7f4b2406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.959+0000 7f4b23fff700 1 -- 172.21.15.67:0/1288035171 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4b2c08d560 con 0x7f4b3c102c00 2023-12-05T09:31:20.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.959+0000 7f4b3affd700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4b2406cf80 0x7f4b2406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:20.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.959+0000 7f4b3affd700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4b2406cf80 0x7f4b2406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c10ee90 tx=0x7f4b3000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:20.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:20.964+0000 7f4b23fff700 1 -- 172.21.15.67:0/1288035171 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4b2c05add0 con 0x7f4b3c102c00 2023-12-05T09:31:21.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.198+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b3c10ece0 con 0x7f4b2406cf80 2023-12-05T09:31:21.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.199+0000 7f4b23fff700 1 -- 172.21.15.67:0/1288035171 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f4b3c10ece0 con 0x7f4b2406cf80 2023-12-05T09:31:21.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4b2406cf80 msgr2=0x7f4b2406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4b2406cf80 0x7f4b2406f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c10ee90 tx=0x7f4b3000b040 comp rx=0 tx=0).stop 2023-12-05T09:31:21.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b3c102c00 msgr2=0x7f4b3c1135f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b3c102c00 0x7f4b3c1135f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c000c00 tx=0x7f4b2c009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 shutdown_connections 2023-12-05T09:31:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b3c102c00 0x7f4b3c1135f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f4b2406cf80 0x7f4b2406f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 --2- 172.21.15.67:0/1288035171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4b3c1035a0 0x7f4b3c113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 >> 172.21.15.67:0/1288035171 conn(0x7f4b3c0f8790 msgr2=0x7f4b3c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 shutdown_connections 2023-12-05T09:31:21.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.202+0000 7f4b41b46700 1 -- 172.21.15.67:0/1288035171 wait complete. 2023-12-05T09:31:21.215 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:31:21.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.342+0000 7f487f40e700 1 -- 172.21.15.67:0/2066519267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878102c00 msgr2=0x7f4878102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.342+0000 7f487f40e700 1 --2- 172.21.15.67:0/2066519267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878102c00 0x7f4878102fd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4874004940 tx=0x7f4874009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.343+0000 7f487f40e700 1 -- 172.21.15.67:0/2066519267 shutdown_connections 2023-12-05T09:31:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.343+0000 7f487f40e700 1 --2- 172.21.15.67:0/2066519267 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f48781035a0 0x7f48780fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.343+0000 7f487f40e700 1 --2- 172.21.15.67:0/2066519267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4878102c00 0x7f4878102fd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.343+0000 7f487f40e700 1 -- 172.21.15.67:0/2066519267 >> 172.21.15.67:0/2066519267 conn(0x7f48780f8790 msgr2=0x7f48780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.343+0000 7f487f40e700 1 -- 172.21.15.67:0/2066519267 shutdown_connections 2023-12-05T09:31:21.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.343+0000 7f487f40e700 1 -- 172.21.15.67:0/2066519267 wait complete. 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.344+0000 7f487f40e700 1 Processor -- start 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.344+0000 7f487f40e700 1 -- start start 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.344+0000 7f487f40e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4878102c00 0x7f4878113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.344+0000 7f487f40e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48781035a0 0x7f4878113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.344+0000 7f487f40e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48781141e0 con 0x7f4878102c00 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.344+0000 7f487f40e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487810d4d0 con 0x7f48781035a0 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.344+0000 7f487d1aa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4878102c00 0x7f4878113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.344+0000 7f487d1aa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4878102c00 0x7f4878113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49796/0 (socket says 172.21.15.67:49796) 2023-12-05T09:31:21.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.345+0000 7f487d1aa700 1 -- 172.21.15.67:0/589573685 learned_addr learned my addr 172.21.15.67:0/589573685 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:21.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.345+0000 7f487c9a9700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48781035a0 0x7f4878113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:21.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.345+0000 7f487d1aa700 1 -- 172.21.15.67:0/589573685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48781035a0 msgr2=0x7f4878113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.345+0000 7f487d1aa700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48781035a0 0x7f4878113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.345+0000 7f487d1aa700 1 -- 172.21.15.67:0/589573685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874005040 con 0x7f4878102c00 2023-12-05T09:31:21.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.345+0000 7f487d1aa700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4878102c00 0x7f4878113610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4874008d80 tx=0x7f4874009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:21.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.345+0000 7f486dffb700 1 -- 172.21.15.67:0/589573685 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487400e030 con 0x7f4878102c00 2023-12-05T09:31:21.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.346+0000 7f486dffb700 1 -- 172.21.15.67:0/589573685 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4874004290 con 0x7f4878102c00 2023-12-05T09:31:21.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.346+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487810d700 con 0x7f4878102c00 2023-12-05T09:31:21.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.346+0000 7f486dffb700 1 -- 172.21.15.67:0/589573685 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487401cda0 con 0x7f4878102c00 2023-12-05T09:31:21.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.346+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487810dc40 con 0x7f4878102c00 2023-12-05T09:31:21.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.347+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48780fff10 con 0x7f4878102c00 2023-12-05T09:31:21.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.348+0000 7f486dffb700 1 -- 172.21.15.67:0/589573685 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f487401c600 con 0x7f4878102c00 2023-12-05T09:31:21.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.349+0000 7f486dffb700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f486406cf80 0x7f486406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:21.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.349+0000 7f486dffb700 1 -- 172.21.15.67:0/589573685 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f487408de20 con 0x7f4878102c00 2023-12-05T09:31:21.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.349+0000 7f487c9a9700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f486406cf80 0x7f486406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:21.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.350+0000 7f487c9a9700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f486406cf80 0x7f486406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f487810eeb0 tx=0x7f486800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:21.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.354+0000 7f486dffb700 1 -- 172.21.15.67:0/589573685 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f487405b5f0 con 0x7f4878102c00 2023-12-05T09:31:21.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.582+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f487810ebf0 con 0x7f486406cf80 2023-12-05T09:31:21.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.583+0000 7f486dffb700 1 -- 172.21.15.67:0/589573685 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f487810ebf0 con 0x7f486406cf80 2023-12-05T09:31:21.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f486406cf80 msgr2=0x7f486406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f486406cf80 0x7f486406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f487810eeb0 tx=0x7f486800b040 comp rx=0 tx=0).stop 2023-12-05T09:31:21.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4878102c00 msgr2=0x7f4878113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4878102c00 0x7f4878113610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4874008d80 tx=0x7f4874009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 shutdown_connections 2023-12-05T09:31:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f486406cf80 0x7f486406f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4878102c00 0x7f4878113610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 --2- 172.21.15.67:0/589573685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48781035a0 0x7f4878113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 >> 172.21.15.67:0/589573685 conn(0x7f48780f8790 msgr2=0x7f48780fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 shutdown_connections 2023-12-05T09:31:21.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.586+0000 7f487f40e700 1 -- 172.21.15.67:0/589573685 wait complete. 2023-12-05T09:31:21.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.725+0000 7f376abb9700 1 -- 172.21.15.67:0/1089887226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 msgr2=0x7f3764102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.725+0000 7f376abb9700 1 --2- 172.21.15.67:0/1089887226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 0x7f3764102fc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3758004940 tx=0x7f3758009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:21.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.725+0000 7f376abb9700 1 -- 172.21.15.67:0/1089887226 shutdown_connections 2023-12-05T09:31:21.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.725+0000 7f376abb9700 1 --2- 172.21.15.67:0/1089887226 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3764103590 0x7f37640fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.725+0000 7f376abb9700 1 --2- 172.21.15.67:0/1089887226 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 0x7f3764102fc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.725+0000 7f376abb9700 1 -- 172.21.15.67:0/1089887226 >> 172.21.15.67:0/1089887226 conn(0x7f37640f87a0 msgr2=0x7f37640fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:21.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.725+0000 7f376abb9700 1 -- 172.21.15.67:0/1089887226 shutdown_connections 2023-12-05T09:31:21.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.725+0000 7f376abb9700 1 -- 172.21.15.67:0/1089887226 wait complete. 2023-12-05T09:31:21.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.726+0000 7f376abb9700 1 Processor -- start 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.726+0000 7f376abb9700 1 -- start start 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f376abb9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 0x7f37641136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f376abb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3764103590 0x7f3764113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f376abb9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764114290 con 0x7f3764102bf0 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f376abb9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376410d580 con 0x7f3764103590 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f3768955700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 0x7f37641136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f3768955700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 0x7f37641136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49818/0 (socket says 172.21.15.67:49818) 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f3768955700 1 -- 172.21.15.67:0/2103474171 learned_addr learned my addr 172.21.15.67:0/2103474171 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f3763fff700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3764103590 0x7f3764113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f3768955700 1 -- 172.21.15.67:0/2103474171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3764103590 msgr2=0x7f3764113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.727+0000 7f3768955700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3764103590 0x7f3764113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.728+0000 7f3768955700 1 -- 172.21.15.67:0/2103474171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758005040 con 0x7f3764102bf0 2023-12-05T09:31:21.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.728+0000 7f3768955700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 0x7f37641136c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3758009fd0 tx=0x7f3758009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:21.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.728+0000 7f37617fa700 1 -- 172.21.15.67:0/2103474171 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3758021070 con 0x7f3764102bf0 2023-12-05T09:31:21.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.728+0000 7f37617fa700 1 -- 172.21.15.67:0/2103474171 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f375801c400 con 0x7f3764102bf0 2023-12-05T09:31:21.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.728+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376410d7b0 con 0x7f3764102bf0 2023-12-05T09:31:21.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.728+0000 7f37617fa700 1 -- 172.21.15.67:0/2103474171 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f375800e070 con 0x7f3764102bf0 2023-12-05T09:31:21.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.728+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376410dc90 con 0x7f3764102bf0 2023-12-05T09:31:21.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.729+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37640fc3a0 con 0x7f3764102bf0 2023-12-05T09:31:21.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.730+0000 7f37617fa700 1 -- 172.21.15.67:0/2103474171 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f375801c570 con 0x7f3764102bf0 2023-12-05T09:31:21.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.731+0000 7f37617fa700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f375406cf80 0x7f375406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:21.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.731+0000 7f37617fa700 1 -- 172.21.15.67:0/2103474171 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f375808d590 con 0x7f3764102bf0 2023-12-05T09:31:21.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.731+0000 7f3763fff700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f375406cf80 0x7f375406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:21.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.732+0000 7f3763fff700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f375406cf80 0x7f375406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f376410ef60 tx=0x7f375000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:21.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.736+0000 7f37617fa700 1 -- 172.21.15.67:0/2103474171 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f375805ae00 con 0x7f3764102bf0 2023-12-05T09:31:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:21 smithi134 ceph-mon[172895]: pgmap v28: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:21 smithi134 ceph-mon[172895]: Upgrade: Updating crash.smithi134 (2/2) 2023-12-05T09:31:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:21 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:21 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:31:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:21 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:21 smithi134 ceph-mon[172895]: Deploying daemon crash.smithi134 on smithi134 2023-12-05T09:31:21.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.956+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f376410eca0 con 0x7f375406cf80 2023-12-05T09:31:21.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.966+0000 7f37617fa700 1 -- 172.21.15.67:0/2103474171 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f376410eca0 con 0x7f375406cf80 2023-12-05T09:31:21.965 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:31:21.965 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (2m) 46s ago 12m 15.9M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:31:21.965 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 starting - - - - 2023-12-05T09:31:21.965 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (11m) 31s ago 11m 7822k - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 9979f648eeec 2023-12-05T09:31:21.965 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (2m) 46s ago 12m 78.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:31:21.965 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (7m) 46s ago 7m 6295M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:31:21.965 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (7m) 46s ago 7m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (7m) 31s ago 7m 15.2M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (7m) 31s ago 7m 15.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (4m) 46s ago 13m 485M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (3m) 31s ago 11m 450M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (61s) 46s ago 14m 33.9M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (35s) 31s ago 11m 28.3M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 c85edd1646d0 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (3m) 46s ago 12m 8150k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 31s ago 11m 8384k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (10m) 46s ago 10m 790M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 5dacd9d5ef00 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (10m) 46s ago 10m 855M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (10m) 46s ago 10m 660M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (9m) 31s ago 9m 1033M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (9m) 31s ago 9m 777M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:31:21.966 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (9m) 31s ago 9m 875M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:31:21.967 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (2m) 46s ago 12m 48.7M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:31:21.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f375406cf80 msgr2=0x7f375406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f375406cf80 0x7f375406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f376410ef60 tx=0x7f375000b040 comp rx=0 tx=0).stop 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 msgr2=0x7f37641136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 0x7f37641136c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3758009fd0 tx=0x7f3758009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 shutdown_connections 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f375406cf80 0x7f375406f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3764102bf0 0x7f37641136c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 --2- 172.21.15.67:0/2103474171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3764103590 0x7f3764113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 >> 172.21.15.67:0/2103474171 conn(0x7f37640f87a0 msgr2=0x7f37640fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 shutdown_connections 2023-12-05T09:31:21.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:21.969+0000 7f376abb9700 1 -- 172.21.15.67:0/2103474171 wait complete. 2023-12-05T09:31:22.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.106+0000 7f747e2d0700 1 -- 172.21.15.67:0/885915469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 msgr2=0x7f74780703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.106+0000 7f747e2d0700 1 --2- 172.21.15.67:0/885915469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 0x7f74780703b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7468004970 tx=0x7f7468009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:22.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.107+0000 7f747e2d0700 1 -- 172.21.15.67:0/885915469 shutdown_connections 2023-12-05T09:31:22.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.107+0000 7f747e2d0700 1 --2- 172.21.15.67:0/885915469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74780708f0 0x7f7478108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.107+0000 7f747e2d0700 1 --2- 172.21.15.67:0/885915469 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 0x7f74780703b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.107+0000 7f747e2d0700 1 -- 172.21.15.67:0/885915469 >> 172.21.15.67:0/885915469 conn(0x7f74780f8790 msgr2=0x7f74780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:22.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.107+0000 7f747e2d0700 1 -- 172.21.15.67:0/885915469 shutdown_connections 2023-12-05T09:31:22.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.107+0000 7f747e2d0700 1 -- 172.21.15.67:0/885915469 wait complete. 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f747e2d0700 1 Processor -- start 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f747e2d0700 1 -- start start 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f747e2d0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 0x7f74781157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f747e2d0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74780708f0 0x7f7478115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f747e2d0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7478116380 con 0x7f747806ffe0 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f747e2d0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747810f6b0 con 0x7f74780708f0 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f7477fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 0x7f74781157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f7477fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 0x7f74781157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49838/0 (socket says 172.21.15.67:49838) 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.108+0000 7f7477fff700 1 -- 172.21.15.67:0/1841847420 learned_addr learned my addr 172.21.15.67:0/1841847420 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:22.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.109+0000 7f74777fe700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74780708f0 0x7f7478115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.109+0000 7f7477fff700 1 -- 172.21.15.67:0/1841847420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74780708f0 msgr2=0x7f7478115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.109+0000 7f7477fff700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74780708f0 0x7f7478115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.109+0000 7f7477fff700 1 -- 172.21.15.67:0/1841847420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7468005040 con 0x7f747806ffe0 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.109+0000 7f7477fff700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 0x7f74781157f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7468000c00 tx=0x7f7468009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.109+0000 7f7474ff9700 1 -- 172.21.15.67:0/1841847420 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746800e040 con 0x7f747806ffe0 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.109+0000 7f7474ff9700 1 -- 172.21.15.67:0/1841847420 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7468013420 con 0x7f747806ffe0 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.109+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747810f930 con 0x7f747806ffe0 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.110+0000 7f7474ff9700 1 -- 172.21.15.67:0/1841847420 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f746801c630 con 0x7f747806ffe0 2023-12-05T09:31:22.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.110+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747810fe70 con 0x7f747806ffe0 2023-12-05T09:31:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.111+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74781065d0 con 0x7f747806ffe0 2023-12-05T09:31:22.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.112+0000 7f7474ff9700 1 -- 172.21.15.67:0/1841847420 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f74680139e0 con 0x7f747806ffe0 2023-12-05T09:31:22.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.113+0000 7f7474ff9700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f746006cf80 0x7f746006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.113+0000 7f7474ff9700 1 -- 172.21.15.67:0/1841847420 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f746808d8f0 con 0x7f747806ffe0 2023-12-05T09:31:22.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.113+0000 7f74777fe700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f746006cf80 0x7f746006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.114+0000 7f74777fe700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f746006cf80 0x7f746006f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7478111020 tx=0x7f746c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:22.115 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.117+0000 7f7474ff9700 1 -- 172.21.15.67:0/1841847420 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f746805b020 con 0x7f747806ffe0 2023-12-05T09:31:22.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:21 smithi067 ceph-mon[210894]: pgmap v28: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:22.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:21 smithi067 ceph-mon[210894]: Upgrade: Updating crash.smithi134 (2/2) 2023-12-05T09:31:22.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:21 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:22.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:21 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-05T09:31:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:21 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:22.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:21 smithi067 ceph-mon[210894]: Deploying daemon crash.smithi134 on smithi134 2023-12-05T09:31:22.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.412+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f747804bbd0 con 0x7f747806ffe0 2023-12-05T09:31:22.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.413+0000 7f7474ff9700 1 -- 172.21.15.67:0/1841847420 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f7468055e60 con 0x7f747806ffe0 2023-12-05T09:31:22.411 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:31:22.411 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:31:22.412 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 10, 2023-12-05T09:31:22.413 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 4 2023-12-05T09:31:22.413 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:31:22.413 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:31:22.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f746006cf80 msgr2=0x7f746006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f746006cf80 0x7f746006f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7478111020 tx=0x7f746c00b040 comp rx=0 tx=0).stop 2023-12-05T09:31:22.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 msgr2=0x7f74781157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 0x7f74781157f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7468000c00 tx=0x7f7468009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:22.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 shutdown_connections 2023-12-05T09:31:22.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f746006cf80 0x7f746006f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f747806ffe0 0x7f74781157f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 --2- 172.21.15.67:0/1841847420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74780708f0 0x7f7478115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 >> 172.21.15.67:0/1841847420 conn(0x7f74780f8790 msgr2=0x7f7478103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:22.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 shutdown_connections 2023-12-05T09:31:22.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.415+0000 7f747e2d0700 1 -- 172.21.15.67:0/1841847420 wait complete. 2023-12-05T09:31:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.554+0000 7ffae822e700 1 -- 172.21.15.67:0/3181686378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae0102c00 msgr2=0x7ffae0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.554+0000 7ffae822e700 1 --2- 172.21.15.67:0/3181686378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae0102c00 0x7ffae0102fd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffadc004940 tx=0x7ffadc009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.554+0000 7ffae822e700 1 -- 172.21.15.67:0/3181686378 shutdown_connections 2023-12-05T09:31:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.554+0000 7ffae822e700 1 --2- 172.21.15.67:0/3181686378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffae01035a0 0x7ffae00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.554+0000 7ffae822e700 1 --2- 172.21.15.67:0/3181686378 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae0102c00 0x7ffae0102fd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.554+0000 7ffae822e700 1 -- 172.21.15.67:0/3181686378 >> 172.21.15.67:0/3181686378 conn(0x7ffae00f8790 msgr2=0x7ffae00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.554+0000 7ffae822e700 1 -- 172.21.15.67:0/3181686378 shutdown_connections 2023-12-05T09:31:22.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.554+0000 7ffae822e700 1 -- 172.21.15.67:0/3181686378 wait complete. 2023-12-05T09:31:22.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.555+0000 7ffae822e700 1 Processor -- start 2023-12-05T09:31:22.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.555+0000 7ffae822e700 1 -- start start 2023-12-05T09:31:22.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.556+0000 7ffae822e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffae0102c00 0x7ffae006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.556+0000 7ffae822e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae01035a0 0x7ffae0070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.556+0000 7ffae822e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0070a80 con 0x7ffae01035a0 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.556+0000 7ffae822e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0070bf0 con 0x7ffae0102c00 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.556+0000 7ffae57c9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae01035a0 0x7ffae0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.556+0000 7ffae57c9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae01035a0 0x7ffae0070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49858/0 (socket says 172.21.15.67:49858) 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.556+0000 7ffae57c9700 1 -- 172.21.15.67:0/1037236809 learned_addr learned my addr 172.21.15.67:0/1037236809 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.556+0000 7ffae5fca700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffae0102c00 0x7ffae006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffae57c9700 1 -- 172.21.15.67:0/1037236809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffae0102c00 msgr2=0x7ffae006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffae57c9700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffae0102c00 0x7ffae006ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffae57c9700 1 -- 172.21.15.67:0/1037236809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc005040 con 0x7ffae01035a0 2023-12-05T09:31:22.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffae57c9700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae01035a0 0x7ffae0070480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffad000eb40 tx=0x7ffad000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:22.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffad67fc700 1 -- 172.21.15.67:0/1037236809 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad0007cc0 con 0x7ffae01035a0 2023-12-05T09:31:22.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae0119880 con 0x7ffae01035a0 2023-12-05T09:31:22.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffad67fc700 1 -- 172.21.15.67:0/1037236809 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffad000f040 con 0x7ffae01035a0 2023-12-05T09:31:22.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffad67fc700 1 -- 172.21.15.67:0/1037236809 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad000c8f0 con 0x7ffae01035a0 2023-12-05T09:31:22.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.557+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae0119ce0 con 0x7ffae01035a0 2023-12-05T09:31:22.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.558+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae00fff10 con 0x7ffae01035a0 2023-12-05T09:31:22.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.559+0000 7ffad67fc700 1 -- 172.21.15.67:0/1037236809 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7ffad000cb60 con 0x7ffae01035a0 2023-12-05T09:31:22.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.560+0000 7ffad67fc700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ffacc06cf80 0x7ffacc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.560+0000 7ffad67fc700 1 -- 172.21.15.67:0/1037236809 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffad008bfe0 con 0x7ffae01035a0 2023-12-05T09:31:22.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.561+0000 7ffae5fca700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ffacc06cf80 0x7ffacc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.561+0000 7ffae5fca700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ffacc06cf80 0x7ffacc06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00b0d0 tx=0x7ffadc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:22.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.565+0000 7ffad67fc700 1 -- 172.21.15.67:0/1037236809 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffad00bf2f0 con 0x7ffae01035a0 2023-12-05T09:31:22.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.819+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffae00fc360 con 0x7ffae01035a0 2023-12-05T09:31:22.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.820+0000 7ffad67fc700 1 -- 172.21.15.67:0/1037236809 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1858 (secure 0 0 0) 0x7ffad0055cb0 con 0x7ffae01035a0 2023-12-05T09:31:22.819 INFO:teuthology.orchestra.run.smithi067.stdout:e20 2023-12-05T09:31:22.819 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:31:22.819 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:31:22.819 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 20 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:30:26.034169+0000 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2023-12-05T09:31:22.820 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:31:22.821 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:31:22.821 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:31:22.821 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:31:22.821 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:31:22.821 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:31:22.821 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:31:22.821 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:31:22.821 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:31:22.822 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ffacc06cf80 msgr2=0x7ffacc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ffacc06cf80 0x7ffacc06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00b0d0 tx=0x7ffadc009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae01035a0 msgr2=0x7ffae0070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae01035a0 0x7ffae0070480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffad000eb40 tx=0x7ffad000b040 comp rx=0 tx=0).stop 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 shutdown_connections 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffae0102c00 0x7ffae006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ffacc06cf80 0x7ffacc06f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 --2- 172.21.15.67:0/1037236809 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffae01035a0 0x7ffae0070480 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 >> 172.21.15.67:0/1037236809 conn(0x7ffae00f8790 msgr2=0x7ffae00fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.822+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 shutdown_connections 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.823+0000 7ffae822e700 1 -- 172.21.15.67:0/1037236809 wait complete. 2023-12-05T09:31:22.824 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 20 2023-12-05T09:31:22.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.962+0000 7fc1db5e3700 1 -- 172.21.15.67:0/4123627335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d41035a0 msgr2=0x7fc1d40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.962+0000 7fc1db5e3700 1 --2- 172.21.15.67:0/4123627335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d41035a0 0x7fc1d40fcc10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4004940 tx=0x7fc1c4009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:22.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.962+0000 7fc1db5e3700 1 -- 172.21.15.67:0/4123627335 shutdown_connections 2023-12-05T09:31:22.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.962+0000 7fc1db5e3700 1 --2- 172.21.15.67:0/4123627335 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d41035a0 0x7fc1d40fcc10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.962+0000 7fc1db5e3700 1 --2- 172.21.15.67:0/4123627335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d4102c00 0x7fc1d4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.962+0000 7fc1db5e3700 1 -- 172.21.15.67:0/4123627335 >> 172.21.15.67:0/4123627335 conn(0x7fc1d40f8790 msgr2=0x7fc1d40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:22.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.962+0000 7fc1db5e3700 1 -- 172.21.15.67:0/4123627335 shutdown_connections 2023-12-05T09:31:22.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.962+0000 7fc1db5e3700 1 -- 172.21.15.67:0/4123627335 wait complete. 2023-12-05T09:31:22.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.963+0000 7fc1db5e3700 1 Processor -- start 2023-12-05T09:31:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.963+0000 7fc1db5e3700 1 -- start start 2023-12-05T09:31:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.963+0000 7fc1db5e3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4102c00 0x7fc1d4113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.963+0000 7fc1db5e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d41035a0 0x7fc1d4113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.963+0000 7fc1db5e3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d410d530 con 0x7fc1d4102c00 2023-12-05T09:31:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.963+0000 7fc1db5e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d410d6a0 con 0x7fc1d41035a0 2023-12-05T09:31:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.963+0000 7fc1d937f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4102c00 0x7fc1d4113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.964+0000 7fc1d937f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4102c00 0x7fc1d4113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49872/0 (socket says 172.21.15.67:49872) 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.964+0000 7fc1d937f700 1 -- 172.21.15.67:0/2163927697 learned_addr learned my addr 172.21.15.67:0/2163927697 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.964+0000 7fc1d8b7e700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d41035a0 0x7fc1d4113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.964+0000 7fc1d937f700 1 -- 172.21.15.67:0/2163927697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d41035a0 msgr2=0x7fc1d4113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.964+0000 7fc1d937f700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d41035a0 0x7fc1d4113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.964+0000 7fc1d937f700 1 -- 172.21.15.67:0/2163927697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c4005040 con 0x7fc1d4102c00 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.964+0000 7fc1d937f700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4102c00 0x7fc1d4113670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000b790 tx=0x7fc1d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.964+0000 7fc1c9ffb700 1 -- 172.21.15.67:0/2163927697 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d000f6f0 con 0x7fc1d4102c00 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.965+0000 7fc1c9ffb700 1 -- 172.21.15.67:0/2163927697 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1d000fd00 con 0x7fc1d4102c00 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.965+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d410d980 con 0x7fc1d4102c00 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.965+0000 7fc1c9ffb700 1 -- 172.21.15.67:0/2163927697 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d00103a0 con 0x7fc1d4102c00 2023-12-05T09:31:22.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.965+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d410dec0 con 0x7fc1d4102c00 2023-12-05T09:31:22.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.966+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d40fff10 con 0x7fc1d4102c00 2023-12-05T09:31:22.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.967+0000 7fc1c9ffb700 1 -- 172.21.15.67:0/2163927697 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fc1d000f850 con 0x7fc1d4102c00 2023-12-05T09:31:22.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.968+0000 7fc1c9ffb700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1c006cf80 0x7fc1c006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:22.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.968+0000 7fc1c9ffb700 1 -- 172.21.15.67:0/2163927697 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc1d008c1b0 con 0x7fc1d4102c00 2023-12-05T09:31:22.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.968+0000 7fc1d8b7e700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1c006cf80 0x7fc1c006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:22.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.969+0000 7fc1d8b7e700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1c006cf80 0x7fc1c006f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1d410ef10 tx=0x7fc1c4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:22.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:22.972+0000 7fc1c9ffb700 1 -- 172.21.15.67:0/2163927697 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc1d0059b30 con 0x7fc1d4102c00 2023-12-05T09:31:23.069 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:22 smithi134 ceph-mon[172895]: from='client.44101 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:23.069 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:22 smithi134 ceph-mon[172895]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:23.069 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:22 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/1841847420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:23.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:22 smithi067 ceph-mon[210894]: from='client.44101 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:23.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:22 smithi067 ceph-mon[210894]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:23.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:22 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/1841847420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:23.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.199+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1d404bb80 con 0x7fc1c006cf80 2023-12-05T09:31:23.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.201+0000 7fc1c9ffb700 1 -- 172.21.15.67:0/2163927697 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc1d404bb80 con 0x7fc1c006cf80 2023-12-05T09:31:23.199 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: "mon" 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "4/21 daemons upgraded", 2023-12-05T09:31:23.200 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading crash daemons", 2023-12-05T09:31:23.201 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:31:23.201 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:31:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1c006cf80 msgr2=0x7fc1c006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1c006cf80 0x7fc1c006f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc1d410ef10 tx=0x7fc1c4009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4102c00 msgr2=0x7fc1d4113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4102c00 0x7fc1d4113670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000b790 tx=0x7fc1d0009250 comp rx=0 tx=0).stop 2023-12-05T09:31:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 shutdown_connections 2023-12-05T09:31:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc1c006cf80 0x7fc1c006f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc1d4102c00 0x7fc1d4113670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 --2- 172.21.15.67:0/2163927697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc1d41035a0 0x7fc1d4113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 >> 172.21.15.67:0/2163927697 conn(0x7fc1d40f8790 msgr2=0x7fc1d40fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 shutdown_connections 2023-12-05T09:31:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.203+0000 7fc1db5e3700 1 -- 172.21.15.67:0/2163927697 wait complete. 2023-12-05T09:31:23.340 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.341+0000 7f4970bb7700 1 -- 172.21.15.67:0/1355670419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c1057b0 msgr2=0x7f496c0fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.341+0000 7f4970bb7700 1 --2- 172.21.15.67:0/1355670419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c1057b0 0x7f496c0fee20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4960004940 tx=0x7f4960009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.342+0000 7f4970bb7700 1 -- 172.21.15.67:0/1355670419 shutdown_connections 2023-12-05T09:31:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.342+0000 7f4970bb7700 1 --2- 172.21.15.67:0/1355670419 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c1057b0 0x7f496c0fee20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.342+0000 7f4970bb7700 1 --2- 172.21.15.67:0/1355670419 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c104e10 0x7f496c1051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.342+0000 7f4970bb7700 1 -- 172.21.15.67:0/1355670419 >> 172.21.15.67:0/1355670419 conn(0x7f496c0fa9e0 msgr2=0x7f496c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.342+0000 7f4970bb7700 1 -- 172.21.15.67:0/1355670419 shutdown_connections 2023-12-05T09:31:23.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.342+0000 7f4970bb7700 1 -- 172.21.15.67:0/1355670419 wait complete. 2023-12-05T09:31:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.342+0000 7f4970bb7700 1 Processor -- start 2023-12-05T09:31:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.343+0000 7f4970bb7700 1 -- start start 2023-12-05T09:31:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.343+0000 7f4970bb7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c104e10 0x7f496c115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.343+0000 7f4970bb7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c1057b0 0x7f496c115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:23.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.343+0000 7f4970bb7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c1163c0 con 0x7f496c104e10 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.343+0000 7f4970bb7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c10f6f0 con 0x7f496c1057b0 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.343+0000 7f496a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c104e10 0x7f496c115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.343+0000 7f496a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c104e10 0x7f496c115830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:49876/0 (socket says 172.21.15.67:49876) 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.343+0000 7f496a59c700 1 -- 172.21.15.67:0/1946679866 learned_addr learned my addr 172.21.15.67:0/1946679866 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f4969d9b700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c1057b0 0x7f496c115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f496a59c700 1 -- 172.21.15.67:0/1946679866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c1057b0 msgr2=0x7f496c115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f496a59c700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c1057b0 0x7f496c115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f496a59c700 1 -- 172.21.15.67:0/1946679866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960005040 con 0x7f496c104e10 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f4969d9b700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c1057b0 0x7f496c115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f496a59c700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c104e10 0x7f496c115830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f495c00eb70 tx=0x7f495c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f495affd700 1 -- 172.21.15.67:0/1946679866 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f495c007cc0 con 0x7f496c104e10 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f495affd700 1 -- 172.21.15.67:0/1946679866 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f495c00f040 con 0x7f496c104e10 2023-12-05T09:31:23.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f495affd700 1 -- 172.21.15.67:0/1946679866 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f495c0095f0 con 0x7f496c104e10 2023-12-05T09:31:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c10f970 con 0x7f496c104e10 2023-12-05T09:31:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.344+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c10feb0 con 0x7f496c104e10 2023-12-05T09:31:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.346+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c1072e0 con 0x7f496c104e10 2023-12-05T09:31:23.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.347+0000 7f495affd700 1 -- 172.21.15.67:0/1946679866 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f495c009750 con 0x7f496c104e10 2023-12-05T09:31:23.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.348+0000 7f495affd700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f495406cf80 0x7f495406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:23.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.348+0000 7f495affd700 1 -- 172.21.15.67:0/1946679866 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f495c08c1e0 con 0x7f496c104e10 2023-12-05T09:31:23.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.348+0000 7f4969d9b700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f495406cf80 0x7f495406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:23.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.349+0000 7f4969d9b700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f495406cf80 0x7f495406f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4960009fd0 tx=0x7f4960009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:23.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.353+0000 7f495affd700 1 -- 172.21.15.67:0/1946679866 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f495c059930 con 0x7f496c104e10 2023-12-05T09:31:23.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.649+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f496c0fe5b0 con 0x7f496c104e10 2023-12-05T09:31:23.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.649+0000 7f495affd700 1 -- 172.21.15.67:0/1946679866 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f495c0594c0 con 0x7f496c104e10 2023-12-05T09:31:23.648 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_OK 2023-12-05T09:31:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f495406cf80 msgr2=0x7f495406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f495406cf80 0x7f495406f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4960009fd0 tx=0x7f4960009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c104e10 msgr2=0x7f496c115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c104e10 0x7f496c115830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f495c00eb70 tx=0x7f495c00b040 comp rx=0 tx=0).stop 2023-12-05T09:31:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 shutdown_connections 2023-12-05T09:31:23.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f495406cf80 0x7f495406f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f496c104e10 0x7f496c115830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 --2- 172.21.15.67:0/1946679866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f496c1057b0 0x7f496c115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 >> 172.21.15.67:0/1946679866 conn(0x7f496c0fa9e0 msgr2=0x7f496c0fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 shutdown_connections 2023-12-05T09:31:23.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:23.652+0000 7f4970bb7700 1 -- 172.21.15.67:0/1946679866 wait complete. 2023-12-05T09:31:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:23 smithi134 ceph-mon[172895]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:23 smithi134 ceph-mon[172895]: pgmap v29: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:23 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/1037236809' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:31:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:23 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:23 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:23 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:23 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/1946679866' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:31:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:23 smithi067 ceph-mon[210894]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:23 smithi067 ceph-mon[210894]: pgmap v29: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:23 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/1037236809' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:31:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:23 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:23 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:23 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:23 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/1946679866' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:31:24.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:24 smithi067 ceph-mon[210894]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:24.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:24 smithi134 ceph-mon[172895]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:25 smithi067 ceph-mon[210894]: pgmap v30: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:25 smithi134 ceph-mon[172895]: pgmap v30: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:27.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:27 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:27.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:27 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:27.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:27 smithi067 ceph-mon[210894]: pgmap v31: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:27.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:27 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:27.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:27 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:27.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:27 smithi134 ceph-mon[172895]: pgmap v31: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:28.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:28 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:28.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:28 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:28.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:28 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:28.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:28 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:28.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:28 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:28.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:28 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:28.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:28 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:28.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:28 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:29.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:29 smithi067 ceph-mon[210894]: pgmap v32: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:29.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:29 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:29.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:29 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:29.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:29 smithi134 ceph-mon[172895]: pgmap v32: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:29.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:29 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:29.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:29 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:31.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:31 smithi067 ceph-mon[210894]: pgmap v33: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:31.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:31:31.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:31.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:31 smithi134 ceph-mon[172895]: pgmap v33: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:31 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:31:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:31 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:31.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:31 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: pgmap v34: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:33.800 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:33.801 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]: dispatch 2023-12-05T09:31:33.801 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]': finished 2023-12-05T09:31:33.801 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2023-12-05T09:31:33.801 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2023-12-05T09:31:33.801 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:33 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T09:31:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:31:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: pgmap v34: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]: dispatch 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]': finished 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2023-12-05T09:31:34.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:33 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T09:31:34.902 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:34 smithi067 ceph-mon[210894]: Upgrade: Setting container_image for all crash 2023-12-05T09:31:34.902 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:34 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T09:31:34.902 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:34 smithi067 ceph-mon[210894]: Upgrade: osd.0 is safe to restart 2023-12-05T09:31:34.902 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:34.902 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:31:34.902 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:34 smithi134 ceph-mon[172895]: Upgrade: Setting container_image for all crash 2023-12-05T09:31:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:34 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-05T09:31:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:34 smithi134 ceph-mon[172895]: Upgrade: osd.0 is safe to restart 2023-12-05T09:31:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-05T09:31:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:36.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:35 smithi067 ceph-mon[210894]: Upgrade: Updating osd.0 2023-12-05T09:31:36.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:35 smithi067 ceph-mon[210894]: Deploying daemon osd.0 on smithi067 2023-12-05T09:31:36.121 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:35 smithi067 ceph-mon[210894]: pgmap v35: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:35 smithi134 ceph-mon[172895]: Upgrade: Updating osd.0 2023-12-05T09:31:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:35 smithi134 ceph-mon[172895]: Deploying daemon osd.0 on smithi067 2023-12-05T09:31:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:35 smithi134 ceph-mon[172895]: pgmap v35: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:37.451 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:37 smithi067 systemd[1]: Stopping Ceph osd.0 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:31:37.796 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:37 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[130141]: 2023-12-05T09:31:37.451+0000 7fb0b0699700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:31:37.796 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:37 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[130141]: 2023-12-05T09:31:37.451+0000 7fb0b0699700 -1 osd.0 51 *** Got signal Terminated *** 2023-12-05T09:31:37.796 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:37 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[130141]: 2023-12-05T09:31:37.451+0000 7fb0b0699700 -1 osd.0 51 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:31:38.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:37 smithi067 ceph-mon[210894]: pgmap v36: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:38.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:37 smithi067 ceph-mon[210894]: osd.0 marked itself down and dead 2023-12-05T09:31:38.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:37 smithi134 ceph-mon[172895]: pgmap v36: 65 pgs: 65 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:38.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:37 smithi134 ceph-mon[172895]: osd.0 marked itself down and dead 2023-12-05T09:31:38.798 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:38 smithi067 bash[224282]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0 2023-12-05T09:31:39.106 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:38 smithi067 ceph-mon[210894]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:31:39.106 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:38 smithi067 ceph-mon[210894]: failed to encode map e52 with expected crc 2023-12-05T09:31:39.106 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:38 smithi067 ceph-mon[210894]: osdmap e52: 6 total, 5 up, 6 in 2023-12-05T09:31:39.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:38 smithi134 ceph-mon[172895]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:31:39.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:38 smithi134 ceph-mon[172895]: failed to encode map e52 with expected crc 2023-12-05T09:31:39.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:38 smithi134 ceph-mon[172895]: osdmap e52: 6 total, 5 up, 6 in 2023-12-05T09:31:39.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:39 smithi067 ceph-mon[210894]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:39.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:39 smithi067 ceph-mon[210894]: failed to encode map e53 with expected crc 2023-12-05T09:31:39.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:39 smithi067 ceph-mon[210894]: osdmap e53: 6 total, 5 up, 6 in 2023-12-05T09:31:39.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:39 smithi067 ceph-mon[210894]: failed to encode map e53 with expected crc 2023-12-05T09:31:39.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:39 smithi067 ceph-mon[210894]: failed to encode map e53 with expected crc 2023-12-05T09:31:39.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:39 smithi067 ceph-mon[210894]: failed to encode map e53 with expected crc 2023-12-05T09:31:39.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:39 smithi067 ceph-mon[210894]: failed to encode map e53 with expected crc 2023-12-05T09:31:39.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:39 smithi067 ceph-mon[210894]: failed to encode map e53 with expected crc 2023-12-05T09:31:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:39 smithi134 ceph-mon[172895]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:39 smithi134 ceph-mon[172895]: failed to encode map e53 with expected crc 2023-12-05T09:31:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:39 smithi134 ceph-mon[172895]: osdmap e53: 6 total, 5 up, 6 in 2023-12-05T09:31:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:39 smithi134 ceph-mon[172895]: failed to encode map e53 with expected crc 2023-12-05T09:31:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:39 smithi134 ceph-mon[172895]: failed to encode map e53 with expected crc 2023-12-05T09:31:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:39 smithi134 ceph-mon[172895]: failed to encode map e53 with expected crc 2023-12-05T09:31:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:39 smithi134 ceph-mon[172895]: failed to encode map e53 with expected crc 2023-12-05T09:31:40.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:39 smithi134 ceph-mon[172895]: failed to encode map e53 with expected crc 2023-12-05T09:31:40.253 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:39 smithi067 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.0.service: Succeeded. 2023-12-05T09:31:40.253 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:39 smithi067 systemd[1]: Stopped Ceph osd.0 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:31:40.618 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:40 smithi067 systemd[1]: Starting Ceph osd.0 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:31:41.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:41 smithi067 ceph-mon[210894]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:41.618 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:41 smithi067 bash[224548]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-05T09:31:41.619 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:41 smithi067 bash[224548]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-05T09:31:41.619 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:41 smithi067 bash[224548]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-05T09:31:41.619 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:41 smithi067 bash[224548]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-05T09:31:41.619 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:41 smithi067 bash[224548]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-05T09:31:41.619 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:41 smithi067 bash[224548]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-05T09:31:41.619 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:41 smithi067 bash[224548]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-05T09:31:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:41 smithi134 ceph-mon[172895]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:42.618 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:42 smithi067 bash[224826]: cc8a8add819d463e6d7a15dbd31171b2e23883e4b1d048b25e0254dfc6b15828 2023-12-05T09:31:42.618 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:42 smithi067 systemd[1]: Started Ceph osd.0 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:31:42.618 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:42 smithi067 ceph-osd[224863]: -- 172.21.15.67:0/493058198 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a1593ed1e0 con 0x55a1593bcc00 2023-12-05T09:31:43.118 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:42 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[224840]: 2023-12-05T09:31:42.769+0000 7fbbfe436640 -1 Falling back to public interface 2023-12-05T09:31:43.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:43.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:43.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:43 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:43.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:43 smithi067 ceph-mon[210894]: pgmap v41: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:43.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:43 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:43.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:43 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:43.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:43 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:43.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:43 smithi134 ceph-mon[172895]: pgmap v41: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:44.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:44 smithi067 ceph-mon[210894]: Health check failed: Degraded data redundancy: 73/378 objects degraded (19.312%), 20 pgs degraded (PG_DEGRADED) 2023-12-05T09:31:44.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:44 smithi134 ceph-mon[172895]: Health check failed: Degraded data redundancy: 73/378 objects degraded (19.312%), 20 pgs degraded (PG_DEGRADED) 2023-12-05T09:31:45.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:45 smithi067 ceph-mon[210894]: pgmap v42: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:45.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:45 smithi134 ceph-mon[172895]: pgmap v42: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:31:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:31:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:47.618 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:47 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[224840]: 2023-12-05T09:31:47.334+0000 7fbbfe436640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-05T09:31:48.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:47 smithi067 ceph-mon[210894]: pgmap v43: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:48.118 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:47 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[224840]: 2023-12-05T09:31:47.902+0000 7fbbfe436640 -1 osd.0 51 log_to_monitors true 2023-12-05T09:31:48.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:47 smithi134 ceph-mon[172895]: pgmap v43: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:49.258 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:31:48 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[224840]: 2023-12-05T09:31:48.958+0000 7fbbed8a3700 -1 osd.0 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:31:49.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:48 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:49.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:48 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:49.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:48 smithi067 ceph-mon[210894]: from='osd.0 [v2:172.21.15.67:6802/2109297054,v1:172.21.15.67:6803/2109297054]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T09:31:49.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:48 smithi067 ceph-mon[210894]: pgmap v44: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:49.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:48 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:49.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:48 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:49.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:48 smithi134 ceph-mon[172895]: from='osd.0 [v2:172.21.15.67:6802/2109297054,v1:172.21.15.67:6803/2109297054]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-05T09:31:49.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:48 smithi134 ceph-mon[172895]: pgmap v44: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:50.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:49 smithi067 ceph-mon[210894]: from='osd.0 [v2:172.21.15.67:6802/2109297054,v1:172.21.15.67:6803/2109297054]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T09:31:50.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:49 smithi067 ceph-mon[210894]: failed to encode map e54 with expected crc 2023-12-05T09:31:50.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:49 smithi067 ceph-mon[210894]: osdmap e54: 6 total, 5 up, 6 in 2023-12-05T09:31:50.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:49 smithi067 ceph-mon[210894]: from='osd.0 [v2:172.21.15.67:6802/2109297054,v1:172.21.15.67:6803/2109297054]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:31:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:49 smithi134 ceph-mon[172895]: from='osd.0 [v2:172.21.15.67:6802/2109297054,v1:172.21.15.67:6803/2109297054]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-05T09:31:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:49 smithi134 ceph-mon[172895]: failed to encode map e54 with expected crc 2023-12-05T09:31:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:49 smithi134 ceph-mon[172895]: osdmap e54: 6 total, 5 up, 6 in 2023-12-05T09:31:50.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:49 smithi134 ceph-mon[172895]: from='osd.0 [v2:172.21.15.67:6802/2109297054,v1:172.21.15.67:6803/2109297054]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:31:51.216 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:50 smithi067 ceph-mon[210894]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:31:51.217 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:50 smithi067 ceph-mon[210894]: failed to encode map e55 with expected crc 2023-12-05T09:31:51.217 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:50 smithi067 ceph-mon[210894]: osd.0 [v2:172.21.15.67:6802/2109297054,v1:172.21.15.67:6803/2109297054] boot 2023-12-05T09:31:51.217 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:50 smithi067 ceph-mon[210894]: osdmap e55: 6 total, 6 up, 6 in 2023-12-05T09:31:51.217 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:50 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:31:51.217 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:50 smithi067 ceph-mon[210894]: pgmap v47: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:51.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:50 smithi134 ceph-mon[172895]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:31:51.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:50 smithi134 ceph-mon[172895]: failed to encode map e55 with expected crc 2023-12-05T09:31:51.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:50 smithi134 ceph-mon[172895]: osd.0 [v2:172.21.15.67:6802/2109297054,v1:172.21.15.67:6803/2109297054] boot 2023-12-05T09:31:51.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:50 smithi134 ceph-mon[172895]: osdmap e55: 6 total, 6 up, 6 in 2023-12-05T09:31:51.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:50 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-05T09:31:51.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:50 smithi134 ceph-mon[172895]: pgmap v47: 65 pgs: 20 active+undersized+degraded, 14 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 73/378 objects degraded (19.312%) 2023-12-05T09:31:52.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: osdmap e56: 6 total, 6 up, 6 in 2023-12-05T09:31:52.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:52.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:52.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:52.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T09:31:52.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T09:31:52.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:51 smithi067 ceph-mon[210894]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-05T09:31:52.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: osdmap e56: 6 total, 6 up, 6 in 2023-12-05T09:31:52.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: failed to encode map e56 with expected crc 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:52.378 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:52.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T09:31:52.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T09:31:52.379 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:51 smithi134 ceph-mon[172895]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2023-12-05T09:31:53.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:52 smithi067 ceph-mon[210894]: pgmap v49: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 13/378 objects degraded (3.439%) 2023-12-05T09:31:53.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:52 smithi134 ceph-mon[172895]: pgmap v49: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 13/378 objects degraded (3.439%) 2023-12-05T09:31:53.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.810+0000 7fd34ede6700 1 -- 172.21.15.67:0/2369419967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348070520 msgr2=0x7fd348070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:53.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.810+0000 7fd34ede6700 1 --2- 172.21.15.67:0/2369419967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348070520 0x7fd348070990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd334004970 tx=0x7fd334009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:53.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.810+0000 7fd34ede6700 1 -- 172.21.15.67:0/2369419967 shutdown_connections 2023-12-05T09:31:53.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.810+0000 7fd34ede6700 1 --2- 172.21.15.67:0/2369419967 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348070520 0x7fd348070990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:53.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.810+0000 7fd34ede6700 1 --2- 172.21.15.67:0/2369419967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd348071c10 0x7fd34806ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:53.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.810+0000 7fd34ede6700 1 -- 172.21.15.67:0/2369419967 >> 172.21.15.67:0/2369419967 conn(0x7fd3480f8790 msgr2=0x7fd3480faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:53.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.810+0000 7fd34ede6700 1 -- 172.21.15.67:0/2369419967 shutdown_connections 2023-12-05T09:31:53.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.810+0000 7fd34ede6700 1 -- 172.21.15.67:0/2369419967 wait complete. 2023-12-05T09:31:53.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.811+0000 7fd34ede6700 1 Processor -- start 2023-12-05T09:31:53.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.812+0000 7fd34ede6700 1 -- start start 2023-12-05T09:31:53.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.812+0000 7fd34ede6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd348070520 0x7fd348119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:53.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.812+0000 7fd34ede6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348071c10 0x7fd34811a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:53.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.812+0000 7fd34ede6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34811a8a0 con 0x7fd348071c10 2023-12-05T09:31:53.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.812+0000 7fd34ede6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd348113b40 con 0x7fd348070520 2023-12-05T09:31:53.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.813+0000 7fd347fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348071c10 0x7fd34811a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:53.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.813+0000 7fd347fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348071c10 0x7fd34811a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60222/0 (socket says 172.21.15.67:60222) 2023-12-05T09:31:53.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.813+0000 7fd347fff700 1 -- 172.21.15.67:0/2772707937 learned_addr learned my addr 172.21.15.67:0/2772707937 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:53.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.813+0000 7fd34cb82700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd348070520 0x7fd348119c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:53.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.813+0000 7fd347fff700 1 -- 172.21.15.67:0/2772707937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd348070520 msgr2=0x7fd348119c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:53.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.813+0000 7fd347fff700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd348070520 0x7fd348119c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:53.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.813+0000 7fd347fff700 1 -- 172.21.15.67:0/2772707937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334005040 con 0x7fd348071c10 2023-12-05T09:31:53.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.814+0000 7fd347fff700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348071c10 0x7fd34811a1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd334004f50 tx=0x7fd334009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:53.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.814+0000 7fd3457fa700 1 -- 172.21.15.67:0/2772707937 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33400e040 con 0x7fd348071c10 2023-12-05T09:31:53.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.814+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd348113dc0 con 0x7fd348071c10 2023-12-05T09:31:53.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.814+0000 7fd3457fa700 1 -- 172.21.15.67:0/2772707937 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd33400bc10 con 0x7fd348071c10 2023-12-05T09:31:53.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.814+0000 7fd3457fa700 1 -- 172.21.15.67:0/2772707937 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd33401c630 con 0x7fd348071c10 2023-12-05T09:31:53.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.814+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd348114300 con 0x7fd348071c10 2023-12-05T09:31:53.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.815+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3480fe0b0 con 0x7fd348071c10 2023-12-05T09:31:53.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.816+0000 7fd3457fa700 1 -- 172.21.15.67:0/2772707937 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fd334013960 con 0x7fd348071c10 2023-12-05T09:31:53.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.817+0000 7fd3457fa700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fd33806cf80 0x7fd33806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:53.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.817+0000 7fd3457fa700 1 -- 172.21.15.67:0/2772707937 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd33408d9a0 con 0x7fd348071c10 2023-12-05T09:31:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.817+0000 7fd34cb82700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fd33806cf80 0x7fd33806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:53.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.818+0000 7fd34cb82700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fd33806cf80 0x7fd33806f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009bf0 tx=0x7fd33c0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:53.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:53.822+0000 7fd3457fa700 1 -- 172.21.15.67:0/2772707937 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd33405b0d0 con 0x7fd348071c10 2023-12-05T09:31:54.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.051+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd34804bb80 con 0x7fd33806cf80 2023-12-05T09:31:54.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.053+0000 7fd3457fa700 1 -- 172.21.15.67:0/2772707937 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd34804bb80 con 0x7fd33806cf80 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fd33806cf80 msgr2=0x7fd33806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fd33806cf80 0x7fd33806f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009bf0 tx=0x7fd33c0091a0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348071c10 msgr2=0x7fd34811a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348071c10 0x7fd34811a1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd334004f50 tx=0x7fd334009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 shutdown_connections 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd348070520 0x7fd348119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fd33806cf80 0x7fd33806f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 --2- 172.21.15.67:0/2772707937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd348071c10 0x7fd34811a1c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 >> 172.21.15.67:0/2772707937 conn(0x7fd3480f8790 msgr2=0x7fd3480fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:54.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.055+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 shutdown_connections 2023-12-05T09:31:54.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.056+0000 7fd34ede6700 1 -- 172.21.15.67:0/2772707937 wait complete. 2023-12-05T09:31:54.068 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:31:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.194+0000 7f65e1279700 1 -- 172.21.15.67:0/3103960867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 msgr2=0x7f65dc0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.194+0000 7f65e1279700 1 --2- 172.21.15.67:0/3103960867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 0x7f65dc0fcc10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65d0004940 tx=0x7f65d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.194+0000 7f65e1279700 1 -- 172.21.15.67:0/3103960867 shutdown_connections 2023-12-05T09:31:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.194+0000 7f65e1279700 1 --2- 172.21.15.67:0/3103960867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 0x7f65dc0fcc10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.194+0000 7f65e1279700 1 --2- 172.21.15.67:0/3103960867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65dc102c00 0x7f65dc102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.194+0000 7f65e1279700 1 -- 172.21.15.67:0/3103960867 >> 172.21.15.67:0/3103960867 conn(0x7f65dc0f8790 msgr2=0x7f65dc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.194+0000 7f65e1279700 1 -- 172.21.15.67:0/3103960867 shutdown_connections 2023-12-05T09:31:54.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.194+0000 7f65e1279700 1 -- 172.21.15.67:0/3103960867 wait complete. 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.195+0000 7f65e1279700 1 Processor -- start 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.195+0000 7f65e1279700 1 -- start start 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65e1279700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65dc102c00 0x7f65dc1135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65e1279700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 0x7f65dc113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65e1279700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc114160 con 0x7f65dc1035a0 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65e1279700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc10d490 con 0x7f65dc102c00 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65da7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 0x7f65dc113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65da7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 0x7f65dc113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60254/0 (socket says 172.21.15.67:60254) 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65da7fc700 1 -- 172.21.15.67:0/3031892951 learned_addr learned my addr 172.21.15.67:0/3031892951 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:54.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65daffd700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65dc102c00 0x7f65dc1135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:54.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65da7fc700 1 -- 172.21.15.67:0/3031892951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65dc102c00 msgr2=0x7f65dc1135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65da7fc700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65dc102c00 0x7f65dc1135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.196+0000 7f65da7fc700 1 -- 172.21.15.67:0/3031892951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0005040 con 0x7f65dc1035a0 2023-12-05T09:31:54.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.197+0000 7f65da7fc700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 0x7f65dc113b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009fd0 tx=0x7f65d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:54.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.197+0000 7f65c37fe700 1 -- 172.21.15.67:0/3031892951 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d0021070 con 0x7f65dc1035a0 2023-12-05T09:31:54.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.197+0000 7f65c37fe700 1 -- 172.21.15.67:0/3031892951 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65d001c400 con 0x7f65dc1035a0 2023-12-05T09:31:54.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.197+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc10d710 con 0x7f65dc1035a0 2023-12-05T09:31:54.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.197+0000 7f65c37fe700 1 -- 172.21.15.67:0/3031892951 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d000e070 con 0x7f65dc1035a0 2023-12-05T09:31:54.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.197+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc10dbf0 con 0x7f65dc1035a0 2023-12-05T09:31:54.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.198+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc0fc390 con 0x7f65dc1035a0 2023-12-05T09:31:54.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.199+0000 7f65c37fe700 1 -- 172.21.15.67:0/3031892951 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f65d001c570 con 0x7f65dc1035a0 2023-12-05T09:31:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.200+0000 7f65c37fe700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f65c406cf80 0x7f65c406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.200+0000 7f65c37fe700 1 -- 172.21.15.67:0/3031892951 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f65d008d750 con 0x7f65dc1035a0 2023-12-05T09:31:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.200+0000 7f65daffd700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f65c406cf80 0x7f65c406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:54.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.201+0000 7f65daffd700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f65c406cf80 0x7f65c406f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f65cc004600 tx=0x7f65cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:54.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.205+0000 7f65c37fe700 1 -- 172.21.15.67:0/3031892951 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f65d005ae80 con 0x7f65dc1035a0 2023-12-05T09:31:54.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:53 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 13/378 objects degraded (3.439%), 3 pgs degraded (PG_DEGRADED) 2023-12-05T09:31:54.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:53 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 13/378 objects degraded (3.439%), 3 pgs degraded (PG_DEGRADED) 2023-12-05T09:31:54.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.431+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65dc1132a0 con 0x7f65c406cf80 2023-12-05T09:31:54.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.432+0000 7f65c37fe700 1 -- 172.21.15.67:0/3031892951 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f65dc1132a0 con 0x7f65c406cf80 2023-12-05T09:31:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f65c406cf80 msgr2=0x7f65c406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f65c406cf80 0x7f65c406f430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f65cc004600 tx=0x7f65cc00b040 comp rx=0 tx=0).stop 2023-12-05T09:31:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 msgr2=0x7f65dc113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 0x7f65dc113b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009fd0 tx=0x7f65d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 shutdown_connections 2023-12-05T09:31:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65dc102c00 0x7f65dc1135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f65c406cf80 0x7f65c406f430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 --2- 172.21.15.67:0/3031892951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f65dc1035a0 0x7f65dc113b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 >> 172.21.15.67:0/3031892951 conn(0x7f65dc0f8790 msgr2=0x7f65dc0fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.434+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 shutdown_connections 2023-12-05T09:31:54.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.435+0000 7f65e1279700 1 -- 172.21.15.67:0/3031892951 wait complete. 2023-12-05T09:31:54.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.573+0000 7f1553fff700 1 -- 172.21.15.67:0/299860590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 msgr2=0x7f1554108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.573+0000 7f1553fff700 1 --2- 172.21.15.67:0/299860590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 0x7f1554108db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1548004970 tx=0x7f1548009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:54.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.573+0000 7f1553fff700 1 -- 172.21.15.67:0/299860590 shutdown_connections 2023-12-05T09:31:54.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.573+0000 7f1553fff700 1 --2- 172.21.15.67:0/299860590 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 0x7f1554108db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.573+0000 7f1553fff700 1 --2- 172.21.15.67:0/299860590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f155406ff80 0x7f1554070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.573+0000 7f1553fff700 1 -- 172.21.15.67:0/299860590 >> 172.21.15.67:0/299860590 conn(0x7f15540f85f0 msgr2=0x7f15540faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:54.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.574+0000 7f1553fff700 1 -- 172.21.15.67:0/299860590 shutdown_connections 2023-12-05T09:31:54.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.574+0000 7f1553fff700 1 -- 172.21.15.67:0/299860590 wait complete. 2023-12-05T09:31:54.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.574+0000 7f1553fff700 1 Processor -- start 2023-12-05T09:31:54.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.574+0000 7f1553fff700 1 -- start start 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.575+0000 7f1553fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f155406ff80 0x7f1554115620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.575+0000 7f1553fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 0x7f1554115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.575+0000 7f1553fff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15541161f0 con 0x7f1554070890 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.575+0000 7f1553fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155410f4e0 con 0x7f155406ff80 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.575+0000 7f15527fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 0x7f1554115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.575+0000 7f15527fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 0x7f1554115ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60280/0 (socket says 172.21.15.67:60280) 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.575+0000 7f15527fc700 1 -- 172.21.15.67:0/1169909201 learned_addr learned my addr 172.21.15.67:0/1169909201 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.575+0000 7f1552ffd700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f155406ff80 0x7f1554115620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f15527fc700 1 -- 172.21.15.67:0/1169909201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f155406ff80 msgr2=0x7f1554115620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f15527fc700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f155406ff80 0x7f1554115620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f15527fc700 1 -- 172.21.15.67:0/1169909201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548005040 con 0x7f1554070890 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f15527fc700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 0x7f1554115ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1548005010 tx=0x7f1548009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:54.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f153b7fe700 1 -- 172.21.15.67:0/1169909201 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f154800e040 con 0x7f1554070890 2023-12-05T09:31:54.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f153b7fe700 1 -- 172.21.15.67:0/1169909201 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1548004290 con 0x7f1554070890 2023-12-05T09:31:54.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155410f710 con 0x7f1554070890 2023-12-05T09:31:54.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f153b7fe700 1 -- 172.21.15.67:0/1169909201 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f154801c3f0 con 0x7f1554070890 2023-12-05T09:31:54.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.576+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155410fc50 con 0x7f1554070890 2023-12-05T09:31:54.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.577+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1554106470 con 0x7f1554070890 2023-12-05T09:31:54.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.578+0000 7f153b7fe700 1 -- 172.21.15.67:0/1169909201 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f1548013420 con 0x7f1554070890 2023-12-05T09:31:54.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.579+0000 7f153b7fe700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f153c06cf80 0x7f153c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.579+0000 7f153b7fe700 1 -- 172.21.15.67:0/1169909201 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f154808d890 con 0x7f1554070890 2023-12-05T09:31:54.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.579+0000 7f1552ffd700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f153c06cf80 0x7f153c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:54.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.580+0000 7f1552ffd700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f153c06cf80 0x7f153c06f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15540f9d50 tx=0x7f154400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:54.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.584+0000 7f153b7fe700 1 -- 172.21.15.67:0/1169909201 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f154805b040 con 0x7f1554070890 2023-12-05T09:31:54.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.801+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f155404bb80 con 0x7f153c06cf80 2023-12-05T09:31:54.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.811+0000 7f153b7fe700 1 -- 172.21.15.67:0/1169909201 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f155404bb80 con 0x7f153c06cf80 2023-12-05T09:31:54.810 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:31:54.810 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (3m) 8s ago 13m 15.9M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:31:54.810 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (35s) 8s ago 13m 7860k - 19.0.0-11-g3fe8d441 56dea28e5206 e6de51f67edd 2023-12-05T09:31:54.810 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (31s) 28s ago 12m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 b78b9e680949 2023-12-05T09:31:54.810 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (2m) 8s ago 12m 79.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:31:54.810 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (8m) 8s ago 8m 6296M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:31:54.810 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (8m) 8s ago 8m 5209M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (8m) 28s ago 8m 15.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (8m) 28s ago 8m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (5m) 8s ago 14m 512M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (4m) 28s ago 12m 451M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (94s) 8s ago 14m 56.6M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (67s) 28s ago 12m 42.2M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 c85edd1646d0 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (3m) 8s ago 13m 8870k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 28s ago 12m 8094k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:31:54.811 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (12s) 8s ago 11m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 cc8a8add819d 2023-12-05T09:31:54.812 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (11m) 8s ago 11m 861M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 55d7419decbe 2023-12-05T09:31:54.812 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (10m) 8s ago 10m 664M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:31:54.812 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (10m) 28s ago 10m 1035M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:31:54.812 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (9m) 28s ago 9m 779M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:31:54.812 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (9m) 28s ago 9m 876M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:31:54.812 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (3m) 8s ago 12m 51.5M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:31:54.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f153c06cf80 msgr2=0x7f153c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f153c06cf80 0x7f153c06f430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15540f9d50 tx=0x7f154400b040 comp rx=0 tx=0).stop 2023-12-05T09:31:54.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 msgr2=0x7f1554115ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 0x7f1554115ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1548005010 tx=0x7f1548009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:54.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 shutdown_connections 2023-12-05T09:31:54.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f155406ff80 0x7f1554115620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f153c06cf80 0x7f153c06f430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 --2- 172.21.15.67:0/1169909201 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1554070890 0x7f1554115ba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 >> 172.21.15.67:0/1169909201 conn(0x7f15540f85f0 msgr2=0x7f15541035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:54.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 shutdown_connections 2023-12-05T09:31:54.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.813+0000 7f1553fff700 1 -- 172.21.15.67:0/1169909201 wait complete. 2023-12-05T09:31:54.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.953+0000 7f1c54914700 1 -- 172.21.15.67:0/2088393951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c501035a0 msgr2=0x7f1c500fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.953+0000 7f1c54914700 1 --2- 172.21.15.67:0/2088393951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c501035a0 0x7f1c500fcc10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1c44004940 tx=0x7f1c44009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:54.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.953+0000 7f1c54914700 1 -- 172.21.15.67:0/2088393951 shutdown_connections 2023-12-05T09:31:54.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.953+0000 7f1c54914700 1 --2- 172.21.15.67:0/2088393951 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c501035a0 0x7f1c500fcc10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.953+0000 7f1c54914700 1 --2- 172.21.15.67:0/2088393951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c50102c00 0x7f1c50102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.953+0000 7f1c54914700 1 -- 172.21.15.67:0/2088393951 >> 172.21.15.67:0/2088393951 conn(0x7f1c500f8790 msgr2=0x7f1c500faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:54.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.954+0000 7f1c54914700 1 -- 172.21.15.67:0/2088393951 shutdown_connections 2023-12-05T09:31:54.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.954+0000 7f1c54914700 1 -- 172.21.15.67:0/2088393951 wait complete. 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.954+0000 7f1c54914700 1 Processor -- start 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.955+0000 7f1c54914700 1 -- start start 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.955+0000 7f1c54914700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c50102c00 0x7f1c50113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.955+0000 7f1c54914700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c501035a0 0x7f1c50113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.955+0000 7f1c54914700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50114210 con 0x7f1c50102c00 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.955+0000 7f1c54914700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5010d500 con 0x7f1c501035a0 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.955+0000 7f1c4e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c50102c00 0x7f1c50113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.955+0000 7f1c4e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c50102c00 0x7f1c50113680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60300/0 (socket says 172.21.15.67:60300) 2023-12-05T09:31:54.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.955+0000 7f1c4e59c700 1 -- 172.21.15.67:0/3563663679 learned_addr learned my addr 172.21.15.67:0/3563663679 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:54.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c4e59c700 1 -- 172.21.15.67:0/3563663679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c501035a0 msgr2=0x7f1c50113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:54.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c4e59c700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c501035a0 0x7f1c50113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:54.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c4e59c700 1 -- 172.21.15.67:0/3563663679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44005040 con 0x7f1c50102c00 2023-12-05T09:31:54.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c4e59c700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c50102c00 0x7f1c50113680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c40002a50 tx=0x7f1c400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:54.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c3effd700 1 -- 172.21.15.67:0/3563663679 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c40007cc0 con 0x7f1c50102c00 2023-12-05T09:31:54.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c3effd700 1 -- 172.21.15.67:0/3563663679 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c4000f040 con 0x7f1c50102c00 2023-12-05T09:31:54.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5010d7e0 con 0x7f1c50102c00 2023-12-05T09:31:54.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c3effd700 1 -- 172.21.15.67:0/3563663679 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c40009540 con 0x7f1c50102c00 2023-12-05T09:31:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.956+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5010dd20 con 0x7f1c50102c00 2023-12-05T09:31:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.957+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50113330 con 0x7f1c50102c00 2023-12-05T09:31:54.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.958+0000 7f1c3effd700 1 -- 172.21.15.67:0/3563663679 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f1c400096a0 con 0x7f1c50102c00 2023-12-05T09:31:54.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.959+0000 7f1c3effd700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1c3806cf80 0x7f1c3806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:54.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.959+0000 7f1c3effd700 1 -- 172.21.15.67:0/3563663679 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1c4008c260 con 0x7f1c50102c00 2023-12-05T09:31:54.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.960+0000 7f1c4dd9b700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1c3806cf80 0x7f1c3806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:54.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.960+0000 7f1c4dd9b700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1c3806cf80 0x7f1c3806f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c44004f90 tx=0x7f1c44009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:54.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:54.964+0000 7f1c3effd700 1 -- 172.21.15.67:0/3563663679 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1c40059a30 con 0x7f1c50102c00 2023-12-05T09:31:55.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.259+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c500fc390 con 0x7f1c50102c00 2023-12-05T09:31:55.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.260+0000 7f1c3effd700 1 -- 172.21.15.67:0/3563663679 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f1c500fc390 con 0x7f1c50102c00 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 5, 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 1 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:31:55.259 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:31:55.260 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:31:55.260 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:31:55.260 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 9, 2023-12-05T09:31:55.260 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 5 2023-12-05T09:31:55.260 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:31:55.260 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1c3806cf80 msgr2=0x7f1c3806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1c3806cf80 0x7f1c3806f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c44004f90 tx=0x7f1c44009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c50102c00 msgr2=0x7f1c50113680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c50102c00 0x7f1c50113680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c40002a50 tx=0x7f1c400046b0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 shutdown_connections 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1c3806cf80 0x7f1c3806f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1c50102c00 0x7f1c50113680 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 --2- 172.21.15.67:0/3563663679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c501035a0 0x7f1c50113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 >> 172.21.15.67:0/3563663679 conn(0x7f1c500f8790 msgr2=0x7f1c500fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.262+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 shutdown_connections 2023-12-05T09:31:55.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.263+0000 7f1c54914700 1 -- 172.21.15.67:0/3563663679 wait complete. 2023-12-05T09:31:55.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:54 smithi067 ceph-mon[210894]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:55.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:54 smithi067 ceph-mon[210894]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:55.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:54 smithi067 ceph-mon[210894]: pgmap v50: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:55.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:54 smithi067 ceph-mon[210894]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:55.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:54 smithi134 ceph-mon[172895]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:55.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:54 smithi134 ceph-mon[172895]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:55.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:54 smithi134 ceph-mon[172895]: pgmap v50: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:55.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:54 smithi134 ceph-mon[172895]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:55.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.400+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3437995699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 msgr2=0x7ff1c80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:55.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.400+0000 7ff1cfebd700 1 --2- 172.21.15.67:0/3437995699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 0x7ff1c80fcc10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8004940 tx=0x7ff1b8009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.400+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3437995699 shutdown_connections 2023-12-05T09:31:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.400+0000 7ff1cfebd700 1 --2- 172.21.15.67:0/3437995699 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 0x7ff1c80fcc10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.400+0000 7ff1cfebd700 1 --2- 172.21.15.67:0/3437995699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c8102c00 0x7ff1c8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.400+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3437995699 >> 172.21.15.67:0/3437995699 conn(0x7ff1c80f8790 msgr2=0x7ff1c80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.401+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3437995699 shutdown_connections 2023-12-05T09:31:55.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.401+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3437995699 wait complete. 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.401+0000 7ff1cfebd700 1 Processor -- start 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.402+0000 7ff1cfebd700 1 -- start start 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.402+0000 7ff1cfebd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c8102c00 0x7ff1c81135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.402+0000 7ff1cfebd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 0x7ff1c8113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.402+0000 7ff1cfebd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8114160 con 0x7ff1c81035a0 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.402+0000 7ff1cfebd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c810d490 con 0x7ff1c8102c00 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.402+0000 7ff1cd458700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 0x7ff1c8113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.402+0000 7ff1cd458700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 0x7ff1c8113b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60318/0 (socket says 172.21.15.67:60318) 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.402+0000 7ff1cd458700 1 -- 172.21.15.67:0/3347489396 learned_addr learned my addr 172.21.15.67:0/3347489396 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1cdc59700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c8102c00 0x7ff1c81135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1cd458700 1 -- 172.21.15.67:0/3347489396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c8102c00 msgr2=0x7ff1c81135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:55.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1cd458700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c8102c00 0x7ff1c81135d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1cd458700 1 -- 172.21.15.67:0/3347489396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b8005040 con 0x7ff1c81035a0 2023-12-05T09:31:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1cd458700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 0x7ff1c8113b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8000c00 tx=0x7ff1b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1be7fc700 1 -- 172.21.15.67:0/3347489396 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1b8021070 con 0x7ff1c81035a0 2023-12-05T09:31:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1be7fc700 1 -- 172.21.15.67:0/3347489396 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff1b801c400 con 0x7ff1c81035a0 2023-12-05T09:31:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c810d710 con 0x7ff1c81035a0 2023-12-05T09:31:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.403+0000 7ff1be7fc700 1 -- 172.21.15.67:0/3347489396 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1b800e070 con 0x7ff1c81035a0 2023-12-05T09:31:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.404+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c810dbf0 con 0x7ff1c81035a0 2023-12-05T09:31:55.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.405+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c80fc390 con 0x7ff1c81035a0 2023-12-05T09:31:55.404 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.406+0000 7ff1be7fc700 1 -- 172.21.15.67:0/3347489396 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7ff1b801c570 con 0x7ff1c81035a0 2023-12-05T09:31:55.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.407+0000 7ff1be7fc700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff1b406cf80 0x7ff1b406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:55.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.408+0000 7ff1be7fc700 1 -- 172.21.15.67:0/3347489396 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff1b808d5e0 con 0x7ff1c81035a0 2023-12-05T09:31:55.406 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.408+0000 7ff1cdc59700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff1b406cf80 0x7ff1b406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:55.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.408+0000 7ff1cdc59700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff1b406cf80 0x7ff1b406f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009b80 tx=0x7ff1c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:55.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.412+0000 7ff1be7fc700 1 -- 172.21.15.67:0/3347489396 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff1b805ad90 con 0x7ff1c81035a0 2023-12-05T09:31:55.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.672+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff1c810ebb0 con 0x7ff1c81035a0 2023-12-05T09:31:55.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.672+0000 7ff1be7fc700 1 -- 172.21.15.67:0/3347489396 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1858 (secure 0 0 0) 0x7ff1b805a920 con 0x7ff1c81035a0 2023-12-05T09:31:55.671 INFO:teuthology.orchestra.run.smithi067.stdout:e20 2023-12-05T09:31:55.671 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:31:55.671 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:31:55.671 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:31:55.671 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:31:55.671 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 20 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:30:26.034169+0000 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:31:55.672 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:31:55.673 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:31:55.674 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:31:55.674 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:31:55.674 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:31:55.674 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:31:55.674 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:31:55.674 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff1b406cf80 msgr2=0x7ff1b406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff1b406cf80 0x7ff1b406f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009b80 tx=0x7ff1c400b040 comp rx=0 tx=0).stop 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 msgr2=0x7ff1c8113b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 0x7ff1c8113b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8000c00 tx=0x7ff1b8009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 shutdown_connections 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c8102c00 0x7ff1c81135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff1b406cf80 0x7ff1b406f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 --2- 172.21.15.67:0/3347489396 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff1c81035a0 0x7ff1c8113b10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 >> 172.21.15.67:0/3347489396 conn(0x7ff1c80f8790 msgr2=0x7ff1c80fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:55.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 shutdown_connections 2023-12-05T09:31:55.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.675+0000 7ff1cfebd700 1 -- 172.21.15.67:0/3347489396 wait complete. 2023-12-05T09:31:55.676 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 20 2023-12-05T09:31:55.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.816+0000 7f0878a2a700 1 -- 172.21.15.67:0/2221799960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 msgr2=0x7f0874070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:55.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.816+0000 7f0878a2a700 1 --2- 172.21.15.67:0/2221799960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 0x7f0874070990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0868004970 tx=0x7f0868009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:55.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.816+0000 7f0878a2a700 1 -- 172.21.15.67:0/2221799960 shutdown_connections 2023-12-05T09:31:55.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.816+0000 7f0878a2a700 1 --2- 172.21.15.67:0/2221799960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 0x7f0874070990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.816+0000 7f0878a2a700 1 --2- 172.21.15.67:0/2221799960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874071c10 0x7f087406ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.816+0000 7f0878a2a700 1 -- 172.21.15.67:0/2221799960 >> 172.21.15.67:0/2221799960 conn(0x7f08740f8560 msgr2=0x7f08740fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:55.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.816+0000 7f0878a2a700 1 -- 172.21.15.67:0/2221799960 shutdown_connections 2023-12-05T09:31:55.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.816+0000 7f0878a2a700 1 -- 172.21.15.67:0/2221799960 wait complete. 2023-12-05T09:31:55.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.817+0000 7f0878a2a700 1 Processor -- start 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.817+0000 7f0878a2a700 1 -- start start 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0878a2a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 0x7f0874119a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0878a2a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874071c10 0x7f0874119f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0878a2a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087411a5c0 con 0x7f0874070520 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0878a2a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08741138f0 con 0x7f0874071c10 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0872d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 0x7f0874119a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0872d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 0x7f0874119a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:60340/0 (socket says 172.21.15.67:60340) 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0872d9d700 1 -- 172.21.15.67:0/632717634 learned_addr learned my addr 172.21.15.67:0/632717634 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f087259c700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874071c10 0x7f0874119f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0872d9d700 1 -- 172.21.15.67:0/632717634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874071c10 msgr2=0x7f0874119f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0872d9d700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874071c10 0x7f0874119f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.818+0000 7f0872d9d700 1 -- 172.21.15.67:0/632717634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868005040 con 0x7f0874070520 2023-12-05T09:31:55.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.819+0000 7f0872d9d700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 0x7f0874119a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0864002a50 tx=0x7f08640046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:55.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.819+0000 7f085b7fe700 1 -- 172.21.15.67:0/632717634 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0864007cc0 con 0x7f0874070520 2023-12-05T09:31:55.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.819+0000 7f085b7fe700 1 -- 172.21.15.67:0/632717634 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f086400f040 con 0x7f0874070520 2023-12-05T09:31:55.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.819+0000 7f085b7fe700 1 -- 172.21.15.67:0/632717634 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0864009540 con 0x7f0874070520 2023-12-05T09:31:55.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.819+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0874113bd0 con 0x7f0874070520 2023-12-05T09:31:55.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.819+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08741140e0 con 0x7f0874070520 2023-12-05T09:31:55.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.820+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08740fdea0 con 0x7f0874070520 2023-12-05T09:31:55.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.821+0000 7f085b7fe700 1 -- 172.21.15.67:0/632717634 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7f08640096a0 con 0x7f0874070520 2023-12-05T09:31:55.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.822+0000 7f085b7fe700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f085c06cf80 0x7f085c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:55.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.822+0000 7f085b7fe700 1 -- 172.21.15.67:0/632717634 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f086408c410 con 0x7f0874070520 2023-12-05T09:31:55.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.823+0000 7f087259c700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f085c06cf80 0x7f085c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:55.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.823+0000 7f087259c700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f085c06cf80 0x7f085c06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0874114c20 tx=0x7f0868009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:55.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:55.827+0000 7f085b7fe700 1 -- 172.21.15.67:0/632717634 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0864059ac0 con 0x7f0874070520 2023-12-05T09:31:56.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.059+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f087404bbf0 con 0x7f085c06cf80 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.060+0000 7f085b7fe700 1 -- 172.21.15.67:0/632717634 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f087404bbf0 con 0x7f085c06cf80 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: "mon" 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:31:56.059 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "7/21 daemons upgraded", 2023-12-05T09:31:56.060 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T09:31:56.060 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:31:56.060 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:31:56.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f085c06cf80 msgr2=0x7f085c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:56.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f085c06cf80 0x7f085c06f430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0874114c20 tx=0x7f0868009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:56.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 msgr2=0x7f0874119a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:56.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 0x7f0874119a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0864002a50 tx=0x7f08640046b0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 shutdown_connections 2023-12-05T09:31:56.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f085c06cf80 0x7f085c06f430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0874070520 0x7f0874119a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 --2- 172.21.15.67:0/632717634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0874071c10 0x7f0874119f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 >> 172.21.15.67:0/632717634 conn(0x7f08740f8560 msgr2=0x7f087410cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:56.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 shutdown_connections 2023-12-05T09:31:56.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.063+0000 7f0878a2a700 1 -- 172.21.15.67:0/632717634 wait complete. 2023-12-05T09:31:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.202+0000 7fc2e53be700 1 -- 172.21.15.67:0/1822724321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 msgr2=0x7fc2e0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.202+0000 7fc2e53be700 1 --2- 172.21.15.67:0/1822724321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 0x7fc2e0102fd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0004940 tx=0x7fc2d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.202+0000 7fc2e53be700 1 -- 172.21.15.67:0/1822724321 shutdown_connections 2023-12-05T09:31:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.202+0000 7fc2e53be700 1 --2- 172.21.15.67:0/1822724321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e01035a0 0x7fc2e00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.202+0000 7fc2e53be700 1 --2- 172.21.15.67:0/1822724321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 0x7fc2e0102fd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.202+0000 7fc2e53be700 1 -- 172.21.15.67:0/1822724321 >> 172.21.15.67:0/1822724321 conn(0x7fc2e00f8790 msgr2=0x7fc2e00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.202+0000 7fc2e53be700 1 -- 172.21.15.67:0/1822724321 shutdown_connections 2023-12-05T09:31:56.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.202+0000 7fc2e53be700 1 -- 172.21.15.67:0/1822724321 wait complete. 2023-12-05T09:31:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.203+0000 7fc2e53be700 1 Processor -- start 2023-12-05T09:31:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.203+0000 7fc2e53be700 1 -- start start 2023-12-05T09:31:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.203+0000 7fc2e53be700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 0x7fc2e0113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.203+0000 7fc2e53be700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e01035a0 0x7fc2e0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.203+0000 7fc2e53be700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01141e0 con 0x7fc2e0102c00 2023-12-05T09:31:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.203+0000 7fc2e53be700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e010d4d0 con 0x7fc2e01035a0 2023-12-05T09:31:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.204+0000 7fc2deffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 0x7fc2e0113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:56.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.204+0000 7fc2deffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 0x7fc2e0113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52352/0 (socket says 172.21.15.67:52352) 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.204+0000 7fc2deffd700 1 -- 172.21.15.67:0/137227551 learned_addr learned my addr 172.21.15.67:0/137227551 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.204+0000 7fc2deffd700 1 -- 172.21.15.67:0/137227551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e01035a0 msgr2=0x7fc2e0113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.204+0000 7fc2deffd700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e01035a0 0x7fc2e0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.204+0000 7fc2deffd700 1 -- 172.21.15.67:0/137227551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0005040 con 0x7fc2e0102c00 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.204+0000 7fc2deffd700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 0x7fc2e0113610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009360 tx=0x7fc2d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.204+0000 7fc2c77fe700 1 -- 172.21.15.67:0/137227551 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d000e040 con 0x7fc2e0102c00 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.205+0000 7fc2c77fe700 1 -- 172.21.15.67:0/137227551 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2d000bc50 con 0x7fc2e0102c00 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.205+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e010d700 con 0x7fc2e0102c00 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.205+0000 7fc2c77fe700 1 -- 172.21.15.67:0/137227551 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d001c630 con 0x7fc2e0102c00 2023-12-05T09:31:56.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.205+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e010dc40 con 0x7fc2e0102c00 2023-12-05T09:31:56.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.206+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e00fff10 con 0x7fc2e0102c00 2023-12-05T09:31:56.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.207+0000 7fc2c77fe700 1 -- 172.21.15.67:0/137227551 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 38) v1 ==== 91038+0+0 (secure 0 0 0) 0x7fc2d0013420 con 0x7fc2e0102c00 2023-12-05T09:31:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.207+0000 7fc2c77fe700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc2c806cf80 0x7fc2c806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:31:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.208+0000 7fc2c77fe700 1 -- 172.21.15.67:0/137227551 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc2d008d7f0 con 0x7fc2e0102c00 2023-12-05T09:31:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.208+0000 7fc2de7fc700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc2c806cf80 0x7fc2c806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:31:56.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.208+0000 7fc2de7fc700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc2c806cf80 0x7fc2c806f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc2e010eeb0 tx=0x7fc2d4009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:31:56.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.212+0000 7fc2c77fe700 1 -- 172.21.15.67:0/137227551 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc2d005afa0 con 0x7fc2e0102c00 2023-12-05T09:31:56.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:55 smithi067 ceph-mon[210894]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/378 objects degraded (3.439%), 3 pgs degraded) 2023-12-05T09:31:56.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:55 smithi067 ceph-mon[210894]: Cluster is now healthy 2023-12-05T09:31:56.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:55 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3563663679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:56.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:55 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3347489396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:31:56.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:55 smithi134 ceph-mon[172895]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/378 objects degraded (3.439%), 3 pgs degraded) 2023-12-05T09:31:56.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:55 smithi134 ceph-mon[172895]: Cluster is now healthy 2023-12-05T09:31:56.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:55 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3563663679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:31:56.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:55 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3347489396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:31:56.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.503+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc2e004bb80 con 0x7fc2e0102c00 2023-12-05T09:31:56.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.503+0000 7fc2c77fe700 1 -- 172.21.15.67:0/137227551 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc2d005ab30 con 0x7fc2e0102c00 2023-12-05T09:31:56.502 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_OK 2023-12-05T09:31:56.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc2c806cf80 msgr2=0x7fc2c806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:56.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc2c806cf80 0x7fc2c806f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc2e010eeb0 tx=0x7fc2d4009ce0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 msgr2=0x7fc2e0113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:31:56.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 0x7fc2e0113610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009360 tx=0x7fc2d0009e30 comp rx=0 tx=0).stop 2023-12-05T09:31:56.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 shutdown_connections 2023-12-05T09:31:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fc2c806cf80 0x7fc2c806f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc2e0102c00 0x7fc2e0113610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 --2- 172.21.15.67:0/137227551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2e01035a0 0x7fc2e0113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:31:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.505+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 >> 172.21.15.67:0/137227551 conn(0x7fc2e00f8790 msgr2=0x7fc2e00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:31:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.506+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 shutdown_connections 2023-12-05T09:31:56.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:31:56.506+0000 7fc2e53be700 1 -- 172.21.15.67:0/137227551 wait complete. 2023-12-05T09:31:57.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:56 smithi067 ceph-mon[210894]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:57.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:56 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/137227551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:31:57.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:56 smithi067 ceph-mon[210894]: pgmap v51: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:31:57.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:56 smithi134 ceph-mon[172895]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:31:57.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:56 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/137227551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:31:57.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:56 smithi134 ceph-mon[172895]: pgmap v51: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:00.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:31:59 smithi067 ceph-mon[210894]: pgmap v52: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:00.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:31:59 smithi134 ceph-mon[172895]: pgmap v52: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:01 smithi067 ceph-mon[210894]: pgmap v53: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:32:02.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:01 smithi134 ceph-mon[172895]: pgmap v53: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:32:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:04.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:03 smithi067 ceph-mon[210894]: pgmap v54: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 432 B/s wr, 0 op/s 2023-12-05T09:32:04.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:03 smithi067 ceph-mon[210894]: mgrmap e39: smithi067.alxtvv(active, since 92s), standbys: smithi134.yfqkak 2023-12-05T09:32:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:03 smithi134 ceph-mon[172895]: pgmap v54: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 432 B/s wr, 0 op/s 2023-12-05T09:32:04.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:03 smithi134 ceph-mon[172895]: mgrmap e39: smithi067.alxtvv(active, since 92s), standbys: smithi134.yfqkak 2023-12-05T09:32:06.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:05 smithi067 ceph-mon[210894]: pgmap v55: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:32:06.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:05 smithi134 ceph-mon[172895]: pgmap v55: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:32:07.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:06 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T09:32:07.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:06 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T09:32:07.981 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:07 smithi067 ceph-mon[210894]: pgmap v56: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:32:07.981 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:07 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T09:32:07.981 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:07 smithi067 ceph-mon[210894]: Upgrade: osd.1 is safe to restart 2023-12-05T09:32:08.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:07 smithi134 ceph-mon[172895]: pgmap v56: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:32:08.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:07 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-05T09:32:08.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:07 smithi134 ceph-mon[172895]: Upgrade: osd.1 is safe to restart 2023-12-05T09:32:09.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:09 smithi067 ceph-mon[210894]: Upgrade: Updating osd.1 2023-12-05T09:32:09.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:09 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:09.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:09 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:32:09.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:09 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:32:09.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:09 smithi067 ceph-mon[210894]: Deploying daemon osd.1 on smithi067 2023-12-05T09:32:09.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:09 smithi067 ceph-mon[210894]: pgmap v57: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:32:09.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:09 smithi134 ceph-mon[172895]: Upgrade: Updating osd.1 2023-12-05T09:32:09.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:09 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:09.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:09 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-05T09:32:09.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:09 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:32:09.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:09 smithi134 ceph-mon[172895]: Deploying daemon osd.1 on smithi067 2023-12-05T09:32:09.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:09 smithi134 ceph-mon[172895]: pgmap v57: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:32:11.123 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:10 smithi067 systemd[1]: Stopping Ceph osd.1 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:32:11.123 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:11 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[139715]: 2023-12-05T09:32:11.123+0000 7f94afb03700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:32:11.123 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:11 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[139715]: 2023-12-05T09:32:11.123+0000 7f94afb03700 -1 osd.1 56 *** Got signal Terminated *** 2023-12-05T09:32:11.123 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:11 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[139715]: 2023-12-05T09:32:11.123+0000 7f94afb03700 -1 osd.1 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:32:11.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:11 smithi067 ceph-mon[210894]: pgmap v58: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:32:11.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:11 smithi067 ceph-mon[210894]: osd.1 marked itself down and dead 2023-12-05T09:32:11.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:11 smithi134 ceph-mon[172895]: pgmap v58: 65 pgs: 65 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2023-12-05T09:32:11.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:11 smithi134 ceph-mon[172895]: osd.1 marked itself down and dead 2023-12-05T09:32:12.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:11 smithi067 bash[231536]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1 2023-12-05T09:32:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:12 smithi067 ceph-mon[210894]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:32:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:12 smithi067 ceph-mon[210894]: failed to encode map e57 with expected crc 2023-12-05T09:32:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:12 smithi067 ceph-mon[210894]: failed to encode map e57 with expected crc 2023-12-05T09:32:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:12 smithi067 ceph-mon[210894]: failed to encode map e57 with expected crc 2023-12-05T09:32:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:12 smithi067 ceph-mon[210894]: osdmap e57: 6 total, 5 up, 6 in 2023-12-05T09:32:12.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:12 smithi067 ceph-mon[210894]: failed to encode map e57 with expected crc 2023-12-05T09:32:12.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:12 smithi134 ceph-mon[172895]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:32:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:12 smithi134 ceph-mon[172895]: failed to encode map e57 with expected crc 2023-12-05T09:32:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:12 smithi134 ceph-mon[172895]: failed to encode map e57 with expected crc 2023-12-05T09:32:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:12 smithi134 ceph-mon[172895]: failed to encode map e57 with expected crc 2023-12-05T09:32:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:12 smithi134 ceph-mon[172895]: osdmap e57: 6 total, 5 up, 6 in 2023-12-05T09:32:12.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:12 smithi134 ceph-mon[172895]: failed to encode map e57 with expected crc 2023-12-05T09:32:13.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:13 smithi067 ceph-mon[210894]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:13 smithi067 ceph-mon[210894]: osdmap e58: 6 total, 5 up, 6 in 2023-12-05T09:32:13.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:13 smithi067 ceph-mon[210894]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:13 smithi067 ceph-mon[210894]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:13 smithi067 ceph-mon[210894]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:13 smithi067 ceph-mon[210894]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:13 smithi067 ceph-mon[210894]: pgmap v61: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:13.619 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:13 smithi067 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.1.service: Succeeded. 2023-12-05T09:32:13.619 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:13 smithi067 systemd[1]: Stopped Ceph osd.1 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:32:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:13 smithi134 ceph-mon[172895]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:13 smithi134 ceph-mon[172895]: osdmap e58: 6 total, 5 up, 6 in 2023-12-05T09:32:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:13 smithi134 ceph-mon[172895]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:13 smithi134 ceph-mon[172895]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:13 smithi134 ceph-mon[172895]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:13 smithi134 ceph-mon[172895]: failed to encode map e58 with expected crc 2023-12-05T09:32:13.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:13 smithi134 ceph-mon[172895]: pgmap v61: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:14.006 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:13 smithi067 systemd[1]: Starting Ceph osd.1 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:32:14.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:14 smithi067 ceph-mon[210894]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2023-12-05T09:32:14.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:14 smithi134 ceph-mon[172895]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2023-12-05T09:32:15.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:14 smithi067 bash[231806]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-05T09:32:15.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:14 smithi067 bash[231806]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-05T09:32:15.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:14 smithi067 bash[231806]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-05T09:32:15.119 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:14 smithi067 bash[231806]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-05T09:32:15.119 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:14 smithi067 bash[231806]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-05T09:32:15.119 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:14 smithi067 bash[231806]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-05T09:32:15.119 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:14 smithi067 bash[231806]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-05T09:32:15.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:15 smithi067 ceph-mon[210894]: pgmap v62: 65 pgs: 2 active+undersized+degraded, 29 peering, 3 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8/378 objects degraded (2.116%) 2023-12-05T09:32:15.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:15 smithi134 ceph-mon[172895]: pgmap v62: 65 pgs: 2 active+undersized+degraded, 29 peering, 3 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8/378 objects degraded (2.116%) 2023-12-05T09:32:16.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:15 smithi067 bash[232083]: 5c8edfa1578a1d1c95da6cf1298b1ce0b0c6ea619d06802829ce18e78a1e0bc6 2023-12-05T09:32:16.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:15 smithi067 systemd[1]: Started Ceph osd.1 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:32:16.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:15 smithi067 ceph-osd[232121]: -- 172.21.15.67:0/4294099697 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55738fd7d1e0 con 0x55738fd4cc00 2023-12-05T09:32:16.618 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:16 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[232098]: 2023-12-05T09:32:16.163+0000 7efff9bbc640 -1 Falling back to public interface 2023-12-05T09:32:16.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:16 smithi067 ceph-mon[210894]: Health check failed: Degraded data redundancy: 8/378 objects degraded (2.116%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T09:32:16.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:16.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:16.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:32:16.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:16.619 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:32:16.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:16 smithi134 ceph-mon[172895]: Health check failed: Degraded data redundancy: 8/378 objects degraded (2.116%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T09:32:16.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:16.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:16.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:32:16.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:16.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:32:17.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:17 smithi067 ceph-mon[210894]: pgmap v63: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:17.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:17 smithi134 ceph-mon[172895]: pgmap v63: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:18.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:18 smithi067 ceph-mon[210894]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2023-12-05T09:32:18.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:18 smithi134 ceph-mon[172895]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2023-12-05T09:32:19.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:19 smithi067 ceph-mon[210894]: pgmap v64: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:19.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:19 smithi134 ceph-mon[172895]: pgmap v64: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:21.618 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:21 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[232098]: 2023-12-05T09:32:21.274+0000 7efff9bbc640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-05T09:32:21.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:21 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:21.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:21 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:21.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:21 smithi067 ceph-mon[210894]: pgmap v65: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:21 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:21 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:21.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:21 smithi134 ceph-mon[172895]: pgmap v65: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:22.368 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:21 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[232098]: 2023-12-05T09:32:21.959+0000 7efff9bbc640 -1 osd.1 56 log_to_monitors true 2023-12-05T09:32:23.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:32:22 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[232098]: 2023-12-05T09:32:22.847+0000 7effe8828700 -1 osd.1 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:32:23.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:22 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:23.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:22 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:23.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:22 smithi067 ceph-mon[210894]: from='osd.1 [v2:172.21.15.67:6810/95427693,v1:172.21.15.67:6811/95427693]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T09:32:23.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:22 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:23.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:22 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:23.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:22 smithi134 ceph-mon[172895]: from='osd.1 [v2:172.21.15.67:6810/95427693,v1:172.21.15.67:6811/95427693]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-05T09:32:24.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:23 smithi067 ceph-mon[210894]: pgmap v66: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:24.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:23 smithi067 ceph-mon[210894]: from='osd.1 [v2:172.21.15.67:6810/95427693,v1:172.21.15.67:6811/95427693]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T09:32:24.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:23 smithi067 ceph-mon[210894]: osdmap e59: 6 total, 5 up, 6 in 2023-12-05T09:32:24.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:23 smithi067 ceph-mon[210894]: from='osd.1 [v2:172.21.15.67:6810/95427693,v1:172.21.15.67:6811/95427693]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:32:24.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:23 smithi067 ceph-mon[210894]: failed to encode map e59 with expected crc 2023-12-05T09:32:24.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:23 smithi067 ceph-mon[210894]: failed to encode map e59 with expected crc 2023-12-05T09:32:24.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:23 smithi134 ceph-mon[172895]: pgmap v66: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:24.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:23 smithi134 ceph-mon[172895]: from='osd.1 [v2:172.21.15.67:6810/95427693,v1:172.21.15.67:6811/95427693]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-05T09:32:24.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:23 smithi134 ceph-mon[172895]: osdmap e59: 6 total, 5 up, 6 in 2023-12-05T09:32:24.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:23 smithi134 ceph-mon[172895]: from='osd.1 [v2:172.21.15.67:6810/95427693,v1:172.21.15.67:6811/95427693]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:32:24.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:23 smithi134 ceph-mon[172895]: failed to encode map e59 with expected crc 2023-12-05T09:32:24.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:23 smithi134 ceph-mon[172895]: failed to encode map e59 with expected crc 2023-12-05T09:32:25.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:24 smithi067 ceph-mon[210894]: failed to encode map e59 with expected crc 2023-12-05T09:32:25.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:24 smithi067 ceph-mon[210894]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:32:25.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:24 smithi067 ceph-mon[210894]: failed to encode map e60 with expected crc 2023-12-05T09:32:25.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:24 smithi067 ceph-mon[210894]: osd.1 [v2:172.21.15.67:6810/95427693,v1:172.21.15.67:6811/95427693] boot 2023-12-05T09:32:25.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:24 smithi067 ceph-mon[210894]: osdmap e60: 6 total, 6 up, 6 in 2023-12-05T09:32:25.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:24 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:32:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:24 smithi134 ceph-mon[172895]: failed to encode map e59 with expected crc 2023-12-05T09:32:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:24 smithi134 ceph-mon[172895]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:32:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:24 smithi134 ceph-mon[172895]: failed to encode map e60 with expected crc 2023-12-05T09:32:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:24 smithi134 ceph-mon[172895]: osd.1 [v2:172.21.15.67:6810/95427693,v1:172.21.15.67:6811/95427693] boot 2023-12-05T09:32:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:24 smithi134 ceph-mon[172895]: osdmap e60: 6 total, 6 up, 6 in 2023-12-05T09:32:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:24 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-05T09:32:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: pgmap v69: 65 pgs: 2 peering, 16 active+undersized+degraded, 16 active+undersized, 31 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: osdmap e61: 6 total, 6 up, 6 in 2023-12-05T09:32:26.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 58/378 objects degraded (15.344%), 16 pgs degraded (PG_DEGRADED) 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:26.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:25 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: pgmap v69: 65 pgs: 2 peering, 16 active+undersized+degraded, 16 active+undersized, 31 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: osdmap e61: 6 total, 6 up, 6 in 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: failed to encode map e61 with expected crc 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:32:26.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:26.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 58/378 objects degraded (15.344%), 16 pgs degraded (PG_DEGRADED) 2023-12-05T09:32:26.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:32:26.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:26.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:26.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:26.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:25 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T09:32:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.660+0000 7f3fe5e54700 1 -- 172.21.15.67:0/339036131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe01035a0 msgr2=0x7f3fe00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.660+0000 7f3fe5e54700 1 --2- 172.21.15.67:0/339036131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe01035a0 0x7f3fe00fcc10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4004940 tx=0x7f3fd4009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.660+0000 7f3fe5e54700 1 -- 172.21.15.67:0/339036131 shutdown_connections 2023-12-05T09:32:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.660+0000 7f3fe5e54700 1 --2- 172.21.15.67:0/339036131 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe01035a0 0x7f3fe00fcc10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.660+0000 7f3fe5e54700 1 --2- 172.21.15.67:0/339036131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe0102c00 0x7f3fe0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.660+0000 7f3fe5e54700 1 -- 172.21.15.67:0/339036131 >> 172.21.15.67:0/339036131 conn(0x7f3fe00f8790 msgr2=0x7f3fe00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:26.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.660+0000 7f3fe5e54700 1 -- 172.21.15.67:0/339036131 shutdown_connections 2023-12-05T09:32:26.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.661+0000 7f3fe5e54700 1 -- 172.21.15.67:0/339036131 wait complete. 2023-12-05T09:32:26.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.661+0000 7f3fe5e54700 1 Processor -- start 2023-12-05T09:32:26.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.662+0000 7f3fe5e54700 1 -- start start 2023-12-05T09:32:26.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.662+0000 7f3fe5e54700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe0102c00 0x7f3fe0115890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:26.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.662+0000 7f3fe5e54700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe01035a0 0x7f3fe0115dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:26.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.662+0000 7f3fe5e54700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0116420 con 0x7f3fe0102c00 2023-12-05T09:32:26.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.662+0000 7f3fe5e54700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe010f750 con 0x7f3fe01035a0 2023-12-05T09:32:26.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.662+0000 7f3fdf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe0102c00 0x7f3fe0115890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:26.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.662+0000 7f3fdf7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe0102c00 0x7f3fe0115890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57614/0 (socket says 172.21.15.67:57614) 2023-12-05T09:32:26.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.662+0000 7f3fdf7fe700 1 -- 172.21.15.67:0/524860417 learned_addr learned my addr 172.21.15.67:0/524860417 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fdeffd700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe01035a0 0x7f3fe0115dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fdf7fe700 1 -- 172.21.15.67:0/524860417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe01035a0 msgr2=0x7f3fe0115dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fdf7fe700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe01035a0 0x7f3fe0115dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fdf7fe700 1 -- 172.21.15.67:0/524860417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4005040 con 0x7f3fe0102c00 2023-12-05T09:32:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fdeffd700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe01035a0 0x7f3fe0115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:32:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fdf7fe700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe0102c00 0x7f3fe0115890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0002a50 tx=0x7f3fd00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fc7fff700 1 -- 172.21.15.67:0/524860417 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd0007cc0 con 0x7f3fe0102c00 2023-12-05T09:32:26.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fc7fff700 1 -- 172.21.15.67:0/524860417 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3fd000f040 con 0x7f3fe0102c00 2023-12-05T09:32:26.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fc7fff700 1 -- 172.21.15.67:0/524860417 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd0009540 con 0x7f3fe0102c00 2023-12-05T09:32:26.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe010fa30 con 0x7f3fe0102c00 2023-12-05T09:32:26.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.663+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe010ff70 con 0x7f3fe0102c00 2023-12-05T09:32:26.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.664+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe00fc390 con 0x7f3fe0102c00 2023-12-05T09:32:26.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.665+0000 7f3fc7fff700 1 -- 172.21.15.67:0/524860417 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f3fd00096a0 con 0x7f3fe0102c00 2023-12-05T09:32:26.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.667+0000 7f3fc7fff700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3fc806ce70 0x7f3fc806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:26.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.667+0000 7f3fc7fff700 1 -- 172.21.15.67:0/524860417 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3fd008c080 con 0x7f3fe0102c00 2023-12-05T09:32:26.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.667+0000 7f3fdeffd700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3fc806ce70 0x7f3fc806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:26.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.668+0000 7f3fdeffd700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3fc806ce70 0x7f3fc806f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400b3b0 tx=0x7f3fd4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:26.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.672+0000 7f3fc7fff700 1 -- 172.21.15.67:0/524860417 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3fd00599d0 con 0x7f3fe0102c00 2023-12-05T09:32:26.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.902+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fe0110e70 con 0x7f3fc806ce70 2023-12-05T09:32:26.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.903+0000 7f3fc7fff700 1 -- 172.21.15.67:0/524860417 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3fe0110e70 con 0x7f3fc806ce70 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3fc806ce70 msgr2=0x7f3fc806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3fc806ce70 0x7f3fc806f320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400b3b0 tx=0x7f3fd4009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe0102c00 msgr2=0x7f3fe0115890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe0102c00 0x7f3fe0115890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0002a50 tx=0x7f3fd00046b0 comp rx=0 tx=0).stop 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 shutdown_connections 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3fc806ce70 0x7f3fc806f320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fe0102c00 0x7f3fe0115890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 --2- 172.21.15.67:0/524860417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe01035a0 0x7f3fe0115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.905+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 >> 172.21.15.67:0/524860417 conn(0x7f3fe00f8790 msgr2=0x7f3fe00fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.906+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 shutdown_connections 2023-12-05T09:32:26.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:26.906+0000 7f3fe5e54700 1 -- 172.21.15.67:0/524860417 wait complete. 2023-12-05T09:32:26.920 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:32:27.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.045+0000 7fee82848700 1 -- 172.21.15.67:0/617157049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 msgr2=0x7fee7c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.045+0000 7fee82848700 1 --2- 172.21.15.67:0/617157049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 0x7fee7c102fd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee6c004940 tx=0x7fee6c009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:27.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.046+0000 7fee82848700 1 -- 172.21.15.67:0/617157049 shutdown_connections 2023-12-05T09:32:27.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.046+0000 7fee82848700 1 --2- 172.21.15.67:0/617157049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee7c1035a0 0x7fee7c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.046+0000 7fee82848700 1 --2- 172.21.15.67:0/617157049 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 0x7fee7c102fd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.046+0000 7fee82848700 1 -- 172.21.15.67:0/617157049 >> 172.21.15.67:0/617157049 conn(0x7fee7c0f8790 msgr2=0x7fee7c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:27.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.046+0000 7fee82848700 1 -- 172.21.15.67:0/617157049 shutdown_connections 2023-12-05T09:32:27.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.046+0000 7fee82848700 1 -- 172.21.15.67:0/617157049 wait complete. 2023-12-05T09:32:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.047+0000 7fee82848700 1 Processor -- start 2023-12-05T09:32:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.047+0000 7fee82848700 1 -- start start 2023-12-05T09:32:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.047+0000 7fee82848700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 0x7fee7c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.047+0000 7fee82848700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee7c1035a0 0x7fee7c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.047+0000 7fee82848700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c070a80 con 0x7fee7c102c00 2023-12-05T09:32:27.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.047+0000 7fee82848700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c070bf0 con 0x7fee7c1035a0 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.047+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 0x7fee7c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee7bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 0x7fee7c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57628/0 (socket says 172.21.15.67:57628) 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee7bfff700 1 -- 172.21.15.67:0/2684937862 learned_addr learned my addr 172.21.15.67:0/2684937862 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee7b7fe700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee7c1035a0 0x7fee7c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee7bfff700 1 -- 172.21.15.67:0/2684937862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee7c1035a0 msgr2=0x7fee7c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee7bfff700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee7c1035a0 0x7fee7c070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee7bfff700 1 -- 172.21.15.67:0/2684937862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c005040 con 0x7fee7c102c00 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee7b7fe700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee7c1035a0 0x7fee7c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee7bfff700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 0x7fee7c06ff40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009fd0 tx=0x7fee6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:27.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee78ff9700 1 -- 172.21.15.67:0/2684937862 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee6c00e040 con 0x7fee7c102c00 2023-12-05T09:32:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee78ff9700 1 -- 172.21.15.67:0/2684937862 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee6c00bc50 con 0x7fee7c102c00 2023-12-05T09:32:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee78ff9700 1 -- 172.21.15.67:0/2684937862 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee6c013ea0 con 0x7fee7c102c00 2023-12-05T09:32:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.048+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c119870 con 0x7fee7c102c00 2023-12-05T09:32:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.049+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c119cd0 con 0x7fee7c102c00 2023-12-05T09:32:27.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.050+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c0fff10 con 0x7fee7c102c00 2023-12-05T09:32:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.051+0000 7fee78ff9700 1 -- 172.21.15.67:0/2684937862 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fee6c013420 con 0x7fee7c102c00 2023-12-05T09:32:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.052+0000 7fee78ff9700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fee6406ce70 0x7fee6406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.052+0000 7fee78ff9700 1 -- 172.21.15.67:0/2684937862 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fee6c08d810 con 0x7fee7c102c00 2023-12-05T09:32:27.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.052+0000 7fee7b7fe700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fee6406ce70 0x7fee6406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.053+0000 7fee7b7fe700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fee6406ce70 0x7fee6406f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fee70009fd0 tx=0x7fee70009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:27.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.056+0000 7fee78ff9700 1 -- 172.21.15.67:0/2684937862 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fee6c0576d0 con 0x7fee7c102c00 2023-12-05T09:32:27.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:26 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T09:32:27.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:26 smithi067 ceph-mon[210894]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-05T09:32:27.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:26 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T09:32:27.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:26 smithi134 ceph-mon[172895]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2023-12-05T09:32:27.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.286+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee7c0716f0 con 0x7fee6406ce70 2023-12-05T09:32:27.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.287+0000 7fee78ff9700 1 -- 172.21.15.67:0/2684937862 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fee7c0716f0 con 0x7fee6406ce70 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fee6406ce70 msgr2=0x7fee6406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fee6406ce70 0x7fee6406f320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fee70009fd0 tx=0x7fee70009f20 comp rx=0 tx=0).stop 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 msgr2=0x7fee7c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 0x7fee7c06ff40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009fd0 tx=0x7fee6c009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 shutdown_connections 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fee6406ce70 0x7fee6406f320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fee7c102c00 0x7fee7c06ff40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 --2- 172.21.15.67:0/2684937862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee7c1035a0 0x7fee7c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 >> 172.21.15.67:0/2684937862 conn(0x7fee7c0f8790 msgr2=0x7fee7c0fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 shutdown_connections 2023-12-05T09:32:27.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.290+0000 7fee82848700 1 -- 172.21.15.67:0/2684937862 wait complete. 2023-12-05T09:32:27.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.429+0000 7f06bf7f9700 1 -- 172.21.15.67:0/3228163082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b80fbb40 msgr2=0x7f06b80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.429+0000 7f06bf7f9700 1 --2- 172.21.15.67:0/3228163082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b80fbb40 0x7f06b80fbfb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06a8004940 tx=0x7f06a8009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:27.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.430+0000 7f06bf7f9700 1 -- 172.21.15.67:0/3228163082 shutdown_connections 2023-12-05T09:32:27.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.430+0000 7f06bf7f9700 1 --2- 172.21.15.67:0/3228163082 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b80fbb40 0x7f06b80fbfb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.430+0000 7f06bf7f9700 1 --2- 172.21.15.67:0/3228163082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b8101b00 0x7f06b8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.430+0000 7f06bf7f9700 1 -- 172.21.15.67:0/3228163082 >> 172.21.15.67:0/3228163082 conn(0x7f06b80719b0 msgr2=0x7f06b8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:27.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.430+0000 7f06bf7f9700 1 -- 172.21.15.67:0/3228163082 shutdown_connections 2023-12-05T09:32:27.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.430+0000 7f06bf7f9700 1 -- 172.21.15.67:0/3228163082 wait complete. 2023-12-05T09:32:27.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bf7f9700 1 Processor -- start 2023-12-05T09:32:27.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bf7f9700 1 -- start start 2023-12-05T09:32:27.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bf7f9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b80fbb40 0x7f06b8113690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bf7f9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b8101b00 0x7f06b8113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bf7f9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8114260 con 0x7f06b8101b00 2023-12-05T09:32:27.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bf7f9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b810d550 con 0x7f06b80fbb40 2023-12-05T09:32:27.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bcd94700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b8101b00 0x7f06b8113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bcd94700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b8101b00 0x7f06b8113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57656/0 (socket says 172.21.15.67:57656) 2023-12-05T09:32:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bcd94700 1 -- 172.21.15.67:0/2494325509 learned_addr learned my addr 172.21.15.67:0/2494325509 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.431+0000 7f06bd595700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b80fbb40 0x7f06b8113690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.432+0000 7f06bcd94700 1 -- 172.21.15.67:0/2494325509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b80fbb40 msgr2=0x7f06b8113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.432+0000 7f06bcd94700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b80fbb40 0x7f06b8113690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.432+0000 7f06bcd94700 1 -- 172.21.15.67:0/2494325509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8005040 con 0x7f06b8101b00 2023-12-05T09:32:27.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.432+0000 7f06bcd94700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b8101b00 0x7f06b8113c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009180 tx=0x7f06a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.432+0000 7f06adffb700 1 -- 172.21.15.67:0/2494325509 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a800e040 con 0x7f06b8101b00 2023-12-05T09:32:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.432+0000 7f06adffb700 1 -- 172.21.15.67:0/2494325509 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06a8004290 con 0x7f06b8101b00 2023-12-05T09:32:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.432+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b810d780 con 0x7f06b8101b00 2023-12-05T09:32:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.432+0000 7f06adffb700 1 -- 172.21.15.67:0/2494325509 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06a801c3f0 con 0x7f06b8101b00 2023-12-05T09:32:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.433+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b810dcc0 con 0x7f06b8101b00 2023-12-05T09:32:27.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.434+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b80734d0 con 0x7f06b8101b00 2023-12-05T09:32:27.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.435+0000 7f06adffb700 1 -- 172.21.15.67:0/2494325509 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f06a8013420 con 0x7f06b8101b00 2023-12-05T09:32:27.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.435+0000 7f06adffb700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f06a406ce60 0x7f06a406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.436+0000 7f06adffb700 1 -- 172.21.15.67:0/2494325509 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f06a808d4c0 con 0x7f06b8101b00 2023-12-05T09:32:27.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.436+0000 7f06bd595700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f06a406ce60 0x7f06a406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.436+0000 7f06bd595700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f06a406ce60 0x7f06a406f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06b80fa100 tx=0x7f06b400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:27.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.440+0000 7f06adffb700 1 -- 172.21.15.67:0/2494325509 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f06a805af50 con 0x7f06b8101b00 2023-12-05T09:32:27.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.665+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f06b810ec70 con 0x7f06a406ce60 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.675+0000 7f06adffb700 1 -- 172.21.15.67:0/2494325509 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f06b810ec70 con 0x7f06a406ce60 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (3m) 7s ago 13m 16.0M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (68s) 7s ago 13m 7860k - 19.0.0-11-g3fe8d441 56dea28e5206 e6de51f67edd 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (64s) 61s ago 12m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 b78b9e680949 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (3m) 7s ago 13m 79.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (8m) 7s ago 8m 6296M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (8m) 7s ago 8m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (8m) 61s ago 8m 15.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (8m) 61s ago 8m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (5m) 7s ago 14m 517M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:32:27.675 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (4m) 61s ago 12m 451M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (2m) 7s ago 15m 64.0M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (100s) 61s ago 12m 42.2M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 c85edd1646d0 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (4m) 7s ago 13m 8522k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 61s ago 12m 8094k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (45s) 7s ago 12m 114M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 cc8a8add819d 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (12s) 7s ago 11m 12.8M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 5c8edfa1578a 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (11m) 7s ago 11m 671M 1618M 17.2.7-109-g1fd3ca3c e139fc5fd9fc c4f351349df9 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (10m) 61s ago 10m 1035M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (10m) 61s ago 10m 779M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (10m) 61s ago 10m 876M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:32:27.676 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (3m) 7s ago 13m 52.8M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:32:27.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f06a406ce60 msgr2=0x7f06a406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f06a406ce60 0x7f06a406f310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f06b80fa100 tx=0x7f06b400b040 comp rx=0 tx=0).stop 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b8101b00 msgr2=0x7f06b8113c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b8101b00 0x7f06b8113c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009180 tx=0x7f06a8009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 shutdown_connections 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b80fbb40 0x7f06b8113690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f06a406ce60 0x7f06a406f310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 --2- 172.21.15.67:0/2494325509 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f06b8101b00 0x7f06b8113c10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 >> 172.21.15.67:0/2494325509 conn(0x7f06b80719b0 msgr2=0x7f06b80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 shutdown_connections 2023-12-05T09:32:27.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.678+0000 7f06bf7f9700 1 -- 172.21.15.67:0/2494325509 wait complete. 2023-12-05T09:32:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.816+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3492729604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f4102c00 msgr2=0x7f97f4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.816+0000 7f97fc2fd700 1 --2- 172.21.15.67:0/3492729604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f4102c00 0x7f97f4102fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97f0004940 tx=0x7f97f0009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.816+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3492729604 shutdown_connections 2023-12-05T09:32:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.816+0000 7f97fc2fd700 1 --2- 172.21.15.67:0/3492729604 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f41035a0 0x7f97f40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.816+0000 7f97fc2fd700 1 --2- 172.21.15.67:0/3492729604 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f4102c00 0x7f97f4102fd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.816+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3492729604 >> 172.21.15.67:0/3492729604 conn(0x7f97f40f8790 msgr2=0x7f97f40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.816+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3492729604 shutdown_connections 2023-12-05T09:32:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.816+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3492729604 wait complete. 2023-12-05T09:32:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.817+0000 7f97fc2fd700 1 Processor -- start 2023-12-05T09:32:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.817+0000 7f97fc2fd700 1 -- start start 2023-12-05T09:32:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.817+0000 7f97fc2fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f4102c00 0x7f97f41157d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.817+0000 7f97fc2fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f41035a0 0x7f97f4115d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.817+0000 7f97fc2fd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4116360 con 0x7f97f41035a0 2023-12-05T09:32:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.817+0000 7f97fc2fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f410f690 con 0x7f97f4102c00 2023-12-05T09:32:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.818+0000 7f97f9898700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f41035a0 0x7f97f4115d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.818+0000 7f97f9898700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f41035a0 0x7f97f4115d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57684/0 (socket says 172.21.15.67:57684) 2023-12-05T09:32:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.818+0000 7f97f9898700 1 -- 172.21.15.67:0/3132947308 learned_addr learned my addr 172.21.15.67:0/3132947308 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.818+0000 7f97fa099700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f4102c00 0x7f97f41157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.818+0000 7f97f9898700 1 -- 172.21.15.67:0/3132947308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f4102c00 msgr2=0x7f97f41157d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.818+0000 7f97f9898700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f4102c00 0x7f97f41157d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.818+0000 7f97f9898700 1 -- 172.21.15.67:0/3132947308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f0005040 con 0x7f97f41035a0 2023-12-05T09:32:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.818+0000 7f97f9898700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f41035a0 0x7f97f4115d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97e400eb40 tx=0x7f97e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.819+0000 7f97eaffd700 1 -- 172.21.15.67:0/3132947308 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e4007cc0 con 0x7f97f41035a0 2023-12-05T09:32:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.819+0000 7f97eaffd700 1 -- 172.21.15.67:0/3132947308 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97e400f040 con 0x7f97f41035a0 2023-12-05T09:32:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.819+0000 7f97eaffd700 1 -- 172.21.15.67:0/3132947308 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e400ca30 con 0x7f97f41035a0 2023-12-05T09:32:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.819+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f410f910 con 0x7f97f41035a0 2023-12-05T09:32:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.819+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f410fe50 con 0x7f97f41035a0 2023-12-05T09:32:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.820+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f40fc390 con 0x7f97f41035a0 2023-12-05T09:32:27.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.821+0000 7f97eaffd700 1 -- 172.21.15.67:0/3132947308 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f97e400cb90 con 0x7f97f41035a0 2023-12-05T09:32:27.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.822+0000 7f97eaffd700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f97e006ce70 0x7f97e006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:27.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.822+0000 7f97eaffd700 1 -- 172.21.15.67:0/3132947308 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f97e408be30 con 0x7f97f41035a0 2023-12-05T09:32:27.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.822+0000 7f97fa099700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f97e006ce70 0x7f97e006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:27.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.823+0000 7f97fa099700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f97e006ce70 0x7f97e006f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f97f000b0d0 tx=0x7f97f0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:27.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:27.827+0000 7f97eaffd700 1 -- 172.21.15.67:0/3132947308 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f97e4059780 con 0x7f97f41035a0 2023-12-05T09:32:28.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:27 smithi067 ceph-mon[210894]: pgmap v71: 65 pgs: 2 peering, 7 active+undersized+degraded, 5 active+undersized, 51 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 25/378 objects degraded (6.614%) 2023-12-05T09:32:28.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.122+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97f404bb80 con 0x7f97f41035a0 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.123+0000 7f97eaffd700 1 -- 172.21.15.67:0/3132947308 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f97e4059310 con 0x7f97f41035a0 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T09:32:28.122 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 8, 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 6 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:32:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:32:28.124 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f97e006ce70 msgr2=0x7f97e006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f97e006ce70 0x7f97e006f320 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f97f000b0d0 tx=0x7f97f0009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f41035a0 msgr2=0x7f97f4115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f41035a0 0x7f97f4115d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97e400eb40 tx=0x7f97e400b040 comp rx=0 tx=0).stop 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 shutdown_connections 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97f4102c00 0x7f97f41157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f97e006ce70 0x7f97e006f320 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 --2- 172.21.15.67:0/3132947308 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97f41035a0 0x7f97f4115d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 >> 172.21.15.67:0/3132947308 conn(0x7f97f40f8790 msgr2=0x7f97f40fa000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 shutdown_connections 2023-12-05T09:32:28.125 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.125+0000 7f97fc2fd700 1 -- 172.21.15.67:0/3132947308 wait complete. 2023-12-05T09:32:28.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:27 smithi134 ceph-mon[172895]: pgmap v71: 65 pgs: 2 peering, 7 active+undersized+degraded, 5 active+undersized, 51 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 25/378 objects degraded (6.614%) 2023-12-05T09:32:28.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.263+0000 7efdb5c15700 1 -- 172.21.15.67:0/377301443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb0102c00 msgr2=0x7efdb0102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.263+0000 7efdb5c15700 1 --2- 172.21.15.67:0/377301443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb0102c00 0x7efdb0102fd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efda0004940 tx=0x7efda0009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.263+0000 7efdb5c15700 1 -- 172.21.15.67:0/377301443 shutdown_connections 2023-12-05T09:32:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.263+0000 7efdb5c15700 1 --2- 172.21.15.67:0/377301443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdb01035a0 0x7efdb00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.263+0000 7efdb5c15700 1 --2- 172.21.15.67:0/377301443 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb0102c00 0x7efdb0102fd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.263+0000 7efdb5c15700 1 -- 172.21.15.67:0/377301443 >> 172.21.15.67:0/377301443 conn(0x7efdb00f8790 msgr2=0x7efdb00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.263+0000 7efdb5c15700 1 -- 172.21.15.67:0/377301443 shutdown_connections 2023-12-05T09:32:28.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.263+0000 7efdb5c15700 1 -- 172.21.15.67:0/377301443 wait complete. 2023-12-05T09:32:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.264+0000 7efdb5c15700 1 Processor -- start 2023-12-05T09:32:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.264+0000 7efdb5c15700 1 -- start start 2023-12-05T09:32:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.264+0000 7efdb5c15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdb0102c00 0x7efdb0113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.264+0000 7efdb5c15700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb01035a0 0x7efdb0113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.264+0000 7efdb5c15700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0114210 con 0x7efdb01035a0 2023-12-05T09:32:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.264+0000 7efdb5c15700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb010d500 con 0x7efdb0102c00 2023-12-05T09:32:28.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.265+0000 7efdaeffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb01035a0 0x7efdb0113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.265+0000 7efdaeffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb01035a0 0x7efdb0113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57710/0 (socket says 172.21.15.67:57710) 2023-12-05T09:32:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.265+0000 7efdaeffd700 1 -- 172.21.15.67:0/3573047504 learned_addr learned my addr 172.21.15.67:0/3573047504 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.265+0000 7efdaf7fe700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdb0102c00 0x7efdb0113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.265+0000 7efdaeffd700 1 -- 172.21.15.67:0/3573047504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdb0102c00 msgr2=0x7efdb0113640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.265+0000 7efdaeffd700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdb0102c00 0x7efdb0113640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.265+0000 7efdaeffd700 1 -- 172.21.15.67:0/3573047504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0005040 con 0x7efdb01035a0 2023-12-05T09:32:28.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.265+0000 7efdaeffd700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb01035a0 0x7efdb0113bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efda400eb40 tx=0x7efda400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:28.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.266+0000 7efd97fff700 1 -- 172.21.15.67:0/3573047504 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda4007cc0 con 0x7efdb01035a0 2023-12-05T09:32:28.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.266+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb010d730 con 0x7efdb01035a0 2023-12-05T09:32:28.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.266+0000 7efd97fff700 1 -- 172.21.15.67:0/3573047504 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efda400f040 con 0x7efdb01035a0 2023-12-05T09:32:28.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.266+0000 7efd97fff700 1 -- 172.21.15.67:0/3573047504 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda400c8f0 con 0x7efdb01035a0 2023-12-05T09:32:28.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.266+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb010dc70 con 0x7efdb01035a0 2023-12-05T09:32:28.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.267+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb00fff10 con 0x7efdb01035a0 2023-12-05T09:32:28.267 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.268+0000 7efd97fff700 1 -- 172.21.15.67:0/3573047504 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7efda400cb60 con 0x7efdb01035a0 2023-12-05T09:32:28.268 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.269+0000 7efd97fff700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7efd9806ce70 0x7efd9806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:28.268 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.269+0000 7efd97fff700 1 -- 172.21.15.67:0/3573047504 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efda408bcb0 con 0x7efdb01035a0 2023-12-05T09:32:28.268 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.269+0000 7efdaf7fe700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7efd9806ce70 0x7efd9806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:28.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.270+0000 7efdaf7fe700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7efd9806ce70 0x7efd9806f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efda00045a0 tx=0x7efda0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:28.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.273+0000 7efd97fff700 1 -- 172.21.15.67:0/3573047504 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efda40596d0 con 0x7efdb01035a0 2023-12-05T09:32:28.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.526+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efdb00fc360 con 0x7efdb01035a0 2023-12-05T09:32:28.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.526+0000 7efd97fff700 1 -- 172.21.15.67:0/3573047504 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1858 (secure 0 0 0) 0x7efda4059260 con 0x7efdb01035a0 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:e20 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 20 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:32:28.526 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:30:26.034169+0000 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:32:28.527 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:32:28.528 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:32:28.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7efd9806ce70 msgr2=0x7efd9806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7efd9806ce70 0x7efd9806f320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efda00045a0 tx=0x7efda0009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb01035a0 msgr2=0x7efdb0113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb01035a0 0x7efdb0113bc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efda400eb40 tx=0x7efda400b040 comp rx=0 tx=0).stop 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 shutdown_connections 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdb0102c00 0x7efdb0113640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7efd9806ce70 0x7efd9806f320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 --2- 172.21.15.67:0/3573047504 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efdb01035a0 0x7efdb0113bc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 >> 172.21.15.67:0/3573047504 conn(0x7efdb00f8790 msgr2=0x7efdb00fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 shutdown_connections 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.529+0000 7efdb5c15700 1 -- 172.21.15.67:0/3573047504 wait complete. 2023-12-05T09:32:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 20 2023-12-05T09:32:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.669+0000 7f09d6ab6700 1 -- 172.21.15.67:0/3698680574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 msgr2=0x7f09d00703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.669+0000 7f09d6ab6700 1 --2- 172.21.15.67:0/3698680574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 0x7f09d00703b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09c4004970 tx=0x7f09c4009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.669+0000 7f09d6ab6700 1 -- 172.21.15.67:0/3698680574 shutdown_connections 2023-12-05T09:32:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.669+0000 7f09d6ab6700 1 --2- 172.21.15.67:0/3698680574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d00708f0 0x7f09d0108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.669+0000 7f09d6ab6700 1 --2- 172.21.15.67:0/3698680574 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 0x7f09d00703b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.669+0000 7f09d6ab6700 1 -- 172.21.15.67:0/3698680574 >> 172.21.15.67:0/3698680574 conn(0x7f09d00f8790 msgr2=0x7f09d00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:28.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.669+0000 7f09d6ab6700 1 -- 172.21.15.67:0/3698680574 shutdown_connections 2023-12-05T09:32:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.669+0000 7f09d6ab6700 1 -- 172.21.15.67:0/3698680574 wait complete. 2023-12-05T09:32:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.670+0000 7f09d6ab6700 1 Processor -- start 2023-12-05T09:32:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.670+0000 7f09d6ab6700 1 -- start start 2023-12-05T09:32:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d6ab6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 0x7f09d01157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:28.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d6ab6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d00708f0 0x7f09d0115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d6ab6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0116380 con 0x7f09d006ffe0 2023-12-05T09:32:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d6ab6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d010f6b0 con 0x7f09d00708f0 2023-12-05T09:32:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d4852700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 0x7f09d01157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d4852700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 0x7f09d01157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57732/0 (socket says 172.21.15.67:57732) 2023-12-05T09:32:28.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d4852700 1 -- 172.21.15.67:0/1174597260 learned_addr learned my addr 172.21.15.67:0/1174597260 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d4852700 1 -- 172.21.15.67:0/1174597260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d00708f0 msgr2=0x7f09d0115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d4852700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d00708f0 0x7f09d0115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.671+0000 7f09d4852700 1 -- 172.21.15.67:0/1174597260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4005040 con 0x7f09d006ffe0 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.672+0000 7f09d4852700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 0x7f09d01157f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f09c4005010 tx=0x7f09c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.672+0000 7f09cd7fa700 1 -- 172.21.15.67:0/1174597260 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c400e040 con 0x7f09d006ffe0 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.672+0000 7f09cd7fa700 1 -- 172.21.15.67:0/1174597260 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f09c4004290 con 0x7f09d006ffe0 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.672+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d010f930 con 0x7f09d006ffe0 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.672+0000 7f09cd7fa700 1 -- 172.21.15.67:0/1174597260 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09c401c3f0 con 0x7f09d006ffe0 2023-12-05T09:32:28.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.672+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d010fe70 con 0x7f09d006ffe0 2023-12-05T09:32:28.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.673+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d01065d0 con 0x7f09d006ffe0 2023-12-05T09:32:28.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.674+0000 7f09cd7fa700 1 -- 172.21.15.67:0/1174597260 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f09c4013420 con 0x7f09d006ffe0 2023-12-05T09:32:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.676+0000 7f09cd7fa700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f09c006ce70 0x7f09c006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.676+0000 7f09cd7fa700 1 -- 172.21.15.67:0/1174597260 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f09c408d6e0 con 0x7f09d006ffe0 2023-12-05T09:32:28.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.676+0000 7f09cffff700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f09c006ce70 0x7f09c006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:28.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.677+0000 7f09cffff700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f09c006ce70 0x7f09c006f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09d0111020 tx=0x7f09bc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:28.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.680+0000 7f09cd7fa700 1 -- 172.21.15.67:0/1174597260 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f09c405b0e0 con 0x7f09d006ffe0 2023-12-05T09:32:28.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.911+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09d010bdd0 con 0x7f09c006ce70 2023-12-05T09:32:28.911 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.912+0000 7f09cd7fa700 1 -- 172.21.15.67:0/1174597260 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f09d010bdd0 con 0x7f09c006ce70 2023-12-05T09:32:28.911 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "mon" 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "8/21 daemons upgraded", 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:32:28.912 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:32:28.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.914+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f09c006ce70 msgr2=0x7f09c006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.914+0000 7f09d6ab6700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f09c006ce70 0x7f09c006f320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f09d0111020 tx=0x7f09bc00b040 comp rx=0 tx=0).stop 2023-12-05T09:32:28.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 msgr2=0x7f09d01157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:28.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 0x7f09d01157f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f09c4005010 tx=0x7f09c4009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:28.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 shutdown_connections 2023-12-05T09:32:28.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f09c006ce70 0x7f09c006f320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f09d006ffe0 0x7f09d01157f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 --2- 172.21.15.67:0/1174597260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d00708f0 0x7f09d0115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:28.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 >> 172.21.15.67:0/1174597260 conn(0x7f09d00f8790 msgr2=0x7f09d0103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:28.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 shutdown_connections 2023-12-05T09:32:28.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:28.915+0000 7f09d6ab6700 1 -- 172.21.15.67:0/1174597260 wait complete. 2023-12-05T09:32:29.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.054+0000 7fcde91c5700 1 -- 172.21.15.67:0/814932229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 msgr2=0x7fcde4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:29.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.054+0000 7fcde91c5700 1 --2- 172.21.15.67:0/814932229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 0x7fcde4102fd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4004940 tx=0x7fcdd4009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:29.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.054+0000 7fcde91c5700 1 -- 172.21.15.67:0/814932229 shutdown_connections 2023-12-05T09:32:29.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.054+0000 7fcde91c5700 1 --2- 172.21.15.67:0/814932229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde41035a0 0x7fcde40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:29.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.054+0000 7fcde91c5700 1 --2- 172.21.15.67:0/814932229 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 0x7fcde4102fd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:29.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.054+0000 7fcde91c5700 1 -- 172.21.15.67:0/814932229 >> 172.21.15.67:0/814932229 conn(0x7fcde40f8790 msgr2=0x7fcde40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:29.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.054+0000 7fcde91c5700 1 -- 172.21.15.67:0/814932229 shutdown_connections 2023-12-05T09:32:29.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.054+0000 7fcde91c5700 1 -- 172.21.15.67:0/814932229 wait complete. 2023-12-05T09:32:29.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.055+0000 7fcde91c5700 1 Processor -- start 2023-12-05T09:32:29.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.055+0000 7fcde91c5700 1 -- start start 2023-12-05T09:32:29.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.055+0000 7fcde91c5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 0x7fcde4115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:29.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.055+0000 7fcde91c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde41035a0 0x7fcde4115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:29.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.055+0000 7fcde91c5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41163d0 con 0x7fcde4102c00 2023-12-05T09:32:29.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.055+0000 7fcde91c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde410f700 con 0x7fcde41035a0 2023-12-05T09:32:29.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcde2d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 0x7fcde4115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:29.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcde2d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 0x7fcde4115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57748/0 (socket says 172.21.15.67:57748) 2023-12-05T09:32:29.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcde2d9d700 1 -- 172.21.15.67:0/3613431132 learned_addr learned my addr 172.21.15.67:0/3613431132 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:29.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcde259c700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde41035a0 0x7fcde4115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:29.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcde2d9d700 1 -- 172.21.15.67:0/3613431132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde41035a0 msgr2=0x7fcde4115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:29.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcde2d9d700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde41035a0 0x7fcde4115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:29.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcde2d9d700 1 -- 172.21.15.67:0/3613431132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd4005040 con 0x7fcde4102c00 2023-12-05T09:32:29.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcde2d9d700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 0x7fcde4115840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009360 tx=0x7fcdd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:29.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcdcb7fe700 1 -- 172.21.15.67:0/3613431132 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd400e040 con 0x7fcde4102c00 2023-12-05T09:32:29.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.056+0000 7fcdcb7fe700 1 -- 172.21.15.67:0/3613431132 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdd400bc50 con 0x7fcde4102c00 2023-12-05T09:32:29.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.057+0000 7fcdcb7fe700 1 -- 172.21.15.67:0/3613431132 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdd401c630 con 0x7fcde4102c00 2023-12-05T09:32:29.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.057+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde410f980 con 0x7fcde4102c00 2023-12-05T09:32:29.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.057+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde410fec0 con 0x7fcde4102c00 2023-12-05T09:32:29.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.058+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde40fc390 con 0x7fcde4102c00 2023-12-05T09:32:29.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.059+0000 7fcdcb7fe700 1 -- 172.21.15.67:0/3613431132 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fcdd4013420 con 0x7fcde4102c00 2023-12-05T09:32:29.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.060+0000 7fcdcb7fe700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fcdcc06ce70 0x7fcdcc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:29.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.060+0000 7fcdcb7fe700 1 -- 172.21.15.67:0/3613431132 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcdd408d580 con 0x7fcde4102c00 2023-12-05T09:32:29.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.060+0000 7fcde259c700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fcdcc06ce70 0x7fcdcc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:29.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.061+0000 7fcde259c700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fcdcc06ce70 0x7fcdcc06f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8007fd0 tx=0x7fcdd8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:29.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.065+0000 7fcdcb7fe700 1 -- 172.21.15.67:0/3613431132 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcdd405af50 con 0x7fcde4102c00 2023-12-05T09:32:29.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:28 smithi067 ceph-mon[210894]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:32:29.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:28 smithi067 ceph-mon[210894]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:32:29.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:28 smithi067 ceph-mon[210894]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:32:29.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:28 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3132947308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:29.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:28 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3573047504' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:32:29.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:28 smithi134 ceph-mon[172895]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:32:29.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:28 smithi134 ceph-mon[172895]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:32:29.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:28 smithi134 ceph-mon[172895]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:32:29.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:28 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3132947308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:29.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:28 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3573047504' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:32:29.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.359+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcde4110e20 con 0x7fcde4102c00 2023-12-05T09:32:29.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.360+0000 7fcdcb7fe700 1 -- 172.21.15.67:0/3613431132 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fcdd405aae0 con 0x7fcde4102c00 2023-12-05T09:32:29.359 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_OK 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fcdcc06ce70 msgr2=0x7fcdcc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fcdcc06ce70 0x7fcdcc06f320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8007fd0 tx=0x7fcdd8009040 comp rx=0 tx=0).stop 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 msgr2=0x7fcde4115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 0x7fcde4115840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009360 tx=0x7fcdd4009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 shutdown_connections 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fcdcc06ce70 0x7fcdcc06f320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcde4102c00 0x7fcde4115840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 --2- 172.21.15.67:0/3613431132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcde41035a0 0x7fcde4115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.362+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 >> 172.21.15.67:0/3613431132 conn(0x7fcde40f8790 msgr2=0x7fcde40fa090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.363+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 shutdown_connections 2023-12-05T09:32:29.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:29.363+0000 7fcde91c5700 1 -- 172.21.15.67:0/3613431132 wait complete. 2023-12-05T09:32:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:29 smithi067 ceph-mon[210894]: pgmap v72: 65 pgs: 2 peering, 63 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:29 smithi067 ceph-mon[210894]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/378 objects degraded (6.614%), 7 pgs degraded) 2023-12-05T09:32:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:29 smithi067 ceph-mon[210894]: Cluster is now healthy 2023-12-05T09:32:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:29 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3613431132' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:32:30.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:29 smithi134 ceph-mon[172895]: pgmap v72: 65 pgs: 2 peering, 63 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:30.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:29 smithi134 ceph-mon[172895]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/378 objects degraded (6.614%), 7 pgs degraded) 2023-12-05T09:32:30.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:29 smithi134 ceph-mon[172895]: Cluster is now healthy 2023-12-05T09:32:30.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:29 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3613431132' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:32:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:30 smithi067 ceph-mon[210894]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:32:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:32:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:30 smithi134 ceph-mon[172895]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:32:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:32:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:31 smithi067 ceph-mon[210894]: pgmap v73: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:32.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:31 smithi134 ceph-mon[172895]: pgmap v73: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:33 smithi067 ceph-mon[210894]: pgmap v74: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:33 smithi134 ceph-mon[172895]: pgmap v74: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:35.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:34 smithi067 ceph-mon[210894]: pgmap v75: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:35.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:34 smithi134 ceph-mon[172895]: pgmap v75: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:37.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:36 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:37.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:36 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:38.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:37 smithi067 ceph-mon[210894]: pgmap v76: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:38.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:37 smithi134 ceph-mon[172895]: pgmap v76: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:40.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:39 smithi067 ceph-mon[210894]: pgmap v77: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:40.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:39 smithi134 ceph-mon[172895]: pgmap v77: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:41.587 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:41 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T09:32:41.587 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:41 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T09:32:41.587 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:41 smithi067 ceph-mon[210894]: Upgrade: osd.2 is safe to restart 2023-12-05T09:32:41.587 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:41 smithi067 ceph-mon[210894]: pgmap v78: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:41.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:41 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T09:32:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:41 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-05T09:32:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:41 smithi134 ceph-mon[172895]: Upgrade: osd.2 is safe to restart 2023-12-05T09:32:41.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:41 smithi134 ceph-mon[172895]: pgmap v78: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:42.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:42 smithi067 ceph-mon[210894]: Upgrade: Updating osd.2 2023-12-05T09:32:42.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:42 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:42.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:42 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:32:42.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:42 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:32:42.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:42 smithi067 ceph-mon[210894]: Deploying daemon osd.2 on smithi067 2023-12-05T09:32:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:42 smithi134 ceph-mon[172895]: Upgrade: Updating osd.2 2023-12-05T09:32:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:42 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:42 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-05T09:32:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:42 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:32:42.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:42 smithi134 ceph-mon[172895]: Deploying daemon osd.2 on smithi067 2023-12-05T09:32:43.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:43 smithi067 ceph-mon[210894]: pgmap v79: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:44.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:43 smithi134 ceph-mon[172895]: pgmap v79: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:44.836 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:44 smithi067 systemd[1]: Stopping Ceph osd.2 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:32:44.836 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:44 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[148526]: 2023-12-05T09:32:44.777+0000 7fac918e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:32:44.836 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:44 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[148526]: 2023-12-05T09:32:44.777+0000 7fac918e5700 -1 osd.2 61 *** Got signal Terminated *** 2023-12-05T09:32:44.836 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:44 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[148526]: 2023-12-05T09:32:44.777+0000 7fac918e5700 -1 osd.2 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:32:45.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:44 smithi067 ceph-mon[210894]: osd.2 marked itself down and dead 2023-12-05T09:32:45.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:44 smithi134 ceph-mon[172895]: osd.2 marked itself down and dead 2023-12-05T09:32:45.837 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:45 smithi067 bash[238049]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2 2023-12-05T09:32:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: pgmap v80: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:32:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: failed to encode map e62 with expected crc 2023-12-05T09:32:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: failed to encode map e62 with expected crc 2023-12-05T09:32:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: failed to encode map e62 with expected crc 2023-12-05T09:32:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: osdmap e62: 6 total, 5 up, 6 in 2023-12-05T09:32:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:32:46.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:45 smithi067 ceph-mon[210894]: osdmap e63: 6 total, 5 up, 6 in 2023-12-05T09:32:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: pgmap v80: 65 pgs: 65 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:32:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:32:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: failed to encode map e62 with expected crc 2023-12-05T09:32:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: failed to encode map e62 with expected crc 2023-12-05T09:32:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: failed to encode map e62 with expected crc 2023-12-05T09:32:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: osdmap e62: 6 total, 5 up, 6 in 2023-12-05T09:32:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:32:46.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:45 smithi134 ceph-mon[172895]: osdmap e63: 6 total, 5 up, 6 in 2023-12-05T09:32:46.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:46 smithi067 ceph-mon[210894]: failed to encode map e63 with expected crc 2023-12-05T09:32:46.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:46 smithi067 ceph-mon[210894]: failed to encode map e63 with expected crc 2023-12-05T09:32:46.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:46 smithi067 ceph-mon[210894]: failed to encode map e63 with expected crc 2023-12-05T09:32:46.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:46 smithi067 ceph-mon[210894]: failed to encode map e63 with expected crc 2023-12-05T09:32:46.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:46 smithi067 ceph-mon[210894]: failed to encode map e63 with expected crc 2023-12-05T09:32:46.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:46 smithi067 ceph-mon[210894]: failed to encode map e63 with expected crc 2023-12-05T09:32:46.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:46 smithi067 ceph-mon[210894]: failed to encode map e63 with expected crc 2023-12-05T09:32:47.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:46 smithi134 ceph-mon[172895]: failed to encode map e63 with expected crc 2023-12-05T09:32:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:46 smithi134 ceph-mon[172895]: failed to encode map e63 with expected crc 2023-12-05T09:32:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:46 smithi134 ceph-mon[172895]: failed to encode map e63 with expected crc 2023-12-05T09:32:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:46 smithi134 ceph-mon[172895]: failed to encode map e63 with expected crc 2023-12-05T09:32:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:46 smithi134 ceph-mon[172895]: failed to encode map e63 with expected crc 2023-12-05T09:32:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:46 smithi134 ceph-mon[172895]: failed to encode map e63 with expected crc 2023-12-05T09:32:47.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:46 smithi134 ceph-mon[172895]: failed to encode map e63 with expected crc 2023-12-05T09:32:47.279 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:46 smithi067 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.2.service: Succeeded. 2023-12-05T09:32:47.279 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:46 smithi067 systemd[1]: Stopped Ceph osd.2 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:32:47.618 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:47 smithi067 systemd[1]: Starting Ceph osd.2 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:32:48.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:47 smithi067 ceph-mon[210894]: pgmap v83: 65 pgs: 6 active+undersized+degraded, 7 stale+active+clean, 6 active+undersized, 46 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 18/378 objects degraded (4.762%) 2023-12-05T09:32:48.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:47 smithi067 ceph-mon[210894]: Health check failed: Degraded data redundancy: 18/378 objects degraded (4.762%), 6 pgs degraded (PG_DEGRADED) 2023-12-05T09:32:48.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:47 smithi134 ceph-mon[172895]: pgmap v83: 65 pgs: 6 active+undersized+degraded, 7 stale+active+clean, 6 active+undersized, 46 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 18/378 objects degraded (4.762%) 2023-12-05T09:32:48.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:47 smithi134 ceph-mon[172895]: Health check failed: Degraded data redundancy: 18/378 objects degraded (4.762%), 6 pgs degraded (PG_DEGRADED) 2023-12-05T09:32:48.868 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:48 smithi067 bash[238317]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-05T09:32:48.868 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:48 smithi067 bash[238317]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-05T09:32:48.868 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:48 smithi067 bash[238317]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-05T09:32:48.868 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:48 smithi067 bash[238317]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-05T09:32:48.868 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:48 smithi067 bash[238317]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-05T09:32:48.868 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:48 smithi067 bash[238317]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-05T09:32:48.868 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:48 smithi067 bash[238317]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-05T09:32:49.618 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:49 smithi067 bash[238593]: c43c33a4a00587d4e2eeb15d94713007618a4e3c0f0ab506c6e1e367735f084e 2023-12-05T09:32:49.618 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:49 smithi067 systemd[1]: Started Ceph osd.2 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:32:49.618 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:49 smithi067 ceph-osd[238631]: -- 172.21.15.67:0/2285782300 <== mon.0 v2:172.21.15.67:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cfa89f71e0 con 0x55cfa89c7000 2023-12-05T09:32:50.118 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:49 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[238608]: 2023-12-05T09:32:49.732+0000 7f707fe69640 -1 Falling back to public interface 2023-12-05T09:32:50.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:49 smithi067 ceph-mon[210894]: pgmap v84: 65 pgs: 9 active+undersized+degraded, 3 stale+active+clean, 10 active+undersized, 43 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 31/378 objects degraded (8.201%) 2023-12-05T09:32:50.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:49 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:50.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:49 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:50.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:49 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:32:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:49 smithi134 ceph-mon[172895]: pgmap v84: 65 pgs: 9 active+undersized+degraded, 3 stale+active+clean, 10 active+undersized, 43 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 31/378 objects degraded (8.201%) 2023-12-05T09:32:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:49 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:49 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:49 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:32:51.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:51 smithi067 ceph-mon[210894]: pgmap v85: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/378 objects degraded (12.169%) 2023-12-05T09:32:51.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:51 smithi134 ceph-mon[172895]: pgmap v85: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/378 objects degraded (12.169%) 2023-12-05T09:32:54.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:53 smithi067 ceph-mon[210894]: pgmap v86: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/378 objects degraded (12.169%) 2023-12-05T09:32:54.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:53 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:54.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:53 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:54.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:53 smithi134 ceph-mon[172895]: pgmap v86: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/378 objects degraded (12.169%) 2023-12-05T09:32:54.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:53 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:54.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:53 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:54.618 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:54 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[238608]: 2023-12-05T09:32:54.230+0000 7f707fe69640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-05T09:32:55.118 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:54 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[238608]: 2023-12-05T09:32:54.745+0000 7f707fe69640 -1 osd.2 61 log_to_monitors true 2023-12-05T09:32:55.118 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:32:54 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[238608]: 2023-12-05T09:32:54.838+0000 7f706f2d6700 -1 osd.2 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:32:55.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:54 smithi067 ceph-mon[210894]: from='osd.2 [v2:172.21.15.67:6818/4278620943,v1:172.21.15.67:6819/4278620943]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T09:32:55.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:54 smithi134 ceph-mon[172895]: from='osd.2 [v2:172.21.15.67:6818/4278620943,v1:172.21.15.67:6819/4278620943]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-05T09:32:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:55 smithi067 ceph-mon[210894]: pgmap v87: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/378 objects degraded (12.169%) 2023-12-05T09:32:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:55 smithi067 ceph-mon[210894]: from='osd.2 [v2:172.21.15.67:6818/4278620943,v1:172.21.15.67:6819/4278620943]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T09:32:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:55 smithi067 ceph-mon[210894]: osdmap e64: 6 total, 5 up, 6 in 2023-12-05T09:32:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:55 smithi067 ceph-mon[210894]: from='osd.2 [v2:172.21.15.67:6818/4278620943,v1:172.21.15.67:6819/4278620943]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:32:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:56.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:55 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 46/378 objects degraded (12.169%), 13 pgs degraded (PG_DEGRADED) 2023-12-05T09:32:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:55 smithi134 ceph-mon[172895]: pgmap v87: 65 pgs: 13 active+undersized+degraded, 14 active+undersized, 38 active+clean; 330 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 46/378 objects degraded (12.169%) 2023-12-05T09:32:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:55 smithi134 ceph-mon[172895]: from='osd.2 [v2:172.21.15.67:6818/4278620943,v1:172.21.15.67:6819/4278620943]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-05T09:32:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:55 smithi134 ceph-mon[172895]: osdmap e64: 6 total, 5 up, 6 in 2023-12-05T09:32:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:55 smithi134 ceph-mon[172895]: from='osd.2 [v2:172.21.15.67:6818/4278620943,v1:172.21.15.67:6819/4278620943]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2023-12-05T09:32:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:56.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:55 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 46/378 objects degraded (12.169%), 13 pgs degraded (PG_DEGRADED) 2023-12-05T09:32:57.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: failed to encode map e64 with expected crc 2023-12-05T09:32:57.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:32:57.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: failed to encode map e64 with expected crc 2023-12-05T09:32:57.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: osd.2 [v2:172.21.15.67:6818/4278620943,v1:172.21.15.67:6819/4278620943] boot 2023-12-05T09:32:57.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: osdmap e65: 6 total, 6 up, 6 in 2023-12-05T09:32:57.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: failed to encode map e64 with expected crc 2023-12-05T09:32:57.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: failed to encode map e65 with expected crc 2023-12-05T09:32:57.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:32:57.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:56 smithi067 ceph-mon[210894]: osdmap e66: 6 total, 6 up, 6 in 2023-12-05T09:32:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: failed to encode map e64 with expected crc 2023-12-05T09:32:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:32:57.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: failed to encode map e64 with expected crc 2023-12-05T09:32:57.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: osd.2 [v2:172.21.15.67:6818/4278620943,v1:172.21.15.67:6819/4278620943] boot 2023-12-05T09:32:57.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: osdmap e65: 6 total, 6 up, 6 in 2023-12-05T09:32:57.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: failed to encode map e64 with expected crc 2023-12-05T09:32:57.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: failed to encode map e65 with expected crc 2023-12-05T09:32:57.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-05T09:32:57.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:56 smithi134 ceph-mon[172895]: osdmap e66: 6 total, 6 up, 6 in 2023-12-05T09:32:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:57 smithi067 ceph-mon[210894]: pgmap v90: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 29/378 objects degraded (7.672%) 2023-12-05T09:32:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:57 smithi067 ceph-mon[210894]: failed to encode map e66 with expected crc 2023-12-05T09:32:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:57 smithi067 ceph-mon[210894]: failed to encode map e66 with expected crc 2023-12-05T09:32:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:57 smithi067 ceph-mon[210894]: failed to encode map e66 with expected crc 2023-12-05T09:32:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:57 smithi067 ceph-mon[210894]: failed to encode map e66 with expected crc 2023-12-05T09:32:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:57 smithi134 ceph-mon[172895]: pgmap v90: 65 pgs: 10 peering, 8 active+undersized+degraded, 9 active+undersized, 38 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 29/378 objects degraded (7.672%) 2023-12-05T09:32:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:57 smithi134 ceph-mon[172895]: failed to encode map e66 with expected crc 2023-12-05T09:32:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:57 smithi134 ceph-mon[172895]: failed to encode map e66 with expected crc 2023-12-05T09:32:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:57 smithi134 ceph-mon[172895]: failed to encode map e66 with expected crc 2023-12-05T09:32:58.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:57 smithi134 ceph-mon[172895]: failed to encode map e66 with expected crc 2023-12-05T09:32:59.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.514+0000 7fdbd13e3700 1 -- 172.21.15.67:0/2436532306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 msgr2=0x7fdbcc0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:59.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.514+0000 7fdbd13e3700 1 --2- 172.21.15.67:0/2436532306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 0x7fdbcc0703b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc004970 tx=0x7fdbbc009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:59.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.515+0000 7fdbd13e3700 1 -- 172.21.15.67:0/2436532306 shutdown_connections 2023-12-05T09:32:59.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.515+0000 7fdbd13e3700 1 --2- 172.21.15.67:0/2436532306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbcc0708f0 0x7fdbcc108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.515+0000 7fdbd13e3700 1 --2- 172.21.15.67:0/2436532306 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 0x7fdbcc0703b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.515+0000 7fdbd13e3700 1 -- 172.21.15.67:0/2436532306 >> 172.21.15.67:0/2436532306 conn(0x7fdbcc0f8790 msgr2=0x7fdbcc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.515+0000 7fdbd13e3700 1 -- 172.21.15.67:0/2436532306 shutdown_connections 2023-12-05T09:32:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.515+0000 7fdbd13e3700 1 -- 172.21.15.67:0/2436532306 wait complete. 2023-12-05T09:32:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbd13e3700 1 Processor -- start 2023-12-05T09:32:59.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbd13e3700 1 -- start start 2023-12-05T09:32:59.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbd13e3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 0x7fdbcc1157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:59.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbd13e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbcc0708f0 0x7fdbcc115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:59.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbd13e3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc116380 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbd13e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc10f6b0 con 0x7fdbcc0708f0 2023-12-05T09:32:59.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbcaffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 0x7fdbcc1157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:59.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbcaffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 0x7fdbcc1157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47888/0 (socket says 172.21.15.67:47888) 2023-12-05T09:32:59.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.516+0000 7fdbcaffd700 1 -- 172.21.15.67:0/3966233344 learned_addr learned my addr 172.21.15.67:0/3966233344 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:59.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbca7fc700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbcc0708f0 0x7fdbcc115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:59.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbcaffd700 1 -- 172.21.15.67:0/3966233344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbcc0708f0 msgr2=0x7fdbcc115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:59.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbcaffd700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbcc0708f0 0x7fdbcc115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbcaffd700 1 -- 172.21.15.67:0/3966233344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc005040 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbca7fc700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbcc0708f0 0x7fdbcc115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:32:59.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbcaffd700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 0x7fdbcc1157f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc004f50 tx=0x7fdbbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:59.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbb37fe700 1 -- 172.21.15.67:0/3966233344 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbbc00e040 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbb37fe700 1 -- 172.21.15.67:0/3966233344 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdbbc00bc10 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbb37fe700 1 -- 172.21.15.67:0/3966233344 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbbc01c630 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.517+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc10f930 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.518+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc10fe70 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.519+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc1065d0 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.520+0000 7fdbb37fe700 1 -- 172.21.15.67:0/3966233344 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fdbbc013420 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.520+0000 7fdbb37fe700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdbb406ce70 0x7fdbb406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:59.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.521+0000 7fdbb37fe700 1 -- 172.21.15.67:0/3966233344 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdbbc08d770 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.521+0000 7fdbca7fc700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdbb406ce70 0x7fdbb406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:59.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.521+0000 7fdbca7fc700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdbb406ce70 0x7fdbb406f320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009fd0 tx=0x7fdbc0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:59.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.525+0000 7fdbb37fe700 1 -- 172.21.15.67:0/3966233344 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdbbc05b0c0 con 0x7fdbcc06ffe0 2023-12-05T09:32:59.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.753+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbcc04bb80 con 0x7fdbb406ce70 2023-12-05T09:32:59.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.754+0000 7fdbb37fe700 1 -- 172.21.15.67:0/3966233344 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdbcc04bb80 con 0x7fdbb406ce70 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdbb406ce70 msgr2=0x7fdbb406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdbb406ce70 0x7fdbb406f320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009fd0 tx=0x7fdbc0009ee0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 msgr2=0x7fdbcc1157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 0x7fdbcc1157f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc004f50 tx=0x7fdbbc009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 shutdown_connections 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdbb406ce70 0x7fdbb406f320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdbcc06ffe0 0x7fdbcc1157f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 --2- 172.21.15.67:0/3966233344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbcc0708f0 0x7fdbcc115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.756+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 >> 172.21.15.67:0/3966233344 conn(0x7fdbcc0f8790 msgr2=0x7fdbcc103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.757+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 shutdown_connections 2023-12-05T09:32:59.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.757+0000 7fdbd13e3700 1 -- 172.21.15.67:0/3966233344 wait complete. 2023-12-05T09:32:59.770 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: pgmap v92: 65 pgs: 10 peering, 7 active+undersized+degraded, 7 active+undersized, 41 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 26/378 objects degraded (6.878%) 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:59.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T09:32:59.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T09:32:59.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:32:59 smithi067 ceph-mon[210894]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2023-12-05T09:32:59.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:59.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:59.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:32:59.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: pgmap v92: 65 pgs: 10 peering, 7 active+undersized+degraded, 7 active+undersized, 41 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 26/378 objects degraded (6.878%) 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T09:32:59.878 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:32:59 smithi134 ceph-mon[172895]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2023-12-05T09:32:59.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.896+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279272582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc102c20 msgr2=0x7fdedc102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:59.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.896+0000 7fdee16bf700 1 --2- 172.21.15.67:0/4279272582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc102c20 0x7fdedc102ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdecc004940 tx=0x7fdecc009e30 comp rx=0 tx=0).stop 2023-12-05T09:32:59.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.897+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279272582 shutdown_connections 2023-12-05T09:32:59.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.897+0000 7fdee16bf700 1 --2- 172.21.15.67:0/4279272582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc065390 0x7fdedc065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.897+0000 7fdee16bf700 1 --2- 172.21.15.67:0/4279272582 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc102c20 0x7fdedc102ff0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.897+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279272582 >> 172.21.15.67:0/4279272582 conn(0x7fdedc0719b0 msgr2=0x7fdedc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:32:59.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.897+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279272582 shutdown_connections 2023-12-05T09:32:59.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.897+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279272582 wait complete. 2023-12-05T09:32:59.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.898+0000 7fdee16bf700 1 Processor -- start 2023-12-05T09:32:59.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.898+0000 7fdee16bf700 1 -- start start 2023-12-05T09:32:59.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdee16bf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc065390 0x7fdedc0fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:59.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdee16bf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc102c20 0x7fdedc0fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdee16bf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0fc7c0 con 0x7fdedc065390 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdee16bf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0fc930 con 0x7fdedc102c20 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdedaffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc065390 0x7fdedc0fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdedaffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc065390 0x7fdedc0fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47908/0 (socket says 172.21.15.67:47908) 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdedaffd700 1 -- 172.21.15.67:0/4279498105 learned_addr learned my addr 172.21.15.67:0/4279498105 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fded3fff700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc102c20 0x7fdedc0fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdedaffd700 1 -- 172.21.15.67:0/4279498105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc102c20 msgr2=0x7fdedc0fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdedaffd700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc102c20 0x7fdedc0fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.899+0000 7fdedaffd700 1 -- 172.21.15.67:0/4279498105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc005040 con 0x7fdedc065390 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.900+0000 7fdedaffd700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc065390 0x7fdedc0fbbf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009180 tx=0x7fdecc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.900+0000 7fded37fe700 1 -- 172.21.15.67:0/4279498105 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdecc00e040 con 0x7fdedc065390 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.900+0000 7fded37fe700 1 -- 172.21.15.67:0/4279498105 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdecc013420 con 0x7fdedc065390 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.900+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc1198c0 con 0x7fdedc065390 2023-12-05T09:32:59.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.900+0000 7fded37fe700 1 -- 172.21.15.67:0/4279498105 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdecc01c630 con 0x7fdedc065390 2023-12-05T09:32:59.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.900+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc119db0 con 0x7fdedc065390 2023-12-05T09:32:59.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.901+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc0fff40 con 0x7fdedc065390 2023-12-05T09:32:59.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.902+0000 7fded37fe700 1 -- 172.21.15.67:0/4279498105 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fdecc0139e0 con 0x7fdedc065390 2023-12-05T09:32:59.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.903+0000 7fded37fe700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdec806ce60 0x7fdec806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:32:59.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.903+0000 7fded37fe700 1 -- 172.21.15.67:0/4279498105 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdecc08d600 con 0x7fdedc065390 2023-12-05T09:32:59.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.903+0000 7fded3fff700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdec806ce60 0x7fdec806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:32:59.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.904+0000 7fded3fff700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdec806ce60 0x7fdec806f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdec4006fd0 tx=0x7fdec4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:32:59.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:32:59.907+0000 7fded37fe700 1 -- 172.21.15.67:0/4279498105 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdecc057560 con 0x7fdedc065390 2023-12-05T09:33:00.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.135+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdedc0fd330 con 0x7fdec806ce60 2023-12-05T09:33:00.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.137+0000 7fded37fe700 1 -- 172.21.15.67:0/4279498105 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdedc0fd330 con 0x7fdec806ce60 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdec806ce60 msgr2=0x7fdec806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdec806ce60 0x7fdec806f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdec4006fd0 tx=0x7fdec4008040 comp rx=0 tx=0).stop 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc065390 msgr2=0x7fdedc0fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc065390 0x7fdedc0fbbf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009180 tx=0x7fdecc009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 shutdown_connections 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdec806ce60 0x7fdec806f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdedc065390 0x7fdedc0fbbf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 --2- 172.21.15.67:0/4279498105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdedc102c20 0x7fdedc0fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 >> 172.21.15.67:0/4279498105 conn(0x7fdedc0719b0 msgr2=0x7fdedc0faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:00.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.139+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 shutdown_connections 2023-12-05T09:33:00.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.140+0000 7fdee16bf700 1 -- 172.21.15.67:0/4279498105 wait complete. 2023-12-05T09:33:00.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.278+0000 7f669fc2e700 1 -- 172.21.15.67:0/743552280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 msgr2=0x7f6698108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.278+0000 7f669fc2e700 1 --2- 172.21.15.67:0/743552280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 0x7f6698108f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6688004970 tx=0x7f6688009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:00.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.278+0000 7f669fc2e700 1 -- 172.21.15.67:0/743552280 shutdown_connections 2023-12-05T09:33:00.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.278+0000 7f669fc2e700 1 --2- 172.21.15.67:0/743552280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 0x7f6698108f10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.278+0000 7f669fc2e700 1 --2- 172.21.15.67:0/743552280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669806ffe0 0x7f66980703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.278+0000 7f669fc2e700 1 -- 172.21.15.67:0/743552280 >> 172.21.15.67:0/743552280 conn(0x7f66980f8790 msgr2=0x7f66980faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:00.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.278+0000 7f669fc2e700 1 -- 172.21.15.67:0/743552280 shutdown_connections 2023-12-05T09:33:00.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.278+0000 7f669fc2e700 1 -- 172.21.15.67:0/743552280 wait complete. 2023-12-05T09:33:00.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.279+0000 7f669fc2e700 1 Processor -- start 2023-12-05T09:33:00.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.279+0000 7f669fc2e700 1 -- start start 2023-12-05T09:33:00.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669fc2e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669806ffe0 0x7f6698115810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:00.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669fc2e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 0x7f6698115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:00.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669fc2e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981163a0 con 0x7f66980708f0 2023-12-05T09:33:00.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669fc2e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669810f6d0 con 0x7f669806ffe0 2023-12-05T09:33:00.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669d1c9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 0x7f6698115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:00.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669d1c9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 0x7f6698115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47926/0 (socket says 172.21.15.67:47926) 2023-12-05T09:33:00.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669d1c9700 1 -- 172.21.15.67:0/2787012141 learned_addr learned my addr 172.21.15.67:0/2787012141 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:00.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669d9ca700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669806ffe0 0x7f6698115810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:00.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669d1c9700 1 -- 172.21.15.67:0/2787012141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669806ffe0 msgr2=0x7f6698115810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669d1c9700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669806ffe0 0x7f6698115810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.280+0000 7f669d1c9700 1 -- 172.21.15.67:0/2787012141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6688005040 con 0x7f66980708f0 2023-12-05T09:33:00.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.281+0000 7f669d1c9700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 0x7f6698115d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6688005010 tx=0x7f6688009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:00.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.281+0000 7f668e7fc700 1 -- 172.21.15.67:0/2787012141 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f668800e040 con 0x7f66980708f0 2023-12-05T09:33:00.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.281+0000 7f668e7fc700 1 -- 172.21.15.67:0/2787012141 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6688004290 con 0x7f66980708f0 2023-12-05T09:33:00.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.281+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669810f950 con 0x7f66980708f0 2023-12-05T09:33:00.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.281+0000 7f668e7fc700 1 -- 172.21.15.67:0/2787012141 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f668801c3f0 con 0x7f66980708f0 2023-12-05T09:33:00.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.281+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669810fe90 con 0x7f66980708f0 2023-12-05T09:33:00.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.282+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66981065d0 con 0x7f66980708f0 2023-12-05T09:33:00.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.283+0000 7f668e7fc700 1 -- 172.21.15.67:0/2787012141 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6688013420 con 0x7f66980708f0 2023-12-05T09:33:00.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.284+0000 7f668e7fc700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f668406ce70 0x7f668406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:00.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.284+0000 7f668e7fc700 1 -- 172.21.15.67:0/2787012141 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f668808d6e0 con 0x7f66980708f0 2023-12-05T09:33:00.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.285+0000 7f669d9ca700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f668406ce70 0x7f668406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:00.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.285+0000 7f669d9ca700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f668406ce70 0x7f668406f320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6694009fd0 tx=0x7f669400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:00.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.289+0000 7f668e7fc700 1 -- 172.21.15.67:0/2787012141 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f668805b0e0 con 0x7f66980708f0 2023-12-05T09:33:00.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.509+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f669810bdb0 con 0x7f668406ce70 2023-12-05T09:33:00.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.519+0000 7f668e7fc700 1 -- 172.21.15.67:0/2787012141 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f669810bdb0 con 0x7f668406ce70 2023-12-05T09:33:00.527 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:33:00.527 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (4m) 6s ago 14m 16.1M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:33:00.527 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (101s) 6s ago 14m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 e6de51f67edd 2023-12-05T09:33:00.527 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (97s) 94s ago 13m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 b78b9e680949 2023-12-05T09:33:00.527 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (3m) 6s ago 13m 79.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:33:00.527 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (9m) 6s ago 9m 6297M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (9m) 6s ago 9m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (9m) 94s ago 9m 15.3M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (9m) 94s ago 9m 15.9M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (6m) 6s ago 15m 519M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (5m) 94s ago 13m 451M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (2m) 6s ago 15m 68.0M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (2m) 94s ago 13m 42.2M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 c85edd1646d0 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (4m) 6s ago 14m 8346k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 94s ago 13m 8094k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (78s) 6s ago 12m 120M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 cc8a8add819d 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (45s) 6s ago 12m 123M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 5c8edfa1578a 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (11s) 6s ago 11m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 c43c33a4a005 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (11m) 94s ago 11m 1035M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 74425c4457ef 2023-12-05T09:33:00.528 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (11m) 94s ago 11m 779M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:33:00.529 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (10m) 94s ago 10m 876M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:33:00.529 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (4m) 6s ago 13m 53.1M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:33:00.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f668406ce70 msgr2=0x7f668406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f668406ce70 0x7f668406f320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6694009fd0 tx=0x7f669400b040 comp rx=0 tx=0).stop 2023-12-05T09:33:00.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 msgr2=0x7f6698115d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 0x7f6698115d50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6688005010 tx=0x7f6688009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:00.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 shutdown_connections 2023-12-05T09:33:00.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f669806ffe0 0x7f6698115810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f668406ce70 0x7f668406f320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 --2- 172.21.15.67:0/2787012141 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66980708f0 0x7f6698115d50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 >> 172.21.15.67:0/2787012141 conn(0x7f66980f8790 msgr2=0x7f6698103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:00.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 shutdown_connections 2023-12-05T09:33:00.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.522+0000 7f669fc2e700 1 -- 172.21.15.67:0/2787012141 wait complete. 2023-12-05T09:33:00.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.660+0000 7f364bc7a700 1 -- 172.21.15.67:0/2740664523 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36441035a0 msgr2=0x7f36440fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.660+0000 7f364bc7a700 1 --2- 172.21.15.67:0/2740664523 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36441035a0 0x7f36440fcc10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3634004940 tx=0x7f3634009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.660+0000 7f364bc7a700 1 -- 172.21.15.67:0/2740664523 shutdown_connections 2023-12-05T09:33:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.660+0000 7f364bc7a700 1 --2- 172.21.15.67:0/2740664523 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f36441035a0 0x7f36440fcc10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.660+0000 7f364bc7a700 1 --2- 172.21.15.67:0/2740664523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3644102c00 0x7f3644102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.660+0000 7f364bc7a700 1 -- 172.21.15.67:0/2740664523 >> 172.21.15.67:0/2740664523 conn(0x7f36440f8790 msgr2=0x7f36440faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:00.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.660+0000 7f364bc7a700 1 -- 172.21.15.67:0/2740664523 shutdown_connections 2023-12-05T09:33:00.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.660+0000 7f364bc7a700 1 -- 172.21.15.67:0/2740664523 wait complete. 2023-12-05T09:33:00.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.661+0000 7f364bc7a700 1 Processor -- start 2023-12-05T09:33:00.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.661+0000 7f364bc7a700 1 -- start start 2023-12-05T09:33:00.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.661+0000 7f364bc7a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3644102c00 0x7f3644115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:00.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.661+0000 7f364bc7a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36441035a0 0x7f3644115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:00.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.661+0000 7f364bc7a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36441163d0 con 0x7f3644102c00 2023-12-05T09:33:00.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.661+0000 7f364bc7a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364410f700 con 0x7f36441035a0 2023-12-05T09:33:00.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.661+0000 7f3649a16700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3644102c00 0x7f3644115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:00.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f3649a16700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3644102c00 0x7f3644115840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47944/0 (socket says 172.21.15.67:47944) 2023-12-05T09:33:00.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f3649a16700 1 -- 172.21.15.67:0/1279539955 learned_addr learned my addr 172.21.15.67:0/1279539955 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:00.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f3649215700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36441035a0 0x7f3644115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:00.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f3649a16700 1 -- 172.21.15.67:0/1279539955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36441035a0 msgr2=0x7f3644115d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f3649a16700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36441035a0 0x7f3644115d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f3649a16700 1 -- 172.21.15.67:0/1279539955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634005040 con 0x7f3644102c00 2023-12-05T09:33:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f3649a16700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3644102c00 0x7f3644115840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3640002a50 tx=0x7f36400046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f363a7fc700 1 -- 172.21.15.67:0/1279539955 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3640007cc0 con 0x7f3644102c00 2023-12-05T09:33:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f363a7fc700 1 -- 172.21.15.67:0/1279539955 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f364000f040 con 0x7f3644102c00 2023-12-05T09:33:00.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f363a7fc700 1 -- 172.21.15.67:0/1279539955 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f364000d9c0 con 0x7f3644102c00 2023-12-05T09:33:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.662+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364410f9e0 con 0x7f3644102c00 2023-12-05T09:33:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.663+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364410fef0 con 0x7f3644102c00 2023-12-05T09:33:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.664+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36440fc390 con 0x7f3644102c00 2023-12-05T09:33:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.665+0000 7f363a7fc700 1 -- 172.21.15.67:0/1279539955 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f364000db40 con 0x7f3644102c00 2023-12-05T09:33:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.666+0000 7f363a7fc700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f363006ce70 0x7f363006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.666+0000 7f363a7fc700 1 -- 172.21.15.67:0/1279539955 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f364008bf00 con 0x7f3644102c00 2023-12-05T09:33:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.666+0000 7f3649215700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f363006ce70 0x7f363006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:00.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.667+0000 7f3649215700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f363006ce70 0x7f363006f320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3644110a30 tx=0x7f3634009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:00.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.671+0000 7f363a7fc700 1 -- 172.21.15.67:0/1279539955 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f36400599a0 con 0x7f3644102c00 2023-12-05T09:33:00.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:00 smithi067 ceph-mon[210894]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:00.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:00 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 26/378 objects degraded (6.878%), 7 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:00.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:00 smithi134 ceph-mon[172895]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:00.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:00 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 26/378 objects degraded (6.878%), 7 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:00.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.966+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3644110e20 con 0x7f3644102c00 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.966+0000 7f363a7fc700 1 -- 172.21.15.67:0/1279539955 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f364000ddf0 con 0x7f3644102c00 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:33:00.965 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 3, 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 3 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 7, 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 7 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:33:00.966 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:33:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f363006ce70 msgr2=0x7f363006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f363006ce70 0x7f363006f320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3644110a30 tx=0x7f3634009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3644102c00 msgr2=0x7f3644115840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3644102c00 0x7f3644115840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3640002a50 tx=0x7f36400046b0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 shutdown_connections 2023-12-05T09:33:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f363006ce70 0x7f363006f320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3644102c00 0x7f3644115840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 --2- 172.21.15.67:0/1279539955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36441035a0 0x7f3644115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.968+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 >> 172.21.15.67:0/1279539955 conn(0x7f36440f8790 msgr2=0x7f36440fa190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.969+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 shutdown_connections 2023-12-05T09:33:00.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:00.969+0000 7f364bc7a700 1 -- 172.21.15.67:0/1279539955 wait complete. 2023-12-05T09:33:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.107+0000 7fb231027700 1 -- 172.21.15.67:0/874014649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0fca00 msgr2=0x7fb22c0fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.107+0000 7fb231027700 1 --2- 172.21.15.67:0/874014649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0fca00 0x7fb22c0fce70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb220004940 tx=0x7fb220009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.107+0000 7fb231027700 1 -- 172.21.15.67:0/874014649 shutdown_connections 2023-12-05T09:33:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.107+0000 7fb231027700 1 --2- 172.21.15.67:0/874014649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c0fca00 0x7fb22c0fce70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.107+0000 7fb231027700 1 --2- 172.21.15.67:0/874014649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb22c102a40 0x7fb22c102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.107+0000 7fb231027700 1 -- 172.21.15.67:0/874014649 >> 172.21.15.67:0/874014649 conn(0x7fb22c0f8560 msgr2=0x7fb22c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.107+0000 7fb231027700 1 -- 172.21.15.67:0/874014649 shutdown_connections 2023-12-05T09:33:01.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.107+0000 7fb231027700 1 -- 172.21.15.67:0/874014649 wait complete. 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.108+0000 7fb231027700 1 Processor -- start 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.108+0000 7fb231027700 1 -- start start 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb231027700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb22c0fca00 0x7fb22c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb231027700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c102a40 0x7fb22c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb231027700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c070a80 con 0x7fb22c102a40 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb231027700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c070bf0 con 0x7fb22c0fca00 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb22b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c102a40 0x7fb22c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb22b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c102a40 0x7fb22c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47960/0 (socket says 172.21.15.67:47960) 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb22b7fe700 1 -- 172.21.15.67:0/1174148339 learned_addr learned my addr 172.21.15.67:0/1174148339 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb22b7fe700 1 -- 172.21.15.67:0/1174148339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb22c0fca00 msgr2=0x7fb22c06ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb22b7fe700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb22c0fca00 0x7fb22c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.109+0000 7fb22b7fe700 1 -- 172.21.15.67:0/1174148339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb220005040 con 0x7fb22c102a40 2023-12-05T09:33:01.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.110+0000 7fb22b7fe700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c102a40 0x7fb22c070480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb220008d80 tx=0x7fb220009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.110+0000 7fb228ff9700 1 -- 172.21.15.67:0/1174148339 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb22000e030 con 0x7fb22c102a40 2023-12-05T09:33:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.110+0000 7fb228ff9700 1 -- 172.21.15.67:0/1174148339 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb220004290 con 0x7fb22c102a40 2023-12-05T09:33:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.110+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c1195b0 con 0x7fb22c102a40 2023-12-05T09:33:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.110+0000 7fb228ff9700 1 -- 172.21.15.67:0/1174148339 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb22001ce60 con 0x7fb22c102a40 2023-12-05T09:33:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.110+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c119a90 con 0x7fb22c102a40 2023-12-05T09:33:01.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.111+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c104ec0 con 0x7fb22c102a40 2023-12-05T09:33:01.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.112+0000 7fb228ff9700 1 -- 172.21.15.67:0/1174148339 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fb22001c690 con 0x7fb22c102a40 2023-12-05T09:33:01.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.113+0000 7fb228ff9700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fb21406ce70 0x7fb21406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.113+0000 7fb228ff9700 1 -- 172.21.15.67:0/1174148339 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb22008dcb0 con 0x7fb22c102a40 2023-12-05T09:33:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.114+0000 7fb22bfff700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fb21406ce70 0x7fb21406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:01.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.114+0000 7fb22bfff700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fb21406ce70 0x7fb21406f320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009fd0 tx=0x7fb21c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:01.115 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.117+0000 7fb228ff9700 1 -- 172.21.15.67:0/1174148339 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb220057bf0 con 0x7fb22c102a40 2023-12-05T09:33:01.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.370+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb22c104ec0 con 0x7fb22c102a40 2023-12-05T09:33:01.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.371+0000 7fb228ff9700 1 -- 172.21.15.67:0/1174148339 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1858 (secure 0 0 0) 0x7fb22005b210 con 0x7fb22c102a40 2023-12-05T09:33:01.369 INFO:teuthology.orchestra.run.smithi067.stdout:e20 2023-12-05T09:33:01.369 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:33:01.369 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:33:01.369 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:33:01.369 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:33:01.369 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:33:01.369 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 20 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:30:26.034169+0000 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:33:01.370 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:33:01.371 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:33:01.372 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:33:01.372 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:33:01.372 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:33:01.372 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:33:01.372 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fb21406ce70 msgr2=0x7fb21406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fb21406ce70 0x7fb21406f320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009fd0 tx=0x7fb21c00b040 comp rx=0 tx=0).stop 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c102a40 msgr2=0x7fb22c070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c102a40 0x7fb22c070480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb220008d80 tx=0x7fb220009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 shutdown_connections 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb22c0fca00 0x7fb22c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fb21406ce70 0x7fb21406f320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 --2- 172.21.15.67:0/1174148339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb22c102a40 0x7fb22c070480 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 >> 172.21.15.67:0/1174148339 conn(0x7fb22c0f8560 msgr2=0x7fb22c0f9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 shutdown_connections 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.373+0000 7fb231027700 1 -- 172.21.15.67:0/1174148339 wait complete. 2023-12-05T09:33:01.373 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 20 2023-12-05T09:33:01.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.512+0000 7fe99f862700 1 -- 172.21.15.67:0/3984389893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 msgr2=0x7fe998102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.512+0000 7fe99f862700 1 --2- 172.21.15.67:0/3984389893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 0x7fe998102fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe994004940 tx=0x7fe994009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:01.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.512+0000 7fe99f862700 1 -- 172.21.15.67:0/3984389893 shutdown_connections 2023-12-05T09:33:01.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.512+0000 7fe99f862700 1 --2- 172.21.15.67:0/3984389893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9981035a0 0x7fe9980fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.512+0000 7fe99f862700 1 --2- 172.21.15.67:0/3984389893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 0x7fe998102fd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.512+0000 7fe99f862700 1 -- 172.21.15.67:0/3984389893 >> 172.21.15.67:0/3984389893 conn(0x7fe9980f8790 msgr2=0x7fe9980faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:01.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.512+0000 7fe99f862700 1 -- 172.21.15.67:0/3984389893 shutdown_connections 2023-12-05T09:33:01.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.512+0000 7fe99f862700 1 -- 172.21.15.67:0/3984389893 wait complete. 2023-12-05T09:33:01.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.513+0000 7fe99f862700 1 Processor -- start 2023-12-05T09:33:01.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.513+0000 7fe99f862700 1 -- start start 2023-12-05T09:33:01.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.514+0000 7fe99f862700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 0x7fe998113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.514+0000 7fe99f862700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9981035a0 0x7fe998113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.514+0000 7fe99f862700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981141e0 con 0x7fe998102c00 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.514+0000 7fe99f862700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99810d4d0 con 0x7fe9981035a0 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.514+0000 7fe99d5fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 0x7fe998113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.514+0000 7fe99d5fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 0x7fe998113610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47988/0 (socket says 172.21.15.67:47988) 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.514+0000 7fe99d5fe700 1 -- 172.21.15.67:0/3401792338 learned_addr learned my addr 172.21.15.67:0/3401792338 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.514+0000 7fe99cdfd700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9981035a0 0x7fe998113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe99d5fe700 1 -- 172.21.15.67:0/3401792338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9981035a0 msgr2=0x7fe998113b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe99d5fe700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9981035a0 0x7fe998113b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe99d5fe700 1 -- 172.21.15.67:0/3401792338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe994005040 con 0x7fe998102c00 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe99d5fe700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 0x7fe998113610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe994009fd0 tx=0x7fe994009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe98dffb700 1 -- 172.21.15.67:0/3401792338 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe99400e040 con 0x7fe998102c00 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe98dffb700 1 -- 172.21.15.67:0/3401792338 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe99400bc50 con 0x7fe998102c00 2023-12-05T09:33:01.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99810d700 con 0x7fe998102c00 2023-12-05T09:33:01.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe98dffb700 1 -- 172.21.15.67:0/3401792338 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe994013ea0 con 0x7fe998102c00 2023-12-05T09:33:01.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.515+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99810dc40 con 0x7fe998102c00 2023-12-05T09:33:01.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.516+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9980fff10 con 0x7fe998102c00 2023-12-05T09:33:01.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.517+0000 7fe98dffb700 1 -- 172.21.15.67:0/3401792338 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe994013420 con 0x7fe998102c00 2023-12-05T09:33:01.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.518+0000 7fe98dffb700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe98406ce70 0x7fe98406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.518+0000 7fe98dffb700 1 -- 172.21.15.67:0/3401792338 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe99408d810 con 0x7fe998102c00 2023-12-05T09:33:01.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.519+0000 7fe99cdfd700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe98406ce70 0x7fe98406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:01.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.519+0000 7fe99cdfd700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe98406ce70 0x7fe98406f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe988007fd0 tx=0x7fe988009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.523+0000 7fe98dffb700 1 -- 172.21.15.67:0/3401792338 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe99405b180 con 0x7fe998102c00 2023-12-05T09:33:01.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.749+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe99810ebf0 con 0x7fe98406ce70 2023-12-05T09:33:01.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.751+0000 7fe98dffb700 1 -- 172.21.15.67:0/3401792338 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe99810ebf0 con 0x7fe98406ce70 2023-12-05T09:33:01.749 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:33:01.749 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:33:01.749 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: "mon" 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "9/21 daemons upgraded", 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:33:01.750 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:33:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe98406ce70 msgr2=0x7fe98406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe98406ce70 0x7fe98406f320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe988007fd0 tx=0x7fe988009040 comp rx=0 tx=0).stop 2023-12-05T09:33:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 msgr2=0x7fe998113610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 0x7fe998113610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe994009fd0 tx=0x7fe994009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 shutdown_connections 2023-12-05T09:33:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe98406ce70 0x7fe98406f320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe998102c00 0x7fe998113610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 --2- 172.21.15.67:0/3401792338 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9981035a0 0x7fe998113b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.753+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 >> 172.21.15.67:0/3401792338 conn(0x7fe9980f8790 msgr2=0x7fe9980fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:01.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.754+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 shutdown_connections 2023-12-05T09:33:01.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.754+0000 7fe99f862700 1 -- 172.21.15.67:0/3401792338 wait complete. 2023-12-05T09:33:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.894+0000 7f04e2fff700 1 -- 172.21.15.67:0/1043742980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc1035a0 msgr2=0x7f04dc0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.894+0000 7f04e2fff700 1 --2- 172.21.15.67:0/1043742980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc1035a0 0x7f04dc0fcc10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f04c8004940 tx=0x7f04c8009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.894+0000 7f04e2fff700 1 -- 172.21.15.67:0/1043742980 shutdown_connections 2023-12-05T09:33:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.894+0000 7f04e2fff700 1 --2- 172.21.15.67:0/1043742980 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc1035a0 0x7f04dc0fcc10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.894+0000 7f04e2fff700 1 --2- 172.21.15.67:0/1043742980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04dc102c00 0x7f04dc102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.894+0000 7f04e2fff700 1 -- 172.21.15.67:0/1043742980 >> 172.21.15.67:0/1043742980 conn(0x7f04dc0f8790 msgr2=0x7f04dc0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.894+0000 7f04e2fff700 1 -- 172.21.15.67:0/1043742980 shutdown_connections 2023-12-05T09:33:01.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.894+0000 7f04e2fff700 1 -- 172.21.15.67:0/1043742980 wait complete. 2023-12-05T09:33:01.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.895+0000 7f04e2fff700 1 Processor -- start 2023-12-05T09:33:01.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.895+0000 7f04e2fff700 1 -- start start 2023-12-05T09:33:01.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e2fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc102c00 0x7f04dc115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e2fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04dc1035a0 0x7f04dc115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e2fff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1163c0 con 0x7f04dc102c00 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e2fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc10f6f0 con 0x7f04dc1035a0 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e0d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc102c00 0x7f04dc115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e0d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc102c00 0x7f04dc115830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48006/0 (socket says 172.21.15.67:48006) 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e0d9b700 1 -- 172.21.15.67:0/4157740526 learned_addr learned my addr 172.21.15.67:0/4157740526 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e0d9b700 1 -- 172.21.15.67:0/4157740526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04dc1035a0 msgr2=0x7f04dc115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e0d9b700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04dc1035a0 0x7f04dc115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:01.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.896+0000 7f04e0d9b700 1 -- 172.21.15.67:0/4157740526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c8005040 con 0x7f04dc102c00 2023-12-05T09:33:01.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.897+0000 7f04e0d9b700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc102c00 0x7f04dc115830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f04d0002a50 tx=0x7f04d00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:01.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.897+0000 7f04d97fa700 1 -- 172.21.15.67:0/4157740526 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04d0007cc0 con 0x7f04dc102c00 2023-12-05T09:33:01.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.897+0000 7f04d97fa700 1 -- 172.21.15.67:0/4157740526 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f04d000f040 con 0x7f04dc102c00 2023-12-05T09:33:01.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.897+0000 7f04d97fa700 1 -- 172.21.15.67:0/4157740526 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04d0009540 con 0x7f04dc102c00 2023-12-05T09:33:01.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.897+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc10f9d0 con 0x7f04dc102c00 2023-12-05T09:33:01.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.897+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc10ff10 con 0x7f04dc102c00 2023-12-05T09:33:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.898+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc0fc390 con 0x7f04dc102c00 2023-12-05T09:33:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.899+0000 7f04d97fa700 1 -- 172.21.15.67:0/4157740526 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f04d00096a0 con 0x7f04dc102c00 2023-12-05T09:33:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.900+0000 7f04d97fa700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f04cc06ce60 0x7f04cc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.900+0000 7f04d97fa700 1 -- 172.21.15.67:0/4157740526 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f04d008c080 con 0x7f04dc102c00 2023-12-05T09:33:01.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.900+0000 7f04dbfff700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f04cc06ce60 0x7f04cc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:01.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.901+0000 7f04dbfff700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f04cc06ce60 0x7f04cc06f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f04c8004f90 tx=0x7f04c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:01.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:01.904+0000 7f04d97fa700 1 -- 172.21.15.67:0/4157740526 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f04d00599d0 con 0x7f04dc102c00 2023-12-05T09:33:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: pgmap v93: 65 pgs: 10 peering, 55 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:33:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/1279539955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/1174148339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:33:02.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/378 objects degraded (6.878%), 7 pgs degraded) 2023-12-05T09:33:02.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:01 smithi067 ceph-mon[210894]: Cluster is now healthy 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: pgmap v93: 65 pgs: 10 peering, 55 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/1279539955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/1174148339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/378 objects degraded (6.878%), 7 pgs degraded) 2023-12-05T09:33:02.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:01 smithi134 ceph-mon[172895]: Cluster is now healthy 2023-12-05T09:33:02.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.199+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f04dc04bb80 con 0x7f04dc102c00 2023-12-05T09:33:02.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.200+0000 7f04d97fa700 1 -- 172.21.15.67:0/4157740526 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f04d0059560 con 0x7f04dc102c00 2023-12-05T09:33:02.198 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_OK 2023-12-05T09:33:02.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f04cc06ce60 msgr2=0x7f04cc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:02.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f04cc06ce60 0x7f04cc06f310 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f04c8004f90 tx=0x7f04c8009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:02.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc102c00 msgr2=0x7f04dc115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:02.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc102c00 0x7f04dc115830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f04d0002a50 tx=0x7f04d00046b0 comp rx=0 tx=0).stop 2023-12-05T09:33:02.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 shutdown_connections 2023-12-05T09:33:02.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f04cc06ce60 0x7f04cc06f310 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:02.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f04dc102c00 0x7f04dc115830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:02.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 --2- 172.21.15.67:0/4157740526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04dc1035a0 0x7f04dc115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:02.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 >> 172.21.15.67:0/4157740526 conn(0x7f04dc0f8790 msgr2=0x7f04dc0fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:02.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.202+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 shutdown_connections 2023-12-05T09:33:02.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:02.203+0000 7f04e2fff700 1 -- 172.21.15.67:0/4157740526 wait complete. 2023-12-05T09:33:03.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:02 smithi067 ceph-mon[210894]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:03.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:02 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/4157740526' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:33:03.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:02 smithi134 ceph-mon[172895]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:03.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:02 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/4157740526' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:33:04.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:03 smithi067 ceph-mon[210894]: pgmap v94: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:04.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:03 smithi134 ceph-mon[172895]: pgmap v94: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:06.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:05 smithi067 ceph-mon[210894]: pgmap v95: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:06.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:05 smithi134 ceph-mon[172895]: pgmap v95: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:08.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:07 smithi067 ceph-mon[210894]: pgmap v96: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:08.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:07 smithi134 ceph-mon[172895]: pgmap v96: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:10.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:09 smithi067 ceph-mon[210894]: pgmap v97: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:10.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:09 smithi134 ceph-mon[172895]: pgmap v97: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:12.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:11 smithi067 ceph-mon[210894]: pgmap v98: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:12.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:11 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:12.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:11 smithi134 ceph-mon[172895]: pgmap v98: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:12.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:11 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:14.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:13 smithi067 ceph-mon[210894]: pgmap v99: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:14.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:13 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T09:33:14.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:13 smithi134 ceph-mon[172895]: pgmap v99: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:14.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:13 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T09:33:15.074 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:14 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T09:33:15.074 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:14 smithi134 ceph-mon[172895]: Upgrade: osd.3 is safe to restart 2023-12-05T09:33:15.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:14 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-05T09:33:15.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:14 smithi067 ceph-mon[210894]: Upgrade: osd.3 is safe to restart 2023-12-05T09:33:16.082 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:15 smithi134 ceph-mon[172895]: pgmap v100: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:16.082 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:16.082 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:33:16.082 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:33:16.082 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:16.082 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:33:16.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:15 smithi067 ceph-mon[210894]: pgmap v100: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:16.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:16.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-05T09:33:16.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:33:16.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:16.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:33:17.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:16 smithi067 ceph-mon[210894]: Upgrade: Updating osd.3 2023-12-05T09:33:17.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:16 smithi067 ceph-mon[210894]: Deploying daemon osd.3 on smithi134 2023-12-05T09:33:17.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:16 smithi067 ceph-mon[210894]: pgmap v101: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:16 smithi134 ceph-mon[172895]: Upgrade: Updating osd.3 2023-12-05T09:33:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:16 smithi134 ceph-mon[172895]: Deploying daemon osd.3 on smithi134 2023-12-05T09:33:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:16 smithi134 ceph-mon[172895]: pgmap v101: 65 pgs: 65 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:18.127 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:17 smithi134 systemd[1]: Stopping Ceph osd.3 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:33:18.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:18 smithi067 ceph-mon[210894]: osd.3 marked itself down and dead 2023-12-05T09:33:18.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:18 smithi134 ceph-mon[172895]: osd.3 marked itself down and dead 2023-12-05T09:33:18.627 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:18 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[122627]: 2023-12-05T09:33:18.174+0000 7f815beca700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:33:18.627 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:18 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[122627]: 2023-12-05T09:33:18.174+0000 7f815beca700 -1 osd.3 66 *** Got signal Terminated *** 2023-12-05T09:33:18.627 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:18 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[122627]: 2023-12-05T09:33:18.174+0000 7f815beca700 -1 osd.3 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:33:19.126 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:18 smithi134 bash[185063]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3 2023-12-05T09:33:19.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:19 smithi134 ceph-mon[172895]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:33:19.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:19 smithi134 ceph-mon[172895]: failed to encode map e67 with expected crc 2023-12-05T09:33:19.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:19 smithi134 ceph-mon[172895]: osdmap e67: 6 total, 5 up, 6 in 2023-12-05T09:33:19.503 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:19 smithi134 ceph-mon[172895]: pgmap v103: 65 pgs: 16 stale+active+clean, 49 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:19.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:19 smithi067 ceph-mon[210894]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:33:19.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:19 smithi067 ceph-mon[210894]: failed to encode map e67 with expected crc 2023-12-05T09:33:19.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:19 smithi067 ceph-mon[210894]: osdmap e67: 6 total, 5 up, 6 in 2023-12-05T09:33:19.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:19 smithi067 ceph-mon[210894]: pgmap v103: 65 pgs: 16 stale+active+clean, 49 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2023-12-05T09:33:20.613 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:20 smithi134 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.3.service: Succeeded. 2023-12-05T09:33:20.613 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:20 smithi134 systemd[1]: Stopped Ceph osd.3 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:33:20.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:20 smithi134 ceph-mon[172895]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:20 smithi134 ceph-mon[172895]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:20 smithi134 ceph-mon[172895]: osdmap e68: 6 total, 5 up, 6 in 2023-12-05T09:33:20.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:20 smithi134 ceph-mon[172895]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:20 smithi134 ceph-mon[172895]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:20 smithi134 ceph-mon[172895]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:20 smithi067 ceph-mon[210894]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:20 smithi067 ceph-mon[210894]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:20 smithi067 ceph-mon[210894]: osdmap e68: 6 total, 5 up, 6 in 2023-12-05T09:33:20.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:20 smithi067 ceph-mon[210894]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:20 smithi067 ceph-mon[210894]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:20 smithi067 ceph-mon[210894]: failed to encode map e68 with expected crc 2023-12-05T09:33:20.877 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:20 smithi134 systemd[1]: Starting Ceph osd.3 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:33:21.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:21 smithi067 ceph-mon[210894]: pgmap v105: 65 pgs: 2 active+undersized+degraded, 7 peering, 12 stale+active+clean, 2 active+undersized, 42 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 4/378 objects degraded (1.058%) 2023-12-05T09:33:21.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:21 smithi134 ceph-mon[172895]: pgmap v105: 65 pgs: 2 active+undersized+degraded, 7 peering, 12 stale+active+clean, 2 active+undersized, 42 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 4/378 objects degraded (1.058%) 2023-12-05T09:33:22.126 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:21 smithi134 bash[185333]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-05T09:33:22.127 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:21 smithi134 bash[185333]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-05T09:33:22.127 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:21 smithi134 bash[185333]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-05T09:33:22.127 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:21 smithi134 bash[185333]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-05T09:33:22.127 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:21 smithi134 bash[185333]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-05T09:33:22.127 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:21 smithi134 bash[185333]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-05T09:33:22.127 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:21 smithi134 bash[185333]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-05T09:33:22.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:22 smithi067 ceph-mon[210894]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-05T09:33:22.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:22 smithi067 ceph-mon[210894]: Health check failed: Degraded data redundancy: 4/378 objects degraded (1.058%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:22.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:22 smithi134 ceph-mon[172895]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2023-12-05T09:33:22.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:22 smithi134 ceph-mon[172895]: Health check failed: Degraded data redundancy: 4/378 objects degraded (1.058%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:22.627 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:22 smithi134 bash[185583]: ec57f7ef86f1a5dd2d25f81443941020fbe813ddc72a2c747f04dd2c669bd0d9 2023-12-05T09:33:22.627 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:22 smithi134 ceph-osd[185621]: -- 172.21.15.134:0/2669805618 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5574af9431e0 con 0x5574af913000 2023-12-05T09:33:22.627 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:22 smithi134 systemd[1]: Started Ceph osd.3 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:33:23.377 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:23 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[185598]: 2023-12-05T09:33:23.059+0000 7fec69da7640 -1 Falling back to public interface 2023-12-05T09:33:23.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:23 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:23.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:23 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:23.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:23 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:33:23.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:23 smithi067 ceph-mon[210894]: pgmap v106: 65 pgs: 11 active+undersized+degraded, 7 peering, 2 stale+active+clean, 11 active+undersized, 34 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 48/378 objects degraded (12.698%) 2023-12-05T09:33:23.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:23 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:23 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:23 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:33:23.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:23 smithi134 ceph-mon[172895]: pgmap v106: 65 pgs: 11 active+undersized+degraded, 7 peering, 2 stale+active+clean, 11 active+undersized, 34 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 48/378 objects degraded (12.698%) 2023-12-05T09:33:25.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:24 smithi134 ceph-mon[172895]: pgmap v107: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/378 objects degraded (20.635%) 2023-12-05T09:33:25.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:24 smithi134 ceph-mon[172895]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-05T09:33:25.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:24 smithi067 ceph-mon[210894]: pgmap v107: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/378 objects degraded (20.635%) 2023-12-05T09:33:25.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:24 smithi067 ceph-mon[210894]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2023-12-05T09:33:26.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:26 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:26.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:26 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:26.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:26 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:26.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:26 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:27.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:27 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:27.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:27 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:27.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:27 smithi134 ceph-mon[172895]: pgmap v108: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/378 objects degraded (20.635%) 2023-12-05T09:33:28.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:27 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:28.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:27 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:28.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:27 smithi067 ceph-mon[210894]: pgmap v108: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/378 objects degraded (20.635%) 2023-12-05T09:33:28.377 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:28 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[185598]: 2023-12-05T09:33:28.222+0000 7fec69da7640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-05T09:33:29.126 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:28 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[185598]: 2023-12-05T09:33:28.822+0000 7fec69da7640 -1 osd.3 66 log_to_monitors true 2023-12-05T09:33:29.955 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:33:29 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[185598]: 2023-12-05T09:33:29.851+0000 7fec59214700 -1 osd.3 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:33:29.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:29 smithi134 ceph-mon[172895]: pgmap v109: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/378 objects degraded (20.635%) 2023-12-05T09:33:29.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:29 smithi134 ceph-mon[172895]: from='osd.3 [v2:172.21.15.134:6800/4075414049,v1:172.21.15.134:6801/4075414049]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:33:29.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:29 smithi134 ceph-mon[172895]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:33:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:29 smithi067 ceph-mon[210894]: pgmap v109: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 330 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 78/378 objects degraded (20.635%) 2023-12-05T09:33:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:29 smithi067 ceph-mon[210894]: from='osd.3 [v2:172.21.15.134:6800/4075414049,v1:172.21.15.134:6801/4075414049]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:33:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:29 smithi067 ceph-mon[210894]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-05T09:33:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T09:33:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='osd.3 [v2:172.21.15.134:6800/4075414049,v1:172.21.15.134:6801/4075414049]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:33:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: osdmap e69: 6 total, 5 up, 6 in 2023-12-05T09:33:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:33:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: failed to encode map e69 with expected crc 2023-12-05T09:33:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 78/378 objects degraded (20.635%), 20 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:31.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:33:31.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='osd.3 [v2:172.21.15.134:6800/4075414049,v1:172.21.15.134:6801/4075414049]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: osdmap e69: 6 total, 5 up, 6 in 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: failed to encode map e69 with expected crc 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T09:33:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 78/378 objects degraded (20.635%), 20 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:31.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:31.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:33:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: failed to encode map e69 with expected crc 2023-12-05T09:33:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T09:33:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-05T09:33:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: pgmap v111: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 78/378 objects degraded (20.635%) 2023-12-05T09:33:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:33:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: failed to encode map e70 with expected crc 2023-12-05T09:33:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: osd.3 [v2:172.21.15.134:6800/4075414049,v1:172.21.15.134:6801/4075414049] boot 2023-12-05T09:33:32.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: osdmap e70: 6 total, 6 up, 6 in 2023-12-05T09:33:32.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:33:32.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: failed to encode map e69 with expected crc 2023-12-05T09:33:32.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T09:33:32.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2023-12-05T09:33:32.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: pgmap v111: 65 pgs: 20 active+undersized+degraded, 18 active+undersized, 27 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 78/378 objects degraded (20.635%) 2023-12-05T09:33:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:33:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: failed to encode map e70 with expected crc 2023-12-05T09:33:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: osd.3 [v2:172.21.15.134:6800/4075414049,v1:172.21.15.134:6801/4075414049] boot 2023-12-05T09:33:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: osdmap e70: 6 total, 6 up, 6 in 2023-12-05T09:33:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:31 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-05T09:33:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.360+0000 7f2cedab4700 1 -- 172.21.15.67:0/3114763720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce81035a0 msgr2=0x7f2ce80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.360+0000 7f2cedab4700 1 --2- 172.21.15.67:0/3114763720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce81035a0 0x7f2ce80fcc10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc004940 tx=0x7f2cdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.360+0000 7f2cedab4700 1 -- 172.21.15.67:0/3114763720 shutdown_connections 2023-12-05T09:33:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.360+0000 7f2cedab4700 1 --2- 172.21.15.67:0/3114763720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce81035a0 0x7f2ce80fcc10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.360+0000 7f2cedab4700 1 --2- 172.21.15.67:0/3114763720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce8102c00 0x7f2ce8102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.360+0000 7f2cedab4700 1 -- 172.21.15.67:0/3114763720 >> 172.21.15.67:0/3114763720 conn(0x7f2ce80f8790 msgr2=0x7f2ce80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.360+0000 7f2cedab4700 1 -- 172.21.15.67:0/3114763720 shutdown_connections 2023-12-05T09:33:32.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.360+0000 7f2cedab4700 1 -- 172.21.15.67:0/3114763720 wait complete. 2023-12-05T09:33:32.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.361+0000 7f2cedab4700 1 Processor -- start 2023-12-05T09:33:32.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.361+0000 7f2cedab4700 1 -- start start 2023-12-05T09:33:32.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.361+0000 7f2cedab4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce8102c00 0x7f2ce81157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:32.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2cedab4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce81035a0 0x7f2ce8115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2cedab4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8116350 con 0x7f2ce8102c00 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2cedab4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce810f680 con 0x7f2ce81035a0 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2ce77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce8102c00 0x7f2ce81157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2ce77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce8102c00 0x7f2ce81157c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48016/0 (socket says 172.21.15.67:48016) 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2ce77fe700 1 -- 172.21.15.67:0/1885319771 learned_addr learned my addr 172.21.15.67:0/1885319771 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2ce6ffd700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce81035a0 0x7f2ce8115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2ce77fe700 1 -- 172.21.15.67:0/1885319771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce81035a0 msgr2=0x7f2ce8115d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2ce77fe700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce81035a0 0x7f2ce8115d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.362+0000 7f2ce77fe700 1 -- 172.21.15.67:0/1885319771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc005040 con 0x7f2ce8102c00 2023-12-05T09:33:32.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.363+0000 7f2ce77fe700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce8102c00 0x7f2ce81157c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800eb40 tx=0x7f2cd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:32.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.363+0000 7f2ccffff700 1 -- 172.21.15.67:0/1885319771 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd8007cc0 con 0x7f2ce8102c00 2023-12-05T09:33:32.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.363+0000 7f2ccffff700 1 -- 172.21.15.67:0/1885319771 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cd800f040 con 0x7f2ce8102c00 2023-12-05T09:33:32.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.363+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce810f900 con 0x7f2ce8102c00 2023-12-05T09:33:32.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.363+0000 7f2ccffff700 1 -- 172.21.15.67:0/1885319771 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd800c990 con 0x7f2ce8102c00 2023-12-05T09:33:32.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.363+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce810fe10 con 0x7f2ce8102c00 2023-12-05T09:33:32.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.364+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce80fc390 con 0x7f2ce8102c00 2023-12-05T09:33:32.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.365+0000 7f2ccffff700 1 -- 172.21.15.67:0/1885319771 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2cd800cc00 con 0x7f2ce8102c00 2023-12-05T09:33:32.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.367+0000 7f2ccffff700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2cd006ce70 0x7f2cd006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:32.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.367+0000 7f2ccffff700 1 -- 172.21.15.67:0/1885319771 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2cd808bf70 con 0x7f2ce8102c00 2023-12-05T09:33:32.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.367+0000 7f2ce6ffd700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2cd006ce70 0x7f2cd006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:32.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.368+0000 7f2ce6ffd700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2cd006ce70 0x7f2cd006f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2ce81109b0 tx=0x7f2cdc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:32.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.372+0000 7f2ccffff700 1 -- 172.21.15.67:0/1885319771 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2cd80598f0 con 0x7f2ce8102c00 2023-12-05T09:33:32.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.602+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce8110e10 con 0x7f2cd006ce70 2023-12-05T09:33:32.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.603+0000 7f2ccffff700 1 -- 172.21.15.67:0/1885319771 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2ce8110e10 con 0x7f2cd006ce70 2023-12-05T09:33:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2cd006ce70 msgr2=0x7f2cd006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2cd006ce70 0x7f2cd006f320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2ce81109b0 tx=0x7f2cdc009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce8102c00 msgr2=0x7f2ce81157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce8102c00 0x7f2ce81157c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800eb40 tx=0x7f2cd800b040 comp rx=0 tx=0).stop 2023-12-05T09:33:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 shutdown_connections 2023-12-05T09:33:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2cd006ce70 0x7f2cd006f320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2ce8102c00 0x7f2ce81157c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 --2- 172.21.15.67:0/1885319771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce81035a0 0x7f2ce8115d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 >> 172.21.15.67:0/1885319771 conn(0x7f2ce80f8790 msgr2=0x7f2ce8070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 shutdown_connections 2023-12-05T09:33:32.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.606+0000 7f2cedab4700 1 -- 172.21.15.67:0/1885319771 wait complete. 2023-12-05T09:33:32.619 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:33:32.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.746+0000 7fdf12147700 1 -- 172.21.15.67:0/412491722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c102a70 msgr2=0x7fdf0c102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:32.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.746+0000 7fdf12147700 1 --2- 172.21.15.67:0/412491722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c102a70 0x7fdf0c102e40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf08004940 tx=0x7fdf08009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:32.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.746+0000 7fdf12147700 1 -- 172.21.15.67:0/412491722 shutdown_connections 2023-12-05T09:33:32.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.746+0000 7fdf12147700 1 --2- 172.21.15.67:0/412491722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c0fca30 0x7fdf0c0fcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.746+0000 7fdf12147700 1 --2- 172.21.15.67:0/412491722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c102a70 0x7fdf0c102e40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.746+0000 7fdf12147700 1 -- 172.21.15.67:0/412491722 >> 172.21.15.67:0/412491722 conn(0x7fdf0c0f8590 msgr2=0x7fdf0c0fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:32.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.746+0000 7fdf12147700 1 -- 172.21.15.67:0/412491722 shutdown_connections 2023-12-05T09:33:32.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.746+0000 7fdf12147700 1 -- 172.21.15.67:0/412491722 wait complete. 2023-12-05T09:33:32.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.747+0000 7fdf12147700 1 Processor -- start 2023-12-05T09:33:32.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.747+0000 7fdf12147700 1 -- start start 2023-12-05T09:33:32.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf12147700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0fca30 0x7fdf0c115600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:32.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf12147700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c102a70 0x7fdf0c115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:32.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf12147700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1161d0 con 0x7fdf0c0fca30 2023-12-05T09:33:32.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf12147700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c10f4c0 con 0x7fdf0c102a70 2023-12-05T09:33:32.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf11145700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0fca30 0x7fdf0c115600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf11145700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0fca30 0x7fdf0c115600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48030/0 (socket says 172.21.15.67:48030) 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf11145700 1 -- 172.21.15.67:0/2133274689 learned_addr learned my addr 172.21.15.67:0/2133274689 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf11145700 1 -- 172.21.15.67:0/2133274689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c102a70 msgr2=0x7fdf0c115b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf11145700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c102a70 0x7fdf0c115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.748+0000 7fdf11145700 1 -- 172.21.15.67:0/2133274689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08005040 con 0x7fdf0c0fca30 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.749+0000 7fdf11145700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0fca30 0x7fdf0c115600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009360 tx=0x7fdf08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.749+0000 7fdf01ffb700 1 -- 172.21.15.67:0/2133274689 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0800e040 con 0x7fdf0c0fca30 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.749+0000 7fdf01ffb700 1 -- 172.21.15.67:0/2133274689 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdf0800bc50 con 0x7fdf0c0fca30 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.749+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c10f6f0 con 0x7fdf0c0fca30 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.749+0000 7fdf01ffb700 1 -- 172.21.15.67:0/2133274689 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0801c630 con 0x7fdf0c0fca30 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.749+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c10fc30 con 0x7fdf0c0fca30 2023-12-05T09:33:32.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.750+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c05f270 con 0x7fdf0c0fca30 2023-12-05T09:33:32.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.751+0000 7fdf01ffb700 1 -- 172.21.15.67:0/2133274689 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fdf08013420 con 0x7fdf0c0fca30 2023-12-05T09:33:32.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.752+0000 7fdf01ffb700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdef806ce70 0x7fdef806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:32.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.752+0000 7fdf01ffb700 1 -- 172.21.15.67:0/2133274689 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdf0808d580 con 0x7fdf0c0fca30 2023-12-05T09:33:32.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.752+0000 7fdf10944700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdef806ce70 0x7fdef806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:32.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.753+0000 7fdf10944700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdef806ce70 0x7fdef806f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c110ea0 tx=0x7fdefc009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:32.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.757+0000 7fdf01ffb700 1 -- 172.21.15.67:0/2133274689 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdf0805af50 con 0x7fdf0c0fca30 2023-12-05T09:33:32.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.990+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf0c10fea0 con 0x7fdef806ce70 2023-12-05T09:33:32.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.992+0000 7fdf01ffb700 1 -- 172.21.15.67:0/2133274689 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdf0c10fea0 con 0x7fdef806ce70 2023-12-05T09:33:32.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdef806ce70 msgr2=0x7fdef806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:32.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdef806ce70 0x7fdef806f320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c110ea0 tx=0x7fdefc009ce0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0fca30 msgr2=0x7fdf0c115600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:32.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0fca30 0x7fdf0c115600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009360 tx=0x7fdf08009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 shutdown_connections 2023-12-05T09:33:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fdef806ce70 0x7fdef806f320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf0c0fca30 0x7fdf0c115600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 --2- 172.21.15.67:0/2133274689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf0c102a70 0x7fdf0c115b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 >> 172.21.15.67:0/2133274689 conn(0x7fdf0c0f8590 msgr2=0x7fdf0c0f9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 shutdown_connections 2023-12-05T09:33:32.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:32.994+0000 7fdf12147700 1 -- 172.21.15.67:0/2133274689 wait complete. 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: osdmap e71: 6 total, 6 up, 6 in 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:32 smithi067 ceph-mon[210894]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: osdmap e71: 6 total, 6 up, 6 in 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:32 smithi134 ceph-mon[172895]: failed to encode map e71 with expected crc 2023-12-05T09:33:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.133+0000 7fa512bf6700 1 -- 172.21.15.67:0/2445441627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 msgr2=0x7fa50c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.133+0000 7fa512bf6700 1 --2- 172.21.15.67:0/2445441627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 0x7fa50c102fd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa500004940 tx=0x7fa500009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:33.131 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.133+0000 7fa512bf6700 1 -- 172.21.15.67:0/2445441627 shutdown_connections 2023-12-05T09:33:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.133+0000 7fa512bf6700 1 --2- 172.21.15.67:0/2445441627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50c1035a0 0x7fa50c0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.133+0000 7fa512bf6700 1 --2- 172.21.15.67:0/2445441627 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 0x7fa50c102fd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.133+0000 7fa512bf6700 1 -- 172.21.15.67:0/2445441627 >> 172.21.15.67:0/2445441627 conn(0x7fa50c0f8790 msgr2=0x7fa50c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.133+0000 7fa512bf6700 1 -- 172.21.15.67:0/2445441627 shutdown_connections 2023-12-05T09:33:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.133+0000 7fa512bf6700 1 -- 172.21.15.67:0/2445441627 wait complete. 2023-12-05T09:33:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.134+0000 7fa512bf6700 1 Processor -- start 2023-12-05T09:33:33.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.134+0000 7fa512bf6700 1 -- start start 2023-12-05T09:33:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa512bf6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 0x7fa50c115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa512bf6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50c1035a0 0x7fa50c115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa512bf6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c1163c0 con 0x7fa50c102c00 2023-12-05T09:33:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa512bf6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c10f6f0 con 0x7fa50c1035a0 2023-12-05T09:33:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa510992700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 0x7fa50c115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa510992700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 0x7fa50c115830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48048/0 (socket says 172.21.15.67:48048) 2023-12-05T09:33:33.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa510992700 1 -- 172.21.15.67:0/310099722 learned_addr learned my addr 172.21.15.67:0/310099722 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:33.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa50bfff700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50c1035a0 0x7fa50c115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa510992700 1 -- 172.21.15.67:0/310099722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50c1035a0 msgr2=0x7fa50c115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa510992700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50c1035a0 0x7fa50c115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa510992700 1 -- 172.21.15.67:0/310099722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500005040 con 0x7fa50c102c00 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.135+0000 7fa50bfff700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50c1035a0 0x7fa50c115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.136+0000 7fa510992700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 0x7fa50c115830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa500009360 tx=0x7fa500009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.136+0000 7fa5097fa700 1 -- 172.21.15.67:0/310099722 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50000e040 con 0x7fa50c102c00 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.136+0000 7fa5097fa700 1 -- 172.21.15.67:0/310099722 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa50000bc50 con 0x7fa50c102c00 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.136+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c10f970 con 0x7fa50c102c00 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.136+0000 7fa5097fa700 1 -- 172.21.15.67:0/310099722 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50001c630 con 0x7fa50c102c00 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.136+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c10feb0 con 0x7fa50c102c00 2023-12-05T09:33:33.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.137+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c0fc390 con 0x7fa50c102c00 2023-12-05T09:33:33.136 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.138+0000 7fa5097fa700 1 -- 172.21.15.67:0/310099722 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fa500013420 con 0x7fa50c102c00 2023-12-05T09:33:33.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.139+0000 7fa5097fa700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fa4fc06ce70 0x7fa4fc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.140+0000 7fa5097fa700 1 -- 172.21.15.67:0/310099722 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa50008d580 con 0x7fa50c102c00 2023-12-05T09:33:33.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.140+0000 7fa50bfff700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fa4fc06ce70 0x7fa4fc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.140+0000 7fa50bfff700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fa4fc06ce70 0x7fa4fc06f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8007fd0 tx=0x7fa4f8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:33.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.144+0000 7fa5097fa700 1 -- 172.21.15.67:0/310099722 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa50005af50 con 0x7fa50c102c00 2023-12-05T09:33:33.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.363+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa50c110e80 con 0x7fa4fc06ce70 2023-12-05T09:33:33.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.373+0000 7fa5097fa700 1 -- 172.21.15.67:0/310099722 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa50c110e80 con 0x7fa4fc06ce70 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (4m) 39s ago 14m 16.1M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (2m) 39s ago 14m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 e6de51f67edd 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (2m) 8s ago 13m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 b78b9e680949 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (4m) 39s ago 14m 79.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (10m) 39s ago 10m 6297M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (9m) 39s ago 9m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (9m) 8s ago 9m 15.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (10m) 8s ago 9m 16.5M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (6m) 39s ago 16m 519M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:33:33.372 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (5m) 8s ago 13m 453M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (3m) 39s ago 16m 68.0M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (2m) 8s ago 13m 54.9M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 c85edd1646d0 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (5m) 39s ago 14m 8346k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 8s ago 13m 8376k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (111s) 39s ago 13m 120M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 cc8a8add819d 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (77s) 39s ago 12m 123M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 5c8edfa1578a 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (44s) 39s ago 12m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 c43c33a4a005 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (11s) 8s ago 11m 12.5M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 ec57f7ef86f1 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (11m) 8s ago 11m 800M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 4071ba5de5ab 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (11m) 8s ago 11m 896M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:33:33.373 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (4m) 39s ago 14m 53.1M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:33:33.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fa4fc06ce70 msgr2=0x7fa4fc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fa4fc06ce70 0x7fa4fc06f320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8007fd0 tx=0x7fa4f8009040 comp rx=0 tx=0).stop 2023-12-05T09:33:33.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 msgr2=0x7fa50c115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 0x7fa50c115830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa500009360 tx=0x7fa500009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:33.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 shutdown_connections 2023-12-05T09:33:33.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fa4fc06ce70 0x7fa4fc06f320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa50c102c00 0x7fa50c115830 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 --2- 172.21.15.67:0/310099722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50c1035a0 0x7fa50c115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.375+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 >> 172.21.15.67:0/310099722 conn(0x7fa50c0f8790 msgr2=0x7fa50c0fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:33.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.376+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 shutdown_connections 2023-12-05T09:33:33.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.376+0000 7fa512bf6700 1 -- 172.21.15.67:0/310099722 wait complete. 2023-12-05T09:33:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.515+0000 7f0766b3f700 1 -- 172.21.15.67:0/2760039669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601035a0 msgr2=0x7f07600fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.515+0000 7f0766b3f700 1 --2- 172.21.15.67:0/2760039669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601035a0 0x7f07600fcc10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f074c004940 tx=0x7f074c009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.515+0000 7f0766b3f700 1 -- 172.21.15.67:0/2760039669 shutdown_connections 2023-12-05T09:33:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.515+0000 7f0766b3f700 1 --2- 172.21.15.67:0/2760039669 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601035a0 0x7f07600fcc10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.515+0000 7f0766b3f700 1 --2- 172.21.15.67:0/2760039669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0760102c00 0x7f0760102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.515+0000 7f0766b3f700 1 -- 172.21.15.67:0/2760039669 >> 172.21.15.67:0/2760039669 conn(0x7f07600f8790 msgr2=0x7f07600faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.515+0000 7f0766b3f700 1 -- 172.21.15.67:0/2760039669 shutdown_connections 2023-12-05T09:33:33.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.515+0000 7f0766b3f700 1 -- 172.21.15.67:0/2760039669 wait complete. 2023-12-05T09:33:33.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.516+0000 7f0766b3f700 1 Processor -- start 2023-12-05T09:33:33.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.516+0000 7f0766b3f700 1 -- start start 2023-12-05T09:33:33.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.517+0000 7f0766b3f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0760102c00 0x7f076006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.517+0000 7f0766b3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07601035a0 0x7f0760070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.517+0000 7f0766b3f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760070a80 con 0x7f0760102c00 2023-12-05T09:33:33.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.517+0000 7f0766b3f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760070bf0 con 0x7f07601035a0 2023-12-05T09:33:33.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.517+0000 7f07648db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0760102c00 0x7f076006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.517+0000 7f07648db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0760102c00 0x7f076006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48060/0 (socket says 172.21.15.67:48060) 2023-12-05T09:33:33.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.517+0000 7f07648db700 1 -- 172.21.15.67:0/116306255 learned_addr learned my addr 172.21.15.67:0/116306255 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:33.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f075ffff700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07601035a0 0x7f0760070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f07648db700 1 -- 172.21.15.67:0/116306255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07601035a0 msgr2=0x7f0760070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f07648db700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07601035a0 0x7f0760070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f07648db700 1 -- 172.21.15.67:0/116306255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c005040 con 0x7f0760102c00 2023-12-05T09:33:33.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f075ffff700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07601035a0 0x7f0760070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:33:33.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f07648db700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0760102c00 0x7f076006ff40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f075400eb40 tx=0x7f075400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:33.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f075d7fa700 1 -- 172.21.15.67:0/116306255 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0754007cc0 con 0x7f0760102c00 2023-12-05T09:33:33.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f075d7fa700 1 -- 172.21.15.67:0/116306255 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f075400f040 con 0x7f0760102c00 2023-12-05T09:33:33.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0760119810 con 0x7f0760102c00 2023-12-05T09:33:33.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f075d7fa700 1 -- 172.21.15.67:0/116306255 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0754009570 con 0x7f0760102c00 2023-12-05T09:33:33.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.518+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0760119c70 con 0x7f0760102c00 2023-12-05T09:33:33.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.520+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07600fc390 con 0x7f0760102c00 2023-12-05T09:33:33.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.520+0000 7f075d7fa700 1 -- 172.21.15.67:0/116306255 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f07540096d0 con 0x7f0760102c00 2023-12-05T09:33:33.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.521+0000 7f075d7fa700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f075006ce60 0x7f075006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.522+0000 7f075d7fa700 1 -- 172.21.15.67:0/116306255 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f075408bff0 con 0x7f0760102c00 2023-12-05T09:33:33.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.522+0000 7f075ffff700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f075006ce60 0x7f075006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.522+0000 7f075ffff700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f075006ce60 0x7f075006f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f074c009fd0 tx=0x7f074c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:33.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.526+0000 7f075d7fa700 1 -- 172.21.15.67:0/116306255 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0754055f20 con 0x7f0760102c00 2023-12-05T09:33:33.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.820+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0760119e90 con 0x7f0760102c00 2023-12-05T09:33:33.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.821+0000 7f075d7fa700 1 -- 172.21.15.67:0/116306255 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f0754059540 con 0x7f0760102c00 2023-12-05T09:33:33.819 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:33:33.819 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:33:33.819 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 2, 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 4 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 6, 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 8 2023-12-05T09:33:33.820 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:33:33.821 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:33:33.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f075006ce60 msgr2=0x7f075006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f075006ce60 0x7f075006f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f074c009fd0 tx=0x7f074c009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:33.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0760102c00 msgr2=0x7f076006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0760102c00 0x7f076006ff40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f075400eb40 tx=0x7f075400b040 comp rx=0 tx=0).stop 2023-12-05T09:33:33.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 shutdown_connections 2023-12-05T09:33:33.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f075006ce60 0x7f075006f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0760102c00 0x7f076006ff40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 --2- 172.21.15.67:0/116306255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07601035a0 0x7f0760070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 >> 172.21.15.67:0/116306255 conn(0x7f07600f8790 msgr2=0x7f07600fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:33.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 shutdown_connections 2023-12-05T09:33:33.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.823+0000 7f0766b3f700 1 -- 172.21.15.67:0/116306255 wait complete. 2023-12-05T09:33:33.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.963+0000 7f1ba3ede700 1 -- 172.21.15.67:0/2217404482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c1057c0 msgr2=0x7f1b9c0fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.963+0000 7f1ba3ede700 1 --2- 172.21.15.67:0/2217404482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c1057c0 0x7f1b9c0fee30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c004940 tx=0x7f1b8c009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.963+0000 7f1ba3ede700 1 -- 172.21.15.67:0/2217404482 shutdown_connections 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.963+0000 7f1ba3ede700 1 --2- 172.21.15.67:0/2217404482 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c1057c0 0x7f1b9c0fee30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.963+0000 7f1ba3ede700 1 --2- 172.21.15.67:0/2217404482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b9c104e20 0x7f1b9c1051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.963+0000 7f1ba3ede700 1 -- 172.21.15.67:0/2217404482 >> 172.21.15.67:0/2217404482 conn(0x7f1b9c0fa990 msgr2=0x7f1b9c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.963+0000 7f1ba3ede700 1 -- 172.21.15.67:0/2217404482 shutdown_connections 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.963+0000 7f1ba3ede700 1 -- 172.21.15.67:0/2217404482 wait complete. 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.964+0000 7f1ba3ede700 1 Processor -- start 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.964+0000 7f1ba3ede700 1 -- start start 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba3ede700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c104e20 0x7f1b9c1158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba3ede700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b9c1057c0 0x7f1b9c115de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba3ede700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c116430 con 0x7f1b9c104e20 2023-12-05T09:33:33.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba3ede700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c10f760 con 0x7f1b9c1057c0 2023-12-05T09:33:33.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba1c7a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c104e20 0x7f1b9c1158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba1c7a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c104e20 0x7f1b9c1158a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48080/0 (socket says 172.21.15.67:48080) 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba1c7a700 1 -- 172.21.15.67:0/1174910033 learned_addr learned my addr 172.21.15.67:0/1174910033 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba1479700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b9c1057c0 0x7f1b9c115de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba1c7a700 1 -- 172.21.15.67:0/1174910033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b9c1057c0 msgr2=0x7f1b9c115de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba1c7a700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b9c1057c0 0x7f1b9c115de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.965+0000 7f1ba1c7a700 1 -- 172.21.15.67:0/1174910033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c005040 con 0x7f1b9c104e20 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.966+0000 7f1ba1c7a700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c104e20 0x7f1b9c1158a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800eb40 tx=0x7f1b9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.966+0000 7f1b927fc700 1 -- 172.21.15.67:0/1174910033 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b98007cc0 con 0x7f1b9c104e20 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.966+0000 7f1b927fc700 1 -- 172.21.15.67:0/1174910033 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1b9800f040 con 0x7f1b9c104e20 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.966+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c10f9e0 con 0x7f1b9c104e20 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.966+0000 7f1b927fc700 1 -- 172.21.15.67:0/1174910033 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9800c990 con 0x7f1b9c104e20 2023-12-05T09:33:33.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.966+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c10fef0 con 0x7f1b9c104e20 2023-12-05T09:33:33.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.967+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c1072f0 con 0x7f1b9c104e20 2023-12-05T09:33:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.968+0000 7f1b927fc700 1 -- 172.21.15.67:0/1174910033 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f1b9800cc00 con 0x7f1b9c104e20 2023-12-05T09:33:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.969+0000 7f1b927fc700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1b8806ce70 0x7f1b8806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.969+0000 7f1b927fc700 1 -- 172.21.15.67:0/1174910033 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1b9808bf70 con 0x7f1b9c104e20 2023-12-05T09:33:33.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.969+0000 7f1ba1479700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1b8806ce70 0x7f1b8806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:33.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.970+0000 7f1ba1479700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1b8806ce70 0x7f1b8806f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c110a90 tx=0x7f1b8c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:33.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:33.974+0000 7f1b927fc700 1 -- 172.21.15.67:0/1174910033 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1b980598f0 con 0x7f1b9c104e20 2023-12-05T09:33:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:33 smithi067 ceph-mon[210894]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:33 smithi067 ceph-mon[210894]: pgmap v114: 65 pgs: 8 peering, 17 active+undersized+degraded, 13 active+undersized, 27 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 67/378 objects degraded (17.725%) 2023-12-05T09:33:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:33 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/116306255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:34.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:33 smithi134 ceph-mon[172895]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:33 smithi134 ceph-mon[172895]: pgmap v114: 65 pgs: 8 peering, 17 active+undersized+degraded, 13 active+undersized, 27 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 67/378 objects degraded (17.725%) 2023-12-05T09:33:34.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:33 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/116306255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:33:34.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.226+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1b9c04bbd0 con 0x7f1b9c104e20 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.227+0000 7f1b927fc700 1 -- 172.21.15.67:0/1174910033 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1858 (secure 0 0 0) 0x7f1b98059480 con 0x7f1b9c104e20 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:e20 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 20 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:33:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:30:26.034169+0000 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:33:34.226 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:33:34.227 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:33:34.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1b8806ce70 msgr2=0x7f1b8806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:34.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1b8806ce70 0x7f1b8806f320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c110a90 tx=0x7f1b8c009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:34.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c104e20 msgr2=0x7f1b9c1158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:34.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c104e20 0x7f1b9c1158a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800eb40 tx=0x7f1b9800b040 comp rx=0 tx=0).stop 2023-12-05T09:33:34.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 shutdown_connections 2023-12-05T09:33:34.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f1b8806ce70 0x7f1b8806f320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b9c104e20 0x7f1b9c1158a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 --2- 172.21.15.67:0/1174910033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b9c1057c0 0x7f1b9c115de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 >> 172.21.15.67:0/1174910033 conn(0x7f1b9c0fa990 msgr2=0x7f1b9c0fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:34.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 shutdown_connections 2023-12-05T09:33:34.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.229+0000 7f1ba3ede700 1 -- 172.21.15.67:0/1174910033 wait complete. 2023-12-05T09:33:34.229 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 20 2023-12-05T09:33:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.368+0000 7f5b4d940700 1 -- 172.21.15.67:0/182305671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b481035a0 msgr2=0x7f5b480fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.368+0000 7f5b4d940700 1 --2- 172.21.15.67:0/182305671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b481035a0 0x7f5b480fcc10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c004940 tx=0x7f5b3c009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.368+0000 7f5b4d940700 1 -- 172.21.15.67:0/182305671 shutdown_connections 2023-12-05T09:33:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.368+0000 7f5b4d940700 1 --2- 172.21.15.67:0/182305671 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b481035a0 0x7f5b480fcc10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.368+0000 7f5b4d940700 1 --2- 172.21.15.67:0/182305671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b48102c00 0x7f5b48102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.368+0000 7f5b4d940700 1 -- 172.21.15.67:0/182305671 >> 172.21.15.67:0/182305671 conn(0x7f5b480f8790 msgr2=0x7f5b480faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.368+0000 7f5b4d940700 1 -- 172.21.15.67:0/182305671 shutdown_connections 2023-12-05T09:33:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.369+0000 7f5b4d940700 1 -- 172.21.15.67:0/182305671 wait complete. 2023-12-05T09:33:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.369+0000 7f5b4d940700 1 Processor -- start 2023-12-05T09:33:34.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.369+0000 7f5b4d940700 1 -- start start 2023-12-05T09:33:34.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.370+0000 7f5b4d940700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b48102c00 0x7f5b48115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:34.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.370+0000 7f5b4d940700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b481035a0 0x7f5b48115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:34.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.370+0000 7f5b4d940700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481163c0 con 0x7f5b48102c00 2023-12-05T09:33:34.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.370+0000 7f5b4d940700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4810f6f0 con 0x7f5b481035a0 2023-12-05T09:33:34.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.370+0000 7f5b46ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b48102c00 0x7f5b48115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:34.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.370+0000 7f5b46ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b48102c00 0x7f5b48115830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48094/0 (socket says 172.21.15.67:48094) 2023-12-05T09:33:34.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.370+0000 7f5b46ffd700 1 -- 172.21.15.67:0/1016809524 learned_addr learned my addr 172.21.15.67:0/1016809524 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:34.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.370+0000 7f5b467fc700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b481035a0 0x7f5b48115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:34.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b46ffd700 1 -- 172.21.15.67:0/1016809524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b481035a0 msgr2=0x7f5b48115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:34.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b46ffd700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b481035a0 0x7f5b48115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b46ffd700 1 -- 172.21.15.67:0/1016809524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c005040 con 0x7f5b48102c00 2023-12-05T09:33:34.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b46ffd700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b48102c00 0x7f5b48115830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800c830 tx=0x7f5b38004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:34.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b2f7fe700 1 -- 172.21.15.67:0/1016809524 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b380106f0 con 0x7f5b48102c00 2023-12-05T09:33:34.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b2f7fe700 1 -- 172.21.15.67:0/1016809524 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b38010d00 con 0x7f5b48102c00 2023-12-05T09:33:34.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4810f9d0 con 0x7f5b48102c00 2023-12-05T09:33:34.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b2f7fe700 1 -- 172.21.15.67:0/1016809524 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b38012e90 con 0x7f5b48102c00 2023-12-05T09:33:34.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.371+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4810fee0 con 0x7f5b48102c00 2023-12-05T09:33:34.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.373+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b480fc390 con 0x7f5b48102c00 2023-12-05T09:33:34.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.373+0000 7f5b2f7fe700 1 -- 172.21.15.67:0/1016809524 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f5b38010850 con 0x7f5b48102c00 2023-12-05T09:33:34.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.374+0000 7f5b2f7fe700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f5b3006ce60 0x7f5b3006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:34.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.375+0000 7f5b2f7fe700 1 -- 172.21.15.67:0/1016809524 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5b3808c220 con 0x7f5b48102c00 2023-12-05T09:33:34.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.375+0000 7f5b467fc700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f5b3006ce60 0x7f5b3006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:34.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.375+0000 7f5b467fc700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f5b3006ce60 0x7f5b3006f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b48110a20 tx=0x7f5b3c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:34.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.379+0000 7f5b2f7fe700 1 -- 172.21.15.67:0/1016809524 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5b38059cb0 con 0x7f5b48102c00 2023-12-05T09:33:34.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.608+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b48110e80 con 0x7f5b3006ce60 2023-12-05T09:33:34.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.609+0000 7f5b2f7fe700 1 -- 172.21.15.67:0/1016809524 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5b48110e80 con 0x7f5b3006ce60 2023-12-05T09:33:34.607 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "mon" 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "10/21 daemons upgraded", 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:33:34.608 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:33:34.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f5b3006ce60 msgr2=0x7f5b3006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:34.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f5b3006ce60 0x7f5b3006f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5b48110a20 tx=0x7f5b3c009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:34.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b48102c00 msgr2=0x7f5b48115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:34.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b48102c00 0x7f5b48115830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800c830 tx=0x7f5b38004470 comp rx=0 tx=0).stop 2023-12-05T09:33:34.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 shutdown_connections 2023-12-05T09:33:34.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f5b3006ce60 0x7f5b3006f310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b48102c00 0x7f5b48115830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 --2- 172.21.15.67:0/1016809524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b481035a0 0x7f5b48115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 >> 172.21.15.67:0/1016809524 conn(0x7f5b480f8790 msgr2=0x7f5b480fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:34.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 shutdown_connections 2023-12-05T09:33:34.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.612+0000 7f5b4d940700 1 -- 172.21.15.67:0/1016809524 wait complete. 2023-12-05T09:33:34.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.749+0000 7fe5faf80700 1 -- 172.21.15.67:0/598584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f4102c00 msgr2=0x7fe5f4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:34.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.749+0000 7fe5faf80700 1 --2- 172.21.15.67:0/598584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f4102c00 0x7fe5f4102fd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8004940 tx=0x7fe5e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:34.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.749+0000 7fe5faf80700 1 -- 172.21.15.67:0/598584 shutdown_connections 2023-12-05T09:33:34.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.749+0000 7fe5faf80700 1 --2- 172.21.15.67:0/598584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5f41035a0 0x7fe5f40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.749+0000 7fe5faf80700 1 --2- 172.21.15.67:0/598584 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f4102c00 0x7fe5f4102fd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.749+0000 7fe5faf80700 1 -- 172.21.15.67:0/598584 >> 172.21.15.67:0/598584 conn(0x7fe5f40f8790 msgr2=0x7fe5f40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:34.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.749+0000 7fe5faf80700 1 -- 172.21.15.67:0/598584 shutdown_connections 2023-12-05T09:33:34.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.749+0000 7fe5faf80700 1 -- 172.21.15.67:0/598584 wait complete. 2023-12-05T09:33:34.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.750+0000 7fe5faf80700 1 Processor -- start 2023-12-05T09:33:34.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.750+0000 7fe5faf80700 1 -- start start 2023-12-05T09:33:34.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.751+0000 7fe5faf80700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5f4102c00 0x7fe5f4113610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:34.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.751+0000 7fe5faf80700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f41035a0 0x7fe5f4113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:34.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.751+0000 7fe5faf80700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f41141e0 con 0x7fe5f41035a0 2023-12-05T09:33:34.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.751+0000 7fe5faf80700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f410d4d0 con 0x7fe5f4102c00 2023-12-05T09:33:34.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.751+0000 7fe5f3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f41035a0 0x7fe5f4113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:34.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.751+0000 7fe5f3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f41035a0 0x7fe5f4113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48104/0 (socket says 172.21.15.67:48104) 2023-12-05T09:33:34.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.751+0000 7fe5f3fff700 1 -- 172.21.15.67:0/3747294867 learned_addr learned my addr 172.21.15.67:0/3747294867 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f8d1c700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5f4102c00 0x7fe5f4113610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f3fff700 1 -- 172.21.15.67:0/3747294867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5f4102c00 msgr2=0x7fe5f4113610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f3fff700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5f4102c00 0x7fe5f4113610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f3fff700 1 -- 172.21.15.67:0/3747294867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8005040 con 0x7fe5f41035a0 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f8d1c700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5f4102c00 0x7fe5f4113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f3fff700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f41035a0 0x7fe5f4113b90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0002a50 tx=0x7fe5e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f17fa700 1 -- 172.21.15.67:0/3747294867 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e0007cc0 con 0x7fe5f41035a0 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f17fa700 1 -- 172.21.15.67:0/3747294867 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5e000f040 con 0x7fe5f41035a0 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f410d760 con 0x7fe5f41035a0 2023-12-05T09:33:34.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5f17fa700 1 -- 172.21.15.67:0/3747294867 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e000d9a0 con 0x7fe5f41035a0 2023-12-05T09:33:34.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.752+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f410dca0 con 0x7fe5f41035a0 2023-12-05T09:33:34.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.754+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f40fff10 con 0x7fe5f41035a0 2023-12-05T09:33:34.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.755+0000 7fe5f17fa700 1 -- 172.21.15.67:0/3747294867 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe5e000dc10 con 0x7fe5f41035a0 2023-12-05T09:33:34.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.755+0000 7fe5f17fa700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe5e406ce70 0x7fe5e406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:33:34.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.756+0000 7fe5f17fa700 1 -- 172.21.15.67:0/3747294867 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe5e008c040 con 0x7fe5f41035a0 2023-12-05T09:33:34.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.756+0000 7fe5f8d1c700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe5e406ce70 0x7fe5e406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:33:34.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.756+0000 7fe5f8d1c700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe5e406ce70 0x7fe5e406f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800b840 tx=0x7fe5e8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:33:34.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:34.760+0000 7fe5f17fa700 1 -- 172.21.15.67:0/3747294867 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe5e0059a30 con 0x7fe5f41035a0 2023-12-05T09:33:35.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.053+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe5f40fc390 con 0x7fe5f41035a0 2023-12-05T09:33:35.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.054+0000 7fe5f17fa700 1 -- 172.21.15.67:0/3747294867 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+849 (secure 0 0 0) 0x7fe5e00595c0 con 0x7fe5f41035a0 2023-12-05T09:33:35.052 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_WARN Degraded data redundancy: 50/378 objects degraded (13.228%), 12 pgs degraded 2023-12-05T09:33:35.052 INFO:teuthology.orchestra.run.smithi067.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 50/378 objects degraded (13.228%), 12 pgs degraded 2023-12-05T09:33:35.052 INFO:teuthology.orchestra.run.smithi067.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2023-12-05T09:33:35.052 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2023-12-05T09:33:35.053 INFO:teuthology.orchestra.run.smithi067.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2023-12-05T09:33:35.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe5e406ce70 msgr2=0x7fe5e406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:35.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe5e406ce70 0x7fe5e406f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800b840 tx=0x7fe5e8009e30 comp rx=0 tx=0).stop 2023-12-05T09:33:35.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f41035a0 msgr2=0x7fe5f4113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:33:35.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f41035a0 0x7fe5f4113b90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0002a50 tx=0x7fe5e0004600 comp rx=0 tx=0).stop 2023-12-05T09:33:35.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 shutdown_connections 2023-12-05T09:33:35.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5f4102c00 0x7fe5f4113610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:35.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe5e406ce70 0x7fe5e406f320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:35.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 --2- 172.21.15.67:0/3747294867 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe5f41035a0 0x7fe5f4113b90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:33:35.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 >> 172.21.15.67:0/3747294867 conn(0x7fe5f40f8790 msgr2=0x7fe5f40fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:33:35.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 shutdown_connections 2023-12-05T09:33:35.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:33:35.056+0000 7fe5faf80700 1 -- 172.21.15.67:0/3747294867 wait complete. 2023-12-05T09:33:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:34 smithi067 ceph-mon[210894]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:34 smithi067 ceph-mon[210894]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:34 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/1174910033' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:33:35.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:34 smithi134 ceph-mon[172895]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:34 smithi134 ceph-mon[172895]: from='client.34296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:34 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/1174910033' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:33:36.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:35 smithi067 ceph-mon[210894]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:36.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:35 smithi067 ceph-mon[210894]: pgmap v115: 65 pgs: 8 peering, 12 active+undersized+degraded, 7 active+undersized, 38 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 50/378 objects degraded (13.228%) 2023-12-05T09:33:36.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:35 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3747294867' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:33:36.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:35 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 50/378 objects degraded (13.228%), 12 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:36.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:35 smithi134 ceph-mon[172895]: from='client.34308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:33:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:35 smithi134 ceph-mon[172895]: pgmap v115: 65 pgs: 8 peering, 12 active+undersized+degraded, 7 active+undersized, 38 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 50/378 objects degraded (13.228%) 2023-12-05T09:33:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:35 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3747294867' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:33:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:35 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 50/378 objects degraded (13.228%), 12 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:37.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:36 smithi067 ceph-mon[210894]: pgmap v116: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:37.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:36 smithi134 ceph-mon[172895]: pgmap v116: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:38.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:37 smithi134 ceph-mon[172895]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/378 objects degraded (13.228%), 12 pgs degraded) 2023-12-05T09:33:38.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:37 smithi134 ceph-mon[172895]: Cluster is now healthy 2023-12-05T09:33:38.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:37 smithi067 ceph-mon[210894]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/378 objects degraded (13.228%), 12 pgs degraded) 2023-12-05T09:33:38.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:37 smithi067 ceph-mon[210894]: Cluster is now healthy 2023-12-05T09:33:39.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:38 smithi134 ceph-mon[172895]: pgmap v117: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:39.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:38 smithi067 ceph-mon[210894]: pgmap v117: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:41.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:41 smithi067 ceph-mon[210894]: pgmap v118: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:41.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:41 smithi134 ceph-mon[172895]: pgmap v118: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:44.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:43 smithi067 ceph-mon[210894]: pgmap v119: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:44.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:43 smithi134 ceph-mon[172895]: pgmap v119: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:45 smithi067 ceph-mon[210894]: pgmap v120: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T09:33:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:46.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:45 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:33:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:45 smithi134 ceph-mon[172895]: pgmap v120: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:45 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T09:33:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:45 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:46.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:45 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:33:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:46 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T09:33:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:46 smithi067 ceph-mon[210894]: Upgrade: osd.4 is safe to restart 2023-12-05T09:33:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:33:47.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:33:47.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:46 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-05T09:33:47.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:46 smithi134 ceph-mon[172895]: Upgrade: osd.4 is safe to restart 2023-12-05T09:33:47.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:47.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:47.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-05T09:33:47.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:33:48.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:47 smithi067 ceph-mon[210894]: Upgrade: Updating osd.4 2023-12-05T09:33:48.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:47 smithi067 ceph-mon[210894]: Deploying daemon osd.4 on smithi134 2023-12-05T09:33:48.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:47 smithi067 ceph-mon[210894]: pgmap v121: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:48.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:47 smithi134 ceph-mon[172895]: Upgrade: Updating osd.4 2023-12-05T09:33:48.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:47 smithi134 ceph-mon[172895]: Deploying daemon osd.4 on smithi134 2023-12-05T09:33:48.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:47 smithi134 ceph-mon[172895]: pgmap v121: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:49.013 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:48 smithi134 ceph-mon[172895]: pgmap v122: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:49.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:48 smithi067 ceph-mon[210894]: pgmap v122: 65 pgs: 65 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:49.377 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:49 smithi134 systemd[1]: Stopping Ceph osd.4 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:33:49.870 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:49 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[130583]: 2023-12-05T09:33:49.486+0000 7fa57b35d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:33:49.870 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:49 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[130583]: 2023-12-05T09:33:49.486+0000 7fa57b35d700 -1 osd.4 71 *** Got signal Terminated *** 2023-12-05T09:33:49.870 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:49 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[130583]: 2023-12-05T09:33:49.486+0000 7fa57b35d700 -1 osd.4 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:33:50.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:49 smithi134 ceph-mon[172895]: osd.4 marked itself down and dead 2023-12-05T09:33:50.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:49 smithi067 ceph-mon[210894]: osd.4 marked itself down and dead 2023-12-05T09:33:50.871 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:50 smithi134 bash[191618]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4 2023-12-05T09:33:51.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:50 smithi134 ceph-mon[172895]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:33:51.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:50 smithi134 ceph-mon[172895]: failed to encode map e72 with expected crc 2023-12-05T09:33:51.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:50 smithi134 ceph-mon[172895]: failed to encode map e72 with expected crc 2023-12-05T09:33:51.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:50 smithi134 ceph-mon[172895]: osdmap e72: 6 total, 5 up, 6 in 2023-12-05T09:33:51.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:50 smithi134 ceph-mon[172895]: failed to encode map e72 with expected crc 2023-12-05T09:33:51.130 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:50 smithi134 ceph-mon[172895]: pgmap v124: 65 pgs: 6 stale+active+clean, 59 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:51.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:50 smithi067 ceph-mon[210894]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:33:51.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:50 smithi067 ceph-mon[210894]: failed to encode map e72 with expected crc 2023-12-05T09:33:51.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:50 smithi067 ceph-mon[210894]: failed to encode map e72 with expected crc 2023-12-05T09:33:51.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:50 smithi067 ceph-mon[210894]: osdmap e72: 6 total, 5 up, 6 in 2023-12-05T09:33:51.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:50 smithi067 ceph-mon[210894]: failed to encode map e72 with expected crc 2023-12-05T09:33:51.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:50 smithi067 ceph-mon[210894]: pgmap v124: 65 pgs: 6 stale+active+clean, 59 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:33:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:51 smithi134 ceph-mon[172895]: failed to encode map e73 with expected crc 2023-12-05T09:33:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:51 smithi134 ceph-mon[172895]: osdmap e73: 6 total, 5 up, 6 in 2023-12-05T09:33:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:51 smithi134 ceph-mon[172895]: failed to encode map e73 with expected crc 2023-12-05T09:33:52.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:51 smithi134 ceph-mon[172895]: failed to encode map e73 with expected crc 2023-12-05T09:33:52.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:51 smithi067 ceph-mon[210894]: failed to encode map e73 with expected crc 2023-12-05T09:33:52.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:51 smithi067 ceph-mon[210894]: osdmap e73: 6 total, 5 up, 6 in 2023-12-05T09:33:52.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:51 smithi067 ceph-mon[210894]: failed to encode map e73 with expected crc 2023-12-05T09:33:52.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:51 smithi067 ceph-mon[210894]: failed to encode map e73 with expected crc 2023-12-05T09:33:52.413 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:52 smithi134 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.4.service: Succeeded. 2023-12-05T09:33:52.413 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:52 smithi134 systemd[1]: Stopped Ceph osd.4 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:33:52.775 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:52 smithi134 systemd[1]: Starting Ceph osd.4 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:33:53.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:52 smithi134 ceph-mon[172895]: pgmap v126: 65 pgs: 2 active+undersized+degraded, 5 stale+active+clean, 3 active+undersized, 55 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6/378 objects degraded (1.587%) 2023-12-05T09:33:53.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:52 smithi067 ceph-mon[210894]: pgmap v126: 65 pgs: 2 active+undersized+degraded, 5 stale+active+clean, 3 active+undersized, 55 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6/378 objects degraded (1.587%) 2023-12-05T09:33:53.799 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:53 smithi134 bash[191888]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-05T09:33:53.799 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:53 smithi134 bash[191888]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-05T09:33:53.799 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:53 smithi134 bash[191888]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-05T09:33:53.800 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:53 smithi134 bash[191888]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-05T09:33:53.800 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:53 smithi134 bash[191888]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-05T09:33:53.800 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:53 smithi134 bash[191888]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-05T09:33:53.800 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:53 smithi134 bash[191888]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-05T09:33:54.309 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:53 smithi134 ceph-mon[172895]: Health check failed: Degraded data redundancy: 6/378 objects degraded (1.587%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:54.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:53 smithi067 ceph-mon[210894]: Health check failed: Degraded data redundancy: 6/378 objects degraded (1.587%), 2 pgs degraded (PG_DEGRADED) 2023-12-05T09:33:54.876 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:54 smithi134 bash[192137]: 1ea7395d56d9f68b512cdf3d13bf3800f64a7f18bdfe0dc610c484cdfe704698 2023-12-05T09:33:54.877 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:54 smithi134 ceph-osd[192175]: -- 172.21.15.134:0/3546848151 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558b5eccb1e0 con 0x558b5ec9ac00 2023-12-05T09:33:54.877 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:54 smithi134 systemd[1]: Started Ceph osd.4 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:33:55.376 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:33:54 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:33:54.931+0000 7fe04639c640 -1 Falling back to public interface 2023-12-05T09:33:55.859 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:55.860 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:55.860 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:55 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:33:55.860 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:55 smithi134 ceph-mon[172895]: pgmap v127: 65 pgs: 10 active+undersized+degraded, 2 stale+active+clean, 11 active+undersized, 42 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 35/378 objects degraded (9.259%) 2023-12-05T09:33:55.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:55.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:55.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:55 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:33:55.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:55 smithi067 ceph-mon[210894]: pgmap v127: 65 pgs: 10 active+undersized+degraded, 2 stale+active+clean, 11 active+undersized, 42 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 35/378 objects degraded (9.259%) 2023-12-05T09:33:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:57 smithi067 ceph-mon[210894]: pgmap v128: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 65/378 objects degraded (17.196%) 2023-12-05T09:33:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:57 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:58.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:57 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:58.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:57 smithi134 ceph-mon[172895]: pgmap v128: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 65/378 objects degraded (17.196%) 2023-12-05T09:33:58.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:57 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:58.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:57 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:59.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:59.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:59 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:59.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:33:59 smithi067 ceph-mon[210894]: pgmap v129: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 65/378 objects degraded (17.196%) 2023-12-05T09:33:59.758 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:59.759 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:59 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:33:59.759 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:33:59 smithi134 ceph-mon[172895]: pgmap v129: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 65/378 objects degraded (17.196%) 2023-12-05T09:34:00.376 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:34:00 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:34:00.060+0000 7fe04639c640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-05T09:34:00.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:00 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 65/378 objects degraded (17.196%), 16 pgs degraded (PG_DEGRADED) 2023-12-05T09:34:00.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:00 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 65/378 objects degraded (17.196%), 16 pgs degraded (PG_DEGRADED) 2023-12-05T09:34:00.877 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:34:00 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:34:00.686+0000 7fe04639c640 -1 osd.4 71 log_to_monitors true 2023-12-05T09:34:01.796 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:34:01 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:34:01.509+0000 7fe03680b700 -1 osd.4 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:34:01.796 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:01 smithi134 ceph-mon[172895]: from='osd.4 [v2:172.21.15.134:6808/3391162370,v1:172.21.15.134:6809/3391162370]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:34:01.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:01 smithi134 ceph-mon[172895]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:34:01.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:01 smithi134 ceph-mon[172895]: pgmap v130: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 65/378 objects degraded (17.196%) 2023-12-05T09:34:01.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:01.797 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:34:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:01 smithi067 ceph-mon[210894]: from='osd.4 [v2:172.21.15.134:6808/3391162370,v1:172.21.15.134:6809/3391162370]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:34:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:01 smithi067 ceph-mon[210894]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-05T09:34:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:01 smithi067 ceph-mon[210894]: pgmap v130: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 65/378 objects degraded (17.196%) 2023-12-05T09:34:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:01.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:34:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T09:34:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: failed to encode map e74 with expected crc 2023-12-05T09:34:02.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: osdmap e74: 6 total, 5 up, 6 in 2023-12-05T09:34:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='osd.4 [v2:172.21.15.134:6808/3391162370,v1:172.21.15.134:6809/3391162370]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:34:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:34:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:34:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:34:02.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:02.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:34:02.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:02.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:02.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:02.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:02 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T09:34:02.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-05T09:34:02.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: failed to encode map e74 with expected crc 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: osdmap e74: 6 total, 5 up, 6 in 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='osd.4 [v2:172.21.15.134:6808/3391162370,v1:172.21.15.134:6809/3391162370]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:02.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:02 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T09:34:03.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:03 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T09:34:03.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:03 smithi067 ceph-mon[210894]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-05T09:34:03.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:03 smithi067 ceph-mon[210894]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:34:03.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:03 smithi067 ceph-mon[210894]: failed to encode map e75 with expected crc 2023-12-05T09:34:03.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:03 smithi067 ceph-mon[210894]: osd.4 [v2:172.21.15.134:6808/3391162370,v1:172.21.15.134:6809/3391162370] boot 2023-12-05T09:34:03.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:03 smithi067 ceph-mon[210894]: osdmap e75: 6 total, 6 up, 6 in 2023-12-05T09:34:03.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:03 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:34:03.870 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:03 smithi067 ceph-mon[210894]: pgmap v133: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/378 objects degraded (17.196%) 2023-12-05T09:34:03.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:03 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T09:34:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:03 smithi134 ceph-mon[172895]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-05T09:34:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:03 smithi134 ceph-mon[172895]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:34:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:03 smithi134 ceph-mon[172895]: failed to encode map e75 with expected crc 2023-12-05T09:34:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:03 smithi134 ceph-mon[172895]: osd.4 [v2:172.21.15.134:6808/3391162370,v1:172.21.15.134:6809/3391162370] boot 2023-12-05T09:34:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:03 smithi134 ceph-mon[172895]: osdmap e75: 6 total, 6 up, 6 in 2023-12-05T09:34:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:03 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-05T09:34:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:03 smithi134 ceph-mon[172895]: pgmap v133: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 65/378 objects degraded (17.196%) 2023-12-05T09:34:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:04 smithi067 ceph-mon[210894]: failed to encode map e76 with expected crc 2023-12-05T09:34:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:04 smithi067 ceph-mon[210894]: osdmap e76: 6 total, 6 up, 6 in 2023-12-05T09:34:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:04 smithi067 ceph-mon[210894]: failed to encode map e76 with expected crc 2023-12-05T09:34:04.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:04 smithi067 ceph-mon[210894]: failed to encode map e76 with expected crc 2023-12-05T09:34:04.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:04 smithi134 ceph-mon[172895]: failed to encode map e76 with expected crc 2023-12-05T09:34:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:04 smithi134 ceph-mon[172895]: osdmap e76: 6 total, 6 up, 6 in 2023-12-05T09:34:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:04 smithi134 ceph-mon[172895]: failed to encode map e76 with expected crc 2023-12-05T09:34:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:04 smithi134 ceph-mon[172895]: failed to encode map e76 with expected crc 2023-12-05T09:34:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.212+0000 7fe87e1df700 1 -- 172.21.15.67:0/3901999401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 msgr2=0x7fe878102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.212+0000 7fe87e1df700 1 --2- 172.21.15.67:0/3901999401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 0x7fe878102fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe868004940 tx=0x7fe868009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.212+0000 7fe87e1df700 1 -- 172.21.15.67:0/3901999401 shutdown_connections 2023-12-05T09:34:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.212+0000 7fe87e1df700 1 --2- 172.21.15.67:0/3901999401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8781035a0 0x7fe8780fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.212+0000 7fe87e1df700 1 --2- 172.21.15.67:0/3901999401 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 0x7fe878102fd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.212+0000 7fe87e1df700 1 -- 172.21.15.67:0/3901999401 >> 172.21.15.67:0/3901999401 conn(0x7fe8780f8790 msgr2=0x7fe8780faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.212+0000 7fe87e1df700 1 -- 172.21.15.67:0/3901999401 shutdown_connections 2023-12-05T09:34:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.212+0000 7fe87e1df700 1 -- 172.21.15.67:0/3901999401 wait complete. 2023-12-05T09:34:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.213+0000 7fe87e1df700 1 Processor -- start 2023-12-05T09:34:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.213+0000 7fe87e1df700 1 -- start start 2023-12-05T09:34:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe87e1df700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 0x7fe878113640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe87e1df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8781035a0 0x7fe878113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe87e1df700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878114210 con 0x7fe878102c00 2023-12-05T09:34:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe87e1df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87810d500 con 0x7fe8781035a0 2023-12-05T09:34:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe8777fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 0x7fe878113640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe8777fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 0x7fe878113640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52502/0 (socket says 172.21.15.67:52502) 2023-12-05T09:34:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe8777fe700 1 -- 172.21.15.67:0/661842452 learned_addr learned my addr 172.21.15.67:0/661842452 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe8777fe700 1 -- 172.21.15.67:0/661842452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8781035a0 msgr2=0x7fe878113bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe8777fe700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8781035a0 0x7fe878113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.214+0000 7fe8777fe700 1 -- 172.21.15.67:0/661842452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868005040 con 0x7fe878102c00 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.215+0000 7fe8777fe700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 0x7fe878113640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe868008d80 tx=0x7fe868009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.215+0000 7fe85ffff700 1 -- 172.21.15.67:0/661842452 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86800e030 con 0x7fe878102c00 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.215+0000 7fe85ffff700 1 -- 172.21.15.67:0/661842452 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe868004290 con 0x7fe878102c00 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.215+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87810d730 con 0x7fe878102c00 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.215+0000 7fe85ffff700 1 -- 172.21.15.67:0/661842452 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe86801ce60 con 0x7fe878102c00 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.215+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87810dc70 con 0x7fe878102c00 2023-12-05T09:34:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.216+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8780fff10 con 0x7fe878102c00 2023-12-05T09:34:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.217+0000 7fe85ffff700 1 -- 172.21.15.67:0/661842452 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fe86801c690 con 0x7fe878102c00 2023-12-05T09:34:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.219+0000 7fe85ffff700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe86006ce00 0x7fe86006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.219+0000 7fe85ffff700 1 -- 172.21.15.67:0/661842452 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe86808dd50 con 0x7fe878102c00 2023-12-05T09:34:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.219+0000 7fe876ffd700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe86006ce00 0x7fe86006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:05.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.220+0000 7fe876ffd700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe86006ce00 0x7fe86006f2b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe87810eee0 tx=0x7fe86c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.224+0000 7fe85ffff700 1 -- 172.21.15.67:0/661842452 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe86805b6a0 con 0x7fe878102c00 2023-12-05T09:34:05.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.454+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe87804bbf0 con 0x7fe86006ce00 2023-12-05T09:34:05.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.455+0000 7fe85ffff700 1 -- 172.21.15.67:0/661842452 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe87804bbf0 con 0x7fe86006ce00 2023-12-05T09:34:05.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe86006ce00 msgr2=0x7fe86006f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe86006ce00 0x7fe86006f2b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe87810eee0 tx=0x7fe86c00b040 comp rx=0 tx=0).stop 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 msgr2=0x7fe878113640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 0x7fe878113640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe868008d80 tx=0x7fe868009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 shutdown_connections 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fe86006ce00 0x7fe86006f2b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe878102c00 0x7fe878113640 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 --2- 172.21.15.67:0/661842452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8781035a0 0x7fe878113bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 >> 172.21.15.67:0/661842452 conn(0x7fe8780f8790 msgr2=0x7fe8780fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 shutdown_connections 2023-12-05T09:34:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.458+0000 7fe87e1df700 1 -- 172.21.15.67:0/661842452 wait complete. 2023-12-05T09:34:05.471 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:34:05.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.601+0000 7ff870245700 1 -- 172.21.15.67:0/4128884129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 msgr2=0x7ff868102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.601+0000 7ff870245700 1 --2- 172.21.15.67:0/4128884129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 0x7ff868102ff0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff864004940 tx=0x7ff864009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:05.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.601+0000 7ff870245700 1 -- 172.21.15.67:0/4128884129 shutdown_connections 2023-12-05T09:34:05.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.601+0000 7ff870245700 1 --2- 172.21.15.67:0/4128884129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff868065390 0x7ff868065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.601+0000 7ff870245700 1 --2- 172.21.15.67:0/4128884129 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 0x7ff868102ff0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.601+0000 7ff870245700 1 -- 172.21.15.67:0/4128884129 >> 172.21.15.67:0/4128884129 conn(0x7ff8680719b0 msgr2=0x7ff868071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:05.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.601+0000 7ff870245700 1 -- 172.21.15.67:0/4128884129 shutdown_connections 2023-12-05T09:34:05.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.601+0000 7ff870245700 1 -- 172.21.15.67:0/4128884129 wait complete. 2023-12-05T09:34:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.602+0000 7ff870245700 1 Processor -- start 2023-12-05T09:34:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.602+0000 7ff870245700 1 -- start start 2023-12-05T09:34:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.602+0000 7ff870245700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff868065390 0x7ff868113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.602+0000 7ff870245700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 0x7ff868113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.602+0000 7ff870245700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff868114230 con 0x7ff868102c20 2023-12-05T09:34:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.602+0000 7ff870245700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86810d590 con 0x7ff868065390 2023-12-05T09:34:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff86d7e0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 0x7ff868113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:05.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff86d7e0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 0x7ff868113be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:52520/0 (socket says 172.21.15.67:52520) 2023-12-05T09:34:05.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff86d7e0700 1 -- 172.21.15.67:0/1093754194 learned_addr learned my addr 172.21.15.67:0/1093754194 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:05.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff86dfe1700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff868065390 0x7ff868113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:05.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff86d7e0700 1 -- 172.21.15.67:0/1093754194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff868065390 msgr2=0x7ff868113660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff86d7e0700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff868065390 0x7ff868113660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff86d7e0700 1 -- 172.21.15.67:0/1093754194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864005040 con 0x7ff868102c20 2023-12-05T09:34:05.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff86d7e0700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 0x7ff868113be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff858002a50 tx=0x7ff8580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:05.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff85e7fc700 1 -- 172.21.15.67:0/1093754194 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff858007cc0 con 0x7ff868102c20 2023-12-05T09:34:05.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86810d820 con 0x7ff868102c20 2023-12-05T09:34:05.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff85e7fc700 1 -- 172.21.15.67:0/1093754194 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff85800f040 con 0x7ff868102c20 2023-12-05T09:34:05.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.603+0000 7ff85e7fc700 1 -- 172.21.15.67:0/1093754194 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff85800d9c0 con 0x7ff868102c20 2023-12-05T09:34:05.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.604+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86810dd60 con 0x7ff868102c20 2023-12-05T09:34:05.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.605+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8680fff40 con 0x7ff868102c20 2023-12-05T09:34:05.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.606+0000 7ff85e7fc700 1 -- 172.21.15.67:0/1093754194 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff85800db20 con 0x7ff868102c20 2023-12-05T09:34:05.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.607+0000 7ff85e7fc700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff85406ce70 0x7ff85406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.607+0000 7ff85e7fc700 1 -- 172.21.15.67:0/1093754194 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff85808c0a0 con 0x7ff868102c20 2023-12-05T09:34:05.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.607+0000 7ff86dfe1700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff85406ce70 0x7ff85406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:05.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.608+0000 7ff86dfe1700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff85406ce70 0x7ff85406f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff86400b840 tx=0x7ff864009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:05.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.612+0000 7ff85e7fc700 1 -- 172.21.15.67:0/1093754194 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff858059970 con 0x7ff868102c20 2023-12-05T09:34:05.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.840+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff868109c40 con 0x7ff85406ce70 2023-12-05T09:34:05.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.841+0000 7ff85e7fc700 1 -- 172.21.15.67:0/1093754194 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff868109c40 con 0x7ff85406ce70 2023-12-05T09:34:05.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.843+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff85406ce70 msgr2=0x7ff85406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff85406ce70 0x7ff85406f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff86400b840 tx=0x7ff864009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:05.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 msgr2=0x7ff868113be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 0x7ff868113be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff858002a50 tx=0x7ff8580046b0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 shutdown_connections 2023-12-05T09:34:05.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff868065390 0x7ff868113660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff85406ce70 0x7ff85406f320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 --2- 172.21.15.67:0/1093754194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff868102c20 0x7ff868113be0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 >> 172.21.15.67:0/1093754194 conn(0x7ff8680719b0 msgr2=0x7ff8680fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:05.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 shutdown_connections 2023-12-05T09:34:05.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.844+0000 7ff870245700 1 -- 172.21.15.67:0/1093754194 wait complete. 2023-12-05T09:34:05.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:05 smithi067 ceph-mon[210894]: pgmap v135: 65 pgs: 7 peering, 9 active+undersized+degraded, 12 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/378 objects degraded (10.053%) 2023-12-05T09:34:05.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:05 smithi134 ceph-mon[172895]: pgmap v135: 65 pgs: 7 peering, 9 active+undersized+degraded, 12 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 38/378 objects degraded (10.053%) 2023-12-05T09:34:05.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.982+0000 7f8ae702e700 1 -- 172.21.15.67:0/1723017271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae01035a0 msgr2=0x7f8ae00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.982+0000 7f8ae702e700 1 --2- 172.21.15.67:0/1723017271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae01035a0 0x7f8ae00fcc10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8acc004940 tx=0x7f8acc009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:05.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.983+0000 7f8ae702e700 1 -- 172.21.15.67:0/1723017271 shutdown_connections 2023-12-05T09:34:05.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.983+0000 7f8ae702e700 1 --2- 172.21.15.67:0/1723017271 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae01035a0 0x7f8ae00fcc10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.983+0000 7f8ae702e700 1 --2- 172.21.15.67:0/1723017271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae0102c00 0x7f8ae0102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.983+0000 7f8ae702e700 1 -- 172.21.15.67:0/1723017271 >> 172.21.15.67:0/1723017271 conn(0x7f8ae00f8790 msgr2=0x7f8ae00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:05.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.983+0000 7f8ae702e700 1 -- 172.21.15.67:0/1723017271 shutdown_connections 2023-12-05T09:34:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.983+0000 7f8ae702e700 1 -- 172.21.15.67:0/1723017271 wait complete. 2023-12-05T09:34:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.983+0000 7f8ae702e700 1 Processor -- start 2023-12-05T09:34:05.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.984+0000 7f8ae702e700 1 -- start start 2023-12-05T09:34:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.984+0000 7f8ae702e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae0102c00 0x7f8ae006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.984+0000 7f8ae702e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae01035a0 0x7f8ae0070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.984+0000 7f8ae702e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0070a80 con 0x7f8ae0102c00 2023-12-05T09:34:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.984+0000 7f8ae702e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae0070bf0 con 0x7f8ae01035a0 2023-12-05T09:34:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.984+0000 7f8ae4dca700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae0102c00 0x7f8ae006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.984+0000 7f8ae4dca700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae0102c00 0x7f8ae006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37462/0 (socket says 172.21.15.67:37462) 2023-12-05T09:34:05.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.984+0000 7f8ae4dca700 1 -- 172.21.15.67:0/1338069947 learned_addr learned my addr 172.21.15.67:0/1338069947 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8ae4dca700 1 -- 172.21.15.67:0/1338069947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae01035a0 msgr2=0x7f8ae0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8ae4dca700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae01035a0 0x7f8ae0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8ae4dca700 1 -- 172.21.15.67:0/1338069947 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc005040 con 0x7f8ae0102c00 2023-12-05T09:34:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8ae4dca700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae0102c00 0x7f8ae006ff40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400eb40 tx=0x7f8ad400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8add7fa700 1 -- 172.21.15.67:0/1338069947 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad4007cc0 con 0x7f8ae0102c00 2023-12-05T09:34:05.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8add7fa700 1 -- 172.21.15.67:0/1338069947 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ad400f040 con 0x7f8ae0102c00 2023-12-05T09:34:05.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae0119810 con 0x7f8ae0102c00 2023-12-05T09:34:05.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8add7fa700 1 -- 172.21.15.67:0/1338069947 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad4009570 con 0x7f8ae0102c00 2023-12-05T09:34:05.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.985+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae0119c70 con 0x7f8ae0102c00 2023-12-05T09:34:05.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.986+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae00fc390 con 0x7f8ae0102c00 2023-12-05T09:34:05.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.988+0000 7f8add7fa700 1 -- 172.21.15.67:0/1338069947 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f8ad40096d0 con 0x7f8ae0102c00 2023-12-05T09:34:05.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.988+0000 7f8add7fa700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f8ad006ce70 0x7f8ad006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:05.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.989+0000 7f8add7fa700 1 -- 172.21.15.67:0/1338069947 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8ad408bff0 con 0x7f8ae0102c00 2023-12-05T09:34:05.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.989+0000 7f8adffff700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f8ad006ce70 0x7f8ad006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:05.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.989+0000 7f8adffff700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f8ad006ce70 0x7f8ad006f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00b0d0 tx=0x7f8acc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:05.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:05.993+0000 7f8add7fa700 1 -- 172.21.15.67:0/1338069947 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8ad4055f20 con 0x7f8ae0102c00 2023-12-05T09:34:06.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.214+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ae00fa950 con 0x7f8ad006ce70 2023-12-05T09:34:06.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.225+0000 7f8add7fa700 1 -- 172.21.15.67:0/1338069947 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8ae00fa950 con 0x7f8ad006ce70 2023-12-05T09:34:06.223 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:34:06.223 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (5m) 72s ago 15m 16.1M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:34:06.224 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (2m) 72s ago 15m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 e6de51f67edd 2023-12-05T09:34:06.224 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (2m) 9s ago 14m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 b78b9e680949 2023-12-05T09:34:06.224 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (4m) 72s ago 14m 79.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:34:06.224 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (10m) 72s ago 10m 6297M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:34:06.224 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (10m) 72s ago 10m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:34:06.224 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (10m) 9s ago 10m 16.0M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:34:06.224 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (10m) 9s ago 10m 16.6M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:34:06.224 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (7m) 72s ago 16m 519M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (6m) 9s ago 14m 453M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (3m) 72s ago 16m 68.0M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (3m) 9s ago 14m 57.7M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 c85edd1646d0 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (5m) 72s ago 15m 8346k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 9s ago 14m 8958k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (2m) 72s ago 13m 120M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 cc8a8add819d 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (110s) 72s ago 13m 123M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 5c8edfa1578a 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (77s) 72s ago 12m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 c43c33a4a005 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (43s) 9s ago 12m 132M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 ec57f7ef86f1 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (12s) 9s ago 12m 12.5M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 1ea7395d56d9 2023-12-05T09:34:06.225 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (11m) 9s ago 11m 903M 2642M 17.2.7-109-g1fd3ca3c e139fc5fd9fc 607dada76628 2023-12-05T09:34:06.226 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (5m) 72s ago 14m 53.1M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:34:06.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f8ad006ce70 msgr2=0x7f8ad006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:06.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f8ad006ce70 0x7f8ad006f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00b0d0 tx=0x7f8acc009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:06.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae0102c00 msgr2=0x7f8ae006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:06.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae0102c00 0x7f8ae006ff40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400eb40 tx=0x7f8ad400b040 comp rx=0 tx=0).stop 2023-12-05T09:34:06.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 shutdown_connections 2023-12-05T09:34:06.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f8ad006ce70 0x7f8ad006f320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8ae0102c00 0x7f8ae006ff40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 --2- 172.21.15.67:0/1338069947 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ae01035a0 0x7f8ae0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 >> 172.21.15.67:0/1338069947 conn(0x7f8ae00f8790 msgr2=0x7f8ae00fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:06.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 shutdown_connections 2023-12-05T09:34:06.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.227+0000 7f8ae702e700 1 -- 172.21.15.67:0/1338069947 wait complete. 2023-12-05T09:34:06.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.363+0000 7f7c43e44700 1 -- 172.21.15.67:0/4263022830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c1035a0 msgr2=0x7f7c3c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:06.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.363+0000 7f7c43e44700 1 --2- 172.21.15.67:0/4263022830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c1035a0 0x7f7c3c0fcc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c004940 tx=0x7f7c2c009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.363+0000 7f7c43e44700 1 -- 172.21.15.67:0/4263022830 shutdown_connections 2023-12-05T09:34:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.363+0000 7f7c43e44700 1 --2- 172.21.15.67:0/4263022830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c1035a0 0x7f7c3c0fcc10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.363+0000 7f7c43e44700 1 --2- 172.21.15.67:0/4263022830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c3c102c00 0x7f7c3c102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.363+0000 7f7c43e44700 1 -- 172.21.15.67:0/4263022830 >> 172.21.15.67:0/4263022830 conn(0x7f7c3c0f8790 msgr2=0x7f7c3c0faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.364+0000 7f7c43e44700 1 -- 172.21.15.67:0/4263022830 shutdown_connections 2023-12-05T09:34:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.364+0000 7f7c43e44700 1 -- 172.21.15.67:0/4263022830 wait complete. 2023-12-05T09:34:06.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.364+0000 7f7c43e44700 1 Processor -- start 2023-12-05T09:34:06.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c43e44700 1 -- start start 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c43e44700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c102c00 0x7f7c3c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c43e44700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c3c1035a0 0x7f7c3c0704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c43e44700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c070af0 con 0x7f7c3c102c00 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c43e44700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c070c60 con 0x7f7c3c1035a0 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c41be0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c102c00 0x7f7c3c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c41be0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c102c00 0x7f7c3c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37488/0 (socket says 172.21.15.67:37488) 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c41be0700 1 -- 172.21.15.67:0/3521511790 learned_addr learned my addr 172.21.15.67:0/3521511790 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.365+0000 7f7c413df700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c3c1035a0 0x7f7c3c0704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c41be0700 1 -- 172.21.15.67:0/3521511790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c3c1035a0 msgr2=0x7f7c3c0704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c41be0700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c3c1035a0 0x7f7c3c0704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c41be0700 1 -- 172.21.15.67:0/3521511790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c005040 con 0x7f7c3c102c00 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c413df700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c3c1035a0 0x7f7c3c0704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:34:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c41be0700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c102c00 0x7f7c3c06ff40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c38002a50 tx=0x7f7c380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:06.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c327fc700 1 -- 172.21.15.67:0/3521511790 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c38007cc0 con 0x7f7c3c102c00 2023-12-05T09:34:06.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c327fc700 1 -- 172.21.15.67:0/3521511790 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c3800f040 con 0x7f7c3c102c00 2023-12-05T09:34:06.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c327fc700 1 -- 172.21.15.67:0/3521511790 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c38009540 con 0x7f7c3c102c00 2023-12-05T09:34:06.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c119880 con 0x7f7c3c102c00 2023-12-05T09:34:06.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.366+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c119dc0 con 0x7f7c3c102c00 2023-12-05T09:34:06.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.367+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c1050d0 con 0x7f7c3c102c00 2023-12-05T09:34:06.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.368+0000 7f7c327fc700 1 -- 172.21.15.67:0/3521511790 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7c380096a0 con 0x7f7c3c102c00 2023-12-05T09:34:06.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.369+0000 7f7c327fc700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f7c2806ce70 0x7f7c2806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:06.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.369+0000 7f7c327fc700 1 -- 172.21.15.67:0/3521511790 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7c3808c080 con 0x7f7c3c102c00 2023-12-05T09:34:06.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.370+0000 7f7c413df700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f7c2806ce70 0x7f7c2806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:06.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.370+0000 7f7c413df700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f7c2806ce70 0x7f7c2806f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c071940 tx=0x7f7c2c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:06.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.374+0000 7f7c327fc700 1 -- 172.21.15.67:0/3521511790 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7c38055f40 con 0x7f7c3c102c00 2023-12-05T09:34:06.668 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.670+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7c3c04bbb0 con 0x7f7c3c102c00 2023-12-05T09:34:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.671+0000 7f7c327fc700 1 -- 172.21.15.67:0/3521511790 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f7c38059560 con 0x7f7c3c102c00 2023-12-05T09:34:06.669 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:34:06.669 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:34:06.669 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:34:06.669 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:34:06.669 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:34:06.669 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 1, 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 5 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 5, 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 9 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:34:06.670 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:34:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f7c2806ce70 msgr2=0x7f7c2806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f7c2806ce70 0x7f7c2806f320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c071940 tx=0x7f7c2c009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c102c00 msgr2=0x7f7c3c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c102c00 0x7f7c3c06ff40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c38002a50 tx=0x7f7c380046b0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 shutdown_connections 2023-12-05T09:34:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f7c2806ce70 0x7f7c2806f320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7c3c102c00 0x7f7c3c06ff40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 --2- 172.21.15.67:0/3521511790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c3c1035a0 0x7f7c3c0704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 >> 172.21.15.67:0/3521511790 conn(0x7f7c3c0f8790 msgr2=0x7f7c3c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 shutdown_connections 2023-12-05T09:34:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.673+0000 7f7c43e44700 1 -- 172.21.15.67:0/3521511790 wait complete. 2023-12-05T09:34:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.812+0000 7f9294bc0700 1 -- 172.21.15.67:0/4205112800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 msgr2=0x7f92900fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.812+0000 7f9294bc0700 1 --2- 172.21.15.67:0/4205112800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 0x7f92900fcc10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9284004940 tx=0x7f9284009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.812+0000 7f9294bc0700 1 -- 172.21.15.67:0/4205112800 shutdown_connections 2023-12-05T09:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.812+0000 7f9294bc0700 1 --2- 172.21.15.67:0/4205112800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 0x7f92900fcc10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.812+0000 7f9294bc0700 1 --2- 172.21.15.67:0/4205112800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9290102c00 0x7f9290102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.812+0000 7f9294bc0700 1 -- 172.21.15.67:0/4205112800 >> 172.21.15.67:0/4205112800 conn(0x7f92900f8790 msgr2=0x7f92900faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.812+0000 7f9294bc0700 1 -- 172.21.15.67:0/4205112800 shutdown_connections 2023-12-05T09:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.812+0000 7f9294bc0700 1 -- 172.21.15.67:0/4205112800 wait complete. 2023-12-05T09:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.813+0000 7f9294bc0700 1 Processor -- start 2023-12-05T09:34:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.813+0000 7f9294bc0700 1 -- start start 2023-12-05T09:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.814+0000 7f9294bc0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9290102c00 0x7f929006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.814+0000 7f9294bc0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 0x7f92900704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.814+0000 7f9294bc0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9290070af0 con 0x7f92901035a0 2023-12-05T09:34:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.814+0000 7f9294bc0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9290070c60 con 0x7f9290102c00 2023-12-05T09:34:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.814+0000 7f928dd9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 0x7f92900704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.814+0000 7f928dd9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 0x7f92900704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37512/0 (socket says 172.21.15.67:37512) 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.814+0000 7f928dd9b700 1 -- 172.21.15.67:0/2381460394 learned_addr learned my addr 172.21.15.67:0/2381460394 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f928e59c700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9290102c00 0x7f929006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f928dd9b700 1 -- 172.21.15.67:0/2381460394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9290102c00 msgr2=0x7f929006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f928dd9b700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9290102c00 0x7f929006ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f928dd9b700 1 -- 172.21.15.67:0/2381460394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284005040 con 0x7f92901035a0 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f928e59c700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9290102c00 0x7f929006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f928dd9b700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 0x7f92900704a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9284009180 tx=0x7f9284009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f927effd700 1 -- 172.21.15.67:0/2381460394 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928400e040 con 0x7f92901035a0 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f927effd700 1 -- 172.21.15.67:0/2381460394 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9284004290 con 0x7f92901035a0 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9290119880 con 0x7f92901035a0 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f927effd700 1 -- 172.21.15.67:0/2381460394 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928401c3f0 con 0x7f92901035a0 2023-12-05T09:34:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.815+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9290119d60 con 0x7f92901035a0 2023-12-05T09:34:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.816+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92901050d0 con 0x7f92901035a0 2023-12-05T09:34:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.818+0000 7f927effd700 1 -- 172.21.15.67:0/2381460394 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f928400bc50 con 0x7f92901035a0 2023-12-05T09:34:06.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.818+0000 7f927effd700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f927806ce70 0x7f927806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:06.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.819+0000 7f927effd700 1 -- 172.21.15.67:0/2381460394 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f928408d540 con 0x7f92901035a0 2023-12-05T09:34:06.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.819+0000 7f928e59c700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f927806ce70 0x7f927806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:06.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.819+0000 7f928e59c700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f927806ce70 0x7f927806f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9280007fd0 tx=0x7f9280009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:06.823+0000 7f927effd700 1 -- 172.21.15.67:0/2381460394 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9284057480 con 0x7f92901035a0 2023-12-05T09:34:06.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:06 smithi067 ceph-mon[210894]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:06.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:06 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 38/378 objects degraded (10.053%), 9 pgs degraded (PG_DEGRADED) 2023-12-05T09:34:06.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:06 smithi067 ceph-mon[210894]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:06.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:06 smithi134 ceph-mon[172895]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:06.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:06 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 38/378 objects degraded (10.053%), 9 pgs degraded (PG_DEGRADED) 2023-12-05T09:34:06.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:06 smithi134 ceph-mon[172895]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:07.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.078+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f92900fc390 con 0x7f92901035a0 2023-12-05T09:34:07.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.079+0000 7f927effd700 1 -- 172.21.15.67:0/2381460394 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1858 (secure 0 0 0) 0x7f928405aaa0 con 0x7f92901035a0 2023-12-05T09:34:07.077 INFO:teuthology.orchestra.run.smithi067.stdout:e20 2023-12-05T09:34:07.077 INFO:teuthology.orchestra.run.smithi067.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-05T09:34:07.077 INFO:teuthology.orchestra.run.smithi067.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:legacy client fscid: 1 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:Filesystem 'cephfs' (1) 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:fs_name cephfs 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 20 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-12-05T09:23:28.000471+0000 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:modified 2023-12-05T09:30:26.034169+0000 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:tableserver 0 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:root 0 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:session_timeout 60 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:session_autoclose 300 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:max_file_size 1099511627776 2023-12-05T09:34:07.078 INFO:teuthology.orchestra.run.smithi067.stdout:max_xattr_size 65536 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:required_client_features {} 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure 0 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:last_failure_osd_epoch 46 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:max_mds 2 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:in 0,1 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:up {0=14478,1=14494} 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:failed 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:damaged 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:stopped 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:data_pools [3] 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:metadata_pool 2 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:inline_data disabled 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:balancer 2023-12-05T09:34:07.079 INFO:teuthology.orchestra.run.smithi067.stdout:bal_rank_mask -1 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout:standby_count_wanted 1 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.kyspon{0:14478} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.67:6826/4061541911,v1:172.21.15.67:6827/4061541911] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi067.qaibsa{1:14494} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.67:6828/1160981491,v1:172.21.15.67:6829/1160981491] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout:Standby daemons: 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vmnpaq{-1:24331} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.134:6826/1595650402,v1:172.21.15.134:6827/1595650402] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:34:07.080 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.cephfs.smithi134.vvbmln{-1:24339} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/2708731143,v1:172.21.15.134:6825/2708731143] compat {c=[1],r=[1],i=[7ff]}] 2023-12-05T09:34:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f927806ce70 msgr2=0x7f927806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f927806ce70 0x7f927806f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9280007fd0 tx=0x7f9280009040 comp rx=0 tx=0).stop 2023-12-05T09:34:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 msgr2=0x7f92900704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 0x7f92900704a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9284009180 tx=0x7f9284009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 shutdown_connections 2023-12-05T09:34:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9290102c00 0x7f929006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f927806ce70 0x7f927806f320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 --2- 172.21.15.67:0/2381460394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f92901035a0 0x7f92900704a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.081+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 >> 172.21.15.67:0/2381460394 conn(0x7f92900f8790 msgr2=0x7f92900fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:07.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.082+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 shutdown_connections 2023-12-05T09:34:07.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.082+0000 7f9294bc0700 1 -- 172.21.15.67:0/2381460394 wait complete. 2023-12-05T09:34:07.082 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 20 2023-12-05T09:34:07.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.221+0000 7f147c0c2700 1 -- 172.21.15.67:0/842902494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f147406ffe0 msgr2=0x7f14740703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.221+0000 7f147c0c2700 1 --2- 172.21.15.67:0/842902494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f147406ffe0 0x7f14740703b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1470004970 tx=0x7f1470009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:07.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.221+0000 7f147c0c2700 1 -- 172.21.15.67:0/842902494 shutdown_connections 2023-12-05T09:34:07.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.221+0000 7f147c0c2700 1 --2- 172.21.15.67:0/842902494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14740708f0 0x7f1474108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.221+0000 7f147c0c2700 1 --2- 172.21.15.67:0/842902494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f147406ffe0 0x7f14740703b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.221+0000 7f147c0c2700 1 -- 172.21.15.67:0/842902494 >> 172.21.15.67:0/842902494 conn(0x7f14740f8790 msgr2=0x7f14740faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:07.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.221+0000 7f147c0c2700 1 -- 172.21.15.67:0/842902494 shutdown_connections 2023-12-05T09:34:07.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.221+0000 7f147c0c2700 1 -- 172.21.15.67:0/842902494 wait complete. 2023-12-05T09:34:07.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.222+0000 7f147c0c2700 1 Processor -- start 2023-12-05T09:34:07.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.222+0000 7f147c0c2700 1 -- start start 2023-12-05T09:34:07.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.222+0000 7f147c0c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f147406ffe0 0x7f14741157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:07.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.222+0000 7f147c0c2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14740708f0 0x7f1474115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:07.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.222+0000 7f147c0c2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1474116380 con 0x7f14740708f0 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.222+0000 7f147c0c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147410f6b0 con 0x7f147406ffe0 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.223+0000 7f147965d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14740708f0 0x7f1474115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.223+0000 7f147965d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14740708f0 0x7f1474115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37526/0 (socket says 172.21.15.67:37526) 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.223+0000 7f147965d700 1 -- 172.21.15.67:0/625027476 learned_addr learned my addr 172.21.15.67:0/625027476 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.223+0000 7f1479e5e700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f147406ffe0 0x7f14741157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.223+0000 7f147965d700 1 -- 172.21.15.67:0/625027476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f147406ffe0 msgr2=0x7f14741157f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.223+0000 7f147965d700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f147406ffe0 0x7f14741157f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.223+0000 7f147965d700 1 -- 172.21.15.67:0/625027476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470005040 con 0x7f14740708f0 2023-12-05T09:34:07.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.223+0000 7f147965d700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14740708f0 0x7f1474115d30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f146400eb40 tx=0x7f146400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:07.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.224+0000 7f146a7fc700 1 -- 172.21.15.67:0/625027476 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1464007cc0 con 0x7f14740708f0 2023-12-05T09:34:07.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.224+0000 7f146a7fc700 1 -- 172.21.15.67:0/625027476 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f146400f040 con 0x7f14740708f0 2023-12-05T09:34:07.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.224+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147410f930 con 0x7f14740708f0 2023-12-05T09:34:07.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.224+0000 7f146a7fc700 1 -- 172.21.15.67:0/625027476 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1464009570 con 0x7f14740708f0 2023-12-05T09:34:07.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.224+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147410fe70 con 0x7f14740708f0 2023-12-05T09:34:07.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.225+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14741065d0 con 0x7f14740708f0 2023-12-05T09:34:07.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.226+0000 7f146a7fc700 1 -- 172.21.15.67:0/625027476 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f14640096d0 con 0x7f14740708f0 2023-12-05T09:34:07.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.227+0000 7f146a7fc700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f146006ce70 0x7f146006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:07.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.227+0000 7f146a7fc700 1 -- 172.21.15.67:0/625027476 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f146408be80 con 0x7f14740708f0 2023-12-05T09:34:07.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.227+0000 7f1479e5e700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f146006ce70 0x7f146006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:07.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.228+0000 7f1479e5e700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f146006ce70 0x7f146006f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1470004e30 tx=0x7f1470009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:07.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.232+0000 7f146a7fc700 1 -- 172.21.15.67:0/625027476 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1464059920 con 0x7f14740708f0 2023-12-05T09:34:07.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.461+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f147410bdb0 con 0x7f146006ce70 2023-12-05T09:34:07.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.462+0000 7f146a7fc700 1 -- 172.21.15.67:0/625027476 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f147410bdb0 con 0x7f146006ce70 2023-12-05T09:34:07.460 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:34:07.460 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "mon" 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "11/21 daemons upgraded", 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Currently upgrading osd daemons", 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": false 2023-12-05T09:34:07.461 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:34:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.464+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f146006ce70 msgr2=0x7f146006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.464+0000 7f147c0c2700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f146006ce70 0x7f146006f320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1470004e30 tx=0x7f1470009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.464+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14740708f0 msgr2=0x7f1474115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.464+0000 7f147c0c2700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14740708f0 0x7f1474115d30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f146400eb40 tx=0x7f146400b040 comp rx=0 tx=0).stop 2023-12-05T09:34:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.465+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 shutdown_connections 2023-12-05T09:34:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.465+0000 7f147c0c2700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f147406ffe0 0x7f14741157f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.465+0000 7f147c0c2700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f146006ce70 0x7f146006f320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.465+0000 7f147c0c2700 1 --2- 172.21.15.67:0/625027476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f14740708f0 0x7f1474115d30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.465+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 >> 172.21.15.67:0/625027476 conn(0x7f14740f8790 msgr2=0x7f1474103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:07.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.465+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 shutdown_connections 2023-12-05T09:34:07.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.465+0000 7f147c0c2700 1 -- 172.21.15.67:0/625027476 wait complete. 2023-12-05T09:34:07.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.606+0000 7f707a687700 1 -- 172.21.15.67:0/3014565497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 msgr2=0x7f7074102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.606+0000 7f707a687700 1 --2- 172.21.15.67:0/3014565497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 0x7f7074102fd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7064004940 tx=0x7f7064009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:07.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.606+0000 7f707a687700 1 -- 172.21.15.67:0/3014565497 shutdown_connections 2023-12-05T09:34:07.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.606+0000 7f707a687700 1 --2- 172.21.15.67:0/3014565497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70741035a0 0x7f70740fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.606+0000 7f707a687700 1 --2- 172.21.15.67:0/3014565497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 0x7f7074102fd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.606+0000 7f707a687700 1 -- 172.21.15.67:0/3014565497 >> 172.21.15.67:0/3014565497 conn(0x7f70740f8790 msgr2=0x7f70740faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:07.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.606+0000 7f707a687700 1 -- 172.21.15.67:0/3014565497 shutdown_connections 2023-12-05T09:34:07.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.606+0000 7f707a687700 1 -- 172.21.15.67:0/3014565497 wait complete. 2023-12-05T09:34:07.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.607+0000 7f707a687700 1 Processor -- start 2023-12-05T09:34:07.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.607+0000 7f707a687700 1 -- start start 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f707a687700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 0x7f7074115830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f707a687700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70741035a0 0x7f7074115d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f707a687700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70741163c0 con 0x7f7074102c00 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f707a687700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707410f6f0 con 0x7f70741035a0 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f7073fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 0x7f7074115830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f7073fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 0x7f7074115830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:37538/0 (socket says 172.21.15.67:37538) 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f7073fff700 1 -- 172.21.15.67:0/3326517284 learned_addr learned my addr 172.21.15.67:0/3326517284 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f70737fe700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70741035a0 0x7f7074115d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f7073fff700 1 -- 172.21.15.67:0/3326517284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70741035a0 msgr2=0x7f7074115d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f7073fff700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70741035a0 0x7f7074115d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f7073fff700 1 -- 172.21.15.67:0/3326517284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064005040 con 0x7f7074102c00 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.608+0000 7f70737fe700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70741035a0 0x7f7074115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:34:07.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.609+0000 7f7073fff700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 0x7f7074115830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7064009fd0 tx=0x7f7064009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:07.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.609+0000 7f7070ff9700 1 -- 172.21.15.67:0/3326517284 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f706400e040 con 0x7f7074102c00 2023-12-05T09:34:07.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.609+0000 7f7070ff9700 1 -- 172.21.15.67:0/3326517284 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f706400bc50 con 0x7f7074102c00 2023-12-05T09:34:07.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.609+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707410f970 con 0x7f7074102c00 2023-12-05T09:34:07.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.609+0000 7f7070ff9700 1 -- 172.21.15.67:0/3326517284 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7064013ea0 con 0x7f7074102c00 2023-12-05T09:34:07.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.609+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707410feb0 con 0x7f7074102c00 2023-12-05T09:34:07.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.610+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70740fc390 con 0x7f7074102c00 2023-12-05T09:34:07.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.611+0000 7f7070ff9700 1 -- 172.21.15.67:0/3326517284 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f7064013420 con 0x7f7074102c00 2023-12-05T09:34:07.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.612+0000 7f7070ff9700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f705c06ce70 0x7f705c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:07.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.612+0000 7f7070ff9700 1 -- 172.21.15.67:0/3326517284 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f706408d810 con 0x7f7074102c00 2023-12-05T09:34:07.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.613+0000 7f70737fe700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f705c06ce70 0x7f705c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:07.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.613+0000 7f70737fe700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f705c06ce70 0x7f705c06f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7068009fd0 tx=0x7f7068009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:07.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.616+0000 7f7070ff9700 1 -- 172.21.15.67:0/3326517284 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f706405b160 con 0x7f7074102c00 2023-12-05T09:34:07.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:07 smithi067 ceph-mon[210894]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:07.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:07 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3521511790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:07.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:07 smithi067 ceph-mon[210894]: pgmap v136: 65 pgs: 7 peering, 58 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:07.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:07 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/2381460394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:34:07.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:07 smithi134 ceph-mon[172895]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:07.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:07 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3521511790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:07.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:07 smithi134 ceph-mon[172895]: pgmap v136: 65 pgs: 7 peering, 58 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:07.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:07 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/2381460394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-05T09:34:07.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.908+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7074110e10 con 0x7f7074102c00 2023-12-05T09:34:07.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.909+0000 7f7070ff9700 1 -- 172.21.15.67:0/3326517284 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f706405acf0 con 0x7f7074102c00 2023-12-05T09:34:07.907 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_OK 2023-12-05T09:34:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f705c06ce70 msgr2=0x7f705c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f705c06ce70 0x7f705c06f320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7068009fd0 tx=0x7f7068009f20 comp rx=0 tx=0).stop 2023-12-05T09:34:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 msgr2=0x7f7074115830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 0x7f7074115830 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7064009fd0 tx=0x7f7064009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:07.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 shutdown_connections 2023-12-05T09:34:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f705c06ce70 0x7f705c06f320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7074102c00 0x7f7074115830 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 --2- 172.21.15.67:0/3326517284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70741035a0 0x7f7074115d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 >> 172.21.15.67:0/3326517284 conn(0x7f70740f8790 msgr2=0x7f70740fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 shutdown_connections 2023-12-05T09:34:07.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:07.911+0000 7f707a687700 1 -- 172.21.15.67:0/3326517284 wait complete. 2023-12-05T09:34:08.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:08 smithi067 ceph-mon[210894]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:08.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:08 smithi067 ceph-mon[210894]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/378 objects degraded (10.053%), 9 pgs degraded) 2023-12-05T09:34:08.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:08 smithi067 ceph-mon[210894]: Cluster is now healthy 2023-12-05T09:34:08.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:08 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3326517284' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:34:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:08 smithi134 ceph-mon[172895]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:08 smithi134 ceph-mon[172895]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/378 objects degraded (10.053%), 9 pgs degraded) 2023-12-05T09:34:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:08 smithi134 ceph-mon[172895]: Cluster is now healthy 2023-12-05T09:34:08.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:08 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3326517284' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:34:09.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:09 smithi067 ceph-mon[210894]: pgmap v137: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:09.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:09 smithi134 ceph-mon[172895]: pgmap v137: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:11.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:11 smithi067 ceph-mon[210894]: pgmap v138: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:11.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:11 smithi134 ceph-mon[172895]: pgmap v138: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:14.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:13 smithi067 ceph-mon[210894]: pgmap v139: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:14.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:13 smithi134 ceph-mon[172895]: pgmap v139: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:16.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:15 smithi067 ceph-mon[210894]: pgmap v140: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:16.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:16.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:15 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:34:16.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:15 smithi134 ceph-mon[172895]: pgmap v140: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:16.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:16.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:15 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:34:17.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:17.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:16 smithi134 ceph-mon[172895]: pgmap v141: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:17.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:17.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:16 smithi067 ceph-mon[210894]: pgmap v141: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:18.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:17 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T09:34:18.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:17 smithi134 ceph-mon[172895]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T09:34:18.313 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:17 smithi134 ceph-mon[172895]: Upgrade: osd.5 is safe to restart 2023-12-05T09:34:18.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:17 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T09:34:18.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:17 smithi067 ceph-mon[210894]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-05T09:34:18.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:17 smithi067 ceph-mon[210894]: Upgrade: osd.5 is safe to restart 2023-12-05T09:34:19.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:19 smithi134 ceph-mon[172895]: Upgrade: Updating osd.5 2023-12-05T09:34:19.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:19 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:19.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:19 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:34:19.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:19 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:34:19.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:19 smithi134 ceph-mon[172895]: Deploying daemon osd.5 on smithi134 2023-12-05T09:34:19.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:19 smithi134 ceph-mon[172895]: pgmap v142: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:20.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:19 smithi067 ceph-mon[210894]: Upgrade: Updating osd.5 2023-12-05T09:34:20.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:19 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:20.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:19 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-05T09:34:20.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:19 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:34:20.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:19 smithi067 ceph-mon[210894]: Deploying daemon osd.5 on smithi134 2023-12-05T09:34:20.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:19 smithi067 ceph-mon[210894]: pgmap v142: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:21.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:21 smithi067 ceph-mon[210894]: pgmap v143: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:21.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:21 smithi134 ceph-mon[172895]: pgmap v143: 65 pgs: 65 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:21.627 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:21 smithi134 systemd[1]: Stopping Ceph osd.5 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:34:22.127 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:21 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[138430]: 2023-12-05T09:34:21.639+0000 7f2e2b903700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:34:22.127 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:21 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[138430]: 2023-12-05T09:34:21.639+0000 7f2e2b903700 -1 osd.5 76 *** Got signal Terminated *** 2023-12-05T09:34:22.127 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:21 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[138430]: 2023-12-05T09:34:21.639+0000 7f2e2b903700 -1 osd.5 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:34:22.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:22 smithi067 ceph-mon[210894]: osd.5 marked itself down and dead 2023-12-05T09:34:22.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:22 smithi134 ceph-mon[172895]: osd.5 marked itself down and dead 2023-12-05T09:34:23.333 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:23 smithi134 bash[198307]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5 2023-12-05T09:34:23.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:23 smithi067 ceph-mon[210894]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:34:23.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:23 smithi067 ceph-mon[210894]: osdmap e77: 6 total, 5 up, 6 in 2023-12-05T09:34:23.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:23 smithi067 ceph-mon[210894]: pgmap v145: 65 pgs: 13 stale+active+clean, 52 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:23.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:23 smithi134 ceph-mon[172895]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-05T09:34:23.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:23 smithi134 ceph-mon[172895]: osdmap e77: 6 total, 5 up, 6 in 2023-12-05T09:34:23.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:23 smithi134 ceph-mon[172895]: pgmap v145: 65 pgs: 13 stale+active+clean, 52 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:24.445 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:24 smithi134 ceph-mon[172895]: osdmap e78: 6 total, 5 up, 6 in 2023-12-05T09:34:24.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:24 smithi067 ceph-mon[210894]: osdmap e78: 6 total, 5 up, 6 in 2023-12-05T09:34:24.741 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:24 smithi134 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.5.service: Succeeded. 2023-12-05T09:34:24.741 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:24 smithi134 systemd[1]: Stopped Ceph osd.5 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:34:25.110 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:24 smithi134 systemd[1]: Starting Ceph osd.5 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:34:25.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:25 smithi134 ceph-mon[172895]: pgmap v147: 65 pgs: 3 peering, 10 stale+active+clean, 3 active+undersized, 49 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:25.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:25 smithi067 ceph-mon[210894]: pgmap v147: 65 pgs: 3 peering, 10 stale+active+clean, 3 active+undersized, 49 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:26.350 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:25 smithi134 bash[198572]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-05T09:34:26.350 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:25 smithi134 bash[198572]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-05T09:34:26.351 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:25 smithi134 bash[198572]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-05T09:34:26.351 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:25 smithi134 bash[198572]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-05T09:34:26.351 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:25 smithi134 bash[198572]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-05T09:34:26.351 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:25 smithi134 bash[198572]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-05T09:34:26.351 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:25 smithi134 bash[198572]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-05T09:34:26.611 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:26 smithi134 ceph-mon[172895]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T09:34:26.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:26 smithi067 ceph-mon[210894]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-12-05T09:34:27.126 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:26 smithi134 bash[198840]: 6eaea923d8df7ec2d46db7dbc18544cc6e71e06eac106981a0f31754dc7d4d6a 2023-12-05T09:34:27.126 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:26 smithi134 systemd[1]: Started Ceph osd.5 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:34:27.127 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:26 smithi134 ceph-osd[198878]: -- 172.21.15.134:0/1122873641 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d1ea8a71e0 con 0x55d1ea876c00 2023-12-05T09:34:27.626 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:27 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:34:27.216+0000 7fec70e04640 -1 Falling back to public interface 2023-12-05T09:34:28.117 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:27 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:28.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:27 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:28.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:27 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:34:28.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:27 smithi067 ceph-mon[210894]: pgmap v148: 65 pgs: 12 active+undersized+degraded, 3 peering, 13 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/378 objects degraded (13.492%) 2023-12-05T09:34:28.123 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:27 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:28.123 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:27 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:28.123 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:27 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:34:28.124 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:27 smithi134 ceph-mon[172895]: pgmap v148: 65 pgs: 12 active+undersized+degraded, 3 peering, 13 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 51/378 objects degraded (13.492%) 2023-12-05T09:34:29.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:28 smithi067 ceph-mon[210894]: Health check failed: Degraded data redundancy: 51/378 objects degraded (13.492%), 12 pgs degraded (PG_DEGRADED) 2023-12-05T09:34:29.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:28 smithi134 ceph-mon[172895]: Health check failed: Degraded data redundancy: 51/378 objects degraded (13.492%), 12 pgs degraded (PG_DEGRADED) 2023-12-05T09:34:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:29 smithi067 ceph-mon[210894]: pgmap v149: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:34:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:29 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:30.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:29 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:30.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:29 smithi134 ceph-mon[172895]: pgmap v149: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:34:30.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:29 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:30.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:29 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:30 smithi067 ceph-mon[210894]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T09:34:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:31.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:30 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:31.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:30 smithi134 ceph-mon[172895]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-12-05T09:34:31.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:31.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:30 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:31 smithi067 ceph-mon[210894]: pgmap v150: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:34:32.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:32.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:34:32.126 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:31 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:34:31.760+0000 7fec70e04640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-05T09:34:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:31 smithi134 ceph-mon[172895]: pgmap v150: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:34:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:31 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:32.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:31 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:34:32.626 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:32 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:34:32.245+0000 7fec70e04640 -1 osd.5 76 log_to_monitors true 2023-12-05T09:34:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:32 smithi067 ceph-mon[210894]: from='osd.5 [v2:172.21.15.134:6816/867837745,v1:172.21.15.134:6817/867837745]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:34:33.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:32 smithi067 ceph-mon[210894]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:34:33.126 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:34:32 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:34:32.856+0000 7fec60a72700 -1 osd.5 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-05T09:34:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:32 smithi134 ceph-mon[172895]: from='osd.5 [v2:172.21.15.134:6816/867837745,v1:172.21.15.134:6817/867837745]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:34:33.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:32 smithi134 ceph-mon[172895]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-05T09:34:33.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:33 smithi134 ceph-mon[172895]: pgmap v151: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:34:33.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:33 smithi134 ceph-mon[172895]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T09:34:33.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:33 smithi134 ceph-mon[172895]: from='osd.5 [v2:172.21.15.134:6816/867837745,v1:172.21.15.134:6817/867837745]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:34:33.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:33 smithi134 ceph-mon[172895]: osdmap e79: 6 total, 5 up, 6 in 2023-12-05T09:34:33.964 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:33 smithi134 ceph-mon[172895]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:34:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:33 smithi067 ceph-mon[210894]: pgmap v151: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 330 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:34:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:33 smithi067 ceph-mon[210894]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-05T09:34:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:33 smithi067 ceph-mon[210894]: from='osd.5 [v2:172.21.15.134:6816/867837745,v1:172.21.15.134:6817/867837745]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:34:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:33 smithi067 ceph-mon[210894]: osdmap e79: 6 total, 5 up, 6 in 2023-12-05T09:34:34.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:33 smithi067 ceph-mon[210894]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2023-12-05T09:34:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:34:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: osd.5 [v2:172.21.15.134:6816/867837745,v1:172.21.15.134:6817/867837745] boot 2023-12-05T09:34:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: osdmap e80: 6 total, 6 up, 6 in 2023-12-05T09:34:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:34:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-05T09:34:35.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:34:35.120 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:34 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-05T09:34:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: osd.5 [v2:172.21.15.134:6816/867837745,v1:172.21.15.134:6817/867837745] boot 2023-12-05T09:34:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: osdmap e80: 6 total, 6 up, 6 in 2023-12-05T09:34:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-05T09:34:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-05T09:34:35.128 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:34:35.129 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:34 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:35.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:35 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067[210871]: 2023-12-05T09:34:35.341+0000 7fefde808700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T09:34:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:35 smithi067 ceph-mon[210894]: Upgrade: Setting container_image for all osd 2023-12-05T09:34:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:35 smithi067 ceph-mon[210894]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-05T09:34:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:35 smithi067 ceph-mon[210894]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T09:34:36.119 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:35 smithi067 ceph-mon[210894]: pgmap v154: 65 pgs: 1 peering, 14 active+undersized+degraded, 13 active+undersized, 37 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:34:36.125 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:35 smithi067 ceph-mon[210894]: osdmap e81: 6 total, 6 up, 6 in 2023-12-05T09:34:36.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:35 smithi067 ceph-mon[210894]: Health check update: Degraded data redundancy: 58/378 objects degraded (15.344%), 14 pgs degraded (PG_DEGRADED) 2023-12-05T09:34:36.126 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:35 smithi067 ceph-mon[210894]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T09:34:36.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:35 smithi134 ceph-mon[172895]: Upgrade: Setting container_image for all osd 2023-12-05T09:34:36.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:35 smithi134 ceph-mon[172895]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-05T09:34:36.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:35 smithi134 ceph-mon[172895]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T09:34:36.126 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:35 smithi134 ceph-mon[172895]: pgmap v154: 65 pgs: 1 peering, 14 active+undersized+degraded, 13 active+undersized, 37 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/378 objects degraded (15.344%) 2023-12-05T09:34:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:35 smithi134 ceph-mon[172895]: osdmap e81: 6 total, 6 up, 6 in 2023-12-05T09:34:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:35 smithi134 ceph-mon[172895]: Health check update: Degraded data redundancy: 58/378 objects degraded (15.344%), 14 pgs degraded (PG_DEGRADED) 2023-12-05T09:34:36.127 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:35 smithi134 ceph-mon[172895]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-05T09:34:37.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:36 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:37.368 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:36 smithi067 ceph-mon[210894]: pgmap v156: 65 pgs: 5 activating, 1 peering, 8 active+undersized+degraded, 10 active+undersized, 41 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 26/378 objects degraded (6.878%) 2023-12-05T09:34:37.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:36 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:37.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:36 smithi134 ceph-mon[172895]: pgmap v156: 65 pgs: 5 activating, 1 peering, 8 active+undersized+degraded, 10 active+undersized, 41 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 26/378 objects degraded (6.878%) 2023-12-05T09:34:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.067+0000 7f868826d700 1 -- 172.21.15.67:0/1416992327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 msgr2=0x7f8680102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.067+0000 7f868826d700 1 --2- 172.21.15.67:0/1416992327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 0x7f8680102fd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f867c004940 tx=0x7f867c009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.067+0000 7f868826d700 1 -- 172.21.15.67:0/1416992327 shutdown_connections 2023-12-05T09:34:38.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.067+0000 7f868826d700 1 --2- 172.21.15.67:0/1416992327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801035a0 0x7f86800fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.067+0000 7f868826d700 1 --2- 172.21.15.67:0/1416992327 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 0x7f8680102fd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.067+0000 7f868826d700 1 -- 172.21.15.67:0/1416992327 >> 172.21.15.67:0/1416992327 conn(0x7f86800f8790 msgr2=0x7f86800faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.067+0000 7f868826d700 1 -- 172.21.15.67:0/1416992327 shutdown_connections 2023-12-05T09:34:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.067+0000 7f868826d700 1 -- 172.21.15.67:0/1416992327 wait complete. 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.068+0000 7f868826d700 1 Processor -- start 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.068+0000 7f868826d700 1 -- start start 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.068+0000 7f868826d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 0x7f8680115850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.068+0000 7f868826d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801035a0 0x7f8680115d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.068+0000 7f868826d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8680116470 con 0x7f8680102c00 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.068+0000 7f868826d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868010f710 con 0x7f86801035a0 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.068+0000 7f8686009700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 0x7f8680115850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.069+0000 7f8686009700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 0x7f8680115850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55526/0 (socket says 172.21.15.67:55526) 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.069+0000 7f8686009700 1 -- 172.21.15.67:0/1028787137 learned_addr learned my addr 172.21.15.67:0/1028787137 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.069+0000 7f8685808700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801035a0 0x7f8680115d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.069+0000 7f8686009700 1 -- 172.21.15.67:0/1028787137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801035a0 msgr2=0x7f8680115d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.069+0000 7f8686009700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801035a0 0x7f8680115d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.069+0000 7f8686009700 1 -- 172.21.15.67:0/1028787137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c005040 con 0x7f8680102c00 2023-12-05T09:34:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.069+0000 7f8686009700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 0x7f8680115850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f867c009360 tx=0x7f867c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.069+0000 7f8676ffd700 1 -- 172.21.15.67:0/1028787137 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867c00e040 con 0x7f8680102c00 2023-12-05T09:34:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.070+0000 7f8676ffd700 1 -- 172.21.15.67:0/1028787137 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f867c013420 con 0x7f8680102c00 2023-12-05T09:34:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.070+0000 7f8676ffd700 1 -- 172.21.15.67:0/1028787137 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867c01c610 con 0x7f8680102c00 2023-12-05T09:34:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.070+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868010f990 con 0x7f8680102c00 2023-12-05T09:34:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.070+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868010fed0 con 0x7f8680102c00 2023-12-05T09:34:38.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.071+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86800fc390 con 0x7f8680102c00 2023-12-05T09:34:38.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.072+0000 7f8676ffd700 1 -- 172.21.15.67:0/1028787137 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f867c013590 con 0x7f8680102c00 2023-12-05T09:34:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.074+0000 7f8676ffd700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f866c06ce70 0x7f866c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.074+0000 7f8676ffd700 1 -- 172.21.15.67:0/1028787137 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f867c08d580 con 0x7f8680102c00 2023-12-05T09:34:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.074+0000 7f8685808700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f866c06ce70 0x7f866c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.074+0000 7f8685808700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f866c06ce70 0x7f866c06f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8680111080 tx=0x7f86700091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:38.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.079+0000 7f8676ffd700 1 -- 172.21.15.67:0/1028787137 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f867c05afa0 con 0x7f8680102c00 2023-12-05T09:34:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.309+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8680110ea0 con 0x7f866c06ce70 2023-12-05T09:34:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.310+0000 7f8676ffd700 1 -- 172.21.15.67:0/1028787137 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f8680110ea0 con 0x7f866c06ce70 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.312+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f866c06ce70 msgr2=0x7f866c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.312+0000 7f868826d700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f866c06ce70 0x7f866c06f320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8680111080 tx=0x7f86700091a0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.312+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 msgr2=0x7f8680115850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.312+0000 7f868826d700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 0x7f8680115850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f867c009360 tx=0x7f867c009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.313+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 shutdown_connections 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.313+0000 7f868826d700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f866c06ce70 0x7f866c06f320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.313+0000 7f868826d700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8680102c00 0x7f8680115850 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.313+0000 7f868826d700 1 --2- 172.21.15.67:0/1028787137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86801035a0 0x7f8680115d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.313+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 >> 172.21.15.67:0/1028787137 conn(0x7f86800f8790 msgr2=0x7f86800fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.313+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 shutdown_connections 2023-12-05T09:34:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.313+0000 7f868826d700 1 -- 172.21.15.67:0/1028787137 wait complete. 2023-12-05T09:34:38.325 INFO:teuthology.orchestra.run.smithi067.stdout:true 2023-12-05T09:34:38.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.454+0000 7f40fb96e700 1 -- 172.21.15.67:0/4272155687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 msgr2=0x7f40f4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:38.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.454+0000 7f40fb96e700 1 --2- 172.21.15.67:0/4272155687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 0x7f40f4102fd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40f0004940 tx=0x7f40f0009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.454+0000 7f40fb96e700 1 -- 172.21.15.67:0/4272155687 shutdown_connections 2023-12-05T09:34:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.454+0000 7f40fb96e700 1 --2- 172.21.15.67:0/4272155687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40f41035a0 0x7f40f40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.454+0000 7f40fb96e700 1 --2- 172.21.15.67:0/4272155687 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 0x7f40f4102fd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.454+0000 7f40fb96e700 1 -- 172.21.15.67:0/4272155687 >> 172.21.15.67:0/4272155687 conn(0x7f40f40f8790 msgr2=0x7f40f40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.454+0000 7f40fb96e700 1 -- 172.21.15.67:0/4272155687 shutdown_connections 2023-12-05T09:34:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.454+0000 7f40fb96e700 1 -- 172.21.15.67:0/4272155687 wait complete. 2023-12-05T09:34:38.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.455+0000 7f40fb96e700 1 Processor -- start 2023-12-05T09:34:38.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.455+0000 7f40fb96e700 1 -- start start 2023-12-05T09:34:38.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.455+0000 7f40fb96e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 0x7f40f406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:38.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.455+0000 7f40fb96e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40f41035a0 0x7f40f4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:38.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.455+0000 7f40fb96e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f4070a80 con 0x7f40f4102c00 2023-12-05T09:34:38.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.455+0000 7f40fb96e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f4070bf0 con 0x7f40f41035a0 2023-12-05T09:34:38.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f970a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 0x7f40f406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:38.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f970a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 0x7f40f406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55546/0 (socket says 172.21.15.67:55546) 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f970a700 1 -- 172.21.15.67:0/2691427027 learned_addr learned my addr 172.21.15.67:0/2691427027 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f8f09700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40f41035a0 0x7f40f4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f970a700 1 -- 172.21.15.67:0/2691427027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40f41035a0 msgr2=0x7f40f4070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f970a700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40f41035a0 0x7f40f4070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f970a700 1 -- 172.21.15.67:0/2691427027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0005040 con 0x7f40f4102c00 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f8f09700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40f41035a0 0x7f40f4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.456+0000 7f40f970a700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 0x7f40f406ff40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f40f0000c00 tx=0x7f40f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.457+0000 7f40e9ffb700 1 -- 172.21.15.67:0/2691427027 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f0021070 con 0x7f40f4102c00 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.457+0000 7f40e9ffb700 1 -- 172.21.15.67:0/2691427027 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f40f001c400 con 0x7f40f4102c00 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.457+0000 7f40e9ffb700 1 -- 172.21.15.67:0/2691427027 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f000e070 con 0x7f40f4102c00 2023-12-05T09:34:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.457+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f4119880 con 0x7f40f4102c00 2023-12-05T09:34:38.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.457+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f4119c30 con 0x7f40f4102c00 2023-12-05T09:34:38.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.458+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f40fff10 con 0x7f40f4102c00 2023-12-05T09:34:38.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.460+0000 7f40e9ffb700 1 -- 172.21.15.67:0/2691427027 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f40f001c9e0 con 0x7f40f4102c00 2023-12-05T09:34:38.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.461+0000 7f40e9ffb700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f40e006ce60 0x7f40e006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:38.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.461+0000 7f40e9ffb700 1 -- 172.21.15.67:0/2691427027 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f40f008d490 con 0x7f40f4102c00 2023-12-05T09:34:38.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.461+0000 7f40f8f09700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f40e006ce60 0x7f40e006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:38.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.462+0000 7f40f8f09700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f40e006ce60 0x7f40e006f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40e4004600 tx=0x7f40e400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:38.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.465+0000 7f40e9ffb700 1 -- 172.21.15.67:0/2691427027 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f40f00573d0 con 0x7f40f4102c00 2023-12-05T09:34:38.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.697+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40f40fc360 con 0x7f40e006ce60 2023-12-05T09:34:38.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.698+0000 7f40e9ffb700 1 -- 172.21.15.67:0/2691427027 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f40f40fc360 con 0x7f40e006ce60 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.700+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f40e006ce60 msgr2=0x7f40e006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.700+0000 7f40fb96e700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f40e006ce60 0x7f40e006f310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40e4004600 tx=0x7f40e400b040 comp rx=0 tx=0).stop 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.700+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 msgr2=0x7f40f406ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.700+0000 7f40fb96e700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 0x7f40f406ff40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f40f0000c00 tx=0x7f40f0009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.701+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 shutdown_connections 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.701+0000 7f40fb96e700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f40e006ce60 0x7f40e006f310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.701+0000 7f40fb96e700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f40f4102c00 0x7f40f406ff40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.701+0000 7f40fb96e700 1 --2- 172.21.15.67:0/2691427027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40f41035a0 0x7f40f4070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.701+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 >> 172.21.15.67:0/2691427027 conn(0x7f40f40f8790 msgr2=0x7f40f40fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:38.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.701+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 shutdown_connections 2023-12-05T09:34:38.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:38.701+0000 7f40fb96e700 1 -- 172.21.15.67:0/2691427027 wait complete. 2023-12-05T09:34:38.713 INFO:teuthology.orchestra.run.smithi067.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-05T09:34:38.722 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:38 smithi067 ceph-mon[210894]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/378 objects degraded (6.878%), 8 pgs degraded) 2023-12-05T09:34:38.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:38 smithi134 ceph-mon[172895]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/378 objects degraded (6.878%), 8 pgs degraded) 2023-12-05T09:34:39.222 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch ps' 2023-12-05T09:34:39.701 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:34:39.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:39 smithi067 ceph-mon[210894]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:39.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:39 smithi067 ceph-mon[210894]: pgmap v157: 65 pgs: 5 activating, 1 peering, 59 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:39.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:39 smithi067 ceph-mon[210894]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:39.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:39 smithi134 ceph-mon[172895]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:39.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:39 smithi134 ceph-mon[172895]: pgmap v157: 65 pgs: 5 activating, 1 peering, 59 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:39.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:39 smithi134 ceph-mon[172895]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.876+0000 7ff5b892c700 1 -- 172.21.15.67:0/1519864879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b41035a0 msgr2=0x7ff5b40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.876+0000 7ff5b892c700 1 --2- 172.21.15.67:0/1519864879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b41035a0 0x7ff5b40fcc10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8004940 tx=0x7ff5a8009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.876+0000 7ff5b892c700 1 -- 172.21.15.67:0/1519864879 shutdown_connections 2023-12-05T09:34:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.876+0000 7ff5b892c700 1 --2- 172.21.15.67:0/1519864879 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b41035a0 0x7ff5b40fcc10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.876+0000 7ff5b892c700 1 --2- 172.21.15.67:0/1519864879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b4102c00 0x7ff5b4102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.876+0000 7ff5b892c700 1 -- 172.21.15.67:0/1519864879 >> 172.21.15.67:0/1519864879 conn(0x7ff5b40f8790 msgr2=0x7ff5b40faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.876+0000 7ff5b892c700 1 -- 172.21.15.67:0/1519864879 shutdown_connections 2023-12-05T09:34:40.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.876+0000 7ff5b892c700 1 -- 172.21.15.67:0/1519864879 wait complete. 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.877+0000 7ff5b892c700 1 Processor -- start 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b892c700 1 -- start start 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b892c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b4102c00 0x7ff5b410b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b892c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b41035a0 0x7ff5b410b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b892c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b410e610 con 0x7ff5b4102c00 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b892c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b410bde0 con 0x7ff5b41035a0 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b4102c00 0x7ff5b410b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b4102c00 0x7ff5b410b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55566/0 (socket says 172.21.15.67:55566) 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b259c700 1 -- 172.21.15.67:0/24128451 learned_addr learned my addr 172.21.15.67:0/24128451 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:40.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.878+0000 7ff5b1d9b700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b41035a0 0x7ff5b410b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:40.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5b259c700 1 -- 172.21.15.67:0/24128451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b41035a0 msgr2=0x7ff5b410b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:40.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5b259c700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b41035a0 0x7ff5b410b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:40.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5b259c700 1 -- 172.21.15.67:0/24128451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8005040 con 0x7ff5b4102c00 2023-12-05T09:34:40.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5b259c700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b4102c00 0x7ff5b410b360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4002a50 tx=0x7ff5a40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:40.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5a2ffd700 1 -- 172.21.15.67:0/24128451 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a4007cc0 con 0x7ff5b4102c00 2023-12-05T09:34:40.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b410c0c0 con 0x7ff5b4102c00 2023-12-05T09:34:40.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5a2ffd700 1 -- 172.21.15.67:0/24128451 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff5a400f040 con 0x7ff5b4102c00 2023-12-05T09:34:40.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5a2ffd700 1 -- 172.21.15.67:0/24128451 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5a400d9c0 con 0x7ff5b4102c00 2023-12-05T09:34:40.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.879+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b411e200 con 0x7ff5b4102c00 2023-12-05T09:34:40.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.881+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b40fc390 con 0x7ff5b4102c00 2023-12-05T09:34:40.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.881+0000 7ff5a2ffd700 1 -- 172.21.15.67:0/24128451 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7ff5a400db60 con 0x7ff5b4102c00 2023-12-05T09:34:40.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.882+0000 7ff5a2ffd700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff59c06ce70 0x7ff59c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:40.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.882+0000 7ff5a2ffd700 1 -- 172.21.15.67:0/24128451 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff5a408b920 con 0x7ff5b4102c00 2023-12-05T09:34:40.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.883+0000 7ff5b1d9b700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff59c06ce70 0x7ff59c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:40.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.883+0000 7ff5b1d9b700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff59c06ce70 0x7ff59c06f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5b410cea0 tx=0x7ff5a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:40.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:40.887+0000 7ff5a2ffd700 1 -- 172.21.15.67:0/24128451 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff5a4055800 con 0x7ff5b4102c00 2023-12-05T09:34:41.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.107+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5b40fa940 con 0x7ff59c06ce70 2023-12-05T09:34:41.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.118+0000 7ff5a2ffd700 1 -- 172.21.15.67:0/24128451 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff5b40fa940 con 0x7ff59c06ce70 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (5m) 107s ago 15m 16.1M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (3m) 107s ago 16m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 e6de51f67edd 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (3m) 11s ago 15m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 b78b9e680949 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (5m) 107s ago 15m 79.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (11m) 107s ago 11m 6297M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (11m) 107s ago 11m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (11m) 11s ago 11m 16.1M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (11m) 11s ago 11m 16.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (7m) 107s ago 17m 519M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (6m) 11s ago 14m 453M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (4m) 107s ago 17m 68.0M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (3m) 11s ago 14m 54.8M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 c85edd1646d0 2023-12-05T09:34:41.117 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (6m) 107s ago 15m 8346k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:34:41.118 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 11s ago 14m 8368k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:34:41.118 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (2m) 107s ago 14m 120M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 cc8a8add819d 2023-12-05T09:34:41.118 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (2m) 107s ago 13m 123M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 5c8edfa1578a 2023-12-05T09:34:41.118 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (112s) 107s ago 13m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 c43c33a4a005 2023-12-05T09:34:41.118 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (78s) 11s ago 13m 141M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 ec57f7ef86f1 2023-12-05T09:34:41.118 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (46s) 11s ago 12m 125M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 1ea7395d56d9 2023-12-05T09:34:41.118 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (14s) 11s ago 12m 12.0M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 6eaea923d8df 2023-12-05T09:34:41.118 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (6m) 107s ago 15m 53.1M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff59c06ce70 msgr2=0x7ff59c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff59c06ce70 0x7ff59c06f320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5b410cea0 tx=0x7ff5a8009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b4102c00 msgr2=0x7ff5b410b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b4102c00 0x7ff5b410b360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4002a50 tx=0x7ff5a40046b0 comp rx=0 tx=0).stop 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 shutdown_connections 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7ff59c06ce70 0x7ff59c06f320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5b4102c00 0x7ff5b410b360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 --2- 172.21.15.67:0/24128451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b41035a0 0x7ff5b410b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.120+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 >> 172.21.15.67:0/24128451 conn(0x7ff5b40f8790 msgr2=0x7ff5b40fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:41.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.121+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 shutdown_connections 2023-12-05T09:34:41.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:41.121+0000 7ff5b892c700 1 -- 172.21.15.67:0/24128451 wait complete. 2023-12-05T09:34:41.479 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:41 smithi067 ceph-mon[210894]: pgmap v158: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:41.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch upgrade status' 2023-12-05T09:34:41.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:41 smithi134 ceph-mon[172895]: pgmap v158: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:41.940 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:34:42.367 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:42 smithi067 ceph-mon[210894]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:42.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:42 smithi134 ceph-mon[172895]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:43.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.107+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/922932929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 msgr2=0x7f6f880fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.107+0000 7f6f8e2bc700 1 --2- 172.21.15.67:0/922932929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f880fcc10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c004940 tx=0x7f6f7c009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.107+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/922932929 shutdown_connections 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.107+0000 7f6f8e2bc700 1 --2- 172.21.15.67:0/922932929 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f880fcc10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.107+0000 7f6f8e2bc700 1 --2- 172.21.15.67:0/922932929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f88102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.107+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/922932929 >> 172.21.15.67:0/922932929 conn(0x7f6f880f8790 msgr2=0x7f6f880faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.107+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/922932929 shutdown_connections 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.108+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/922932929 wait complete. 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.108+0000 7f6f8e2bc700 1 Processor -- start 2023-12-05T09:34:43.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.109+0000 7f6f8e2bc700 1 -- start start 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.109+0000 7f6f8e2bc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f881157b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.109+0000 7f6f8e2bc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.109+0000 7f6f8e2bc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88116340 con 0x7f6f881035a0 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.109+0000 7f6f8e2bc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8810f670 con 0x7f6f88102c00 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.109+0000 7f6f877fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.109+0000 7f6f877fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88115cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55586/0 (socket says 172.21.15.67:55586) 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.109+0000 7f6f877fe700 1 -- 172.21.15.67:0/1294881575 learned_addr learned my addr 172.21.15.67:0/1294881575 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f87fff700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f881157b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f877fe700 1 -- 172.21.15.67:0/1294881575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 msgr2=0x7f6f881157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f877fe700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f881157b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f877fe700 1 -- 172.21.15.67:0/1294881575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c005040 con 0x7f6f881035a0 2023-12-05T09:34:43.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f877fe700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88115cf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009360 tx=0x7f6f7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:43.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f84ff9700 1 -- 172.21.15.67:0/1294881575 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c00e040 con 0x7f6f881035a0 2023-12-05T09:34:43.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f84ff9700 1 -- 172.21.15.67:0/1294881575 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f7c00bc50 con 0x7f6f881035a0 2023-12-05T09:34:43.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8810f8f0 con 0x7f6f881035a0 2023-12-05T09:34:43.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f84ff9700 1 -- 172.21.15.67:0/1294881575 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7c01c630 con 0x7f6f881035a0 2023-12-05T09:34:43.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.110+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8810fe30 con 0x7f6f881035a0 2023-12-05T09:34:43.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.111+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f880fc390 con 0x7f6f881035a0 2023-12-05T09:34:43.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.113+0000 7f6f84ff9700 1 -- 172.21.15.67:0/1294881575 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f6f7c013420 con 0x7f6f881035a0 2023-12-05T09:34:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.114+0000 7f6f84ff9700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f6f7006ce70 0x7f6f7006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.114+0000 7f6f84ff9700 1 -- 172.21.15.67:0/1294881575 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6f7c08d780 con 0x7f6f881035a0 2023-12-05T09:34:43.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.114+0000 7f6f87fff700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f6f7006ce70 0x7f6f7006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:43.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.115+0000 7f6f87fff700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f6f7006ce70 0x7f6f7006f320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009fd0 tx=0x7f6f78009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.118+0000 7f6f84ff9700 1 -- 172.21.15.67:0/1294881575 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6f7c05b150 con 0x7f6f881035a0 2023-12-05T09:34:43.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.345+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f88115480 con 0x7f6f7006ce70 2023-12-05T09:34:43.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.346+0000 7f6f84ff9700 1 -- 172.21.15.67:0/1294881575 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f6f88115480 con 0x7f6f7006ce70 2023-12-05T09:34:43.345 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:34:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ff918c95653912ae4c171d8d1db5f5eabc756f85ff7e3ce78f13f9c521198459", 2023-12-05T09:34:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "in_progress": true, 2023-12-05T09:34:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-05T09:34:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "services_complete": [ 2023-12-05T09:34:43.345 INFO:teuthology.orchestra.run.smithi067.stdout: "crash", 2023-12-05T09:34:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr", 2023-12-05T09:34:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "osd", 2023-12-05T09:34:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "mon" 2023-12-05T09:34:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2023-12-05T09:34:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "progress": "12/21 daemons upgraded", 2023-12-05T09:34:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-05T09:34:43.346 INFO:teuthology.orchestra.run.smithi067.stdout: "is_paused": true 2023-12-05T09:34:43.346 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.348+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f6f7006ce70 msgr2=0x7f6f7006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.348+0000 7f6f8e2bc700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f6f7006ce70 0x7f6f7006f320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009fd0 tx=0x7f6f78009f60 comp rx=0 tx=0).stop 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.348+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 msgr2=0x7f6f88115cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.348+0000 7f6f8e2bc700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88115cf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009360 tx=0x7f6f7c009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.349+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 shutdown_connections 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.349+0000 7f6f8e2bc700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f88102c00 0x7f6f881157b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.349+0000 7f6f8e2bc700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f6f7006ce70 0x7f6f7006f320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.349+0000 7f6f8e2bc700 1 --2- 172.21.15.67:0/1294881575 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f881035a0 0x7f6f88115cf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.349+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 >> 172.21.15.67:0/1294881575 conn(0x7f6f880f8790 msgr2=0x7f6f880fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.349+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 shutdown_connections 2023-12-05T09:34:43.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:43.349+0000 7f6f8e2bc700 1 -- 172.21.15.67:0/1294881575 wait complete. 2023-12-05T09:34:43.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:43 smithi067 ceph-mon[210894]: pgmap v159: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:43.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:43 smithi134 ceph-mon[172895]: pgmap v159: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:43.722 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph health detail' 2023-12-05T09:34:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:34:44.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:44 smithi067 ceph-mon[210894]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:44.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:44 smithi134 ceph-mon[172895]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:34:45.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.457+0000 7effed4a6700 1 -- 172.21.15.67:0/1513083110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe8102c00 msgr2=0x7effe8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.457+0000 7effed4a6700 1 --2- 172.21.15.67:0/1513083110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe8102c00 0x7effe8102fd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7effd8004940 tx=0x7effd8009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.457+0000 7effed4a6700 1 -- 172.21.15.67:0/1513083110 shutdown_connections 2023-12-05T09:34:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.457+0000 7effed4a6700 1 --2- 172.21.15.67:0/1513083110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effe81035a0 0x7effe80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.457+0000 7effed4a6700 1 --2- 172.21.15.67:0/1513083110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe8102c00 0x7effe8102fd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.457+0000 7effed4a6700 1 -- 172.21.15.67:0/1513083110 >> 172.21.15.67:0/1513083110 conn(0x7effe80f8790 msgr2=0x7effe80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.457+0000 7effed4a6700 1 -- 172.21.15.67:0/1513083110 shutdown_connections 2023-12-05T09:34:45.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.457+0000 7effed4a6700 1 -- 172.21.15.67:0/1513083110 wait complete. 2023-12-05T09:34:45.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.458+0000 7effed4a6700 1 Processor -- start 2023-12-05T09:34:45.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.458+0000 7effed4a6700 1 -- start start 2023-12-05T09:34:45.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.458+0000 7effed4a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effe8102c00 0x7effe81157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:45.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.458+0000 7effed4a6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe81035a0 0x7effe8115d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:45.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.458+0000 7effed4a6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe8116350 con 0x7effe81035a0 2023-12-05T09:34:45.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.458+0000 7effed4a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe810f680 con 0x7effe8102c00 2023-12-05T09:34:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effdffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe81035a0 0x7effe8115d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effdffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe81035a0 0x7effe8115d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:55606/0 (socket says 172.21.15.67:55606) 2023-12-05T09:34:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effdffff700 1 -- 172.21.15.67:0/2755993937 learned_addr learned my addr 172.21.15.67:0/2755993937 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effe6ffd700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effe8102c00 0x7effe81157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effdffff700 1 -- 172.21.15.67:0/2755993937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effe8102c00 msgr2=0x7effe81157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effdffff700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effe8102c00 0x7effe81157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effdffff700 1 -- 172.21.15.67:0/2755993937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8005040 con 0x7effe81035a0 2023-12-05T09:34:45.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effe6ffd700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effe8102c00 0x7effe81157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:34:45.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.459+0000 7effdffff700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe81035a0 0x7effe8115d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7effd0002a50 tx=0x7effd00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:45.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.460+0000 7effdf7fe700 1 -- 172.21.15.67:0/2755993937 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd0007cc0 con 0x7effe81035a0 2023-12-05T09:34:45.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.460+0000 7effdf7fe700 1 -- 172.21.15.67:0/2755993937 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effd000f040 con 0x7effe81035a0 2023-12-05T09:34:45.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.460+0000 7effdf7fe700 1 -- 172.21.15.67:0/2755993937 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd00095d0 con 0x7effe81035a0 2023-12-05T09:34:45.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.460+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe810f960 con 0x7effe81035a0 2023-12-05T09:34:45.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.460+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe810fea0 con 0x7effe81035a0 2023-12-05T09:34:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.461+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe80fc390 con 0x7effe81035a0 2023-12-05T09:34:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.462+0000 7effdf7fe700 1 -- 172.21.15.67:0/2755993937 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7effd0009730 con 0x7effe81035a0 2023-12-05T09:34:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.463+0000 7effdf7fe700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7effd406ce60 0x7effd406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.463+0000 7effdf7fe700 1 -- 172.21.15.67:0/2755993937 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7effd008bf60 con 0x7effe81035a0 2023-12-05T09:34:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.463+0000 7effe6ffd700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7effd406ce60 0x7effd406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:45.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.464+0000 7effe6ffd700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7effd406ce60 0x7effd406f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effd8004f90 tx=0x7effd8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:45.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.468+0000 7effdf7fe700 1 -- 172.21.15.67:0/2755993937 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7effd0059960 con 0x7effe81035a0 2023-12-05T09:34:45.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:45 smithi067 ceph-mon[210894]: pgmap v160: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:45.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:45 smithi134 ceph-mon[172895]: pgmap v160: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:45.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.760+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7effe804bb80 con 0x7effe81035a0 2023-12-05T09:34:45.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.761+0000 7effdf7fe700 1 -- 172.21.15.67:0/2755993937 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+261 (secure 0 0 0) 0x7effd00594f0 con 0x7effe81035a0 2023-12-05T09:34:45.761 INFO:teuthology.orchestra.run.smithi067.stdout:HEALTH_ERR Upgrade: failed due to an unexpected exception 2023-12-05T09:34:45.761 INFO:teuthology.orchestra.run.smithi067.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-05T09:34:45.761 INFO:teuthology.orchestra.run.smithi067.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7effd406ce60 msgr2=0x7effd406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7effd406ce60 0x7effd406f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7effd8004f90 tx=0x7effd8009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe81035a0 msgr2=0x7effe8115d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe81035a0 0x7effe8115d00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7effd0002a50 tx=0x7effd00046b0 comp rx=0 tx=0).stop 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 shutdown_connections 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effe8102c00 0x7effe81157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7effd406ce60 0x7effd406f310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 --2- 172.21.15.67:0/2755993937 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7effe81035a0 0x7effe8115d00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 >> 172.21.15.67:0/2755993937 conn(0x7effe80f8790 msgr2=0x7effe80fa050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 shutdown_connections 2023-12-05T09:34:45.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:45.763+0000 7effed4a6700 1 -- 172.21.15.67:0/2755993937 wait complete. 2023-12-05T09:34:46.151 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions' 2023-12-05T09:34:46.589 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:34:46.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:46 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/2755993937' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:34:46.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:46.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:34:46.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:46.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:46 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/2755993937' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-05T09:34:46.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:46.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:34:46.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:34:47.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:47 smithi067 ceph-mon[210894]: pgmap v161: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:47.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:47 smithi134 ceph-mon[172895]: pgmap v161: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:47.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.832+0000 7f3cd200f700 1 -- 172.21.15.67:0/140783484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 msgr2=0x7f3ccc0fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:47.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.832+0000 7f3cd200f700 1 --2- 172.21.15.67:0/140783484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 0x7f3ccc0fce70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc004940 tx=0x7f3cbc009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:47.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.833+0000 7f3cd200f700 1 -- 172.21.15.67:0/140783484 shutdown_connections 2023-12-05T09:34:47.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.833+0000 7f3cd200f700 1 --2- 172.21.15.67:0/140783484 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 0x7f3ccc0fce70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:47.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.833+0000 7f3cd200f700 1 --2- 172.21.15.67:0/140783484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc102a40 0x7f3ccc102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:47.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.833+0000 7f3cd200f700 1 -- 172.21.15.67:0/140783484 >> 172.21.15.67:0/140783484 conn(0x7f3ccc0f8560 msgr2=0x7f3ccc0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:47.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.833+0000 7f3cd200f700 1 -- 172.21.15.67:0/140783484 shutdown_connections 2023-12-05T09:34:47.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.833+0000 7f3cd200f700 1 -- 172.21.15.67:0/140783484 wait complete. 2023-12-05T09:34:47.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd200f700 1 Processor -- start 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd200f700 1 -- start start 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd200f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 0x7f3ccc1155e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd200f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc102a40 0x7f3ccc115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd200f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc116170 con 0x7f3ccc0fca00 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd200f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc10f4a0 con 0x7f3ccc102a40 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd100d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 0x7f3ccc1155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd100d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 0x7f3ccc1155e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:47824/0 (socket says 172.21.15.67:47824) 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.834+0000 7f3cd100d700 1 -- 172.21.15.67:0/4267289256 learned_addr learned my addr 172.21.15.67:0/4267289256 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:34:47.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cd080c700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc102a40 0x7f3ccc115b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:47.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cd100d700 1 -- 172.21.15.67:0/4267289256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc102a40 msgr2=0x7f3ccc115b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:47.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cd100d700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc102a40 0x7f3ccc115b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:47.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cd100d700 1 -- 172.21.15.67:0/4267289256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc005040 con 0x7f3ccc0fca00 2023-12-05T09:34:47.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cd100d700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 0x7f3ccc1155e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8002a50 tx=0x7f3cc80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:47.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cc1ffb700 1 -- 172.21.15.67:0/4267289256 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cc8007cc0 con 0x7f3ccc0fca00 2023-12-05T09:34:47.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cc1ffb700 1 -- 172.21.15.67:0/4267289256 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3cc800f040 con 0x7f3ccc0fca00 2023-12-05T09:34:47.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cc1ffb700 1 -- 172.21.15.67:0/4267289256 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cc800d9c0 con 0x7f3ccc0fca00 2023-12-05T09:34:47.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.835+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc10f780 con 0x7f3ccc0fca00 2023-12-05T09:34:47.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.836+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc10fcf0 con 0x7f3ccc0fca00 2023-12-05T09:34:47.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.837+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc05f270 con 0x7f3ccc0fca00 2023-12-05T09:34:47.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.838+0000 7f3cc1ffb700 1 -- 172.21.15.67:0/4267289256 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f3cc800db20 con 0x7f3ccc0fca00 2023-12-05T09:34:47.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.839+0000 7f3cc1ffb700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3cb806ce70 0x7f3cb806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:34:47.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.839+0000 7f3cc1ffb700 1 -- 172.21.15.67:0/4267289256 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3cc808c0a0 con 0x7f3ccc0fca00 2023-12-05T09:34:47.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.839+0000 7f3cd080c700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3cb806ce70 0x7f3cb806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:34:47.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.840+0000 7f3cd080c700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3cb806ce70 0x7f3cb806f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc110e80 tx=0x7f3cbc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:34:47.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:47.843+0000 7f3cc1ffb700 1 -- 172.21.15.67:0/4267289256 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3cc8059970 con 0x7f3ccc0fca00 2023-12-05T09:34:48.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.138+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ccc110c60 con 0x7f3ccc0fca00 2023-12-05T09:34:48.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.139+0000 7f3cc1ffb700 1 -- 172.21.15.67:0/4267289256 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f3cc8059500 con 0x7f3ccc0fca00 2023-12-05T09:34:48.137 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:34:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:34:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:34:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 6 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 10 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:34:48.138 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3cb806ce70 msgr2=0x7f3cb806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3cb806ce70 0x7f3cb806f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc110e80 tx=0x7f3cbc009e30 comp rx=0 tx=0).stop 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 msgr2=0x7f3ccc1155e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 0x7f3ccc1155e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8002a50 tx=0x7f3cc80046b0 comp rx=0 tx=0).stop 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 shutdown_connections 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f3cb806ce70 0x7f3cb806f320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ccc0fca00 0x7f3ccc1155e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 --2- 172.21.15.67:0/4267289256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ccc102a40 0x7f3ccc115b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:34:48.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.141+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 >> 172.21.15.67:0/4267289256 conn(0x7f3ccc0f8560 msgr2=0x7f3ccc0f9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:34:48.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.142+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 shutdown_connections 2023-12-05T09:34:48.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:34:48.142+0000 7f3cd200f700 1 -- 172.21.15.67:0/4267289256 wait complete. 2023-12-05T09:34:48.486 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:48 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/4267289256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:48.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-05T09:34:48.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:48 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/4267289256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:34:48.956 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:34:49.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:49 smithi067 ceph-mon[210894]: pgmap v162: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:49.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:49 smithi134 ceph-mon[172895]: pgmap v162: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:49.999 INFO:teuthology.orchestra.run.smithi067.stdout:wait for servicemap items w/ changing names to refresh 2023-12-05T09:34:50.396 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'sleep 60' 2023-12-05T09:34:50.838 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:34:51.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:51 smithi067 ceph-mon[210894]: pgmap v163: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:51.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:51 smithi134 ceph-mon[172895]: pgmap v163: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:53.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:53 smithi067 ceph-mon[210894]: pgmap v164: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:53.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:53 smithi134 ceph-mon[172895]: pgmap v164: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:55.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:55 smithi067 ceph-mon[210894]: pgmap v165: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:55.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:55 smithi134 ceph-mon[172895]: pgmap v165: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:57.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:57 smithi067 ceph-mon[210894]: pgmap v166: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:57.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:57 smithi134 ceph-mon[172895]: pgmap v166: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:59.621 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:34:59 smithi067 ceph-mon[210894]: pgmap v167: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:34:59.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:34:59 smithi134 ceph-mon[172895]: pgmap v167: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:01.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:01 smithi067 ceph-mon[210894]: pgmap v168: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:01.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:35:01.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:01 smithi134 ceph-mon[172895]: pgmap v168: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:01.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:35:03.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:03 smithi067 ceph-mon[210894]: pgmap v169: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:03.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:03 smithi134 ceph-mon[172895]: pgmap v169: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:05.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:05 smithi067 ceph-mon[210894]: pgmap v170: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:05.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:05 smithi134 ceph-mon[172895]: pgmap v170: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:07.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:07 smithi067 ceph-mon[210894]: pgmap v171: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:07.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:07 smithi134 ceph-mon[172895]: pgmap v171: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:09.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:09 smithi067 ceph-mon[210894]: pgmap v172: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:09.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:09 smithi134 ceph-mon[172895]: pgmap v172: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:11.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:11 smithi067 ceph-mon[210894]: pgmap v173: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:11.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:11 smithi134 ceph-mon[172895]: pgmap v173: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:13.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:13 smithi067 ceph-mon[210894]: pgmap v174: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:13.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:13 smithi134 ceph-mon[172895]: pgmap v174: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:15.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:15 smithi067 ceph-mon[210894]: pgmap v175: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:15.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:15 smithi134 ceph-mon[172895]: pgmap v175: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:16.869 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:16 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:35:16.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:16 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:35:17.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:17 smithi067 ceph-mon[210894]: pgmap v176: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:17.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:17 smithi134 ceph-mon[172895]: pgmap v176: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:19.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:19 smithi067 ceph-mon[210894]: pgmap v177: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:19.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:19 smithi134 ceph-mon[172895]: pgmap v177: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:21.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:21 smithi067 ceph-mon[210894]: pgmap v178: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:21.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:21 smithi134 ceph-mon[172895]: pgmap v178: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:23.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:23 smithi067 ceph-mon[210894]: pgmap v179: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:23.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:23 smithi134 ceph-mon[172895]: pgmap v179: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:25.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:25 smithi067 ceph-mon[210894]: pgmap v180: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:25.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:25 smithi134 ceph-mon[172895]: pgmap v180: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:27.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:27 smithi067 ceph-mon[210894]: pgmap v181: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:27.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:27 smithi134 ceph-mon[172895]: pgmap v181: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:29.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:29 smithi067 ceph-mon[210894]: pgmap v182: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:29.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:29 smithi134 ceph-mon[172895]: pgmap v182: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:31.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:31 smithi067 ceph-mon[210894]: pgmap v183: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:31.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:31 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:35:31.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:31 smithi134 ceph-mon[172895]: pgmap v183: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:31.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:31 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:35:33.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:33 smithi067 ceph-mon[210894]: pgmap v184: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:33.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:33 smithi134 ceph-mon[172895]: pgmap v184: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:35.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:35 smithi067 ceph-mon[210894]: pgmap v185: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:35.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:35 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:35:35.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:35 smithi134 ceph-mon[172895]: pgmap v185: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:35.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:35 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-05T09:35:36.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:36 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:35:36.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:36 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:35:36.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:36 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:35:36.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:36 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-05T09:35:36.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:36 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-05T09:35:36.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:36 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' 2023-12-05T09:35:37.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:37 smithi067 ceph-mon[210894]: pgmap v186: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:37.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:37 smithi134 ceph-mon[172895]: pgmap v186: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:39.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:39 smithi067 ceph-mon[210894]: pgmap v187: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:39.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:39 smithi134 ceph-mon[172895]: pgmap v187: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:41.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:41 smithi067 ceph-mon[210894]: pgmap v188: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:41.626 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:41 smithi134 ceph-mon[172895]: pgmap v188: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:43.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:43 smithi067 ceph-mon[210894]: pgmap v189: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:43.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:43 smithi134 ceph-mon[172895]: pgmap v189: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:45.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:45 smithi067 ceph-mon[210894]: pgmap v190: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:45.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:45 smithi134 ceph-mon[172895]: pgmap v190: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:46.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:46 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:35:46.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:46 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:35:47.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:47 smithi067 ceph-mon[210894]: pgmap v191: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:47.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:47 smithi134 ceph-mon[172895]: pgmap v191: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:49.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:49 smithi067 ceph-mon[210894]: pgmap v192: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:49.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:49 smithi134 ceph-mon[172895]: pgmap v192: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:51.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:51 smithi067 ceph-mon[210894]: pgmap v193: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:51.627 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:51 smithi134 ceph-mon[172895]: pgmap v193: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:52.238 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph orch ps' 2023-12-05T09:35:52.675 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:35:53.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:53 smithi067 ceph-mon[210894]: pgmap v194: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:53.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:53 smithi134 ceph-mon[172895]: pgmap v194: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.925+0000 7fabcff60700 1 -- 172.21.15.67:0/1714911934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc8102c00 msgr2=0x7fabc8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:53.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.925+0000 7fabcff60700 1 --2- 172.21.15.67:0/1714911934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc8102c00 0x7fabc8102fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabc4004940 tx=0x7fabc4009e30 comp rx=0 tx=0).stop 2023-12-05T09:35:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.925+0000 7fabcff60700 1 -- 172.21.15.67:0/1714911934 shutdown_connections 2023-12-05T09:35:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.925+0000 7fabcff60700 1 --2- 172.21.15.67:0/1714911934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc81035a0 0x7fabc80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.925+0000 7fabcff60700 1 --2- 172.21.15.67:0/1714911934 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc8102c00 0x7fabc8102fd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.925+0000 7fabcff60700 1 -- 172.21.15.67:0/1714911934 >> 172.21.15.67:0/1714911934 conn(0x7fabc80f8790 msgr2=0x7fabc80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:35:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.925+0000 7fabcff60700 1 -- 172.21.15.67:0/1714911934 shutdown_connections 2023-12-05T09:35:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.925+0000 7fabcff60700 1 -- 172.21.15.67:0/1714911934 wait complete. 2023-12-05T09:35:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.926+0000 7fabcff60700 1 Processor -- start 2023-12-05T09:35:53.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.926+0000 7fabcff60700 1 -- start start 2023-12-05T09:35:53.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.927+0000 7fabcff60700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc8102c00 0x7fabc8115840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:53.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.927+0000 7fabcff60700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81035a0 0x7fabc8115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:53.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.927+0000 7fabcff60700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc81163d0 con 0x7fabc81035a0 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.927+0000 7fabcff60700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc810f700 con 0x7fabc8102c00 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.927+0000 7fabcd4fb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81035a0 0x7fabc8115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.927+0000 7fabcd4fb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81035a0 0x7fabc8115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:57598/0 (socket says 172.21.15.67:57598) 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.927+0000 7fabcd4fb700 1 -- 172.21.15.67:0/556587782 learned_addr learned my addr 172.21.15.67:0/556587782 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.927+0000 7fabcdcfc700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc8102c00 0x7fabc8115840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabcd4fb700 1 -- 172.21.15.67:0/556587782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc8102c00 msgr2=0x7fabc8115840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabcd4fb700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc8102c00 0x7fabc8115840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabcd4fb700 1 -- 172.21.15.67:0/556587782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4005040 con 0x7fabc81035a0 2023-12-05T09:35:53.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabcdcfc700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc8102c00 0x7fabc8115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:35:53.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabcd4fb700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81035a0 0x7fabc8115d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fabb8002a50 tx=0x7fabb8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:35:53.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabbe7fc700 1 -- 172.21.15.67:0/556587782 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb8007cc0 con 0x7fabc81035a0 2023-12-05T09:35:53.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabbe7fc700 1 -- 172.21.15.67:0/556587782 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fabb800f040 con 0x7fabc81035a0 2023-12-05T09:35:53.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc810f9e0 con 0x7fabc81035a0 2023-12-05T09:35:53.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabbe7fc700 1 -- 172.21.15.67:0/556587782 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb800d9a0 con 0x7fabc81035a0 2023-12-05T09:35:53.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.928+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc810ff20 con 0x7fabc81035a0 2023-12-05T09:35:53.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.930+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc80fc390 con 0x7fabc81035a0 2023-12-05T09:35:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.931+0000 7fabbe7fc700 1 -- 172.21.15.67:0/556587782 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7fabb800dc60 con 0x7fabc81035a0 2023-12-05T09:35:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.932+0000 7fabbe7fc700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fabb406ce70 0x7fabb406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:53.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.932+0000 7fabbe7fc700 1 -- 172.21.15.67:0/556587782 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fabb808c140 con 0x7fabc81035a0 2023-12-05T09:35:53.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.932+0000 7fabcdcfc700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fabb406ce70 0x7fabb406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:53.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.933+0000 7fabcdcfc700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fabb406ce70 0x7fabb406f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fabc4000c00 tx=0x7fabc4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:35:53.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:53.937+0000 7fabbe7fc700 1 -- 172.21.15.67:0/556587782 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fabb8059ab0 con 0x7fabc81035a0 2023-12-05T09:35:54.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.158+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 --> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fabc8115510 con 0x7fabb406ce70 2023-12-05T09:35:54.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.168+0000 7fabbe7fc700 1 -- 172.21.15.67:0/556587782 <== mgr.34104 v2:172.21.15.67:6800/4222876781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fabc8115510 con 0x7fabb406ce70 2023-12-05T09:35:54.167 INFO:teuthology.orchestra.run.smithi067.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-05T09:35:54.167 INFO:teuthology.orchestra.run.smithi067.stdout:alertmanager.smithi067 smithi067 *:9093,9094 running (7m) 3m ago 17m 16.1M - 0.25.0 c8568f914cd2 7673e509e63b 2023-12-05T09:35:54.167 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi067 smithi067 running (4m) 3m ago 17m 7852k - 19.0.0-11-g3fe8d441 56dea28e5206 e6de51f67edd 2023-12-05T09:35:54.167 INFO:teuthology.orchestra.run.smithi067.stdout:crash.smithi134 smithi134 running (4m) 84s ago 16m 7847k - 19.0.0-11-g3fe8d441 56dea28e5206 b78b9e680949 2023-12-05T09:35:54.167 INFO:teuthology.orchestra.run.smithi067.stdout:grafana.smithi067 smithi067 *:3000 running (6m) 3m ago 16m 79.7M - 9.4.7 2c41d148cca3 8c2488b75a89 2023-12-05T09:35:54.167 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.kyspon smithi067 running (12m) 3m ago 12m 6297M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 64df751ce50b 2023-12-05T09:35:54.167 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi067.qaibsa smithi067 running (12m) 3m ago 12m 5208M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc 2e14d9783233 2023-12-05T09:35:54.167 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vmnpaq smithi134 running (12m) 84s ago 12m 16.1M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc eb771fc64db8 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:mds.cephfs.smithi134.vvbmln smithi134 running (12m) 84s ago 12m 16.8M - 17.2.7-109-g1fd3ca3c e139fc5fd9fc c5afa6895f51 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi067.alxtvv smithi067 *:8443,9283,8765 running (9m) 3m ago 18m 519M - 19.0.0-11-g3fe8d441 56dea28e5206 3dd6ab24433a 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:mgr.smithi134.yfqkak smithi134 *:8443,9283,8765 running (8m) 84s ago 16m 453M - 19.0.0-11-g3fe8d441 56dea28e5206 ade16183524a 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi067 smithi067 running (5m) 3m ago 18m 68.0M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 25dffe125a4a 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:mon.smithi134 smithi134 running (5m) 84s ago 16m 54.8M 2048M 19.0.0-11-g3fe8d441 56dea28e5206 c85edd1646d0 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi067 smithi067 *:9100 running (7m) 3m ago 17m 8346k - 1.5.0 0da6a335fe13 9762a235d607 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 84s ago 16m 8368k - 1.5.0 0da6a335fe13 d4959ace1a5d 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:osd.0 smithi067 running (4m) 3m ago 15m 120M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 cc8a8add819d 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:osd.1 smithi067 running (3m) 3m ago 15m 123M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 5c8edfa1578a 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:osd.2 smithi067 running (3m) 3m ago 14m 12.6M 1618M 19.0.0-11-g3fe8d441 56dea28e5206 c43c33a4a005 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:osd.3 smithi134 running (2m) 84s ago 14m 141M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 ec57f7ef86f1 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:osd.4 smithi134 running (2m) 84s ago 13m 125M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 1ea7395d56d9 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:osd.5 smithi134 running (87s) 84s ago 13m 12.0M 2642M 19.0.0-11-g3fe8d441 56dea28e5206 6eaea923d8df 2023-12-05T09:35:54.168 INFO:teuthology.orchestra.run.smithi067.stdout:prometheus.smithi067 smithi067 *:9095 running (7m) 3m ago 16m 53.1M - 2.43.0 a07b618ecd1d 5acb15bdf155 2023-12-05T09:35:54.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fabb406ce70 msgr2=0x7fabb406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:54.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fabb406ce70 0x7fabb406f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fabc4000c00 tx=0x7fabc4009e30 comp rx=0 tx=0).stop 2023-12-05T09:35:54.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81035a0 msgr2=0x7fabc8115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:54.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81035a0 0x7fabc8115d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fabb8002a50 tx=0x7fabb8004600 comp rx=0 tx=0).stop 2023-12-05T09:35:54.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 shutdown_connections 2023-12-05T09:35:54.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fabc8102c00 0x7fabc8115840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:54.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7fabb406ce70 0x7fabb406f320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:54.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 --2- 172.21.15.67:0/556587782 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fabc81035a0 0x7fabc8115d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:54.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 >> 172.21.15.67:0/556587782 conn(0x7fabc80f8790 msgr2=0x7fabc80fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:35:54.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 shutdown_connections 2023-12-05T09:35:54.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:54.171+0000 7fabcff60700 1 -- 172.21.15.67:0/556587782 wait complete. 2023-12-05T09:35:54.621 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions' 2023-12-05T09:35:55.059 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:35:55.562 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:55 smithi067 ceph-mon[210894]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:35:55.562 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:55 smithi067 ceph-mon[210894]: pgmap v195: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:55.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:55 smithi134 ceph-mon[172895]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-05T09:35:55.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:55 smithi134 ceph-mon[172895]: pgmap v195: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:56.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.248+0000 7f665753f700 1 -- 172.21.15.67:0/2314051958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66501035a0 msgr2=0x7f66500fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.248+0000 7f665753f700 1 --2- 172.21.15.67:0/2314051958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66501035a0 0x7f66500fcc10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6640004940 tx=0x7f6640009e30 comp rx=0 tx=0).stop 2023-12-05T09:35:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.248+0000 7f665753f700 1 -- 172.21.15.67:0/2314051958 shutdown_connections 2023-12-05T09:35:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.248+0000 7f665753f700 1 --2- 172.21.15.67:0/2314051958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f66501035a0 0x7f66500fcc10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.248+0000 7f665753f700 1 --2- 172.21.15.67:0/2314051958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6650102c00 0x7f6650102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.248+0000 7f665753f700 1 -- 172.21.15.67:0/2314051958 >> 172.21.15.67:0/2314051958 conn(0x7f66500f8790 msgr2=0x7f66500faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:35:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.248+0000 7f665753f700 1 -- 172.21.15.67:0/2314051958 shutdown_connections 2023-12-05T09:35:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.248+0000 7f665753f700 1 -- 172.21.15.67:0/2314051958 wait complete. 2023-12-05T09:35:56.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.249+0000 7f665753f700 1 Processor -- start 2023-12-05T09:35:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.249+0000 7f665753f700 1 -- start start 2023-12-05T09:35:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.249+0000 7f665753f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6650102c00 0x7f6650115860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.249+0000 7f665753f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66501035a0 0x7f6650115da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.249+0000 7f665753f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6650116480 con 0x7f6650102c00 2023-12-05T09:35:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.249+0000 7f665753f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665010f720 con 0x7f66501035a0 2023-12-05T09:35:56.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.250+0000 7f66552db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6650102c00 0x7f6650115860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.250+0000 7f66552db700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6650102c00 0x7f6650115860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48086/0 (socket says 172.21.15.67:48086) 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.250+0000 7f66552db700 1 -- 172.21.15.67:0/2123816135 learned_addr learned my addr 172.21.15.67:0/2123816135 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.250+0000 7f6654ada700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66501035a0 0x7f6650115da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.250+0000 7f66552db700 1 -- 172.21.15.67:0/2123816135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66501035a0 msgr2=0x7f6650115da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.250+0000 7f66552db700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66501035a0 0x7f6650115da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.250+0000 7f66552db700 1 -- 172.21.15.67:0/2123816135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6640005040 con 0x7f6650102c00 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.250+0000 7f66552db700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6650102c00 0x7f6650115860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f664c00b790 tx=0x7f664c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.251+0000 7f6645ffb700 1 -- 172.21.15.67:0/2123816135 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664c00f770 con 0x7f6650102c00 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.251+0000 7f6645ffb700 1 -- 172.21.15.67:0/2123816135 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f664c00fd80 con 0x7f6650102c00 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.251+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665010fa00 con 0x7f6650102c00 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.251+0000 7f6645ffb700 1 -- 172.21.15.67:0/2123816135 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664c00d310 con 0x7f6650102c00 2023-12-05T09:35:56.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.251+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665010ff40 con 0x7f6650102c00 2023-12-05T09:35:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.252+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66500fc390 con 0x7f6650102c00 2023-12-05T09:35:56.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.253+0000 7f6645ffb700 1 -- 172.21.15.67:0/2123816135 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f664c010420 con 0x7f6650102c00 2023-12-05T09:35:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.254+0000 7f6645ffb700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f663c06ce70 0x7f663c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.254+0000 7f6645ffb700 1 -- 172.21.15.67:0/2123816135 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f664c08c240 con 0x7f6650102c00 2023-12-05T09:35:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.254+0000 7f6654ada700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f663c06ce70 0x7f663c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:56.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.255+0000 7f6654ada700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f663c06ce70 0x7f663c06f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6650111090 tx=0x7f6640009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:35:56.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.259+0000 7f6645ffb700 1 -- 172.21.15.67:0/2123816135 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f664c059c10 con 0x7f6650102c00 2023-12-05T09:35:56.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.555+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6650109c90 con 0x7f6650102c00 2023-12-05T09:35:56.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.555+0000 7f6645ffb700 1 -- 172.21.15.67:0/2123816135 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f6650109c90 con 0x7f6650102c00 2023-12-05T09:35:56.553 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": { 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": { 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 2 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": { 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 6 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": { 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4 2023-12-05T09:35:56.554 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-12-05T09:35:56.555 INFO:teuthology.orchestra.run.smithi067.stdout: "overall": { 2023-12-05T09:35:56.555 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 17.2.7-109-g1fd3ca3c (1fd3ca3c4ef43cc7b533b4bacec3e9dcde01eb6c) quincy (stable)": 4, 2023-12-05T09:35:56.555 INFO:teuthology.orchestra.run.smithi067.stdout: "ceph version 19.0.0-11-g3fe8d441 (3fe8d441c2f973bfe963ba4dd30ba8eac9f36227) reef (dev)": 10 2023-12-05T09:35:56.555 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-12-05T09:35:56.555 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-12-05T09:35:56.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f663c06ce70 msgr2=0x7f663c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:56.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f663c06ce70 0x7f663c06f320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6650111090 tx=0x7f6640009e30 comp rx=0 tx=0).stop 2023-12-05T09:35:56.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6650102c00 msgr2=0x7f6650115860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:56.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6650102c00 0x7f6650115860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f664c00b790 tx=0x7f664c009250 comp rx=0 tx=0).stop 2023-12-05T09:35:56.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 shutdown_connections 2023-12-05T09:35:56.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f663c06ce70 0x7f663c06f320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:56.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6650102c00 0x7f6650115860 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:56.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 --2- 172.21.15.67:0/2123816135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66501035a0 0x7f6650115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:56.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 >> 172.21.15.67:0/2123816135 conn(0x7f66500f8790 msgr2=0x7f66500fa070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:35:56.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 shutdown_connections 2023-12-05T09:35:56.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:56.558+0000 7f665753f700 1 -- 172.21.15.67:0/2123816135 wait complete. 2023-12-05T09:35:56.954 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-05T09:35:57.391 INFO:teuthology.orchestra.run.smithi067.stderr:Inferring config /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/mon.smithi067/config 2023-12-05T09:35:57.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:57 smithi067 ceph-mon[210894]: pgmap v196: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:57.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:57 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/2123816135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:35:57.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:57 smithi134 ceph-mon[172895]: pgmap v196: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:57.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:57 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/2123816135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:35:58.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.548+0000 7f946be1d700 1 -- 172.21.15.67:0/1901114760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9464102c00 msgr2=0x7f9464102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:58.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.548+0000 7f946be1d700 1 --2- 172.21.15.67:0/1901114760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9464102c00 0x7f9464102fd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9460004940 tx=0x7f9460009e30 comp rx=0 tx=0).stop 2023-12-05T09:35:58.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.548+0000 7f946be1d700 1 -- 172.21.15.67:0/1901114760 shutdown_connections 2023-12-05T09:35:58.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.548+0000 7f946be1d700 1 --2- 172.21.15.67:0/1901114760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94641035a0 0x7f94640fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:58.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.548+0000 7f946be1d700 1 --2- 172.21.15.67:0/1901114760 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9464102c00 0x7f9464102fd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:58.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.548+0000 7f946be1d700 1 -- 172.21.15.67:0/1901114760 >> 172.21.15.67:0/1901114760 conn(0x7f94640f8790 msgr2=0x7f94640faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:35:58.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.548+0000 7f946be1d700 1 -- 172.21.15.67:0/1901114760 shutdown_connections 2023-12-05T09:35:58.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.548+0000 7f946be1d700 1 -- 172.21.15.67:0/1901114760 wait complete. 2023-12-05T09:35:58.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.549+0000 7f946be1d700 1 Processor -- start 2023-12-05T09:35:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.550+0000 7f946be1d700 1 -- start start 2023-12-05T09:35:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.550+0000 7f946be1d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9464102c00 0x7f946406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:58.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.550+0000 7f946be1d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94641035a0 0x7f9464070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.550+0000 7f946be1d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464070a80 con 0x7f94641035a0 2023-12-05T09:35:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.550+0000 7f946be1d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464070bf0 con 0x7f9464102c00 2023-12-05T09:35:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f94693b8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94641035a0 0x7f9464070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f9469bb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9464102c00 0x7f946406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f9469bb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9464102c00 0x7f946406ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.67:51484/0 (socket says 172.21.15.67:51484) 2023-12-05T09:35:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f9469bb9700 1 -- 172.21.15.67:0/3109287305 learned_addr learned my addr 172.21.15.67:0/3109287305 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:35:58.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f94693b8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94641035a0 0x7f9464070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48106/0 (socket says 172.21.15.67:48106) 2023-12-05T09:35:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f94693b8700 1 -- 172.21.15.67:0/3109287305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9464102c00 msgr2=0x7f946406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f94693b8700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9464102c00 0x7f946406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f94693b8700 1 -- 172.21.15.67:0/3109287305 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460005040 con 0x7f94641035a0 2023-12-05T09:35:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f94693b8700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94641035a0 0x7f9464070480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9464066f70 tx=0x7f945400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:35:58.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f945a7fc700 1 -- 172.21.15.67:0/3109287305 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9454004e90 con 0x7f94641035a0 2023-12-05T09:35:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.551+0000 7f945a7fc700 1 -- 172.21.15.67:0/3109287305 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f945400f040 con 0x7f94641035a0 2023-12-05T09:35:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.552+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9464119880 con 0x7f94641035a0 2023-12-05T09:35:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.552+0000 7f945a7fc700 1 -- 172.21.15.67:0/3109287305 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f945400c980 con 0x7f94641035a0 2023-12-05T09:35:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.552+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9464119ce0 con 0x7f94641035a0 2023-12-05T09:35:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.553+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94640fff10 con 0x7f94641035a0 2023-12-05T09:35:58.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.554+0000 7f945a7fc700 1 -- 172.21.15.67:0/3109287305 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f9454007cc0 con 0x7f94641035a0 2023-12-05T09:35:58.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.555+0000 7f945a7fc700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f945006ce70 0x7f945006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:58.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.555+0000 7f945a7fc700 1 -- 172.21.15.67:0/3109287305 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f945408bd00 con 0x7f94641035a0 2023-12-05T09:35:58.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.555+0000 7f9469bb9700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f945006ce70 0x7f945006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:58.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.556+0000 7f9469bb9700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f945006ce70 0x7f945006f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f946000b0d0 tx=0x7f9460009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:35:58.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.559+0000 7f945a7fc700 1 -- 172.21.15.67:0/3109287305 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9454055c70 con 0x7f94641035a0 2023-12-05T09:35:58.854 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.856+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f94640fc360 con 0x7f94641035a0 2023-12-05T09:35:58.854 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.856+0000 7f945a7fc700 1 -- 172.21.15.67:0/3109287305 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f9454059290 con 0x7f94641035a0 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f945006ce70 msgr2=0x7f945006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f945006ce70 0x7f945006f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f946000b0d0 tx=0x7f9460009e30 comp rx=0 tx=0).stop 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94641035a0 msgr2=0x7f9464070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94641035a0 0x7f9464070480 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9464066f70 tx=0x7f945400b040 comp rx=0 tx=0).stop 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 shutdown_connections 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9464102c00 0x7f946406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f945006ce70 0x7f945006f320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 --2- 172.21.15.67:0/3109287305 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94641035a0 0x7f9464070480 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:58.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 >> 172.21.15.67:0/3109287305 conn(0x7f94640f8790 msgr2=0x7f94640fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:35:58.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 shutdown_connections 2023-12-05T09:35:58.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:58.859+0000 7f946be1d700 1 -- 172.21.15.67:0/3109287305 wait complete. 2023-12-05T09:35:58.871 INFO:teuthology.orchestra.run.smithi067.stdout:false 2023-12-05T09:35:59.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:35:59.247 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-05T09:35:59.343 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7570eb2c5fb0497bad2885a523f0f427 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_3fe8d441c2f973bfe963ba4dd30ba8eac9f36227/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-05T09:35:59.347 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-05T09:35:59.358 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-05T09:35:59.359 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:35:59.359 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T09:35:59.413 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-12-05T09:35:59.413 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T09:35:59.501 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T09:35:59.606 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:59 smithi067 ceph-mon[210894]: pgmap v197: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:59.606 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:35:59 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3109287305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:35:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.744+0000 7f2a357ff700 1 -- 172.21.15.67:0/3799569409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a300fcab0 msgr2=0x7f2a300fcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.744+0000 7f2a357ff700 1 --2- 172.21.15.67:0/3799569409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a300fcab0 0x7f2a300fcf20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a24004940 tx=0x7f2a24009e30 comp rx=0 tx=0).stop 2023-12-05T09:35:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.744+0000 7f2a357ff700 1 -- 172.21.15.67:0/3799569409 shutdown_connections 2023-12-05T09:35:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.744+0000 7f2a357ff700 1 --2- 172.21.15.67:0/3799569409 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a300fcab0 0x7f2a300fcf20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:59.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.744+0000 7f2a357ff700 1 --2- 172.21.15.67:0/3799569409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a30102af0 0x7f2a30102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:59.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.744+0000 7f2a357ff700 1 -- 172.21.15.67:0/3799569409 >> 172.21.15.67:0/3799569409 conn(0x7f2a300f85f0 msgr2=0x7f2a300faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:35:59.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.744+0000 7f2a357ff700 1 -- 172.21.15.67:0/3799569409 shutdown_connections 2023-12-05T09:35:59.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.745+0000 7f2a357ff700 1 -- 172.21.15.67:0/3799569409 wait complete. 2023-12-05T09:35:59.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.746+0000 7f2a357ff700 1 Processor -- start 2023-12-05T09:35:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.746+0000 7f2a357ff700 1 -- start start 2023-12-05T09:35:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.746+0000 7f2a357ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a300fcab0 0x7f2a3006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:59.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.746+0000 7f2a357ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a30102af0 0x7f2a30070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.746+0000 7f2a357ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a300709c0 con 0x7f2a30102af0 2023-12-05T09:35:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.746+0000 7f2a357ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30070b00 con 0x7f2a300fcab0 2023-12-05T09:35:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2e7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a30102af0 0x7f2a30070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2e7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a30102af0 0x7f2a30070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48118/0 (socket says 172.21.15.67:48118) 2023-12-05T09:35:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2e7fc700 1 -- 172.21.15.67:0/3054952505 learned_addr learned my addr 172.21.15.67:0/3054952505 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:35:59.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2effd700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a300fcab0 0x7f2a3006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2e7fc700 1 -- 172.21.15.67:0/3054952505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a300fcab0 msgr2=0x7f2a3006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2e7fc700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a300fcab0 0x7f2a3006ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2e7fc700 1 -- 172.21.15.67:0/3054952505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a24005040 con 0x7f2a30102af0 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2effd700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a300fcab0 0x7f2a3006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.747+0000 7f2a2e7fc700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a30102af0 0x7f2a30070480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009360 tx=0x7f2a24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.748+0000 7f2a177fe700 1 -- 172.21.15.67:0/3054952505 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2400e040 con 0x7f2a30102af0 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.748+0000 7f2a177fe700 1 -- 172.21.15.67:0/3054952505 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a2400bc50 con 0x7f2a30102af0 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.748+0000 7f2a177fe700 1 -- 172.21.15.67:0/3054952505 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2401c630 con 0x7f2a30102af0 2023-12-05T09:35:59.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.748+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a30070d80 con 0x7f2a30102af0 2023-12-05T09:35:59.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.748+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a301199d0 con 0x7f2a30102af0 2023-12-05T09:35:59.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.749+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a30104f70 con 0x7f2a30102af0 2023-12-05T09:35:59.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.750+0000 7f2a177fe700 1 -- 172.21.15.67:0/3054952505 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f2a24013420 con 0x7f2a30102af0 2023-12-05T09:35:59.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.751+0000 7f2a177fe700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2a1806ce70 0x7f2a1806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:35:59.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.751+0000 7f2a177fe700 1 -- 172.21.15.67:0/3054952505 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2a2408d580 con 0x7f2a30102af0 2023-12-05T09:35:59.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.751+0000 7f2a2effd700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2a1806ce70 0x7f2a1806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:35:59.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.752+0000 7f2a2effd700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2a1806ce70 0x7f2a1806f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009fd0 tx=0x7f2a20009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:35:59.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.755+0000 7f2a177fe700 1 -- 172.21.15.67:0/3054952505 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2a240574c0 con 0x7f2a30102af0 2023-12-05T09:35:59.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:59 smithi134 ceph-mon[172895]: pgmap v197: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:35:59.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:35:59 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3109287305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-05T09:35:59.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.967+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a30064730 con 0x7f2a30102af0 2023-12-05T09:35:59.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.968+0000 7f2a177fe700 1 -- 172.21.15.67:0/3054952505 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16404 (secure 0 0 0) 0x7f2a2405aae0 con 0x7f2a30102af0 2023-12-05T09:35:59.967 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:35:59.967 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":81,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","created":"2023-12-05T09:17:21.700862+0000","modified":"2023-12-05T09:34:34.829780+0000","last_up_change":"2023-12-05T09:34:33.827519+0000","last_in_change":"2023-12-05T09:22:09.939138+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:21:24.629667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T09:23:26.505239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T09:23:27.500572+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d6a29a-57c6-4943-9a9b-1bb55401f054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":51,"up_from":55,"up_thru":80,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2109297054},{"type":"v1","addr":"172.21.15.67:6803","nonce":2109297054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2109297054},{"type":"v1","addr":"172.21.15.67:6805","nonce":2109297054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2109297054},{"type":"v1","addr":"172.21.15.67:6809","nonce":2109297054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2109297054},{"type":"v1","addr":"172.21.15.67:6807","nonce":2109297054}]},"public_addr":"172.21.15.67:6803/2109297054","cluster_addr":"172.21.15.67:6805/2109297054","heartbeat_back_addr":"172.21.15.67:6809/2109297054","heartbeat_front_addr":"172.21.15.67:6807/2109297054","state":["exists","up"]},{"osd":1,"uuid":"21d6b362-1d8c-4508-b7df-5a156074fc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":56,"up_from":60,"up_thru":80,"down_at":57,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":95427693},{"type":"v1","addr":"172.21.15.67:6811","nonce":95427693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":95427693},{"type":"v1","addr":"172.21.15.67:6813","nonce":95427693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":95427693},{"type":"v1","addr":"172.21.15.67:6817","nonce":95427693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":95427693},{"type":"v1","addr":"172.21.15.67:6815","nonce":95427693}]},"public_addr":"172.21.15.67:6811/95427693","cluster_addr":"172.21.15.67:6813/95427693","heartbeat_back_addr":"172.21.15.67:6817/95427693","heartbeat_front_addr":"172.21.15.67:6815/95427693","state":["exists","up"]},{"osd":2,"uuid":"214bcc5f-be74-4b12-b23e-c325bae6a18f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":61,"up_from":65,"up_thru":80,"down_at":62,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4278620943},{"type":"v1","addr":"172.21.15.67:6819","nonce":4278620943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4278620943},{"type":"v1","addr":"172.21.15.67:6821","nonce":4278620943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4278620943},{"type":"v1","addr":"172.21.15.67:6825","nonce":4278620943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4278620943},{"type":"v1","addr":"172.21.15.67:6823","nonce":4278620943}]},"public_addr":"172.21.15.67:6819/4278620943","cluster_addr":"172.21.15.67:6821/4278620943","heartbeat_back_addr":"172.21.15.67:6825/4278620943","heartbeat_front_addr":"172.21.15.67:6823/4278620943","state":["exists","up"]},{"osd":3,"uuid":"6bce7967-b081-4a08-ac54-9552edf45ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":66,"up_from":70,"up_thru":80,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":4075414049},{"type":"v1","addr":"172.21.15.134:6801","nonce":4075414049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":4075414049},{"type":"v1","addr":"172.21.15.134:6803","nonce":4075414049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":4075414049},{"type":"v1","addr":"172.21.15.134:6807","nonce":4075414049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":4075414049},{"type":"v1","addr":"172.21.15.134:6805","nonce":4075414049}]},"public_addr":"172.21.15.134:6801/4075414049","cluster_addr":"172.21.15.134:6803/4075414049","heartbeat_back_addr":"172.21.15.134:6807/4075414049","heartbeat_front_addr":"172.21.15.134:6805/4075414049","state":["exists","up"]},{"osd":4,"uuid":"5d1c05dc-2b50-493a-9e5e-d0b16d911091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":71,"up_from":75,"up_thru":80,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3391162370},{"type":"v1","addr":"172.21.15.134:6809","nonce":3391162370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3391162370},{"type":"v1","addr":"172.21.15.134:6811","nonce":3391162370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3391162370},{"type":"v1","addr":"172.21.15.134:6815","nonce":3391162370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3391162370},{"type":"v1","addr":"172.21.15.134:6813","nonce":3391162370}]},"public_addr":"172.21.15.134:6809/3391162370","cluster_addr":"172.21.15.134:6811/3391162370","heartbeat_back_addr":"172.21.15.134:6815/3391162370","heartbeat_front_addr":"172.21.15.134:6813/3391162370","state":["exists","up"]},{"osd":5,"uuid":"43ae157e-59ef-448e-b33f-5ebfadf73ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":76,"up_from":80,"up_thru":80,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":867837745},{"type":"v1","addr":"172.21.15.134:6817","nonce":867837745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":867837745},{"type":"v1","addr":"172.21.15.134:6819","nonce":867837745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":867837745},{"type":"v1","addr":"172.21.15.134:6823","nonce":867837745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":867837745},{"type":"v1","addr":"172.21.15.134:6821","nonce":867837745}]},"public_addr":"172.21.15.134:6817/867837745","cluster_addr":"172.21.15.134:6819/867837745","heartbeat_back_addr":"172.21.15.134:6823/867837745","heartbeat_front_addr":"172.21.15.134:6821/867837745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:30.796950+0000","dead_epoch":51},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:55.649954+0000","dead_epoch":56},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:20.496287+0000","dead_epoch":61},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:41.995990+0000","dead_epoch":66},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:04.343494+0000","dead_epoch":71},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:26.824683+0000","dead_epoch":76}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3637826020":"2023-12-06T09:30:30.716180+0000","172.21.15.67:0/4207254869":"2023-12-06T09:25:33.288852+0000","172.21.15.67:6801/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6801/3666384983":"2023-12-06T09:25:33.288852+0000","172.21.15.67:0/266329309":"2023-12-06T09:19:26.041323+0000","172.21.15.134:0/181843478":"2023-12-06T09:27:04.474771+0000","172.21.15.67:0/2057389438":"2023-12-06T09:17:56.446884+0000","172.21.15.134:6825/3151035948":"2023-12-06T09:23:40.978176+0000","172.21.15.134:0/3832644508":"2023-12-06T09:27:04.474771+0000","172.21.15.67:6801/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.134:6824/3151035948":"2023-12-06T09:23:40.978176+0000","172.21.15.67:6800/3666384983":"2023-12-06T09:25:33.288852+0000","172.21.15.67:0/3210428255":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/3864088954":"2023-12-06T09:25:33.288852+0000","172.21.15.67:0/2190646552":"2023-12-06T09:17:56.446884+0000","172.21.15.134:0/29053483":"2023-12-06T09:27:04.474771+0000","172.21.15.67:6801/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/2132118036":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/3434626511":"2023-12-06T09:19:26.041323+0000","172.21.15.134:0/567071518":"2023-12-06T09:27:04.474771+0000","172.21.15.67:6800/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/2889018783":"2023-12-06T09:30:30.716180+0000","172.21.15.67:0/2936759595":"2023-12-06T09:25:33.288852+0000","172.21.15.67:6800/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6800/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3189096558":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/4223108820":"2023-12-06T09:30:30.716180+0000","172.21.15.134:6828/1604582340":"2023-12-06T09:27:04.474771+0000","172.21.15.67:0/1134257028":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/440859058":"2023-12-06T09:25:33.288852+0000","172.21.15.134:6829/1604582340":"2023-12-06T09:27:04.474771+0000","172.21.15.134:0/2478780622":"2023-12-06T09:27:04.474771+0000","172.21.15.134:0/2776807637":"2023-12-06T09:27:04.474771+0000","172.21.15.67:0/3754244083":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/3415963237":"2023-12-06T09:30:30.716180+0000","172.21.15.67:6800/3637826020":"2023-12-06T09:30:30.716180+0000","172.21.15.67:0/1060895899":"2023-12-06T09:30:30.716180+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:35:59.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2a1806ce70 msgr2=0x7f2a1806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:59.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2a1806ce70 0x7f2a1806f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009fd0 tx=0x7f2a20009f20 comp rx=0 tx=0).stop 2023-12-05T09:35:59.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a30102af0 msgr2=0x7f2a30070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:35:59.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a30102af0 0x7f2a30070480 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009360 tx=0x7f2a24009e30 comp rx=0 tx=0).stop 2023-12-05T09:35:59.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 shutdown_connections 2023-12-05T09:35:59.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a300fcab0 0x7f2a3006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:59.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f2a1806ce70 0x7f2a1806f320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:59.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 --2- 172.21.15.67:0/3054952505 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2a30102af0 0x7f2a30070480 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:35:59.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 >> 172.21.15.67:0/3054952505 conn(0x7f2a300f85f0 msgr2=0x7f2a300fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:35:59.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 shutdown_connections 2023-12-05T09:35:59.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:35:59.971+0000 7f2a357ff700 1 -- 172.21.15.67:0/3054952505 wait complete. 2023-12-05T09:35:59.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T09:21:24.629667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T09:23:26.505239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T09:23:27.500572+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-05T09:35:59.988 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T09:36:00.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.192+0000 7f31107ff700 1 -- 172.21.15.67:0/1954925806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 msgr2=0x7f3108108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:00.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.192+0000 7f31107ff700 1 --2- 172.21.15.67:0/1954925806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 0x7f3108108e50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f30f8004970 tx=0x7f30f8009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:00.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.192+0000 7f31107ff700 1 -- 172.21.15.67:0/1954925806 shutdown_connections 2023-12-05T09:36:00.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.192+0000 7f31107ff700 1 --2- 172.21.15.67:0/1954925806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 0x7f3108108e50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.192+0000 7f31107ff700 1 --2- 172.21.15.67:0/1954925806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310806ffe0 0x7f31080703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.192+0000 7f31107ff700 1 -- 172.21.15.67:0/1954925806 >> 172.21.15.67:0/1954925806 conn(0x7f31080f86d0 msgr2=0x7f31080faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:00.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.192+0000 7f31107ff700 1 -- 172.21.15.67:0/1954925806 shutdown_connections 2023-12-05T09:36:00.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.192+0000 7f31107ff700 1 -- 172.21.15.67:0/1954925806 wait complete. 2023-12-05T09:36:00.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.193+0000 7f31107ff700 1 Processor -- start 2023-12-05T09:36:00.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.193+0000 7f31107ff700 1 -- start start 2023-12-05T09:36:00.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f31107ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310806ffe0 0x7f31081154e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:00.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f31107ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 0x7f3108115a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:00.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f31107ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108116070 con 0x7f31080708f0 2023-12-05T09:36:00.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f31107ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310810f5b0 con 0x7f310806ffe0 2023-12-05T09:36:00.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f310dd9a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 0x7f3108115a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:00.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f310dd9a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 0x7f3108115a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48144/0 (socket says 172.21.15.67:48144) 2023-12-05T09:36:00.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f310dd9a700 1 -- 172.21.15.67:0/4292399720 learned_addr learned my addr 172.21.15.67:0/4292399720 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f310e59b700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310806ffe0 0x7f31081154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f310dd9a700 1 -- 172.21.15.67:0/4292399720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310806ffe0 msgr2=0x7f31081154e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f310dd9a700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310806ffe0 0x7f31081154e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.194+0000 7f310dd9a700 1 -- 172.21.15.67:0/4292399720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f8005040 con 0x7f31080708f0 2023-12-05T09:36:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.195+0000 7f310dd9a700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 0x7f3108115a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f30f8004f50 tx=0x7f30f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.195+0000 7f30feffd700 1 -- 172.21.15.67:0/4292399720 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f800e040 con 0x7f31080708f0 2023-12-05T09:36:00.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.195+0000 7f30feffd700 1 -- 172.21.15.67:0/4292399720 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f30f800bc10 con 0x7f31080708f0 2023-12-05T09:36:00.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.195+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310810f830 con 0x7f31080708f0 2023-12-05T09:36:00.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.195+0000 7f30feffd700 1 -- 172.21.15.67:0/4292399720 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f801c3f0 con 0x7f31080708f0 2023-12-05T09:36:00.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.195+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310810fd70 con 0x7f31080708f0 2023-12-05T09:36:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.196+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3108106510 con 0x7f31080708f0 2023-12-05T09:36:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.197+0000 7f30feffd700 1 -- 172.21.15.67:0/4292399720 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f30f8013420 con 0x7f31080708f0 2023-12-05T09:36:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.198+0000 7f30feffd700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f30f406ce70 0x7f30f406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.198+0000 7f30feffd700 1 -- 172.21.15.67:0/4292399720 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f30f808d710 con 0x7f31080708f0 2023-12-05T09:36:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.198+0000 7f310e59b700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f30f406ce70 0x7f30f406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:00.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.199+0000 7f310e59b700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f30f406ce70 0x7f30f406f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3104009fd0 tx=0x7f3104009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:00.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.203+0000 7f30feffd700 1 -- 172.21.15.67:0/4292399720 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f30f805b060 con 0x7f31080708f0 2023-12-05T09:36:00.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.413+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3108064730 con 0x7f31080708f0 2023-12-05T09:36:00.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.413+0000 7f30feffd700 1 -- 172.21.15.67:0/4292399720 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30f805abf0 con 0x7f31080708f0 2023-12-05T09:36:00.411 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-12-05T09:36:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.415+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f30f406ce70 msgr2=0x7f30f406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.415+0000 7f31107ff700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f30f406ce70 0x7f30f406f320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3104009fd0 tx=0x7f3104009f20 comp rx=0 tx=0).stop 2023-12-05T09:36:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.415+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 msgr2=0x7f3108115a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.415+0000 7f31107ff700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 0x7f3108115a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f30f8004f50 tx=0x7f30f8009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.416+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 shutdown_connections 2023-12-05T09:36:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.416+0000 7f31107ff700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310806ffe0 0x7f31081154e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.416+0000 7f31107ff700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f30f406ce70 0x7f30f406f320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.416+0000 7f31107ff700 1 --2- 172.21.15.67:0/4292399720 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31080708f0 0x7f3108115a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.416+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 >> 172.21.15.67:0/4292399720 conn(0x7f31080f86d0 msgr2=0x7f3108103690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:00.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.416+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 shutdown_connections 2023-12-05T09:36:00.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.416+0000 7f31107ff700 1 -- 172.21.15.67:0/4292399720 wait complete. 2023-12-05T09:36:00.433 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T09:36:00.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.636+0000 7f07dd5ff700 1 -- 172.21.15.67:0/2792064993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d81034e0 msgr2=0x7f07d80fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:00.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.636+0000 7f07dd5ff700 1 --2- 172.21.15.67:0/2792064993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d81034e0 0x7f07d80fcb50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07cc004940 tx=0x7f07cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:00.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.636+0000 7f07dd5ff700 1 -- 172.21.15.67:0/2792064993 shutdown_connections 2023-12-05T09:36:00.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.636+0000 7f07dd5ff700 1 --2- 172.21.15.67:0/2792064993 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d81034e0 0x7f07d80fcb50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.636+0000 7f07dd5ff700 1 --2- 172.21.15.67:0/2792064993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07d8102b40 0x7f07d8102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.636+0000 7f07dd5ff700 1 -- 172.21.15.67:0/2792064993 >> 172.21.15.67:0/2792064993 conn(0x7f07d80f86d0 msgr2=0x7f07d80faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:00.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.636+0000 7f07dd5ff700 1 -- 172.21.15.67:0/2792064993 shutdown_connections 2023-12-05T09:36:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.636+0000 7f07dd5ff700 1 -- 172.21.15.67:0/2792064993 wait complete. 2023-12-05T09:36:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.637+0000 7f07dd5ff700 1 Processor -- start 2023-12-05T09:36:00.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.637+0000 7f07dd5ff700 1 -- start start 2023-12-05T09:36:00.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.637+0000 7f07dd5ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d8102b40 0x7f07d8071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.637+0000 7f07dd5ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07d81034e0 0x7f07d806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.637+0000 7f07dd5ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8070590 con 0x7f07d8102b40 2023-12-05T09:36:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.637+0000 7f07dd5ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8070700 con 0x7f07d81034e0 2023-12-05T09:36:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.638+0000 7f07d6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d8102b40 0x7f07d8071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.638+0000 7f07d6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d8102b40 0x7f07d8071a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48170/0 (socket says 172.21.15.67:48170) 2023-12-05T09:36:00.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.638+0000 7f07d6ffd700 1 -- 172.21.15.67:0/721556522 learned_addr learned my addr 172.21.15.67:0/721556522 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.638+0000 7f07d67fc700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07d81034e0 0x7f07d806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.638+0000 7f07d6ffd700 1 -- 172.21.15.67:0/721556522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07d81034e0 msgr2=0x7f07d806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.638+0000 7f07d6ffd700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07d81034e0 0x7f07d806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.638+0000 7f07d6ffd700 1 -- 172.21.15.67:0/721556522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc005040 con 0x7f07d8102b40 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.638+0000 7f07d6ffd700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d8102b40 0x7f07d8071a90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07c8002a80 tx=0x7f07c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.639+0000 7f07bf7fe700 1 -- 172.21.15.67:0/721556522 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c8007cc0 con 0x7f07d8102b40 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.639+0000 7f07bf7fe700 1 -- 172.21.15.67:0/721556522 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f07c800f040 con 0x7f07d8102b40 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.639+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d80709e0 con 0x7f07d8102b40 2023-12-05T09:36:00.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.639+0000 7f07bf7fe700 1 -- 172.21.15.67:0/721556522 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07c800da60 con 0x7f07d8102b40 2023-12-05T09:36:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.639+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d811df40 con 0x7f07d8102b40 2023-12-05T09:36:00.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.640+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d8105010 con 0x7f07d8102b40 2023-12-05T09:36:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.641+0000 7f07bf7fe700 1 -- 172.21.15.67:0/721556522 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f07c800dbc0 con 0x7f07d8102b40 2023-12-05T09:36:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.642+0000 7f07bf7fe700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f07c006ce70 0x7f07c006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.642+0000 7f07bf7fe700 1 -- 172.21.15.67:0/721556522 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f07c808bf00 con 0x7f07d8102b40 2023-12-05T09:36:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.642+0000 7f07d67fc700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f07c006ce70 0x7f07c006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:00.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.643+0000 7f07d67fc700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f07c006ce70 0x7f07c006f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07d8071730 tx=0x7f07cc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:00.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.647+0000 7f07bf7fe700 1 -- 172.21.15.67:0/721556522 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f07c8059850 con 0x7f07d8102b40 2023-12-05T09:36:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.857+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f07d8071470 con 0x7f07d8102b40 2023-12-05T09:36:00.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.857+0000 7f07bf7fe700 1 -- 172.21.15.67:0/721556522 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v81) v1 ==== 107+0+11 (secure 0 0 0) 0x7f07c80593e0 con 0x7f07d8102b40 2023-12-05T09:36:00.856 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-12-05T09:36:00.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f07c006ce70 msgr2=0x7f07c006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:00.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f07c006ce70 0x7f07c006f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07d8071730 tx=0x7f07cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:00.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d8102b40 msgr2=0x7f07d8071a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d8102b40 0x7f07d8071a90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f07c8002a80 tx=0x7f07c80046b0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 shutdown_connections 2023-12-05T09:36:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f07c006ce70 0x7f07c006f320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07d8102b40 0x7f07d8071a90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 --2- 172.21.15.67:0/721556522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07d81034e0 0x7f07d806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 >> 172.21.15.67:0/721556522 conn(0x7f07d80f86d0 msgr2=0x7f07d80fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 shutdown_connections 2023-12-05T09:36:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:00.860+0000 7f07dd5ff700 1 -- 172.21.15.67:0/721556522 wait complete. 2023-12-05T09:36:00.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:00 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3054952505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:36:00.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:00 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/4292399720' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:36:00.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T09:36:00.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:00 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3054952505' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:36:00.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:00 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/4292399720' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:36:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.080+0000 7f43d6bff700 1 -- 172.21.15.67:0/1365882901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d0102b50 msgr2=0x7f43d0102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.080+0000 7f43d6bff700 1 --2- 172.21.15.67:0/1365882901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d0102b50 0x7f43d0102f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43c4004940 tx=0x7f43c4009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.081+0000 7f43d6bff700 1 -- 172.21.15.67:0/1365882901 shutdown_connections 2023-12-05T09:36:01.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.081+0000 7f43d6bff700 1 --2- 172.21.15.67:0/1365882901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d01034f0 0x7f43d00fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.081+0000 7f43d6bff700 1 --2- 172.21.15.67:0/1365882901 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d0102b50 0x7f43d0102f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.081+0000 7f43d6bff700 1 -- 172.21.15.67:0/1365882901 >> 172.21.15.67:0/1365882901 conn(0x7f43d00f8700 msgr2=0x7f43d00fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:01.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.081+0000 7f43d6bff700 1 -- 172.21.15.67:0/1365882901 shutdown_connections 2023-12-05T09:36:01.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.081+0000 7f43d6bff700 1 -- 172.21.15.67:0/1365882901 wait complete. 2023-12-05T09:36:01.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.081+0000 7f43d6bff700 1 Processor -- start 2023-12-05T09:36:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43d6bff700 1 -- start start 2023-12-05T09:36:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43d6bff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d0102b50 0x7f43d0113340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43d6bff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d01034f0 0x7f43d0113880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43d6bff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0113f60 con 0x7f43d01034f0 2023-12-05T09:36:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43d6bff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d010d3f0 con 0x7f43d0102b50 2023-12-05T09:36:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43cffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d01034f0 0x7f43d0113880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:01.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43cffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d01034f0 0x7f43d0113880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48184/0 (socket says 172.21.15.67:48184) 2023-12-05T09:36:01.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43cffff700 1 -- 172.21.15.67:0/2532169125 learned_addr learned my addr 172.21.15.67:0/2532169125 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:01.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.082+0000 7f43d499b700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d0102b50 0x7f43d0113340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:01.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.083+0000 7f43cffff700 1 -- 172.21.15.67:0/2532169125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d0102b50 msgr2=0x7f43d0113340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:01.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.083+0000 7f43cffff700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d0102b50 0x7f43d0113340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.083+0000 7f43cffff700 1 -- 172.21.15.67:0/2532169125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4005040 con 0x7f43d01034f0 2023-12-05T09:36:01.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.083+0000 7f43cffff700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d01034f0 0x7f43d0113880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00b790 tx=0x7f43bc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:01.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.083+0000 7f43cd7fa700 1 -- 172.21.15.67:0/2532169125 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43bc00f6f0 con 0x7f43d01034f0 2023-12-05T09:36:01.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.083+0000 7f43cd7fa700 1 -- 172.21.15.67:0/2532169125 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43bc00fd00 con 0x7f43d01034f0 2023-12-05T09:36:01.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.083+0000 7f43cd7fa700 1 -- 172.21.15.67:0/2532169125 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43bc0103a0 con 0x7f43d01034f0 2023-12-05T09:36:01.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.083+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d010d670 con 0x7f43d01034f0 2023-12-05T09:36:01.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.084+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d010dc30 con 0x7f43d01034f0 2023-12-05T09:36:01.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.084+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d00ffe60 con 0x7f43d01034f0 2023-12-05T09:36:01.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.086+0000 7f43cd7fa700 1 -- 172.21.15.67:0/2532169125 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f43bc00f850 con 0x7f43d01034f0 2023-12-05T09:36:01.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.087+0000 7f43cd7fa700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f43c006ce70 0x7f43c006f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:01.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.087+0000 7f43cd7fa700 1 -- 172.21.15.67:0/2532169125 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f43bc08c090 con 0x7f43d01034f0 2023-12-05T09:36:01.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.087+0000 7f43d499b700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f43c006ce70 0x7f43c006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:01.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.088+0000 7f43d499b700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f43c006ce70 0x7f43c006f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b3b0 tx=0x7f43c4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:01.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.092+0000 7f43cd7fa700 1 -- 172.21.15.67:0/2532169125 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f43bc059a60 con 0x7f43d01034f0 2023-12-05T09:36:01.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.300+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f43d010e920 con 0x7f43d01034f0 2023-12-05T09:36:01.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.300+0000 7f43cd7fa700 1 -- 172.21.15.67:0/2532169125 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v81) v1 ==== 107+0+11 (secure 0 0 0) 0x7f43bc0595f0 con 0x7f43d01034f0 2023-12-05T09:36:01.299 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-12-05T09:36:01.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f43c006ce70 msgr2=0x7f43c006f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:01.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f43c006ce70 0x7f43c006f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b3b0 tx=0x7f43c4009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:01.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d01034f0 msgr2=0x7f43d0113880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:01.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d01034f0 0x7f43d0113880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00b790 tx=0x7f43bc009220 comp rx=0 tx=0).stop 2023-12-05T09:36:01.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 shutdown_connections 2023-12-05T09:36:01.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43d0102b50 0x7f43d0113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f43c006ce70 0x7f43c006f320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 --2- 172.21.15.67:0/2532169125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43d01034f0 0x7f43d0113880 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 >> 172.21.15.67:0/2532169125 conn(0x7f43d00f8700 msgr2=0x7f43d00fa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:01.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 shutdown_connections 2023-12-05T09:36:01.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.303+0000 7f43d6bff700 1 -- 172.21.15.67:0/2532169125 wait complete. 2023-12-05T09:36:01.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-05T09:36:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.522+0000 7f78c0fff700 1 -- 172.21.15.67:0/1872785208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 msgr2=0x7f78bc102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.522+0000 7f78c0fff700 1 --2- 172.21.15.67:0/1872785208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 0x7f78bc102f10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f78ac004940 tx=0x7f78ac009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.522+0000 7f78c0fff700 1 -- 172.21.15.67:0/1872785208 shutdown_connections 2023-12-05T09:36:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.522+0000 7f78c0fff700 1 --2- 172.21.15.67:0/1872785208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78bc1034e0 0x7f78bc0fcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.522+0000 7f78c0fff700 1 --2- 172.21.15.67:0/1872785208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 0x7f78bc102f10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.522+0000 7f78c0fff700 1 -- 172.21.15.67:0/1872785208 >> 172.21.15.67:0/1872785208 conn(0x7f78bc0f86d0 msgr2=0x7f78bc0faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.522+0000 7f78c0fff700 1 -- 172.21.15.67:0/1872785208 shutdown_connections 2023-12-05T09:36:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.522+0000 7f78c0fff700 1 -- 172.21.15.67:0/1872785208 wait complete. 2023-12-05T09:36:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.523+0000 7f78c0fff700 1 Processor -- start 2023-12-05T09:36:01.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.523+0000 7f78c0fff700 1 -- start start 2023-12-05T09:36:01.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.523+0000 7f78c0fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 0x7f78bc115590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:01.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.523+0000 7f78c0fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78bc1034e0 0x7f78bc115ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:01.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.523+0000 7f78c0fff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc116120 con 0x7f78bc102b40 2023-12-05T09:36:01.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.523+0000 7f78c0fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc10f660 con 0x7f78bc1034e0 2023-12-05T09:36:01.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78ba59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 0x7f78bc115590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:01.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78ba59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 0x7f78bc115590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48196/0 (socket says 172.21.15.67:48196) 2023-12-05T09:36:01.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78ba59c700 1 -- 172.21.15.67:0/2108231245 learned_addr learned my addr 172.21.15.67:0/2108231245 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:01.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78b9d9b700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78bc1034e0 0x7f78bc115ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:01.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78ba59c700 1 -- 172.21.15.67:0/2108231245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78bc1034e0 msgr2=0x7f78bc115ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:01.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78ba59c700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78bc1034e0 0x7f78bc115ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78ba59c700 1 -- 172.21.15.67:0/2108231245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac005040 con 0x7f78bc102b40 2023-12-05T09:36:01.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78ba59c700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 0x7f78bc115590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009360 tx=0x7f78ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:01.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78aaffd700 1 -- 172.21.15.67:0/2108231245 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ac00e040 con 0x7f78bc102b40 2023-12-05T09:36:01.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78aaffd700 1 -- 172.21.15.67:0/2108231245 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f78ac00bc50 con 0x7f78bc102b40 2023-12-05T09:36:01.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc10f8e0 con 0x7f78bc102b40 2023-12-05T09:36:01.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.524+0000 7f78aaffd700 1 -- 172.21.15.67:0/2108231245 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78ac01c630 con 0x7f78bc102b40 2023-12-05T09:36:01.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.525+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc10fea0 con 0x7f78bc102b40 2023-12-05T09:36:01.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.526+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc064730 con 0x7f78bc102b40 2023-12-05T09:36:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.527+0000 7f78aaffd700 1 -- 172.21.15.67:0/2108231245 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f78ac013420 con 0x7f78bc102b40 2023-12-05T09:36:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.528+0000 7f78aaffd700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f78a406ce70 0x7f78a406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.528+0000 7f78aaffd700 1 -- 172.21.15.67:0/2108231245 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f78ac08d580 con 0x7f78bc102b40 2023-12-05T09:36:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.528+0000 7f78b9d9b700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f78a406ce70 0x7f78a406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:01.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.528+0000 7f78b9d9b700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f78a406ce70 0x7f78a406f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009fd0 tx=0x7f78b0009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:01.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.532+0000 7f78aaffd700 1 -- 172.21.15.67:0/2108231245 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f78ac05af50 con 0x7f78bc102b40 2023-12-05T09:36:01.617 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:01 smithi067 ceph-mon[210894]: pgmap v198: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:36:01.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:01 smithi067 ceph-mon[210894]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:36:01.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:01 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/721556522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T09:36:01.618 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:01 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/2532169125' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T09:36:01.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.759+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78bc110110 con 0x7f78bc102b40 2023-12-05T09:36:01.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.760+0000 7f78aaffd700 1 -- 172.21.15.67:0/2108231245 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v81) v1 ==== 81+0+2190 (secure 0 0 0) 0x7f78ac05aae0 con 0x7f78bc102b40 2023-12-05T09:36:01.758 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/3637826020 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:01.758 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/4207254869 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:01.758 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/2543364948 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:01.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/3666384983 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:01.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/266329309 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:01.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/181843478 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:01.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2057389438 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:01.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:6825/3151035948 2023-12-06T09:23:40.978176+0000 2023-12-05T09:36:01.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/3832644508 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:01.759 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/1356443197 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:01.761 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:6824/3151035948 2023-12-06T09:23:40.978176+0000 2023-12-05T09:36:01.761 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/3666384983 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:01.761 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3210428255 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:01.762 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3864088954 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:01.762 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2190646552 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:01.762 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/29053483 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:01.762 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/434315882 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:01.762 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2132118036 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:01.762 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3434626511 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/567071518 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/2543364948 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2889018783 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2936759595 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/434315882 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/1356443197 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3189096558 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/4223108820 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:01.763 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:6828/1604582340 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/1134257028 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/440859058 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:6829/1604582340 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/2478780622 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/2776807637 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3754244083 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3415963237 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/3637826020 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:01.764 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/1060895899 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.762+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f78a406ce70 msgr2=0x7f78a406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.762+0000 7f78c0fff700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f78a406ce70 0x7f78a406f320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009fd0 tx=0x7f78b0009f20 comp rx=0 tx=0).stop 2023-12-05T09:36:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.762+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 msgr2=0x7f78bc115590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.762+0000 7f78c0fff700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 0x7f78bc115590 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009360 tx=0x7f78ac009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.763+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 shutdown_connections 2023-12-05T09:36:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.763+0000 7f78c0fff700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f78a406ce70 0x7f78a406f320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.763+0000 7f78c0fff700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78bc102b40 0x7f78bc115590 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.763+0000 7f78c0fff700 1 --2- 172.21.15.67:0/2108231245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78bc1034e0 0x7f78bc115ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.763+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 >> 172.21.15.67:0/2108231245 conn(0x7f78bc0f86d0 msgr2=0x7f78bc0fa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.763+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 shutdown_connections 2023-12-05T09:36:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:01.763+0000 7f78c0fff700 1 -- 172.21.15.67:0/2108231245 wait complete. 2023-12-05T09:36:01.769 INFO:teuthology.orchestra.run.smithi067.stderr:listed 37 entries 2023-12-05T09:36:01.779 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-05T09:36:01.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:01.779 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-05T09:36:01.858 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:36:01.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:01.858 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-05T09:36:01.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:01 smithi134 ceph-mon[172895]: pgmap v198: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:36:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:01 smithi134 ceph-mon[172895]: from='mgr.34104 172.21.15.67:0/3902382003' entity='mgr.smithi067.alxtvv' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-05T09:36:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:01 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/721556522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T09:36:01.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:01 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/2532169125' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T09:36:01.946 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:36:01.946 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T09:36:02.055 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-05T09:36:02.055 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-05T09:36:02.153 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-05T09:36:02.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.356+0000 7f59a07ff700 1 -- 172.21.15.67:0/4185263343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5998070870 msgr2=0x7f5998108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:02.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.356+0000 7f59a07ff700 1 --2- 172.21.15.67:0/4185263343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5998070870 0x7f5998108e30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5988004940 tx=0x7f5988009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:02.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.356+0000 7f59a07ff700 1 -- 172.21.15.67:0/4185263343 shutdown_connections 2023-12-05T09:36:02.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.356+0000 7f59a07ff700 1 --2- 172.21.15.67:0/4185263343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5998070870 0x7f5998108e30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.356+0000 7f59a07ff700 1 --2- 172.21.15.67:0/4185263343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f599806ff60 0x7f5998070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.356+0000 7f59a07ff700 1 -- 172.21.15.67:0/4185263343 >> 172.21.15.67:0/4185263343 conn(0x7f59980f8630 msgr2=0x7f59980faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:02.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.356+0000 7f59a07ff700 1 -- 172.21.15.67:0/4185263343 shutdown_connections 2023-12-05T09:36:02.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.356+0000 7f59a07ff700 1 -- 172.21.15.67:0/4185263343 wait complete. 2023-12-05T09:36:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.357+0000 7f59a07ff700 1 Processor -- start 2023-12-05T09:36:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.357+0000 7f59a07ff700 1 -- start start 2023-12-05T09:36:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.357+0000 7f59a07ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f599806ff60 0x7f5998115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:02.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.357+0000 7f59a07ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5998070870 0x7f5998115950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.357+0000 7f59a07ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998115fa0 con 0x7f599806ff60 2023-12-05T09:36:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.357+0000 7f59a07ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599810f500 con 0x7f5998070870 2023-12-05T09:36:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.357+0000 7f599e59b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f599806ff60 0x7f5998115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f599e59b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f599806ff60 0x7f5998115410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48220/0 (socket says 172.21.15.67:48220) 2023-12-05T09:36:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f599e59b700 1 -- 172.21.15.67:0/1580882059 learned_addr learned my addr 172.21.15.67:0/1580882059 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f599dd9a700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5998070870 0x7f5998115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f599e59b700 1 -- 172.21.15.67:0/1580882059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5998070870 msgr2=0x7f5998115950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:02.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f599e59b700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5998070870 0x7f5998115950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f599e59b700 1 -- 172.21.15.67:0/1580882059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5988005040 con 0x7f599806ff60 2023-12-05T09:36:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f599e59b700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f599806ff60 0x7f5998115410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f599400eb70 tx=0x7f599400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f598effd700 1 -- 172.21.15.67:0/1580882059 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5994007cc0 con 0x7f599806ff60 2023-12-05T09:36:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f598effd700 1 -- 172.21.15.67:0/1580882059 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f599400f040 con 0x7f599806ff60 2023-12-05T09:36:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f598effd700 1 -- 172.21.15.67:0/1580882059 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59940095f0 con 0x7f599806ff60 2023-12-05T09:36:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.358+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599810f780 con 0x7f599806ff60 2023-12-05T09:36:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.359+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599810fcc0 con 0x7f599806ff60 2023-12-05T09:36:02.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.360+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59981064f0 con 0x7f599806ff60 2023-12-05T09:36:02.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.361+0000 7f598effd700 1 -- 172.21.15.67:0/1580882059 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f5994009750 con 0x7f599806ff60 2023-12-05T09:36:02.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.362+0000 7f598effd700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f598406ce70 0x7f598406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:02.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.362+0000 7f598effd700 1 -- 172.21.15.67:0/1580882059 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f599408bfe0 con 0x7f599806ff60 2023-12-05T09:36:02.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.362+0000 7f599dd9a700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f598406ce70 0x7f598406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:02.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.363+0000 7f599dd9a700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f598406ce70 0x7f598406f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f598800b0d0 tx=0x7f5988009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:02.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.367+0000 7f598effd700 1 -- 172.21.15.67:0/1580882059 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5994055e40 con 0x7f599806ff60 2023-12-05T09:36:02.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.585+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5998110ad0 con 0x7f599806ff60 2023-12-05T09:36:02.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.586+0000 7f598effd700 1 -- 172.21.15.67:0/1580882059 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16404 (secure 0 0 0) 0x7f5994059460 con 0x7f599806ff60 2023-12-05T09:36:02.585 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-12-05T09:36:02.585 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":81,"fsid":"f6a41352-934e-11ee-95a2-87774f69a715","created":"2023-12-05T09:17:21.700862+0000","modified":"2023-12-05T09:34:34.829780+0000","last_up_change":"2023-12-05T09:34:33.827519+0000","last_in_change":"2023-12-05T09:22:09.939138+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-05T09:21:24.629667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-05T09:23:26.505239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-05T09:23:27.500572+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"73d6a29a-57c6-4943-9a9b-1bb55401f054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":51,"up_from":55,"up_thru":80,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2109297054},{"type":"v1","addr":"172.21.15.67:6803","nonce":2109297054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2109297054},{"type":"v1","addr":"172.21.15.67:6805","nonce":2109297054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2109297054},{"type":"v1","addr":"172.21.15.67:6809","nonce":2109297054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2109297054},{"type":"v1","addr":"172.21.15.67:6807","nonce":2109297054}]},"public_addr":"172.21.15.67:6803/2109297054","cluster_addr":"172.21.15.67:6805/2109297054","heartbeat_back_addr":"172.21.15.67:6809/2109297054","heartbeat_front_addr":"172.21.15.67:6807/2109297054","state":["exists","up"]},{"osd":1,"uuid":"21d6b362-1d8c-4508-b7df-5a156074fc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":56,"up_from":60,"up_thru":80,"down_at":57,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":95427693},{"type":"v1","addr":"172.21.15.67:6811","nonce":95427693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":95427693},{"type":"v1","addr":"172.21.15.67:6813","nonce":95427693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":95427693},{"type":"v1","addr":"172.21.15.67:6817","nonce":95427693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":95427693},{"type":"v1","addr":"172.21.15.67:6815","nonce":95427693}]},"public_addr":"172.21.15.67:6811/95427693","cluster_addr":"172.21.15.67:6813/95427693","heartbeat_back_addr":"172.21.15.67:6817/95427693","heartbeat_front_addr":"172.21.15.67:6815/95427693","state":["exists","up"]},{"osd":2,"uuid":"214bcc5f-be74-4b12-b23e-c325bae6a18f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":61,"up_from":65,"up_thru":80,"down_at":62,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":4278620943},{"type":"v1","addr":"172.21.15.67:6819","nonce":4278620943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":4278620943},{"type":"v1","addr":"172.21.15.67:6821","nonce":4278620943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":4278620943},{"type":"v1","addr":"172.21.15.67:6825","nonce":4278620943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":4278620943},{"type":"v1","addr":"172.21.15.67:6823","nonce":4278620943}]},"public_addr":"172.21.15.67:6819/4278620943","cluster_addr":"172.21.15.67:6821/4278620943","heartbeat_back_addr":"172.21.15.67:6825/4278620943","heartbeat_front_addr":"172.21.15.67:6823/4278620943","state":["exists","up"]},{"osd":3,"uuid":"6bce7967-b081-4a08-ac54-9552edf45ca4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":66,"up_from":70,"up_thru":80,"down_at":67,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":4075414049},{"type":"v1","addr":"172.21.15.134:6801","nonce":4075414049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":4075414049},{"type":"v1","addr":"172.21.15.134:6803","nonce":4075414049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":4075414049},{"type":"v1","addr":"172.21.15.134:6807","nonce":4075414049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":4075414049},{"type":"v1","addr":"172.21.15.134:6805","nonce":4075414049}]},"public_addr":"172.21.15.134:6801/4075414049","cluster_addr":"172.21.15.134:6803/4075414049","heartbeat_back_addr":"172.21.15.134:6807/4075414049","heartbeat_front_addr":"172.21.15.134:6805/4075414049","state":["exists","up"]},{"osd":4,"uuid":"5d1c05dc-2b50-493a-9e5e-d0b16d911091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":71,"up_from":75,"up_thru":80,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3391162370},{"type":"v1","addr":"172.21.15.134:6809","nonce":3391162370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3391162370},{"type":"v1","addr":"172.21.15.134:6811","nonce":3391162370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3391162370},{"type":"v1","addr":"172.21.15.134:6815","nonce":3391162370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3391162370},{"type":"v1","addr":"172.21.15.134:6813","nonce":3391162370}]},"public_addr":"172.21.15.134:6809/3391162370","cluster_addr":"172.21.15.134:6811/3391162370","heartbeat_back_addr":"172.21.15.134:6815/3391162370","heartbeat_front_addr":"172.21.15.134:6813/3391162370","state":["exists","up"]},{"osd":5,"uuid":"43ae157e-59ef-448e-b33f-5ebfadf73ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":76,"up_from":80,"up_thru":80,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":867837745},{"type":"v1","addr":"172.21.15.134:6817","nonce":867837745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":867837745},{"type":"v1","addr":"172.21.15.134:6819","nonce":867837745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":867837745},{"type":"v1","addr":"172.21.15.134:6823","nonce":867837745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":867837745},{"type":"v1","addr":"172.21.15.134:6821","nonce":867837745}]},"public_addr":"172.21.15.134:6817/867837745","cluster_addr":"172.21.15.134:6819/867837745","heartbeat_back_addr":"172.21.15.134:6823/867837745","heartbeat_front_addr":"172.21.15.134:6821/867837745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:30.796950+0000","dead_epoch":51},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:20:55.649954+0000","dead_epoch":56},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:20.496287+0000","dead_epoch":61},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:21:41.995990+0000","dead_epoch":66},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:04.343494+0000","dead_epoch":71},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-05T09:22:26.824683+0000","dead_epoch":76}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.67:6801/3637826020":"2023-12-06T09:30:30.716180+0000","172.21.15.67:0/4207254869":"2023-12-06T09:25:33.288852+0000","172.21.15.67:6801/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:6801/3666384983":"2023-12-06T09:25:33.288852+0000","172.21.15.67:0/266329309":"2023-12-06T09:19:26.041323+0000","172.21.15.134:0/181843478":"2023-12-06T09:27:04.474771+0000","172.21.15.67:0/2057389438":"2023-12-06T09:17:56.446884+0000","172.21.15.134:6825/3151035948":"2023-12-06T09:23:40.978176+0000","172.21.15.134:0/3832644508":"2023-12-06T09:27:04.474771+0000","172.21.15.67:6801/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.134:6824/3151035948":"2023-12-06T09:23:40.978176+0000","172.21.15.67:6800/3666384983":"2023-12-06T09:25:33.288852+0000","172.21.15.67:0/3210428255":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/3864088954":"2023-12-06T09:25:33.288852+0000","172.21.15.67:0/2190646552":"2023-12-06T09:17:56.446884+0000","172.21.15.134:0/29053483":"2023-12-06T09:27:04.474771+0000","172.21.15.67:6801/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:0/2132118036":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/3434626511":"2023-12-06T09:19:26.041323+0000","172.21.15.134:0/567071518":"2023-12-06T09:27:04.474771+0000","172.21.15.67:6800/2543364948":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/2889018783":"2023-12-06T09:30:30.716180+0000","172.21.15.67:0/2936759595":"2023-12-06T09:25:33.288852+0000","172.21.15.67:6800/434315882":"2023-12-06T09:19:26.041323+0000","172.21.15.67:6800/1356443197":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/3189096558":"2023-12-06T09:17:56.446884+0000","172.21.15.67:0/4223108820":"2023-12-06T09:30:30.716180+0000","172.21.15.134:6828/1604582340":"2023-12-06T09:27:04.474771+0000","172.21.15.67:0/1134257028":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/440859058":"2023-12-06T09:25:33.288852+0000","172.21.15.134:6829/1604582340":"2023-12-06T09:27:04.474771+0000","172.21.15.134:0/2478780622":"2023-12-06T09:27:04.474771+0000","172.21.15.134:0/2776807637":"2023-12-06T09:27:04.474771+0000","172.21.15.67:0/3754244083":"2023-12-06T09:18:23.902584+0000","172.21.15.67:0/3415963237":"2023-12-06T09:30:30.716180+0000","172.21.15.67:6800/3637826020":"2023-12-06T09:30:30.716180+0000","172.21.15.67:0/1060895899":"2023-12-06T09:30:30.716180+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-05T09:36:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f598406ce70 msgr2=0x7f598406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f598406ce70 0x7f598406f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f598800b0d0 tx=0x7f5988009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f599806ff60 msgr2=0x7f5998115410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f599806ff60 0x7f5998115410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f599400eb70 tx=0x7f599400b040 comp rx=0 tx=0).stop 2023-12-05T09:36:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 shutdown_connections 2023-12-05T09:36:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f598406ce70 0x7f598406f320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f599806ff60 0x7f5998115410 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 --2- 172.21.15.67:0/1580882059 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5998070870 0x7f5998115950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 >> 172.21.15.67:0/1580882059 conn(0x7f59980f8630 msgr2=0x7f5998103670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:02.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 shutdown_connections 2023-12-05T09:36:02.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.589+0000 7f59a07ff700 1 -- 172.21.15.67:0/1580882059 wait complete. 2023-12-05T09:36:02.603 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:02 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/2108231245' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T09:36:02.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-05T09:21:24.629667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-05T09:23:26.505239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-05T09:23:27.500572+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-05T09:36:02.606 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-05T09:36:02.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.810+0000 7f40645ff700 1 -- 172.21.15.67:0/2780521347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c1034e0 msgr2=0x7f405c0fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.810+0000 7f40645ff700 1 --2- 172.21.15.67:0/2780521347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c1034e0 0x7f405c0fcb50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f404c004940 tx=0x7f404c009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.810+0000 7f40645ff700 1 -- 172.21.15.67:0/2780521347 shutdown_connections 2023-12-05T09:36:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.810+0000 7f40645ff700 1 --2- 172.21.15.67:0/2780521347 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c1034e0 0x7f405c0fcb50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.810+0000 7f40645ff700 1 --2- 172.21.15.67:0/2780521347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f405c102b40 0x7f405c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.810+0000 7f40645ff700 1 -- 172.21.15.67:0/2780521347 >> 172.21.15.67:0/2780521347 conn(0x7f405c0f86d0 msgr2=0x7f405c0faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:02.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.810+0000 7f40645ff700 1 -- 172.21.15.67:0/2780521347 shutdown_connections 2023-12-05T09:36:02.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.810+0000 7f40645ff700 1 -- 172.21.15.67:0/2780521347 wait complete. 2023-12-05T09:36:02.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.811+0000 7f40645ff700 1 Processor -- start 2023-12-05T09:36:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.811+0000 7f40645ff700 1 -- start start 2023-12-05T09:36:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.811+0000 7f40645ff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c102b40 0x7f405c115540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.811+0000 7f40645ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f405c1034e0 0x7f405c115a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.811+0000 7f40645ff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c1160d0 con 0x7f405c102b40 2023-12-05T09:36:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.811+0000 7f40645ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c10f610 con 0x7f405c1034e0 2023-12-05T09:36:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f406239b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c102b40 0x7f405c115540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:02.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f406239b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c102b40 0x7f405c115540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48238/0 (socket says 172.21.15.67:48238) 2023-12-05T09:36:02.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f406239b700 1 -- 172.21.15.67:0/2106392700 learned_addr learned my addr 172.21.15.67:0/2106392700 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:02.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f4061b9a700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f405c1034e0 0x7f405c115a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:02.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f406239b700 1 -- 172.21.15.67:0/2106392700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f405c1034e0 msgr2=0x7f405c115a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:02.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f406239b700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f405c1034e0 0x7f405c115a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:02.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f406239b700 1 -- 172.21.15.67:0/2106392700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c005040 con 0x7f405c102b40 2023-12-05T09:36:02.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f406239b700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c102b40 0x7f405c115540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4058002a50 tx=0x7f40580046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:02.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.812+0000 7f4052ffd700 1 -- 172.21.15.67:0/2106392700 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4058007cc0 con 0x7f405c102b40 2023-12-05T09:36:02.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.813+0000 7f4052ffd700 1 -- 172.21.15.67:0/2106392700 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f405800f040 con 0x7f405c102b40 2023-12-05T09:36:02.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.813+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c10f8f0 con 0x7f405c102b40 2023-12-05T09:36:02.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.813+0000 7f4052ffd700 1 -- 172.21.15.67:0/2106392700 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405800d9c0 con 0x7f405c102b40 2023-12-05T09:36:02.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.813+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c10fe80 con 0x7f405c102b40 2023-12-05T09:36:02.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.814+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c064730 con 0x7f405c102b40 2023-12-05T09:36:02.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.815+0000 7f4052ffd700 1 -- 172.21.15.67:0/2106392700 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f405800db20 con 0x7f405c102b40 2023-12-05T09:36:02.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.816+0000 7f4052ffd700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f404806ce70 0x7f404806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:02.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.816+0000 7f4052ffd700 1 -- 172.21.15.67:0/2106392700 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f405808c0a0 con 0x7f405c102b40 2023-12-05T09:36:02.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.816+0000 7f4061b9a700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f404806ce70 0x7f404806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:02.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.816+0000 7f4061b9a700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f404806ce70 0x7f404806f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f405c110940 tx=0x7f404c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:02.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:02.820+0000 7f4052ffd700 1 -- 172.21.15.67:0/2106392700 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4058059970 con 0x7f405c102b40 2023-12-05T09:36:02.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:02 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/2108231245' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T09:36:03.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.032+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f405c1100a0 con 0x7f405c102b40 2023-12-05T09:36:03.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.032+0000 7f4052ffd700 1 -- 172.21.15.67:0/2106392700 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4058059500 con 0x7f405c102b40 2023-12-05T09:36:03.031 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-12-05T09:36:03.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f404806ce70 msgr2=0x7f404806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f404806ce70 0x7f404806f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f405c110940 tx=0x7f404c009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:03.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c102b40 msgr2=0x7f405c115540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c102b40 0x7f405c115540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4058002a50 tx=0x7f40580046b0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 shutdown_connections 2023-12-05T09:36:03.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f404806ce70 0x7f404806f320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f405c102b40 0x7f405c115540 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 --2- 172.21.15.67:0/2106392700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f405c1034e0 0x7f405c115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 >> 172.21.15.67:0/2106392700 conn(0x7f405c0f86d0 msgr2=0x7f405c0fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:03.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 shutdown_connections 2023-12-05T09:36:03.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.035+0000 7f40645ff700 1 -- 172.21.15.67:0/2106392700 wait complete. 2023-12-05T09:36:03.051 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-05T09:36:03.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.255+0000 7f7134dff700 1 -- 172.21.15.67:0/523347032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 msgr2=0x7f71300fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.255+0000 7f7134dff700 1 --2- 172.21.15.67:0/523347032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 0x7f71300fcb50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7124004940 tx=0x7f7124009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.255+0000 7f7134dff700 1 -- 172.21.15.67:0/523347032 shutdown_connections 2023-12-05T09:36:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.255+0000 7f7134dff700 1 --2- 172.21.15.67:0/523347032 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 0x7f71300fcb50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.255+0000 7f7134dff700 1 --2- 172.21.15.67:0/523347032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7130102b40 0x7f7130102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.255+0000 7f7134dff700 1 -- 172.21.15.67:0/523347032 >> 172.21.15.67:0/523347032 conn(0x7f71300f86d0 msgr2=0x7f71300faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.255+0000 7f7134dff700 1 -- 172.21.15.67:0/523347032 shutdown_connections 2023-12-05T09:36:03.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.255+0000 7f7134dff700 1 -- 172.21.15.67:0/523347032 wait complete. 2023-12-05T09:36:03.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.256+0000 7f7134dff700 1 Processor -- start 2023-12-05T09:36:03.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.256+0000 7f7134dff700 1 -- start start 2023-12-05T09:36:03.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.256+0000 7f7134dff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7130102b40 0x7f713006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:03.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.256+0000 7f7134dff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 0x7f7130070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:03.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.256+0000 7f7134dff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130071f30 con 0x7f71301034e0 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.256+0000 7f7134dff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300709f0 con 0x7f7130102b40 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f712dd9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 0x7f7130070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f712dd9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 0x7f7130070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48248/0 (socket says 172.21.15.67:48248) 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f712dd9b700 1 -- 172.21.15.67:0/2053311675 learned_addr learned my addr 172.21.15.67:0/2053311675 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f712e59c700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7130102b40 0x7f713006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f712dd9b700 1 -- 172.21.15.67:0/2053311675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7130102b40 msgr2=0x7f713006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f712dd9b700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7130102b40 0x7f713006ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f712dd9b700 1 -- 172.21.15.67:0/2053311675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124005040 con 0x7f71301034e0 2023-12-05T09:36:03.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f712dd9b700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 0x7f7130070480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7124009180 tx=0x7f7124009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.257+0000 7f711effd700 1 -- 172.21.15.67:0/2053311675 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712400e040 con 0x7f71301034e0 2023-12-05T09:36:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.258+0000 7f711effd700 1 -- 172.21.15.67:0/2053311675 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7124004290 con 0x7f71301034e0 2023-12-05T09:36:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.258+0000 7f711effd700 1 -- 172.21.15.67:0/2053311675 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712401c3f0 con 0x7f71301034e0 2023-12-05T09:36:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.258+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7130070c70 con 0x7f71301034e0 2023-12-05T09:36:03.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.258+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7130119a00 con 0x7f71301034e0 2023-12-05T09:36:03.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.259+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7130105010 con 0x7f71301034e0 2023-12-05T09:36:03.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.260+0000 7f711effd700 1 -- 172.21.15.67:0/2053311675 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f712400bc50 con 0x7f71301034e0 2023-12-05T09:36:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.261+0000 7f711effd700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f711806ce70 0x7f711806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.261+0000 7f711effd700 1 -- 172.21.15.67:0/2053311675 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f712408d5f0 con 0x7f71301034e0 2023-12-05T09:36:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.262+0000 7f712e59c700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f711806ce70 0x7f711806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:03.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.262+0000 7f712e59c700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f711806ce70 0x7f711806f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7120009fd0 tx=0x7f7120009f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:03.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.266+0000 7f711effd700 1 -- 172.21.15.67:0/2053311675 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f71240575e0 con 0x7f71301034e0 2023-12-05T09:36:03.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.478+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f7130109af0 con 0x7f71301034e0 2023-12-05T09:36:03.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.478+0000 7f711effd700 1 -- 172.21.15.67:0/2053311675 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v81) v1 ==== 107+0+11 (secure 0 0 0) 0x7f712405ac00 con 0x7f71301034e0 2023-12-05T09:36:03.476 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-12-05T09:36:03.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f711806ce70 msgr2=0x7f711806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f711806ce70 0x7f711806f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7120009fd0 tx=0x7f7120009f20 comp rx=0 tx=0).stop 2023-12-05T09:36:03.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 msgr2=0x7f7130070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 0x7f7130070480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7124009180 tx=0x7f7124009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:03.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 shutdown_connections 2023-12-05T09:36:03.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7130102b40 0x7f713006ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f711806ce70 0x7f711806f320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 --2- 172.21.15.67:0/2053311675 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f71301034e0 0x7f7130070480 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 >> 172.21.15.67:0/2053311675 conn(0x7f71300f86d0 msgr2=0x7f71300fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:03.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 shutdown_connections 2023-12-05T09:36:03.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.481+0000 7f7134dff700 1 -- 172.21.15.67:0/2053311675 wait complete. 2023-12-05T09:36:03.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-05T09:36:03.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.704+0000 7f42a8fff700 1 -- 172.21.15.67:0/2482589494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 msgr2=0x7f42a40fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.704+0000 7f42a8fff700 1 --2- 172.21.15.67:0/2482589494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 0x7f42a40fcb50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4298004940 tx=0x7f4298009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:03.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.705+0000 7f42a8fff700 1 -- 172.21.15.67:0/2482589494 shutdown_connections 2023-12-05T09:36:03.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.705+0000 7f42a8fff700 1 --2- 172.21.15.67:0/2482589494 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 0x7f42a40fcb50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.705+0000 7f42a8fff700 1 --2- 172.21.15.67:0/2482589494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a4102b40 0x7f42a4102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.705+0000 7f42a8fff700 1 -- 172.21.15.67:0/2482589494 >> 172.21.15.67:0/2482589494 conn(0x7f42a40f86d0 msgr2=0x7f42a40faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:03.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.705+0000 7f42a8fff700 1 -- 172.21.15.67:0/2482589494 shutdown_connections 2023-12-05T09:36:03.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.705+0000 7f42a8fff700 1 -- 172.21.15.67:0/2482589494 wait complete. 2023-12-05T09:36:03.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.705+0000 7f42a8fff700 1 Processor -- start 2023-12-05T09:36:03.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a8fff700 1 -- start start 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a8fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a4102b40 0x7f42a406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a8fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 0x7f42a4070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a8fff700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40709c0 con 0x7f42a41034e0 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a8fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a4070b00 con 0x7f42a4102b40 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a1d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 0x7f42a4070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a1d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 0x7f42a4070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48266/0 (socket says 172.21.15.67:48266) 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a1d9b700 1 -- 172.21.15.67:0/3913959164 learned_addr learned my addr 172.21.15.67:0/3913959164 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.706+0000 7f42a259c700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a4102b40 0x7f42a406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:03.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f42a1d9b700 1 -- 172.21.15.67:0/3913959164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a4102b40 msgr2=0x7f42a406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f42a1d9b700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a4102b40 0x7f42a406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f42a1d9b700 1 -- 172.21.15.67:0/3913959164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298005040 con 0x7f42a41034e0 2023-12-05T09:36:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f42a1d9b700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 0x7f42a4070480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4298009360 tx=0x7f4298009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f4292ffd700 1 -- 172.21.15.67:0/3913959164 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f429800e040 con 0x7f42a41034e0 2023-12-05T09:36:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f4292ffd700 1 -- 172.21.15.67:0/3913959164 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4298013420 con 0x7f42a41034e0 2023-12-05T09:36:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f4292ffd700 1 -- 172.21.15.67:0/3913959164 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f429801c610 con 0x7f42a41034e0 2023-12-05T09:36:03.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a4070d80 con 0x7f42a41034e0 2023-12-05T09:36:03.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.707+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a4119a90 con 0x7f42a41034e0 2023-12-05T09:36:03.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.709+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a4105010 con 0x7f42a41034e0 2023-12-05T09:36:03.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.709+0000 7f4292ffd700 1 -- 172.21.15.67:0/3913959164 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f4298013590 con 0x7f42a41034e0 2023-12-05T09:36:03.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.711+0000 7f4292ffd700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f428c06ce70 0x7f428c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:03.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.711+0000 7f4292ffd700 1 -- 172.21.15.67:0/3913959164 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f429808d520 con 0x7f42a41034e0 2023-12-05T09:36:03.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.711+0000 7f42a259c700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f428c06ce70 0x7f428c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:03.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.712+0000 7f42a259c700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f428c06ce70 0x7f428c06f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4294004f60 tx=0x7f429400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:03.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.716+0000 7f4292ffd700 1 -- 172.21.15.67:0/3913959164 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4298057400 con 0x7f42a41034e0 2023-12-05T09:36:03.867 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:03 smithi067 ceph-mon[210894]: pgmap v199: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:36:03.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:03 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/1580882059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:36:03.868 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:03 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/2106392700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:36:03.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:03 smithi134 ceph-mon[172895]: pgmap v199: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2023-12-05T09:36:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:03 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/1580882059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-05T09:36:03.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:03 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/2106392700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-05T09:36:03.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.929+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f42a4064730 con 0x7f42a41034e0 2023-12-05T09:36:03.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.929+0000 7f4292ffd700 1 -- 172.21.15.67:0/3913959164 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v81) v1 ==== 107+0+11 (secure 0 0 0) 0x7f429805aa20 con 0x7f42a41034e0 2023-12-05T09:36:03.928 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-12-05T09:36:03.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f428c06ce70 msgr2=0x7f428c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f428c06ce70 0x7f428c06f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4294004f60 tx=0x7f429400b040 comp rx=0 tx=0).stop 2023-12-05T09:36:03.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 msgr2=0x7f42a4070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:03.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 0x7f42a4070480 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4298009360 tx=0x7f4298009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:03.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 shutdown_connections 2023-12-05T09:36:03.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a4102b40 0x7f42a406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f428c06ce70 0x7f428c06f320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 --2- 172.21.15.67:0/3913959164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f42a41034e0 0x7f42a4070480 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:03.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 >> 172.21.15.67:0/3913959164 conn(0x7f42a40f86d0 msgr2=0x7f42a40fa280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:03.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 shutdown_connections 2023-12-05T09:36:03.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:03.932+0000 7f42a8fff700 1 -- 172.21.15.67:0/3913959164 wait complete. 2023-12-05T09:36:03.949 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-05T09:36:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.150+0000 7f25d739d700 1 -- 172.21.15.67:0/3042463893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d0102930 msgr2=0x7f25d0102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:04.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.150+0000 7f25d739d700 1 --2- 172.21.15.67:0/3042463893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d0102930 0x7f25d0102d00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f25cc004940 tx=0x7f25cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.150+0000 7f25d739d700 1 -- 172.21.15.67:0/3042463893 shutdown_connections 2023-12-05T09:36:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.150+0000 7f25d739d700 1 --2- 172.21.15.67:0/3042463893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25d00fc8f0 0x7f25d00fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.150+0000 7f25d739d700 1 --2- 172.21.15.67:0/3042463893 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d0102930 0x7f25d0102d00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.150+0000 7f25d739d700 1 -- 172.21.15.67:0/3042463893 >> 172.21.15.67:0/3042463893 conn(0x7f25d00f8450 msgr2=0x7f25d00fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.150+0000 7f25d739d700 1 -- 172.21.15.67:0/3042463893 shutdown_connections 2023-12-05T09:36:04.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.150+0000 7f25d739d700 1 -- 172.21.15.67:0/3042463893 wait complete. 2023-12-05T09:36:04.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.151+0000 7f25d739d700 1 Processor -- start 2023-12-05T09:36:04.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.151+0000 7f25d739d700 1 -- start start 2023-12-05T09:36:04.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.151+0000 7f25d739d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d00fc8f0 0x7f25d006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:04.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.151+0000 7f25d739d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25d0102930 0x7f25d0070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:04.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.151+0000 7f25d739d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00709c0 con 0x7f25d00fc8f0 2023-12-05T09:36:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.151+0000 7f25d739d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0070b00 con 0x7f25d0102930 2023-12-05T09:36:04.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.151+0000 7f25d639b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d00fc8f0 0x7f25d006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25d639b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d00fc8f0 0x7f25d006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:48282/0 (socket says 172.21.15.67:48282) 2023-12-05T09:36:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25d639b700 1 -- 172.21.15.67:0/1772450446 learned_addr learned my addr 172.21.15.67:0/1772450446 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-12-05T09:36:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25d5b9a700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25d0102930 0x7f25d0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25d639b700 1 -- 172.21.15.67:0/1772450446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25d0102930 msgr2=0x7f25d0070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25d639b700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25d0102930 0x7f25d0070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:04.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25d639b700 1 -- 172.21.15.67:0/1772450446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc005040 con 0x7f25d00fc8f0 2023-12-05T09:36:04.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25d5b9a700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25d0102930 0x7f25d0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-05T09:36:04.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25d639b700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d00fc8f0 0x7f25d006ff40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009360 tx=0x7f25cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25c6ffd700 1 -- 172.21.15.67:0/1772450446 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25cc00e040 con 0x7f25d00fc8f0 2023-12-05T09:36:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25c6ffd700 1 -- 172.21.15.67:0/1772450446 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f25cc00bc50 con 0x7f25d00fc8f0 2023-12-05T09:36:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.152+0000 7f25c6ffd700 1 -- 172.21.15.67:0/1772450446 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25cc01c630 con 0x7f25d00fc8f0 2023-12-05T09:36:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.153+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d0070d80 con 0x7f25d00fc8f0 2023-12-05T09:36:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.153+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d0119870 con 0x7f25d00fc8f0 2023-12-05T09:36:04.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.154+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d0104db0 con 0x7f25d00fc8f0 2023-12-05T09:36:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.155+0000 7f25c6ffd700 1 -- 172.21.15.67:0/1772450446 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 39) v1 ==== 90936+0+0 (secure 0 0 0) 0x7f25cc013420 con 0x7f25d00fc8f0 2023-12-05T09:36:04.159 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.155+0000 7f25c6ffd700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f25bc06ce70 0x7f25bc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-05T09:36:04.160 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.156+0000 7f25c6ffd700 1 -- 172.21.15.67:0/1772450446 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f25cc08d650 con 0x7f25d00fc8f0 2023-12-05T09:36:04.160 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.156+0000 7f25d5b9a700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f25bc06ce70 0x7f25bc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-05T09:36:04.160 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.156+0000 7f25d5b9a700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f25bc06ce70 0x7f25bc06f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007fd0 tx=0x7f25c0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-05T09:36:04.160 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.160+0000 7f25c6ffd700 1 -- 172.21.15.67:0/1772450446 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f25cc057510 con 0x7f25d00fc8f0 2023-12-05T09:36:04.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.388+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25d004c3c0 con 0x7f25d00fc8f0 2023-12-05T09:36:04.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.388+0000 7f25c6ffd700 1 -- 172.21.15.67:0/1772450446 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v81) v1 ==== 81+0+2190 (secure 0 0 0) 0x7f25cc05ab30 con 0x7f25d00fc8f0 2023-12-05T09:36:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/3637826020 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/4207254869 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/2543364948 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/3666384983 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/266329309 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/181843478 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2057389438 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:04.387 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:6825/3151035948 2023-12-06T09:23:40.978176+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/3832644508 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/1356443197 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:6824/3151035948 2023-12-06T09:23:40.978176+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/3666384983 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3210428255 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3864088954 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2190646552 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/29053483 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6801/434315882 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:04.388 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2132118036 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3434626511 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/567071518 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/2543364948 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2889018783 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/2936759595 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/434315882 2023-12-06T09:19:26.041323+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/1356443197 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3189096558 2023-12-06T09:17:56.446884+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/4223108820 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:04.389 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:6828/1604582340 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/1134257028 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/440859058 2023-12-06T09:25:33.288852+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:6829/1604582340 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/2478780622 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.134:0/2776807637 2023-12-06T09:27:04.474771+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3754244083 2023-12-06T09:18:23.902584+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/3415963237 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:6800/3637826020 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:04.390 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67:0/1060895899 2023-12-06T09:30:30.716180+0000 2023-12-05T09:36:04.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f25bc06ce70 msgr2=0x7f25bc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:04.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f25bc06ce70 0x7f25bc06f320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007fd0 tx=0x7f25c0009040 comp rx=0 tx=0).stop 2023-12-05T09:36:04.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d00fc8f0 msgr2=0x7f25d006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-05T09:36:04.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d00fc8f0 0x7f25d006ff40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009360 tx=0x7f25cc009e30 comp rx=0 tx=0).stop 2023-12-05T09:36:04.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 shutdown_connections 2023-12-05T09:36:04.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:6800/4222876781,v1:172.21.15.67:6801/4222876781] conn(0x7f25bc06ce70 0x7f25bc06f320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:04.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f25d00fc8f0 0x7f25d006ff40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:04.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 --2- 172.21.15.67:0/1772450446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25d0102930 0x7f25d0070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-05T09:36:04.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 >> 172.21.15.67:0/1772450446 conn(0x7f25d00f8450 msgr2=0x7f25d0100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-05T09:36:04.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 shutdown_connections 2023-12-05T09:36:04.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-12-05T09:36:04.391+0000 7f25d739d700 1 -- 172.21.15.67:0/1772450446 wait complete. 2023-12-05T09:36:04.393 INFO:teuthology.orchestra.run.smithi067.stderr:listed 37 entries 2023-12-05T09:36:04.407 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-05T09:36:04.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:04.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-05T09:36:04.506 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2023-12-05T09:36:04.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:04.507 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-05T09:36:04.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:04.600 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-12-05T09:36:04.705 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-05T09:36:04.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:04.707 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-05T09:36:04.804 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:04 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/2053311675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T09:36:04.804 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:04 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/3913959164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T09:36:04.804 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:04 smithi067 ceph-mon[210894]: from='client.? 172.21.15.67:0/1772450446' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T09:36:04.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:04.817 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-12-05T09:36:04.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:04 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/2053311675' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-05T09:36:04.876 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:04 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/3913959164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-05T09:36:04.877 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:04 smithi134 ceph-mon[172895]: from='client.? 172.21.15.67:0/1772450446' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-05T09:36:04.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:04.936 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2023-12-05T09:36:04.985 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-05T09:36:04.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:04.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-05T09:36:05.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-05T09:36:05.061 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2023-12-05T09:36:05.187 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-05T09:36:05.200 INFO:tasks.cephadm:Teardown begin 2023-12-05T09:36:05.200 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:36:05.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:36:05.353 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-05T09:36:05.354 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-05T09:36:05.400 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-05T09:36:05.447 INFO:tasks.cephadm:Stopping all daemons... 2023-12-05T09:36:05.447 INFO:tasks.cephadm.mon.smithi067:Stopping mon.smithi067... 2023-12-05T09:36:05.448 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067 2023-12-05T09:36:05.529 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:05 smithi067 ceph-mon[210894]: pgmap v200: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:36:05.628 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:05 smithi134 ceph-mon[172895]: pgmap v200: 65 pgs: 65 active+clean; 330 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2023-12-05T09:36:05.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:05 smithi067 systemd[1]: Stopping Ceph mon.smithi067 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:36:05.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:05 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067[210871]: 2023-12-05T09:36:05.786+0000 7fefe180e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi067 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:36:05.796 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:05 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067[210871]: 2023-12-05T09:36:05.786+0000 7fefe180e700 -1 mon.smithi067@0(leader) e3 *** Got Signal Terminated *** 2023-12-05T09:36:06.436 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Dec 05 09:36:06 smithi067 bash[248196]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi067 2023-12-05T09:36:06.467 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi067.service' 2023-12-05T09:36:06.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T09:36:06.569 INFO:tasks.cephadm.mon.smithi067:Stopped mon.smithi067 2023-12-05T09:36:06.569 INFO:tasks.cephadm.mon.smithi134:Stopping mon.smithi134... 2023-12-05T09:36:06.570 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi134 2023-12-05T09:36:06.931 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:06 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:36:07.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:06 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi134[172872]: 2023-12-05T09:36:06.931+0000 7fa936fff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:36:07.227 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:06 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi134[172872]: 2023-12-05T09:36:06.931+0000 7fa936fff700 -1 mon.smithi134@1(peon) e3 *** Got Signal Terminated *** 2023-12-05T09:36:07.508 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Dec 05 09:36:07 smithi134 bash[204407]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-mon-smithi134 2023-12-05T09:36:07.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@mon.smithi134.service' 2023-12-05T09:36:07.631 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T09:36:07.632 INFO:tasks.cephadm.mon.smithi134:Stopped mon.smithi134 2023-12-05T09:36:07.632 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-05T09:36:07.632 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.0 2023-12-05T09:36:07.967 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:36:07 smithi067 systemd[1]: Stopping Ceph osd.0 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:36:08.367 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:36:07 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[224840]: 2023-12-05T09:36:07.969+0000 7fbbf42ae700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:36:08.367 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:36:07 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[224840]: 2023-12-05T09:36:07.969+0000 7fbbf42ae700 -1 osd.0 81 *** Got signal Terminated *** 2023-12-05T09:36:08.368 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:36:07 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0[224840]: 2023-12-05T09:36:07.969+0000 7fbbf42ae700 -1 osd.0 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:36:13.868 INFO:journalctl@ceph.osd.0.smithi067.stdout:Dec 05 09:36:13 smithi067 bash[248354]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-0 2023-12-05T09:36:14.984 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.0.service' 2023-12-05T09:36:15.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T09:36:15.078 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-05T09:36:15.078 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-05T09:36:15.079 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.1 2023-12-05T09:36:15.368 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:36:15 smithi067 systemd[1]: Stopping Ceph osd.1 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:36:15.867 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:36:15 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[232098]: 2023-12-05T09:36:15.408+0000 7effefa34700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:36:15.868 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:36:15 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[232098]: 2023-12-05T09:36:15.409+0000 7effefa34700 -1 osd.1 81 *** Got signal Terminated *** 2023-12-05T09:36:15.868 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:36:15 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1[232098]: 2023-12-05T09:36:15.409+0000 7effefa34700 -1 osd.1 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:36:21.118 INFO:journalctl@ceph.osd.1.smithi067.stdout:Dec 05 09:36:20 smithi067 bash[248628]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-1 2023-12-05T09:36:22.365 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.1.service' 2023-12-05T09:36:22.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T09:36:22.458 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-05T09:36:22.459 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-05T09:36:22.459 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.2 2023-12-05T09:36:22.618 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:36:22 smithi067 systemd[1]: Stopping Ceph osd.2 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:36:23.117 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:36:22 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[238608]: 2023-12-05T09:36:22.792+0000 7f7075ce1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:36:23.118 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:36:22 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[238608]: 2023-12-05T09:36:22.792+0000 7f7075ce1700 -1 osd.2 81 *** Got signal Terminated *** 2023-12-05T09:36:23.118 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:36:22 smithi067 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2[238608]: 2023-12-05T09:36:22.792+0000 7f7075ce1700 -1 osd.2 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:36:28.618 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:36:28 smithi067 bash[248887]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-2 2023-12-05T09:36:29.710 DEBUG:teuthology.orchestra.run.smithi067:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.2.service' 2023-12-05T09:36:29.775 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:36:29 smithi067 systemd[1]: ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.2.service: Succeeded. 2023-12-05T09:36:29.776 INFO:journalctl@ceph.osd.2.smithi067.stdout:Dec 05 09:36:29 smithi067 systemd[1]: Stopped Ceph osd.2 for f6a41352-934e-11ee-95a2-87774f69a715. 2023-12-05T09:36:29.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T09:36:29.802 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-05T09:36:29.802 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-05T09:36:29.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.3 2023-12-05T09:36:30.126 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:36:29 smithi134 systemd[1]: Stopping Ceph osd.3 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:36:30.626 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:36:30 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[185598]: 2023-12-05T09:36:30.159+0000 7fec5fc1f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:36:30.626 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:36:30 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[185598]: 2023-12-05T09:36:30.159+0000 7fec5fc1f700 -1 osd.3 81 *** Got signal Terminated *** 2023-12-05T09:36:30.627 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:36:30 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3[185598]: 2023-12-05T09:36:30.159+0000 7fec5fc1f700 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:36:34.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:34 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:34.100+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:35.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:35 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:35.110+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:35.689 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:35 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:35.433+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:11.711131+0000 front 2023-12-05T09:36:11.711202+0000 (oldest deadline 2023-12-05T09:36:35.210898+0000) 2023-12-05T09:36:36.103 INFO:journalctl@ceph.osd.3.smithi134.stdout:Dec 05 09:36:35 smithi134 bash[204552]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-3 2023-12-05T09:36:36.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:36 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:36.105+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:36.801 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:36 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:36.430+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:11.711131+0000 front 2023-12-05T09:36:11.711202+0000 (oldest deadline 2023-12-05T09:36:35.210898+0000) 2023-12-05T09:36:37.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.3.service' 2023-12-05T09:36:37.206 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T09:36:37.206 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-05T09:36:37.206 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-05T09:36:37.206 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.4 2023-12-05T09:36:37.376 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:37 smithi134 systemd[1]: Stopping Ceph osd.4 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:36:37.377 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:37 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:37.122+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:37.876 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:37 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:37.394+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:11.711131+0000 front 2023-12-05T09:36:11.711202+0000 (oldest deadline 2023-12-05T09:36:35.210898+0000) 2023-12-05T09:36:37.877 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:37 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:37.559+0000 7fe03c214700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:36:37.877 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:37 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:37.559+0000 7fe03c214700 -1 osd.4 81 *** Got signal Terminated *** 2023-12-05T09:36:37.877 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:37 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:37.559+0000 7fe03c214700 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:36:38.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:38 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:38.085+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:38.876 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:38 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:38.404+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:11.711131+0000 front 2023-12-05T09:36:11.711202+0000 (oldest deadline 2023-12-05T09:36:35.210898+0000) 2023-12-05T09:36:39.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:39 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:39.042+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:39.876 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:39 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:39.429+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:11.711131+0000 front 2023-12-05T09:36:11.711202+0000 (oldest deadline 2023-12-05T09:36:35.210898+0000) 2023-12-05T09:36:40.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:40 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:40.005+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:40.877 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:40 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:40.470+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:11.711131+0000 front 2023-12-05T09:36:11.711202+0000 (oldest deadline 2023-12-05T09:36:35.210898+0000) 2023-12-05T09:36:41.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:40 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:40.995+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:41.876 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:41 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:41.461+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:11.711131+0000 front 2023-12-05T09:36:11.711202+0000 (oldest deadline 2023-12-05T09:36:35.210898+0000) 2023-12-05T09:36:41.876 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:41 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:41.461+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:15.211394+0000 front 2023-12-05T09:36:15.211416+0000 (oldest deadline 2023-12-05T09:36:41.012010+0000) 2023-12-05T09:36:42.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:42 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:42.027+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:42.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:42 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:42.027+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:42.876 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:42 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:42.431+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:11.711131+0000 front 2023-12-05T09:36:11.711202+0000 (oldest deadline 2023-12-05T09:36:35.210898+0000) 2023-12-05T09:36:42.876 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:42 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4[192152]: 2023-12-05T09:36:42.431+0000 7fe03800e700 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:15.211394+0000 front 2023-12-05T09:36:15.211416+0000 (oldest deadline 2023-12-05T09:36:41.012010+0000) 2023-12-05T09:36:43.378 INFO:journalctl@ceph.osd.4.smithi134.stdout:Dec 05 09:36:43 smithi134 bash[204818]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-4 2023-12-05T09:36:43.378 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:43 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:43.072+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:43.378 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:43 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:43.072+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:44.126 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:44 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:44.064+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:44.127 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:44 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:44.064+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:44.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.4.service' 2023-12-05T09:36:44.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T09:36:44.751 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-05T09:36:44.751 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-05T09:36:44.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.5 2023-12-05T09:36:45.058 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:44 smithi134 systemd[1]: Stopping Ceph osd.5 for f6a41352-934e-11ee-95a2-87774f69a715... 2023-12-05T09:36:45.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:45 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:45.060+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:45.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:45 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:45.060+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:45.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:45 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:45.075+0000 7fec66c7c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-05T09:36:45.377 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:45 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:45.075+0000 7fec66c7c700 -1 osd.5 81 *** Got signal Terminated *** 2023-12-05T09:36:45.377 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:45 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:45.075+0000 7fec66c7c700 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-05T09:36:46.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:46 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:46.077+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:46.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:46 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:46.077+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:47.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:47 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:47.059+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:47.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:47 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:47.059+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:48.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:48 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:48.028+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:48.377 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:48 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:48.028+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:49.377 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:49 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:49.030+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:49.378 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:49 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:49.030+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:49.378 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:49 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:49.030+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6822 osd.2 since back 2023-12-05T09:36:27.072114+0000 front 2023-12-05T09:36:27.072079+0000 (oldest deadline 2023-12-05T09:36:48.171854+0000) 2023-12-05T09:36:50.376 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:50 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:50.001+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6806 osd.0 since back 2023-12-05T09:36:08.369578+0000 front 2023-12-05T09:36:08.369419+0000 (oldest deadline 2023-12-05T09:36:33.669531+0000) 2023-12-05T09:36:50.377 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:50 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:50.001+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6814 osd.1 since back 2023-12-05T09:36:17.770569+0000 front 2023-12-05T09:36:17.770533+0000 (oldest deadline 2023-12-05T09:36:41.770897+0000) 2023-12-05T09:36:50.377 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:50 smithi134 ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5[198855]: 2023-12-05T09:36:50.001+0000 7fec62275700 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.67:6822 osd.2 since back 2023-12-05T09:36:27.072114+0000 front 2023-12-05T09:36:27.072079+0000 (oldest deadline 2023-12-05T09:36:48.171854+0000) 2023-12-05T09:36:50.876 INFO:journalctl@ceph.osd.5.smithi134.stdout:Dec 05 09:36:50 smithi134 bash[205081]: ceph-f6a41352-934e-11ee-95a2-87774f69a715-osd-5 2023-12-05T09:36:51.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f6a41352-934e-11ee-95a2-87774f69a715@osd.5.service' 2023-12-05T09:36:52.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-05T09:36:52.090 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-05T09:36:52.090 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f6a41352-934e-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-05T09:37:15.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f6a41352-934e-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-05T09:37:24.657 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:37:24.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-05T09:37:24.814 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-05T09:37:24.815 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420/remote/smithi067/crash 2023-12-05T09:37:24.816 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/crash -- . 2023-12-05T09:37:24.889 INFO:teuthology.orchestra.run.smithi067.stderr:tar: /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-05T09:37:24.889 INFO:teuthology.orchestra.run.smithi067.stderr:tar: Error is not recoverable: exiting now 2023-12-05T09:37:24.892 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420/remote/smithi134/crash 2023-12-05T09:37:24.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/crash -- . 2023-12-05T09:37:24.961 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/f6a41352-934e-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-05T09:37:24.961 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2023-12-05T09:37:24.964 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-05T09:37:24.964 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-05T09:37:25.044 INFO:teuthology.orchestra.run.smithi067.stderr:grep: /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph.log: No such file or directory 2023-12-05T09:37:25.048 INFO:tasks.cephadm:Compressing logs... 2023-12-05T09:37:25.049 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T09:37:25.053 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-05T09:37:25.118 INFO:teuthology.orchestra.run.smithi067.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-05T09:37:25.118 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-05T09:37:25.119 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi067.kyspon.log 2023-12-05T09:37:25.120 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-05T09:37:25.121 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi067.kyspon.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-05T09:37:25.122 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-05T09:37:25.122 INFO:teuthology.orchestra.run.smithi134.stderr:: No such file or directory 2023-12-05T09:37:25.122 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mgr.smithi067.alxtvv.log 2023-12-05T09:37:25.123 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-05T09:37:25.124 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-05T09:37:25.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi134.vvbmln.log 2023-12-05T09:37:25.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-volume.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-05T09:37:25.126 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-05T09:37:25.129 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mgr.smithi067.alxtvv.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi067.qaibsa.log 2023-12-05T09:37:25.129 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mon.smithi067.log 2023-12-05T09:37:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi134.vvbmln.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi134.vmnpaq.log 2023-12-05T09:37:25.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mon.smithi134.log 2023-12-05T09:37:25.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi134.vmnpaq.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-05T09:37:25.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mon.smithi134.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-05T09:37:25.131 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi067.qaibsa.log: /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mon.smithi067.log: gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-05T09:37:25.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.4.log: 94.2% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi134.vmnpaq.log.gz 2023-12-05T09:37:25.133 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mgr.smithi134.yfqkak.log 2023-12-05T09:37:25.135 INFO:teuthology.orchestra.run.smithi067.stderr: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-05T09:37:25.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.5.log: 91.4% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi134.vvbmln.log.gz 2023-12-05T09:37:25.138 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.1.log: 90.9% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-05T09:37:25.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mgr.smithi134.yfqkak.log: 90.9% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-05T09:37:25.190 INFO:teuthology.orchestra.run.smithi134.stderr: 88.7% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mgr.smithi134.yfqkak.log.gz 2023-12-05T09:37:25.419 INFO:teuthology.orchestra.run.smithi134.stderr: 92.4% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mon.smithi134.log.gz 2023-12-05T09:37:25.459 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mgr.smithi067.alxtvv.log.gz 2023-12-05T09:37:25.812 INFO:teuthology.orchestra.run.smithi067.stderr: 90.7% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mon.smithi067.log.gz 2023-12-05T09:37:29.330 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-05T09:37:29.384 INFO:teuthology.orchestra.run.smithi067.stderr: 93.4% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-05T09:37:30.394 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-05T09:37:30.549 INFO:teuthology.orchestra.run.smithi067.stderr: 93.4% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-05T09:37:31.030 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-05T09:37:31.034 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-05T09:37:31.035 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m5.936s 2023-12-05T09:37:31.035 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m14.504s 2023-12-05T09:37:31.035 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m1.302s 2023-12-05T09:37:31.401 INFO:teuthology.orchestra.run.smithi067.stderr: 93.3% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-05T09:38:09.443 INFO:teuthology.orchestra.run.smithi067.stderr: 93.1% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi067.qaibsa.log.gz 2023-12-05T09:38:20.372 INFO:teuthology.orchestra.run.smithi067.stderr: 92.9% -- replaced with /var/log/ceph/f6a41352-934e-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi067.kyspon.log.gz 2023-12-05T09:38:20.374 INFO:teuthology.orchestra.run.smithi067.stderr: 2023-12-05T09:38:20.375 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m55.282s 2023-12-05T09:38:20.375 INFO:teuthology.orchestra.run.smithi067.stderr:user 1m48.636s 2023-12-05T09:38:20.375 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m7.992s 2023-12-05T09:38:20.376 INFO:tasks.cephadm:Archiving logs... 2023-12-05T09:38:20.376 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420/remote/smithi067/log 2023-12-05T09:38:20.377 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-05T09:38:38.026 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420/remote/smithi134/log 2023-12-05T09:38:38.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-05T09:38:40.571 INFO:tasks.cephadm:Removing cluster... 2023-12-05T09:38:40.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f6a41352-934e-11ee-95a2-87774f69a715 --force 2023-12-05T09:38:41.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f6a41352-934e-11ee-95a2-87774f69a715 --force 2023-12-05T09:38:42.544 INFO:tasks.cephadm:Removing cephadm ... 2023-12-05T09:38:42.544 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-05T09:38:42.596 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-05T09:38:42.642 INFO:tasks.cephadm:Teardown complete 2023-12-05T09:38:42.643 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-05T09:38:42.655 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-05T09:38:42.655 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-05T09:38:42.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-05T09:38:42.805 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-05T09:38:42.816 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-05T09:38:42.817 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T09:38:42.822 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-05T09:38:42.862 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2023-12-05T09:38:42.866 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2023-12-05T09:38:42.870 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T09:38:42.870 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2023-12-05T09:38:42.871 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 120 +1048us[+1116us] +/- 99ms 2023-12-05T09:38:42.871 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 +350us[ +420us] +/- 53ms 2023-12-05T09:38:42.871 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -2355us[-2355us] +/- 126ms 2023-12-05T09:38:42.871 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:38:42.876 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-05T09:38:42.876 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2023-12-05T09:38:42.876 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +1092us[+1174us] +/- 100ms 2023-12-05T09:38:42.876 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 +400us[ +482us] +/- 53ms 2023-12-05T09:38:42.877 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -2312us[-2230us] +/- 126ms 2023-12-05T09:38:42.877 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-05T09:38:42.877 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-05T09:38:42.892 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-05T09:38:42.893 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-05T09:38:42.904 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-05T09:38:43.092 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-05T09:38:43.263 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T09:38:43.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:38:43.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-05T09:38:43.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:38:43.420 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-05T09:38:43.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-05T09:38:43.452 INFO:teuthology.task.internal:Duration was 2421.223555 seconds 2023-12-05T09:38:43.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-05T09:38:43.464 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-05T09:38:43.464 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-05T09:38:43.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-05T09:38:43.585 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T09:38:43.586 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-05T09:38:43.907 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-05T09:38:43.908 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2023-12-05T09:38:43.908 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-05T09:38:43.971 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2023-12-05T09:38:43.971 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-05T09:38:44.032 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-05T09:38:44.033 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-05T09:38:44.037 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-05T09:38:44.142 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-05T09:38:44.142 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-05T09:38:44.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-05T09:38:44.327 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-05T09:38:44.339 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-05T09:38:44.340 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-05T09:38:44.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-05T09:38:44.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-05T09:38:44.494 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-05T09:38:44.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-05T09:38:44.566 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2023-12-05T09:38:44.573 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2023-12-05T09:38:44.607 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-05T09:38:44.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:38:44.652 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-05T09:38:44.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-05T09:38:44.696 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-05T09:38:44.710 INFO:teuthology.task.internal:Transferring archived files... 2023-12-05T09:38:44.711 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420/remote/smithi067 2023-12-05T09:38:44.711 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-05T09:38:44.803 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420/remote/smithi134 2023-12-05T09:38:44.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-05T09:38:44.891 INFO:teuthology.task.internal:Removing archive directory... 2023-12-05T09:38:44.891 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-05T09:38:44.896 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-05T09:38:44.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-05T09:38:44.959 INFO:teuthology.task.internal:Not uploading archives. 2023-12-05T09:38:44.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-05T09:38:44.974 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-05T09:38:44.975 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-05T09:38:44.983 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-05T09:38:45.025 INFO:teuthology.orchestra.run.smithi067.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 5 09:38 /home/ubuntu/cephtest 2023-12-05T09:38:45.029 INFO:teuthology.orchestra.run.smithi134.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 5 09:38 /home/ubuntu/cephtest 2023-12-05T09:38:45.033 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-05T09:38:45.046 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-05T09:38:45.072 INFO:teuthology.nuke:Checking targets against current locks 2023-12-05T09:38:45.097 DEBUG:teuthology.nuke:shortname: smithi067 2023-12-05T09:38:45.097 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T09:38:45.117 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 08:36:37.496653', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHS5jYZtkjceRfwHtaU358dFtA0mrMxKQT2N74/VgBaOxYtnZDjJnvcjAacIyr2mfVHUguQyetFGXXUbzfMPok='} 2023-12-05T09:38:45.119 DEBUG:teuthology.nuke:shortname: smithi134 2023-12-05T09:38:45.119 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T09:38:45.137 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-05_08:35:01-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7477420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 08:36:37.495001', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAC7aCyhiG4JoyuAzxJcXfUai0Jgy4lYZHbdRum0UriSKq17r0+2aQsqL+Yadq9Bfab5OJ5FxbN1nQIu2RnnTX0='} 2023-12-05T09:38:45.166 INFO:teuthology.orchestra.console.smithi067:Power off 2023-12-05T09:38:45.167 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:38:45.193 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-12-05T09:38:45.194 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:38:45.218 INFO:teuthology.orchestra.console.smithi134:Power off 2023-12-05T09:38:45.218 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T09:38:45.230 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-12-05T09:38:45.247 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-12-05T09:38:45.247 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:38:45.291 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-05T09:38:49.232 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:38:49.292 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:38:49.345 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-12-05T09:38:49.402 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-05T09:38:53.350 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:38:53.403 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T09:38:53.461 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-12-05T09:38:53.513 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-05T09:38:53.562 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-12-05T09:38:53.614 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-12-05T09:38:53.720 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2421.2235548496246 failure_reason: 'Command failed on smithi067 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a41352-934e-11ee-95a2-87774f69a715 -e sha1=3fe8d441c2f973bfe963ba4dd30ba8eac9f36227 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default host.a-kernel-sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae host.b-kernel-sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae owner: mchangir sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7570eb2c5fb0497bad2885a523f0f427 status: fail success: false 2023-12-05T09:38:53.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T09:38:53.806 INFO:teuthology.run:FAIL